Virtual space control system, virtual space control method, and program

Abstract

A virtual space control system 1 causes an information terminal device 50 to display a virtual space and to display an avatar corresponding to a user in the displayed virtual space. An information processing device 50 included in the virtual space control system 1 performs, on a display screen of a first information terminal device with which a first user has logged in to the virtual space, display for showing a second avatar at a position that is exposed without being hidden by information displayed on the display screen when it is detected that, in the virtual space, a second avatar corresponding to a second user is in an information sharing range of a first avatar corresponding to the first user or is in an approaching state in which the probability of entry thereto is high.

Description

Virtual space control system, virtual space control method and program

[0001] The present invention relates to a virtual space control system, a virtual space control method, and a program.

[0002] 2. Description of the Related Art There is known a technology relating to a virtual office configured in a virtual space, in which each user uses an avatar to carry out work or the like in the virtual office (see, for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2022-071314

[0004] In a virtual space such as a virtual office, when multiple avatars are close to each other in the virtual space or exist in the same space, an information sharing function is known that allows the users to hear each other's voices. Because avatar users display the virtual space on the display screen of their information terminal devices, depending on the nature of their work, the window displaying the virtual space may be minimized or displayed behind another window. In such a situation, users may not notice that another user's avatar is approaching.

[0005] The present disclosure aims to appropriately notify a user in a virtual space that an avatar of another user is approaching.

[0006] In order to solve the above-mentioned problems and achieve the objectives, the virtual space control system of the present disclosure is a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user in the displayed virtual space, and when the information processing device provided in the virtual space control system detects that a second avatar corresponding to a second user has entered the information sharing range of a first avatar corresponding to a first user in the virtual space, or is in a close proximity state in which the second avatar is likely to enter, the information processing device displays the second avatar on the display screen of the first information terminal device on which the first user is logged in to the virtual space, in a position that is exposed and not hidden by information displayed on the display screen.

[0007] The virtual space control method of the present disclosure is a virtual space control method executed by a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user in the displayed virtual space, and when it detects that a second avatar corresponding to a second user has entered the information sharing range of a first avatar corresponding to a first user in the virtual space, or is in a close proximity state where the second avatar is likely to enter, the second avatar is displayed on the display screen of a first information terminal device on which the first user is logged in to the virtual space, in a position where it is exposed and not hidden by information displayed on the display screen.

[0008] The program of the present disclosure causes a computer that controls a space sharing system to perform the following operation: when it detects that a second avatar corresponding to a second user has entered the information sharing range of a first avatar corresponding to a first user in a virtual space, or is in a state of proximity where the second avatar is likely to enter the information sharing range of the first avatar corresponding to a first user, the program causes the computer to display the second avatar on the display screen of a first information terminal device on which the first user is logged in to the virtual space, in a position where it is exposed and not hidden by information displayed on the display screen.

[0009] According to the present disclosure, a user can be appropriately notified that another user's avatar is approaching in a virtual space.

[0010] FIG. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to a first embodiment. FIG. 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. FIG. 4 is a block diagram showing an example of the configuration of an information processing device according to the first embodiment. FIG. 5 is a diagram showing an example of a display screen of an information terminal device according to the first embodiment. FIG. 6 is a diagram showing an example of a virtual office window displayed on the display screen of FIG. 5. FIG. 7 is a diagram showing another example of the display screen of an information terminal device according to the first embodiment. FIG. 8 is a flowchart showing an example of a virtual space control method according to the first embodiment. FIG. 9 is a flowchart showing another example of a virtual space control method according to the first embodiment. FIG. 10 is a diagram showing an example of a display screen of an information terminal device according to a second embodiment. FIG. 11 is a diagram showing another example of a display screen of an information terminal device according to the second embodiment. FIG. 12 is a flowchart showing an example of a virtual space control method according to the second embodiment. FIG. 13 is a flowchart showing another example of a virtual space control method according to the second embodiment.

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A virtual space control system, a virtual space control method, and a program according to the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0012] [First embodiment] (Virtual space control system) Fig. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to a first embodiment. The virtual space control system 1 controls a virtual office configured in a virtual space. In the following embodiment, a virtual office will be described as an example, but the present invention is not limited to virtual offices and can also be applied to various services that use avatars for communication in a virtual space.

[0013] An overview of the virtual office controlled by the virtual space control system 1 will be described. A user uses an information terminal device to come into (log in to) the virtual office using their own account and perform work. In the virtual office, an avatar associated with the user is set. When a user logs in to the virtual office using their own information terminal device 10 (described later), the avatar moves to any seat in the virtual office or to a predetermined seat, and the user operates and displays the avatar to sit down. The user can operate the avatar to move around the virtual office. In the virtual office, for example, when avatars are close to each other in the virtual office or when avatars are located in the same space, such as a conference room, they can share information such that they can hear each other's voices.

[0014] The virtual space control system 1 includes an information terminal device 10 that each user uses for business purposes, and a server device 30 .

[0015] (Information Terminal Device) Fig. 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. The information terminal device 10 is a terminal device used by a user who performs work in a virtual office. The information terminal device 10 is a terminal device on which the user executes a virtual office application. The information terminal device 10 is a terminal device that the user uses to log in to the virtual office using their own account when logging in to the virtual office.

[0016] The information terminal device 10 is, for example, an information terminal device such as a general-purpose personal computer, a smartphone, or a tablet terminal. The information terminal device 10 is connected to the server device 30 via a network so as to be able to communicate data with the server device 30.

[0017] The information terminal device 10 acquires account user information of the information terminal device 10 based on the account information of the person who is logged in to the information terminal device 10 .

[0018] The information terminal device 10 includes a camera 11 , a microphone 12 , an operation unit 13 , a display unit 17 , an audio output unit 18 , a communication unit 19 , and a terminal control device 20 .

[0019] The camera 11 captures an image in a direction facing the information terminal device 10. The camera 11 is disposed at a position where it captures an image in a direction facing the display unit 17 of the information terminal device 10. In other words, the camera 11 captures an image in a direction in which a person using the information terminal device 10 is present. The camera 11 is disposed, for example, near the display unit 17. The camera 11 outputs the captured image to the image acquisition unit 21 of the terminal control device 20.

[0020] The microphone 12 picks up sounds around the information terminal device 10. The microphone 12 may pick up sounds from the direction facing the display unit 17 of the information terminal device 10, or may be provided in a headset connected to the information terminal device 10. In other words, the microphone 12 picks up sounds spoken by the person using the information terminal device 10 and sounds from the surrounding area. The microphone 12 outputs audio information related to the picked-up sounds to the audio acquisition unit 22 of the terminal control device 20.

[0021] The operation unit 13 is an input device capable of inputting various operations to the information terminal device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the terminal control device 20. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel overlaid on the display unit 17, buttons, switches, etc. The operation unit 13 can accept, for example, a key input operation, a click operation, or a touch operation.

[0022] The operation unit 13 can accept operations such as moving an avatar corresponding to the user in the virtual office in any direction on the display screen of the display unit 17. For example, the operation unit 13 accepts operations such as overlapping or placing the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0023] By placing one's avatar on top of another or adjacent to another avatar, a user can initiate a video or voice call in the virtual office application. Whether a video or voice call will be conducted may be preset or may be set by the user.

[0024] The display unit 17 displays various types of video including text and images. The display unit 17 is, for example, a display including a liquid crystal display, an organic electroluminescence (EL) display, etc. The display unit 17 displays a video of a virtual office. In this embodiment, when a video call becomes possible, the display unit 17 outputs a video of the user of another avatar with whom the video call is being made, in other words, a video captured by the camera 11 of the information terminal device 10 used by the user of the other avatar. The display on the display unit 17 is controlled by the display control unit 27.

[0025] The audio output unit 18 is an audio output device that outputs audio from the virtual office. In this embodiment, when the user is using the virtual office, the audio output unit 18 outputs audio around the user's own avatar. When a voice call or video call becomes possible, the audio output unit 18 also outputs the audio of the user of another avatar with whom the user is making the voice call or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the user of the avatar. The audio output of the audio output unit 18 is controlled by an audio output control unit 28.

[0026] The communication unit 19 is a communication unit for performing wired communication or wireless communication. The communication unit 19 performs communication using a communication method using, for example, Wi-Fi (registered trademark) or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 19 is controlled by a communication control unit 29. The communication unit 19 communicates data such as video and audio with the server device 30. The communication unit 19 communicates data such as account user information of the information terminal device 10 and application operation status information with the server device 30.

[0027] (Terminal Control Device) The terminal control device 20 controls each unit of the information terminal device 10. The terminal control device 20 has, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to the present disclosure. The terminal control device 20 may be realized by an integrated circuit such as an ASIC or FPGA. The terminal control device 20 loads a stored program into memory and executes instructions included in the program. The terminal control device 20 includes an internal memory such as the RAM described above, which is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be realized by a combination of hardware and software.

[0028] The terminal control device 20 has functional blocks realized by circuits and executed programs, including a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a memory unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0029] The video acquisition unit 21 acquires video captured by the camera 11. More specifically, the video acquisition unit 21 acquires video captured by the camera 11 of a person facing the information terminal device 10, etc. The video data acquired by the camera 11 is a moving image.

[0030] The voice acquisition unit 22 acquires voice detected by the microphone 12. The voice acquisition unit 22 acquires voice such as voice spoken by a person present in the vicinity of the information terminal device 10.

[0031] The operation reception unit 23 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0032] The operation accepting unit 23 accepts operations on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to move the user's own avatar in the virtual office on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to overlap or place the user's own avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0033] The application control unit 24 controls the operation of various applications executed on the information terminal device 10. The applications executed by the application control unit 24 may cooperate with an application control unit 42 of the server device 30, which will be described later, to control the various applications.

[0034] The application control unit 24 causes a display control unit 27 (described later) to display on the display unit 17 a display related to an application running on the information terminal device 10. The display related to the application is a window, an icon, or the like that shows the display related to the application to the user of the information terminal device 10.

[0035] When the user of the information terminal device 10 is logged in to the virtual office, the application control unit 24 makes the virtual office executed by the application control unit 42 of the server device 30 available on the information terminal device 10. Furthermore, based on an instruction from the application control unit 42 of the server device 30, the application control unit 24 displays other avatars in an exposed position that is not hidden by information displayed on the display screen of the display unit 17.

[0036] When a virtual office application is being executed on the information terminal device 10, the application control unit 24 shares information using the display control unit 27 and the audio output control unit 28 based on an information sharing range set around an avatar corresponding to the user of the information terminal device 10. Furthermore, when a video call with an avatar corresponding to another user is started while the virtual office application is being executed on the information terminal device 10, the application control unit 24 performs the video call using the display control unit 27 and the audio output control unit 28.

[0037] The application control unit 24 causes the communication control unit 29 to transmit the display state of the window displaying the virtual office on the display unit 17 of the information terminal device 10 to the server device 30. The display state of the window displaying the virtual office is information indicating whether the window displaying the virtual office is being displayed appropriately on the display unit 17.

[0038] A state in which the window displaying the virtual office is properly displayed means a state in which the window displaying the virtual office is not hidden behind information such as other windows, and is displayed in a manner that allows the user of the information terminal device 10 to see other avatars that exist around the user's avatar. Even if a portion of the window displaying the virtual office is hidden by information such as other windows, the window displaying the virtual office may be considered to be properly displayed as long as the range in which the user of the information terminal device 10 can see other avatars that exist around the user's avatar is displayed.

[0039] A state in which the window displaying the virtual office is not properly displayed means that the window displaying the virtual office is hidden behind information such as other windows, and the user of the information terminal device 10 cannot see other avatars that exist around the user's avatar. In this case, the window displaying the virtual office is not properly displayed when the window displaying the virtual office is completely hidden by information such as other windows, or when it is partially hidden by information such as other windows, and the user of the information terminal device 10 cannot see other avatars that exist around the user's avatar. Furthermore, a state in which the window displaying the virtual office is not properly displayed also occurs when the window displaying the virtual office is minimized by an operation by the user of the information terminal device 10, for example.

[0040] The application control unit 24 grasps the position and information sharing range of each avatar in the virtual office, and detects whether another avatar has entered the information sharing range of any avatar, or whether there is a high possibility that another avatar will enter the information sharing range of any avatar.

[0041] The storage unit 26 stores information such as the calculation contents and programs of the terminal control device 20. The storage unit 26 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or HDD (Hard Disk Drive).

[0042] The storage unit 26 stores programs and setting information relating to applications used in the information terminal device 10, such as a virtual office application.

[0043] The following describes the information sharing range and information sharing set for avatars in a virtual office. In the virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and is the range in which information can be shared between multiple users who are included in the information sharing range. One example of information sharing in the information sharing range is mutual sharing of audio. In other words, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Furthermore, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Information that can be shared in the information sharing range is not limited to audio, but also includes other information such as video and text. In this embodiment, the information sharing range is described as an example in which audio is shared.

[0044] For example, when a second avatar enters the information sharing range of a first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Furthermore, when a second avatar enters the information sharing range of a first avatar and a first avatar enters the information sharing range of the second avatar, two-way voice sharing allows each user to sense the other's presence and enables conversation without any special operations. Therefore, the information sharing range can also be referred to as the voice sharing range. Specifically, when a first avatar and a second avatar are within each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar can be heard in the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar can be heard in the information terminal device 10 used by the first user.

[0045] It is also possible to set up a space that allows information sharing among all avatars within a specific range, such as a conference room set up in a virtual office. Outside of such a set space, the information sharing range is set for each avatar.

[0046] The information sharing range of each avatar is set to an initial size and shape when the user starts using the virtual office. The size and shape of the information sharing range of each avatar may be changeable by a user operation.

[0047] The display control unit 27 controls the display of various images on the display unit 17. The display control unit 27 controls the display of an image of the virtual office on the display unit 17. In this embodiment, when the information to be shared includes an image or text, the display control unit 27 outputs the image or text to the display unit 17. Furthermore, when a video call becomes possible, the display control unit 27 outputs an image of the user's avatar in the virtual office to the display unit 17.

[0048] The audio output control unit 28 controls the output of audio in the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user of another avatar who is present within the information sharing range in the virtual office. Furthermore, when a video call becomes possible, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user who is the other party in the video call.

[0049] The communication control unit 29 controls the communication unit 19 to transmit and receive data such as video and audio to and from the server device 30, and to transmit and receive operation status information of the application. More specifically, the communication control unit 29 controls, for example, the communication unit 19 to receive video and audio of the virtual office from the server device 30. The communication control unit 29 controls, for example, the communication unit 19 to transmit to the server device 30 video and audio of the person facing the display unit 17 of the information terminal device 10, acquired by the video acquisition unit 21 and the audio acquisition unit 22. The operation status information of the application includes, for example, in the case of a virtual office application, the operation of an avatar by the operation unit 13, and the operation of starting and ending a video call.

[0050] (Server Device) Fig. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. The server device 30 is a server device of a company to which the users of the information terminal devices 10 belong, or a server device of a business entity that provides a virtual office service, and may be a general-purpose server device, including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 includes a communication unit 31 and a server control device 40.

[0051] The communication unit 31 is a communication unit for performing wired communication or wireless communication. The communication unit 31 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 31 is controlled by the communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operation status information with multiple information terminal devices 10.

[0052] (Server control device) The server control device 40 controls each unit of the server device 30. The server control device 40 has, for example, a control device such as a CPU or MPU, and a storage device such as a RAM or ROM. The server control device 40 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The server control device 40 may be realized by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to the present disclosure.

[0053] The server control device 40 includes a communication control unit 41, an application control unit 42, and a storage unit 49 as functional blocks realized by circuits and programs to be executed.

[0054] The communication control unit 41 controls the communication unit 31 to transmit and receive data including video and audio to and from the information terminal device 10, and to transmit and receive operation status information of applications, etc. The communication control unit 41, for example, controls the communication unit 31 to receive from the information terminal device 10 video captured by the camera 11 of the information terminal device 10 and audio collected by the microphone 12 of the information terminal device 10. The communication control unit 41, for example, controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. The operation status information of the application is, for example, configuration information of the virtual office application.

[0055] The application control unit 42 controls the operation of various applications running on the server device 30. For example, the application control unit 42 controls the operation of a virtual office application. For example, the application control unit 42 controls the operation of an application used for online communication.

[0056] The application control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 that is executing the application via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged in to the virtual office.

[0057] The storage unit 49 stores information such as the contents of calculations and programs of the server control device 40. The storage unit 49 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or HDD.

[0058] The storage unit 49 stores information indicating a virtual office configured in a virtual space. For each user who logs in to the virtual office, the storage unit 49 stores an avatar, the information terminal device 10 associated with the avatar, and information indicating the account user of the information terminal device 10. For each user, the storage unit 49 may also store organizational information indicating the department to which the user belongs or job position information indicating the job position. The storage unit 49 stores information indicating the locations of objects that configure the virtual office, such as the sections that configure the virtual office and the virtual desks.

[0059] (Information Processing Device) An example of the configuration of an information processing device according to the first embodiment will be described with reference to FIG. 4. FIG. 4 is a block diagram showing an example of the configuration of an information processing device according to the first embodiment. The information processing device 50 is a conceptual device realized by the cooperation of either or both of the server device 30 and a plurality of information terminal devices 10 used in the virtual office. Either the information terminal devices 10 or the server device 30 may be the information processing device 50, or the information processing system 1 including the information terminal devices 10 and the server device 30 may be the information processing device 50. Each unit of the information processing device 50 is realized by the cooperation of either or both of the terminal control device 20 and the server control device 40.

[0060] When the information processing device 50 detects that a second avatar corresponding to a second user is in close proximity to a first avatar corresponding to a first user in a virtual office, it displays an icon image representing the second avatar on the display screen of the first information terminal device (hereinafter referred to as the "first information terminal device 10") on which the first user is logged in to the virtual office, in a position that is exposed and not hidden by information such as windows displayed on the display screen.

[0061] The close proximity state is a state in which a second avatar corresponding to a second user has entered, or is likely to enter, the information sharing range of a first avatar corresponding to a first user.

[0062] The state in which the second avatar enters the information sharing range of the first avatar is the state in which the second avatar moves from outside to inside the information sharing range of the first avatar.

[0063] A state in which the second avatar is likely to enter the information sharing range of the first avatar means that the second avatar is moving toward the information sharing range of the first avatar and has approached the information sharing range of the first avatar to within a predetermined distance. Specifically, this means that the second avatar is moving toward the information sharing range of the first avatar and has approached to within one or two times the radius of the information sharing range of the first avatar, with the first avatar at its center.

[0064] As shown in FIG. 4 , the information processing device 50 includes a detection unit 51 , a display control unit 54 , and an audio output control unit 55 .

[0065] The detection unit 51 detects that a second avatar corresponding to a second user is in a close proximity state to a first avatar corresponding to a first user in the virtual office. The second avatar being in a close proximity state to the first avatar means that the second user can hear or will hear the voice, such as the speech, of the user of the first avatar.

[0066] In this embodiment, the detection unit 51 may detect, as a proximity state, that a second avatar corresponding to a second user who belongs to a different organization from the first user has entered the information sharing range of the first avatar, or that there is a high possibility that this second avatar will enter the information sharing range of the first avatar.

[0067] In this embodiment, the detection unit 51 may detect, as a proximity state, that a second avatar corresponding to a second user who has a different job position from the first user has entered the information sharing range of the first avatar, or that there is a high possibility that a second avatar will enter the information sharing range of the first avatar.

[0068] A position different from that of the first user is, for example, a higher position than the first user who is a general employee. A position different from that of the first user is, for example, a higher position than the other avatars that exist in the same virtual office as the first user. A position different from that of the first user is, for example, a lower position than the first user, such as an executive or department head. A position different from that of the first user is, for example, a lower position than the avatars that exist in the same virtual office as the first user.

[0069] The detection unit 51 detects a second avatar that has left the information sharing range of the first avatar in the virtual office. When it detects that the second avatar has left the information sharing range of the first avatar, the information processing device 50 is in a state where the second user cannot hear the speech of the first user.

[0070] When the information processing device 50 is implemented in the information terminal device 10, the detection unit 51 only needs to detect a second user for a first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the detection unit 51 only needs to detect a second user for each of all users.

[0071] The display control unit 54 causes the display units 17 of the multiple information terminal devices 10 to display images showing various types of information, such as a virtual office screen.

[0072] When the detection unit 51 detects that the second avatar is in close proximity to the first avatar, the display control unit 54 displays an icon image representing the second avatar on the display screen of the first information terminal device 10 where the first user is logged in to the virtual office, in a position that is exposed and not hidden by information such as windows displayed on the display screen.

[0073] The exposed position that is not hidden by information such as a window displayed on the display screen is, for example, the top, bottom, left, and right outer periphery of the display screen of display unit 17. The exposed position that is not hidden by information such as a window displayed on the display screen is, for example, an area on the display screen where information such as a window is not displayed and the background image is visible.

[0074] When a video call becomes possible, the display control unit 54 causes images of faces and the like to be displayed on the information terminal device 10 used by the first user corresponding to the first avatar and the information terminal device 10 (hereinafter referred to as the "second information terminal device 10") used by the second user corresponding to the second avatar who is logged in to the virtual office. More specifically, the display control unit 54 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10, and causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0075] When the video call is stopped, the display control unit 54 stops the video sharing between the first user and the second user.

[0076] When a second avatar enters the information sharing range of a first avatar, the audio output control unit 55 enables the second user to share the audio of the first user. Furthermore, when the second avatar enters the information sharing range of the first avatar and the first avatar enters the information sharing range of the second avatar, the second user can share the audio of the first user, and the first user can share the audio of the second user. In other words, the first user and the second user can share audio, enabling audio conversations, etc. More specifically, when audio sharing is enabled, the audio output control unit 55 enables the information terminal device 10 used by the first user corresponding to the first avatar and the second information terminal device 10 where the second user corresponding to the second avatar is logged in to the virtual office to hear each other's voices. More specifically, the audio output control unit 55 outputs the audio of the second user picked up by the microphone 12 of the second information terminal device 10 from the audio output unit 18 of the first information terminal device 10, and outputs the audio of the first user picked up by the microphone 12 of the first information terminal device 10 from the audio output unit 18 of the second information terminal device 10.

[0077] When the first avatar and the second avatar are no longer included in the information sharing range due to, for example, the movement of the avatar, the audio output control unit 55 stops audio sharing between the first user and the second user.

[0078] 5 to 7 , a description will be given of a display screen on the display unit 17 of the first information terminal device 10 used by a first user who is logged in to a virtual office. FIG. 5 is a diagram showing an example of a display screen on the display unit 17 of the information terminal device according to the first embodiment. FIG. 6 is a diagram showing an example of a virtual office window displayed on the display screen of FIG. 5. FIG. 7 is a diagram showing another example of a display screen of the information terminal device according to the first embodiment. As shown in FIG. 5 , the display unit 17 of the first information terminal device 10 displays, for example, a window W1 that displays a virtual office screen using a virtual office application, a window W2 for another application, and a window W3. In the example shown in FIG. 5 , window W1 is displayed behind window W2.

[0079] FIG. 6 is an enlarged view of window W1 in FIG. 5. As shown in FIG. 6, window W1 displaying the virtual office displays an image of the virtual office. Multiple virtual desks D are arranged in the virtual office, and multiple avatars A are present. FIG. 6 shows a state in which a second avatar A2 has moved in the direction of arrow R2 from an adjacent section not displayed on the first user's information terminal device 10, which is outside the display range of the virtual office displayed on the first user's information terminal device 10. In this case, there is a high possibility that the second avatar A2 will enter the information sharing range C1 of the first avatar A1.

[0080] As shown in FIG. 7, a display B2 indicating the presence of a second avatar A2 is displayed on the outer periphery of the display screen of the first user's information terminal device 10 at a position that is not hidden by a window and is exposed.

[0081] 6, when there is a high possibility that the second avatar A2 will enter the information sharing range C1 of the first avatar A1, the display B2 indicating the presence of the second avatar may be a display using an image or text indicating that there is a high possibility that the second avatar A2 will enter. Although not shown, when there is a high possibility that the second avatar A2 will enter the information sharing range C1 of the first avatar A1, the display may be a display using an image or text indicating that the second avatar A2 has entered.

[0082] (Virtual space control method) A virtual space control method will be described with reference to Figures 8 and 9. Figure 8 is a flowchart showing an example of a virtual space control method according to the first embodiment. The processing shown in Figure 8 is executed while a virtual office is provided by the virtual space control system 1. When the information processing device 50 is implemented in the information terminal device 10, the processing of the flowcharts shown in Figures 8 and 9 may be executed for a first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the processing of the flowcharts shown in Figures 8 and 9 may be executed for all users.

[0083] The information processing device 50 determines whether the second avatar has entered the information sharing range of the first avatar (step S101). More specifically, the information processing device 50 detects, in the virtual office, the second avatar that has entered the information sharing range of the first avatar using the detection unit 51. If the information processing device 50 determines that the second avatar has entered the information sharing range of the first avatar (Yes in step S101), the information processing device 50 proceeds to step S102. If the information processing device 50 does not determine that the second avatar has entered the information sharing range of the first avatar (No in step S101), the information processing device 50 ends the processing of this flowchart.

[0084] When it is determined that the second avatar has entered the information sharing range of the first avatar (Yes in step S101), the information processing device 50 displays an icon image representing the second avatar at the edge of the display screen of the display unit 17 of the first information terminal 10 in the direction of the second avatar as seen from the first avatar (step S102). The information processing device 50 proceeds to step S103.

[0085] The information processing device 50 enables audio sharing (step S103). More specifically, the information processing device 50 controls the audio output control unit 55 to enable the first information terminal device 10 and the second information terminal device 10 to hear each other's voices and other sounds. The information processing device 50 proceeds to step S104.

[0086] The information processing device 50 detects whether the second avatar has left the information sharing range of the first avatar (step S104). More specifically, the information processing device 50 detects, via the detection unit 51, that the second avatar has left the information sharing range of the first avatar in the virtual office. If the information processing device 50 determines that the second avatar has left the information sharing range of the first avatar (Yes in step S104), the information processing device 50 proceeds to step S105. If the information processing device 50 does not determine that the second avatar has left the information sharing range of the first avatar (No in step S104), the information processing device 50 executes the process of step S104 again.

[0087] When it is determined that the second avatar has left the information sharing range of the first avatar (Yes in step S104), the information processing device 50 stops audio sharing (step S105). More specifically, the information processing device 50 stops audio sharing between the first information terminal device 10 and the second information terminal device 10 by using the audio output control unit 55. The information processing device 50 proceeds to step S106.

[0088] The information processing device 50 stops displaying the icon image representing the second avatar, which is displayed in the direction of the second avatar at the edge of the display screen of the display unit 17 of the first information terminal 10 (step S106). The information processing device 50 ends the processing of this flowchart.

[0089] Fig. 9 is a flowchart showing another example of the virtual space control method according to the first embodiment. The processing shown in Fig. 9 is executed while the virtual office is provided by the virtual space control system 1. The processing in steps S112, S113, S114 to S116, and S118 in Fig. 9 is similar to the processing in steps S102, S101, S103 to S105, and S106 in Fig. 8.

[0090] The information processing device 50 determines whether or not the second avatar is likely to be within the information sharing range of the first avatar (step S111). More specifically, the information processing device 50 detects, in the virtual office, a second avatar that is likely to be within the information sharing range of the first avatar using the detection unit 51. If the information processing device 50 determines that the second avatar is likely to be within the information sharing range of the first avatar (Yes in step S111), the process proceeds to step S112. If the information processing device 50 does not determine that the second avatar is likely to be within the information sharing range of the first avatar (No in step S111), the process proceeds to step S117.

[0091] The information processing device 50 determines whether an icon image of a second avatar is being displayed on an edge of the display screen of the display unit 17 of the first information terminal 10 (step S117). When the information processing device 50 determines that an icon image of a second avatar is being displayed on an edge of the display screen of the display unit 17 of the first information terminal 10 (Yes in step S117), the information processing device 50 proceeds to step S118. When the result of step S117 is Yes, it means that the information processing device 50 has obtained Yes from step S116 and proceeded to the determination of step S117. When the result of step S117 is No, it means that the processing of steps S112 to S116 has not been performed and step S111 has become No, or that the processing has been started again after the processing of step S118 and step S111 has become No. When the information processing device 50 does not determine that an icon image of a second avatar is being displayed on an edge of the display screen of the display unit 17 of the first information terminal 10 (No in step S117), the information processing device 50 executes the processing of this flowchart.

[0092] (Effects) As described above, in this embodiment, when it is detected that a second avatar is approaching within the information sharing range of a first avatar in a virtual office, the second avatar can be displayed on the display screen of the first information terminal device 10 in an exposed position that is not hidden by a window. According to this embodiment, even if the first user minimizes the virtual office screen window on the display screen of the information terminal device 10 or displays it behind another window, the first user can confirm the approach of the second avatar of the second user. According to this embodiment, the first user can notice that the second avatar has entered, or is likely to enter, the information sharing range of the first avatar. According to this embodiment, it is possible to appropriately display the approach of another user's avatar in a virtual space such as a virtual office.

[0093] In this way, in this embodiment, for example, when a first user is having a highly confidential conversation with a second user, by confirming that a second avatar is approaching, the first user can interrupt the highly confidential conversation or ask the second user to wait.

[0094] According to this embodiment, the first user can notice that the second avatar has entered or is likely to enter the information sharing range of the first avatar, thereby reducing the occurrence of situations where the second user suddenly speaks to the first avatar in close proximity or suddenly requests a voice call.

[0095] According to this embodiment, the first user can notice that the second avatar has entered or is likely to enter the information sharing range of the first avatar, and can prepare for communication with the second user, for example, by saving or minimizing materials corresponding to the window in which the first user is working, presenting materials to be used in communication with the second user, etc. Furthermore, according to this embodiment, the first user can respond to the second user with ample time.

[0096] According to this embodiment, it is possible to detect a state in which a second avatar corresponding to a second user who belongs to a different organization from the first user has entered, or is likely to enter, the information sharing range of a first avatar. According to this embodiment, it is possible to detect the approach of a second user who belongs to a different organization from the first user and who is likely to need to keep information confidential. In this embodiment, for example, when a first user is having a highly confidential conversation with a second user, by detecting that a second avatar is approaching, the first user can interrupt the highly confidential conversation or ask the second user to wait.

[0097] According to this embodiment, it is possible to detect that a second avatar corresponding to a second user who has a different job title from the first user has entered or is likely to enter. In this embodiment, for example, when the first user is having a highly confidential conversation with the second user, by detecting that the second avatar is approaching, it is possible to interrupt the highly confidential conversation or ask the second user to wait.

[0098] Second Embodiment A virtual space control system 1 according to a second embodiment will be described with reference to Figs. 10 to 13. Fig. 10 is a diagram showing an example of a display screen of an information terminal device according to the second embodiment. Fig. 11 is a diagram showing another example of a display screen of an information terminal device according to the second embodiment. Fig. 12 is a flowchart showing an example of a virtual space control method according to the second embodiment. Fig. 13 is a flowchart showing another example of a virtual space control method according to the second embodiment. In the following description, components similar to those of the virtual space control system 1 of the first embodiment are given the same or corresponding reference numerals, and detailed description thereof will be omitted. The virtual space control system 1 differs from the first embodiment in the processing of the information processing device 50.

[0099] When the information processing device 50 detects that a second avatar is approaching a first avatar in the virtual office, it displays an icon image representing the second avatar on the display screen of the first information terminal device in the direction of the second avatar based on the position of the first avatar in the virtual office.

[0100] When the window displaying the virtual office is hidden on the display screen of the first information terminal device 10, the information processing device 50 displays an icon image representing the second avatar on the periphery of the display screen of the first information terminal device 10. In other words, when the window displaying the virtual office is not properly displayed on the display screen of the first information terminal device 10, the information processing device 50 displays an icon image representing the second avatar on the periphery of the display screen of the first information terminal device 10.

[0101] As described above, a state in which the window displaying the virtual office is not displayed properly means that the window displaying the virtual office is hidden by information from other windows or is minimized.

[0102] The outer periphery is, for example, the top, bottom, right and left edges of the display screen.

[0103] When the detection unit 51 detects that the second avatar is approaching the first avatar, the display control unit 54 displays an icon image representing the second avatar on the display screen of the first information terminal device 10 where the first user is logged in to the virtual office, in the direction of the second avatar based on the position of the first avatar in the virtual office.

[0104] When the detection unit 51 detects that the second avatar is in close proximity to the first avatar, the display control unit 54 displays an icon image representing the second avatar on the outer periphery of the display screen of the first information terminal device 10 on which the first user is logged in to the virtual office.

[0105] 10 and 11, a display screen on the display unit 17 of the first information terminal device 10 used by the first user who is logged in to the virtual office will be described. As shown in Fig. 10, on the display unit 17 of the first information terminal device 10, a window W1 displaying the virtual office screen is displayed behind a window W2. Window W1 is the same as that shown in Fig. 6.

[0106] As shown in Fig. 11, an indicator B2 indicating the presence of the second avatar A2 is displayed in the direction of the second avatar relative to the position of the first avatar. Specifically, in Fig. 11, in window W1 that is displayed hidden behind window W2, there is a high possibility that the second avatar A2 will enter the information sharing range C1 to the lower right of the position of the first avatar A1, as shown in Fig. 6. Therefore, an icon B2 indicating the second avatar is displayed in the lower right position on the periphery of the display screen of the display unit 17 of the first information terminal device 10.

[0107] (Virtual Space Control Method) The virtual space control method will be described with reference to Figures 12 and 13. The processes of step S121, step S123 to step S126, and step S128 in Figure 12 are the same as those of step S101, step S102 to step S105, and step S106 in Figure 8. The process of step S127 in Figure 12 is the same as that of step S117 in Figure 9.

[0108] The information processing device 50 determines whether the window displaying the virtual office is not being properly displayed on the display screen of the display unit 17 of the first information terminal 10 (step S122). If the information processing device 50 determines that the window displaying the virtual office is not being properly displayed on the display screen of the display unit 17 of the first information terminal 10 (Yes in step S122), the information processing device 50 proceeds to step S123. If the information processing device 50 does not determine that the window displaying the virtual office is not being properly displayed on the display screen of the display unit 17 of the first information terminal 10 (No in step S122), the information processing device 50 proceeds to step S124.

[0109] The processes in steps S131, S133 to S139 in Fig. 13 are the same as those in steps S111, S112 to S118 in Fig. 9. The process in step S132 in Fig. 13 is the same as that in step S122 in Fig. 12.

[0110] (Effects) As described above, in this embodiment, a display indicating the presence of the second avatar A2 can be performed in the direction of the second avatar A2 relative to the position of the first avatar A1. According to this embodiment, the display is performed at a position that corresponds to the direction from which the second avatar A2 is coming, so the first user can confirm in the virtual office which direction the second avatar is coming from. According to this embodiment, if the first user anticipated the second avatar coming, the expected direction of the second avatar is predicted, so the first user can intuitively understand that the expected second avatar has arrived. According to this embodiment, even if the first user did not anticipate the second avatar coming, knowing the direction from which the second avatar is coming may allow the first user to make some estimate of what kind of user's second avatar is coming.

[0111] In this embodiment, when the window displaying the virtual office is hidden on the display screen of the first information terminal device 10, that is, when the window displaying the virtual office is not properly displayed, a display showing the second avatar can be made on the periphery of the display screen of the first information terminal device 10. According to this embodiment, even when the first user cannot confirm the presence of other avatars around the first avatar on the display screen, the first user can notice that another avatar has entered, or is likely to enter, the information sharing range of the first avatar.

[0112] The virtual space control system, virtual space control method, and program of the present disclosure can be used, for example, in a communication system that uses avatars for communication in a virtual space such as a virtual office.

[0113] REFERENCE SIGNS LIST 1 Virtual space control system 10 Information terminal device 11 Camera 12 Microphone 13 Operation unit 17 Display unit 18 Audio output unit 19 Communication unit 20 Terminal control device 21 Video acquisition unit 22 Audio acquisition unit 23 Operation acceptance unit 24 Application control unit 27 Display control unit 28 Audio output control unit 29 Communication control unit 30 Server device 31 Communication unit 40 Server control device 41 Communication control unit 42 Application control unit 49 Storage unit 50 Information processing device 51 Detection unit 54 Display control unit 55 Audio output control unit

Claims

1. A virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user in the displayed virtual space, wherein the information processing device included in the virtual space control system, when detecting that, in the virtual space, a second avatar corresponding to a second user is in a state of entering or highly likely to enter the information sharing range of a first avatar corresponding to a first user, performs a display indicating the second avatar at a position that is not hidden by the information displayed on the display screen of the first information terminal device on which the first user has logged in to the virtual space. Virtual space control system.

2. When the information processing device detects that it is in the approaching state in the virtual space, the information processing device performs a display indicating the second avatar in the direction of the second avatar with respect to the position of the first avatar in the virtual space. The virtual space control system according to claim 1.

3. When the window for displaying the virtual space on the display screen of the first information terminal device is hidden, the information processing device performs a display indicating the second avatar on the outer peripheral portion of the display screen of the first information terminal device. The virtual space control system according to claim 1 or 2.

4. When the information processing device detects that the second avatar corresponding to a second user belonging to an organization different from that of the first user is in the approaching state, the information processing device performs a display indicating the second avatar at a position that is not hidden by the information displayed on the display screen of the first information terminal device. The virtual space control system according to claim 1 or 2.

5. When the information processing device detects that the second avatar corresponding to a second user having a position different from that of the first user is in the approaching state, the information processing device performs a display indicating the second avatar at a position that is not hidden by the information displayed on the display screen of the first information terminal device. The virtual space control system according to claim 1 or 2.

6. A virtual space control method executed by a virtual space control system that causes an information terminal device to display a virtual space and causes the virtual space to display an avatar corresponding to a user, the method comprising: when it is detected that, in the virtual space, a second avatar corresponding to a second user is in a state of entering or highly likely to enter a sharing range of information of a first avatar corresponding to a first user, a display indicating the second avatar is performed at a position on a display screen of a first information terminal device on which the first user has logged in to the virtual space, the position being exposed without being hidden by the information displayed on the display screen; virtual space control method.

7. A program that causes a computer that controls a space sharing system to operate such that, when it is detected that, in the virtual space, a second avatar corresponding to a second user is in a state of entering or highly likely to enter a sharing range of information of a first avatar corresponding to a first user, a display indicating the second avatar is performed at a position on a display screen of a first information terminal device on which the first user has logged in to the virtual space, the position being exposed without being hidden by the information displayed on the display screen.

Images