Virtual space control system and virtual space control method

Abstract

To appropriately perform communication in a virtual space.SOLUTION: A virtual space control system 1 comprises an information processor 50 that when a first avatar corresponding to a first user is moved to a conference space in which all avatars existing in a conference room can perform information sharing by the first user using a first information terminal device 10, makes the first avatar be displayed in the conference room and be displayed in a changed display form at a predetermined position before the movement in the virtual space, and that when a request for information sharing to the first avatar displayed in the changed display form at the predetermined position is performed using a second avatar corresponding to a second user by the second user using a second information terminal device 10, enables information sharing between the first user and the second user in a state in which information sharing between the first user and a user of an avatar existing in the conference room is limited.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a virtual space control system and a virtual space control method. [Background technology]

[0002] There is known technology relating to a virtual office configured in a virtual space, in which each user uses an avatar to perform work within the virtual office (see, for example, Patent Document 1). When the avatars are close to each other in the virtual space, or when they are located in the same space in the virtual office, they can hear each other's voices. In a conference room set up in the virtual office, all avatars in the conference room can converse with each other. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-071314 Summary of the Invention [Problem to be solved by the invention]

[0004] Each avatar user communicates with another user by moving their own avatar near the avatar of the other user with whom they wish to have a voice conversation, etc. For example, if a first avatar of a first user moves to a location such as a conference room or a section of another department in a virtual office, a second user who wishes to communicate with the first user may be unable to communicate because the first avatar is not at the first avatar's desk. Also, if a user searches for the first avatar and moves a second avatar near the first avatar, the first avatar may be in a location such as a conference room or a section of another department, and the content of the communication between the first user and the second user may be overheard by users of other avatars.

[0005] The present disclosure aims to appropriately carry out communication within a virtual space. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objectives, the virtual space control system of the present disclosure is a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user of the information terminal device in the virtual space, and an information processing device provided in the virtual space control system, when a first avatar corresponding to a first user moves in the virtual space, displays the first avatar at the destination to which it moved and displays a temporary first avatar at the position before the first avatar moved, and when a second user requests communication from the temporary first avatar using the second avatar corresponding to the second user, enables communication between the first user and the second user while communication between the first user and users of other avatars present in the vicinity of the first avatar is restricted.

[0007] The virtual space control method of the present disclosure is a virtual space control method executed by a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user of the information terminal device in the virtual space, wherein when a first avatar corresponding to a first user moves in the virtual space, the first avatar is displayed at the location to which it moved, and a temporary first avatar is displayed at the location before the first avatar moved, and when a second user requests communication from the temporary first avatar using a second avatar corresponding to the second user, the virtual space control system enables communication between the first user and the second user while communication between the first user and users of other avatars present in the vicinity of the first avatar is restricted. [Effects of the Invention]

[0008] According to the present disclosure, communication within a virtual space can be carried out appropriately. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of the information processing device according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of a display screen of a virtual office displayed on the display screen of an information terminal device according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. [Figure 7] FIG. 7 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. [Figure 10] FIG. 10 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. [Figure 12] FIG. 12 is a flowchart showing an example of a virtual space control method according to the first embodiment. [Figure 13] FIG. 13 is a flowchart showing an example of a virtual space control method according to the first embodiment. [Figure 14] FIG. 14 is a flowchart showing an example of a virtual space control method according to the second embodiment. [Figure 15] FIG. 15 is a flowchart showing an example of a virtual space control method according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A virtual space control system and a virtual space control method according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0011] [First embodiment] (Virtual space control system) 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to a first embodiment. The virtual space control system 1 controls a virtual office configured in a virtual space. In the following embodiment, a virtual office is used as an example for explanation, but the present invention is not limited to virtual offices and can also be applied to various services that use avatars for communication in a virtual space.

[0012] In the following description, an information terminal device used by a first user to log in to a virtual office will be referred to as a first information terminal device, and an information terminal device used by another user, a second user, to log in to the virtual office will be referred to as a second information terminal device. A first information terminal device is any information terminal device that is logged in to a virtual office. A second information terminal device is an information terminal device different from the first information terminal device and is any information terminal device that is logged in to the same virtual office as the first information terminal device.

[0013] In the following description, a user who moves into a conference in the virtual office and participates in the conference is referred to as a first user, and a user who requests communication with the first user is referred to as a second user.

[0014] An overview of the virtual office controlled by the virtual space control system 1 will be described. A user uses an information terminal device 10 to come to work (log in) to the virtual office using their own account and perform work. In the virtual office, an avatar associated with the user is set. When a user logs in to the virtual office using their own information terminal device 10 (described later), the avatar moves to any seat in the virtual office or to a predetermined seat and the user operates and displays the avatar to sit down. The user can operate the avatar to move around the virtual office. In the virtual office, for example, when avatars are close to each other in the virtual office or when avatars are located in the same space, such as a conference room in the virtual office, they can share information in a way that allows them to hear each other's voices.

[0015] In the virtual office, each user can operate their own avatar to move it around the virtual space as if they were walking, for example, to move their avatar close to the avatar of a user with whom they wish to communicate, or to move to a conference room in the virtual office.

[0016] The virtual space control system 1 includes an information terminal device 10 that each user uses for business purposes and logs into the virtual office, and a server device 30.

[0017] (Information terminal device) 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. The information terminal device 10 is a terminal device used by a user who performs work in a virtual office. The information terminal device 10 is a terminal device on which the user executes a virtual office application. The information terminal device 10 is a terminal device through which the user logs in to the virtual office using their own account when logging in to the virtual office.

[0018] The information terminal device 10 is, for example, an information terminal device such as a general-purpose personal computer, a smartphone, or a tablet terminal, etc. The information terminal device 10 is connected to the server device 30 via a network so as to be able to communicate data with it.

[0019] The information terminal device 10 logs in to the virtual office based on the account information of the user who is logged in to the information terminal device 10.

[0020] The information terminal device 10 includes a camera 11 , a microphone 12 , an operation unit 13 , a display unit 17 , an audio output unit 18 , a communication unit 19 , and a terminal control device 20 .

[0021] Camera 11 captures an image in the direction facing information terminal device 10. Camera 11 is disposed at a position where it captures an image in the direction facing display unit 17 of information terminal device 10. In other words, camera 11 captures an image in the direction where a user using information terminal device 10 is located. Camera 11 is disposed, for example, near display unit 17. Camera 11 outputs the captured image to image acquisition unit 21 of terminal control device 20.

[0022] The microphone 12 picks up sounds around the information terminal device 10. The microphone 12 may pick up sounds from the direction facing the display unit 17 of the information terminal device 10, and may be provided in a headset connected to the information terminal device 10. In other words, the microphone 12 picks up sounds spoken by the user using the information terminal device 10 and sounds from the surrounding area. The microphone 12 outputs audio information related to the picked-up sounds to the audio acquisition unit 22 of the terminal control device 20.

[0023] The operation unit 13 is an input device capable of inputting various operations to the information terminal device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the terminal control device 20. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel arranged over the display unit 17, buttons, switches, etc. The operation unit 13 can receive, for example, a key input operation, a click operation, or a touch operation.

[0024] The operation unit 13 can accept operations such as moving an avatar corresponding to the user in the virtual office in any direction on the display screen of the display unit 17. For example, the operation unit 13 accepts operations such as overlapping or placing the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0025] By performing an operation such as superimposing one's avatar on another or placing it adjacent to another avatar, communication such as a video call or a voice call can be initiated between users in the virtual office application. Whether a video call or a voice call will be conducted may be set in advance or may be set by the user's operation.

[0026] The operation unit 13 accepts operations to request communication with other users via avatars in the virtual office. For example, the operation unit 13 accepts, on the display screen of the display unit 17, an operation to search for other users with whom the user wishes to communicate in the virtual office, an operation to select a user from the search results and request communication, etc.

[0027] The display unit 17 displays various types of video including text and images. The display unit 17 is, for example, a display including a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display unit 17 displays a video of a virtual office, etc. In this embodiment, when a video call becomes possible, the display unit 17 outputs a video of the user of another avatar with whom the video call is being made, in other words, a video captured by the camera 11 of the information terminal device 10 used by the user of the other avatar. The display of the display unit 17 is controlled by the display control unit 27.

[0028] The audio output unit 18 is an audio output device that outputs audio from the virtual office. In this embodiment, when the user is using the virtual office, the audio output unit 18 outputs the audio around the user's avatar in the virtual office. When a voice call or video call becomes possible, the audio output unit 18 outputs the audio of the user of another avatar with whom the user is making the voice call or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the user of the avatar. The audio output of the audio output unit 18 is controlled by the audio output control unit 28.

[0029] The communication unit 19 is a communication unit for performing wired communication or wireless communication. The communication unit 19 performs communication using a communication method such as Wi-Fi (registered trademark) or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 19 is controlled by a communication control unit 29. The communication unit 19 communicates data such as video and audio or application operation information with the server device 30. The communication unit 19 communicates data such as account information of a user logged in to the information terminal device 10 and application operation status information with the server device 30.

[0030] (Terminal Control Device) The terminal control device 20 controls each part of the information terminal device 10. The terminal control device 20 has, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to the present disclosure. The terminal control device 20 may be realized by an integrated circuit such as an ASIC or an FPGA. The terminal control device 20 loads a stored program into memory and executes instructions included in the program. The terminal control device 20 includes an internal memory such as the RAM described above, and the internal memory is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be realized by a combination of hardware and software.

[0031] The terminal control device 20 has functional blocks realized by circuits and executed programs, including a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a memory unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0032] The video acquisition unit 21 acquires video captured by the camera 11. More specifically, the video acquisition unit 21 acquires video captured by the camera 11 of a user facing the information terminal device 10, etc. The video data acquired by the camera 11 is a moving image.

[0033] The voice acquisition unit 22 acquires the voice detected by the microphone 12. The voice acquisition unit 22 acquires voice such as the voice spoken by a user present in the vicinity of the information terminal device .

[0034] The operation reception unit 23 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0035] The operation accepting unit 23 accepts operations on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to move the user's own avatar in the virtual office on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to overlap or place the user's own avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0036] The operation reception unit 23 receives an operation to request communication with another user via an avatar in the virtual office. For example, the operation reception unit 23 receives, on the display screen of the display unit 17, an operation to search for another user with whom the user wishes to communicate in the virtual office, an operation to select a user from the search results and request communication, and the like.

[0037] The application control unit 24 controls the operation of various applications executed on the information terminal device 10. The applications operated by the application control unit 24 may be controlled in cooperation with a virtual office control unit 42 of the server device 30, which will be described later.

[0038] The application control unit 24 causes a display control unit 27, which will be described later, to display on the display unit 17 a display related to an application running on the information terminal device 10. The display related to the application is a display screen such as a window or an icon that shows the display related to the application to the user of the information terminal device 10.

[0039] When the user of the information terminal device 10 is logged in to the virtual office, the application control unit 24 makes the virtual office executed by the virtual office control unit 42 of the server device 30 available to the information terminal device 10 .

[0040] When a virtual office application is being executed on the information terminal device 10, the application control unit 24 shares information using the display control unit 27 and the audio output control unit 28 based on an information sharing range set around an avatar corresponding to the user of the information terminal device 10. Furthermore, when a video call with an avatar corresponding to another user is started while the virtual office application is being executed on the information terminal device 10, the application control unit 24 performs the video call using the display control unit 27 and the audio output control unit 28.

[0041] The application control unit 24 displays a display screen (window) of the virtual office application on the display screen of the information terminal device 10.

[0042] When a video call becomes possible, the application control unit 24 causes the first information terminal device 10 in which the first user is logged in to the virtual office and the second information terminal device 10 in which the second user is logged in to the virtual office to mutually display images of faces, etc. More specifically, the application control unit 24 of the terminal control device 20 of the first information terminal device 10 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10. Similarly, the application control unit 24 of the terminal control device 20 of the second information terminal device 10 causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0043] When an operation to stop the video call is performed, the application control unit 24 stops the video call between the first user and the second user.

[0044] The storage unit 26 stores, for example, information such as the calculation contents and programs of the terminal control device 20. The storage unit 26 is configured, for example, with a RAM, a main storage device such as a ROM, and a storage device such as an SSD or an HDD (Hard Disk Drive).

[0045] The storage unit 26 stores programs and setting information relating to applications used in the information terminal device 10, such as a virtual office application.

[0046] The storage unit 26 stores meeting schedule information indicating the schedule of the user of the information terminal device 10.

[0047] The meeting schedule information is information indicating a meeting that a user is planning to participate in using an avatar in a meeting room in the virtual office. The meeting schedule information includes, for example, a scheduled start time, a scheduled end time, and information indicating the meeting room. The meeting schedule information may be obtained from a server such as a virtual office application or groupware used by the information terminal device 10.

[0048] The following describes the information sharing range and information sharing set for avatars in a virtual office. In the virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and is the range in which information can be shared between multiple users who are included in the information sharing range. One example of information sharing in the information sharing range is mutual sharing of audio. In other words, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Furthermore, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Information that can be shared in the information sharing range is not limited to audio, but also includes other information such as video and text. In this embodiment, the information sharing range is described as an example in which audio is shared.

[0049] For example, when a second avatar enters the information sharing range of a first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Furthermore, when a second avatar enters the information sharing range of a first avatar and a first avatar enters the information sharing range of the second avatar, two-way voice sharing occurs, allowing each user to sense the other's presence and to converse without any special operations. Therefore, the information sharing range can also be referred to as the voice sharing range. Specifically, when a first avatar and a second avatar are within each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar can be heard in the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar can be heard in the information terminal device 10 used by the first user.

[0050] It is also possible to set up a space that allows information sharing among all avatars within a specific range, such as a conference room set up in a virtual office. Outside of such a set space, the information sharing range is set for each avatar.

[0051] The initial size (area) and shape of the information sharing range for each avatar are set when the virtual office is first used.

[0052] The initial shape of the information sharing range is, for example, a circle with the target avatar at the center, and the initial size of the information sharing range is set to, for example, a size that includes two or three virtual desks for two to four people in a virtual office.

[0053] The display control unit 27 controls the display of various images on the display unit 17. The display control unit 27 controls the display of an image of the virtual office on the display unit 17. In this embodiment, when the information to be shared includes an image or text, the display control unit 27 outputs the image or text to the display unit 17. Furthermore, when a video call becomes possible, the display control unit 27 outputs an image of the user's virtual office avatar to the display unit 17. The display control unit 27 controls the display of an image related to the virtual office on the display unit 17 based on an image output instruction from the application control unit 24 to the display unit 17.

[0054] The audio output control unit 28 controls the output of audio in the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user of another avatar who is present within the information sharing range in the virtual office. Furthermore, when a video call becomes possible, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user who is the other party in the video call.

[0055] The communication control unit 29 controls the communication unit 19 to transmit and receive data such as video and audio to and from the server device 30, and to transmit and receive operation status information of the application. More specifically, the communication control unit 29 controls, for example, the communication unit 19 to receive video and audio of the virtual office from the server device 30. The communication control unit 29 controls, for example, the communication unit 19 to transmit to the server device 30, video and audio of the user facing the display unit 17 of the information terminal device 10, acquired by the video acquisition unit 21 and the audio acquisition unit 22. The operation status information of the application includes, for example, in the case of a virtual office application, the operation of an avatar by the operation unit 13, and the operation of starting and ending a video call.

[0056] (Server device) FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. The server device 30 is a server device of a company to which the users of the information terminal devices 10 belong, or a server device of a business entity that provides a virtual office service, and may be a general-purpose server device including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 includes a communication unit 31 and a server control device 40.

[0057] The communication unit 31 is a communication unit for performing wired communication or wireless communication. The communication unit 31 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 31 is controlled by a communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operation status information with multiple information terminal devices 10.

[0058] (Server control device) The server control device 40 controls each unit of the server device 30. The server control device 40 includes, for example, a control device such as a CPU or MPU, and a storage device such as a RAM or ROM. The server control device 40 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The server control device 40 may be realized by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to the present disclosure.

[0059] The server control device 40 includes a communication control unit 41, a virtual office control unit 42, and a storage unit 49 as functional blocks realized by circuits and programs that are executed.

[0060] The communication control unit 41 controls the communication unit 31 to transmit and receive data including video and audio to and from the information terminal device 10, and to transmit and receive operation status information of applications, etc. The communication control unit 41, for example, controls the communication unit 31 to receive from the information terminal device 10 video captured by the camera 11 of the information terminal device 10 and audio collected by the microphone 12 of the information terminal device 10. The communication control unit 41, for example, controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. The operation status information of the application is, for example, configuration information of the virtual office application.

[0061] The virtual office control unit 42 controls the operation of various applications running on the server device 30. For example, the virtual office control unit 42 controls the operation of a virtual office application. For example, the virtual office control unit 42 controls the operation of an application used for online communication.

[0062] The virtual office control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 that is executing the application via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged in to the virtual office.

[0063] The storage unit 49 stores information such as the contents of calculations and programs of the server control device 40. The storage unit 49 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or HDD.

[0064] The storage unit 49 stores information indicating a virtual office configured in a virtual space. For each user who logs in to the virtual office, the storage unit 49 stores information indicating an avatar, an information terminal device 10 associated with the avatar, and a user account of the information terminal device 10. The storage unit 49 stores information indicating the layout of objects that configure the virtual office, such as the sections that configure the virtual office and virtual desks.

[0065] (Information processing device) An example of the configuration of an information processing device according to the first embodiment will be described with reference to FIG. 4. FIG. 4 is a block diagram showing an example of the configuration of an information processing device according to the first embodiment. The information processing device 50 is a conceptual device realized by the cooperation of either or both of the server device 30 and a plurality of information terminal devices 10 used in the virtual office. Either the information terminal devices 10 or the server device 30 may be the information processing device 50, or the virtual space control system 1 including the information terminal devices 10 and the server device 30 may be the information processing device 50. Each unit of the information processing device 50 is realized by the cooperation of either or both of the terminal control device 20 and the server control device 40.

[0066] A temporary avatar, such as a temporary first avatar, is displayed so that the avatar can be distinguished before and after movement. A temporary avatar is an avatar whose display mode has been changed. For example, a temporary avatar is an avatar whose color has been changed, whose size has been changed, or whose shape has been changed. Hereinafter, a temporary avatar is referred to as an avatar ghost.

[0067] When a first avatar corresponding to a first user moves in the virtual office, the information processing device 50 displays the first avatar at the location to which the first avatar moved, and also displays a ghost of the first avatar, which is a temporary first avatar, at the location before the first avatar moved.When a second user uses a second avatar corresponding to the second user to request communication with the ghost of the first avatar, the information processing device 50 enables communication between the first user and the second user while restricting communication between the first user and users of other avatars present in the vicinity of the first avatar.

[0068] In this embodiment, a case where the first avatar moves to a conference room, in other words, a case where the first avatar moves to a conference room, will be described as an example.

[0069] In this embodiment, when a first user in a virtual office uses a first information terminal device 10 to move a first avatar corresponding to the first user to a conference space where all avatars present in a conference room can share information, the information processing device 50 displays the first avatar in the conference room and also displays a ghost of the first avatar in a predetermined position in the virtual office before the move, with the display form changed. When a second user uses a second information terminal device 10 to request information sharing using a second avatar corresponding to the second user, with the ghost of the first avatar displayed in a predetermined position with the display form changed, the information processing device 50 enables information sharing between the first user and the second user, while information sharing between the first user and the user of the avatar present in the conference room is restricted.

[0070] Changing the display form means making it possible to distinguish between the avatar before and after moving to the conference room. Changing the display form means, for example, changing the color of the avatar, changing the size of the avatar, or changing the shape of the avatar. An avatar with a changed display form is called an avatar ghost.

[0071] The specified position in the virtual space before the movement is preferably the position used by the first avatar before it moved to the conference room, and if a seat is assigned to each avatar, it may also be the seat assigned to the first avatar.

[0072] 4, information processing device 50 includes avatar position detection unit 51, operation detection unit 52, application control unit 55, display control unit 58, and audio output control unit 59. For example, avatar position detection unit 51 may be realized by server control device 40, application control unit 55 may be realized by cooperation between terminal control device 20 and server control device 40, and operation detection unit 52 and display control unit 58 may be realized by terminal control device 20, but this is not limitative.

[0073] The avatar position detection unit 51 detects the positions of avatars in the virtual office. In this embodiment, the avatar position detection unit 51 detects the positions of the avatars in the virtual office, thereby detecting the positions of a first avatar corresponding to a first user and a second avatar corresponding to a second user. Based on the positions of the first avatar and the second avatar, the avatar position detection unit 51 detects that the distance between the first avatar and the second avatar in the virtual space is equal to or greater than a predetermined distance.

[0074] The avatar position detection unit 51 detects other avatars that have entered the information sharing range of the ghost of the first avatar in the virtual office.

[0075] The avatar position detection unit 51 detects another avatar that has moved out of the information sharing range of the ghost of the first avatar in the virtual office.

[0076] When the information processing device 50 is implemented in the information terminal device 10, the avatar position detection unit 51 may detect other users for a first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the avatar position detection unit 51 may detect other users for all users.

[0077] The operation detection unit 52 detects that the user of the information terminal device 10 has performed an operation requesting communication with another user in the virtual office.

[0078] The operation detection unit 52 detects that a user who has received a communication request from another user in the virtual office has performed an operation to permit communication with the other user.

[0079] In this embodiment, when a first user uses first information terminal device 10 in a virtual office to move a first avatar to a conference space where all avatars in a conference room can share information, the application control unit 55 displays the first avatar in the conference room and also displays a ghost of the first avatar at a predetermined position in the virtual office in a different display form from before the move.When a first user uses first information terminal device 10 to move a first avatar into a conference room in the virtual office, the application control unit 55 displays the first avatar in the conference room and also displays a ghost of the first avatar at a predetermined position in the virtual office in a different display form from before the move.

[0080] Conditions under which the ghost of the first avatar is displayed due to the movement of the first avatar include, for example, when the first avatar starts moving to a conference room in the virtual office just before the scheduled start time of a meeting that has been previously set and stored as scheduled meeting information in memory unit 26, or when the scheduled start time arrives while the first avatar is moving to the conference room or has already moved, or when the first avatar enters the conference room.

[0081] The ghost of the first avatar has an information sharing range set around it, just like the first avatar. Information sharing with other avatars that were around the first avatar before the first avatar moved is no longer possible once the first avatar moves and is no longer included in each of the avatars' information sharing ranges.

[0082] The application control unit 55 may display the ghost of the first avatar, like the second avatar, only on the display screen of the second information terminal device 10 used by the second user of the second avatar who has moved from the seat of the first avatar, in other words, from a position at least a predetermined distance away from the position of the ghost of the first avatar. In this case, when the first avatar moves to the conference room, the ghost of the first avatar may not be displayed on the display screen of the information terminal device 10 used by the user of the avatar who was within the information sharing range or within a predetermined distance around the first avatar before the first avatar moved to the conference room.

[0083] A location that is more than a specified distance away from the first avatar's seat means, for example, outside the information sharing range of the first avatar's ghost, the range of the same department including the first avatar's seat, or a range centered on the first avatar's ghost with a radius approximately three times the information sharing range of the first avatar's ghost.

[0084] The condition for enabling information sharing by being included in the information sharing range of the ghost of the first avatar may be, for example, when a second avatar moves from a position that is more than a predetermined distance away from the desk of the first avatar in a virtual office. In this case, the second user can know that the first avatar is in a meeting elsewhere because the first avatar is displayed as a ghost. Therefore, if the communication is not urgent or of high importance, the second user can choose not to enter the information sharing range of the ghost of the first avatar. Furthermore, if the communication is urgent or of high importance, the second user can request information sharing by entering the information sharing range of the ghost of the first avatar.

[0085] When a second user uses the second information terminal device 10 to request information sharing using the second avatar to the ghost of the first avatar, which is displayed at a predetermined position with its display form changed, the application control unit 55 enables information sharing between the first user and the second user while restricting information sharing between the first user and the user of the avatar present in the conference room. When the second user uses the second information terminal device 10 to bring the second avatar within the information sharing range of the ghost of the first avatar, the application control unit 55 enables information sharing between the first user and the second user while restricting information sharing between the first user and the user of the avatar present in the conference room. This allows the second user to communicate with the first user present in the conference room before the end of the conference in which the first avatar is participating, in the event of an emergency or when high-importance communication is required.

[0086] When a second user uses the second information terminal device 10 to request information sharing using the second avatar to the ghost of the first avatar, which is displayed in a predetermined position with its display form changed, the application control unit 55 limits the output of the first user's voice to users of avatars present in the conference room. This allows the second avatar to communicate with the first user without causing any inconvenience to users of other avatars in the conference room where the first avatar is present.

[0087] Restricting the audio output means that the audio of the first user and the audio of the second user are not output on the information terminal devices 10 of other users present in the conference room. Restricting the audio output means that the audio is shared only between the first user and the second user.

[0088] The first information terminal device 10 used by the first user outputs the voices of the other avatar users in the conference room, as well as the voice of the second user.

[0089] The second information terminal device 10 used by the second user outputs the voice of the first user, but does not output the voices of the other avatar users in the conference room.

[0090] When a second user uses the second information terminal device 10 to share information using a second avatar with a ghost of a first avatar that is displayed at a predetermined position with its display form changed, the application control unit 55 causes the first information terminal device 10 to change the display form of a second avatar that shares information with the first avatar that is present in the conference room and is displayed as a ghost of the second avatar. When a second user uses the second information terminal device 10 to share information using a second avatar with a ghost of the first avatar that is displayed at a predetermined position, the application control unit 55 causes the first information terminal device 10 of the first user to display a ghost of the second avatar in the conference room. The application control unit 55 does not need to display ghosts of the second avatar on the information terminal devices 10 of users of other avatars that are present in the conference room.

[0091] When the second user uses the second information terminal device 10 to request information sharing using the second avatar to the ghost of the first avatar, in other words, when the second avatar is displayed as a ghost, the application control unit 55 may display a pop-up screen on the display screen (virtual office display screen) of the first information terminal device 10 used by the first user, which allows the first user to choose whether or not to allow communication with the second user, thereby enabling communication with the second user through operation by the first user.

[0092] The application control unit 55 may control the first information terminal device 10 used by the first user to have the voice of the user of another avatar present in the conference room and the voice of the second user of a second avatar who is able to share information as a ghost heard from different directions. Specifically, the application control unit 55 may control the first information terminal device 10 used by the first user to have the voice in the conference room (the voice of the user of another avatar present in the conference room) output as monaural voice, and the voice of the user of the avatar who is able to share information as a ghost output as voice on either the left or right channel. For example, in the case of FIG. 10 described later, it is appropriate to output as voice on the right channel.

[0093] The application control unit 55 may limit communication between a first user present in the conference room and a second user of a second avatar who has requested communication with the first user as a ghost to audio sharing. For example, in the state of FIG. 9 described below, even if the second user superimposes the second avatar on the ghost of the first avatar, a video call may not be performed.

[0094] When a first user in a virtual office uses a first information terminal device 10 to move a first avatar to a conference space where all avatars in a conference room can share information, the application control unit 55 may change the display format to a specified position in the virtual office before the move and narrow the information sharing range around the first avatar.

[0095] Narrowing the information sharing range means, for example, narrowing it to a range that does not include other avatars that exist in the vicinity of the specified location in the virtual office before the movement. By doing so, a second user who wants to share information with a first user can intentionally enter only the information sharing range of the ghost of the first avatar, avoiding the previous information ranges of other avatars. In addition, unintentional information sharing with other avatars that exist in the vicinity of the specified location in the virtual office before the movement is suppressed.

[0096] When a first avatar in a virtual office moves from within the belonging section to which the first user belongs and is placed to outside the belonging section, the application control unit 55 displays the first avatar outside the belonging section and also displays a ghost of the first avatar at the position where the first avatar was before moving within the belonging section.

[0097] The display control unit 58 causes the display units 17 of the multiple information terminal devices 10 to display images showing various types of information, such as a virtual office screen.

[0098] When a video call becomes possible, the display control unit 58 causes images of faces and the like to be displayed on the first information terminal device 10 and the second information terminal device 10. More specifically, the display control unit 58 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10, and causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0099] When the video call is stopped, the display control unit 58 stops the video sharing between the first user and the second user.

[0100] When a second avatar enters the information sharing range of a first avatar, the audio output control unit 59 enables the second user to share the audio of the first user. Furthermore, when the second avatar is within the information sharing range of the first avatar and the first avatar is within the information sharing range of the second avatar, the second user can share the audio of the first user, and the first user can share the audio of the second user. In other words, the first and second users can share audio, enabling them to have audio conversations. More specifically, when audio sharing is enabled, the audio output control unit 59 enables the information terminal device 10 used by the first user corresponding to the first avatar and the second information terminal device 10 where the second user corresponding to the second avatar is logged in to the virtual office to hear each other's voices. More specifically, the audio output control unit 59 outputs the voice of the second user picked up by the microphone 12 of the second information terminal device 10 from the audio output unit 18 of the first information terminal device 10, and outputs the voice of the first user picked up by the microphone 12 of the first information terminal device 10 from the audio output unit 18 of the second information terminal device 10.

[0101] The audio output control unit 59 stops audio sharing between the first user and the second user when the first avatar and the second avatar are no longer included in the information sharing range due to the movement of the avatars, or when an operation to stop audio sharing is performed.

[0102] Display screens will be described with reference to FIGS. 5 to 11. FIG. 5 is a diagram showing an example of a virtual office display screen displayed on the display screen of an information terminal device according to the first embodiment. FIG. 5 shows an example of a first information terminal device 10 used by a first user. As shown in FIG. 5, a display screen W displaying a virtual office screen using, for example, a virtual office application is displayed on the display unit 17 of the information terminal device 10. An image of the virtual office is displayed on the display screen W displaying the virtual office. The first user is performing work with a first avatar A1 positioned at his or her desk in the virtual office. An information sharing range C1 is set around the first avatar A1. Similar information sharing ranges are set for the other avatars, so the first avatar A1 and the other avatars included in the information sharing range C1 of the first avatar A1 are in a state of information sharing, such as being able to hear each other's voices.

[0103] For example, in the case of a first user, the first user's own seat in the virtual office could be a seat that has been set up in advance as the first user's seat, a seat that the first user has selected and is using in the section of the department to which the first user belongs, or a seat that the first user has selected and is using in the virtual office.

[0104] 6 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device according to the first embodiment. In FIG. 6, the belonging section S1, which is the section of the department to which the first user belongs, is indicated by a dashed line. When the first avatar A1 moves from within the belonging section S1 to outside the belonging section S1, a ghost of the first avatar A1 is displayed at the position before the movement within the belonging section S1 (the position of the first avatar A1 in FIG. 6).

[0105] FIG. 7 is a diagram showing another example of a virtual office display screen displayed on the display screen of an information terminal device according to the first embodiment. FIG. 7 shows an example of a first information terminal device 10 used by a first user. FIG. 7 shows a state in which the first user has moved a first avatar A1 to a conference room in the virtual office. As shown in FIG. 7, the display unit 17 of the information terminal device 10 displays, for example, a display screen W displaying a virtual office screen using a virtual office application, with a section W1 indicating an office and a section W2 indicating a conference room. Each avatar in the conference room can share information regardless of the information sharing range, and each avatar can hear each other's voice. The voice of an avatar in the conference room is not shared with other avatars outside the conference room.

[0106] FIG. 8 is a diagram showing another example of a display screen of a virtual office displayed on the display screen of an information terminal device according to the first embodiment. FIG. 8 shows an example of a second information terminal device 10 used by a second user. After a first avatar A1 moves to a conference room, a ghost GA1 of the first avatar is displayed in a predetermined position in the virtual office before the first avatar moved, with the display form changed from before the first avatar moved. The ghost GA1 of the first avatar in FIG. 8 is displayed in a lighter color than the first avatar A1 in FIG. 5. In FIG. 8, a second avatar A2 is moving within the virtual office toward the information sharing range GC1 of the ghost GA1 displayed at the first avatar's own desk in order to communicate with the first user.

[0107] FIG. 9 is a diagram showing another example of a virtual office display screen displayed on the display screen of an information terminal device according to the first embodiment. FIG. 9 shows an example of a second information terminal device 10 used by a second user. When the second user moves the second avatar A2 into the information sharing range GC1 of the ghost GA1 of the first avatar, the first avatar A1 and the ghost GA2 of the second avatar become capable of sharing information. At this time, the user of the second avatar A2 can talk to the user of the first avatar A1. When the second avatar A2 is included in the information sharing range GC1 of the ghost GA1 of the first avatar, even if there is another avatar (the third avatar in the example of FIG. 9) included in the information sharing range around the second avatar A2, the second avatar A2 and the third avatar A3 do not become capable of sharing information. Therefore, since the second avatar A2 is included in the information sharing range GC1 of the ghost GA1 of the first avatar, and the ghost GA1 of the first avatar is included in the information sharing range of the second avatar A2, communication can be carried out excluding other avatars that are near the ghost GA1 of the first avatar or the second avatar A2. In the event of an emergency or when communication of high importance is required, the second avatar can communicate at the location where the first avatar was before moving to the conference room, without having to search for the conference room where the first avatar is present.

[0108] Fig. 10 is a diagram showing another example of a virtual office display screen displayed on the display screen of an information terminal device according to the first embodiment. Fig. 10 shows an example of a first information terminal device 10 used by a first user. When a first avatar A1 and a second avatar A2 are capable of sharing information, the first information terminal device 10 displays the second avatar A2, which is sharing information with the first avatar A1 in the conference room, in a different display form as a ghost of the second avatar. The information terminal device 10 displays a ghost GA2 of the second avatar.

[0109] Fig. 11 is a diagram showing another example of a virtual office display screen displayed on the display screen of an information terminal device according to the first embodiment. Fig. 11 shows an example in which the information sharing range GC1 of the ghost GA1 of the first avatar is narrowed in the same state as in Fig. 8. Specifically, in Fig. 8, the information sharing range GC1 of the ghost GA1 of the first avatar includes the third avatar, whereas in Fig. 10, other avatars such as the third avatar are not included in the information sharing range GC1 of the ghost GA1 of the first avatar.

[0110] (Virtual space control method) A virtual space control method will be described with reference to FIGS. 12 and 13. FIG. 12 is a flowchart showing an example of a virtual space control method according to the first embodiment. FIG. 13 is a flowchart showing an example of a virtual space control method according to the first embodiment. The processes shown in FIGS. 12 and 13 are executed at predetermined time intervals while the virtual office is provided by the virtual space control system 1. While the information terminal device 10 is logged in to the virtual office, a screen showing the virtual office is displayed or becomes displayable on the display screen of the information terminal device 10. When the information processing device 50 is implemented in the information terminal device 10, the processes of the flowcharts shown in FIGS. 12 and 13 may be executed for the first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the processes of the flowcharts shown in FIGS. 12 and 13 may be executed for all users.

[0111] The processing in the information processing device 50 will be described with reference to Fig. 12. The processing shown in Fig. 12 is processing in the information processing device 50 based on the operation of the first information terminal device 10 of the first user.

[0112] The information processing device 50 determines whether the first avatar has moved to a conference room in the virtual office (step S101). More specifically, the information processing device 50 determines whether the first avatar has moved into the conference room on the virtual office screen using the avatar position detection unit 51. If the information processing device 50 determines that the first avatar has moved to the conference room in the virtual office (Yes in step S101), the information processing device 50 proceeds to step S102. If the information processing device 50 does not determine that the first avatar has moved to the conference room in the virtual office (No in step S101), the information processing device 50 ends the processing of this flowchart.

[0113] The information processing device 50 starts enabling the first avatar to communicate with other avatars in the conference room (step S102). More specifically, the information processing device 50 enables the first avatar to communicate with other avatars in the conference room using the application control unit 55. More specifically, the information processing device 50 controls the display control unit 58 to display images of faces and the like on the first information terminal device 10 and on the information terminal devices 10 used by users of other avatars in the conference room. The information processing device 50 controls the audio output control unit 59 to enable audio such as voices to be heard on the information terminal device 10 and on the information terminal devices 10 used by users of other avatars in the conference room. The information processing device 50 proceeds to step S103.

[0114] The information processing device 50 displays a ghost of the first avatar at a predetermined position in the virtual office before the first avatar moved (step S103). More specifically, the information processing device 50 causes the application control unit 55 to display the first avatar in the conference room, and also displays a ghost of the first avatar at a predetermined position in the virtual office before the first avatar moved, with the display form changed from before the first avatar moved. The display of the first avatar in the conference room is displayed on the information terminal devices 10 of all users who are displaying the conference room to which the first avatar moved. As described above, the display of the ghost of the first avatar at a predetermined position before the first avatar moved is displayed on the information terminal device 10 used by the user of the avatar that moved from a position at least a predetermined distance away from the position of the ghost of the first avatar. In this embodiment, it is displayed on the second information terminal device 10 used by the second user. The information processing device 50 proceeds to step S104.

[0115] The information processing device 50 determines whether the second avatar has requested communication with the ghost of the first avatar (step S104). More specifically, the information processing device 50 determines whether the operation detection unit 52 has detected that the second user is attempting to communicate with the first user or is currently communicating with the first user via the first avatar and the second avatar in the virtual office. The information processing device 50 determines that a communication start operation has been performed when the operation detection unit 52 detects, for example, an operation in which the second user moves the second avatar into the information sharing range of the ghost of the first avatar to enable voice conversation, or an operation in which the second user moves the second avatar so as to overlap the ghost of the first avatar to enable video calling. If the information processing device 50 determines that a communication request operation has been performed (Yes in step S104), the process proceeds to step S105. If the information processing device 50 does not determine that a communication request operation has been performed (No in step S104), the process proceeds to step S110.

[0116] When it is determined that a communication request operation has been performed (Yes in step S104), the information processing device 50 displays a ghost of the second avatar (step S105). More specifically, the information processing device 50 causes the application control unit 55 to display a ghost of the second avatar in the conference room in the first information terminal device 10. The information processing device 50 proceeds to step S106.

[0117] The information processing device 50 determines whether to permit communication with the second avatar (step S106). More specifically, the information processing device 50 determines, via the operation detection unit 52, whether the first user has performed an operation to permit communication with the second user. When the operation detection unit 52 determines that the first user has performed an operation to permit communication with the second user, the information processing device 50 determines that communication is permitted. When the information processing device 50 determines that communication with the second avatar is permitted (Yes in step S106), the information processing device 50 proceeds to step S107. When the information processing device 50 does not determine that communication with the second avatar is permitted (No in step S106), the information processing device 50 executes the processing of step S104 again.

[0118] When it is determined that communication with the second avatar is permitted (Yes in step S106), the information processing device 50 starts enabling communication between the first user and the second user by the application control unit 55 while restricting communication with the avatars in the conference room (step S107). Specifically, a state is established in which communication between the first user and the second user is enabled, and the voice of the second user is not output to the information terminal devices 10 of the other users in the conference room. Furthermore, the voice of the other users in the conference room is not output to the information terminal device 10 of the second user. The voice of the second user is also output to the information terminal device 10 of the first user, in addition to the voices of the other users in the conference room.

[0119] The information processing device 50 determines whether to end communication with the second avatar (step S108). More specifically, the information processing device 50 determines to end communication with the second avatar when, for example, the second avatar moves out of the information sharing range of the ghost of the first avatar in the virtual office, or when an operation to end communication between the first avatar and the second avatar in the virtual office is detected. If the information processing device 50 determines to end communication with the second avatar (Yes in step S108), it proceeds to step S109. If the information processing device 50 does not determine to end communication with the second avatar (No in step S108), it executes the process of step S108 again.

[0120] When communication between the first avatar and the second avatar ends and the second avatar leaves the information sharing range of the ghost of the first avatar shown in Figure 9, the display of the ghost of the second avatar shown in Figure 10 also ends.

[0121] The information processing device 50, by the application control unit 55, cancels the enablement of communication with the second avatar and releases the restriction on communication with the avatars in the conference room (step S109). Specifically, the state in which communication between the first user and the second user is enabled is ended, and communication between all avatars in the conference room is enabled. The information processing device 50 proceeds to step S110.

[0122] The information processing device 50 determines whether the first avatar has left the conference room (step S110). More specifically, the information processing device 50 determines whether the first avatar has left the conference room of the virtual office using the avatar position detection unit 51. If the information processing device 50 determines that the first avatar has left the conference room (Yes in step S110), the information processing device 50 proceeds to step S111. If the information processing device 50 does not determine that the first avatar has left the conference room (No in step S110), the information processing device 50 executes the processing of step S104 again.

[0123] When it is determined that the first avatar has left the conference room (Yes in step S110), the information processing device 50 cancels the state in which the first user can communicate with other avatars in the conference room (step S111). More specifically, the information processing device 50 causes the application control unit 55 to cancel information sharing in the virtual office or to terminate the video call function. The information processing device 50 causes the display control unit 58 to terminate the mutual display of images of faces, etc. between the first information terminal device 10 and the information terminal devices 10 used by users of other avatars in the conference room. The information processing device 50 causes the audio output control unit 59 to terminate the state in which voices, etc. can be heard between the information terminal device 10 and the information terminal devices 10 used by users of other avatars in the conference room. The information processing device 50 proceeds to step S112.

[0124] Information processing device 50 stops displaying the ghost of the first avatar (step S112). More specifically, information processing device 50 causes application control unit 55 to stop displaying the ghost of the first avatar at a predetermined position in the virtual office before movement.

[0125] The processing in the information processing device 50 will be described with reference to Fig. 13. The processing shown in Fig. 13 is processing in the information processing device 50 based on the operation of the second information terminal device 10 by the second user.

[0126] The information processing device 50 determines whether the second user has performed a communication request operation on the ghost of the first avatar (step S201). More specifically, when the operation receiving unit 23 of the terminal control device 20 receives a communication request operation from the second user on the ghost of the first avatar, the information processing device 50 determines that the communication request operation has been performed. When the information processing device 50 determines that the second avatar has performed a communication request operation on the ghost of the first avatar (Yes in step S201), the information processing device 50 proceeds to step S202. When the information processing device 50 does not determine that the communication request operation has been performed on the ghost of the first avatar (No in step S201), the information processing device 50 ends the processing of this flowchart.

[0127] When it is determined that a communication request operation has been performed on the ghost of the first avatar (Yes in step S201), the information processing device 50 determines whether communication with the first avatar has been permitted (step S202). When the communication permission operation is accepted by the first user via the first information terminal device 10, the information processing device 50 determines that communication with the first avatar has been permitted. When it is determined that communication with the first avatar has been permitted (Yes in step S202), the information processing device 50 proceeds to step S203. When it is not determined that communication with the first avatar has been permitted (No in step S202), the information processing device 50 ends the processing of this flowchart.

[0128] When it is determined that communication with the first avatar is permitted (Yes in step S202), the information processing device 50 enables communication with the first avatar by the application control unit 55 (step S203).

[0129] The information processing device 50 determines whether the state in which the first avatar can communicate with the second avatar will end (step S204). More specifically, the information processing device 50 determines to end communication with the first avatar when, for example, the second avatar moves out of the information sharing range of the ghost of the first avatar in the virtual office, or when an operation to end communication between the first avatar and the second avatar in the virtual office is detected. When the information processing device 50 determines to end communication with the first avatar (Yes in step S204), it ends the processing of this flowchart. When the information processing device 50 does not determine to end communication with the first avatar (No in step S204), it executes the processing of step S204 again.

[0130] (effect) As described above, in this embodiment, when a first user uses the first information terminal device 10 to move a first avatar into a conference room in a virtual office, the first avatar is displayed in the conference room, and a ghost of the first avatar is displayed at a predetermined position in the virtual office before the move. In this embodiment, when a second user uses the second information terminal device 10 to share information with the ghost of the first avatar using a second avatar, information sharing between the first user and the second user is enabled while information sharing between the first user and the user of an avatar present in the conference room is restricted. According to this embodiment, in the event of an emergency or when communication of high importance is required, the second user can communicate before the end of the conference of the first avatar. According to this embodiment, in the event of an emergency or when communication of high importance is required, the second avatar can communicate with the first avatar without disturbing other avatars in the conference room where the first avatar is present. According to this embodiment, communication in a virtual space can be performed appropriately.

[0131] In this embodiment, when a second user uses the second information terminal device 10 to request information sharing from the ghost of the first avatar using the second avatar, the voice output of the first user is restricted for users of avatars present in the conference room. According to this embodiment, the second avatar can communicate with the first avatar without causing any inconvenience to users of other avatars in the conference room where the first avatar is present.

[0132] In this embodiment, when a second user uses the second information terminal device 10 to request information sharing from the ghost of the first avatar using the second avatar, the second avatar that is in the conference room and shares information with the first avatar is displayed as a ghost on the first information terminal device 10. According to this embodiment, the display can be made so that the first user can recognize that they are requesting communication with the second user.

[0133] In this embodiment, the predetermined location in the virtual office before the first avatar moves is the location that the first avatar used before moving to the conference room. According to this embodiment, the second user can communicate with the first user by moving to the first user's desk or other location without having to check the conference room to which the first user has moved.

[0134] In this embodiment, when a first avatar in a virtual office moves from within the area to which the first user belongs and is placed to outside the area to which the first avatar belongs, the first avatar is displayed outside the area to which the first avatar belongs, and a ghost of the first avatar is displayed in the area to which the first avatar belonged before the move.

[0135] [Second embodiment] A virtual space control system 1 according to the second embodiment will be described using FIG. 14. FIG. 14 is a flowchart showing an example of a virtual space control method according to the second embodiment. In the following description, components similar to those of the virtual space control system 1 of the first embodiment will be given the same or corresponding reference numerals, and detailed description thereof will be omitted. The virtual space control system 1 differs from the first embodiment in the processing performed by the information processing device 50. In this embodiment, a case will be described in which the destination of the first avatar is other than a conference room.

[0136] When a first avatar corresponding to a first user moves in the virtual office, the application control unit 55 displays the first avatar at the destination to which it has moved and also displays a ghost of the first avatar at the position where the first avatar was before it moved.When a second user requests communication from the ghost of the first avatar using a second avatar corresponding to the second user, the application control unit 55 enables communication between the first user and the second user while restricting communication between the first user and users of other avatars present in the vicinity of the first avatar.

[0137] Restricting the output of audio means that the audio of the first user and the audio of the second user are not output in the information terminal devices 10 of other users present in the vicinity of the first avatar.

[0138] When a second user uses a second avatar to request communication from the ghost of the first avatar, and the first avatar is in a state where it can communicate with other avatars in the same compartment as the first avatar, the application control unit 55 may enable communication between the first user and the second user while restricting the first user's voice output to users of the other avatars in the compartment.

[0139] A section refers to an area in a virtual office where multiple virtual desks are arranged together.

[0140] When a second user uses a second avatar to request communication with the ghost of the first avatar, the application control unit 55 may cause at least the first information terminal device 10 to display the ghost of the second avatar, which is a temporary second avatar, at the destination to which the first avatar has been moved.

[0141] When the first avatar moves, the application control unit 55 may display a ghost of the first avatar at the position where the first avatar was present for the longest time near the position of the first avatar before the movement, or at the position assigned to the first avatar.

[0142] The location where the first avatar has been present for the longest time is, for example, the location where the first avatar has been present for the longest time within a predetermined range within a radius of several meters from the location where the first avatar was present before moving, during the several tens of minutes before the first avatar moved. For example, if the first avatar works at his / her desk for more than 30 minutes, then stops by a nearby printer to collect printed materials and moves on, the first avatar's desk will be the location where the first avatar has been present for the longest time.

[0143] The position assigned to the first avatar is, for example, the first avatar's own seat.

[0144] The processing in the information processing device 50 will be described with reference to Fig. 14. The processing shown in Fig. 14 is processing in the information processing device 50 based on the operation of the first information terminal device 10 of the first user in the information processing device 50. The processing in steps S302 to S305, step S307, and step S310 is similar to the processing in steps S103 to S106, step S108, and step S112 in the flowchart shown in Fig. 11.

[0145] The information processing device 50 determines whether the first avatar has started moving in the virtual office (step S301). More specifically, the information processing device 50 determines whether the first avatar has moved on the virtual office screen using the avatar position detection unit 51. If the information processing device 50 determines that the first avatar has moved (Yes in step S301), it proceeds to step S302. If the information processing device 50 does not determine that the first avatar has moved (No in step S301), it ends the processing of this flowchart.

[0146] The processing in step S303 will be described. The information processing device 50, via the application control unit 55, displays the first avatar at the destination, and also displays a ghost of the first avatar at a predetermined position, which is the position where the first avatar spent the longest time before the first avatar moved in the virtual office. The display of the first avatar at the destination is displayed on the information terminal devices 10 of all users who are displaying the destination of the first avatar. As described above, the display of the ghost of the first avatar at the predetermined position before the first avatar moved is displayed on the information terminal device 10 used by the user of the avatar that moved from a position at least a predetermined distance away from the position of the ghost of the first avatar. In this embodiment, the display is displayed on the second information terminal device 10 used by the second user.

[0147] When it is determined that communication with the second avatar is permitted (Yes in step S305), the information processing device 50 starts enabling communication between the first user and the second user by the application control unit 55 while restricting communication with other avatars present around the first avatar (step S306). Specifically, a state is established in which communication between the first user and the second user is enabled, and the voice of the second user is not output to the information terminal device 10 of the user corresponding to the other avatars present around the first avatar. Furthermore, the voice of the user corresponding to the other avatars present around the first avatar is not output to the information terminal device 10 of the second user. The voice of the second user is also output to the information terminal device 10 of the first user, in addition to the voice of the users of the other avatars present around the first avatar, such as in a conference room or in the assigned section.

[0148] The information processing device 50, via the application control unit 55, cancels the enablement of communication with the second avatar and cancels the restriction on communication with other avatars present in the vicinity (step S308). Specifically, the state in which communication between the first user and the second user is possible is ended, and communication between all avatars present in the vicinity is made possible. The information processing device 50 proceeds to step S308.

[0149] The information processing device 50 determines whether the first avatar has returned to a predetermined position, which is the position before the movement (step S309). More specifically, the information processing device 50 determines whether the first avatar has returned to the position before the movement in the virtual office, using the avatar position detection unit 51. If the information processing device 50 determines that the first avatar has returned to the position before the movement in the virtual office (Yes in step S309), the information processing device 50 proceeds to step S3101. If the information processing device 50 does not determine that the first avatar has returned to the position before the movement in the virtual office (No in step S309), the information processing device 50 executes the processing of step S303 again.

[0150] (effect) As described above, in this embodiment, when a first avatar moves in a virtual office, the first avatar is displayed at the destination of the first avatar, and a ghost of the first avatar is displayed at the location where the first avatar was before the first avatar moved. In this embodiment, when a second user uses a second avatar corresponding to the second user to request communication from the ghost of the first avatar, communication between the first user and the second user is enabled while communication between the first user and users of other avatars in the vicinity of the first avatar is restricted. According to this embodiment, in the event of an emergency or when communication of high importance is required, the second user can immediately communicate without having to move the second avatar to the destination of the first avatar, even if the first avatar has moved. According to this embodiment, in the event of an emergency or when communication of high importance is required, the second avatar can communicate with the first avatar without causing inconvenience to other avatars in the vicinity of the destination where the first avatar is located. According to this embodiment, communication within the virtual space can be appropriately performed.

[0151] In this embodiment, when a second user uses a second avatar to make a communication request to the ghost of a first avatar, if the first avatar is able to communicate with other avatars in the same compartment as the first avatar, communication between the first user and the second user is enabled while the first user's voice output to users of the other avatars in the compartment is restricted. According to this embodiment, the second avatar can communicate with the first avatar without causing any inconvenience to users of the other avatars in the same compartment as the first avatar.

[0152] In this embodiment, when a second user uses a second avatar to request communication with the ghost of the first avatar, the ghost of the second avatar is displayed at least at the location where the first avatar has moved on the first information terminal device 10. According to this embodiment, by displaying the ghost of the second avatar near the first avatar, it is possible to indicate that the first user is communicating with a second user of the second avatar who is actually located at a distant location.

[0153] In this embodiment, when the first avatar moves, a ghost of the first avatar is displayed at the position where the first avatar has been present for the longest time in the vicinity of the position of the first avatar before the movement, or at the position assigned to the first avatar. According to this embodiment, the position of the first avatar before the movement can be appropriately set.

[0154] [Third embodiment] 15 is a flowchart showing an example of a virtual space control method according to the third embodiment. The virtual space control system 1 differs from the first embodiment in the processing performed by the information processing device 50.

[0155] When a first user is not using a first avatar to communicate with users of other avatars at a location to which the first avatar has been moved, or is not in a state where communication is possible, and a second user uses a second avatar to request communication from the ghost of the first avatar, the information processing device 50 enables communication between the first user and the second user.

[0156] The application control unit 55 enables communication between the first user and the second user when the first user is not using the first avatar to communicate with users of other avatars at the destination to which the first avatar has moved, or when the user is not in a state where communication is possible, and the second user uses the second avatar to request communication from the ghost of the first avatar.

[0157] When communication between the first user and the second user is enabled in this manner, the first avatar communicates with the second avatar at the destination, but the second avatar is not actually present near the first avatar. Therefore, the application control unit 55 may display a ghost of the second avatar near the first avatar so that the other avatar can see it. In this case, even if the other avatar is within the information sharing range of the first avatar, the other avatar cannot communicate with the first avatar. Furthermore, when the first avatar is communicating with the second avatar while moving, the first avatar approaches the other avatar, and the first avatar and the other avatar are within the information sharing range of the first avatar, the first avatar cannot communicate with the other avatar.

[0158] The application control unit 55 may enable communication between the first user and the second user when, while the first user is using the first avatar to communicate with a user of another avatar at a location to which the first avatar has moved or when communication is possible, the second user uses the second avatar to request communication from the ghost of the first avatar, communication between the first user and the second user is reserved, and communication between the user of the first avatar and the user of the other avatar has ended or communication is no longer possible.

[0159] The processing in the information processing device 50 will be described with reference to Fig. 15. The processing shown in Fig. 15 is processing in the information processing device 50 based on the operation of the first information terminal device 10 of the first user in the information processing device 50. The processing in steps S401 to S403 and steps S405 to S411 is the same as the processing in steps S301 to S403 and steps S34 to S310 in the flowchart shown in Fig. 14.

[0160] The information processing device 50 determines whether the first avatar is communicating with another avatar or is in a state where it can communicate with another avatar (step S404). More specifically, the information processing device 50 determines, via the application control unit 55, whether the first avatar is communicating with another avatar or is in a state where it can communicate with another avatar on the virtual office screen. If the information processing device 50 determines that the first avatar is communicating with another avatar or is in a state where it can communicate with another avatar (Yes in step S401), the process proceeds to step S402. If the information processing device 50 does not determine that the first avatar is communicating with another avatar or is in a state where it can communicate with another avatar (No in step S401), the process proceeds to step S310.

[0161] Furthermore, if the determination in step S404 is Yes, the information processing device 50 may reserve communication between the first user and the second user via the application control unit 55. Then, when communication between the user of the first avatar and the user of another avatar has ended or when communication is no longer possible, the information processing device 50 may enable communication between the first user and the second user via the application control unit 55.

[0162] (effect) As described above, in this embodiment, when a first user is using a first avatar to move the first avatar and is not communicating with other avatar users at a location where the first avatar has moved, or when the location is not in a state where communication is possible, and a second user uses a second avatar to request communication from the ghost of the first avatar, communication between the first user and the second user is enabled. This embodiment can appropriately enable communication between the first user and the second user without interrupting communication already being conducted by the first user with other users.

[0163] In this embodiment, when a first user is using the first avatar to communicate with a user of another avatar at a location where the first avatar has moved, or when communication is possible, and a second user uses the second avatar to request communication from the ghost of the first avatar, communication between the first user and the second user is reserved. In this embodiment, when communication between the user of the first avatar and the user of the other avatar has ended, or when communication is no longer possible, communication between the first user and the second user is enabled. In this embodiment, when the first user is able to communicate with the second user, smooth communication between the first user and the second user is enabled.

[0164] The components of the virtual space control system shown in the figure are conceptual and functional, and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0165] The configuration of the virtual space control system is realized, for example, as software, by a program loaded into memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, using only hardware, only software, or a combination of both.

[0166] The above-described components include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the above-described configurations can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the spirit of the present invention.

[0167] In the above description, the ghost of the first avatar is displayed when the first user moves into the conference room, but the following may also be done. The ghost of the first avatar may not be displayed during a highly important conference, for example, by setting the importance of the conference in the conference schedule information. Alternatively, during a highly important conference, when the second user enters the information range of the ghost of the first avatar, a choice may be displayed on the second information terminal device 10 of the second user asking, "We are in an important conference. Would you like to speak to me?", and if the second user selects "Yes (speak to me)," communication between the first and second users may be enabled. [Explanation of symbols]

[0168] 1 Virtual space control system 10 Information terminal device 11 Camera 12 microphones 13 Control section 17 Display section 18 Audio output section 19 Communications Department 20 Terminal control device 21 Video acquisition unit 22 Voice acquisition unit 23 Operation reception section 24 Application control section 26 Memory section 27 Display control unit 28 Audio output control unit 29 Communication control section 30 Server device 31 Communications Department 40 Server control device 41 Communication control unit 42 Virtual Office Control Unit 49 Memory section 50 Information processing equipment 51 Avatar position detection unit 52 Operation detection unit 55 Application control section 58 Display control unit 59 Audio output control unit

Claims

1. A virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user of the information terminal device in the virtual space, The information processing device included in the virtual space control system includes: When a first avatar corresponding to a first user moves in the virtual space, the first avatar is displayed at a location to which the first avatar has moved, and a temporary first avatar is displayed at a location before the first avatar moved; When a second user makes a communication request to the temporary first avatar using a second avatar corresponding to the second user, communication between the first user and the second user is enabled while communication between the first user and users of other avatars present in the vicinity of the first avatar is restricted. Virtual space control system.

2. The information processing device includes: The temporary first avatar is displayed in a different display form from the first avatar. The virtual space control system according to claim 1 .

3. The information processing device includes: When the first avatar moves from a belonging section to which the first user belongs and is placed to outside the belonging section in the virtual space, the first avatar is displayed outside the belonging section, and the temporary first avatar is displayed at the position of the first avatar before the movement within the belonging section. The virtual space control system according to claim 1 .

4. The information processing device includes: When the first user is not using the first avatar to communicate with a user of another avatar at a location to which the first avatar has been moved, or when the user is not in a state where communication is possible, and when the second user uses the second avatar to make a communication request to the temporary first avatar, communication between the first user and the second user is enabled. The virtual space control system according to claim 1 .

5. The information processing device includes: When the second user uses the second avatar to make a communication request to the temporary first avatar, if the first avatar is in a state in which it can communicate with other avatars present in the section in which the first avatar is present, the first user and the second user can communicate with each other in a state in which the first user's voice output to users of the other avatars present in the section is restricted. The virtual space control system according to claim 1 .

6. The information processing device includes: When the first user is using the first avatar to communicate with a user of another avatar at a location to which the first avatar has been moved, or when communication is possible, and the second user uses the second avatar to make a communication request to the temporary first avatar, communication between the first user and the second user is reserved, and when communication between the user of the first avatar and the user of the other avatar has ended or communication is no longer possible, communication between the first user and the second user is enabled. The virtual space control system according to claim 1 .

7. The information processing device includes: When the second user uses the second avatar to request communication with the temporary first avatar, a temporary second avatar is displayed at a location to which the first avatar has been moved on at least an information terminal device used by the first user. The virtual space control system according to any one of claims 1 to 6.

8. The information processing device includes: When the first avatar moves, the temporary first avatar is displayed at a position where the first avatar has been present for the longest time in the vicinity of the position of the first avatar before the movement, or at a position assigned to the first avatar. The virtual space control system according to claim 1 .

9. 1. A virtual space control method executed by a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user of the information terminal device in the virtual space, comprising: When a first avatar corresponding to a first user moves in the virtual space, the first avatar is displayed at a location where the first avatar has moved, and a temporary first avatar is displayed at a location where the first avatar has moved; When a second user makes a communication request to the temporary first avatar using a second avatar corresponding to the second user, communication between the first user and the second user is enabled in a state in which communication between the first user and users of other avatars present in the vicinity of the first avatar is restricted, A virtual space control method executed by a virtual space control system.

Images