Virtual space control system and virtual space control method

Abstract

To appropriately carry out communication in a virtual space.SOLUTION: An information processing apparatus 50 included in a virtual space control system 1 detects the line-of-sight direction of a first user relative to a first display screen included in a first information terminal device 10 used by the first user, detects the display state, on the first display screen, of a second avatar corresponding to a second user who is another user, and while the first user and the second user are not communicating with each other in a virtual space by using a first avatar corresponding to the first user and the second avatar, when a display situation continues for a predetermined period in which the line-of-sight direction of the first user is directed to the face or the eyes of the second avatar displayed on the first display screen, and the second avatar displayed on the first display screen is directed to the direction of the first user, allows the first user and the second user to communicate with each other.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a virtual space control system and a virtual space control method. [Background technology]

[0002] Communication in virtual spaces has become widespread, and communication via avatars within virtual spaces is also being practiced. Technology relating to virtual offices configured in virtual spaces, in which each user uses an avatar to carry out work within the virtual office, is known (see, for example, Patent Document 1). When the avatars are close to each other in the virtual space, or when the avatars are located in the same space within the virtual office, they are able to hear each other's voices and other sounds. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-177677 Summary of the Invention [Problem to be solved by the invention]

[0004] When a user wishes to communicate with another user of an avatar in a virtual space, the user must move the user's avatar to the location of the other user's avatar. For example, when a user moves the user's avatar in the virtual space by performing an operation such as walking, if the distance to the avatar of the other user with whom the user wishes to communicate is far, the movement takes time. Furthermore, when a user moves the location of the user's avatar in the virtual space directly to the location or vicinity of the avatar of the other user with whom the user wishes to communicate, the other user may suddenly see the user as available for communication, which may result in the communication starting before the user is prepared for communication.

[0005] The present disclosure aims to appropriately carry out communication within a virtual space. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objectives, the virtual space control system of the present disclosure is a virtual space control system that displays a virtual space on multiple information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space, wherein an information processing device provided in the virtual space control system detects the gaze direction of the first user relative to a first display screen provided on a first information terminal device used by the first user, and detects the display state of a second avatar corresponding to another second user on the first display screen, and when the first user and the second user are not communicating in the virtual space using the first avatar corresponding to the first user and the second avatar, if the gaze direction of the first user is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as facing the first user for a predetermined period of time, the virtual space control system enables communication between the first user and the second user.

[0007] The virtual space control system according to the present disclosure is a virtual space control system that displays a virtual space on a plurality of information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space, wherein an information processing device provided in the virtual space control system detects the gaze direction of the first user relative to a first display screen provided in a first information terminal device used by a first user, and detects the gaze direction of the second user relative to a second display screen provided in a second information terminal device used by a second user, and enables communication between the first user and the second user when the gaze direction of the first user is directed toward the face or eyes of the second avatar displayed on the first display screen and the state in which the gaze direction of the second user is directed toward the face or eyes of the first avatar displayed on the second display screen continues for a predetermined period of time when the information processing device provided in the virtual space control system detects the gaze direction of the first user relative to a first display screen provided in a first information terminal device used by a first user, and detects the gaze direction of the second user relative to a second display screen provided in a second information terminal device used by a second user, and enables communication between the first user and the second user when the gaze direction of the first user is directed toward the face or eyes of the first avatar displayed on the second display screen and the state in which the gaze direction of the second user is directed toward the face or eyes of the first avatar displayed on the second display screen continues for a predetermined period of time.

[0008] The virtual space control method according to the present disclosure is a virtual space control method executed by a virtual space control system that displays a virtual space on a plurality of information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space, the method detecting the gaze direction of the first user relative to a first display screen provided on a first information terminal device used by the first user, detecting the display state of a second avatar corresponding to another user, a second user, on the first display screen, and enabling communication between the first user and the second user when the first user's gaze direction is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as facing the first user, when the first user and the second user are not communicating in the virtual space using the first avatar corresponding to the first user and the second avatar, respectively, and the second avatar displayed on the first display screen is displayed as facing the first user for a predetermined period of time.

[0009] The virtual space control method according to the present disclosure is a virtual space control method executed by a virtual space control system that displays a virtual space on a plurality of information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space, the method detecting the gaze direction of a first user toward a first display screen provided on a first information terminal device used by a first user, and detecting the gaze direction of a second user toward a second display screen provided on a second information terminal device used by a second user, and enabling communication between the first user and the second user when the first user and the second user are not communicating in the virtual space using a first avatar corresponding to the first user and a second avatar corresponding to the second user, and when the first user's gaze direction is directed toward the face or eyes of the second avatar displayed on the first display screen and this state of the second user's gaze direction being directed toward the face or eyes of the first avatar displayed on the second display screen continues for a predetermined period of time. [Effects of the Invention]

[0010] According to the present disclosure, communication within a virtual space can be carried out appropriately. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of the information processing device according to the first embodiment. [Figure 5] FIG. 5 is a diagram showing an example of a display screen of a virtual office displayed on the display screen of an information terminal device. [Figure 6] FIG. 6 is a flowchart showing an example of a virtual space control method according to the first embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of a virtual space control method according to the second embodiment. [Figure 8] FIG. 8 is a flowchart showing an example of a virtual space control method according to the third embodiment. [Figure 9] FIG. 9 is a flowchart showing an example of a virtual space control method according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A virtual space control system and a virtual space control method according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0013] [First embodiment] (Virtual space control system) FIG. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to a first embodiment. The virtual space control system 1 controls a virtual office configured in a virtual space. The virtual space control system 1 displays a virtual space on multiple information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space. The following embodiment will be described using a virtual office as an example, but the present invention is not limited to virtual offices; it can also be applied to various services that use avatars for communication in various virtual spaces, such as virtual commercial facilities and virtual game spaces.

[0014] In the following description, an information terminal device used by a first user to log in to a virtual office will be referred to as a first information terminal device, and an information terminal device used by another user, a second user, to log in to the virtual office will be referred to as a second information terminal device. A first information terminal device is any information terminal device that is logged in to a virtual office. A second information terminal device is an information terminal device different from the first information terminal device and is any information terminal device that is logged in to the same virtual office as the first information terminal device.

[0015] An overview of the virtual office controlled by the virtual space control system 1 will be described. A user uses an information terminal device 10 to come to work (log in) to the virtual office using their own account and perform work. In the virtual office, an avatar associated with the user is set. When a user logs in to the virtual office using their own information terminal device 10 (described later), the avatar moves to any seat in the virtual office or to a predetermined seat and the user operates and displays the avatar to sit down. The user can operate the avatar to move around the virtual office. In the virtual office, for example, when avatars are close to each other in the virtual office or when avatars are located in the same space, such as a conference room in the virtual office, they can share information in a way that allows them to hear each other's voices.

[0016] In the virtual office, each user can operate their own avatar to move it around the virtual space as if they were walking, for example, to move their avatar close to the avatar of a user with whom they wish to communicate, or to move to a conference room in the virtual office.

[0017] The virtual space control system 1 includes an information terminal device 10 that each user uses for business purposes and logs into the virtual office, and a server device 30.

[0018] (Information terminal device) 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. The information terminal device 10 is a terminal device used by a user who performs work in a virtual office. The information terminal device 10 is a terminal device on which the user executes a virtual office application. The information terminal device 10 is a terminal device through which the user logs in to the virtual office using their own account when logging in to the virtual office.

[0019] The information terminal device 10 is, for example, an information terminal device such as a general-purpose personal computer, a smartphone, or a tablet terminal, etc. The information terminal device 10 is connected to the server device 30 via a network so as to be able to communicate data with it.

[0020] The information terminal device 10 logs in to the virtual office based on the account information of the user who is logged in to the information terminal device 10.

[0021] The information terminal device 10 includes a camera 11 , a microphone 12 , an operation unit 13 , a display unit 17 , an audio output unit 18 , a communication unit 19 , and a terminal control device 20 .

[0022] Camera 11 captures an image in the direction facing information terminal device 10. Camera 11 is disposed at a position where it captures an image in the direction facing display unit 17 of information terminal device 10. In other words, camera 11 captures an image in the direction where a user using information terminal device 10 is located. Camera 11 is disposed, for example, near display unit 17. Camera 11 outputs the captured image to image acquisition unit 21 of terminal control device 20.

[0023] The microphone 12 picks up sounds around the information terminal device 10. The microphone 12 may pick up sounds from the direction facing the display unit 17 of the information terminal device 10, and may be provided in a headset connected to the information terminal device 10. In other words, the microphone 12 picks up sounds spoken by the user using the information terminal device 10 and sounds from the surrounding area. The microphone 12 outputs audio information related to the picked-up sounds to the audio acquisition unit 22 of the terminal control device 20.

[0024] The operation unit 13 is an input device capable of inputting various operations to the information terminal device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the terminal control device 20. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel arranged over the display unit 17, buttons, switches, etc. The operation unit 13 can receive, for example, a key input operation, a click operation, or a touch operation.

[0025] The operation unit 13 can accept operations such as moving an avatar corresponding to the user in the virtual office in any direction on the display screen of the display unit 17. For example, the operation unit 13 accepts operations such as overlapping or placing the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17. For example, the operation unit 13 accepts an operation to change the orientation of the user's avatar in the virtual office on the display screen of the display unit 17.

[0026] By performing an operation such as superimposing one's avatar on another or placing it adjacent to another avatar, communication such as a video call or a voice call can be initiated between users in the virtual office application. Whether a video call or a voice call will be conducted may be set in advance or may be set by the user's operation.

[0027] The display unit 17 displays various types of video including text and images. The display unit 17 is, for example, a display including a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display unit 17 displays a video of a virtual office, etc. In this embodiment, when a video call becomes possible, the display unit 17 outputs a video of the user of another avatar with whom the video call is being made, in other words, a video captured by the camera 11 of the information terminal device 10 used by the user of the other avatar. The display of the display unit 17 is controlled by the display control unit 27.

[0028] The audio output unit 18 is an audio output device that outputs audio from the virtual office. In this embodiment, when the user is using the virtual office, the audio output unit 18 outputs the audio around the user's avatar in the virtual office. When a voice call or video call becomes possible, the audio output unit 18 outputs the audio of the user of another avatar with whom the user is making the voice call or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the user of the avatar. The audio output of the audio output unit 18 is controlled by the audio output control unit 28.

[0029] The communication unit 19 is a communication unit for performing wired communication or wireless communication. The communication unit 19 performs communication using a communication method such as Wi-Fi (registered trademark) or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 19 is controlled by a communication control unit 29. The communication unit 19 communicates data such as video and audio or application operation information with the server device 30. The communication unit 19 communicates data such as account information of a user logged in to the information terminal device 10 and application operation status information with the server device 30.

[0030] (Terminal Control Device) The terminal control device 20 controls each part of the information terminal device 10. The terminal control device 20 has, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to the present disclosure. The terminal control device 20 may be realized by an integrated circuit such as an ASIC or an FPGA. The terminal control device 20 loads a stored program into memory and executes instructions included in the program. The terminal control device 20 includes an internal memory such as the RAM described above, and the internal memory is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be realized by a combination of hardware and software.

[0031] The terminal control device 20 has functional blocks realized by circuits and executed programs, including a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a gaze detection unit 25, a memory unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0032] The video acquisition unit 21 acquires video captured by the camera 11. More specifically, the video acquisition unit 21 acquires video captured by the camera 11 of a user facing the information terminal device 10, etc. The video data acquired by the camera 11 is a moving image.

[0033] The voice acquisition unit 22 acquires the voice detected by the microphone 12. The voice acquisition unit 22 acquires voice such as the voice spoken by a user present in the vicinity of the information terminal device .

[0034] The operation reception unit 23 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0035] The operation accepting unit 23 accepts operations on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to move the user's own avatar in the virtual office on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to overlap or place the user's own avatar in the virtual office on or adjacent to another avatar on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to change the orientation of the user's own avatar in the virtual office on the display screen of the display unit 17.

[0036] The application control unit 24 controls the operation of various applications executed on the information terminal device 10. The applications operated by the application control unit 24 may be controlled in cooperation with a virtual office control unit 42 of the server device 30, which will be described later.

[0037] The application control unit 24 causes a display control unit 27, which will be described later, to display on the display unit 17 a display related to an application running on the information terminal device 10. The display related to the application is a display screen such as a window or an icon that shows the display related to the application to the user of the information terminal device 10.

[0038] When the user of the information terminal device 10 is logged in to the virtual office, the application control unit 24 makes the virtual office executed by the virtual office control unit 42 of the server device 30 available to the information terminal device 10 .

[0039] When a virtual office application is being executed on the information terminal device 10, the application control unit 24 shares information using the display control unit 27 and the audio output control unit 28 based on an information sharing range set around an avatar corresponding to the user of the information terminal device 10. Furthermore, when a video call with an avatar corresponding to another user is started while the virtual office application is being executed on the information terminal device 10, the application control unit 24 performs the video call using the display control unit 27 and the audio output control unit 28.

[0040] The application control unit 24 displays a display screen (window) of the virtual office application on the display screen of the information terminal device 10.

[0041] The application control unit 24 arbitrarily changes the position of the avatar displayed on the display screen of the virtual office based on a user operation. For example, the application control unit 24 arbitrarily changes the orientation of the avatar displayed on the display screen of the virtual office based on a user operation.

[0042] When a video call becomes possible, the application control unit 24 causes the first information terminal device 10 in which the first user is logged in to the virtual office and the second information terminal device 10 in which the second user is logged in to the virtual office to mutually display images of faces, etc. More specifically, the application control unit 24 of the terminal control device 20 of the first information terminal device 10 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10. Similarly, the application control unit 24 of the terminal control device 20 of the second information terminal device 10 causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0043] When the video call is stopped, the application control unit 24 stops the video call between the first user and the second user.

[0044] The gaze detection unit 25 detects the user's gaze direction with respect to the virtual office on the display screen of the display unit 17. A known method for gaze detection can be used, and is not limited to this. From the image of the user's eyes captured by the camera 11, the gaze detection unit 25 associates the user's gaze direction with the display range in which the virtual office is displayed on the display screen of the display unit 17 based on the position of the camera 11 and the position of the display unit 17. From the image of the user's eyes captured by the camera 11, the gaze detection unit 25 detects whether the user's gaze direction is directed toward the face or eyes of another user's avatar on the display screen of the display unit 17, or toward the surrounding area. In this embodiment, the gaze detection unit 25 detects that the gaze direction of a first user present in front of the display unit 17 of the first information terminal device 10 is directed toward the face or eyes of a second avatar, which is another avatar, displayed on the display screen of the first information terminal device 10. The gaze detection unit 25 transmits the detection result to the server device 30.

[0045] The area around the face or eyes of another user's avatar refers to the area including the area around the head of the other avatar.

[0046] The storage unit 26 stores information such as the calculation contents and programs of the terminal control device 20. The storage unit 26 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or an HDD (Hard Disk Drive).

[0047] The storage unit 26 stores programs and setting information relating to applications used in the information terminal device 10, such as a virtual office application.

[0048] The following describes the information sharing range and information sharing set for avatars in a virtual office. In the virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and is the range in which information can be shared between multiple users who are included in the information sharing range. One example of information sharing in the information sharing range is mutual sharing of audio. In other words, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Furthermore, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Information that can be shared in the information sharing range is not limited to audio, but also includes other information such as video and text. In this embodiment, the information sharing range is described as an example in which audio is shared.

[0049] For example, when a second avatar enters the information sharing range of a first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Furthermore, when a second avatar enters the information sharing range of a first avatar and a first avatar enters the information sharing range of the second avatar, two-way voice sharing occurs, allowing each user to sense the other's presence and to converse without any special operations. Therefore, the information sharing range can also be referred to as the voice sharing range. Specifically, when a first avatar and a second avatar are within each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar can be heard in the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar can be heard in the information terminal device 10 used by the first user.

[0050] It is also possible to set up a space that allows information sharing among all avatars within a specific range, such as a conference room set up in a virtual office. Outside of such a set space, the information sharing range is set for each avatar.

[0051] The display control unit 27 controls the display of various images on the display unit 17. The display control unit 27 controls the display of an image of the virtual office on the display unit 17. In this embodiment, when the information to be shared includes an image or text, the display control unit 27 outputs the image or text to the display unit 17. Furthermore, when a video call becomes possible, the display control unit 27 outputs an image of the user's virtual office avatar to the display unit 17. The display control unit 27 controls the display of an image related to the virtual office on the display unit 17 based on an image output instruction from the application control unit 24 to the display unit 17.

[0052] The audio output control unit 28 controls the output of audio in the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user of another avatar who is present within the information sharing range in the virtual office. Furthermore, when a video call becomes possible, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user who is the other party in the video call.

[0053] The communication control unit 29 controls the communication unit 19 to transmit and receive data such as video and audio to and from the server device 30, and to transmit and receive operation status information of the application. More specifically, the communication control unit 29 controls, for example, the communication unit 19 to receive video and audio of the virtual office from the server device 30. The communication control unit 29 controls, for example, the communication unit 19 to transmit to the server device 30, video and audio of the user facing the display unit 17 of the information terminal device 10, acquired by the video acquisition unit 21 and the audio acquisition unit 22. The operation status information of the application includes, for example, in the case of a virtual office application, the operation of an avatar by the operation unit 13, and the operation of starting and ending a video call.

[0054] (Server device) FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. The server device 30 is a server device of a company to which the users of the information terminal devices 10 belong, or a server device of a business entity that provides a virtual office service, and may be a general-purpose server device including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 includes a communication unit 31 and a server control device 40.

[0055] The communication unit 31 is a communication unit for performing wired communication or wireless communication. The communication unit 31 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 31 is controlled by a communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operation status information with multiple information terminal devices 10.

[0056] (Server control device) The server control device 40 controls each unit of the server device 30. The server control device 40 includes, for example, a control device such as a CPU or MPU, and a storage device such as a RAM or ROM. The server control device 40 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The server control device 40 may be realized by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to the present disclosure.

[0057] The server control device 40 includes a communication control unit 41, a virtual office control unit 42, and a storage unit 49 as functional blocks realized by circuits and programs that are executed.

[0058] The communication control unit 41 controls the communication unit 31 to transmit and receive data including video and audio to and from the information terminal device 10, and to transmit and receive operation status information of applications, etc. The communication control unit 41, for example, controls the communication unit 31 to receive from the information terminal device 10 video captured by the camera 11 of the information terminal device 10 and audio collected by the microphone 12 of the information terminal device 10. The communication control unit 41, for example, controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. The operation status information of the application is, for example, configuration information of the virtual office application.

[0059] The virtual office control unit 42 controls the operation of various applications running on the server device 30. For example, the virtual office control unit 42 controls the operation of a virtual office application. For example, the virtual office control unit 42 controls the operation of an application used for online communication.

[0060] The virtual office control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 that is executing the application via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged in to the virtual office.

[0061] The storage unit 49 stores information such as the contents of calculations and programs of the server control device 40. The storage unit 49 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or HDD.

[0062] The storage unit 49 stores information indicating a virtual office configured in a virtual space. For each user who logs in to the virtual office, the storage unit 49 stores information indicating an avatar, an information terminal device 10 associated with the avatar, and a user account of the information terminal device 10. The storage unit 49 stores information indicating the layout of objects that configure the virtual office, such as the sections that configure the virtual office and virtual desks.

[0063] (Information processing device) An example of the configuration of an information processing device according to the first embodiment will be described with reference to FIG. 4. FIG. 4 is a block diagram showing an example of the configuration of an information processing device according to the first embodiment. The information processing device 50 is a conceptual device realized by the cooperation of either or both of the server device 30 and a plurality of information terminal devices 10 used in the virtual office. Either the information terminal devices 10 or the server device 30 may be the information processing device 50, or the virtual space control system 1 including the information terminal devices 10 and the server device 30 may be the information processing device 50. Each unit of the information processing device 50 is realized by the cooperation of either or both of the terminal control device 20 and the server control device 40.

[0064] The information processing device 50 detects the gaze direction of the first user relative to the first display screen of the first information terminal device 10 used by the first user. The information processing device 50 detects the display state of a second avatar corresponding to another user, a second user, on the first display screen. When the first user and the second user are not communicating in the virtual office using the first avatar and the second avatar corresponding to the first user, the information processing device 50 enables communication between the first user and the second user if the first user's gaze direction is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as facing the first user for a predetermined period of time.

[0065] The information processing device 50 enables communication between the first user and the second user when the first user's gaze direction is directed toward the face or eyes of the second avatar and the second avatar's gaze is displayed as being directed toward the first user for a predetermined period of time while the first user and the second user are not communicating via the virtual office.The information processing device 50 enables communication between the first user and the second user when the first user and the second avatar's gaze meet over the display screen for a predetermined period of time while the first user and the second user are not communicating via the virtual office.

[0066] 4, information processing device 50 includes avatar position detection unit 51, avatar orientation detection unit 52, application control unit 55, display control unit 58, and audio output control unit 59. For example, avatar position detection unit 51 and avatar orientation detection unit 52 may be realized by server control device 40, application control unit 55 may be realized by cooperation between terminal control device 20 and server control device 40, and display control unit 58 may be realized by terminal control device 20, but this is not limitative.

[0067] The avatar position detection unit 51 detects the positions of the avatars in the virtual office, thereby detecting the positions of a first avatar corresponding to a first user and a second avatar corresponding to a second user. Based on the positions of the first avatar and the second avatar, the avatar position detection unit 51 detects that the distance between the first avatar and the second avatar in the virtual space is equal to or greater than a predetermined distance.

[0068] The avatar position detection unit 51 detects a first avatar that has entered an information sharing range of a second avatar in the virtual office.

[0069] The avatar position detection unit 51 detects a first avatar that has gone out of an information sharing range of a second avatar in the virtual office.

[0070] When the information processing device 50 is implemented in the information terminal device 10, the avatar position detection unit 51 only needs to detect a second user corresponding to a first user who is logged in to the information terminal device 10. When the information processing device 50 is implemented in the server device 30, the avatar position detection unit 51 only needs to detect a second user for each of all users.

[0071] The avatar orientation detection unit 52 detects the display state of the avatar corresponding to another user displayed on the display screen. In this embodiment, the avatar orientation detection unit 52 detects the display state of an avatar corresponding to another user displayed on the display screen that is not engaged in communication such as information sharing or video calling between the avatars.

[0072] In this embodiment, the avatar orientation detection unit 52 detects the display state of a second avatar corresponding to a second user, another user, on the first display screen of the first information terminal device 10 used by the first user. In other words, the avatar orientation detection unit 52 detects the gaze direction of the second avatar displayed on the first display screen. For example, the avatar orientation detection unit 52 detects that the gaze direction of the second avatar displayed on the first display screen is directed toward the first user. For example, when the face of the second avatar is displayed facing forward on the first display screen, the avatar orientation detection unit 52 detects that the gaze direction of the second avatar is directed toward the first user.

[0073] The application control unit 55 enables communication between the first user and the second user when, while the first user and the second user are not communicating within the virtual office using a first avatar and a second avatar corresponding to the first user, the first user's gaze is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as if it is facing the first user for a predetermined period of time. The application control unit 55 enables communication between the first user and the second user when, while the first user and the second user are not communicating via the virtual office, the first user's gaze is directed toward the face or eyes of the second avatar and the second avatar's gaze is displayed as if it is facing the first user for a predetermined period of time (hereinafter referred to as "eye contact"). The application control unit 55 enables communication between the first user and the second user when, while the first user and the second user are not communicating via the virtual office, the first user and the second user's gaze meet over the display screen for a predetermined period of time.

[0074] The gaze detection unit 25 of the first information terminal device 10 detects whether the gaze direction of the first user is directed toward the face or eyes of the second avatar.

[0075] The avatar direction detection unit 52 detects whether the second avatar is displayed with its line of sight facing the first user.

[0076] The predetermined time is, for example, a time of about 3 seconds or more and 5 seconds or less.

[0077] Enabling communication between the first user and the second user means enabling information sharing, video calls, etc. For example, the application control unit 55 displays an image of communication method options on the display screen of the display unit 17 of the information terminal device 10. Then, the application control unit 55 enables communication using the communication method selected by a user operation.

[0078] The communication method options are displayed on the display screen of the first information terminal device 10 used by the first user. For example, the communication method options may be displayed near the second avatar on the display screen of the first information terminal device 10 used by the first user.

[0079] When the communication method is limited to one method, the display of communication method options will indicate whether or not to communicate using that communication method. For example, options such as "Voice call / No voice call" will be displayed. When multiple communication methods can be selected, options to select between those communication methods will be displayed. For example, options such as "Voice call / Video call" will be displayed.

[0080] At this time, the display screen of the second information terminal device 10 used by the second user, who is the user of the second avatar A2, may display a message indicating that there is a communication request from the first user, or, when the first user performs an operation to select a communication method, may display an option to select whether or not to accept communication with the first user.

[0081] The application control unit 55 enables communication between the first user and the second user when the first user and the second user make eye contact while the distance between the first avatar and the second avatar in the virtual office is greater than or equal to a predetermined distance.

[0082] The predetermined distance is, for example, a distance that takes 5 seconds or more to move (walk) an avatar within the virtual office until both avatars are included in the information sharing range and communication becomes possible.

[0083] The application control unit 55 enables communication between the first user and the second user when the distance between the first avatar and the second avatar in the virtual office is greater than or equal to a predetermined distance, the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, and the second avatar displayed on the first display screen appears to be facing the first user for a predetermined period of time.

[0084] When the first user and the second user make eye contact, the application control unit 55 may enable communication through information sharing limited to the first user and the second user. In this case, even if another avatar enters the information sharing range of the first avatar or the second avatar while the first user and the second user are sharing information, the user of the other avatar will not share information with the first user or the second user.

[0085] When the first user and the second user make eye contact, the application control unit 55 may enable communication through information sharing not limited to the first user and the second user. In this case, when the first user and the second user are sharing information, if another avatar enters the information sharing range of the first avatar or the second avatar, the user of the other avatar can share information with the first user and the second user.

[0086] At this time, the display screen of the first information terminal device 10 used by the first user and the display screen of the second information terminal device 10 used by the second user may display a message indicating that there is a communication request in the vicinity of another avatar, or may display an option to select whether or not to accept the communication.

[0087] When enabling communication between a first user and a second user by making eye contact, the application control unit 55 may share information in a manner different from when enabling communication by entering an information sharing range. In this case, for example, the application control unit 55 may acquire the relative positional relationship between the first avatar and the second avatar so that audio can be heard in either the left or right channel corresponding to the direction of the other user's avatar.

[0088] The display control unit 58 causes the display units 17 of the multiple information terminal devices 10 to display images showing various types of information, such as a virtual office screen.

[0089] When a video call becomes possible, the display control unit 58 causes images of faces and the like to be displayed on the first information terminal device 10 and the second information terminal device 10. More specifically, the display control unit 58 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10, and causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0090] When the video call is stopped, the display control unit 58 stops the video sharing between the first user and the second user.

[0091] When a second avatar enters the information sharing range of a first avatar, the audio output control unit 59 enables the second user to share the audio of the first user. Furthermore, when the second avatar is within the information sharing range of the first avatar and the first avatar is within the information sharing range of the second avatar, the second user can share the audio of the first user, and the first user can share the audio of the second user. In other words, the first and second users can share audio, enabling them to have audio conversations. More specifically, when audio sharing is enabled, the audio output control unit 59 enables the first information terminal device 10 used by the first user corresponding to the first avatar and the second information terminal device 10 used by the second user corresponding to the second avatar, logged in to the virtual office, to hear each other's voices. More specifically, the audio output control unit 59 outputs the voice of the second user picked up by the microphone 12 of the second information terminal device 10 from the audio output unit 18 of the first information terminal device 10, and outputs the voice of the first user picked up by the microphone 12 of the first information terminal device 10 from the audio output unit 18 of the second information terminal device 10.

[0092] When the first user and the second user make eye contact and enter into a state in which they can share information, the audio output control unit 59 enables the first user and the second user to share audio, enabling communication such as audio conversation.

[0093] The audio output control unit 59 stops audio sharing between the first user and the second user when the first avatar and the second avatar are no longer included in the information sharing range due to the movement of the avatars, or when an operation to stop audio sharing is performed.

[0094] 5 is a diagram showing an example of a virtual office display screen displayed on the display screen of an information terminal device. In the following description, avatar A1 is the first avatar, avatar A2 is the second avatar, avatar A3 is the third avatar, avatar A4 is the fourth avatar, and avatar A5 is the fifth avatar. The user of the first avatar A1 is the first user, and the user of the second avatar A2 is the second user. Similarly, the user of the third avatar A3 is the third user, the user of the fourth avatar A4 is the fourth user, and the user of the fifth avatar A5 is the fifth avatar.

[0095] As shown in Figure 5, an information sharing range is set around each avatar. The information sharing range does not need to be displayed at all times. An information sharing range C1 is set around the first avatar A1, and an information sharing range C2 is set around the second avatar A2. Similarly, an information sharing range C3 is set around the third avatar A3, an information sharing range C4 is set around the fourth avatar A4, and an information sharing range C5 is set around the fifth avatar A5.

[0096] In FIG. 5, the first avatar A1 and the second avatar A2 are separated by a predetermined distance in the virtual office and are not included in each other's information sharing range, so they are not sharing information such as voice. The first avatar A1 and the second avatar A2 are not making a video call or sharing voice. Therefore, the first user and the second user are not communicating via the virtual office. The third avatar A3 and the fourth avatar A4 are included in each other's information sharing range, so they are sharing information such as voice.

[0097] 5, the second avatar A2 is displayed as facing the first user (front). The third avatar A3, the fourth avatar A4, and the fifth avatar A5 are not displayed as facing the first user (front). Therefore, the display screen of the information terminal device 10 used by the second user of the second avatar A2 displays the virtual office in the direction in which the second avatar A2 is facing, and therefore the first avatar A1 is displayed as facing the second avatar A2.

[0098] (Virtual space control method) A virtual space control method will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of a virtual space control method according to the first embodiment. The processing shown in Fig. 6 is executed while a virtual office is provided by the virtual space control system 1. While logged in to the virtual office on the information terminal device 10, a screen showing the virtual office is displayed or is in a state where it can be displayed on the display screen of the information terminal device 10.

[0099] The information processing device 50 determines, using the avatar orientation detection unit 52, whether or not there is another avatar that is displayed as facing the direction of the first user (step S101). More specifically, the information processing device 50 determines, using the avatar orientation detection unit 52, whether or not there is another avatar that is displayed as facing forward. If the information processing device 50 determines, using the avatar orientation detection unit 52, that there is another avatar that is displayed as facing the direction of the first user (Yes in step S101), the information processing device 50 proceeds to step S102. If the information processing device 50 does not determine, using the avatar orientation detection unit 52, that there is another avatar that is displayed as facing the direction of the first user (No in step S101), the information processing device 50 ends the processing of this flowchart.

[0100] When it is determined that there is another avatar that is displayed as facing the first user (Yes in step S101), the information processing device 50 determines, via the application control unit 55, whether or not the first user's gaze is directed toward the other avatar (step S102). More specifically, the information processing device 50 determines, via the application control unit 55, from the detection result of the gaze detection unit 25, whether the direction in which the first user's gaze is directed is toward the face or eyes of the other avatar on the display screen of the display unit 17, or toward the surrounding area thereof. When the information processing device 50 determines, via the application control unit 55, that the first user's gaze is directed toward the other avatar (Yes in step S102), the information processing device 50 proceeds to step S103. When the information processing device 50 does not determine, via the application control unit 55, that the first user's gaze is directed toward the other avatar (No in step S102), the processing of this flowchart ends.

[0101] When it is determined that the line of sight of the first user is directed toward the other avatar (Yes in step S102), the information processing device 50 determines, via the application control unit 55, whether or not a predetermined time has passed since the state in which the first user and the second avatar are directed toward each other (step S103). When the information processing device 50 determines, via the application control unit 55, that the predetermined time has passed since the state in which the first user and the second avatar are directed toward each other (Yes in step S103), the information processing device 50 proceeds to step S104. When the information processing device 50 does not determine, via the application control unit 55, that the predetermined time has passed since the state in which the first user and the second avatar are directed toward each other (No in step S103), the information processing device 50 ends the processing of this flowchart.

[0102] When it is determined that the state in which the two avatars are facing each other has continued for a predetermined time (Yes in step S103), the information processing device 50 causes the application control unit 55 to display options for communication methods to the other avatar. More specifically, the information processing device 50 causes the application control unit 55 to display the options for communication methods near the other avatar on the display screen of the first information terminal device 10 used by the first user (step S104). The information processing device 50 proceeds to step S105.

[0103] The information processing device 50 determines, via the application control unit 55, whether or not a communication method has been selected (step S105). The information processing device 50 determines, via the application control unit 55, whether or not a communication method has been selected by the first user in the first information terminal device 10 used by the first user. If the information processing device 50 determines, via the application control unit 55, that a communication method has been selected (Yes in step S105), the process proceeds to step S106. If the information processing device 50 does not determine, via the application control unit 55, that a communication method has been selected (No in step S105), the process ends in this flowchart.

[0104] When it is determined that a communication method has been selected (Yes in step S105), the information processing device 50 enables communication using the application control unit 55 (step S106). More specifically, the information processing device 50 enables information sharing in a virtual office between the first user and users of other avatars, or activates a video call function, depending on the selected communication method using the application control unit 55. The information processing device 50 controls the display control unit 58 to display images of faces and the like on the first information terminal device 10 and the second information terminal device 10, respectively. The information processing device 50 controls the audio output control unit 59 to enable audio such as voices to be heard between the first information terminal device 10 and the second information terminal device 10, respectively. The information processing device 50 proceeds to step S107.

[0105] The information processing device 50 determines whether an operation to end communication in the virtual office has been performed (step S107). More specifically, the information processing device 50 determines that an operation to end communication in the virtual office has been performed when, for example, an operation to end communication in the virtual office is detected. If the information processing device 50 determines that an operation to end communication has been performed (Yes in step S107), the information processing device 50 proceeds to step S108. If the information processing device 50 does not determine that an operation to end communication has been performed (No in step S107), the information processing device 50 executes the processing of step S107 again.

[0106] When it is determined that an operation to end communication has been performed (Yes in step S107), the information processing device 50 causes the application control unit 55 to cancel the communication enabled state (step S108). More specifically, the information processing device 50 causes the application control unit 55 to cancel information sharing in a virtual office between the first user and the user of another avatar, or to terminate the video call function, depending on the communication method. The information processing device 50 causes the display control unit 58 to terminate the display of images of faces and the like between the first information terminal device 10 and the second information terminal device 10. The information processing device 50 causes the audio output control unit 59 to terminate the state in which audio such as voices can be heard between the first information terminal device 10 and the second information terminal device 10.

[0107] This process is performed for all users who are logged into the virtual office.

[0108] In step S101, among other avatars displayed on the display screen of the first information terminal device 10 used by the first user, avatars that appear to be facing the first user are detected. The other avatars to be detected are avatars that are not engaged in communication such as information sharing or video calls with other avatars. In FIG. 5, the second avatar A2 and the fifth avatar A5 are the detection targets, while the third avatar A3 and the fourth avatar A4 are not the detection targets. The second avatar A2 is displayed as facing the first user. The other avatars to be detected may be avatars that are located at a predetermined distance or more in the virtual office. In FIG. 5, the other avatars that are located at a predetermined distance or more from the first avatar A1 are the second avatar A2 and the fifth avatar A5.

[0109] In step S102, the gaze direction of the first user present in front of the display screen of the first information terminal device 10 is detected from the detection result of the gaze detection unit 25. The gaze detection unit 25 of the first information terminal device 10 may constantly detect the gaze direction of the first user, or may start gaze detection after step S101 becomes Yes. From the detection result of the gaze detection unit 25, the direction in which the first user's gaze is directed on the display screen is detected and compared with the positions of other avatars displayed on the display screen. In FIG. 5, it is determined whether the first user's gaze is directed in the direction of the second avatar A2.

[0110] In step S103, it is determined whether the state of "Yes" in step S101 and the state of "Yes" in step S102 have continued for a predetermined time. If at least one of step S101 and step S102 becomes "No" before the predetermined time has elapsed, the determination in step S103 is "No."

[0111] In step S104, on the display screen of the first information terminal device 10 of the first user, an image of communication method options is displayed near the other avatar for which the answer in step S101 is Yes, in FIG. 5, the second avatar A2.

[0112] In step S105, it is determined whether or not communication is selected using the communication method displayed in step S104. It is determined whether or not an operation such as selecting "voice call" has been performed by the first user operating the first information terminal device 10. Furthermore, it may be determined whether or not an operation to accept communication with the first user has been performed by operating the second information terminal device 10.

[0113] In step S106, communication between the first user and the second user, in other words, communication between the first information terminal device 10 and the second information terminal device 10, for example, voice communication, becomes possible. At this time, even if another avatar enters the information sharing range of the first avatar A1 or the second avatar A2, information sharing with the user of the other avatar does not occur until the state in which communication between the first user and the second user is possible is released in step S108.

[0114] (effect) As described above, in this embodiment, when the first user and the second user are not communicating via the virtual office using the first avatar and the second avatar, if the first user's gaze is directed toward the face or eyes of the second avatar A2 displayed on the first display screen and the second avatar A2 displayed on the first display screen is displayed as if facing the first user for a predetermined period of time, communication between the first user and the second user can be enabled. According to this embodiment, when the first user wishes to communicate with the second user, communication can be enabled without moving the first avatar to the position of the second avatar. This embodiment enables communication within the virtual office when the first avatar and the second avatar make eye contact. This embodiment enables communication while recognizing each other's presence, making it possible to predict when communication will begin. Thus, this embodiment allows appropriate communication within the virtual office.

[0115] In this embodiment, when the distance between the first avatar and the second avatar in the virtual office is equal to or greater than a predetermined distance, if the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as if facing the first user for a predetermined period of time, communication between the first user and the second user can be enabled. According to this embodiment, when the distance between the first avatar and the second avatar in the virtual office is equal to or greater than a predetermined distance, if the first user and the second user make eye contact, communication between the first user and the second user can be enabled.

[0116] In this embodiment, communication by information sharing limited to a first user and a second user can be enabled.

[0117] In this embodiment, when communication is enabled by a first user and a second user making eye contact, information can be shared in a manner different from when communication is enabled by entering an information sharing range. According to this embodiment, for example, when a first user and a second user make eye contact, the relative positional relationship between the first avatar and the second avatar can be obtained, and audio can be heard in either the left or right channel corresponding to the direction of the other user's avatar.

[0118] [Second embodiment] A virtual space control system 1 according to the second embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing an example of a virtual space control method according to the second embodiment. In the following description, components similar to those in the virtual space control system 1 of the first embodiment are given the same or corresponding reference numerals, and detailed description thereof will be omitted. This also applies to the following embodiments. The virtual space control system 1 differs from the first embodiment in the processing in the information processing device 50.

[0119] The avatar orientation detection unit 52 detects the display state of the first avatar displayed on the second display screen of the second information terminal device 10 used by the second user. The avatar orientation detection unit 52 detects the gaze direction of the avatar corresponding to the user displayed on the display screen. In this embodiment, the avatar orientation detection unit 52 detects the orientation of the first avatar corresponding to the first user displayed on the display screen. For example, the avatar orientation detection unit 52 detects that the gaze of the first avatar is displayed in the direction of the second avatar. The gaze direction of the avatar may be the orientation of the avatar. For example, since the face of the first avatar A1 in FIG. 5 is oriented in a direction including the second avatar A2, the avatar orientation detection unit 52 detects that the first avatar A1 is displayed in the direction of the second avatar A2.

[0120] The application control unit 55 enables communication between the first user and the second user when a state in which the first user's gaze direction is directed toward the face or eyes of the second avatar displayed on the first display screen, the first avatar displayed on the first display screen is displayed as facing the direction of the second avatar, and the second avatar displayed on the first display screen is displayed as facing the direction of the first user continues for a predetermined time. The application control unit 55 enables communication between the first user and the second user when a state in which the first user's gaze direction is directed toward the face or eyes of the second avatar, the first avatar is displayed as facing the direction of the second avatar, and the second avatar's gaze is displayed as facing the direction of the first user continues for a predetermined time.

[0121] (Virtual space control method) The virtual space control method will be described with reference to Fig. 7. The processes of steps S201, S203 to S209 in Fig. 7 are the same as those of steps S101, S102 to S108 in Fig. 6.

[0122] The information processing device 50 determines, using the avatar orientation detection unit 52, whether the first avatar is displayed facing the direction of the other avatar (step S202). When the avatar orientation detection unit 52 determines that the first avatar is displayed facing the direction of the other avatar (Yes in step S202), the information processing device 50 proceeds to step S203. When the avatar orientation detection unit 52 does not determine that the first avatar is displayed facing the direction of the other avatar (No in step S202), the information processing device 50 ends the processing of this flowchart.

[0123] In step S202, it is determined whether the first avatar A1 is displayed facing the direction of the other avatar for which the determination in step S201 is Yes, that is, the second avatar A2 in FIG.

[0124] In step S204, it is determined whether the states of "Yes" in step S201 and "Yes" in step S203 have continued for a predetermined time. If at least one of step S201 and step S203 becomes "No" before the predetermined time has elapsed, step S204 is determined to be "No." Furthermore, it may be determined whether the states of "Yes" in step S201, "Yes" in step S202, and "Yes" in step S203 have continued for a predetermined time. If at least one of step S201, step S202, and step S203 becomes "No" before the predetermined time has elapsed, step S204 is determined to be "No."

[0125] (effect) As described above, in this embodiment, when the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, the first avatar displayed on the first display screen is displayed as facing the direction of the second avatar, and the second avatar displayed on the first display screen is displayed as facing the direction of the first user, communication between the first user and the second user can be enabled.

[0126] [Third embodiment] A virtual office control system 1 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of a virtual office control method according to the third embodiment. The virtual office control system 1 differs from the first embodiment in the processing performed by the information processing device 50.

[0127] In this embodiment, the gaze detection unit 25 included in the first information terminal device 10 detects the gaze direction of the first user with respect to a first display screen included in the first information terminal device 10 used by the first user. Also, the gaze detection unit 25 included in the second information terminal device 10 detects the gaze direction of the second user with respect to a second display screen included in the second information terminal device 10 used by the second user.

[0128] The application control unit 55 enables communication between the first user and the second user when, while the first user and the second user are not communicating within the virtual office using a first avatar corresponding to the first user and a second avatar corresponding to the second user, the first user's gaze is directed toward the face or eyes of the second avatar displayed on the first display screen and the second user's gaze is directed toward the face or eyes of the first avatar displayed on the second display screen for a predetermined period of time.

[0129] The application control unit 55 enables communication between the first user and the second user when the distance between the first avatar and the second avatar in the virtual office is greater than or equal to a predetermined distance, the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, and the second user's line of sight is directed toward the face or eyes of the first avatar displayed on the second display screen for a predetermined period of time.

[0130] (Virtual space control method) The virtual space control method will be described with reference to Fig. 8. The processing in steps S304 to S308 in Fig. 8 is the same as that in steps S104 to S108 in Fig. 6.

[0131] The information processing device 50 determines whether the gaze of the first user is directed toward another avatar using the gaze detection unit 25 (step S301). If the gaze detection unit 25 determines that the gaze of the first user is directed toward another avatar (Yes in step S301), the information processing device 50 proceeds to step S302. If the gaze detection unit 25 does not determine that the gaze of the first user is directed toward another avatar (No in step S301), the information processing device 50 ends the processing of this flowchart.

[0132] When it is determined that the first user's gaze is directed toward another avatar (Yes in step S301), the information processing device 50 determines, using the gaze detection unit 25, whether the gaze of the user of the other avatar is directed toward the first avatar (step S302). When the information processing device 50 determines, using the gaze detection unit 25, that the gaze of the user of the other avatar is directed toward the first avatar (Yes in step S302), the information processing device 50 proceeds to step S303. When the information processing device 50 does not determine, using the gaze detection unit 25, that the gaze of the user of the other avatar is directed toward the first avatar (No in step S302), the information processing device 50 ends the processing of this flowchart.

[0133] When it is determined that the gazes of the users of the other avatars are directed toward the first avatar (Yes in step S302), the information processing device 50 determines, via the application control unit 55, whether or not a predetermined time has passed since the users were directed toward each other (step S303). When the information processing device 50 determines, via the application control unit 55, that the predetermined time has passed since the users were directed toward each other (Yes in step S303), the information processing device 50 proceeds to step S304. When the information processing device 50 does not determine, via the application control unit 55, that the predetermined time has passed since the users were directed toward each other (No in step S303), the information processing device 50 ends the processing of this flowchart.

[0134] (effect) As described above, in this embodiment, if the first user and the second user have been facing each other's avatars for a predetermined period of time, communication between them can be enabled. According to this embodiment, for example, when a user wishes to communicate with an avatar located far away, the first user can gaze at the second avatar and the second user can gaze at the first avatar, thereby enabling communication.

[0135] [Fourth embodiment] A virtual office control system 1 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of a virtual office control method according to the fourth embodiment. The virtual office control system 1 differs from the first embodiment in the processing in the information processing device 50.

[0136] The avatar orientation detection unit 52 detects the display state of the second avatar displayed on the first display screen and the display state of the first avatar displayed on the second display screen.

[0137] The application control unit 55 enables communication between the first user and the second user when the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, and the second user's line of sight is directed toward the face or eyes of the first avatar displayed on the second display screen, and the second avatar displayed on the first display screen is displayed as if facing the first user, or the first avatar displayed on the second display screen is displayed as if facing the second user, for a predetermined period of time.

[0138] (Virtual space control method) The virtual space control method will be described with reference to Fig. 9. The processes of steps S405 to S409 in Fig. 9 are the same as those of steps S104 to S108 in Fig. 6. The processes of steps S401 and S402 in Fig. 9 are the same as those of steps S301 and S302 in Fig. 8.

[0139] When it is determined that the gaze of the user of the other avatar is directed toward the first avatar (Yes in step S402), the information processing device 50 determines, using the avatar orientation detection unit 52, whether or not either or both of the first avatar and the other avatar are facing forward (step S403). When it is determined, using the application control unit 55, that either or both of the first avatar and the other avatar are facing forward (Yes in step S403), the information processing device 50 proceeds to step S404. When it is not determined, using the application control unit 55, that either or both of the first avatar and the other avatar are facing forward (No in step S403), the information processing device 50 ends the processing of this flowchart.

[0140] When it is determined that either or both of the first avatar and the other avatar are facing forward (Yes in step S403), the information processing device 50 determines, via the application control unit 55, whether a predetermined time has elapsed during which the first user and the second user are facing each other's avatar and at least one of the avatars is facing forward (step S404). When it is determined, via the application control unit 55, that a predetermined time has elapsed during which the first user and the second user are facing each other's avatar and at least one of the avatars is facing forward (Yes in step S404), the information processing device 50 proceeds to step S405. When it is not determined, via the application control unit 55, that a predetermined time has elapsed during which the first user and the second user are facing each other's avatar and at least one of the avatars is facing forward (No in step S404), the information processing device 50 ends the processing of this flowchart.

[0141] (effect) As described above, in this embodiment, when a first user and a second user are facing each other's avatar and at least one of the avatars is facing forward for a predetermined time, communication between the first user and the second user can be enabled. According to this embodiment, for example, when a user wishes to communicate with an avatar located far away, communication can be enabled if the users are gazing at each other's avatars and at least one of the avatars is facing forward rather than toward the other user.

[0142] The components of the virtual space control system shown in the figure are conceptual and functional, and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0143] The configuration of the virtual space control system is realized, for example, as software, by a program loaded into memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, using only hardware, only software, or a combination of both.

[0144] The above-described components include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the above-described configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible within the scope of the gist of the present invention.

[0145] In the above, when the application control unit 55 of the information processing device 50 determines that the first user's gaze direction is directed toward the face or eyes of the second avatar, or the surrounding area, and the second avatar's gaze is displayed as if it is directed toward the first user, even if the orientation of the first avatar A1 is not exactly directed toward the second avatar A2 due to the first user's operation of the first avatar, the first avatar A1 may be displayed as if it is directed toward the second user on the second information terminal device 10 used by the second user. [Explanation of symbols]

[0146] 1 Virtual space control system 10 Information terminal device 11 Camera 12 microphones 13 Control section 17 Display 18 Audio output section 19 Communications Department 20 Terminal control device 21 Video acquisition unit 22 Voice acquisition unit 23 Operation reception section 24 Application control section 25 Gaze detection unit 26 Memory section 27 Display control unit 28 Audio output control unit 29 Communication control section 30 Server device 31 Communications Department 40 Server control device (control unit) 41 Communication control unit 42 Virtual Office Control Unit 49 Memory section 50 Information processing equipment 51 Avatar position detection unit 52 Avatar orientation detection unit 55 Application control section 58 Display control unit 59 Audio output control unit

Claims

1. A virtual space control system that displays a virtual space on a plurality of information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space, comprising: The information processing device included in the virtual space control system includes: Detecting a line of sight of a first user with respect to a first display screen provided in a first information terminal device used by the first user; detecting a display state of a second avatar corresponding to a second user on the first display screen; When the first user and the second user are not communicating in the virtual space using a first avatar and the second avatar corresponding to the first user, if the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as if facing the first user for a predetermined period of time, communication between the first user and the second user is enabled. Virtual space control system.

2. The information processing device includes: detecting a display state of the first avatar displayed on a second display screen provided in a second information terminal device used by the second user; When the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, the first avatar displayed on the first display screen is displayed as if facing the direction of the second avatar, and the second avatar displayed on the first display screen is displayed as if facing the direction of the first user, this state continues for a predetermined time, enabling communication between the first user and the second user. The virtual space control system according to claim 1 .

3. The information processing device includes: When the distance between the first avatar and the second avatar in the virtual space is equal to or greater than a predetermined distance, and the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, and the second avatar displayed on the first display screen is displayed as if facing the first user, this state continues for a predetermined time, enabling communication between the first user and the second user. The virtual space control system according to claim 1 .

4. A virtual space control system that displays a virtual space on a plurality of information terminal devices and displays avatars corresponding to users of the information terminal devices in the virtual space, comprising: The information processing device included in the virtual space control system includes: Detecting a line of sight of a first user with respect to a first display screen provided in a first information terminal device used by the first user; detecting a line of sight direction of a second user with respect to a second display screen provided in a second information terminal device used by the second user; When the first user and the second user are not communicating in the virtual space using a first avatar corresponding to the first user and a second avatar corresponding to the second user, if the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen and the second user's line of sight is directed toward the face or eyes of the first avatar displayed on the second display screen for a predetermined period of time, communication between the first user and the second user is enabled. Virtual space control system.

5. The information processing device includes: a display state of the second avatar displayed on the first display screen and a display state of the first avatar displayed on the second display screen are detected, and when the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen and the second user's line of sight is directed toward the face or eyes of the first avatar displayed on the second display screen, and the second avatar displayed on the first display screen is displayed as if it is facing the direction of the first user, or when the first avatar displayed on the second display screen is displayed as if it is facing the direction of the second user, this state continues for a predetermined time, enabling communication between the first user and the second user; The virtual space control system according to claim 4 .

6. The information processing device includes: When the distance between the first avatar and the second avatar in the virtual space is equal to or greater than a predetermined distance, and the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen, and the second user's line of sight is directed toward the face or eyes of the first avatar displayed on the second display screen, the state continues for a predetermined time, enabling communication between the first user and the second user. The virtual space control system according to claim 4 .

7. The information processing device includes: enabling communication by sharing information limited to the first user and the second user; 5. The virtual space control system according to claim 1.

8. 1. A virtual space control method executed by a virtual space control system that causes a plurality of information terminal devices to display a virtual space and displays avatars corresponding to users of the information terminal devices in the virtual space, comprising: Detecting a line of sight of a first user with respect to a first display screen provided in a first information terminal device used by the first user; detecting a display state of a second avatar corresponding to a second user on the first display screen; When the first user and the second user are not communicating in the virtual space using a first avatar and the second avatar corresponding to the first user, if the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen and the second avatar displayed on the first display screen is displayed as if facing the first user for a predetermined period of time, communication between the first user and the second user is enabled; A virtual space control method executed by a virtual space control system.

9. 1. A virtual space control method executed by a virtual space control system that causes a plurality of information terminal devices to display a virtual space and displays avatars corresponding to users of the information terminal devices in the virtual space, comprising: Detecting a line of sight of a first user with respect to a first display screen provided in a first information terminal device used by the first user; detecting a line of sight direction of a second user with respect to a second display screen provided in a second information terminal device used by the second user; When the first user and the second user are not communicating in the virtual space using a first avatar corresponding to the first user and a second avatar corresponding to the second user, if the first user's line of sight is directed toward the face or eyes of the second avatar displayed on the first display screen and the second user's line of sight is directed toward the face or eyes of the first avatar displayed on the second display screen for a predetermined period of time, communication between the first user and the second user is enabled. A virtual space control method executed by a virtual space control system.

Images