Virtual space control system and virtual space control method

Abstract

To alleviate feelings of isolation in virtual offices. [Solution] The control unit of the virtual space control system 1 records the audio output from the information terminal device 10 to the virtual office. If the number of other avatars capable of sharing audio that are present around the avatar corresponding to the user in the virtual office is less than a predetermined number, the control unit outputs the audio from the information terminal device 10 used by the user to the information terminal device 10 used by the user.

Description

Technical Field

[0001] The present invention relates to a virtual space control system and a virtual space control method.

Background Art

[0002] Work styles that are not limited by time and place are becoming popular, and it has become possible to perform work such as telecommuting during any time period. Also, even in the case of work by telecommuting using a virtual office (virtual office) configured in a virtual space, it has become possible to share the atmosphere within the company or within the department. There is a known technology that makes it easier for people working in a virtual office and people working in a real office to recognize each other's states (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, depending on the working hours, there may be no one in the department performing other tasks, and even when using a virtual office, there are no people in the department around, so the sense of loneliness may increase.

[0005] The present disclosure aims to eliminate the sense of loneliness in a virtual office.

Means for Solving the Problems

[0006] To solve the above-mentioned problems and achieve the objective, the virtual space control system according to this disclosure is a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to the user of the information terminal device in the virtual space, wherein the control unit of the virtual space control system records the sound output from the information terminal device to the virtual space, and if the number of other avatars that can share sound and are present around the avatar corresponding to the user in the virtual space is less than a predetermined number, it outputs the sound from the information terminal device other than the one used by the user in the recorded sound to the information terminal device used by the user.

[0007] The virtual space control method relating to this disclosure is a virtual space control method performed by a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to the user of the information terminal device in the virtual space, wherein the virtual space control system records the sound output from the information terminal device to the virtual space, and if the number of other avatars that can share the sound present around the avatar corresponding to the user in the virtual space is less than a predetermined number, the system outputs the sound from the information terminal device used by the user to the information terminal device used by the user in the recorded sound. [Effects of the Invention]

[0008] According to this disclosure, it is possible to alleviate feelings of loneliness in virtual offices. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a schematic diagram showing an example configuration of a virtual space control system according to an embodiment. [Figure 2] Figure 2 is a block diagram showing an example configuration of an information terminal device according to an embodiment. [Figure 3] Figure 3 is a block diagram showing an example configuration of a server device according to the embodiment. [Figure 4] Figure 4 shows an example of the time the avatar was within the range where audio could be shared. [Figure 5] Figure 5 shows an example of the display screen of a virtual office as displayed on the display screen of an information terminal device. [Figure 6] Figure 6 shows another example of the virtual office display screen displayed on the information terminal device's display screen. [Figure 7] Figure 7 shows another example of the virtual office display screen displayed on the information terminal device's display screen. [Figure 8] Figure 8 shows another example of the virtual office display screen displayed on the information terminal device's display screen. [Figure 9] Figure 9 is a flowchart showing an example of a virtual space control method according to the embodiment. [Modes for carrying out the invention]

[0010] Embodiments of the virtual space control system and virtual space control method according to the present invention will be described in detail below with reference to the attached drawings. However, the present invention is not limited to the following embodiments.

[0011] [Embodiment] (Virtual Space Control System) Figure 1 is a schematic diagram showing an example configuration of a virtual space control system according to an embodiment. The virtual space control system 1 controls a virtual office configured in the virtual space. In the following embodiments, a virtual office is used as an example for explanation, but it is not limited to virtual offices and can be applied to various services that use avatars for communication in a virtual space.

[0012] In the following explanation, "user" may be referred to as the "first user," and "other users" may be referred to as the "second user." Furthermore, the information terminal device used by the first user to log into the virtual office may be referred to as the first information terminal device, and the information terminal device used by the other user (the second user) to log into the virtual office may be referred to as the second information terminal device. The first information terminal device is any information terminal device logged into the virtual office, while the second information terminal device is a different information terminal device from the first information terminal device, but is any information terminal device logged into the same virtual office as the first information terminal device.

[0013] This section describes the overview of the virtual office controlled by the virtual space control system 1. Users log in to the virtual office using their own account via an information terminal device 10 to perform their duties. In the virtual office, an avatar is set up that corresponds to the user. When a user logs into the virtual office using the information terminal device 10 (described later), the system prompts the user to move their avatar to any seat in the virtual office, or a predetermined seat, and sit down. Users can move around the virtual office by manipulating their avatar. In the virtual office, for example, if avatars are close to each other in the virtual office, or if avatars are located in the same space, such as a conference room, they can share information by hearing each other's voices and other sounds.

[0014] In this embodiment, if the number of other avatars capable of sharing audio around the first avatar corresponding to the first user is less than a predetermined number, the virtual space control system 1 outputs audio other than that used by the first user's information terminal device 10 to the information terminal device 10 used by the first user.

[0015] In this embodiment, the predetermined number is, for example, 2, but an appropriate value will be set depending on the number of people in the department to which the target user belongs and the number of seats in the virtual office.

[0016] If the number of other avatars capable of sharing voice is less than a predetermined number, the number of other avatars located around the avatar is small, and the user of the avatar may feel lonely.

[0017] The virtual space control system 1 includes an information terminal device 10 used by each user for business and the like to log in to a virtual office, and a server device 30.

[0018] The control unit included in the virtual space control system 1 is a conceptual control unit realized by the cooperation of either one or both of the terminal control device 20 of the plurality of information terminal devices 10 used in the virtual office and the server control device 40 of the server device 30. Either the terminal control device 20 of the information terminal device 10 or the server control device 40 of the server device 30 may be used as the control unit included in the virtual space control system 1, or both the terminal control device 20 of the information terminal device 10 and the server control device 40 of the server device 30 may be used as the control unit included in the virtual space control system 1. In the present embodiment, the control unit included in the virtual space control system 1 will be described as the virtual office control unit 42 of the server control device 40 of the server device 30.

[0019] (Information terminal device) FIG. 2 is a block diagram showing a configuration example of an information terminal device according to an embodiment. The information terminal device 10 is a terminal device used by a user who conducts business in a virtual office. The information terminal device 10 is a terminal device for a user to execute an application in a virtual office. The information terminal device 10 is a terminal device for a user to log in to a virtual office with his or her own account when logging in to the virtual office.

[0020] The information terminal device 10 is, for example, an information terminal device such as a general-purpose personal computer, a smartphone, or a tablet terminal. The information terminal device 10 is connected to the server device 30 via a network so as to be capable of data communication.

[0021] The information terminal device 10 logs into the virtual office based on the account information of the user logged into the information terminal device 10.

[0022] The information terminal device 10 includes a camera 11, a microphone 12, an operation unit 13, a display unit 17, an audio output unit 18, a communication unit 19, and a terminal control device 20.

[0023] Camera 11 captures images in the direction facing the information terminal device 10. Camera 11 is positioned to capture images in the direction facing the display unit 17 of the information terminal device 10. In other words, camera 11 captures images in the direction where the user using the information terminal device 10 is located. Camera 11 is positioned, for example, around the display unit 17. Camera 11 outputs the captured image to the image acquisition unit 21 of the terminal control device 20.

[0024] The microphone 12 picks up sounds from the vicinity of the information terminal device 10. The microphone 12 may also pick up sounds coming from the direction opposite to the display unit 17 of the information terminal device 10, and may be provided on a headset connected to the information terminal device 10. In other words, the microphone 12 picks up the voice spoken by the user using the information terminal device 10 and the surrounding sounds. The microphone 12 outputs audio information related to the picked-up voice to the audio acquisition unit 22 of the terminal control device 20.

[0025] The operation unit 13 is an input device capable of receiving various operations for the information terminal device 10. The operation unit 13 outputs an operation signal to the terminal control device 20 corresponding to the received input operation. The operation unit 13 includes, for example, a keyboard, mouse, touch panel arranged on top of the display unit 17, buttons, switches, etc. The operation unit 13 can receive, for example, key input operations, click operations, or touch operations.

[0026] The operation unit 13 can accept operations such as moving the avatar corresponding to the user in the virtual office in any direction on the display screen of the display unit 17. For example, the operation unit 13 can accept operations such as overlapping or placing the user's own avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0027] By overlaying one's own avatar onto another's avatar, or by positioning them adjacent to each other, users can initiate communication such as video calls or voice calls within the virtual office application. Whether to use video or voice calls may be pre-configured or can be set by the user.

[0028] The display unit 17 displays various types of images, including text and images. The display unit 17 is a display including, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. The display unit 17 displays images of a virtual office, etc. In this embodiment, when a video call becomes possible, the display unit 17 outputs the image of the other avatar user making the video call, in other words, the image captured by the camera 11 of the information terminal device 10 used by the other avatar user. The display of the display unit 17 is controlled by the display control unit 27.

[0029] The audio output unit 18 is an audio output device that outputs audio from the virtual office, etc. In this embodiment, when using the virtual office, the audio output unit 18 outputs the audio surrounding the user's avatar in the virtual office. Also, when voice or video calls become possible, the audio output unit 18 outputs the audio of the other avatar user making the voice or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the avatar user. The audio output of the audio output unit 18 is controlled by the audio output control unit 28.

[0030] The communication unit 19 is a communication unit for wired or wireless communication. The communication unit 19 communicates using communication methods such as Wi-Fi (registered trademark) or mobile phone lines, and connects to an intranet or the internet. The communication unit 19 is controlled by the communication control unit 29. The communication unit 19 communicates data such as video and audio, or application operation information, with the server device 30. The communication unit 19 also communicates data such as user account information and application operating status information of users logged into the information terminal device 10 with the server device 30.

[0031] (Terminal control device) The terminal control device 20 controls various parts of the information terminal device 10. The terminal control device 20 includes, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as RAM (Random Access Memory) or ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to this disclosure. The terminal control device 20 may be implemented by an integrated circuit such as an ASIC or FPGA. The terminal control device 20 loads the stored program into memory and executes the instructions contained in the program. The terminal control device 20 includes internal memory such as the aforementioned RAM, and the internal memory is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be implemented by a combination of hardware and software.

[0032] The terminal control device 20 includes, as functional blocks realized by circuits and executed programs, a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a storage unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0033] The video acquisition unit 21 acquires the video captured by the camera 11. More specifically, the video acquisition unit 21 acquires the video captured by the camera 11, which shows a user facing the information terminal device 10. The video data acquired by the camera 11 is a moving image.

[0034] The voice acquisition unit 22 acquires the sound detected by the microphone 12. The voice acquisition unit 22 acquires sounds such as the voice spoken by a user in the vicinity of the information terminal device 10.

[0035] The operation reception unit 23 acquires an operation signal from the operation unit 13 corresponding to the operation performed on the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0036] The operation reception unit 23 receives operations on the display screen of the display unit 17. For example, the operation reception unit 23 receives operations to move the user's avatar in the virtual office on the display screen of the display unit 17. For example, the operation reception unit 23 receives operations to overlap or place the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0037] The application control unit 24 controls the operation of various applications running on the information terminal device 10. The applications running on the application control unit 24 may be controlled in cooperation with the virtual office control unit 42 of the server device 30, which will be described later.

[0038] The application control unit 24 causes the display unit 17 to display information related to the application running on the information terminal device 10, via the display control unit 27, which will be described later. Application-related displays include display screens such as windows and icons that show information related to the application to the user of the information terminal device 10.

[0039] When a user of the information terminal device 10 is logged into the virtual office, the application control unit 24 makes the virtual office running in the server device 30's virtual office control unit 42 available to the information terminal device 10.

[0040] When video calls become available, the application control unit 24 ensures that the faces and other images of the first user are displayed to each other on the first information terminal device 10, where the first user is logged into the virtual office, and on the second information terminal device 10, where the second user is logged into the virtual office. More specifically, the application control unit 24 of the terminal control device 20 of the first information terminal device 10 causes the display unit 17 of the first information terminal device 10 to output the image of the second user captured by the camera 11 of the second information terminal device 10. Similarly, the application control unit 24 of the terminal control device 20 of the second information terminal device 10 causes the display unit 17 of the second information terminal device 10 to output the image of the first user captured by the camera 11 of the first information terminal device 10.

[0041] The application control unit 24 stops video sharing between the first user and the second user if the video call is stopped.

[0042] The memory unit 26 stores information such as the calculation contents and programs of the terminal control device 20. The memory unit 26 is composed of, for example, RAM, a main memory such as ROM, an SSD, an HDD (Hard Disk Drive), and other storage devices.

[0043] The memory unit 26 stores programs and configuration information related to applications used in the information terminal device 10, such as virtual office applications.

[0044] This section describes the information sharing range and information sharing that are set for avatars in a virtual office. In a virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and it is the range in which information can be shared among multiple users that are mutually included in the information sharing range. One example of information sharing within the information sharing range is the sharing of voices. In other words, the information sharing range is the range in which the voices of users of other avatars can be heard by users of other avatars. Also, the information sharing range is the range in which users of other avatars can hear the voices of users of other avatars. The information that can be shared within the information sharing range is not limited to voice, but also includes other information such as video and text. In this embodiment, the information sharing range will be described as an example of sharing voices.

[0045] For example, if the second avatar enters the information sharing range of the first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Also, if the second avatar enters the information sharing range of the first avatar, and the first avatar enters the information sharing range of the second avatar, two-way voice sharing occurs, allowing them to sense each other's presence and enabling conversation without any special operation. Therefore, the information sharing range can also be called the voice sharing range. Specifically, when the first and second avatars are mutually included in each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar becomes audible on the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar becomes audible on the information terminal device 10 used by the first user.

[0046] Furthermore, it is possible to set up spaces that enable information sharing among all avatars within a specific area, such as meeting rooms set up in a virtual office, or the area where avatars corresponding to users belonging to the same department perform their work. Outside of such set spaces, the information sharing area is set for each avatar. In this embodiment, the area where avatars corresponding to users belonging to the same department perform their work (hereinafter referred to as the department area) will be described as the information sharing area for sharing voice.

[0047] The display control unit 27 controls the display of various types of video on the display unit 17. The display control unit 27 controls the display of video of the virtual office on the display unit 17. In this embodiment, if the information being shared includes video or text, the display control unit 27 outputs the video or text to the display unit 17. Also, when a video call becomes possible, the display control unit 27 outputs the video of the virtual office avatar user, etc., to the display unit 17.

[0048] The audio output control unit 28 controls the audio output of the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech of other avatar users within the information sharing range of the virtual office. Also, when video calls become possible, the audio output control unit 28 causes the audio output unit 18 to output the speech of the user who will be making the video call.

[0049] The communication control unit 29 controls the communication unit 19 to control the transmission and reception of data such as video and audio, and the transmission and reception of application operation status information between the communication control unit 29 and the server device 30. More specifically, the communication control unit 29 controls the communication unit 19 to receive video and audio from the virtual office from the server device 30. The communication control unit 29 controls the communication unit 19 to transmit to the server device 30 the video and audio of the user facing the display unit 17 of the information terminal device 10, which have been acquired by the video acquisition unit 21 and the audio acquisition unit 22. Application operation status information includes, for example, in the case of a virtual office application, the operation of the avatar by the operation unit 13, and the operation of starting and ending video calls.

[0050] (Server device) Figure 3 is a block diagram showing an example configuration of a server device according to the embodiment. The server device 30 is a server device of a company to which the users of each information terminal device 10 belong, or a server device of a business entity that provides virtual office services, and may be a general-purpose server device including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 comprises a communication unit 31 and a server control device 40.

[0051] The communication unit 31 is a communication unit for wired or wireless communication. The communication unit 31 communicates using methods such as Wi-Fi or mobile phone lines and connects to an intranet or the internet. The communication unit 31 is controlled by the communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operating status information with multiple information terminal devices 10.

[0052] (Server control unit) The server control device 40 controls various parts of the server device 30. The server control device 40 includes, for example, a control device such as a CPU or MPU, and a storage device such as RAM or ROM. The server control device 40 may be implemented by an integrated circuit such as an ASIC or FPGA. The server control device 40 may be implemented by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to this disclosure.

[0053] The server control device 40 comprises a communication control unit 41, a virtual office control unit 42, and a storage unit 49, as functional blocks realized by circuits and programs.

[0054] The communication control unit 41 controls the communication unit 31 to control the transmission and reception of data, including video and audio, and the transmission and reception of application operation status information between the information terminal device 10 and the communication control unit 41. For example, the communication control unit 41 controls the communication unit 31 to receive video captured by the camera 11 and audio picked up by the microphone 12 of the information terminal device 10. For example, the communication control unit 41 controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. Application operation status information includes, for example, configuration information of the virtual office application.

[0055] The virtual office control unit 42 controls the operation of various applications running on the server device 30. For example, the virtual office control unit 42 controls the operation of virtual office applications. For example, the virtual office control unit 42 controls the operation of applications used for online communication.

[0056] The virtual office control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 running the application, via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged into the virtual office.

[0057] The virtual office control unit 42 detects the location of avatars corresponding to users who are present in the virtual office. More specifically, the virtual office control unit 42 detects avatars that are located within a departmental area set as an information sharing area in the virtual office. The virtual office control unit 42 also detects avatars that have left a departmental area in the virtual office.

[0058] The virtual office control unit 42 records the audio output from the information terminal device 10 to the virtual office (specifically, the ambient sound of the information terminal device 10 using the virtual office) in the storage unit 49. Specifically, the virtual office control unit 42 records the audio of each avatar contained within a department area, which is set as the information sharing area, in the storage unit 49. For each department area, the virtual office control unit 42 records the audio of each avatar contained within that department area in the storage unit 49. Along with the audio, the virtual office control unit 42 also records information about the information terminal device 10, such as the user of the information terminal device 10 and the location of the avatar in the virtual office.

[0059] If the number of other avatars capable of sharing voices that are present around the avatar corresponding to the user within the virtual office is less than a predetermined number, the virtual office control unit 42 outputs voices other than those of the information terminal device 10 used by the user, from the voices recorded in the storage unit 49, to the information terminal device 10 used by the user.

[0060] Other avatars that can share voices refer to other avatars located within the information sharing range of the avatar corresponding to the user. In this embodiment, these are avatars of other users who belong to the same department as the first user and reside within the same department area where the first avatar corresponding to the first user is located.

[0061] The phrase "the number of other avatars that can share voice is less than the specified number" includes not only cases where the number was less than the specified number from the beginning (start of operations), but also cases where the number of other avatars that can share voice went from being more than the specified number to less than the specified number, in other words, cases where the number of other avatars that can share voice fell below the specified number.

[0062] The virtual office control unit 42 outputs audio from information terminal devices 10 used by other avatar users that are within audio sharing range at the avatar's location in the virtual office to the information terminal device 10 used by the avatar user.

[0063] In the virtual office, the audio output from the information terminal device 10 used by other avatar users who were within the range of audio sharing at the avatar's location may be audio from the period when the avatar was within the range of audio sharing, or audio from the period when the avatar was not. In other words, it may be audio from the period when the avatar and other avatars were within the range of audio sharing, or audio from the period when only other avatars were present.

[0064] For example, the virtual office control unit 42 may output audio from an information terminal device 10 used by another avatar user that was in a department area where audio could be shared, to the information terminal device 10 used by the avatar user, during the period when the avatar was in a department area in the virtual office.

[0065] For example, during periods when no avatar is present in a department area within the virtual office, the virtual office control unit 42 may output audio from an information terminal device 10 used by another avatar user that was present in a department area where audio can be shared, to the information terminal device 10 used by the avatar user.

[0066] In the virtual office, the audio output from an information terminal device 10 used by another avatar user that is within a range where audio can be shared with the avatar's location may be, for example, the audio of another avatar corresponding to a user belonging to the same department that is located within a department area set up in the virtual office.

[0067] The virtual office control unit 42 outputs audio recorded from a predetermined number of information terminal devices 10 other than the information terminal device 10 used by the user, to the information terminal device 10 used by the user, if the number of other avatars capable of sharing audio around the avatar corresponding to the user within the virtual office is less than a predetermined number. As a result, within the virtual office, audio is output that represents a state where a predetermined number of avatars are present around the avatar corresponding to the user, and the surroundings are moderately noisy.

[0068] A moderately noisy environment means, for example, that there are four or more other avatars nearby, or in other words, that you can hear the voices of four or more people. A moderately noisy environment means, for example, a noise level [dB] equivalent to the average ambient noise at the avatar's location in a virtual office.

[0069] The virtual office control unit 42 may share the audio recorded in the storage unit 49 with the avatar, and may also place a temporary avatar around the avatar corresponding to the user who output the recorded audio. When the virtual office control unit 42 is outputting the recorded audio, it may display the avatar corresponding to the user included in the recorded audio as a temporary avatar on the virtual office display screen of the information terminal device 10 of the target user.

[0070] The temporary avatar is displayed in a way that makes it distinguishable from the avatars actually present in the virtual office, for example, by changing its color. While it's not possible to communicate or take other actions with the temporary avatar from the avatars actually present in the virtual office, this reduces feelings of loneliness.

[0071] The virtual office control unit 42 stops outputting the recorded audio when the above conditions for outputting the audio recorded in the storage unit 49 are no longer met, when the user's avatar moves outside the area of ​​their department, when it detects an operation to log out of the virtual office, when the information terminal device 10 is disconnected from the network that allows the virtual office to be used, or when the information terminal device 10 is turned off.

[0072] The memory unit 49 stores information such as the calculations performed by the server control device 40 and programs. The memory unit 49 is composed of, for example, RAM, a main memory such as ROM, and a storage device such as an SSD or HDD.

[0073] The memory unit 49 stores information indicating the virtual office to be configured in the virtual space. For each user who logs into the virtual office, the memory unit 49 stores information indicating the avatar, the information terminal device 10 associated with the avatar, and the account user of the information terminal device 10. The memory unit 49 also stores information indicating the arrangement of objects that make up the virtual office, such as the sections and virtual desks that make up the virtual office.

[0074] The storage unit 49 records the audio output from the information terminal device 10 to the virtual office. The storage unit 49 stores, for example, the audio of users corresponding to avatars within a department. The storage unit 49 may also temporarily store, for example, the audio of all users who log in to the virtual office. Along with the above audio, the storage unit 49 records, for example, information about the information terminal device 10, such as the user of the information terminal device 10 and the location of the information terminal device 10 in the virtual office.

[0075] Figure 4 shows an example of the time an avatar was in a voice-sharing area. Here, the voice-sharing area is defined as the area of ​​Department T, which is a departmental area in the virtual office. Users U1, U11, U12, U13, U14, U15, U16, and U17 belong to the same department (Department T). For example, at 18:00, avatar A1, corresponding to user U1, has been in the Department T area since 15:00. Avatar A11, corresponding to user U11, has been in the Department T area since 12:00. Avatar A12, corresponding to user U12, was in the Department T area from before 12:00 until 17:30. Avatar A13, corresponding to user U13, was in the Department T area from before 12:00 until 15:00. Avatar A14, corresponding to user U14, was in the area of ​​department T from before 12:00 until 17:00. Avatar A15, corresponding to user U15, was in the area of ​​department T from before 12:00 until 14:30. Avatar A16, corresponding to user U16, was in the area of ​​department T from before 12:00 until 17:00. Avatar A17, corresponding to user U17, was in the area of ​​department T from before 12:00 and left the area of ​​department T at 18:00.

[0076] The display screen of the virtual office as shown on the display screen of the information terminal device 10 used by the first user U1 will be explained using Figures 5 to 8. In the explanation of Figures 5 to 8, user U1 will be used as the reference point for the first user, but the present invention applies to all users who use the virtual office. With user U1 as the reference point, users U11, U12, U13, U14, U15, U16, and U17 are other users.

[0077] Each user who has placed their avatar in departmental area S1, which is within the area of ​​department T, is able to hear the voices of other users in departmental area S1 of department T. As a specific example, let's consider the case where the avatars of users U1, U11, U12, U13, U14, U15, U16, and U17 are all located in departmental area S1 of department T. Using user U1 as the reference, the information terminal device 10 used by user U1 can hear the voices picked up by the microphones 12 on the information terminal devices 10 used by other users in departmental area S1 of department T: users U11, U12, U13, U14, U15, U16, and U17. The voices picked up by the microphones 12 on the information terminal device 10 used by user U1 are output to the information terminal devices 10 used by other users in departmental area S1 of department T.

[0078] Figure 5 shows an example of the virtual office display screen shown on the display screen of an information terminal device. Figure 5 shows the virtual office at 14:00 as shown in Figure 4. At this time, users U11, U12, U13, U14, U15, U16, and U17 are performing their duties with their respective avatars A11, A12, A13, A14, A15, A16, and A17 placed within the department area S1 of department T. Figure 5 is an example of the virtual office display screen on the information terminal device 10 used by any of users U11, U12, U13, U14, U15, U16, and U17.

[0079] Figure 6 shows another example of the virtual office display screen shown on the information terminal device's display screen. Figure 6 shows the virtual office at 15:00 as shown in Figure 4. User U1, whose avatar is A1, placed avatar A1 in department area S1 of department T and started work at 15:00. At this time, avatar A13 of user U13 and avatar A15 of user U15 are absent from department area S1, for example, because they have left the office, logged out of the virtual office, or are continuing work outside department area S1. Figure 6 shows that the number of other avatars capable of sharing voices that are present around user U1's avatar A1 is 5, and the number of avatars other than avatar A1 present in department area S1 is not less than a predetermined number.

[0080] Figure 7 shows another example of the virtual office display screen shown on the information terminal device's display screen. Figure 7 shows the virtual office at 18:00 as shown in Figure 4. At 18:00, users U11 and U1 are working within department area S1. As shown in Figure 7, avatars A11 and A1 are displayed on the virtual office display screen. In the state shown in Figure 7, at 18:00, it is determined that the number of other avatars capable of sharing audio around avatar A1, which corresponds to user U1, is less than a predetermined number, thus satisfying the condition. Upon meeting this condition, the virtual office control unit 42 outputs the audio recorded from the information terminal devices 10 used by each user to the information terminal device 10 used by user U1.

[0081] During the period in which the above conditions for outputting audio recorded in the memory unit 49 to avatar A1 are met, the audio output to the information terminal device 10 used by user U1 is the audio of users other than user U1 in the department area S1 where avatar A1 is located. Audio is output when a predetermined number or more other avatars exist in department area S1 besides user U1.

[0082] For example, after 18:00, the information terminal device 10 for user U1 outputs audio from department T recorded during periods when avatar A1 is absent from department area S1, such as from 12:00 to 15:00, while maintaining voice sharing with user U11. The output audio consists of the voices of users other than user U1. After 18:00, avatar A11 is also present, so the output audio consists of the voices of users other than user U1, and may exclude the voices of users who are absent from department T's area at the time of output, i.e., the voice of user U11. By outputting audio from periods when avatar A1 is absent from department area S1, user U1 can perform their duties while understanding the situation in department area S1 while avatar A1 is absent.

[0083] For example, after 18:00, the information terminal device 10 for user U1 outputs audio from department T recorded during the period when avatar A1 was present in department area S1, such as 15:00-18:00, while maintaining audio sharing with user U11. The output audio consists of the voices of users other than user U1. Since avatar A11 is also present from 15:00-18:00, the audio consists of voices other than user U1's, and may also exclude the voices of users who were not present in department area S1 at the time of output, i.e., the voice of user U11. Because the output is from the period when avatar A1 was present in department area S1, user U1 has heard the content of the audio before and can perform their duties without worrying about the content of the audio.

[0084] In Figure 7, it is determined that the same conditions are met for avatar A11. Therefore, the virtual office control unit 42 also starts outputting the same audio from the information terminal device 10 used by user U11.

[0085] During the period in which the above conditions for outputting audio recorded in the memory unit 49 to avatar A11 are met, the audio output to the information terminal device 10 used by user U11 is the audio of users other than user U11 in the department area S1 where avatar A11 is located. Audio is output when there are a predetermined number or more other avatars in the area of ​​department T besides user U11.

[0086] The virtual office control unit 42 stops outputting the audio recorded in the storage unit 49 when the above conditions for outputting the audio recorded in the storage unit 49 are no longer met, when the user's avatar moves outside the information sharing range indicated in the department area S1, when it detects an operation to log out from the virtual office, when the information terminal device 10 is disconnected from the network that makes the virtual office available, when the information terminal device 10 is turned off, or when the user finishes using the information terminal device 10 or the virtual office.

[0087] Figure 8 shows another example of the virtual office display screen displayed on the information terminal device's display screen. In Figure 8, in the state shown in Figure 7, temporary avatars corresponding to the users who output the recorded audio are displayed on the virtual office display screen. Specifically, temporary avatars A12', A13', A14', A15', A16', and A17' are displayed, corresponding to users U12, U13, U14, U15, U16, and U17, who belong to department T. The position of each temporary avatar is the position of the respective avatar when the outputted audio was recorded.

[0088] (Virtual space control method) The virtual space control method will be explained using Figure 9. Figure 9 is a flowchart showing an example of a virtual space control method according to an embodiment. The process shown in Figure 9 is executed while the virtual office is provided by the virtual space control system 1. The process shown in Figure 9 is executed by the server control device 40 of the server device 30 of the virtual space control system 1. The process shown in Figure 9 is executed based on each user who is logged into the virtual office.

[0089] The server control device 40, using the virtual office control unit 42, determines whether or not the user has started working in their department in the virtual office using their avatar (step S101). More specifically, the server control device 40, using the virtual office control unit 42, determines whether or not the user has started working in their department in the virtual office based on the user's login information to the virtual office and the location information of the avatar corresponding to the user in the virtual office. If the server control device 40 determines, using the virtual office control unit 42, that the user has started working in their department in the virtual office (step S101; Yes), it proceeds to step S102. If the server control device 40 does not determine, using the virtual office control unit 42, that the user has started working in their department in the virtual office (step S101; No), it terminates the processing of this flowchart.

[0090] If the server control unit 40 determines that it has started work in its own department in the virtual office (step S101; Yes), the server control unit 40, using the virtual office control unit 42, determines whether the number of other avatars in its own department is less than a predetermined number (step S102). More specifically, the server control unit 40, using the virtual office control unit 42, determines whether the number of other avatars in its own department is less than a predetermined number based on the login information of all users to the virtual office and the location information of the avatars corresponding to all users in the virtual office. In other words, the server control unit 40, using the virtual office control unit 42, determines whether the number of other avatars included in the information sharing range, that is, other avatars that can share voice, is less than a predetermined number. If the server control unit 40 determines, using the virtual office control unit 42, that the number of other avatars in its own department is less than a predetermined number (step S102; Yes), it proceeds to step S103. If the server control unit 40 does not determine, using the virtual office control unit 42, that the number of other avatars in its own department is less than a predetermined number (step S102; No), it proceeds to step S107.

[0091] If the server control unit 40 determines that there are fewer than a predetermined number of other avatars within its own department (step S102; Yes), the server control unit 40, via the virtual office control unit 42, starts outputting recorded audio from other users (step S103). More specifically, the server control unit 40, via the virtual office control unit 42, starts outputting audio stored in the storage unit 49, which has been picked up by the information terminal device 10 used by other users, to the information terminal device 10 used by the user. The server control unit 40 then proceeds to step S104.

[0092] The server control device 40, based on the virtual office control unit 42, determines whether the user has finished their work within their own department in the virtual office using their avatar (step S104). More specifically, the server control device 40 determines that the user has finished their work within their own department in the virtual office when, for example, the user's avatar moves outside the area of ​​their own department, an operation to log out from the virtual office is detected, the information terminal device 10 is disconnected from the network that allows the virtual office to be used, or an operation to turn off the power of the information terminal device 10 is performed. If the server control device 40 determines, based on the virtual office control unit 42, that the user has finished their work within their own department in the virtual office (step S104; Yes), it terminates the processing of this flowchart. If the server control device 40 does not determine, based on the virtual office control unit 42, that the user has finished their work within their own department in the virtual office (step S104; No), it proceeds to step S105.

[0093] If the server control unit 40 does not determine that it has finished its work within its own department in the virtual office (step S104; No), the server control unit 40 has the virtual office control unit 42 determine whether the number of other avatars within its own department has exceeded a predetermined number (step S105). In other words, the server control unit 40 has the virtual office control unit 42 determine whether the number of other avatars included in the information sharing range, that is, other avatars that can share voice, has exceeded a predetermined number. If the server control unit 40 has the virtual office control unit 42 determine that the number of other avatars within its own department has exceeded a predetermined number (step S105; Yes), the server control unit 40 proceeds to step S106. If the server control unit 40 has the virtual office control unit 42 not determine that the number of other avatars within its own department has exceeded a predetermined number (step S105; No), the server control unit 40 repeats the process in step S104.

[0094] If the server control device 40 determines that the number of other avatars within its own department exceeds a predetermined number (step S105; Yes), the server control device 40 stops the output of recorded audio from other users via the virtual office control unit 42 (step S106). More specifically, the server control device 40 stops the output of audio stored in the storage unit 49, which has been picked up by other users' information terminal devices 10, to the information terminal device 10 used by the user. The server control device 40 then proceeds to step S107.

[0095] The server control device 40, in accordance with the virtual office control unit 42, determines whether the number of other avatars within its own department has fallen below a predetermined number (step S107). In other words, the server control device 40, in accordance with the virtual office control unit 42, determines whether the number of other avatars included in the information sharing range, that is, other avatars that can share voice, has fallen below a predetermined number. If the server control device 40 determines, in accordance with the virtual office control unit 42, that the number of other avatars within its own department has fallen below a predetermined number (step S107; Yes), it proceeds to step S103. If the server control device 40 does not determine, in accordance with the virtual office control unit 42, that the number of other avatars within its own department has fallen below a predetermined number (step S107; No), it proceeds to step S108.

[0096] If the server control unit 40 does not determine that the number of other avatars within its own department has fallen below a predetermined number (step S107; No), the server control unit 40 determines whether or not to terminate the user's work within its own department in the virtual office using the user's avatar (step S108). If the server control unit 40 determines, based on the virtual office control unit 42, that the user's work within its own department in the virtual office has been terminated (step S108; Yes), the server control unit 40 terminates the processing of this flowchart. If the server control unit 40 does not determine, based on the virtual office control unit 42, that the user's work within its own department in the virtual office has been terminated (step S108; No), the server control unit 40 executes the processing of step S107 again.

[0097] (effect) As described above, in this embodiment, if the number of other avatars capable of sharing audio that are present around the user's avatar in the virtual office is less than a predetermined number, audio other than that of the information terminal device 10 used by the user in the recorded audio can be output to the information terminal device 10 used by the user. In this embodiment, if the number of other avatars present around the user's avatar in the virtual office is small, audio other than that of the information terminal device 10 used by the user can be output. According to this embodiment, feelings of loneliness in the virtual office can be alleviated.

[0098] According to this embodiment, in the virtual office, audio output from an information terminal device 10 used by another avatar user that is within a range where audio can be shared can be output to the information terminal device 10 used by the avatar user.

[0099] According to this embodiment, if the number of other avatars capable of sharing audio that are present around the avatar corresponding to the user within the virtual office is less than a predetermined number, audio recorded from an information terminal device 10 other than the one used by the user, and from a predetermined number or more of those information terminal devices 10, can be output to the information terminal device 10 used by the user.

[0100] According to this embodiment, recorded audio can be shared with an avatar, and an avatar corresponding to the user who output the recorded audio can be placed around the avatar as a temporary avatar. According to this embodiment, feelings of loneliness in a virtual office can be reduced.

[0101] The components of the illustrated virtual space control system are functionally conceptual and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage of each device.

[0102] The configuration of the virtual space control system is implemented, for example, as software, such as a program loaded into memory. In the above embodiment, these were described as functional blocks implemented through the cooperation of hardware or software. That is, these functional blocks can be implemented in various forms using hardware alone, software alone, or a combination thereof.

[0103] The components described above include those that are easily conceivable by those skilled in the art, and those that are substantially identical. Furthermore, the components described above can be combined as appropriate. In addition, various omissions, substitutions, or modifications of the components are possible without departing from the spirit of the present invention. [Explanation of symbols]

[0104] 1. Virtual Space Control System 10 Information terminal device 11 Cameras 12 microphones 13 Control section 17 Display section 18 Audio output section 19 Communications Department 20 Terminal control device (control unit) 21 Video Acquisition Unit 22 Voice acquisition unit 23 Operation Reception Section 24 Application Control Unit 26 Memory section 27 Display Control Unit 28 Audio Output Control Unit 29 Communication Control Unit 30 Server Devices 31 Communications Department 40 Server control unit (control unit) 41 Communication Control Unit 42 Virtual Office Control Unit 49 Memory section

Claims

1. A virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to the user of the information terminal device in the virtual space, The control unit of the virtual space control system is: The audio output from the information terminal device to the virtual space is recorded. In the virtual space, if the number of other avatars capable of sharing audio that exist around the avatar corresponding to the user is less than a predetermined number, the recorded audio other than the audio from the information terminal device used by the user will be output to the information terminal device used by the user. Virtual space control system.

2. The control unit, In the virtual space, at the location of the avatar, audio output from the information terminal device used by another avatar user that is within a range where audio can be shared is output to the information terminal device used by the user. The virtual space control system according to claim 1.

3. The control unit, In the virtual space, if the number of other avatars capable of sharing audio that exist around the avatar corresponding to the user is less than a predetermined number, audio recorded from an information terminal device other than the one used by the user, and from a predetermined number or more of the information terminal devices, is output to the information terminal device used by the user. The virtual space control system according to claim 2.

4. The control unit, The recorded audio is shared with the aforementioned avatar, and an avatar corresponding to the user who output the recorded audio is placed around the aforementioned avatar as a temporary avatar. The virtual space control system according to claim 1.

5. A virtual space control method executed by a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to the user of the information terminal device in the virtual space, The audio output from the information terminal device to the virtual space is recorded. In the virtual space, if the number of other avatars capable of sharing existing voices around the avatar corresponding to the user is less than a predetermined number, the recorded voices other than those of the information terminal device used by the user will be output to the information terminal device used by the user. A virtual space control method performed by a virtual space control system.

Images