Virtual space control system and virtual space control method

Abstract

To appropriately change easiness of hearing sound between avatars on the basis of relevance between users in a virtual space.SOLUTION: A control unit included in the virtual space control system 1 acquires relevance between an avatar and a user corresponding to another avatar located in the same virtual space, and controls easiness of hearing of a voice between the avatars on the basis of the relevance between the users.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a virtual space control system and a virtual space control method. [Background technology]

[0002] In a virtual office (virtual office) configured in a virtual space, each user uses an avatar to perform work within the virtual office. There is known a technique that allows each avatar to hear each other's voices when they are close to each other in the virtual space or when they are in the same space (see, for example, Patent Document 1).

[0003] A technology is known that controls the volume of the voices emitted by users of other client devices corresponding to each avatar image, which are located farther away from the user of a first client device in a virtual space (see, for example, Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-071314 [Patent Document 2] Japanese Patent Publication No. 2022-065363 Summary of the Invention [Problem to be solved by the invention]

[0005] In the technologies described in Patent Documents 1 and 2, the voice of an avatar corresponding to a user who is highly related to the user and who is equidistant from the user's avatar is heard at the same volume as the voice of an avatar corresponding to a user who is less related to the user. This may make it difficult to hear the voice of the avatar corresponding to the user who is more related to the user.

[0006] The present disclosure aims to appropriately change the audibility of voices between avatars in a virtual space based on the relevance between users. [Means for solving the problem]

[0007] In order to solve the above-mentioned problems and achieve the objectives, the virtual space control system of the present disclosure is a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to the user of the information terminal device in the virtual space, and a control unit provided in the virtual space control system obtains the association between the avatar and users corresponding to other avatars located in the same virtual space, and controls the audibility of voices between the avatars based on the association between the users.

[0008] The virtual space control method of the present disclosure is a virtual space control method executed by a virtual space control system that displays a virtual space on an information terminal device and displays an avatar corresponding to a user of the information terminal device in the virtual space, and the virtual space control system obtains an association between the avatar and users corresponding to other avatars located in the same virtual space, and controls the audibility of voices between the avatars based on the association between the users. [Effects of the Invention]

[0009] According to the present disclosure, in a virtual space, it is possible to appropriately change the audibility of voices between avatars based on the relevance between users. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. [Figure 3] FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. [Figure 4]FIG. 4 is a diagram showing an example of a display screen of a virtual office displayed on the display screen of an information terminal device. [Figure 5] FIG. 5 is a flowchart showing an example of a virtual space control method according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing another example of the display screen of the virtual office displayed on the display screen of the information terminal device. [Figure 7] FIG. 7 is a flowchart showing an example of a virtual space control method according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A virtual space control system and a virtual space control method according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, the present invention is not limited to the following embodiments.

[0012] [First embodiment] (Virtual space control system) 1 is a schematic diagram showing an example of the configuration of a virtual space control system according to a first embodiment. The virtual space control system 1 controls a virtual office configured in a virtual space. In the following embodiment, a virtual office is used as an example for explanation, but the present invention is not limited to virtual offices and can also be applied to various services that use avatars for communication in a virtual space.

[0013] In the following description, a "user" may be referred to as a "first user" and an "other user" may be referred to as a "second user." Furthermore, an information terminal device used by a first user to log in to a virtual office may be referred to as a first information terminal device, and an information terminal device used by another user, a second user, to log in to a virtual office may be referred to as a second information terminal device. A first information terminal device is any information terminal device that is logged in to a virtual office, and a second information terminal device is any information terminal device that is different from the first information terminal device and that is logged in to the same virtual office as the first information terminal device.

[0014] An overview of the virtual office controlled by the virtual space control system 1 will be described. A user uses an information terminal device 10 to come to work (log in) to the virtual office using their own account and perform work. In the virtual office, an avatar associated with the user is set. When a user logs in to the virtual office using their own information terminal device 10 (described later), the avatar moves to any seat in the virtual office or to a predetermined seat and the user operates and displays the avatar to sit down. The user can operate the avatar to move around the virtual office. In the virtual office, for example, when avatars are close to each other in the virtual office or when avatars are located in the same space, such as a conference room in the virtual office, they can share information in a way that allows them to hear each other's voices.

[0015] In this embodiment, the virtual space control system 1 acquires the relationship between the avatar corresponding to the user of the information terminal device 10 and the users corresponding to other avatars in the same virtual space, and controls the audibility of the voices between the avatars based on the relationship between the users.

[0016] In this embodiment, the virtual space control system 1 changes the volume of the voice of another avatar output to the information terminal device 10 corresponding to the avatar, based on the association of the avatar with the user corresponding to the other avatar.

[0017] The virtual space control system 1 includes an information terminal device 10 that each user uses for business purposes and logs into a virtual office, and a server device 30.

[0018] The control unit provided in the virtual space control system 1 is a conceptual control unit realized by the cooperation of either or both of the terminal control devices 20 of the multiple information terminal devices 10 used in the virtual office and the server control device 40 of the server device 30. Either the terminal control device 20 of the information terminal device 10 or the server control device 40 of the server device 30 may be the control unit provided in the virtual space control system 1, or the terminal control device 20 of the information terminal device 10 and the server control device 40 of the server device 30 may be the control unit provided in the virtual space control system 1.

[0019] (Information terminal device) 2 is a block diagram showing an example of the configuration of an information terminal device according to the first embodiment. The information terminal device 10 is a terminal device used by a user who performs work in a virtual office. The information terminal device 10 is a terminal device on which the user executes a virtual office application. The information terminal device 10 is a terminal device through which the user logs in to the virtual office using their own account when logging in to the virtual office.

[0020] The information terminal device 10 is, for example, an information terminal device such as a general-purpose personal computer, a smartphone, or a tablet terminal, etc. The information terminal device 10 is connected to the server device 30 via a network so as to be able to communicate data with it.

[0021] The information terminal device 10 logs in to the virtual office based on the account information of the user who is logged in to the information terminal device 10.

[0022] The information terminal device 10 includes a camera 11 , a microphone 12 , an operation unit 13 , a display unit 17 , an audio output unit 18 , a communication unit 19 , and a terminal control device 20 .

[0023] Camera 11 captures an image in the direction facing information terminal device 10. Camera 11 is disposed at a position where it captures an image in the direction facing display unit 17 of information terminal device 10. In other words, camera 11 captures an image in the direction where a user using information terminal device 10 is located. Camera 11 is disposed, for example, near display unit 17. Camera 11 outputs the captured image to image acquisition unit 21 of terminal control device 20.

[0024] The microphone 12 picks up sounds around the information terminal device 10. The microphone 12 may pick up sounds from the direction facing the display unit 17 of the information terminal device 10, and may be provided in a headset connected to the information terminal device 10. In other words, the microphone 12 picks up sounds spoken by the user using the information terminal device 10 and sounds from the surrounding area. The microphone 12 outputs audio information related to the picked-up sounds to the audio acquisition unit 22 of the terminal control device 20.

[0025] The operation unit 13 is an input device capable of inputting various operations to the information terminal device 10. The operation unit 13 outputs an operation signal corresponding to the received input operation to the terminal control device 20. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel arranged over the display unit 17, buttons, switches, etc. The operation unit 13 can receive, for example, a key input operation, a click operation, or a touch operation.

[0026] The operation unit 13 can accept operations such as moving an avatar corresponding to the user in the virtual office in any direction on the display screen of the display unit 17. For example, the operation unit 13 accepts operations such as overlapping or placing the user's avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0027] By performing an operation such as superimposing one's avatar on another or placing it adjacent to another avatar, communication such as a video call or a voice call can be initiated between users in the virtual office application. Whether a video call or a voice call will be conducted may be set in advance or may be set by the user's operation.

[0028] The display unit 17 displays various types of video including text and images. The display unit 17 is, for example, a display including a liquid crystal display, an organic EL (Electro Luminescence) display, etc. The display unit 17 displays a video of a virtual office, etc. In this embodiment, when a video call becomes possible, the display unit 17 outputs a video of the user of another avatar with whom the video call is being made, in other words, a video captured by the camera 11 of the information terminal device 10 used by the user of the other avatar. The display of the display unit 17 is controlled by the display control unit 27.

[0029] The audio output unit 18 is an audio output device that outputs audio from the virtual office. In this embodiment, when the user is using the virtual office, the audio output unit 18 outputs the audio around the user's avatar in the virtual office. When a voice call or video call becomes possible, the audio output unit 18 outputs the audio of the user of another avatar with whom the user is making the voice call or video call, in other words, the audio picked up by the microphone 12 of the information terminal device 10 used by the user of the avatar. The audio output of the audio output unit 18 is controlled by the audio output control unit 28.

[0030] The communication unit 19 is a communication unit for performing wired communication or wireless communication. The communication unit 19 performs communication using a communication method such as Wi-Fi (registered trademark) or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 19 is controlled by a communication control unit 29. The communication unit 19 communicates data such as video and audio or application operation information with the server device 30. The communication unit 19 communicates data such as account information of a user logged in to the information terminal device 10 and application operation status information with the server device 30.

[0031] (Terminal Control Device) The terminal control device 20 controls each part of the information terminal device 10. The terminal control device 20 has, for example, a control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The terminal control device 20 executes a program that controls the operation of the information terminal device 10 according to the present disclosure. The terminal control device 20 may be realized by an integrated circuit such as an ASIC or an FPGA. The terminal control device 20 loads a stored program into memory and executes instructions included in the program. The terminal control device 20 includes an internal memory such as the RAM described above, and the internal memory is used for temporary storage of data in the terminal control device 20. The terminal control device 20 may be realized by a combination of hardware and software.

[0032] The terminal control device 20 has functional blocks realized by circuits and executed programs, including a video acquisition unit 21, an audio acquisition unit 22, an operation reception unit 23, an application control unit 24, a relevance acquisition unit 25, a memory unit 26, a display control unit 27, an audio output control unit 28, and a communication control unit 29.

[0033] The video acquisition unit 21 acquires video captured by the camera 11. More specifically, the video acquisition unit 21 acquires video captured by the camera 11 of a user facing the information terminal device 10, etc. The video data acquired by the camera 11 is a moving image.

[0034] The voice acquisition unit 22 acquires the voice detected by the microphone 12. The voice acquisition unit 22 acquires voice such as the voice spoken by a user present in the vicinity of the information terminal device .

[0035] The operation reception unit 23 acquires an operation signal corresponding to an operation on the operation unit 13 from the operation unit 13. The operation reception unit 23 outputs a control signal corresponding to the acquired operation signal to each unit.

[0036] The operation accepting unit 23 accepts operations on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to move the user's own avatar in the virtual office on the display screen of the display unit 17. For example, the operation accepting unit 23 accepts an operation to overlap or place the user's own avatar in the virtual office next to another avatar on the display screen of the display unit 17.

[0037] The application control unit 24 controls the operation of various applications executed on the information terminal device 10. The applications operated by the application control unit 24 may be controlled in cooperation with a virtual office control unit 42 of the server device 30, which will be described later.

[0038] The application control unit 24 causes a display control unit 27, which will be described later, to display on the display unit 17 a display related to an application running on the information terminal device 10. The display related to the application is a display screen such as a window or an icon that shows the display related to the application to the user of the information terminal device 10.

[0039] When the user of the information terminal device 10 is logged in to the virtual office, the application control unit 24 makes the virtual office executed by the virtual office control unit 42 of the server device 30 available to the information terminal device 10 .

[0040] When a virtual office application is being executed on the information terminal device 10, the application control unit 24 shares information using the display control unit 27 and the audio output control unit 28 based on an information sharing range set around an avatar corresponding to the user of the information terminal device 10. Furthermore, when a video call with an avatar corresponding to another user is started while the virtual office application is being executed on the information terminal device 10, the application control unit 24 performs the video call using the display control unit 27 and the audio output control unit 28.

[0041] The application control unit 24 displays on the display screen of the information terminal device 10 not only a display screen (window) of the virtual office application but also display screens (windows) relating to applications other than the virtual office application.

[0042] The application control unit 24 arbitrarily changes the position of the avatar displayed on the display screen of the virtual office based on the user's operation.

[0043] When a video call becomes possible, the application control unit 24 causes the first information terminal device 10 in which the first user is logged in to the virtual office and the second information terminal device 10 in which the second user is logged in to the virtual office to mutually display images of faces, etc. More specifically, the application control unit 24 of the terminal control device 20 of the first information terminal device 10 causes the display unit 17 of the first information terminal device 10 to output an image of the second user captured by the camera 11 of the second information terminal device 10. Similarly, the application control unit 24 of the terminal control device 20 of the second information terminal device 10 causes the display unit 17 of the second information terminal device 10 to output an image of the first user captured by the camera 11 of the first information terminal device 10.

[0044] When the video call is stopped, the application control unit 24 stops the video sharing between the first user and the second user.

[0045] The relevance acquisition unit 25 acquires the relevance between users corresponding to each avatar in the same virtual office. The relevance acquisition unit 25 acquires the relevance between the avatar corresponding to the user of the information terminal device 10 and users corresponding to other avatars located in the same virtual office. In this embodiment, the relevance acquisition unit 25 acquires whether the relevance between the avatar corresponding to the user of the information terminal device 10 and users corresponding to other avatars located in the same virtual office is high or low. The relevance acquisition unit 25 transmits information indicating the acquired relevance to the server device 30.

[0046] The relevance acquisition unit 25 may determine the relevance between users based on the hierarchy in the group to which the user corresponding to the avatar corresponding to the user of the information terminal device 10 belongs.

[0047] For example, if the group to which the users belong is a company, the relevance acquisition unit 25 may determine the relevance between users based on organizational hierarchies such as departments and sections. More specifically, the relevance acquisition unit 25 may determine the relevance between users based on information indicating the organizational hierarchy, such as information showing organizational hierarchies in a tree structure or information hierarchically dividing different organizations based on relationships such as projects. For example, the relevance acquisition unit 25 may determine the relevance between users based on the distance between the hierarchies, tracing from the hierarchical level of the organization to which the user belongs to to the hierarchical levels of the organization to which other users belong. For example, the relevance acquisition unit 25 may count each change in hierarchical level from the hierarchical level of the organization to which the user belongs to the hierarchical level to the hierarchical level of the organization to which other users belong as "1." Then, if the count from the hierarchical level of the organization to which the user belongs to the hierarchical level of the organization to which other users belong is equal to or less than a predetermined value, for example, "2," the relevance acquisition unit 25 may determine the relevance between the user and the other users as "highly related." If the count is greater than a predetermined value, for example, "2," the relevance acquisition unit 25 may determine the relevance between the user and the other users as "lowly related."

[0048] For example, if the group to which the users belong is a company, the relevance acquisition unit 25 may determine the relevance between users based on the job title hierarchy. More specifically, the relevance acquisition unit 25 may determine the relevance between users based on information indicating the job title hierarchy as described above. For example, the relevance acquisition unit 25 counts each change in hierarchy from the user's own job title hierarchy to the job title hierarchy of the other users as "1." If the count from the user's own job title hierarchy to the job title hierarchy of the other users is less than a predetermined value, for example, "2," the relevance acquisition unit 25 may determine that the user and the other users are "highly relevant." If the count is greater than the predetermined value, for example, "2," the relevance acquisition unit 25 may determine that the user and the other users are "lowly relevant." Alternatively, even if the count from the user's own job title hierarchy to the job title hierarchy of the other users is the same, the relevance acquisition unit 25 may determine that the relevance is "very high" if the other users have higher job titles, and "somewhat high" if the other users have lower job titles.

[0049] The relevance acquisition unit 25 may determine the relevance between users based on the communication history between avatars. For example, if the communication frequency (number of times) between avatars is equal to or greater than a frequency threshold, the relevance acquisition unit 25 may determine that the user and other users are "highly relevant," and if the frequency (number of times) is less than the frequency threshold, the relevance acquisition unit 25 may determine that the user and other users are "highly relevant," and if the total communication time between avatars is equal to or greater than a time threshold, the relevance acquisition unit 25 may determine that the user and other users are "lowly relevant," and if the total communication time is less than the time threshold, the relevance acquisition unit 25 may determine that the user and other users are "highly relevant."

[0050] The communication history between avatars is, for example, a conversation history between avatars in the same office space, a history of participation in the same conference, or a history of access to the same data file.

[0051] The relevance acquisition unit 25 may, for example, calculate the degree of matching between users from user profile information that can be referenced by a virtual office application, and determine the relevance between users based on the degree of matching. For example, the degree of matching may be calculated by counting the matches or similar information in the profile information between users.

[0052] The profile information is information that can be used to calculate the degree of matching between users. The profile information is, for example, information related to work, such as the user's work history, areas of expertise, clients, qualifications obtained, or activity history of clubs outside of work. The profile information may also be information other than work, such as the user's hobbies, place of residence, hometown, and alma mater.

[0053] The targets for which the relevance acquisition unit 25 acquires relevance with the user may include users corresponding to other avatars located within an information sharing range, in other words, a range within which voice can be heard, that enables information sharing around the avatar corresponding to the user of the information terminal device 10.

[0054] The targets from which the relevance acquisition unit 25 acquires relevance with the user may include users corresponding to other avatars located outside the information sharing range of the avatar corresponding to the user in the same virtual office.

[0055] The storage unit 26 stores, for example, information such as the calculation contents and programs of the terminal control device 20. The storage unit 26 is configured, for example, with a RAM, a main storage device such as a ROM, and a storage device such as an SSD or an HDD (Hard Disk Drive).

[0056] The storage unit 26 stores programs and setting information relating to applications used in the information terminal device 10, such as a virtual office application.

[0057] The storage unit 26 stores data used in the relevance acquisition unit 25. The storage unit 26 stores, for example, data indicating the hierarchy of the group to which the user belongs. The storage unit 26 stores, for example, data indicating the communication history of the user.

[0058] The following describes the information sharing range and information sharing set for avatars in a virtual office. In the virtual office, an information sharing range is set around each avatar. The information sharing range is the range in which information can be shared with users of other avatars, and is the range in which information can be shared between multiple users who are included in the information sharing range. One example of information sharing in the information sharing range is mutual sharing of audio. In other words, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Furthermore, the information sharing range is the range in which audio, such as the voice of a user of each avatar, can be heard by users of other avatars. Information that can be shared in the information sharing range is not limited to audio, but also includes other information such as video and text. In this embodiment, the information sharing range is described as an example in which audio is shared.

[0059] For example, when a second avatar enters the information sharing range of a first avatar, the second user of the second avatar can hear the voice of the first user of the first avatar. Furthermore, when a second avatar enters the information sharing range of a first avatar and a first avatar enters the information sharing range of the second avatar, two-way voice sharing occurs, allowing each user to sense the other's presence and to converse without any special operations. Therefore, the information sharing range can also be referred to as the voice sharing range. Specifically, when a first avatar and a second avatar are within each other's information sharing range, the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the first user of the first avatar can be heard in the information terminal device 10 used by the second user, and the voice acquired by the voice acquisition unit 22 of the information terminal device 10 used by the second user of the second avatar can be heard in the information terminal device 10 used by the first user.

[0060] It is also possible to set up a space that allows information sharing among all avatars within a specific range, such as a conference room set up in a virtual office. Outside of such a set space, the information sharing range is set for each avatar.

[0061] The information sharing range is displayed when operating an avatar. The information sharing range for each avatar is set to an initial size and shape when the virtual office is first used. The size and shape of the information sharing range for each avatar may be changeable by user operation.

[0062] The initial shape of the information sharing range is, for example, a circle with the target avatar at the center, and the initial size of the information sharing range is set to, for example, a size that includes two or three virtual desks for two to four people in a virtual office.

[0063] The display control unit 27 controls the display of various images on the display unit 17. The display control unit 27 controls the display of an image of a virtual office on the display unit 17. In this embodiment, when the information to be shared includes an image or text, the display control unit 27 outputs the image or text to the display unit 17. Furthermore, when a video call becomes possible, the display control unit 27 outputs an image of the user's avatar in the virtual office to the display unit 17.

[0064] The audio output control unit 28 controls the output of audio in the audio output unit 18. When information sharing is taking place, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user of another avatar who is present within the information sharing range in the virtual office. Furthermore, when a video call becomes possible, the audio output control unit 28 causes the audio output unit 18 to output the speech and the like of the user who is the other party in the video call.

[0065] The audio output control unit 28 changes the volume of the voice of each avatar based on information indicating changes to the audibility of the voice of the user of the information terminal device 10, which information is received from the server device 30, which will be described later. In this embodiment, the audio output control unit 28 changes the volume of the voice of each avatar based on information indicating changes to the volume of the voice of the user of the information terminal device 10, which information is received from the server device 30, which will be described later.

[0066] The communication control unit 29 controls the communication unit 19 to transmit and receive data such as video and audio to and from the server device 30, and to transmit and receive operation status information of the application. More specifically, the communication control unit 29 controls, for example, the communication unit 19 to receive video and audio of the virtual office from the server device 30. The communication control unit 29 controls, for example, the communication unit 19 to transmit to the server device 30, video and audio of the user facing the display unit 17 of the information terminal device 10, acquired by the video acquisition unit 21 and the audio acquisition unit 22. The operation status information of the application includes, for example, in the case of a virtual office application, the operation of the avatar by the operation unit 13, the operation of starting and ending a video call, etc. The communication control unit 29 also transmits information indicating the relevance acquired by the relevance acquisition unit 25 to the server device.

[0067] (Server device) FIG. 3 is a block diagram showing an example of the configuration of a server device according to the first embodiment. The server device 30 is a server device of a company to which the users of the information terminal devices 10 belong, or a server device of a business entity that provides a virtual office service, and may be a general-purpose server device including a distributed type. The server device 30 constructs and controls a virtual space such as a virtual office. The server device 30 includes a communication unit 31 and a server control device 40.

[0068] The communication unit 31 is a communication unit for performing wired communication or wireless communication. The communication unit 31 performs communication using a communication method such as Wi-Fi or a mobile phone line, and is connected to an intranet or the Internet. The communication of the communication unit 31 is controlled by a communication control unit 41. The communication unit 31 communicates data such as video, audio, and application operation status information with multiple information terminal devices 10.

[0069] (Server control device) The server control device 40 controls each unit of the server device 30. The server control device 40 includes, for example, a control device such as a CPU or MPU, and a storage device such as a RAM or ROM. The server control device 40 may be realized by, for example, an integrated circuit such as an ASIC or FPGA. The server control device 40 may be realized by a combination of hardware and software. The server control device 40 executes a program that controls the operation of the server device 30 according to the present disclosure.

[0070] The server control device 40 includes a communication control unit 41, a virtual office control unit 42, and a storage unit 49 as functional blocks realized by circuits and programs that are executed.

[0071] The communication control unit 41 controls the communication unit 31 to transmit and receive data including video and audio to and from the information terminal device 10, and to transmit and receive operation status information of applications, etc. The communication control unit 41, for example, controls the communication unit 31 to receive from the information terminal device 10 video captured by the camera 11 of the information terminal device 10 and audio collected by the microphone 12 of the information terminal device 10. The communication control unit 41, for example, controls the communication unit 31 to transmit video and audio of the virtual office to the information terminal device 10. The operation status information of the application is, for example, configuration information of the virtual office application.

[0072] The virtual office control unit 42 controls the operation of various applications running on the server device 30. For example, the virtual office control unit 42 controls the operation of a virtual office application. For example, the virtual office control unit 42 controls the operation of an application used for online communication.

[0073] The virtual office control unit 42 transmits the configuration of the application running on the server device 30 to the information terminal device 10 that is executing the application via the communication control unit 41. Specifically, the application control unit 43 transmits information indicating the configuration of the virtual office running on the server device 30 to the information terminal device 10 that is logged in to the virtual office.

[0074] The virtual office control unit 42 detects the position of a first avatar corresponding to a first user and the position of a second avatar corresponding to a second user in the virtual office. More specifically, the virtual office control unit 42 detects, for example, a first avatar that has entered an information sharing range of a second avatar in the virtual office. The virtual office control unit 42 detects, for example, a first avatar that has left an information sharing range of a second avatar in the virtual office.

[0075] The virtual office control unit 42 detects avatars of other users who are communicating with the user and who exist within the information sharing range around the avatar corresponding to the user of the information terminal device 10.

[0076] When a second avatar enters the information sharing range of a first avatar, the virtual office control unit 42 enables the second user to share the voice of the first user. Furthermore, when the second avatar is within the information sharing range of the first avatar and the first avatar is within the information sharing range of the second avatar, the second user can share the voice of the first user, and the first user can share the voice of the second user. In other words, the first and second users can share voice, enabling them to have a conversation via voice. More specifically, when voice sharing is enabled, the virtual office control unit 42 enables the information terminal device 10 used by the first user corresponding to the first avatar and the second information terminal device 10 where the second user corresponding to the second avatar is logged in to the virtual office to hear each other's voices. More specifically, the virtual office control unit 42 causes the voice of the second user picked up by the microphone 12 of the second information terminal device 10 to be output from the voice output unit 18 of the first information terminal device 10, and causes the voice of the first user picked up by the microphone 12 of the first information terminal device 10 to be output from the voice output unit 18 of the second information terminal device 10.

[0077] When the first avatar and the second avatar are no longer included in the information sharing range due to, for example, the movement of the avatar, the virtual office control unit 42 stops the voice sharing between the first user and the second user.

[0078] The virtual office control unit 42 controls the audibility of voices between avatars according to the relevance between the avatar and users corresponding to other avatars located in the same virtual office, based on information indicating the relevance between users acquired from the information terminal device 10. For example, if the virtual office control unit 42 determines that the relevance between users is high, it makes the voices between avatars more audible. For example, if the virtual office control unit 42 determines that the relevance between users is low, it makes the voices between avatars less audible. The virtual office control unit 42 transmits the changes to the audibility of the avatars' voices to the information terminal device 10.

[0079] In this embodiment, the virtual office control unit 42 changes the volume of the voice of the other avatars output to the information terminal device 10 corresponding to the avatar based on the relationship between the avatar and the user corresponding to the other avatar. The volume of the voice of each avatar present in the information sharing area is preset to a fixed value. Each user may preset an easy-to-listen volume on their information terminal device 10. Using this volume as an initial value, for example, if the virtual office control unit 42 determines that the users are highly related to each other, it increases the volume of the voice of the other avatars output to the information terminal device 10 corresponding to the avatar from the initial value. For example, if the virtual office control unit 42 determines that the users are not highly related to each other, it decreases the volume of the voice of the other avatars output to the information terminal device 10 corresponding to the avatar from the initial value. The virtual office control unit 42 transmits the changes to the volume of the avatar's voice to the information terminal device 10. Note that an upper and lower limit volume may be set for the initial volume on each user's information terminal device 10. The virtual office control unit 42 may not increase the volume of the voice of other avatars if the initial volume is greater than the upper limit volume, and may not decrease the volume of the voice of other avatars if the initial volume is less than the lower limit volume.

[0080] For example, the virtual office control unit 42 may linearly or stepwise increase the volume of the audio between the avatars as the relevance between the users corresponding to the avatars increases.

[0081] For example, the virtual office control unit 42 may linearly or stepwise decrease the volume of the audio between the avatars as the relevance of the users corresponding to the avatars decreases.

[0082] The virtual office control unit 42 may be enabled when multiple avatars are sharing information on the outer edge of the information sharing range, in other words, within a predetermined distance of the boundary line that defines the information sharing range.

[0083] The storage unit 49 stores information such as the contents of calculations and programs of the server control device 40. The storage unit 49 is configured with, for example, a RAM, a main storage device such as a ROM, and a storage device such as an SSD or HDD.

[0084] The storage unit 49 stores information indicating a virtual office configured in a virtual space. For each user who logs in to the virtual office, the storage unit 49 stores information indicating an avatar, an information terminal device 10 associated with the avatar, and an account user of the information terminal device 10. The storage unit 49 stores information indicating the layout of objects that configure the virtual office, such as the sections that configure the virtual office and virtual desks.

[0085] The display screen of the virtual office displayed on the display unit of the information terminal device will be described using Figure 4. Figure 4 is a diagram showing an example of the display screen of the virtual office displayed on the display screen of the information terminal device. For the sake of explanation, Figure 4 shows only the information sharing range C1 of the first avatar A1, and the information sharing ranges of the other avatars are omitted. The information sharing range defines the range within which information can be shared, and may or may not be displayed on the display screen of the information terminal device. The same applies to the following figures. A virtual desk D is arranged in the virtual office.

[0086] 4, avatars A2 and A3 are speaking within information sharing range C1 of avatar A1. When the user corresponding to avatar A1 is not highly related to another avatar A3, the volume of the voice of the other avatar A3 is changed to be lower than the initial value and output in the information terminal device 10 used by the user corresponding to avatar A1. When the user corresponding to avatar A1 is highly related to another avatar A2, the volume of the voice of the other avatar A2 is changed to be higher than the initial value in the information terminal device 10 used by the user corresponding to avatar A1.

[0087] (Virtual space control method) A virtual space control method will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of a virtual space control method according to the first embodiment. The processing shown in Fig. 5 is executed while a virtual office is provided by the virtual space control system 1. The processing shown in Fig. 5 is executed by the terminal control device 20 of the information terminal device 10 and the server control device 40 of the server device 30 of the virtual space control system 1.

[0088] The terminal control device 20 starts displaying the virtual office when the application control unit 24 starts operation of the virtual office application (step S101). More specifically, when the application control unit 24 starts the virtual office application by user operation or automatic startup, the display control unit 27 causes the display unit 17 of the information terminal device 10 to display an image showing the virtual office screen. After executing step S101, the process proceeds to step S102.

[0089] The terminal control device 20 acquires the relationships between users using the relationship acquisition unit 25 (step S102). The terminal control device 20 transmits data indicating the relationships between users acquired by the relationship acquisition unit 25 to the server device 30. After executing step S102, the process proceeds to step S103.

[0090] The server control device 40 determines whether the users are highly related to each other (step S103). More specifically, the server control device 40 obtains, via the virtual office control unit 42, whether the avatar corresponding to the user of the information terminal device 10 is highly related to users corresponding to other avatars located in the same virtual office. If the server control device 40 determines via the virtual office control unit 42 that the users are highly related to each other (Yes in step S103), the process proceeds to step S104. If the server control device 40 does not determine via the virtual office control unit 42 that the users are highly related to each other (No in step S103), the process proceeds to step S105.

[0091] If it is determined that the users are highly related to each other (Yes in step S103), the server control device 40 increases the volume of the voice of the other avatar output to the information terminal device 10 corresponding to the avatar by the virtual office control unit 42 (step S104). After executing step S104, the process proceeds to step S107.

[0092] If it is not determined that the users are highly related to each other (No in step S103), the virtual office control unit 42 determines whether the volume of the other avatar corresponding to the other user in the virtual office is at the initial value (step S105). More specifically, if the virtual office control unit 42 has increased the volume of the voice of the other avatar in the virtual office, the server control unit 40 determines that it is not at the initial value. If the virtual office control unit 42 determines that the volume of the voice of the other avatar in the virtual office is at the initial value (Yes in step S105), the server control unit 40 proceeds to step S107. In other words, the volume of the voice of the other avatar is maintained at the initial value. If the virtual office control unit 42 does not determine that the volume of the voice of the other avatar is at the initial value (No in step S105), the server control unit 40 proceeds to step S106.

[0093] If it is not determined that the volume of the voice of the other avatar is at the initial value (No in step S105), the virtual office control unit 42 resets the volume of the voice of the other avatar output to the information terminal device 10 corresponding to the avatar to the initial value (step S106). After executing step S106, the process proceeds to step S107.

[0094] The terminal control device 20 determines whether to terminate use of the virtual office (step S107). The terminal control device 20 determines to terminate use of the virtual office, for example, when it detects an operation to terminate use of the virtual office, when the information processing terminal 10 is disconnected from a network that allows use of the virtual office, or when an operation to turn off the power of the information processing terminal 10 is performed. When the terminal control device 20 determines to terminate use of the virtual office (Yes in step S107), it terminates the processing of this flowchart. When the terminal control device 20 does not determine to terminate use of the virtual office (No in step S107), it executes the processing of step S103 again.

[0095] (effect) As described above, in this embodiment, the relevance between an avatar and users corresponding to other avatars located within the same virtual office is acquired, and the audibility of voices between avatars can be controlled based on the relevance between the users. In this embodiment, the audibility of voices between avatars can be controlled for other avatars that are equidistant from the user's own avatar in the virtual office based on the relevance between the users.

[0096] In this embodiment, the volume of the voice of another avatar output to the information terminal device 10 corresponding to the avatar can be changed based on the avatar's relevance to the user corresponding to the other avatar. In this embodiment, the volume of the voice of the avatar corresponding to the user who is highly related to the avatar and the volume of the voice of the avatar corresponding to the user who is less related to the avatar can be changed. According to this embodiment, by changing the volume of the avatar's voice, the ease of hearing the voices between avatars can be controlled.

[0097] In this embodiment, the relevance between users can be determined based on the hierarchy in the group to which the user corresponding to the avatar belongs. In this embodiment, the relevance between users can be determined based on, for example, the hierarchy of the organization or the hierarchy of the job title. According to this embodiment, the relevance between users can be appropriately determined, making it easier for the user to hear the voices of other users that are useful to the user.

[0098] In this embodiment, the relevance between users can be determined based on the communication history between avatars. According to this embodiment, the relevance between users can be appropriately determined, making it easier for a user to hear the voices of other users that are useful to the user.

[0099] In this embodiment, targets for acquiring associations with a user include users corresponding to other avatars located within the information sharing range of the avatar corresponding to the user. According to this embodiment, the audibility of voices between avatars can be controlled based on associations with users located within the information sharing range and with whom voices are shared.

[0100] In this embodiment, the targets for acquiring the relevance to a user include users corresponding to other avatars located outside the information sharing range of the avatar corresponding to the user in the same virtual office. According to this embodiment, the audibility of voices between avatars can be controlled based on the relevance to users located outside the information sharing range.

[0101] [Second embodiment] A virtual space control system 1 according to the second embodiment will be described with reference to Figures 6 and 7. Figure 6 is a diagram showing another example of a virtual office display screen displayed on the display screen of an information terminal device. Figure 7 is a flowchart showing an example of a virtual space control method according to the second embodiment. In the following description, components similar to those in the virtual space control system 1 of the first embodiment are given the same or corresponding reference numerals, and detailed description thereof will be omitted. The virtual space control system 1 differs from the first embodiment in the processing in the virtual office control unit 42 of the server control device 40 of the server device 30.

[0102] In this embodiment, the virtual space control system 1 changes the form of the information sharing range around the avatar corresponding to the user of the information terminal device 10 based on the relevance of the avatar to users corresponding to other avatars. In this embodiment, the audibility of voices between avatars is controlled by controlling the form of the information sharing range.

[0103] The virtual office control unit 42 changes the type of information sharing range, which is the range within which the voice of the avatar can be heard, based on the avatar's relationship with users corresponding to other avatars. More specifically, the virtual office control unit 42 changes the type of information sharing range around the avatar corresponding to the user of the information terminal device 10, based on information received from the information terminal device 10 indicating the relationship of the user of the information terminal device 10 with other users. The virtual office control unit 42 transmits the changes to the type of information sharing range to the information terminal device 10.

[0104] For example, when the virtual office control unit 42 determines that the users are highly related to each other, it changes the information sharing range around the avatar corresponding to the user of the information terminal device 10 to be wider than the initial value. For example, when the virtual office control unit 42 determines that the users are lowly related to each other, it changes the information sharing range around the avatar corresponding to the user of the information terminal device 10 to be narrower than the initial value.

[0105] Changing the size of the information sharing range to be narrower than the initial value does not necessarily mean setting the area of ​​the information sharing range to 0. In other words, it means narrowing the size of the information sharing range to be narrower than the initial value while maintaining the state in which information can be shared.

[0106] Furthermore, when an avatar of another user communicating with the user is present within the information sharing range around the avatar corresponding to the user of the information terminal device 10, the virtual office control unit 42 changes the size of the information sharing range around the avatar corresponding to the user in a state where the information sharing ranges of the avatar corresponding to the user and the avatar of the other user overlap.

[0107] Another example of a virtual office display screen displayed on the display screen of an information terminal device will be described with reference to Fig. 6. In Fig. 6, an avatar corresponding to another avatar A4, which is highly related to the user corresponding to avatar A1, is speaking outside the information sharing range C1 of first avatar A1. Therefore, the user corresponding to first avatar A1 changes the information sharing range C4 of the other avatar A4 to an expanded information sharing range C4' that includes avatar A1 so that the user corresponding to first avatar A1 can hear the voice of the other avatar A4. In this case, the information terminal device 10 used by the user corresponding to avatar A1 may output the voice of the other avatar A4 at a volume higher than the initial value.

[0108] (Virtual space control method) The virtual space control method will be described with reference to Fig. 7. The processes of steps S201 to S203 and step S207 in Fig. 7 are the same as those of steps S101 to S103 and step S107 in Fig. 5.

[0109] If it is determined that the users are highly related (Yes in step S203), the server control device 40 causes the virtual office control unit 42 to expand the information sharing range around the avatar corresponding to the user of the information terminal device 10 from the initial value (step S204). After executing step S204, the process proceeds to step S207.

[0110] If it is not determined that the users are highly related (No in step S203), the virtual office control unit 42 determines whether the information sharing range around the avatar corresponding to the user of the information terminal device 10 is the initial value (step S205). More specifically, if the virtual office control unit 42 determines that the information sharing range around the avatar corresponding to the user of the information terminal device 10 is expanded from the initial value, the server control unit 40 determines that the information sharing range is not the initial value. If the virtual office control unit 42 determines that the information sharing range around the avatar corresponding to the user of the information terminal device 10 is the initial value (Yes in step S205), the server control unit 40 proceeds to step S207. In other words, the information sharing range around the avatar corresponding to the user of the information terminal device 10 is maintained at the initial value. If the virtual office control unit 42 does not determine that the information sharing range around the avatar corresponding to the user of the information terminal device 10 is the initial value (No in step S205), the server control unit 40 proceeds to step S206.

[0111] If it is not determined that the size of the information sharing range around the avatar corresponding to the user of the information terminal device 10 is the initial value (No in step S205), the virtual office control unit 42 resets the size of the information sharing range around the avatar corresponding to the user of the information terminal device 10 to the initial value (step S206). After executing step S206, the process proceeds to step S207.

[0112] (effect) As described above, in this embodiment, the type of information sharing range, which is the range within which an avatar's voice can be heard, can be changed based on the avatar's relationship with users corresponding to other avatars. In this embodiment, for example, the width of the information sharing range can be changed between an avatar corresponding to a user who is highly related to the avatar and an avatar corresponding to a user who is less related to the avatar. According to this embodiment, by changing the width of the information sharing range of the avatar, it is possible to control the ease with which voices between avatars can be heard.

[0113] The components of the virtual space control system shown in the figure are conceptual and functional, and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of them may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0114] The configuration of the virtual space control system is realized, for example, as software, by a program loaded into memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, using only hardware, only software, or a combination of both.

[0115] The components described above include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the configurations described above can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the configurations are possible within the scope of the gist of the present invention.

[0116] [Variations] The above-mentioned relevance acquisition unit 25 may acquire the relevance between users corresponding to each avatar according to their positions within the same virtual office. In other words, the relevance acquisition unit 25 may change the criteria for determining the relevance between users according to their positions within the same virtual office.

[0117] For example, if the location in the virtual office is the user's usual location, such as the area where the user's desk is located or the work area of ​​the user's department, other avatars located around the avatar corresponding to the user are likely to belong to the same organization. Therefore, the relevance acquisition unit 25 may determine the relevance between users based on the job title hierarchy. This makes it easier to hear the voice of the avatar that is the user's superior or subordinate when the user is usually located.

[0118] For example, if the location in the virtual office is outside the user's usual location, such as an area where the user's desk is not located or outside the work area of ​​the user's department, other avatars located around the avatar corresponding to the user are likely to belong to different organizations. Therefore, the relevance acquisition unit 25 may determine the relevance between users based on the hierarchy of the organizations. This makes it possible to make the voices of avatars corresponding to users in the same organization as the user easier to hear and the voices of avatars corresponding to users in different organizations harder to hear when the user is in a location other than the usual location. [Explanation of symbols]

[0119] 1 Virtual space control system 10 Information terminal device 11 Camera 12 microphones 13 Control section 17 Display section 18 Audio output section 19 Communications Department 20 Terminal control device (control unit) 21 Video acquisition unit 22 Voice acquisition unit 23 Operation reception section 24 Application control section 25 Relevance Acquisition Unit 26 Memory section 27 Display control unit 28 Audio output control unit 29 Communication control section 30 Server device 31 Communications Department 40 Server control device (control unit) 41 Communication control unit 42 Virtual Office Control Unit 49 Memory section

Claims

1. A virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user of the information terminal device in the virtual space, The control unit of the virtual space control system includes: acquiring a relationship between the avatar and a user corresponding to another avatar located in the same virtual space as the avatar, and controlling the audibility of voices between the avatars based on the relationship between the users; Virtual space control system.

2. The control unit changing a volume of the voice of the other avatar that is output to the information terminal device corresponding to the avatar, based on a relationship between the avatar and the user corresponding to the other avatar; The virtual space control system according to claim 1 .

3. The control unit changing a form of an information sharing range, which is a range within which the voice of the avatar can be heard, based on a relationship between the avatar and a user corresponding to the other avatar; 3. The virtual space control system according to claim 1 or 2.

4. The control unit determining the relevance of users to each other based on the hierarchy of a group to which the users corresponding to the avatars belong; 3. The virtual space control system according to claim 1 or 2.

5. The control unit determining a relationship between users based on a communication history between the avatars; 3. The virtual space control system according to claim 1 or 2.

6. 1. A virtual space control method executed by a virtual space control system that causes an information terminal device to display a virtual space and displays an avatar corresponding to a user of the information terminal device in the virtual space, comprising: acquiring a relationship between the avatar and a user corresponding to another avatar located in the same virtual space as the avatar, and controlling the audibility of voices between the avatars based on the relationship between the users; The virtual space control system executes the virtual space control method.

Images