Virtual space management system and method

Abstract

To easily identify a situation of another user via an avatar in a virtual space.SOLUTION: A virtual space management system 1 for managing the situation of each of users who operates an avatar GP1 in a virtual space 4 from a client terminal 3 includes: a virtual space control unit 21 which controls the virtual space provided to the client terminals; an information collection unit 23 which collects user situation information to be acquired by each of the client terminals on the users, from the client terminals; and an information providing unit 24 which provides predetermined user situation information extracted from among the collected user situation information to the virtual space, based on a predetermined policy set for each of the users, in association with avatars operated by the users.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a virtual space management system and method. [Background technology]

[0002] There are known technologies that allow multiple users to gather in a virtual space provided on a server on a network and interact through chats, games, etc. (Patent Documents 1 and 2) There is also known a technology that identifies person-related information, including location information, of conference participants (Patent Document 3). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5969476 [Patent Document 2] Japanese Patent Application Laid-Open No. 2003-058484 [Patent Document 3] Patent No. 6684934 Summary of the Invention [Problem to be solved by the invention]

[0004] When working from home, it is difficult to communicate because it is difficult to keep track of what is happening at work and with coworkers.

[0005] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a virtual space management system that allows users to easily grasp the situations of other users through their avatars in the virtual space. [Means for solving the problem]

[0006] A virtual space management system according to one aspect of the present invention is a virtual space management system that manages the status of each user who operates an avatar in a virtual space from a client terminal, and includes a virtual space control unit that controls the virtual space provided to each client terminal, an information collection unit that collects user status information from each client terminal that each client terminal acquires about the user, and an information provision unit that provides predetermined user status information extracted from the collected user status information based on a predetermined policy set for each user to the virtual space in association with the avatar operated by each user.

[0007] The information providing unit may provide predetermined user situation information to the virtual space as image information and audio information.

[0008] The predetermined policy may be set for each group to which the user belongs.

[0009] The predetermined policy may be set for each designated user.

[0010] There may be a plurality of pieces of predetermined user situation information, and the information providing unit may highlight updated predetermined user situation information from among the plurality of pieces of predetermined user situation information in the virtual space.

[0011] The information providing unit may provide the analysis result of each collected piece of user situation information to the virtual space as one piece of predetermined user situation information.

[0012] The device further includes a video call control unit that controls video calls in the virtual space, and the virtual space control unit determines whether a first avatar corresponding to a first client terminal among the multiple client terminals has come into contact with a second avatar corresponding to a second client terminal among the multiple client terminals in the virtual space.When the virtual space control unit determines that the first avatar and the second avatar have come into contact in the virtual space, the video call control unit can start a video call between the first client terminal and the second client terminal.

[0013] When the virtual space control unit determines that the first avatar and the second avatar have come into contact in the virtual space, the video call control unit can start a video call between the first client terminal and the second client terminal by displaying an image from the first client terminal in the first avatar and an image from the second client terminal in the second avatar. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is an overall schematic diagram of a virtual space management system according to an embodiment of the present invention. [Figure 2] Functional configuration diagram of the virtual space management system. [Figure 3] Illustration of a virtual office. [Figure 4] FIG. 10 is an explanatory diagram showing how user situation information is displayed around an avatar. [Figure 5] Example of user context information. [Figure 6] 10 is a flowchart showing a process for receiving information from a client terminal. [Figure 7] 10 is a flowchart showing another process for receiving information from a client terminal. [Figure 8] 10 is a flowchart of the overall process. [Figure 9] FIG. 10 is an explanatory diagram of an interest information filter, which is an example of a predetermined policy. [Figure 10] 10 is a flowchart of the overall process according to the second embodiment. [Figure 11] 10 is a flowchart of a process for calculating an amount of intellectual activity according to the third embodiment. [Figure 12] Illustration of a virtual office. [Figure 13] FIG. 13 is an explanatory diagram showing how a video call is started in the fourth embodiment. [Figure 14] FIG. 10 is an explanatory diagram showing how an image of a user is displayed within an avatar. [Figure 15] 10 is a flowchart of a video call process. [Figure 16] Flowchart following Figure 15. [Figure 17] 13 is a flowchart of a video call process according to the fifth embodiment. [Figure 18] 13 is a flowchart of the overall process according to the sixth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] In this embodiment, a virtual space management system is provided that enables members of various organizations, such as companies and local governments, to gather in a virtual space and check each other's status at a glance through avatars.

[0016] 1 shows an overview of a virtual space management system 1 according to this embodiment. The virtual space management system 1 includes, for example, a virtual office providing server 2 and a plurality of client terminals 3.

[0017] The virtual office providing server 2 provides a virtual office 4 as a "virtual space" to each client terminal 3. The virtual office providing server 2 includes a virtual office control unit 21 as a "virtual space control unit" that controls the virtual office 4, a video call control unit 22 that controls video calls made in the virtual office, an information collection unit 23 that collects information from each client terminal 3, and an information provision unit 24 that provides information to each client terminal 3 via the virtual office 4. Hereinafter, the virtual office providing server 2 may be abbreviated as server 2.

[0018] A user accesses the server 2 using a client terminal 3 and logs in to the virtual office service, thereby making his or her own avatar GP1 appear in the virtual office 4.

[0019] The virtual office 4 is a virtual space used by the company to which the user belongs, a local government, etc. The layout of the virtual office 4 can be similar to the layout of a real office, or can be different from the layout of a real office.

[0020] In the virtual office 4, for example, furniture and fixtures such as a desk GP21 and chair GP22, a desk nameplate GP31, a conference room GP5, and a concentration room GP6 (see Figure 3 for all of these) are depicted. While avatar GP1 is away from its predetermined seat, a ghost avatar GP12 is displayed at that seat. The ghost avatar GP12 indicates that the user is logged in but not at that seat. When another user comes into contact with the ghost avatar GP12, the other user is moved to the location of the avatar GP1 corresponding to the ghost avatar GP12.

[0021] For example, assume that the virtual office 4 has multiple floors, such as a first floor and a second floor. When the first avatar GP1 on the first floor moves to the second floor, if the second avatar GP1 on the first floor comes into contact with the ghost avatar GP12 of the first avatar GP1, the second avatar GP1 moves to the second floor next to the first avatar GP1.

[0022] Here, we will explain an example of a method for expressing the situation of a user operating avatar GP1 in virtual office 4. The information providing unit 24 displays user situation information collected from each client terminal 3 by the information collecting unit 23 around the avatar.

[0023] For example, a basic information display section GP11 showing basic information about the avatar GP1 is displayed in association with the avatar GP1. The basic information display section GP11 includes, for example, the name of the user operating the avatar GP1.

[0024] Avatars GP1 of users who belong to the same department, which is an example of a "group," are placed in a predetermined area. For example, an avatar GP1 of a user who belongs to a certain department is placed on a desk GP21 used by that department. A department name plate GP23 showing the department name, etc., is displayed on the desk GP21.

[0025] In addition to the basic information display unit GP11 and nameplate GP31, multiple display units GP32, GP33, GP34, and GP35 (described later in FIG. 4) are arranged around the avatar GP1. These display units GP11, GP32 to GP35 display information extracted from the user situation information by the information provider 24 using an interest information filter T1 (described later in FIG. 9).

[0026] Examples of user status information may include biological information or mental information of the user, such as body temperature, heart rate, physical condition, and fatigue level. If the user is wearing a wearable device with a function for measuring biological information, the biological information is updated as needed. If the server 2 has a machine learning model that calculates mental information such as fatigue level and happiness level from biological information, the user's mental information can also be displayed as needed on any of the display units GP11, GP31 to GP35. Hereinafter, the display units GP11, GP31 to GP35 may be abbreviated as display unit GP31, etc.

[0027] The display unit GP31 etc. can display the user status information as numerical values ​​or text. Alternatively, the user status information can be expressed by changing the shape, pattern, size, display color, etc. of the display unit GP31 etc. For example, the user status information can be conveyed to other users by ranking the values ​​of the user status information and changing the method of expression (size, shape, pattern, display color, etc.) for each rank.

[0028] As will be described later, part of the user situation information is provided within the virtual office 4 as audio information such as a chime sound, a buzzer sound, or a synthesized voice message.

[0029] By simply glancing at the virtual office 4 displayed on the screen of the client terminal 3, the user can easily grasp the situation of each user in the office through the display unit GP31 around each avatar GP1.

[0030] The client terminal 3 is equipped with a virtual office application 31 and an information collection application 32. The virtual office application 31 is a computer program that enables the client terminal 3 to access the virtual office server and use the virtual office service. A user can operate an avatar GP1 in the virtual office 4 via a user interface unit 33 (described later in FIG. 2) of the client terminal 3.

[0031] The information collection application 32 automatically collects information (user status information) about the user using the client terminal 3 via the user interface unit 33 of the client terminal 3, and transmits the collected information to the information collection unit 23 of the server 2. The information collection application 32 collects the user status information periodically or irregularly. The information collection application 32 can also collect the user status information from the user interface unit 33 when receiving a request from the server 2.

[0032] The information collection application 32 can send, for example, information acquired by a camera or microphone, information acquired from a keyboard or pointing device, or information acquired from the operating system or other application programs of the client terminal 3 to the server 2 as user status information. The information collection application 32 may transmit each piece of acquired user status information directly to the server 2, or may transmit the results of analyzing each piece of acquired user status information to the server 2.

[0033] According to the virtual space management system 1 of this embodiment configured as described above, a user can grasp the approximate situation of each user corresponding to each avatar GP1 simply by glancing at each display unit GP31, etc. arranged around each avatar GP1.

[0034] In this embodiment, each user's status, such as online status, in a meeting, or out, is not displayed as a list independent of the avatar, but is associated with avatar GP1 and displayed around it, making it easy to grasp the status of the virtual office 4, especially the status of other avatars around one's own avatar (the status of other users using those avatars). [Example]

[0035] The first embodiment will be described with reference to Figures 2 to 9. Figure 2 shows the functional configuration of the virtual space management system 1.

[0036] 1, the virtual space management system 1 includes a virtual office providing server 2 and a plurality of client terminals 3, and the server 2 and each client terminal 3 are connected via a communication network CN to enable two-way communication. The server 2 is also connected to other systems 5 via the communication network CN. The other systems 5 are, for example, attendance management systems, building entry / exit management systems, conference systems, and business management systems.

[0037] The server 2 is a computer equipped with a processor 200 and a memory 201, and functions as the virtual office providing server 2 by executing a computer program stored in the memory 201.

[0038] The server 2 includes, for example, a virtual office control unit 21, a video call control unit 22, an information collection unit 23, an information providing unit 24, a database (DB in the drawing) 25, and a communication unit 26. Details of the virtual office control unit 21, the video call control unit 22, the information collection unit 23, and the information providing unit 24 will be described later.

[0039] The database 25 includes, for example, a table that manages the authentication information of each user who uses the virtual office service, a table that manages each user's virtual office usage history, a table that manages the position and display form of various objects placed in the virtual office 4, and a table that manages user status information obtained from the information collection application 32 of each client terminal 3 (all of which are not shown).

[0040] The communication unit 26 has a function of performing two-way communication with each client terminal 3 via the communication network CN.

[0041] The storage medium MM is a storage medium capable of retaining data for a relatively long period of time, such as a flash memory or a hard disk drive. By connecting the storage medium MM to the server 2, at least a portion of a computer program can be transferred between the storage medium MM and the memory 201.

[0042] The client terminal 3 is a computer used by a user. The client terminal 3 may be configured as, for example, a laptop personal computer, a desktop personal computer, a tablet personal computer, a personal digital assistant (including a so-called smartphone), or a wearable terminal.

[0043] The client terminal 3 includes, for example, a virtual office application 31, an information collection application 32, a user interface (UI in the drawing) unit 33, and a communication unit .

[0044] The virtual office application 31 is a computer program for operating the avatar GP1 in the virtual office 4. The user interface unit 33 is a function for inputting and outputting information between the user and the client terminal 3 via an information input / output device (not shown). Examples of the information input / output device include a keyboard, pointing device, microphone, camera, monitor display, printer, and speaker. The communication unit 34 has a function for two-way communication with the server 2 via the communication network CN.

[0045] The information collection application 32 sends information obtained from the user interface unit 33 and information obtained from an operating system (not shown) or other applications running on the client terminal 3 to the information collection unit 23 of the server 2 either as is or after processing.

[0046] For example, an image captured by a camera can tell whether a user is in front of the client terminal 3. For example, a microphone signal can tell whether a user is talking or the noise surrounding the user. For example, by acquiring keyboard operations, it can be known that the user is inputting some information into the client terminal 3. For example, by acquiring operations on a mouse or touch panel, it can be known that the user is operating some application such as a web browser. For example, if the client terminal 3 has a GPS (Global Positioning System), it can know the user's current location, direction of movement, speed of movement, movement trajectory, etc. For example, if the client terminal 3 has a motion sensor, it can know the user's actions.

[0047] Furthermore, it is possible to know the web pages that the user has visited by acquiring the access history of other applications running on the client terminal 3, such as a web browser. For example, it is possible to know what software the user has been using by acquiring information on word processing software, spreadsheet software, design support software, etc., operated from the client terminal 3.

[0048] Furthermore, by acquiring user information from an attendance management system, it is possible to know what time the user came to work and what time the user left work. For example, by acquiring information from a building access control system, it is possible to know which building the user entered, what time the user left, and what time the user left.

[0049] 3 shows an example of a virtual office 4. The virtual office 4 is configured as a virtual two-dimensional space or a virtual three-dimensional space. The virtual office 4 may also be configured as a so-called virtual 2.5-dimensional space.

[0050] As described above, the virtual office 4 is provided with an avatar GP1 corresponding to each user, fixtures and fittings GP21, GP22 similar to those found in a real office, a desk nameplate GP31, a conference room GP5, a concentration room GP6, and the like.

[0051] Conference room GP5 is an area where users hold conferences via avatars. Who is in conference room GP5 can be visually confirmed from areas other than conference room GP5. When avatar GP1 enters conference room GP5, he automatically becomes a participant in the video call. For example, when avatar GP1 (U12) enters conference room GP5 where avatar GP1 (U8) is present, a video call between the avatars begins. There is no need for the avatars to come into contact with each other. This is because conference room GP5 is an area for conferences, and it is clear that the avatar wishes to make a video call at the time of entry.

[0052] Concentration room GP6 is an area used by users who want to concentrate on work or thinking. Only one avatar can enter concentration room GP6. Other avatars cannot contact the avatar in concentration room GP6, so they cannot make video calls with the avatar in concentration room GP6. For example, it is possible to contact the avatar in concentration room GP6 by displaying a message on the desk nameplate GP31.

[0053] The avatar GP1 may have a common design for all users, or may be selectable for each feature such as hairstyle or accessories. The avatar GP1 does not need to be designed to resemble a human, but may also be an animal or plant. Multiple types of avatars may be provided, such as a normal avatar GP1, a ghost avatar GP12, and a busy avatar GP1N. The busy avatar GP1N is an avatar that notifies others that the user is busy and will not accept video calls from other users. Therefore, even if another user's avatar GP1 contacts the busy avatar GP1N, a video call will not be initiated.

[0054] 4 shows how multiple pieces of user situation information are arranged around an avatar. As described above, multiple display units GP11, GP31 to GP35 can be arranged around avatar GP1. Below, examples of user situation information displayed on each of the display units GP11, GP31 to GP35 will be described.

[0055] Display unit GP11 located below the avatar displays, for example, the name of the user represented by the avatar (operating the avatar). Display unit GP31 placed on a desk displays the user's schedule, etc.

[0056] Display unit GP32 located at the top left of the avatar displays, for example, an image showing users having a conversation. Display unit GP33 located at the top right of the avatar displays, for example, an image showing users eating. Display unit GP23 provided for each department to which a user belongs displays, for example, the name of the department.

[0057] The display unit GP34 located at the lower right of the avatar uses sound (music, sound effects, messages, etc.) to indicate when other avatars enter or leave the room. Therefore, the display unit GP34 can also be called a notification unit GP34 or a representation unit GP34. The other display units GP11, GP31 to GP33, etc., can also be called notification units or representation units.

[0058] The sounds are not associated with the avatars and sounded in the virtual office 4, but act on the user viewing the virtual space 4 (hereinafter referred to as the operating user).

[0059] Display unit GP35 shown to the left of the avatar displays, for example, text or an image indicating that the user is out.

[0060] The inside of the avatar icon can also be used as the display section GP 36 that displays user status information. For example, the elapsed time logged into the virtual office 4 can be displayed in the display section GP 36 inside the avatar.

[0061] The above-described examples of user situation information and the relationship between the display position (representation position) thereof are merely examples, and this embodiment is not limited to the example in Fig. 4. When an image is used on the display unit, it may be either a still image such as an illustration or a moving image such as an animation.

[0062] Fig. 5 is an explanatory diagram showing an example of user situation information, which shows examples of display types of user situation information, methods of acquiring the information, methods of expressing the user situation information, and methods of controlling the same.

[0063] Display types of user status information include, for example, "1. Business status," "2. User status (status of the user in front of the client terminal)," "3. Online status," "4. Floor status," "5. Calendar status," and "6. Communication status."

[0064] Information about the "business status" is acquired, for example, from the operating status of a telephone application, the operating status of an online conference application, the operating status of an email application, the operating status of a software development application, the operating status of an office processing application, the on / off state of the screen of the client terminal 3, the on / off state of the power supply of the client terminal 3, the content posted to a chat application or the like, and the position measurement function of the client terminal 3. Depending on the content of the business status, for example, a phone call mark, an in-meeting mark, an email mark, an in-development mark, a document preparation mark, a client terminal sleeping mark, an unknown mark (when the client terminal is powered off), a moving mark, or the like is displayed on one of the display parts around the avatar.

[0065] Information about the "user status" is acquired from, for example, the state of input to the keyboard, input sounds to the microphone, the presence or absence of an image of the user captured by the camera, the user's actions and facial expressions captured by the camera, user location information, etc. Depending on the content of the user status, for example, a sweating animation, a speech bubble animation, an away mark, a nodding mark, a current location mark (such as "head office," "factory," or "at home") is displayed on one of the displays around the avatar.

[0066] Information about the "online status" is obtained, for example, by operating a pre-prepared status display button (away from desk button, eating button, etc.) or from another system 5 such as an attendance management system. Depending on the online status, for example, an away from desk mark, eating mark, long working hours mark, overtime warning mark, offline duration mark, etc. are displayed on one of the displays around the avatar.

[0067] Information about the "floor status" is acquired from the presence or absence of avatars entering or leaving the virtual office 4, the presence or absence of other avatars within a predetermined range of the operating user's avatar, etc. When another avatar for which seat GP22 is not provided enters the virtual office 4, a door ping-pong sound is made to ring from the operating user's client terminal 3. When another avatar for which seat GP22 is provided enters the virtual office 4, the sound effect of a door opening and closing is emitted from the operating user's client terminal 3. When another avatar enters within a predetermined range of the operating user's avatar, the sound effect of footsteps is emitted from the operating user's client terminal 3.

[0068] Information about the "calendar status" is obtained from, for example, schedule management software.

[0069] Information about the "communication status" is acquired from, for example, the usage status of video calls, the usage status of chat applications, and the like.

[0070] In "control," for example, the initiation of a video call can be prohibited when the user is in a meeting or on the phone. Alternatively, if another user requests a conversation while the user is eating or traveling, a message informing the user of the request can be sent to the client terminal 3 and displayed.

[0071] FIG. 6 is a flowchart showing the process in which the information collection unit 23 of the server 2 collects information from the information collection application 32 of each client terminal 3.

[0072] The information collection application 32 acquires the status of the information input / output unit (keyboard, camera, microphone, etc.) from the user interface unit 33 (S11), and acquires the status of other applications (web browser, business processing application, software development application, etc.) running on the client terminal 3 (S12). Furthermore, the information collection application 32 acquires the status of the operating system of the client terminal 3 (S13), and acquires location information of the client terminal 3 (S14). The information collection application 32 transmits this acquired information to the information collection unit 23 of the server 2 as user status information (S15).

[0073] When the information collection unit 23 receives information from each client terminal 3 (S21), it stores the received information in the database 25 (S22) and analyzes it (S23). Here, analysis refers to processing information from the information collection application 32 to identify the user's situation. For example, it is processing to determine how busy the user is based on the frequency with which characters are entered into the keyboard. The information collection unit 23 stores the analysis results from step S23 in the database 25 (S24).

[0074] In step S21, the information collection unit 23 can also acquire information from another system 5. For example, the information collection unit 23 can specify the identification number of the user who operates the client terminal 3, inquire about the attendance status of the user to the attendance management system, and acquire the response.

[0075] 7 shows a modified example of the process in which the information collection unit 23 of the server 2 collects information from the information collection application 32 of each client terminal 3. In this modified example, the information collection application 32 performs a primary analysis of the information collected from the user interface unit 33 and the like before transmitting the information to the server 2 (S16). The information collection application 32 transmits the results of the primary analysis to the information collection unit 23 (S15).

[0076] Here, the primary analysis means, for example, calculating the number of key inputs per unit time, or calculating the change in the user image per unit time (such as the movement trajectory of feature points set on the user image).

[0077] When the information collection unit 23 of the server 2 receives information (primary analysis results) from each client terminal 3 (S21), it stores the received information in the database 25 (S22) and performs secondary analysis (S23). Secondary analysis involves determining the user's level of busyness from the number of keystrokes per unit time, or inferring the user's actions from the movement trajectory of the user's image. As shown in Figure 7, by sharing the analysis of user situation information between the information collection application 32 and the information collection unit 23, the load on the server 2 can be reduced.

[0078] 8 is a flowchart of the overall processing of the virtual space management system 1. When the virtual office control unit 21 is accessed from the client terminal 3 and acquires login information (information used for user authentication) from the user, it executes a login process to the virtual office service (S31). The virtual office control unit 21 places objects such as avatars and desks within the virtual office 4 (S32).

[0079] The information providing unit 24 refers to an interest information filter T1 (described later in FIG. 9) set for the logged-in user (S33), and displays information (user situation information) set as being of interest to the user about other users around the other avatars (S34). Examples of displaying the situation of the user operating the avatar around the avatar have been described with reference to FIGS. 4 and 5.

[0080] As will be described later with reference to FIG. 9, the interest information filter to be used may be selected depending on the avatar density in the virtual office 4.

[0081] When the virtual office control unit 21 receives an operation from the client terminal 3 (S35), it controls the display of the virtual office 4 in accordance with the operation from the client terminal 3, such as changing the position or facial expression of the avatar (S36).

[0082] When avatars that are not prohibited from video calling come into contact with each other, the video call control unit 22 starts video call processing (S37). An example of the video call processing will be described later. The virtual office control unit 21 executes this processing until an instruction to stop the virtual office service is issued (S38).

[0083] 9 shows an example of an interest information filter T1 as a "predetermined policy." An interest information filter T1 is prepared for each user. The interest information filter T1 defines the status of other users to be provided to the corresponding user.

[0084] 9 includes, for example, a management number C11, a filter name C12, and a display content C13. The filter name C12 succinctly expresses the content of the interest information filter. The display content C13 is the content of the user situation information extracted by the interest information filter.

[0085] The user status information displayed for other avatars on the same floor, the user status information displayed for other avatars in the same group, the user status information displayed for other avatars in the same subgroup, and the user status information displayed for the avatar of a user specified by the operating user may each be different.

[0086] Here, a "group" is a group to which multiple users belong, and can be rephrased as a department. A "subgroup" is a small group that belongs to a group, and can be rephrased as a team.

[0087] For other avatars on the same floor, for example, "1. Business status" and "5. Calendar status" are displayed. For other avatars in the same group, for example, "1. Business status," "3. Online status," "4. Floor status," and "6. Communication status" are displayed. For other avatars in the same subgroup, for example, "1. Business status," "2. User status (status of the user in front of the client terminal)," "3. Online status," "4. Floor status," "5. Calendar status," and "6. Communication status" are displayed. For the avatars of other users specified by the user, for example, "1. Business status," "5. Calendar status," and "6. Communication status" are displayed.

[0088] If another avatar (another user) corresponds to multiple filters in the interest information filter T1, a filter corresponding to a lower concept can be applied. For example, if another avatar on the same floor belongs to a certain group, the "within the same group" filter with management number "2" is applied. If a user specifies the avatar of a specific user who belongs to a subgroup, the "specified user" filter with management number "4" is applied to the avatar of the specified user.

[0089] The present invention is not limited to the above example, and a filter with less display content may be applied preferentially, or conversely, a filter with more display content may be applied preferentially.

[0090] 9 controls the content displayed in each filter according to the avatar density in the virtual office 4. As the avatar density increases, the amount of user situation information placed around each avatar decreases, allowing users to easily grasp the situations of other users.

[0091] According to this embodiment configured as described above, information indicating the status of other users is displayed around the avatar GP1 corresponding to the other users, so that the status of the virtual office 4, particularly the status of other avatars around one's own avatar, can be easily grasped, thereby promoting communication. [Example]

[0092] The second embodiment will be described with reference to Figure 10. In the following embodiments, including this embodiment, differences from the first embodiment will be mainly described. In this embodiment, updated user situation information among the user situation information displayed around the avatar is displayed in an emphasized manner.

[0093] The flowchart in Figure 10 shows the overall processing of the virtual space management system according to this embodiment. Comparing this processing with the processing described in Figure 8, new steps S41 and S42 have been added between steps S34 and S35 in this processing.

[0094] The information providing unit 24 determines whether the status of another user corresponding to another avatar has been updated (S41), and if the user status information has been updated (S41: YES), the information providing unit 24 highlights and displays the updated information (S42).

[0095] This embodiment configured in this manner also achieves the same effects as those of Embodiment 1. Furthermore, in this embodiment, the updated user situation information among the user situation information extracted by the interest information filter T1 is displayed in an emphasized manner, so that the latest situation of the user can be quickly grasped, further improving usability. [Example]

[0096] The third embodiment will be described with reference to Figures 11 and 12. In this embodiment, the user situation information is analyzed, and the analysis result is displayed in the virtual office 4 as one piece of user situation information.

[0097] In this embodiment, the amount of intellectual activity is calculated as the “analysis result of user situation information” by analyzing the user situation information. The amount of intellectual activity is a value indicating the amount of intellectual activity of the user, and is measured from the content of the user situation information.

[0098] 11 is a flowchart showing a process for measuring an amount of intellectual activity. The information providing unit 24 acquires the analysis result stored in the database 25 in step S24 of FIG. 6 or FIG. 7 (S51), and refers to the intellectual activity amount management table T2 (S52).

[0099] The information providing unit 24 calculates the user's intellectual activity score (S53), and further calculates the total score of the group and subgroup to which the user belongs (S54). The information providing unit 24 then displays the user's intellectual activity score and the total intellectual activity score of the group and subgroup to which the user belongs in the virtual office 4 (S55). The user's intellectual activity score is displayed around the avatar corresponding to the user. The total intellectual activity score of the group and subgroup to which the user belongs is displayed according to the position of the group or subgroup.

[0100] The intellectual activity amount management table T2 includes, for example, a management number C21, an item name C22, and a score C23. In the intellectual activity amount management table T2, bonuses or penalties are defined, for example, as "1 point per keyboard input character," "1 point per minute of application startup time," "1 point per minute of video call," "5 points per work-related keyword," and "minus 1 point per banned word."

[0101] A business-related keyword is a keyword associated with a group or subgroup to which a user belongs. For example, if a user belongs to the sales department, keywords such as "developing new customers," "growing existing customers," and "sales promotion" are pre-registered as business-related keywords. The information providing unit 24 can detect business-related keywords by analyzing voice information or chat text collected from the client terminal 3.

[0102] NG words are pre-registered keywords that are undesirable to use, such as "trade secret theft."

[0103] Figure 12 shows the virtual office 4 displaying the intellectual activity scores. Each user's personal score is displayed around the corresponding avatar. The total score of the group and subgroup to which the user belongs is displayed, for example, near the department name plate GP23.

[0104] This embodiment configured in this manner also achieves the same effects as those of Embodiment 1. Furthermore, in this embodiment, the amount of intellectual activity for each user and group is visualized and displayed in the virtual office 4, making it easy to understand whether intellectual activity is active or not. [Example]

[0105] A fourth embodiment will be described with reference to Figures 13 to 16. In this embodiment, a case will be described in which users make video calls to each other within a virtual office 4 via each other's avatars.

[0106] 13 shows how user U1 makes a video call with user U16. When user U1 selects on the screen the avatar GP1 (U16) of the person he or she wants to talk to, a route RT from avatar GP1 (U1) to avatar GP1 (U16) is calculated, and avatar GP1 (U1) moves along the route RT at a predetermined speed (a speed corresponding to walking in a real office).

[0107] Then, when avatar GP1 (U1) reaches the destination location of avatar GP1 (U16), avatar GP1 (U1) stops at a position where its outer edge touches the outer edge of avatar GP1 (U16). The avatars do not substantially overlap. This is because if they overlap, the area in which the video VD is displayed during the video call will become smaller. The avatars may overlap as long as it does not affect the display area of ​​the video VD. When the avatars come into contact with each other, an effect GP13 is displayed on each avatar GP1 (U1) and GP1 (U16), indicating that preparations for the video call are beginning.

[0108] Figure 14 shows avatars during a video call. The size of each avatar GP1 (U1), GP1 (U16) participating in a video call increases by a predetermined amount (a predetermined ratio). The entire avatar may increase in size, or only a portion of the avatar (for example, the upper body or the part corresponding to the head) may increase in size.

[0109] A video VD captured by the user's client terminal 3 is displayed within the enlarged avatar. The video VD is not limited to live footage captured by the camera of the client terminal 3, but may also be an animation or still image selected by the user.

[0110] Since the video VD is displayed within the avatar at the position where the avatars come into contact with each other, the user operating the avatar can easily check the state of the virtual office 4 other than the avatar with which he or she is making a video call.

[0111] The flowchart shown in FIG. 15 shows details of the video call process (S37) shown in the flowchart of FIG.

[0112] The virtual office control unit 21 monitors whether the user has instructed the avatar to move (S61), and if an instruction to move the avatar has been given (S61: YES), calculates a route RT connecting the origin (current position) and destination (target position) (S62). The route RT is calculated so as not to come into contact with other users' avatars or objects such as desks.

[0113] The virtual office control unit 21 moves the avatar to be moved along the route RT to the destination at a predetermined speed (S63). The virtual office control unit 21 determines whether the avatar to be moved has come into contact with another avatar (S64). If the avatar to be moved has come into contact with another avatar (S64: YES), the virtual office control unit 21 stops the movement of the avatar (S65) and instructs the video call control unit 22 to start a video call (S66).

[0114] If the avatar to be moved comes into contact with another avatar that has not been selected as a conversation partner while moving along the route RT (S64: YES), a video call may be initiated within the avatar if the user operating the unscheduled avatar is in a situation where they can participate in the video conference (S66).

[0115] If the avatar to be moved comes into contact with one of the avatars already in a video call while moving along the route RT (S64: YES), the user operating the avatar to be moved can also join the video call that has already started (S66).

[0116] When the video call ends (S67: YES), the virtual office control unit 21 returns to step S38 in Fig. 8. The video call ends, for example, when the avatars move away from each other and are no longer in contact with each other. If the video call is still in progress, the process returns to step S66.

[0117] Fig. 16 is a flowchart showing details of the call control process in Fig. 15. When avatars come into contact with each other and an instruction to start a video call is given, video call control unit 22 starts preparations for the video call, such as sharing video and audio (S71).

[0118] When the video call control unit 22 starts preparation for the video call, it requests the virtual office control unit 21 to display the preparation effect GP13 (S72). When the preparation for the video call is completed (S73: YES), the video call control unit 22 requests the virtual office control unit 21 to stop displaying the preparation effect GP13 and enlarge the size of the avatar GP1 (S74).

[0119] The virtual office control unit 21 determines whether to adjust the positions of the avatars making the video call within the virtual office 4 (S75). If the positions of the avatars are to be adjusted (S75: YES), the virtual office control unit 21 moves the avatars making the video call to a predetermined video call area (S76).

[0120] The predetermined video call area is an area where an avatar making a video call is placed. The predetermined video call area may be, for example, the center of the virtual office 4 or one of the four corners. Whether or not to move the avatar to the predetermined video call area may be determined depending on the number of users making a video call within the virtual office 4. For example, if there are many users making a video call, the video call may be made at the avatar's contact position, and if there are few users making a video call, the avatar may be moved to the center or one of the four corners of the virtual office 4.

[0121] If the video call is to be made without adjusting the position of the avatar and while maintaining the current position (S75: NO), step S76 is skipped and the process proceeds to step S77.

[0122] The video call control unit 22 displays the video VD captured by the camera of the client terminal 3 in the avatar (S77) and starts a voice call (S78).

[0123] The virtual office control unit 21 determines whether the contact between the avatars has been resolved, i.e., whether the avatars during the video call have separated (S79). As long as the avatars remain in contact (S79: NO), the video call is maintained (S77, S78). When the avatars separate (S79: YES), the video call ends (S80).

[0124] When the virtual office control unit 21 detects the end of the video call, it returns the position and size of the avatar to the state before steps S74 and S76 were performed (S81).

[0125] Even if the contact between the avatars is released, the video call may continue for a predetermined short time rather than ending immediately, in case the user accidentally moves the avatar, for example.

[0126] This embodiment configured in this manner also achieves the same effects as those of Embodiment 1. Furthermore, in this embodiment, a user can start a video call simply by touching the avatar they are operating with the avatar of the person they want to talk to, and there is no need to operate any buttons or give voice instructions to start a video call.

[0127] Therefore, in this embodiment, users of the virtual space management system 1 can easily use video calls with intuitive operations while understanding the status of other users through the user status information displayed around each avatar, and can easily communicate in the same way as in a conversation in a real office.

[0128] In this embodiment, a video VD including a user's facial image is displayed inside the avatar, so that the state of the other party can be seen through the facial image, and since the facial image does not obscure the screen other than the avatar, the parties in the video call can check the situation in the virtual office 4 while making the video call, improving convenience. In other words, according to this embodiment, it is possible to both observe the situation in the virtual office 4 from a bird's-eye view and check the situation of the other party on a single screen, improving convenience.

[0129] In this embodiment, a user simply selects the avatar of the person they want to talk to, and a route from the user's avatar to the other person's avatar is calculated, and the user's avatar moves along the route at a normal walking speed. This allows a virtual office 4 that mimics a real office while still providing the convenience of operation inherent to a virtual office 4.

[0130] In this embodiment, a user can join a video call by simply touching their avatar to one of the avatars in the video call, which can further encourage casual conversation.

[0131] In this embodiment, a user can initiate an unscheduled video call by simply touching their avatar with an avatar that is moving to initiate the video call. This allows users to stop a nearby user and start a conversation, as is often seen in real offices, improving convenience.

[0132] In addition, when a user manually moves their avatar toward an avatar with which they wish to make a video call, the video call may not be started automatically even if the avatar comes into contact with another avatar while moving, but may be started only after the avatar stops moving manually. This prevents the video call from being started even if the avatar comes into contact with another avatar while moving, thereby preventing accidental video calls with users other than the desired user. [Example]

[0133] A fifth embodiment will be described with reference to Fig. 17. In this embodiment, keywords used during a video call are displayed so as to be visible to other users in the virtual office 4.

[0134] Fig. 17 is a flowchart showing the call control process of this embodiment. Compared to the process described in Fig. 16, this call control process includes a new step S90 between step S78 and step S79.

[0135] In new step S90, the virtual office control unit 21 displays the keywords passed from the video call control unit 22 within the virtual office 4. The video call control unit 22 recognizes the voice transmitted through the voice call channel, converts it into text data, and analyzes the converted text data to extract keywords. The video call control unit 22 sends some or all of the extracted keywords to the virtual office control unit 21. The virtual office control unit 21 displays some or all of the keywords input from the video call control unit 22 in the form of a speech bubble near the avatar. Other users within the virtual office 4 can see the keywords in the speech bubble associated with the avatar during the video call.

[0136] It is also possible to provide a privacy mode, and if one or both of the users making a video call specify the privacy mode, the extracted keywords will not be displayed in the virtual office 4. The privacy mode can be set, for example, when one of the users making a video call operates a "privacy button." Alternatively, priorities can be set between users, and when a user with a higher priority operates the privacy button, the display of keywords can be suppressed. It is also possible to refuse a third user from joining the video call when the privacy button is operated to switch to the privacy mode.

[0137] When displaying keywords in speech bubbles on an avatar during a video call, information indicating the tendency of comments made during the video call can also be displayed. For example, natural language processing can be used to classify text detected from a voice call channel as either negative or positive, and the classification results can be displayed together with or instead of keywords. For example, speech bubbles such as "Opening up new routes (positive)," "Adding new features (positive)," and "Short delivery time (negative)" can be displayed.

[0138] A part of the keywords may be replaced with information indicating speech tendencies, or all of the keywords may be replaced with information indicating speech tendencies. In the latter case, only the information indicating speech tendencies (text, symbols, marks, colors, etc.), such as "positive," "negative," "positive," "positive," is visible to users other than the user on the video call. When the above-mentioned privacy mode is selected, the information indicating speech tendencies may be displayed instead of displaying the keywords.

[0139] This embodiment configured in this manner also achieves the same effects as the first embodiment. Furthermore, in this embodiment, at least some of the keywords used during a video call can be displayed in the virtual office, allowing nearby users to guess the content of the conversation. This allows other users, whose interest is piqued, to easily join in the conversation by touching their own avatar with the avatar currently chatting.

[0140] Keywords may be extracted according to user attributes, or may be extracted randomly regardless of user attributes. For example, if a keyword registered in a dictionary database associated with the department to which the user belongs is detected from the audio channel of a video call, the keyword can be displayed on the virtual office 4. [Example]

[0141] A sixth embodiment will be described with reference to Fig. 18. In this embodiment, if a user's avatar comes into contact with another user's avatar while the user is controlling the movement of his or her avatar, a video call will not be initiated.

[0142] 18 is a flowchart showing the overall processing of the virtual space video call system 1 of this embodiment. In this processing, the user controls the movement of the avatar by manual operations such as dragging, so the movement route RT is not set.

[0143] After the above steps S31 to S36 are executed, the virtual office control unit 21 determines whether the user is moving the avatar (S101). If the user is moving the avatar (S101: YES), the virtual office control unit 21 does nothing while the user's manual movement continues (S102: YES) and waits until the user's manual movement of the avatar ends. Then, when the user's manual movement of the avatar ends (S102: NO), the virtual office control unit 21 determines whether contact has been made with another avatar (S103). If contact has been made with another avatar (S103: YES), the virtual office control unit 21 starts a call control process for a video call (S104). In step S104, the virtual office control unit 21 executes one of the call control processes described in FIG. 16 or 17.

[0144] This embodiment configured as described above also achieves the same effects as the first embodiment. Furthermore, in this embodiment, when a user manually moves their avatar toward an avatar with which they wish to make a video call, even if the avatar comes into contact with another avatar during the movement, the video call will not be initiated. Therefore, this embodiment can prevent accidental video calls from being made with users other than the user with whom the user wishes to make a video call, improving usability for the user.

[0145] Note that the operation of the avatar by the user is not limited to manual operations such as dragging. For example, the user's line of sight may be detected, and the movement of the avatar may be controlled based on the detected line of sight. Alternatively, the user's body movements, such as the movement of the hands and feet, may be detected by a camera, and the avatar may be moved in accordance with the user's body movements.

[0146] The present invention is not limited to the above-described embodiments. Those skilled in the art can make various additions and modifications within the scope of the present invention. The above-described embodiments can be combined as appropriate. [Explanation of symbols]

[0147] 1, 1A: Virtual space management system, 2: Virtual office provision server, 3: Client terminal, 4: Virtual office, 21: Virtual office control unit, 22: Video call control unit, 23: Information collection unit, 24: Information provision unit, 31: Virtual office application, 32: Information collection application, GP1: Avatar

Claims

[Claim 1] A virtual space management system that manages the status of each user who operates an avatar in a virtual space as a virtual office from a client terminal, comprising: a virtual space control unit that controls the virtual space provided to each of the client terminals; an information collection unit that collects user status information acquired by each of the client terminals regarding the user from each of the client terminals; an information providing unit that provides predetermined user situation information extracted from the collected user situation information based on a predetermined policy set for each user, the predetermined policy being information that the user is set to be interested in about other users, to the virtual space in association with a display unit selected from a plurality of display units arranged around an avatar operated by each user, The information providing unit selects the predetermined policy according to the avatar density in the virtual space, and the predetermined policy is set so that the greater the avatar density, the less the user situation information arranged around the avatar. Virtual space management system.

Images