Virtual space video calling system and method

Abstract

To provide a virtual space video call system and method configured to improve user-friendliness.SOLUTION: A virtual space video call system 1 includes: a virtual space control unit 21 which controls a virtual space 4 to be provided to a plurality of client terminals 3; and a video call control unit 22 which controls video calls in the virtual space. The virtual space control unit determines whether a first avatar corresponding to a first client terminal of the above client terminals has had contact with a second avatar corresponding to a second client terminal of the above client terminals, in the virtual space. When the virtual space control unit determines that the first avatar has had contact with the second avatar in the virtual space, the video call control unit starts a video call between the first client terminal and the second client terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a virtual space video calling system and method. [Background technology]

[0002] There is known a technology that allows multiple users to gather in a virtual space provided on a server on a network and interact through chats, games, etc. (Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 5969476 [Patent Document 2] Japanese Patent Application Laid-Open No. 2003-058484 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in recent years, with the spread of telework, where people work from home, there has been a lack of opportunities for communication, which has led to problems with maintaining a sense of camaraderie in the workplace and sharing information.

[0005] One idea is to gather employee avatars in a virtual office and hold a video call, but with typical video call systems, you select the person you want to call from a list and press the start call button, regardless of the avatar's location in the virtual office. Therefore, even if video calls are introduced into virtual offices, they are not much different from video calls made on smartphones, and lack the ease and convenience of walking up to the person you want to talk to and talking, as is common in real offices.

[0006] However, since the amount of data required for voice calls is small, it is conceivable that other avatars within a circular communication range set for an avatar may be automatically invited to a voice channel to start a voice call.

[0007] However, video calls involve larger amounts of data than voice calls. Therefore, if a method were to automatically start a video call with another avatar within the calling range, it would consume a large amount of computer resources and communication bandwidth. On the other hand, it would be possible to provide a button on the screen to start a video call and start the video call when the button is pressed, but in that case, a special operation would be required to start the call, which is different from starting a conversation in a real office. This makes it less user-friendly and does not promote casual communication.

[0008] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a virtual space video calling system and method that can improve usability for users. [Means for solving the problem]

[0009] A virtual space video call system according to one aspect of the present invention is a virtual space video call system in which multiple client terminals make video calls via a virtual space, and includes a virtual space control unit that controls the virtual space provided to the multiple client terminals, and a video call control unit that controls the video call in the virtual space.The virtual space control unit determines whether a first avatar corresponding to a first client terminal among the multiple client terminals has come into contact with a second avatar corresponding to a second client terminal among the multiple client terminals in the virtual space, and when the virtual space control unit determines that the first avatar and the second avatar have come into contact in the virtual space, the video call control unit starts a video call between the first client terminal and the second client terminal.

[0010] When the virtual space control unit determines that the first avatar and the second avatar have come into contact in the virtual space, the video call control unit can start a video call between the first client terminal and the second client terminal by displaying an image from the first client terminal in the first avatar and an image from the second client terminal in the second avatar.

[0011] The video call control unit may end the video call between the first client terminal and the second client terminal when the virtual space control unit determines that the first avatar and the second avatar have separated.

[0012] The virtual space control unit can enlarge at least a portion of the first avatar and the second avatar when the video call control unit starts a video call between the first client terminal and the second client terminal.

[0013] The virtual space control unit can also set a predetermined effect on the first avatar and the second avatar to indicate that a video call is being prepared while the video call control unit is preparing a video call between the first client terminal and the second client terminal.

[0014] The virtual space control unit may determine whether the first avatar has come into contact with the second avatar as a result of moving through the virtual space.

[0015] When a destination position for the first avatar is specified by the first client terminal, the virtual space control unit may calculate a predetermined route from the current position of the first avatar to the destination position, and move the first avatar along the calculated predetermined route.

[0016] A plurality of route modes for determining the predetermined route may be prepared in advance, and the virtual space control unit may calculate the predetermined route according to a route mode selected by the first client terminal from the plurality of route modes.

[0017] The video call control unit may extract keywords from a video call between the first client terminal and the second client terminal, and the virtual space control unit may display at least a portion of the keywords extracted by the video call control unit in the virtual space so that they can be viewed from client terminals other than the first client or the second client terminal. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is an overall schematic diagram of a virtual space video call system according to an embodiment of the present invention; [Figure 2] Functional configuration diagram of a virtual space video call system. [Figure 3] Illustration of a virtual office. [Figure 4] FIG. 10 is an explanatory diagram showing an avatar preparing to make a video call. [Figure 5] FIG. 10 is an explanatory diagram showing a state during a video call. [Figure 6] FIG. 10 is an explanatory diagram showing the state in which the position and size of the avatar have been adjusted. [Figure 7] 10 is a flowchart of the overall process. [Figure 8] 10 is a flowchart of a video call process. [Figure 9] An explanatory diagram showing how another avatar joins a video call. [Figure 10] An explanatory diagram showing a video call with three people. [Figure 11] FIG. 10 is an explanatory diagram showing how a video call is started when another avatar comes into contact with a moving avatar. [Figure 12] FIG. 10 is an explanatory diagram showing a state during a video call. [Figure 13] 10 is a flowchart showing a process for displaying keywords during a video call in a virtual office according to the second embodiment. [Figure 14] FIG. 10 is an explanatory diagram showing how keywords of an avatar are displayed during a video call. [Figure 15] 10 is a flowchart of the overall process according to the third embodiment. [Figure 16] 10 is a flowchart of the overall process according to the fourth embodiment. [Figure 17] A table that determines routes depending on travel mode. [Figure 18] 13 is a flowchart of the overall process according to the fifth embodiment. [Figure 19] FIG. 13 is a functional configuration diagram of a virtual space video call system according to a sixth embodiment. [Figure 20]13 is a flowchart of the overall process according to the seventh embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] In this embodiment, a virtual space video call system is provided that allows users to easily make video calls with other users, just like having a conversation in a real office, by simply moving their own avatar toward the avatar of the person they want to talk to and touching it, an intuitive operation.

[0020] 1 shows an overview of a virtual space video call system 1 according to this embodiment. The virtual space video call system 1 includes, for example, a virtual office providing server 2 and a plurality of client terminals 3.

[0021] The virtual office providing server 2 provides a virtual office 4 as a "virtual space" to each client terminal 3. The virtual office providing server 2 includes a virtual office control unit 21 as a "virtual space control unit" that controls the virtual office 4, and a video call control unit 22 that controls video calls made in the virtual office. In the following description, the virtual space video call system 1 may be abbreviated as the video call system 1, and the virtual office providing server 2 may be abbreviated as the server 2.

[0022] A user accesses the server 2 using a client terminal 3 and logs in to the virtual office service, thereby making his or her avatar GP1 appear in the virtual office 4. As will be described later, the client terminal 3 has a camera as an image acquisition unit in its user interface unit 32.

[0023] The virtual office 4 is a virtual space used by the company to which the user belongs. The layout of the virtual office 4 can be similar to the layout of a real office, or can be different from the layout of a real office.

[0024] In the virtual office 4, for example, furniture and fixtures such as a desk GP2 and chair GP3, a desk nameplate GP4, a conference room GP5, and a concentration room GP6 (see Figure 3) are depicted. While avatar GP1 is away from its predetermined seat, a ghost avatar GP12 is displayed at that seat. The ghost avatar GP12 indicates that the user is logged in but not at that seat. When another user touches the ghost avatar GP12, the other user is moved to the location of the avatar GP1 corresponding to the ghost avatar GP12.

[0025] For example, assume that the virtual office 4 has multiple floors, such as a first floor and a second floor. When the first avatar GP1 on the first floor moves to the second floor, if the second avatar GP1 on the first floor comes into contact with the ghost avatar GP12 of the first avatar GP1, the second avatar GP1 moves to the second floor next to the first avatar GP1.

[0026] An information display section GP11 showing information about the avatar GP1 is displayed in association with the avatar GP1. The information display section GP11 includes, for example, the name of the user operating the avatar GP1. In addition to the name, the information display section GP11 can also display the name of the department to which the user belongs, a numerical value indicating the activity level of the user, information indicating the user's status, and the like.

[0027] The user's condition may include, for example, biological information and mental information such as physical condition, sleep time, body temperature, heart rate, fatigue level, and happiness level. If the user is wearing a wearable device with a function for measuring biological information, the biological information displayed on the information display unit GP11 is updated as needed. If the server 2 has a machine learning model that calculates mental information such as fatigue level and happiness level from biological information, the user's mental information can also be displayed as needed on the information display unit GP11.

[0028] The information display unit GP11 may also display the user's self-reported biological information or mental information. For example, values ​​such as physical condition, body temperature, and fatigue level that the user inputs to the server 2 via the client terminal 3 may be displayed on the information display unit GP11.

[0029] The information display unit GP11 can display biometric information or mental information as numerical values ​​or text, or can express it as the color or shape of the information display unit GP11 or avatar GP1. For example, if the user is feeling unwell, the avatar GP1 may be displayed in red, or the information display unit GP11 may blink according to the user's heart rate. Note that biometric information or mental information does not need to be displayed constantly on the information display unit GP11; it can also be displayed in a so-called pop-up window when the pointer is placed over the information display unit GP11.

[0030] A case where a video call is made within the virtual office 4 will be described. For example, as shown in the lower right side of the virtual office 4 in the center of FIG. 1, a case where user U3 wishes to make a video call with user U10 will be described. Hereinafter, for example, the avatar GP1 used by user U1 will be referred to as avatar GP1(U1), and the ghost avatar GP12 used by user U1 will be referred to as ghost avatar GP12(U1).

[0031] When user U3's avatar GP1 (U3) wishes to have a video call with user U10's avatar GP1 (U10), he or she moves from his or her desk to the location of avatar GP1 (U10), just as one would do in a real office. To do this, user U3 simply selects and clicks avatar GP1 (U10) with a pointer PT or the like. When avatar GP1 (U10) is selected, the virtual office control unit 21 calculates the route RT from the current position of avatar GP1 (U3) to avatar GP1 (U10) and moves avatar GP1 (U3) along the route RT at a predetermined speed.

[0032] The predetermined speed is a speed that resembles the speed at which a user walks in a real office. The movement route RT is calculated to resemble movement in a real office, so that the avatar GP1 (U3) does not come into contact with other avatars (for example, GP1 (U9)).

[0033] If avatar GP1 (U9) comes into contact with avatar GP1 (U3) moving toward avatar GP1 (U10), a video call between avatar GP1 (U3) and avatar GP1 (U9) will be initiated at that point, as will be described later. If user U3 wants to prioritize a video call with user U10, who he or she initially selected as a conversation partner, he or she can select a mode to reject video calls from other user U9, as will be described later.

[0034] Now, avatar GP1 (U3) travels along route RT and arrives at the location of avatar GP1 (U10). Avatar GP1 (U3) stops at a position where its outer edge touches the outer edge of avatar GP1 (U10).

[0035] When avatar GP1 (U3) and avatar GP1 (U10) come into contact, the video call control unit 22 starts preparing for the video call. Until the preparation for the video call is complete, the virtual office control unit 21 displays a predetermined effect GP13 indicating that the video call is being prepared on each of the avatars GP1 (U3) and GP1 (U10), who are the targets of the video call. The predetermined effect GP13 notifies not only the targets U3 and U10 of the video call but also other users in the vicinity that the video call has started by, for example, changing the color of the avatar GP1, blinking it, enlarging or reducing its size, or displaying an animation.

[0036] As shown in the lower part of Figure 1, when a video call is initiated, the size of each avatar GP1 (U3) and GP1 (U10) participating in the video call is enlarged by a predetermined amount. The user's video VD is then displayed within the enlarged avatar. That is, within the enlarged avatar GP1 (U3), a video VD (U3) containing the face image of user U3 is displayed. Similarly, within the enlarged avatar GP1 (U10), a video VD (U10) of user U10 is displayed.

[0037] In detail, whether or not the user's face image is displayed in the avatar GP1 depends on the orientation of the camera on the client terminal 3, work regulations, etc. If the user does not wish to show their face, the user can turn off the camera, point the camera in a direction away from the user, or display a still image or animation instead of the face image.

[0038] To other users not participating in the video call, the avatar during the video call appears at normal size. To clearly indicate to other users that a video call is in progress, the avatar may change color, shape, or size.

[0039] According to the virtual space video call system 1 of this embodiment configured as described above, a user can start a video call simply by touching an avatar representing the user to the avatar of the person with whom the user wants to talk. This allows the user to easily use video calls with intuitive operations, and allows for easy communication similar to that of a conversation in a real office.

[0040] Furthermore, in this embodiment, the user's facial image is displayed inside the avatar, allowing the user to know what the other person is like through that facial image. In addition, since the facial image does not obscure the screen other than the avatar, the parties in the video call can check the situation inside the virtual office 4 while making the video call, thereby improving convenience.

[0041] In a typical video call system, the purpose is the video call itself, so the facial image of each user participating in the video call is displayed as large as possible. In contrast, the virtual space video call system 1 of this embodiment aims to promote comprehensive communication within the virtual office 4, and the video call is merely one means to achieve this. Communication in the virtual office 4 also includes non-verbal communication, such as checking whether a user is seated or out, whether other avatars are making video calls, how other avatars are moving, and whether or not a busy mark is displayed. For this reason, the virtual space video call system 1 of this embodiment keeps facial images within the avatar during the video call so that non-verbal communication can be fully utilized. Even if the facial image is small, the user's appearance can be seen, so communication during the video call is not hindered.

[0042] In this embodiment, a user simply selects the avatar of the person they want to talk to, and a route from the user's avatar to the other person's avatar is calculated, and the user's avatar moves along the route at a normal walking speed. This allows a virtual office 4 that mimics a real office while still providing the convenience of operation inherent to a virtual office 4. [Example]

[0043] The first embodiment will be described with reference to Figures 2 to 12. Figure 2 shows the functional configuration of the virtual space video call system 1.

[0044] As described in Figure 1, the virtual space video call system 1 comprises a virtual office providing server 2 and multiple client terminals 3, and the server 2 and each client terminal 3 are connected via a communication network CN to enable two-way communication.

[0045] The server 2 is a computer equipped with a processor 200 and a memory 201, and functions as the virtual office providing server 2 by executing a computer program stored in the memory 201.

[0046] The server 2 includes, for example, a virtual office control unit 21, a video call control unit 22, a database (DB in the drawing) 23, and a communication unit 24. The virtual office control unit 21 and the video call control unit 22 will be described in detail later.

[0047] The database 23 includes, for example, a table that manages the authentication information of each user who uses the virtual office service, a table that manages each user's virtual office usage history, and a table that manages the positions and display forms of various objects placed in the virtual office 4 (all of which are not shown).

[0048] The communication unit 24 has a function of performing two-way communication with each client terminal 3 via the communication network CN.

[0049] The storage medium MM is a storage medium capable of retaining data for a relatively long period of time, such as a flash memory or a hard disk drive. By connecting the storage medium MM to the server 2, at least a portion of a computer program can be transferred between the storage medium MM and the memory 201.

[0050] The client terminal 3 is a computer used by a user. The client terminal 3 may be configured as, for example, a laptop personal computer, a desktop personal computer, a tablet personal computer, a personal digital assistant (including a so-called smartphone), or a wearable terminal.

[0051] The client terminal 3 includes, for example, a virtual office application 31, a user interface (UI in the drawing) unit 32, and a communication unit 33.

[0052] The virtual office application 31 is a computer program for operating the avatar GP1 in the virtual office 4. The user interface unit 32 is a function for inputting and outputting information between the user and the client terminal 3 via an information input / output device (not shown). Examples of the information input / output device include a keyboard, pointing device, microphone, camera, monitor display, printer, and speaker. The communication unit 33 has a function for two-way communication with the server 2 via the communication network CN.

[0053] 3 shows an example of a virtual office 4. The virtual office 4 is configured as a virtual two-dimensional space or a virtual three-dimensional space. The virtual office 4 may also be configured as a so-called virtual 2.5-dimensional space.

[0054] As described above, the virtual office 4 is provided with an avatar GP1 corresponding to each user, fixtures and fittings GP2, GP3 similar to those found in a real office, a desk nameplate GP4, a conference room GP5, a concentration room GP6, and the like.

[0055] Conference room GP5 is an area where users hold conferences via avatars. Who is in conference room GP5 can be visually confirmed from areas other than conference room GP5. When avatar GP1 enters conference room GP5, he automatically becomes a participant in the video call. For example, when avatar GP1 (U12) enters conference room GP5 where avatar GP1 (U8) is present, a video call between the avatars begins. There is no need for the avatars to come into contact with each other. This is because conference room GP5 is an area for conferences, and it is clear that the avatar wishes to make a video call at the time of entry.

[0056] Concentration room GP6 is an area used by users who want to concentrate on work or thinking. Only one avatar can enter concentration room GP6. Other avatars cannot contact the avatar in concentration room GP6, so they cannot make video calls with the avatar in concentration room GP6. For example, it is possible to contact the avatar in concentration room GP6 by displaying a message on the desk nameplate GP4 of the avatar.

[0057] The avatar GP1 may have a common design for all users, or may be selectable for each feature such as hairstyle or accessories. The avatar GP1 does not need to be designed to resemble a human, but may also be an animal or plant. Multiple types of avatars may be provided, such as a normal avatar GP1, a ghost avatar GP12, and a busy avatar GP1N. The busy avatar GP1N is an avatar that notifies others that the user is busy and will not accept video calls from other users. Therefore, even if another user's avatar GP1 contacts the busy avatar GP1N, a video call will not be initiated.

[0058] In addition to the above-mentioned avatars, for example, a chat avatar may be prepared to notify people around you that you welcome a video call. The user can freely select a desired avatar.

[0059] 4 shows how user U1 makes a video call with user U16. When user U1 selects the avatar GP1 (U16) of the person he or she wants to talk to on the screen, a route RT from avatar GP1 (U1) to avatar GP1 (U16) is calculated, and avatar GP1 (U1) moves along the route RT at a predetermined speed (a speed corresponding to walking in a real office).

[0060] Then, when avatar GP1 (U1) reaches the destination location of avatar GP1 (U16), avatar GP1 (U1) stops at a position where its outer edge touches the outer edge of avatar GP1 (U16). The avatars do not substantially overlap. This is because if they overlap, the area in which the video VD is displayed during the video call will become smaller. The avatars may overlap as long as it does not affect the display area of ​​the video VD. When the avatars come into contact with each other, an effect GP13 is displayed on each avatar GP1 (U1) and GP1 (U16), indicating that preparations for the video call are beginning.

[0061] Figure 5 shows the state when a video call has started. The size of each avatar GP1 (U1), GP1 (U16) participating in the video call increases by a predetermined amount (a predetermined ratio). The entire avatar may increase in size, or only a part of the avatar (for example, the upper body or the part corresponding to the head) may increase in size.

[0062] A video VD captured by the user's client terminal 3 is displayed within the enlarged avatar. The video VD is not limited to live footage captured by the camera of the client terminal 3, but may also be an animation or still image selected by the user.

[0063] Since the video VD is displayed within the avatar at the position where the avatars come into contact with each other, the user operating the avatar can easily check the state of the virtual office 4 other than the avatar with which he or she is making a video call.

[0064] FIG. 6 shows a modified example of avatar display during a video call. In FIG. 5, the video call was initiated at a position where the avatars touched each other in the virtual office 4. In this modified example, the positions of the avatars that are in contact with each other (a pair of avatars making a video call) are changed to a position different from the initial contact position, and the video call is initiated. In FIG. 6, avatars GP1 (U1) and GP1 (U16) have been relocated to the center of the virtual office 4. The avatars are not limited to the center of the virtual office 4, and the video call may be initiated by moving them to, for example, the four corner areas of the virtual office.

[0065] 7 is a flowchart showing the overall processing of the virtual space video call system 1. The flow described below is an example, and the virtual space video call system 1 of this embodiment can also be realized by methods other than those shown in the drawing.

[0066] After completing initialization processing and user login processing (not shown), the virtual office control unit 21 of the server 2 receives a user operation from the client terminal 3 (S11), and controls the display of the virtual office 4 in accordance with the user operation (S12).

[0067] The virtual office control unit 21 monitors whether the user has instructed the avatar to move (S13), and if an instruction to move the avatar has been given (S13: YES), calculates a route RT connecting the origin (current position) and destination (target position) (S14). The route RT is calculated so as not to come into contact with other users' avatars or objects such as desks.

[0068] The virtual office control unit 21 moves the avatar to be moved along the route RT to the destination at a predetermined speed (S15). The virtual office control unit 21 determines whether the avatar to be moved has come into contact with another avatar (S16). If the avatar to be moved has come into contact with another avatar (S16: YES), the virtual office control unit 21 stops the movement of the avatar (S17) and instructs the video call control unit 22 to start a video call (S18).

[0069] When the avatar to be moved reaches the location of the avatar selected as the conversation partner, the outer edges of the avatars come into contact with each other (S16: YES), and a video call is initiated within the avatars between the users operating the avatars (S18).

[0070] If the avatar to be moved comes into contact with another avatar that has not been selected as a conversation partner while moving along the route RT (S16: YES), a video call with the user operating the unplanned avatar is started within the avatar (S18).

[0071] If the avatar to be moved comes into contact with one of the avatars already in a video call while moving along the route RT (S16: YES), the user operating the avatar to be moved joins the video call that has already started (S18).

[0072] The virtual office control unit 21 continues to execute this process until an instruction to stop the virtual office service is received (S19).

[0073] Fig. 8 is a flowchart showing details of the video call process S18 in Fig. 7. When avatars come into contact with each other and an instruction to start a video call is given, the video call control unit 22 starts preparations for the video call, such as sharing video and audio (S31).

[0074] When the video call control unit 22 starts preparation for the video call, it requests the virtual office control unit 21 to display the preparation effect GP13 (S32).

[0075] When the preparation for the video call is completed (S33: YES), the video call control unit 22 requests the virtual office control unit 21 to stop displaying the preparation effect GP13 and to enlarge the size of the avatar 21 (S34).

[0076] The virtual office control unit 21 determines whether to adjust the positions of the avatars making the video call within the virtual office 4 (S35). If the positions of the avatars are to be adjusted (S35: YES), the virtual office control unit 21 moves the avatars making the video call to a predetermined video call area (S36).

[0077] The predetermined video call area is an area where an avatar making a video call is placed. The predetermined video call area may be, for example, the center of the virtual office 4 or one of the four corners. Whether or not to move the avatar to the predetermined video call area may be determined depending on the number of users making a video call within the virtual office 4. For example, if there are many users making a video call, the video call may be made at the avatar's contact position, and if there are few users making a video call, the avatar may be moved to the center or one of the four corners of the virtual office 4.

[0078] If the video call is to be made without adjusting the position of the avatar and while maintaining the current position (S35: NO), step S36 is skipped and the process proceeds to step S37.

[0079] The video call control unit 22 displays the video VD captured by the camera of the client terminal 3 in the avatar (S37) and starts a voice call (S38).

[0080] The virtual office control unit 21 determines whether the contact between the avatars has been resolved, i.e., whether the avatars during the video call have separated (S39). As long as the avatars remain in contact (S39: NO), the video call is maintained (S37, S38). When the avatars separate (S39: YES), the video call ends (S40).

[0081] When the virtual office control unit 21 detects the end of the video call, it returns the position and size of the avatar to the state before steps S34 and S36 were performed (S41).

[0082] Even if the contact between the avatars is released, the video call may continue for a predetermined short time rather than ending immediately, in case the user accidentally moves the avatar, for example.

[0083] 9 and 10 show an example in which another avatar joins an already ongoing video call. Here, it is assumed that avatar GP1 (U1) and avatar GP1 (U16) come into contact with each other and a video call is taking place between user U1 and user U16.

[0084] If a third user U5 moves avatar GP1(U5) to touch either avatar GP1(U1) or avatar GP1(U16), then avatar GP1(U5) also joins the video call, as shown in FIG.

[0085] 11 and 12 show how an avatar moving toward the avatar of a person it wants to talk to is contacted by another avatar, starting an unscheduled video call.

[0086] When user U1 is moving avatar GP1(U1) along route RT1 toward avatar GP1(U16) to have a video call with user U16, and user U5 wishes to have a video call with user U1, user U5 brings avatar GP1(U5) into contact with the moving avatar GP1(U1).

[0087] When user U5 selects the moving avatar GP1(U1), a route RT2 from avatar GP1(U5) to avatar GP1(U1) is set. Avatar GP1(U5) moves along the route RT2 and comes into contact with the moving avatar GP1(U1).

[0088] The speed V2 for chasing a moving avatar can be set to be faster than the predetermined speed V1, resembling a brisk walk in a real office. This allows user U5 to have a video call with user U16 before user U1 has a video call with user U16, as shown in Figure 12.

[0089] According to this embodiment, a user can start a video call simply by touching the avatar they are controlling with the avatar of the person they want to talk to, without the need for button operations or voice instructions to start a video call. Therefore, users of the virtual space video call system 1 can easily use video calls with intuitive operations, and can easily communicate in the same way as in a real office conversation.

[0090] In this embodiment, a video VD including a user's facial image is displayed inside an avatar, so that the state of the other party can be seen through the facial image, and since the facial image does not obscure the screen other than the avatar, the parties in the video call can check the situation inside the virtual office 4 while making the video call, improving convenience. In other words, according to this embodiment, it is possible to observe the virtual office 4 and check the situation of the other party on a single screen.

[0091] In this embodiment, a user simply selects the avatar of the person they want to talk to, and a route from the user's avatar to the other person's avatar is calculated, and the user's avatar moves along the route at a normal walking speed. This allows a virtual office 4 that mimics a real office while still providing the convenience of operation inherent to a virtual office 4.

[0092] In this embodiment, a user can join a video call by simply touching their avatar to one of the avatars in the video call, which can further encourage casual conversation.

[0093] In this embodiment, a user can initiate an unscheduled video call by simply touching their avatar with an avatar that is moving to initiate the video call. This allows users to stop a nearby user and start a conversation, as is often seen in real offices, improving convenience. [Example]

[0094] The second embodiment will be described with reference to Figures 13 and 14. In the following embodiments, including this embodiment, differences from the first embodiment will be mainly described. In this embodiment, keywords used during a video call are displayed so that they can be seen by other users in the virtual office 4.

[0095] 13 shows the overall processing of the virtual space video call system of this embodiment. Compared to the processing described in FIG. 8, this processing includes a new step S50 between steps S38 and S39.

[0096] In new step S50, the virtual office control unit 21 displays the keywords passed from the video call control unit 22 in the virtual office 4. The video call control unit 22 recognizes the voice transmitted through the voice call channel, converts it into text data, and analyzes the converted text data to extract keywords. The video call control unit 22 sends some or all of the extracted keywords to the virtual office control unit 21. The virtual office control unit 21 displays some or all of the keywords input from the video call control unit 22 in the speech bubble GP14. Other users in the virtual office 4 can see the keywords displayed in the speech bubble GP14.

[0097] In Fig. 14, each user's comment is shown separately in a speech bubble GP14, but it is not necessary to clearly distinguish between the keyword and the speaker. Keywords can be displayed by using multiple speech bubbles GP14 in sequence without distinguishing who made the comment. Alternatively, only one speech bubble GP14 can be displayed at the point where avatars contact each other.

[0098] This embodiment configured in this manner also achieves the same effects as the first embodiment. Furthermore, in this embodiment, at least some of the keywords used during a video call can be displayed in the virtual office, allowing nearby users to guess the content of the conversation. This allows other users, whose interest is piqued, to easily join in the conversation by touching their own avatar with the avatar currently chatting.

[0099] Keywords may be extracted according to user attributes, or may be extracted randomly regardless of user attributes. For example, if a keyword registered in a dictionary database associated with the user's department is detected from the audio channel of a video call, the keyword can be displayed on the virtual office 4.

[0100] Furthermore, the content of the conversation may be evaluated and the score may be managed for each user. For example, if a predetermined keyword related to the work of the department or the company's business is detected in a video call, the user on the call may be given a high score, and if a general keyword other than those is detected, the user on the call may be given a low score. This allows the degree of work contribution of teleworking users to be measured indirectly. [Example]

[0101] A third embodiment will be described with reference to Fig. 15. In the virtual space video call system of this embodiment, a user can reject a video call in advance.

[0102] Comparing the overall process shown in FIG. 15 with the overall process described in FIG. 7, a new step S60 is added between step S16 and step S17 in this process.

[0103] When a user's avatar contacts another user's avatar (S16: YES), the virtual office control unit 21 determines whether the user of the contacted avatar has permitted video calls (S60). If the user of the contacted avatar has not permitted video calls (S60: NO), the process skips steps S17 and S18 and proceeds to step S19.

[0104] Users can choose whether or not to allow video calls in advance. If a user does not allow video calls, the user will use an avatar such as the busy avatar GP1N shown in Figure 3.

[0105] The user can also set whether or not to accept video calls, for example, for a predetermined time period, a predetermined time, or a predetermined day of the week. For example, the user can reject video calls from 9:00 AM to noon, and accept video calls at other times. Alternatively, the user can accept video calls only for a predetermined period of time starting from a certain time. This embodiment configured in this way also achieves the same effects as the first embodiment. [Example]

[0106] A fourth embodiment will be described with reference to Figures 16 and 17. In this embodiment, an avatar is moved within the virtual office 4 according to the movement mode.

[0107] Fig. 16 shows the overall processing of the virtual space video call system 1 of this embodiment. Comparing this processing with the processing shown in Fig. 7, new steps S70 and S71 are added between steps S12 and S14 in this processing.

[0108] In the virtual space video call system 1 of this embodiment, a user can move an avatar without deciding on a destination (movement destination). Here, this movement without a fixed destination is called a stroll. When the user instructs the avatar to stroll (S70: YES), the virtual office control unit 21 determines the destination according to the movement mode set for the user (S71). The virtual office control unit 21 calculates a route toward the destination determined in step S71 (S14), and moves the avatar along the route at a predetermined speed (S15).

[0109] 17 shows a table T1 for managing travel modes. The travel mode management table T1 manages management numbers that distinguish travel modes and the contents of the travel modes.

[0110] Possible movement modes include, for example, moving randomly within the same floor, moving randomly between each floor of a virtual building, circulating within the same floor along a pre-registered route, circulating between each floor of a virtual building along a pre-registered route, moving along a route that ensures an equal number of contacts with each avatar on the same floor, moving along a route that ensures an equal number of contacts with each avatar on each floor of the virtual building, etc. The movement modes are not limited to those described above, and for example, movement may be such that an equal number of contacts are made with the avatars of users belonging to a group created in advance.

[0111] This embodiment configured in this manner also achieves the same effects as those of Embodiment 1. Furthermore, in this embodiment, the user can move within the virtual office 4 or virtual building according to the movement route and can make video calls with other users within their avatars. [Example]

[0112] A fifth embodiment will be described with reference to Fig. 18. In this embodiment, when a predetermined event occurs, the user's avatar is forced to move to promote casual conversation.

[0113] Fig. 18 shows the overall processing of the virtual space video call system 1 according to this embodiment. Comparing this processing with the processing in Fig. 7, new steps S80 and S81 are added between steps S13 and S14 in this processing.

[0114] If the user has not instructed the avatar to move (S13: NO), the virtual office control unit 21 determines whether a chat time has occurred as a predetermined event (S80). Chat time is a period of time during which chatting is encouraged within the virtual office 4. If chat time is occurring (S80: YES), the virtual office control unit 21 selects a destination (S81) and proceeds to step S14. In step S81, the destination can be determined according to the movement route as described in FIG. 17.

[0115] This embodiment configured in this manner also achieves the same effects as those of Embodiment 1. Furthermore, in this embodiment, even if the user does not wish to make a video call (S13: NO), a video call can be forced to be made within the avatar during a predetermined event, thereby promoting communication within the virtual office. [Example]

[0116] A sixth embodiment will be described with reference to Fig. 19. In this embodiment, the client terminal 3 transmits the user's biometric information to the server 2, and the server 2 controls the display of the avatar and the duration of the video call according to the user's condition obtained from the user's biometric information.

[0117] 19 is a functional configuration diagram of the virtual space video call system 1A of this embodiment. A biometric information acquisition unit 34 that detects biometric information is connected to the client terminal 3. The biometric information acquisition unit 34 is configured as a wearable terminal sensor, such as a wristwatch or glasses, and detects the user's body temperature, heart rate, etc. The biometric information acquisition unit 34 may be a camera built into the client terminal 3 or externally connected.

[0118] The user status management unit 25 of the server 2 manages the user's biometric information collected from the client terminal 3 either directly or after statistical processing. The virtual office control unit 21 changes the content displayed on the avatar information display unit GP11 and controls the appearance of the avatar, depending on the user status managed by the user status management unit 25.

[0119] Alternatively, when the fatigue level as a user state reaches a predetermined value, the virtual office control unit 21 can cause the avatar to stroll around and make a video call with another user.

[0120] This embodiment configured in this manner also achieves the same effects as those of Embodiment 1. Furthermore, this embodiment can control the appearance of the avatar or the video call in accordance with the user's state based on the user's biometric information, further improving the convenience for users of the virtual space video call system. [Example]

[0121] A seventh embodiment will be described with reference to Fig. 20. In this embodiment, if a user's avatar comes into contact with another user's avatar while the user is controlling the movement of his or her avatar, a video call will not be initiated.

[0122] Figure 20 is a flowchart showing the overall processing of the virtual space video call system 1 of this embodiment. Comparing this processing with the processing described in Figure 7, in this processing, the user controls the movement of the avatar by dragging or the like, so steps S14 and S15 for setting a movement route RT and moving the avatar are not present. Furthermore, in this embodiment, the movement of the avatar is stopped by a user operation, so step S17 in which the virtual office control unit 21 stops the movement of the avatar is also not present.

[0123] In contrast to this, in this embodiment, a new step S91 is added between step S13 and step S16. The virtual office control unit 21 executes step S91 after step S13, and executes step S16 after step S91.

[0124] In step S91, the virtual office control unit 21 determines whether the user is moving the avatar. If the user is moving the avatar (S91: NO), the virtual office control unit 21 does nothing and waits until the user finishes moving the avatar (S91: YES). Then, when the user finishes moving the avatar, the virtual office control unit 21 determines whether the avatar has come into contact with another avatar (S16), and if the avatar has come into contact with another avatar (S16: YES), starts a video call (S18).

[0125] This embodiment configured as described above also achieves the same effects as the first embodiment. Furthermore, in this embodiment, when a user manually moves their avatar toward an avatar with which they wish to make a video call, even if the avatar comes into contact with another avatar during the movement, the video call will not be initiated. Therefore, this embodiment can prevent accidental video calls from being made with users other than the user with whom the user wishes to make a video call, improving usability for the user.

[0126] Note that the operation of the avatar by the user is not limited to manual operations such as dragging. For example, the user's line of sight may be detected, and the movement of the avatar may be controlled based on the detected line of sight. Alternatively, the user's body movements, such as the movement of the hands and feet, may be detected by a camera, and the avatar may be moved in accordance with the user's body movements.

[0127] The present invention is not limited to the above-described embodiments. Those skilled in the art can make various additions and modifications within the scope of the present invention. The above-described embodiments can be combined as appropriate. [Explanation of symbols]

[0128] 1, 1A: Virtual space video call system, 2: Virtual office providing server, 3: Client terminal, 4: Virtual office, 21: Virtual office control unit, 22: Video call control unit, GP1: Avatar

Claims

1. A virtual space video call system in which a plurality of client terminals make video calls via a virtual space, a virtual space control unit that controls a virtual space provided to the plurality of client terminals; a video call control unit that controls a video call in the virtual space, the virtual space control unit determines whether a first avatar corresponding to a first client terminal among the plurality of client terminals has come into contact with a second avatar corresponding to a second client terminal among the plurality of client terminals in the virtual space; When the virtual space control unit determines that the first avatar and the second avatar have come into contact with each other in the virtual space, the video call control unit starts a video call between the first client terminal and the second client terminal, and further The virtual space control unit sets a predetermined effect on the first avatar and the second avatar indicating that a video call is being prepared, while the video call control unit is preparing for the video call between the first client terminal and the second client terminal. Virtual space video chat system.

2. A virtual space video call system in which a plurality of client terminals make video calls via a virtual space, a virtual space control unit that controls a virtual space provided to the plurality of client terminals; a video call control unit that controls a video call in the virtual space, the virtual space control unit determines whether a first avatar corresponding to a first client terminal among the plurality of client terminals has come into contact with a second avatar corresponding to a second client terminal among the plurality of client terminals in the virtual space; When the virtual space control unit determines that the first avatar and the second avatar have come into contact with each other in the virtual space, the video call control unit starts a video call between the first client terminal and the second client terminal, and further the virtual space control unit is configured to, when a destination position of the first avatar is specified by the first client terminal, calculate a predetermined route from a current position of the first avatar to the destination position, and move the first avatar along the calculated predetermined route; a plurality of route modes for determining the predetermined route are prepared in advance; The virtual space control unit calculates the predetermined route according to a route mode selected by the first client terminal from the plurality of route modes. Virtual space video chat system.

3. A virtual space video call system in which a plurality of client terminals make video calls via a virtual space, a virtual space control unit that controls a virtual space provided to the plurality of client terminals; a video call control unit that controls a video call in the virtual space, the virtual space control unit determines whether a first avatar corresponding to a first client terminal among the plurality of client terminals has come into contact with a second avatar corresponding to a second client terminal among the plurality of client terminals in the virtual space; When the virtual space control unit determines that the first avatar and the second avatar have come into contact with each other in the virtual space, the video call control unit starts a video call between the first client terminal and the second client terminal, and further the video call control unit extracts keywords from the video call between the first client terminal and the second client terminal; The virtual space control unit displays at least a part of the keywords extracted by the video call control unit in the virtual space so that the keywords can be viewed from a client terminal other than the first client terminal or the second client terminal. Virtual space video chat system.

Images