Management device

Abstract

In the present invention, a communication unit communicates with an external device that manages a web meeting which is held in a real space. An avatar control unit displays one or more avatars in a virtual space. A first reception unit receives, from one or more terminal devices which respectively correspond to one or more users respectively corresponding to the one or more avatars, user operations which are made by the one or more users with respect to the corresponding avatars. A determination unit determines whether or not a specific condition is established regarding the position and motion of the one or more avatars in the virtual space. When the specific condition is determined to have been established, a request unit requests, via the communication unit, the external device to hold a web meeting in which one or more specific users respectively corresponding to one or more specific avatars that satisfy the specific condition among the one or more avatars are allowed to participate.

Description

management device

[0001] The present invention relates to a management device.

[0002] Conventionally, the method of participating in a web conference in real space is generally to access a URL provided in advance by the organizer at a specified time. Also, Patent Document 1 discloses a technology in which a user in a virtual space uses a web conference function provided in a medical facility in the virtual space to input the details of a consultation to the real medical facility.

[0003] Patent No. 7272727

[0004] In virtual spaces, users can chat with each other, but it is difficult for them to efficiently share information with each other. Therefore, it is expected that users visiting the metaverse space will launch a separate web conferencing tool in the real world to share information. In this case, there is a problem in that it is not possible to smoothly move from the metaverse space to the web conferencing tool.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to enable users to move smoothly between the metaverse space and the web conference environment.

[0006] A management device according to a preferred aspect of the present disclosure includes a communication unit that communicates with an external device that manages a web conference held in real space; an avatar control unit that displays one or more avatars in a virtual space; a first reception unit that receives user operations on corresponding avatars by one or more users that have a one-to-one correspondence with the one or more avatars from one or more terminal devices that have a one-to-one correspondence with the one or more users; a determination unit that determines whether or not specific conditions are met regarding the positions and movements of the one or more avatars in the virtual space; and a request unit that, when it is determined that the specific conditions are met, requests the external device via the communication unit to hold a web conference in which one or more specific users that have a one-to-one correspondence with one or more specific avatars that satisfy the specific conditions can participate.

[0007] The management device according to the present invention enables a user to smoothly move between the metaverse space and the Web conference environment.

[0008] 1 is a diagram showing the overall configuration of an information processing system including a management device according to a first embodiment. FIG. 4 is a block diagram showing an example of the configuration of the terminal device of FIG. 1. FIG. 5 is a block diagram showing an example of the configuration of the conference server of FIG. 1. FIG. 6 is a block diagram showing an example of the configuration of the management server of FIG. 1. FIG. 7 is a diagram showing an example of a conference space on a metaverse space. FIG. 8 is a diagram showing an example of the behavior of an avatar approaching a conference table. FIG. 9 is a diagram showing another example of the behavior of an avatar approaching the conference table. FIG. 10 is a diagram showing an example of a message displayed on the conference table when a first condition and a second condition are met. FIG. 11 is a diagram showing an example of the behavior of an avatar after a first condition and a second condition are met. FIG. 12 is a diagram showing an example of a Web conference screen displayed on a display device of a terminal device when participating in a Web conference. FIG. 13 is a diagram showing an example of a Web conference screen displayed on a display device of a terminal device. FIG. 14 is a diagram showing an example of a display when requesting transition from a Web conference environment to a metaverse space. FIG. 15 is a diagram showing an example of a display after transition from a Web conference environment to a conference space on a metaverse space. FIG. 16 is a flowchart showing the operation of the processing device of FIG. 4. FIG. 17 is a flowchart showing the operation of the processing device of FIG. 3. FIG. 18 is a diagram showing an example of a case where a second avatar takes a seat after a first avatar has joined a Web conference.

[0009] 1. First Embodiment Hereinafter, the configuration of a management device according to a first embodiment of the present invention will be described with reference to FIGS.

[0010] 1.1. Configuration of the First Embodiment 1.1.1. Overall Configuration Fig. 1 is a diagram showing the overall configuration of an information processing system 1 including a management device according to the first embodiment. The information processing system 1 includes terminal devices 10, a conference server 20, a management server 30, and a communication network NET. Fig. 1 shows a first terminal device 10 [1], a second terminal device 10 [2], and a third terminal device 10 [3] as the terminal devices 10.

[0011] The information processing system 1 is a system that provides a user image generation service to users who own terminal devices 10. A first user U[1], a second user U[2], and a third user U[3] own a first terminal device 10[1], a second terminal device 10[2], and a third terminal device 10[3], respectively.

[0012] In the information processing system 1, the first terminal device 10[1], the second terminal device 10[2], the third terminal device 10[3], the conference server 20, and the management server 30 are communicably connected to each other via a communication network NET. Although three terminal devices 10[1], 10[2], and 10[3] are illustrated in Fig. 1, this number is merely an example, and the information processing system 1 can include any number of terminal devices 10.

[0013] The conference server 20 is a server that provides a Web conference service and enables communication between users based on information about images and sounds from the terminal devices 10 via the communication network NET.

[0014] The management server 30 is a server that provides a service that allows users to move between the metaverse space and a web conference environment. In the description of this embodiment, the metaverse space is synonymous with a general virtual space. In other words, the metaverse space is an example of a virtual space. The management server 30 collects information about users who own each terminal device 10 and information about user operations on avatars corresponding to each user from the terminal devices 10 via the communication network NET, and represents the metaverse space based on the various pieces of information.

[0015] In addition, the management server 30 acquires information regarding the conference URL from the conference server 20 via the communication network NET, and holds a web conference between users corresponding to avatars in the metaverse space based on the acquired conference URL.

[0016] That is, the information processing system 1 is a system that provides any user of the terminal device 10 with an opportunity to move back and forth between the metaverse space and the web conference environment.

[0017] The terminal device 10 includes a personal computer, a tablet terminal, a smartphone, a smartwatch, XR (Extended Reality) glasses, etc. Note that a smartwatch and XR glasses may be connected to the communication network NET via a terminal device 10 other than a smartwatch or XR glasses.

[0018] 1.1.1 Configuration of Terminal Device Fig. 2 is a block diagram showing an example configuration of the terminal device 10 in Fig. 1. As shown in Fig. 2, the terminal device 10 includes a processing device 11, a storage device 12, a communication device 13, a display device 14, an input device 15, an imaging device 16, and a sound recording device 17. The elements included in the terminal device 10 are connected to each other by one or more buses for communicating information.

[0019] The processing device 11 is a processor that controls the entire terminal device 10, and is configured using, for example, one or more chips. The processing device 11 is configured using, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic unit, a register, etc. Note that some or all of the functions of the processing device 11 may be realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array). The processing device 11 executes various processes in parallel or sequentially.

[0020] The storage device 12 is a recording medium that can be read and written by the processing device 11. The storage device 12 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), and an electrically erasable programmable read-only memory (EEPROM). The volatile memory is, for example, a random access memory (RAM).

[0021] The storage device 12 stores a plurality of programs including a control program PR1 to be executed by the processing device 11. The storage device 12 also functions as a work area for the processing device 11.

[0022] The communication device 13 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 13 is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 13 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 13 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0023] The display device 14 is a device that displays images and text information. The display device 14 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal panel and an organic EL (Electro Luminescence) panel are suitably used as the display device 14.

[0024] The input device 15 accepts operations from the first user U[1]. For example, the input device 15 includes a keyboard, a touchpad, a touch panel, and a pointing device such as a mouse. If the input device 15 includes a touch panel, it may also function as the display device 14.

[0025] The imaging device 16 outputs a captured image Gx obtained by capturing an image of the external world. The imaging device 16 includes, for example, a lens, an imaging element, an amplifier, and an AD converter. Light collected through the lens is converted into an analog imaging signal by the imaging element. The amplifier amplifies the imaging signal and outputs it to the AD converter. The AD converter converts the amplified analog imaging signal into imaging information, which is a digital signal. The converted imaging information is output to the processing device 11 as the captured image Gx.

[0026] The recording device 17 outputs audio information Ox obtained by recording surrounding sounds. The recording device 17 includes, for example, a microphone, an amplifier, and an AD converter. The surrounding sounds are converted into analog audio signals by the microphone. The amplifier amplifies the audio signals and outputs them to the AD converter. The AD converter converts the amplified analog audio signals into audio information Ox, which is a digital signal. The converted audio information Ox is output to the processing device 11.

[0027] The processing device 11 functions as an acquisition unit 111, an output unit 112, and a display control unit 113, for example, by reading and executing a control program PR1 from the storage device 12.

[0028] The acquisition unit 111 acquires various information transmitted from the conference server 20 and the management server 30 , the captured image Gx output from the imaging device 16 , and the audio information Ox output from the recording device 17 .

[0029] The output unit 112 outputs the captured image Gx and audio information Ox to the conference server 20 via the communication device 13. The output unit 112 also outputs information input by the first user U[1] using the input device 15 to at least one of the conference server 20 and the management server 30 via the communication device 13. The information input by the first user U[1] includes, for example, text information input on a web conference tool, operation information for moving the first user's avatar in the metaverse space, and the like.

[0030] The display control unit 113 causes the display device 14 to display various pieces of information based on the various pieces of information acquired by the acquisition unit 111 .

[0031] 1.1.2 Configuration of the Conference Server Fig. 3 is a block diagram showing an example configuration of the conference server 20 in Fig. 1. As shown in Fig. 3, the conference server 20 comprises a processing device 21, a storage device 22, a communication device 23, a display device 24, and an input device 25. The elements of the conference server 20 are connected to each other by one or more buses for communicating information.

[0032] The processing device 21 is a processor that controls the entire conference server 20 and is configured, for example, using one or more chips. The processing device 21 is configured, for example, using a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 21 may be realized by hardware such as a DSP, ASIC, PLD, or FPGA. The processing device 21 executes various processes in parallel or sequentially.

[0033] The storage device 22 is a recording medium that can be read and written by the processing device 21. The storage device 22 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM.

[0034] The storage device 22 stores a plurality of programs, including a control program PR2, to be executed by the processing device 21. The plurality of programs includes a well-known Web conferencing tool WCT. The storage device 22 also functions as a work area for the processing device 21.

[0035] The communication device 23 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 23 is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 23 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 23 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0036] The display device 24 is a device that displays images and text information. The display device 24 displays various images under the control of the processing device 21. For example, various display panels such as a liquid crystal panel and an organic EL panel are suitably used as the display device 24.

[0037] The input device 25 is a device that accepts operations by an administrator of the information processing system 1. For example, the input device 25 includes a keyboard, a touchpad, a touch panel, and a pointing device such as a mouse. If the input device 25 includes a touch panel, it may also function as the display device 24. In particular, the administrator of the information processing system 1 can modify the control program PR2 by using the input device 25.

[0038] The processing device 21 functions as an acquisition unit 211, an issuing unit 212, an output unit 213, and a display control unit 214, for example, by reading and executing a control program PR2 from the storage device 22.

[0039] The acquisition unit 211 acquires various types of information transmitted from the terminal device 10. The various types of information include the captured image Gx, the audio information Ox, the text information, and the like.

[0040] When the issuing unit 212 receives a request to hold a Web conference from the management server 30, it issues a uniform resource locator (URL) for the Web conference.

[0041] The output unit 213 outputs the URL of the Web conference issued by the issuing unit 212 to the management server 30 via the communication device 23. The output unit 213 outputs information related to the display screen of the Web conference to the terminal device 10 via the communication device 23.

[0042] The display control unit 214 causes the display device 24 to display various pieces of information based on the various pieces of information acquired by the acquisition unit 211. The display control unit 214 also causes the terminal device 10 to display a web conference tool.

[0043] In this way, the processing device 21 manages a web conference held in real space. A web conference held in real space is a conference held via the Internet. Web conferences can be broadly divided into two types: cloud-based and on-premise. A cloud-based web conference is a conference that uses a conference system provided on the cloud. An on-premise web conference is a conference that uses a conference system provided on a company's own web conference server. Although this embodiment is based on a cloud-based web conference, the web conference may also be an on-premise web conference.

[0044] Each participant of the web conference participates in the web conference using a web conference tool provided in their respective terminal device 10. The conference server 20 provides a web conference system. Note that the conference server 20 may be a server on the cloud or a server within an intranet.

[0045] 1.1.3 Configuration of the Management Server Fig. 4 is a block diagram showing an example configuration of the management server 30 of Fig. 1. As shown in Fig. 4, the management server 30 includes a processing device 31 as a management device, a storage device 32, a communication device 33, a display device 34, and an input device 35. The elements included in the management server 30 are connected to each other by a single or multiple buses for communicating information.

[0046] The processing device 31 is a processor that controls the entire management server 30, and is configured using, for example, one or more chips. The processing device 31 is configured using, for example, a central processing unit (CPU) that includes an interface with peripheral devices, an arithmetic unit, and a register. Note that some or all of the functions of the processing device 31 may be realized by hardware such as a DSP, ASIC, PLD, or FPGA. The processing device 31 executes various processes in parallel or sequentially.

[0047] The storage device 32 is a recording medium that can be read and written by the processing device 31. The storage device 32 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM.

[0048] The storage device 32 stores a control program PR3 and a plurality of programs including the Web conference bot WCB to be executed by the processing device 31. The storage device 32 also functions as a work area for the processing device 31.

[0049] The communication device 33 is hardware serving as a transmitting / receiving device for communicating with other devices. The communication device 33 is also referred to as, for example, a network device, a network controller, a network card, a communication module, etc. The communication device 33 may include a connector for wired connection and an interface circuit corresponding to the connector. The communication device 33 may also include a wireless communication interface. Examples of the connector and interface circuit for wired connection include products that comply with wired LAN, IEEE 1394, and USB. Examples of the wireless communication interface include products that comply with wireless LAN, Bluetooth (registered trademark), etc.

[0050] The display device 34 is a device that displays images and text information. The display device 34 displays various images under the control of the processing device 31. For example, various display panels such as a liquid crystal panel and an organic EL panel are suitably used as the display device 34.

[0051] The input device 35 is a device that accepts operations by an administrator of the information processing system 1. For example, the input device 35 includes a keyboard, a touchpad, a touch panel, and a pointing device such as a mouse. If the input device 35 includes a touch panel, it may also function as the display device 34. In particular, the administrator of the information processing system 1 can modify the control program PR3 by using the input device 35.

[0052] The processing device 31, for example, reads and executes the control program PR3 from the storage device 32, thereby functioning as an acquisition unit 311, a communication unit 312, a first reception unit 313, an avatar control unit 314, a determination unit 315, a request unit 316, a provision unit 317, a second reception unit 318, and a display control unit 319. The processing device 31 is an example of a management device.

[0053] The acquisition unit 311 acquires user information from the first terminal device 10[1] used by the first user U[1], the second terminal device 10[2] used by the second user U[2], and the third terminal device 10[3] used by the third user U[3]. The user information is information about each user obtained from the first terminal device 10[1], the second terminal device 10[2], and the third terminal device 10[3]. For ease of explanation, the following description will focus on the first terminal device 10[1]. The second terminal device 10[2] and the third terminal device 10[3] are similar to the first terminal device 10[1], and therefore will not be described.

[0054] For example, the user information includes text information input by the input device 15 of the first terminal device 10[1]. For example, the user information includes the web search history, web browsing history, etc. of the first user U[1] on the first terminal device 10[1]. Note that it is desirable that the first user U[1] has consented in advance to the acquisition of information about the first user U[1] by the management server 30 through terms of use, etc.

[0055] The communication unit 312 communicates with the processing device 21 of the conference server 20 via the communication network NET.

[0056] The first reception unit 313 receives user operations on corresponding avatars by multiple users who have a one-to-one correspondence with the multiple avatars, from multiple terminal devices that also have a one-to-one correspondence with the multiple users. In this embodiment, for example, the multiple avatars are three: a first avatar A[1], a second avatar A[2], and a third avatar A[3]. The multiple users are three: a first user U[1], a second user U[2], and a third user U[3], and the multiple terminal devices are three: a first terminal device 10[1], a second terminal device 10[2], and a third terminal device 10[3].

[0057] Here, the first avatar A[1] and the first user U[1] correspond one-to-one, and the first user U[1] and the first terminal device 10[1] correspond one-to-one. The second avatar A[2] and the second user U[2] correspond one-to-one, and the second user U[2] and the second terminal device 10[2] correspond one-to-one. The third avatar A[3] and the third user U[3] correspond one-to-one, and the third user U[3] and the third terminal device 10[3] correspond one-to-one. Note that there may be only one user. In other words, the terminal device 10 may be, for example, a single first terminal device 10[1].

[0058] The avatar control unit 314 displays one or more avatars in the metaverse space. More specifically, the avatar control unit 314 controls the position and movement of each avatar in the metaverse space, for example, based on operation information for each avatar received by the first receiving unit 313. As a result of controlling the position and movement of each avatar in the metaverse space, the avatar control unit 314 displays each avatar in the metaverse space.

[0059] The determination unit 315 determines whether a specific condition is met regarding the position and movement in the metaverse space of each of the first avatar A[1], the second avatar A[2], and the third avatar A[3].

[0060] When it is determined that a specific condition is met, the request unit 316 requests the processing device 21 of the conference server 20 via the communication unit 312 to hold a web conference in which one or more specific users who have a one-to-one correspondence with one or more specific avatars that satisfy the specific condition will participate.

[0061] For example, if the determination unit 315 determines that a specific condition is met regarding the position and movement of the first avatar A[1] in the metaverse space, the request unit 316 requests the processing device 21 via the communication unit 312 to hold a web conference for the first user U[1] to participate.

[0062] When the request unit 316 receives the URL of the Web conference issued by the issuing unit 212 of the processing device 21, it confirms with the first user U[1] whether or not to participate in the Web conference. When the first user U[1] agrees to participate in the Web conference, the request unit 316 uses the display control unit 214 of the processing device 21 to transition the first user U[1] from the metaverse space to the Web conference environment.

[0063] The providing unit 317 provides the location information to the processing device 21 of the conference server 20 in response to an inquiry from one or more participating users about location information related to a specific location in the metaverse space. The one or more participating users are one or more specific users who are participating in the web conference. For example, if a first user U[1] joins the web conference from the metaverse space, the specific location is the location where the first avatar A[1] was located at the time the first user U[1] joined the web conference. Furthermore, the specific location may be, for example, a location in the metaverse space determined in the web conference, or a location in the metaverse space set by the first user U[1] himself.

[0064] The second reception unit 318 receives requests from the processing device 21 of the conference server 20 in response to operations by two participating users, that is, a first user U[1] and a second user U[2].

[0065] The display control unit 319 causes the display device 34 to display various pieces of information based on the various pieces of information acquired by the acquisition unit 311. The display control unit 319 also causes the terminal device 10 to display the metaverse space.

[0066] The Web conference bot WCB is a bot that mainly functions as an assistant in a Web conference. The Web conference bot WCB is configured, for example, using a publicly known large-scale language model. A user participating in a Web conference can invite the Web conference bot WCB to the Web conference by using an invitation function of the Web conference tool.

[0067] For example, when one or more participating users request a transition from the Web conference environment to a specific location in the metaverse space, the Web conference bot WCB notifies the one or more participating users of a URL indicating the specific location in response to an inquiry about location information regarding the specific location in the metaverse space. The Web conference bot WCB also assists the one or more participating users by proceeding with the conference, creating minutes, etc.

[0068] 1.2. Specific Operational Examples Specific operational examples of the management server 30 and the conference server 20 will now be described with reference to FIGS.

[0069] 1.2.1 Transition from Metaverse Space to Web Conferencing Environment Figure 5 is a diagram showing an example of a conference space SP in the metaverse space. As shown in Figure 5, three conference tables D1, D2, and D3 are arranged in the conference space SP in the metaverse space. In addition, a first avatar A[1] and a second avatar A[2] are visiting the conference space SP.

[0070] Meeting places MP1, MP2, and MP3 are set at the three conference tables D1, D2, and D3, respectively. Meeting place MP1 is an area within a circle with a radius Ra centered at conference table D1. Meeting place MP2 is an area within a circle with a radius Rb centered at conference table D2. Meeting place MP3 is an area within a circle with a radius Rc centered at conference table D3.

[0071] The radii Ra, Rb, and Rc may be equal to or different from one another. However, the radii Ra, Rb, and Rc are set so that the meeting points MP1, MP2, and MP3 do not overlap one another. The shapes of the meeting points MP1, MP2, and MP3 do not necessarily have to be circular, and may be any shape such as an ellipse or a rectangle.

[0072] 5, a first avatar A[1] is located within the area of ​​the meeting place MP1. A second avatar A[2] is approaching a conference table D1 but is located outside the area of ​​the meeting place MP1. Chairs C1 and C2 are located within the area of ​​the meeting place MP1, but chair C3 is located outside the area of ​​the meeting place MP1.

[0073] At the conference table D1, the specific conditions for issuing a web conference URL are met when all of the following three conditions are met: The first condition is that the avatar is located within the area of ​​the meeting place MP1. The second condition is that the avatar is seated in a chair.

[0074] 6 is a diagram showing an example of the behavior of a first avatar A[1] and a second avatar A[2] approaching a conference table D1. As shown in FIG. 6, the first avatar A[1] is standing in front of chair C1. The second avatar A[2] is walking in front of chair C2. The state shown in FIG. 6 is a state in which only the first condition is satisfied.

[0075] 7 is a diagram showing another example of the behavior of a first avatar A[1] and a second avatar A[2] approaching a conference table D1. As shown in FIG. 7, the first avatar A[1] is seated in chair C1. The second avatar A[2] is standing in front of chair C2. The state shown in FIG. 7 is a state in which the first condition and the second condition are satisfied.

[0076] 8 is a diagram showing an example of a message displayed on the conference table D1 when the first condition and the second condition are satisfied. When the first avatar A[1] sits on the chair C1, thereby satisfying the first condition and the second condition, the message P1 shown in FIG. 8 is displayed on the conference table D1.

[0077] The message P1 may say, for example, "Do you want to hold a meta web conference?" The term "meta web conference" is a coined term that implies a web conference that is seamlessly connected to the metaverse space. Here, if the first avatar A[1] selects the "Yes" button Y1, a request is made to hold a web conference. In other words, the third condition is to select the "Yes" button Y1 in response to the message P1.

[0078] Note that if the first avatar A[1] selects the "No" button N1 in the state shown in Figure 8, the third condition is not met. In this case, when the second avatar A[2] sits in chair C2, message P1 is displayed again.

[0079] 9 is a diagram showing an example of the behavior of the first avatar A[1] and the second avatar A[2] after the first condition and the second condition are satisfied. As shown in FIG. 9, the second avatar A[2] is seated in chair C2 following the first avatar A[1]. In the state shown in FIG. 9, when the first avatar A[1] selects the "Yes" button Y1, the first user U[1] corresponding to the first avatar A[1] and the second user U[2] corresponding to the second avatar A[2] can participate in the web conference.

[0080] FIG. 10 is a diagram showing an example of a web conference screen displayed on the display device 14 of the first terminal device 10[1] when participating in a web conference. FIG. 11 is a diagram showing an example of a web conference screen displayed on the display device 14 of the first terminal device 10[1]. In FIG. 10, when the first user U[1] selects the "Request Participation" button B1, the screen of the display device 14 transitions to the web conference screen shown in FIG. 11. As shown in FIG. 11, the display device 14 displays an image G1 of the first user U[1], an image G2 of the second user U[2], and an image G3 of the conference space SP in the metaverse space. Note that the image G3 of the conference space SP in the metaverse space does not necessarily need to be displayed in the web conference tool.

[0081] The determination unit 315 determines whether or not a specific condition is met for each of the meeting places MP1, MP2, and MP3. The request unit 316 requests the processing device 21 to hold a web conference for each of the meeting places MP1, MP2, and MP3, in which specific users corresponding to specific avatars that satisfy the specific condition can participate.

[0082] 1.2.2. Transition from a Web Conference Environment to a Metaverse Space FIG. 12 is a diagram showing an example of a display when requesting transition from a Web conference environment to a metaverse space. FIG. 13 is a diagram showing an example of a display after transition from a Web conference environment to a conference space SP in a metaverse space. Below, with reference to FIGS. 12 and 13, an example will be described in which a user participating in a Web conference ends the currently held Web conference and returns to the metaverse space. Here, an example will be described in which an avatar corresponding to a user participating in a Web conference returns to the position where it was when it joined the Web conference.

[0083] In the example shown in Figure 12, a first user U[1] activates the chat function of a web conference tool and inputs a message such as that shown in message M1. Here, message M1 is "I want to return to conference table D1 in the metaverse space." After understanding the content of message M1, web conference bot WCB queries the processing device 31 of management server 30 for location information of conference table D1 as a specific location. The second reception unit 318 receives a query for location information regarding a specific location in the metaverse space from web conference bot WCB.

[0084] The providing unit 317 provides the location information to the processing device 21 of the conference server 20 in response to an inquiry about location information relating to a specific location in the metaverse space during a Web conference held in the real space.

[0085] The display control unit 214 of the processing device 21 of the conference server 20 displays a link indicating the specific position of the specific position as a message M2 on the screen of the Web conference.

[0086] When the second reception unit 318 receives an operation on a link indicating a specific location by the first user U[1] or the second user U[2], the avatar control unit 314 causes a first avatar A[1] and a second avatar A[2] corresponding to the first user U[1] and the second user U[2], respectively, to appear at the specific location.

[0087] In this way, by the first user U[1] or the second user U[2] clicking on the link in message M2, the first user U[1] and the second user U[2] can return to the conference table D1 in the metaverse space as the first avatar A[1] and the second avatar A[2], respectively, as shown in Figure 13.

[0088] The specific location is not limited to the location of the conference table D1, but may be any location in the metaverse space that was discussed during the web conference.

[0089] 1.3. Operation of the Management Device According to the First Embodiment 1.3.1. Operation of the Processing Device 31 FIG. 14 is a flowchart showing the operation of the processing device 31 in FIG. 4. Hereinafter, the operation of the processing device 31 will be described with reference to FIG. 14. This operation is related to the transition from the metaverse space to the web conference environment. The routine in FIG. 14 is started, for example, when the processing device 31 is started, and is executed every time a certain period of time has elapsed.

[0090] In step S11, the processing device 31 functions as the first reception unit 313, thereby receiving operations of the first avatar A[1] by the first user U[1], operations of the second avatar A[2] by the second user U[2], and operations of the third avatar A[3] by the third user U[3].

[0091] In step S12, the processing device 31 functions as the avatar control unit 314 to display the first avatar A[1], the second avatar A[2], and the third avatar A[3] in the metaverse space.

[0092] In step S13, the processing device 31 functions as a judgment unit 315 to determine whether specific conditions are met regarding the positions and movements of the first avatar A[1], the second avatar A[2], and the third avatar A[3] in the metaverse space.

[0093] If the specific condition is met, that is, if the determination result in step S13 is positive, the processing device 31 functions as the request unit 316 and requests the processing device 21 to hold a Web conference in step S14.

[0094] On the other hand, if the specific condition is not met, that is, if the determination result in step S13 is negative, the processor 31 temporarily ends this routine.

[0095] In step S15, the processing device 31 functions as the request unit 316 to receive the URL of the Web conference.

[0096] In step S16, the processing device 31 functions as the request unit 316 to determine whether or not participation in the Web conference has been approved.

[0097] If participation in the Web conference is accepted, that is, if the determination result in step S16 is positive, the processing device 31 functions as the request unit 316 and transitions to the Web conference using the display control unit 214 of the processing device 21 in step S17. Thereafter, the processing device 31 temporarily ends this routine.

[0098] On the other hand, if participation in the Web conference has not been approved, that is, if the determination result in step S16 is negative, the processor 31 temporarily ends this routine.

[0099] 1.3.2. Operation of the Processing Device 21 Figure 15 is a flowchart showing the operation of the processing device 21 in Figure 3. The operation of the processing device 21 will be described below with reference to Figure 15. This operation is related to the transition from the Web conference environment to the metaverse space. The routine in Figure 15 is started, for example, when the processing device 21 is started, and is executed every time a certain amount of time has passed.

[0100] Note that this operation is based on an example in which a first user U[1] and a second user U[2] are participating in a Web conference as one or more participating users, and a Web conference bot WCB has been invited.

[0101] In step S21, the processing device 21 functions as the acquisition unit 211 to accept a message input by the first user U[1] or the second user U[2].

[0102] In step S22, the processing device 21 functions as the acquisition unit 211, and uses the Web conference bot WCB to determine whether the input message indicates a desire to transition to the metaverse space.

[0103] If the input message indicates a desire to transition to the metaverse space, i.e., if the judgment result in step S22 is positive, the processing device 21 functions as an acquisition unit 211 and, in step S23, queries the processing device 31 for location information of a specific location via the Web conference bot WCB.

[0104] On the other hand, if the input message does not indicate a desire to transition to the metaverse space, i.e., if the determination result in step S22 is negative, the processing device 21 temporarily terminates this routine. Therefore, in this case, the processing device 21 waits for the input of the next message by the first user U[1] or the second user U[2].

[0105] In step S24, the processing device 21 functions as the acquisition unit 211 to acquire the location information of the specific location provided by the provision unit 317 of the processing device 31.

[0106] In step S25, the processing device 21 functions as the display control unit 214 to display a link indicating the specific position.

[0107] In step S26, the processing device 21 functions as the acquisition unit 211, and determines whether or not an operation on the link has been accepted using the Web conference bot WCB.

[0108] If an operation on the link is received, i.e., if the judgment result in step S26 is positive, the processing device 21 functions as the display control unit 214, and in step S27, uses the display control unit 319 of the processing device 31 to make the first avatar A[1] and the second avatar A[2] appear at a specific position in the metaverse space, and then temporarily terminates this routine.

[0109] On the other hand, if no operation on the link has been received, that is, if the determination result in step S26 is negative, the processor 21 temporarily ends this routine.

[0110] 1.4. Effects of the First Embodiment According to the above description, the processing device 31 serving as a management device according to the first embodiment includes a communication unit 312, an avatar control unit 314, a first reception unit 313, a determination unit 315, and a request unit 316. The communication unit 312 communicates with the processing device 21 of the conference server 20 that manages a Web conference held in real space. The avatar control unit 314 displays one or more avatars in the metaverse space. The first reception unit 313 receives user operations on the corresponding avatars by one or more users who have a one-to-one correspondence with the one or more avatars, from one or more terminal devices that have a one-to-one correspondence with the one or more users.

[0111] The determination unit 315 determines whether a specific condition is met regarding the position and movement of one or more avatars in the metaverse space. If it is determined that the specific condition is met, the request unit 316 requests the processing device 21 of the conference server 20 via the communication unit 312 to hold a web conference in which one or more specific users who have a one-to-one correspondence with one or more specific avatars that satisfy the specific condition will participate.

[0112] According to this aspect, when an avatar performs a specific action at a specific position in the metaverse space, a request is made to the conference server 20 to hold a web conference in which the user corresponding to the avatar can participate. Therefore, one or more users can be smoothly moved from the metaverse space to the web conference environment.

[0113] By moving from the metaverse space to the web conference environment, users can share information more easily.

[0114] The processing device 31 also includes a providing unit 317 and a second receiving unit 318. The providing unit 317 provides location information to the conference server 20 in response to an inquiry from one or more participating users about location information related to a specific location in the metaverse space. The one or more participating users are one or more specific users who are participating in the web conference. The second receiving unit 318 receives requests in response to operations by the one or more participating users from the processing device 21 of the conference server 20. When the second receiving unit 318 receives a specific operation by one or more participating users on a link indicating the specific location, the avatar control unit 314 causes one or more avatars in one-to-one correspondence with the one or more participating users to appear at the specific location.

[0115] According to this aspect, when one or more participating users perform a specific operation on a link, one or more avatars can appear at specific positions in the metaverse space, thereby allowing one or more users to smoothly move from the web conference environment to the metaverse space.

[0116] The specific conditions also include one or more avatars performing a specific action at a specific meeting place MP1 to MP3 in the metaverse space.

[0117] According to this aspect, each user can easily participate in a web conference by operating their own avatar, just as if they were visiting a conference room in real space.

[0118] Furthermore, if the number of specific meeting places is two or more, the determination unit 315 determines whether the specific condition is met for each specific meeting place. The request unit 316 requests the processing device 21 of the conference server 20 to hold a Web conference in which one or more specific users who have a one-to-one correspondence with one or more specific avatars that satisfy the specific condition for each specific meeting place can participate.

[0119] According to this aspect, each user can operate their own avatar to split into a plurality of groups and simultaneously hold their own Web conferences.

[0120] The processing device 31 also has a Web conference bot WCB that functions as an assistant in a Web conference.

[0121] According to this aspect, the progress of the conference, the preparation of minutes, etc. can be left to the Web conference bot WCB, thereby improving convenience for users participating in the Web conference.

[0122] In addition, in response to an inquiry about location information regarding a specific location in the metaverse space, the Web conference bot WCB notifies participating users of a link indicating the specific location.

[0123] According to this aspect, a user participating in a Web conference can have their avatar appear at a specific location in the metaverse space by clicking the link, and thus the user can easily move from the Web conference environment to a specific location in the metaverse space as their avatar.

[0124] 2. Modifications The present disclosure is not limited to the above-described exemplary embodiments. Specific modifications are exemplified below. Two or more modifications selected from the following examples may be combined. Furthermore, the above-described embodiments and the following modifications may be combined in any manner as long as they are not mutually contradictory.

[0125] 2.1. Modification 1 In the first embodiment, an example is shown in FIGS. 8 and 9 in which a first avatar A[1] and a second avatar A[2] are both seated at a meeting place MP1, and then the corresponding first user U[1] and second user U[2] simultaneously participate in a web conference. However, each user may participate in the web conference one by one.

[0126] For example, in the situation shown in Figure 8, if the first avatar A[1], who is already seated in chair C1, selects the "Yes" button Y1 before the second avatar A[2] sits in chair C2, the specific condition will be met only for the first avatar A[1], and only the first avatar A[1] will participate in the web conference.

[0127] 16 is a diagram showing an example in which a second avatar A[2] takes a seat after a first avatar A[1] joins a web conference. For example, the message P2 displays, "Would you like to join the meta web conference?" If the second avatar A[2] selects the "Yes" button Y2, a specific condition is met for the second avatar A[2]. This allows the second user U[2] corresponding to the second avatar A[2] to join the web conference after the first user U[1] has joined.

[0128] 2.2. Modification 2 In the first embodiment, the first to third conditions must be satisfied for the specific condition to be met. However, the specific condition is not limited to this, and various conditions are conceivable. For example, it is conceivable that message P1 shown in FIG. 8 appears when the first condition is met. In this case, the specific condition is met when the first and third conditions are met.

[0129] Alternatively, for example, message P1 may be set to appear when the avatar touches conference table D1, D2, or D3. Although the example in which the specific condition is met when the first and third conditions are satisfied has been described in the above-described second modification, the specific condition may be met when any one of the first to third conditions is satisfied.

[0130] In the first embodiment, the Web conference bot WCB is stored in the storage device 32 of the management server 30 , but it may be stored in the storage device 22 of the conference server 20 .

[0131] 2.3. Modification 3 In the first embodiment, the Web conferencing tool WCT is stored in the storage device 22 of the conference server 20 and executed by the processing device 21. However, the Web conferencing tool WCT may be stored in the storage device 12 of each terminal device 10 and executed by each processing device 11.

[0132] 2.4. Modification 4 In the first embodiment, the Web conference bot WCB is invited by using the invitation function of the Web conference tool. However, the Web conference bot WCB may be configured to automatically participate in a Web conference when the Web conference is held.

[0133] 3. Others (1) In the above-described embodiment, storage device 12, storage device 22, and storage device 32 are exemplified by ROM and RAM, but they may also be flexible disks, magneto-optical disks (e.g., compact disks, digital versatile disks, Blu-ray (registered trademark) disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy (registered trademark) disks, magnetic strips, databases, servers, or other suitable storage media. Furthermore, the programs may be transmitted from a network via telecommunications lines. Furthermore, the programs may be transmitted from a communications network (NET) via telecommunications lines.

[0134] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0135] (3) In the above-described embodiment, input and output information may be stored in a specific location (for example, a memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be transmitted to another device.

[0136] (4) In the above-described embodiment, the determination may be made based on a value (0 or 1) represented using one bit, a Boolean value (true or false), or a comparison of numerical values ​​(e.g., comparison with a predetermined value).

[0137] (5) The order of the exemplary procedures, sequences, flowcharts, etc. illustrated in the above-described embodiments may be rearranged unless inconsistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0138] (6) Each function illustrated in Figures 1 to 16 is realized by any combination of hardware and / or software. Furthermore, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices. A functional block may also be realized by combining software with the single device or the multiple devices.

[0139] (7) The programs exemplified in the above-described embodiments should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other names.

[0140] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0141] (8) In each of the foregoing embodiments, the terms "system" and "network" are used interchangeably.

[0142] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or corresponding other information.

[0143] (10) In the above-described embodiments, the terminal device 10 may be a mobile station (MS). A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate term. In this disclosure, terms such as "mobile station," "user terminal," "user equipment (UE)," and "terminal" may be used interchangeably.

[0144] (11) In the above-described embodiments, the terms "connected," "coupled," or any variations thereof refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be a physical coupling or connection, a logical coupling or connection, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0145] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0146] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching a table, database, or other data structure), and ascertaining something that is considered to be a "determining." Also, "determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and so on. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0147] (14) In the above embodiments, when the terms "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or," as used in this disclosure, is not intended to be an exclusive or.

[0148] (15) In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are plural.

[0149] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0150] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0151] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0152] 1...information processing system, 10...terminal device, 10[1]...first terminal device, 10[2]...second terminal device, 10[3]...third terminal device, 20...conference server, 21...processing device, 30...management server, 31...processing device, 312...communication unit, 313...first reception unit, 314...avatar control unit, 315...determination unit, 316...request unit, 317...providing unit, 318...second reception unit, A[1]...first avatar, A[2]...second avatar, A[3]...third avatar, D1, D2, D3...conference table, MP1, MP2, MP3...gathering place, U[1]...first user, U[2]...second user, U[3]...third user, WCB...Web conference bot

Claims

1. A management device comprising: a communication unit that communicates with an external device that manages a Web conference held in a real space; an avatar control unit that displays one or more avatars in a virtual space; a first reception unit that receives user operations on avatars by one or more users who have a one-to-one correspondence with the one or more users, from one or more terminal devices that have a one-to-one correspondence with the one or more users; a determination unit that determines whether or not a specific condition is met regarding the position and movement of the one or more avatars in the virtual space; and a request unit that, when it is determined that the specific condition is met, requests the external device via the communication unit to hold a Web conference in which one or more specific users who have a one-to-one correspondence with one or more specific avatars that satisfy the specific condition among the one or more avatars can participate.

2. The management device of claim 1, comprising: a providing unit that provides location information to the external device in response to an inquiry about location information regarding a specific location in the virtual space by one or more participating users, among the one or more specific users, who are users participating in the Web conference; and a second receiving unit that receives a request from the external device in response to a user operation of the one or more participating users, wherein when the second receiving unit receives a specific user operation by the one or more participating users on a link indicating the specific location, the avatar control unit causes one or more avatars in one-to-one correspondence with the one or more participating users to appear at the specific location.

3. The management device according to claim 1, wherein the specific condition includes that the one or more avatars perform a specific action at a specific meeting place in the virtual space.

4. The management device of claim 3, wherein when the number of the specific meeting places is two or more, the determination unit determines whether the specific condition is met for each of the specific meeting places, and the request unit requests the external device to hold a Web conference in which one or more specific users who have a one-to-one correspondence with one or more specific avatars that satisfy the specific condition for each of the specific meeting places can participate.

5. The management device according to claim 2, further comprising a Web conference bot that functions as an assistant in the Web conference.

6. The management device according to claim 5, wherein the Web conference bot notifies the one or more participating users of a link indicating the specific location in response to the inquiry.

Images