Program, information processing method, and information processing system

Abstract

To provide a technique for assisting more flexible and highly convenient communication.SOLUTION: An offline information acquisition unit 63 acquires offline information transmitted from each of user terminals 2. An offline avatar management unit 64 generates offline avatar position information relating to the arrangement position in the virtual space of an avatar corresponding to a user who is communicating offline, based on the offline information acquired by the offline information acquisition unit 63. An avatar position management unit 66 transmits the offline avatar position information generated by the offline avatar management unit 64 and the acquired avatar position information to each of the user terminals 2. A howling prevention setting unit 65 transmits information indicating that howling prevention settings are to be made to the user terminals 2 used by users other than an organizer.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a program, an information processing method, and an information processing system. [Background technology]

[0002] In recent years, with the development of communication technology, opportunities for online communication such as remote work and web conferences have increased. In this regard, Patent Document 1 proposes a technology relating to a communication method using a virtual space (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-007893 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, most of the prior art, including the above-mentioned Patent Document 1, basically assumes only online communication and does not assume offline communication. However, in the real world, communication methods are not limited to online only, and offline communication is also common. For example, employees who come to the physical office may have offline conversations, or employees who come to the office and employees working remotely may hold online web conferences, etc.

[0005] The present disclosure has been made in light of the above circumstances, and aims to provide a technology that assists in more flexible and convenient communication. [Means for solving the problem]

[0006] In order to achieve the above object, a program according to one aspect of the present disclosure comprises: Computers used for communication in virtual space an acquiring step of acquiring first information regarding the user's offline communication participation; a generating step of generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed based on the first information; It is a program that executes processing including the above. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide a technology that assists in more flexible and convenient communication. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server that configures an information processing system according to an embodiment of the present disclosure. [Figure 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a server and a user terminal that configure an information processing system according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a diagram illustrating an example of a communication function of an information processing system according to an embodiment of the present disclosure. [Figure 5] FIG. 5 is a diagram illustrating an example of a communication function of the information processing system according to an embodiment of the present disclosure, which is a diagram illustrating an example different from the example of FIG. 4. [Figure 6] FIG. 1 is a diagram illustrating an example of a virtual space to which various types of communication are applied according to an information processing system of an embodiment of the present disclosure. [Figure 7] FIG. 10 is a diagram illustrating an example of a method for acquiring information about offline communication in an information processing system according to an embodiment of the present disclosure. [Figure 8]FIG. 8 is a diagram showing an example of a method for acquiring information about offline communication in an information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the example of FIG. 7. [Figure 9] FIG. 2 is a diagram illustrating an example of the flow of various processes executed by a server configuring an information processing system according to an embodiment of the present disclosure. [Figure 10] FIG. 9 is a diagram showing an example of a method for acquiring information about offline communication in an information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the examples of FIGS. 7 and 8. [Figure 11] FIG. 11 is a diagram showing an example of a method for acquiring information about offline communication in an information processing system according to an embodiment of the present disclosure, and is a diagram showing an example different from the examples of FIGS. 7, 8, and 10. [Figure 12] FIG. 10 is a diagram illustrating an example of an applied use of an online conference operation method in an information processing system according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0010] Prior to describing an embodiment of the present disclosure, a brief description will be given of the content of a service to which an information processing system according to an embodiment of the present disclosure (hereinafter referred to as "the system") is applicable. The service provided by the system is, for example, a communication support service using a virtual space. Specifically, the service according to the system includes, for example, a first function that provides an online communication environment and a second function that supports communication between users by reflecting communication in an offline environment in a virtual space (online environment). By freely using the first and second functions according to the system, users can effectively utilize communication in both online and offline environments, thereby communicating more freely.

[0011] Specifically, this system allows users to communicate with other users by performing various input operations on avatars and objects placed in a virtual space. Note that an avatar may be any display placed in a virtual space corresponding to each user, and may include any other display, such as an icon, hologram, pointer, shape, mark, pattern, character, etc. Also, the avatar may be a two-dimensional display or a three-dimensional display.

[0012] Here, the first function of the present system provides an online communication environment between users, for example, in either a first conversation mode or a second conversation mode, which will be described later. The first conversation mode is a mode in which conversation is realized according to the positions of avatars placed in a virtual space. In the first conversation mode, the volume of the output audio and other parameters are changed according to the distance between the avatars corresponding to each user, realizing communication that is closer to a real-world environment. In other words, in the first conversation mode, a user can realize communication with other users by changing the position of an avatar placed in a virtual space through input operations. The second conversation mode is a mode in which conversation is realized, for example, using conversation objects placed in a virtual space. In the second conversation mode, audio and other output is only provided to users corresponding to avatars connected to specific objects placed in the virtual space. That is, in the second conversation mode, a user can realize communication with other users by connecting (associating) an avatar with an object placed in the virtual space through an input operation. The first and second conversation modes of this system will be described in detail below with reference to FIGS. 4 and 5.

[0013] The second function of this system reflects communication in an offline environment in a virtual space (online environment). As mentioned above, in the real world, communication methods are not limited to online; offline communication is also common. In particular, in recent years, in line with changes in social conditions, an increasing number of users are commuting to the office in addition to remote work. Furthermore, it is not uncommon for users who actually come to the office to hold offline meetings or have casual conversations. However, in such situations, when remote work users who do not come to the office work together, there is often a discrepancy in communication due to issues such as the quantity and quality of communication. Therefore, one of the purposes of the second function of this system is to reflect offline communication in the online environment, thereby providing similar information to users who do not have an offline environment and supporting communication between the two parties. Details of the second function of this system will be described later with reference to Figures 6 to 8.

[0014] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment of the present disclosure. 1 includes a server 1 and user terminals 2-1 to 2-n (n is any natural number equal to or greater than 1). The server 1 and user terminals 2-1 to 2-n are connected to each other via a predetermined network N such as the Internet. Note that the network N is not an essential component, and for example, NFC (Near Field Communication), Bluetooth (registered trademark), LAN (Local Area Network), etc. may also be used. In the following description, the user terminals 2-1 to 2-n will be collectively referred to as user terminal 2 unless there is a need to distinguish between them.

[0015] The server 1 is an information processing device managed by the provider of this system, etc. The server 1 is configured, for example, with a general-purpose PC (Personal Computer), etc. The server 1 acquires, for example, various input information (for example, input operation information and image and audio information, which will be described later) transmitted from each of the user terminals 2, and executes various processes.

[0016] The user terminal 2 is an information processing terminal used by a user who wishes to receive services to which this system is applied. The user terminal 2 is configured, for example, as a general-purpose PC, tablet, smartphone, etc. The user terminal 2 acquires various input information (for example, input operation information, image and audio information, offline information, etc., which will be described later) via, for example, an application or software used to provide the various functions described above, and transmits this information to the server 1.

[0017] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server that configures an information processing system according to an embodiment of the present disclosure.

[0018] As shown in FIG. 2, the server 1 includes a control unit 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20.

[0019] The control unit 11 is configured with a microcomputer or the like including a CPU, a GPU, and a semiconductor memory, and executes various processes according to a program recorded in a ROM 12 or a program loaded from a storage unit 18 into a RAM 13 . The RAM 13 also stores data and the like necessary for the control unit 11 to execute various processes as appropriate.

[0020] The control unit 11, ROM 12, and RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to this bus 14. An output unit 16, an input unit 17, a memory unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

[0021] The output unit 16 is composed of a liquid crystal display, a speaker, etc., and outputs various information as images and sounds.

[0022] The input unit 17 is composed of a keyboard, a mouse, a touch panel, a microphone, various digital cameras, etc., and is used to input various information.

[0023] The storage unit 18 is configured with a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various data.

[0024] The communication unit 19 communicates with other hardware and the like via a predetermined network N. The network N may include any method that allows mutual communication, including the Internet and Bluetooth (registered trademark).

[0025] The drive 20 is provided as needed. Removable media 31, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 31 by the drive 20 are installed in the storage unit 18 as needed. The removable media 31 can also store various data stored in the storage unit 18 in the same way as the storage unit 18.

[0026] Here, the hardware configuration of the user terminal 2 can be basically the same as the hardware configuration of the server 1, so a description thereof will be omitted. Cooperation between such various hardware and various software enables the execution of various processes in the server 1 and the user terminal 2.

[0027] FIG. 3 is a diagram illustrating an example of a functional configuration of a server and a user terminal that configure an information processing system according to an embodiment of the present disclosure.

[0028] First, we will explain an example of the functional configuration of the user terminal 2. As shown in Fig. 3, the control unit 100 of the user terminal 2 executes various programs to function as an input operation information acquisition unit 120, an avatar information management unit 121, a virtual space management unit 122, an offline information management unit 123, an image and audio management unit 124, and an output control unit 125. 3, the input operation information acquisition unit 120, the avatar information management unit 121, the virtual space management unit 122, the image / audio management unit 124, and the output control unit 125 function when participating in online communication, while the offline information management unit 123 functions when participating in offline communication.

[0029] The input operation information acquiring unit 120 accepts information on input operations by the user regarding this system (hereinafter referred to as "input operation information"). The input operation information acquiring unit 120 also transmits the accepted input operation information to the server 1. Note that the input operation information referred to here includes, for example, information on the content of input operations in applications or software used to provide the various functions described above (for example, mouse click operations and input operations related to various keyboards), information on the time when various input operations were performed, and the like.

[0030] The avatar information management unit 121 acquires information about the placement position of each user's avatar (hereinafter referred to as "avatar placement information") transmitted from the server 1 via the communication unit 110. Furthermore, the avatar information management unit 121 determines the placement position of the target user's avatar based on the input operation information acquired by the input operation information acquisition unit 120, and transmits the information to the server 1 as avatar information.

[0031] The virtual space management unit 122 acquires information about the virtual space to be displayed to the user (hereinafter referred to as "virtual space information") transmitted from the server 1 via the communication unit 110. The virtual space management unit 122 generates an output image to be output to an output unit (not shown) of the user terminal 2 based on input operation information (described later), avatar placement information (described later), and the acquired virtual space information.

[0032] The offline information management unit 123 acquires first information related to participation in offline communication. Specifically, in this embodiment, when starting offline communication, a user reads a QR code (registered trademark) placed at a predetermined location in the real world using the user terminal 2 that the user uses. Through this operation, the offline information management unit 123 of the user terminal 2 identifies the location where the read QR code (registered trademark) is located. The offline information management unit 123 transmits information related to the read QR code (registered trademark) and identification information of the target user terminal 2 together to the server 1 as offline information. This allows the server 1 to detect that the user who read the QR code (registered trademark) is participating in offline communication.

[0033] When a user communicates online, the image and audio management unit 124 acquires information about the image or audio that the user wishes to transmit (or send) (hereinafter referred to as "image and audio information"). The image and audio management unit 124 transmits the acquired image and audio information to the server 1. The image and audio management unit 124 also acquires image and audio information of other users transmitted from the server 1.

[0034] The output control unit 125 controls the output of various images, sounds, etc. (for example, image and sound information acquired by the image and sound management unit 124) to an output unit (not shown).

[0035] Next, we will explain an example of the functional configuration of the server 1. As shown in Fig. 3, the control unit 11 of the server 1 executes various programs to function as an input operation information acquisition unit 60, a virtual space management unit 61, an image and audio information acquisition unit 62, an offline information acquisition unit 63, an offline avatar management unit 64, an anti-feedback setting unit 65, and an avatar position management unit 66.

[0036] The input operation information acquisition unit 60 acquires the input operation information transmitted from each of the user terminals 2 via the communication unit 19 .

[0037] The virtual space management unit 61 generates a virtual space that can be presented to each user based on image information stored in a database (not shown) or the like, and transmits the generated image information as virtual space information to each user terminal 2. The virtual space information acquired by each user terminal 2 is presented to each user via a display unit (not shown).

[0038] The image and audio information acquisition unit 62 acquires the image and audio information transmitted from each of the user terminals 2 via the communication unit 19. In addition, the image and audio information acquisition unit 62 transmits the acquired image and audio information to each of the user terminals 2 of the other users.

[0039] The offline information acquisition unit 63 acquires the offline information transmitted from each of the user terminals 2 via the communication unit 19 .

[0040] The offline avatar management unit 64 generates second information on the position in the virtual space where an avatar corresponding to the user is to be placed, based on the first information. Specifically, the offline avatar management unit 64 estimates, based on the offline information acquired by the offline information acquisition unit 63, that the target user has participated in offline communication at the location where a predetermined QR code (registered trademark) is installed, and generates information on the position in the virtual space where the avatar corresponding to the target user is to be placed (hereinafter referred to as "offline avatar position information").

[0041] The howling prevention setting unit 65 determines the organizer of offline communication from among the users participating in the communication. The howling prevention setting unit 65 also transmits information indicating that howling prevention setting is to be performed (hereinafter referred to as "setting information") to the user terminals 2 used by users other than the organizer. Here, the organizer refers to a user terminal 2 used as a host in offline communication. In offline communication, if multiple users simultaneously use user terminals 2 and use microphones, speakers, etc., the audio information of the user terminals 2 may interfere with each other, potentially resulting in a problem known as feedback, which hinders successful online communication. To prevent such problems, the present system can enable only one of the multiple user terminals 2 and disable the microphones, speakers, etc. of the other user terminals 2 when multiple users are communicating offline. This significantly reduces the likelihood of feedback and other problems occurring, particularly when online users participate in offline communication. Note that the present system may determine the organizer of communication in any manner. For example, the present system may determine a user as the organizer if no other users are already connected to the target communication, and, if other users are already connected to the target communication, perform feedback prevention processing on the user terminal 2 of that user.

[0042] The avatar position management unit 66 acquires, via the communication unit 19, avatar position information transmitted from each of the user terminals 2 used by users participating in online communication. Then, the avatar position management unit 66 transmits the offline avatar position information generated by the offline avatar management unit 64 and the acquired avatar position information to each of the user terminals 2. In other words, the avatar position management unit 66 transmits information regarding the placement position of the avatar corresponding to each user in the virtual space to each of the user terminals 2.

[0043] The first conversation mode and the second conversation mode will be described with reference to Figures 4 and 5. Figures 4 and 5 are diagrams showing an example of a communication function of an information processing system according to an embodiment of the present disclosure. In the following description, unless there is a particular need to distinguish between an avatar and a user operating the avatar, no distinction will be made. For example, simply referring to avatar A may refer to the user operating avatar A.

[0044] In the first conversation mode of this system, conversations (input and output of voice information) are conducted according to the relative positions of the avatars arranged in the office space. In the example of Figure 4, avatars A to D corresponding to each user are arranged in predetermined positions in a virtual space that mimics an office in the real world. 4, avatars A and B are positioned close to each other, whereas avatars A and C are positioned relatively far apart. Avatars A and D are positioned even farther apart. Therefore, for example, a voice input by a user corresponding to avatar "A" is output loudly on the user terminal 2 of the user corresponding to avatar "B" and output softly on the user terminal 2 of the user corresponding to avatar "C." Note that the dotted line in Fig. 4 indicates the audible range of the voice of the user corresponding to avatar "A." Therefore, the voice of the user corresponding to "A" is not output on the user terminal 2 of the user corresponding to avatar "D." Also, in the example of Fig. 4, the effect displayed around avatar A indicates that the user corresponding to avatar A is currently inputting voice (speaking). In the example of Fig. 4, areas W1 to W4 (hereinafter referred to as "private rooms") that resemble conference rooms are provided as separate areas in the virtual space on the right side of Fig. 4. By using the private rooms arranged in the virtual space in this way, each user can have a conversation only with other users who are in the areas W1 to W4 in the virtual space.

[0045] In the second conversation mode of the present system, conversations are conducted according to the relationship between the avatar and a specific object placed in the virtual space. In the example of Figure 5, each of avatars D to F is connected to object P placed in the virtual space via an arrow. In this situation, each of the users corresponding to avatars D to F wishes to use the second conversation mode using object P, and each user is performing a command operation on object P (for example, clicking on object P). In the second conversation mode, all users associated with object P can converse with each other, regardless of the position of their avatar. Therefore, in the example of Figure 5, image and audio information input by any sender (for example, the user corresponding to avatar D) is output at the same volume as the input volume on the user terminal 2 of another user (for example, the user corresponding to avatar E or F), regardless of the distance between the respective avatars.

[0046] While providing such online communication methods, the present system also includes functionality that allows for offline communication between users who are physically present in a real office. Specifically, the example in FIG. 6 shows a specific example of the specifications of a virtual space (hereinafter referred to as the "office space") that assumes an environment that includes users who are physically present in a real office and remote work users who work online. In the example in FIG. 6, an avatar corresponding to one of areas F1 to F4 in the office space (described later) is first placed according to the user's type. However, in the present system, each user can freely move the corresponding avatar to any location within the office space, including areas F1 to F4, by operations such as drag and drop. Therefore, each user can freely communicate within the office space regardless of the location of their initially placed avatar.

[0047] In the example of Figure 6, an example of a virtual space including characteristic areas F1 to F4 is displayed as an example of an office space that can be used in both offline and online environments. The areas F1 to F4 that make up the office space in Figure 6 will be described below. Area F1 is a placement area for avatars corresponding to users who are not in a real office and connect only online (for example, remote work users or users who are in an office other than the target office). Specifically, in the example of FIG. 6, avatars P1 and P2 are placed in arbitrary positions in area F1, and the users corresponding to each avatar are remote work users who are not in the real office. Note that in the example of FIG. 6, when a remote work user connects to the office space, the avatar corresponding to the target user is first placed in an arbitrary position in area F1 within the office space.

[0048] Area F2 is a placement area for avatars corresponding to users who are in a real office. Specifically, in the example of FIG. 6, avatars P3 to P5 are placed at arbitrary positions within area F2. Here, in the example of FIG. 6, the office space is designed to resemble the background and seating positions of a real office, and avatars P3 to P5 are all users who are in the real office. Therefore, in the example of FIG. 6, avatars P3 to P5 are placed at positions corresponding to the seating positions of their corresponding users in the real office. This allows users to communicate online in an environment that is closer to a real office environment. Note that in the example of FIG. 6, when a user in a real office connects to the office space, the avatar corresponding to the target user is first placed at their own seat in area F2 within the office space.

[0049] Area F3 is a placement area for avatars corresponding to users holding a meeting in a conference room in a real office space. Specifically, in the example of FIG. 6, avatars P6 and P7 are placed at arbitrary positions within area F3. Here, in the example of FIG. 6, a user can place a target avatar in area F3 by moving the avatar into area F3 using their own input operation (e.g., connecting their avatar to object R1 using an operation such as drag and drop) or by having their user terminal 2 read a QR code (registered trademark) installed in the conference room of the real office. Note that user operations within the real conference room will be described later with reference to FIG. 7. Also, in the example of FIG. 6, video images captured by a camera installed in the real conference room are displayed together with the respective avatars in area M1 within area F3. Other users connected to the office space can check these displays in area F3 to see who is meeting in the actual conference room, what the situation is like, etc., and if necessary, they can enter the actual conference room themselves, or they can remain online and place an avatar in area F3 to participate in the communication.

[0050] Area F4 is a placement area for avatars corresponding to users who are having casual conversations. Specifically, in the example of FIG. 6, avatars P8 and P9 are placed at arbitrary positions within area F4. As in the case of area F3, in the example of FIG. 6, a user can place an avatar in area F4 by moving the avatar into area F4 using their own input operation (e.g., connecting their avatar to object R2 using an operation such as drag and drop), or by having their user terminal 2 read a QR code (registered trademark) installed at a predetermined location in the real office (hereinafter referred to as a "casual conversation point"). Note that operations at a user's real casual conversation point will be described later with reference to FIG. 8.

[0051] This system employs a unique virtual space as shown in Figure 6, making it easy to use for both users who are in a real office and those who work remotely and only connect online, and is equipped with a number of functions to promote effective mutual communication. As a result, this system can provide an optimal communication environment that takes into account each situation, whether online or offline. These features of the present system are particularly useful, for example, in cases where there is a mixture of users who use the system by coming into the actual office as described above and users who do not come into the actual office but work only using the system, or where there are users who commute to different offices and use the system. Specifically, from the perspective of users who actually come into the office, they can proceed with their work while being aware of users who are working remotely and not coming into the office. Conversely, from the perspective of users who work remotely and do not come into the office, they can communicate with other users who are in the office while understanding the communication situation taking place in the actual office, and they can proceed with their work while feeling a greater sense of unity with other users.

[0052] 7 is a diagram illustrating an example of a method for acquiring information about offline communication in an information processing system according to an embodiment of the present disclosure. Specifically, the example of FIG. 7 illustrates a situation in which users U1 and U2 are holding a conference in a real conference room. In the example of FIG. 7, a general-purpose monitor, a general-purpose PC, and a QR code (registered trademark) related to this system are installed in a conference room. First, in the example of FIG. 7, when users U1 and U2 start a conference in the conference room, they read the QR code (registered trademark) installed in the conference room using their own user terminals 2. Then, based on this information, the PC displays avatars corresponding to users U1 and U2 in the virtual conference room in the office space. This allows other users connected to the office space to understand that users U1 and U2 are holding a conference in the real conference room. The PC in the conference room is equipped with a camera, speaker, microphone, etc., and can capture audio and image information related to the conference between users U1 and U2. If necessary, this information can be transmitted to other users connected to the office space shown in Figure 6. Conversely, audio and image information from users connected online can also be output from the PC in the conference room. Therefore, if users U1 and U2 hold their own user terminals 2 during the conference, audio information output from the PC and audio information output from each user's user terminal 2 may interfere with each other, potentially resulting in problems such as feedback. For this reason, the system, for example, in the example shown in Figure 7, is equipped with a feedback prevention function that automatically sets the input or output of the microphone and speaker of each user terminal 2 to a predetermined value or lower when the QR code (registered trademark) is read by each user's user terminal 2. This allows users U1 and U2 to communicate offline in the conference room without worrying about problems such as feedback. In the example of Fig. 6, avatars P6 and P7 corresponding to users U1 and U2 in Fig. 7 are displayed in area F3 connected to object R1. This display allows other users connected to the office space to see that users U1 and U2 are currently communicating in the actual conference room corresponding to area F3.

[0053] Similarly, the example of FIG. 8 shows a situation in which users U3 and U4 are about to have a conversation at the entrance of a real office. In the example of Figure 8, a QR code (registered trademark) is installed near the break space in a real office, and users U3 and U4 can start offline communication by reading the QR code (registered trademark) installed on their respective user terminals 2. 8, as in the example of FIG. 7, there is a possibility that audio information output from the user terminals 2 of the respective users may interfere with each other, resulting in problems such as feedback. In the example of FIG. 8, for example, as described above, if there is no other user already connected to the target communication, the system may determine that user as the organizer. Then, for example, if there is another user already connected to the target communication, the system may send setting information to the user terminal 2 of the newly connected user and set the input or output of the microphone and speaker of the target user terminal 2 to a predetermined value or less. In the example of Fig. 6, avatars F8 and F9 corresponding to users U3 and U4 in Fig. 8 are displayed in area F4 connected to object R2. This display allows other users connected to the office space to see that users U3 and U4 are currently communicating in the real break space corresponding to area F4.

[0054] FIG. 9 is a diagram illustrating an example of the flow of various processes executed by a server configuring an information processing system according to an embodiment of the present disclosure.

[0055] In step S1, the avatar position management unit 66 of the server 1 acquires, via the communication unit 19, avatar position information transmitted from each of the user terminals 2 used by users participating in online communication.

[0056] In step S2, the offline information acquisition unit 63 of the server 1 acquires the offline information transmitted from each of the user terminals 2 via the communication unit 19.

[0057] In step S3, the offline avatar management unit 64 of the server 1 estimates, based on the offline information acquired by the offline information acquisition unit 63, that the target user has participated in offline communication at the location where a specified QR code (registered trademark) is installed, and generates offline avatar position information regarding the location in the virtual space of the avatar corresponding to the target user.

[0058] In step S4, the avatar position management unit 66 of the server 1 transmits the offline avatar position information generated by the offline avatar management unit 64 and the acquired avatar position information to each of the user terminals 2.

[0059] In step S5, the howling prevention setting unit 65 of the server 1 determines the organizer of the offline communication from among the users participating in the communication.

[0060] In step S6, the howling prevention setting unit 65 of the server 1 transmits setting information indicating that howling prevention setting is to be performed to the user terminals 2 used by users other than the organizer. This ends the various processes executed by the server 1.

[0061] The above describes one embodiment of the present disclosure, but the present disclosure is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present disclosure are included in the present disclosure.

[0062] Here, a method for acquiring information related to a user's offline communication, which is different from the above-described embodiment, will be described with reference to Figures 10 and 11. Figures 10 and 11 are diagrams showing an example of a method for acquiring information related to offline communication in an information processing system according to an embodiment of the present disclosure, and are diagrams showing an example different from the examples shown in Figures 7 and 8. In the example of Fig. 10, a QR code (registered trademark) is displayed on an image of the virtual space related to the present system. The present system may obtain information that a user has participated in offline communication by having the QR code (registered trademark) displayed on the display image of the virtual space read by the user terminal 2 of another nearby user. 11, a large QR code (registered trademark) is displayed on the display screen of the user terminal 2. The present system may obtain information that a user has participated in offline communication by simply having the QR code (registered trademark) displayed on an output unit (not shown) of the user terminal 2 read by the user terminal 2 of another nearby user.

[0063] Here, other functions further provided in the present system will be described with reference to Fig. 12. Fig. 12 is a diagram showing an example of an applied use method of the online conference operation method in the information processing system according to an embodiment of the present disclosure. The example of Fig. 12 shows a case where users are holding an online conference using two devices, a user terminal 2-P and a user terminal 2-I. In the example of Fig. 12, the user terminal 2-P is a general-purpose PC, and the user terminal 2-I is a general-purpose smartphone. When a user participates in an online conference, they often participate in the conference while performing other tasks, and may disable the microphone or speaker for the online conference or become so focused on another task that they are unable to respond immediately when other users call out to them. In the example of Figure 12, user terminal 2-P functions as a main terminal that can perform all operations of an online conference that are normally performed. User terminal 2-I functions as an auxiliary terminal that can only operate to enable or disable the microphone, speaker, camera, etc. in an online conference. In this way, in the example of Figure 12, by classifying multiple devices into main terminals and auxiliary terminals and making them function, it becomes easier for users to respond immediately even in situations such as those described above in an online conference.

[0064] In the above embodiment, the system has been described as acquiring information about participation in offline communication by reading a QR code (registered trademark), but this is not limited thereto. The system may acquire information about participation in offline communication by reading information embedded in a card medium using technology such as NFC. The system may also acquire information about participation in offline communication in response to a user's input operation in an office space (e.g., moving an avatar into a simulated conference room in the office space).

[0065] In the above embodiment (the embodiment of FIG. 12), the present system has been described as including a PC or the like as the main terminal and a smartphone or the like as the auxiliary terminal, but this is not limited thereto. The present system can set any hardware as the main terminal and auxiliary terminal, regardless of the shape or type of the device.

[0066] Furthermore, for example, in the above-described embodiment, the communication related to the present system has been described as conversation (audio exchange), but this is not limited thereto. The communication related to the present system may be exchange of only text information such as chat or email, or may include exchange of moving images in addition to audio.

[0067] Furthermore, for example, although not described in the above embodiment, any object may be placed in the above office space. The object may be, for example, fixedly placed at any position in the office space and used to encourage the use of content common to all users. In other words, the object may not only be used to realize a conversation common to users who have performed a command operation (such as a click), but may also be an object that can share any type of content, such as playing video images, participating in various games (such as shogi, Othello, or Werewolf), sharing video images (such as camera images or PC images), or playing advertisements.

[0068] In the above-described embodiment (particularly the embodiment of FIG. 6), the placement position of an avatar in the office space is described as being determined based on the seat position of the real user, but this is not limited thereto. The present system may also determine the placement position of an avatar placed in the office space based on the position information of the user corresponding to the target avatar in the real office. In this case, the system may estimate the location information of the user by applying technologies such as GPS, beacons, etc. Note that the system may use any method to estimate the location information of each user, and may refer to the technology described in Non-Patent Document 1 below, for example. [Non-Patent Document 1] "Beacapp HERE", [online], [Retrieved July 19, 2022], Internet (URL: https: / / jp.beacapp-here.com / )

[0069] Although not described in the above embodiment, the system may acquire information about the user's situation in the actual office (at work, on a break, traveling, in a meeting, etc.). The system may display this information within the office space. The system may also use this information when estimating the location information of the actual user.

[0070] Although not described in the above embodiment, the system can also use location information of users in a real office for the feedback prevention function of the system. Specifically, for example, when two or more users are present in the same location based on the location information of the users in the real office, the system may infer that these users are communicating and perform various processes to prevent feedback.

[0071] Furthermore, although not explained in the above-described embodiments (particularly the embodiments of Figures 6 and 8), the present system may also have a function to restrict the entry of other users into an area corresponding to an actual conference room in the office space (for example, area F3 in Figure 6) depending on the status of the user currently in the area.

[0072] Furthermore, although not described in the above-described embodiments (particularly the embodiments of FIGS. 6 and 8), when information from a camera installed in a conference room in an office space is distributed (e.g., streamed) within a virtual space, constantly broadcasting the situation within the conference room can cause problems such as battery consumption, network bandwidth congestion, and data consumption. In this regard, depending on the purpose of use of the present system, streaming distribution may not be necessary. Specifically, for example, the present system may stop distributing video images when there is no user in the conference room, and continue distributing video images when there is a user in the conference room. For example, the present system may stop distributing video images outside of company business hours, and continue distributing video images during company business hours.

[0073] Although not described in the above embodiment, the concept of an office may include a wide range of concepts, such as a typical company, office, office space, hospital, university laboratory, government office, etc. In recent years, the design and construction of offices have become increasingly diverse, and some offices do not appear to be workplaces at first glance. While the virtual space to which this system is applied has been described as an office, this is not limited to this. Virtual spaces to which this system is applied may also be, for example, event venues, party rooms, restaurants, matchmaking venues, train stations, commercial facilities (supermarkets, convenience stores, etc.), etc.

[0074] In the above embodiment, the office space (particularly areas F2 to F4) has been described as being configured to resemble the design and seating positions of a real office, but this is not limited to this. The design and seating positions of the office space do not necessarily need to strictly correspond to the design and seating positions of a real office. For example, it is sufficient that there is a correspondence between the online environment and the offline environment based on certain criteria, such as changing a rest area in a real office to a sofa area in the virtual space, or changing the room layout to match the screen display, etc. Furthermore, in this system, a correspondence between the virtual space to which this system is applied and reality is not essential, and the virtual space to which this system is applied does not have to include areas that correspond to reality. It is up to the discretion of the system administrator, etc., to decide whether or not to include such areas in the virtual space to which this system is applied.

[0075] In the above-described embodiments (particularly the embodiments shown in FIGS. 6 to 8), the QR Code (registered trademark) of the present system is installed in a real conference room or break space, but this is not limited to this. The QR Code (registered trademark) of the present system may be installed in any location in a real office, such as the entrance to the real office or the center of the real office.

[0076] Furthermore, in the above-described embodiment (particularly the embodiment of FIG. 6), the avatars (e.g., avatars P6 to P9 in FIG. 6) and objects (e.g., objects R1 and R2 in FIG. 6) present in each area are described as being connected, but this is not limited thereto. For example, the avatars present in each area may be placed independently in each area without being connected to the objects placed in that area.

[0077] In the above embodiment, the present system has been described as displaying avatars corresponding to users participating in offline communication at predetermined positions in the office space, but this is not limited to this. The present system may not display avatars corresponding to target users in the office space, but may simply display them in the form of text or a list, for example, such as (Break Space, Mr. A, Mr. B).

[0078] Although not described in the above embodiment, the present system may also have a function of canceling the display of the corresponding office space when the offline communication ends. For example, the present system may cancel the display of the avatar corresponding to the offline communication when a user who participated in the offline communication returns to their seat and operates the user terminal 2. Note that the condition for canceling the display in this case is arbitrary, and the present system may cancel the display of the avatar by setting any condition, such as simply operating the user terminal 2, operating an application related to the present system, or performing a predetermined input operation on the user terminal 2.

[0079] Although not described in the above embodiment, the present system may have a function for calling other users who are participating online while offline communication is taking place. The present system may encourage other users who are participating online to join the offline communication currently taking place by, for example, sounding a ringtone or displaying a message indicating the call only to the target user.

[0080] Although not described in the above embodiment, the present system may have a function that allows the display method of each avatar to be changed depending on the method of participation in the office space, etc. Specifically, for example, the present system may display users participating online in the normal manner and users participating offline in a transparent manner.

[0081] Although not described in the above embodiment, the present system may estimate the state of each user and change the display method of the avatar depending on the state. Specifically, for example, the present system may add a feature such as displaying the avatar semi-transparently when the user is away from the seat for a short period of time (hereinafter referred to as "temporary absence"), and not displaying the avatar when the user is away from the seat for a long period of time (hereinafter referred to as "absence"). Note that the determination of whether a user is away from the seat temporarily or absent may be made based on the status of input operations on the user terminal 2 of each user, the lock status of the terminal, etc.

[0082] In the above-described embodiment (particularly the embodiment of FIG. 6), the office space related to the present system has been described as being composed of areas F1 to F4, but this is not limited thereto. The office space related to the present system does not necessarily have to include all of areas F1 to F4, and any of the areas may be omitted. Furthermore, the office space related to the present system may further include areas with other optional characteristics.

[0083] The above-described series of processes can be executed by hardware or software. In other words, the functional configurations in FIG. 3 and the like are merely examples and are not particularly limited. That is, it is sufficient that the information processing system is provided with a function that can execute the above-described series of processes as a whole, and the type of functional block used to realize this function is not limited to the example in Fig. 3 etc. Furthermore, the location of the functional block is not limited to the example in Fig. 3 etc. and may be arbitrary. Furthermore, one functional block may be configured by hardware alone, by software alone, or by a combination of these.

[0084] Furthermore, for example, the users and numbers of the various hardware components in the above-described embodiments are arbitrary, regardless of the examples described above. Furthermore, the present system may be configured by combining not only the above-described hardware components but also other hardware components. Furthermore, the present system may be configured as a so-called cloud-based system, in which various processes are executed via the Web or the like and the results of the processes are sent to the various hardware components.

[0085] Furthermore, when a series of processes is executed by software, the programs that make up the software are installed into a computer or the like from a network or a recording medium.

[0086] The computer may also be a computer incorporated in dedicated hardware. The computer may also be a computer that can execute various functions by installing various programs. That is, for example, any computer, any mobile terminal such as a smartphone, etc. may be freely adopted as the various hardware in the above-described embodiments.

[0087] Furthermore, the recording medium containing such a program may not only be constituted by a removable medium (not shown) that is provided separately from the device main body in order to provide the program to the user, etc., but may also be constituted by a recording medium that is provided to the user in a state that it is pre-installed in the device main body.

[0088] Furthermore, in this specification, each step in the program stored on the storage medium does not necessarily have to be processed chronologically in the order described in the above embodiment, but may be processed in a different order, or only some of the processing may be performed in parallel or individually.

[0089] In addition, in this specification, the term "system" refers to an overall device that is made up of a plurality of devices or a plurality of means.

[0090] The effects of this embodiment can be achieved even when these other embodiments are adopted. Furthermore, this embodiment can be combined with other embodiments, and other embodiments can be combined with each other as appropriate.

[0091] To summarize the above, the information processing system to which the present disclosure is applied can take on a variety of embodiments having the following configurations. That is, the program to which the present disclosure is applied is Computers used for communication in virtual space an acquisition step (for example, an offline information acquisition unit 63) of acquiring first information related to the user's participation in offline communication; a generating step (e.g., an offline avatar management unit 64) of generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed based on the first information; Any program that executes a process including the above is sufficient.

[0092] The above-mentioned program may further cause the computer to execute a process including an execution step of executing a prevention process for preventing feedback during offline communication.

[0093] The prevention process may be a process of setting audio input and output settings of the information processing terminal of the target user to be equal to or lower than a predetermined value when the communication is started.

[0094] Furthermore, the control may further include a canceling step of canceling the display of the second information in the virtual space when a predetermined condition is satisfied.

[0095] The condition may be that the target user performs a predetermined input operation.

[0096] Furthermore, the acquiring step may acquire the first information by operating an identifier placed at a predetermined location.

[0097] The virtual space may also include a virtual space area that corresponds to a real space and a virtual space area that does not correspond to a real space.

[0098] The above-mentioned program may further cause the computer to execute processing including a first change step of changing a display method of the avatar corresponding to each of the users in accordance with a method of participation of the users in the virtual space.

[0099] The above-mentioned program may further cause the program to execute processing including a second change step of changing a display method of the avatar corresponding to each of the users in accordance with a state of the user.

[0100] The program may further include a calling step for executing a process for encouraging other users who are not participating in the communication to participate in the communication.

[0101] Furthermore, the above-mentioned program may further execute processing including a setting step for setting the multiple devices as main terminals that can use any function related to the communication or auxiliary terminals that are used only for setting the output or input of images or audio related to the communication when the user uses multiple devices to communicate.

[0102] The auxiliary terminal and the main terminal may be arbitrarily switchable.

[0103] Another aspect of the present disclosure is An information processing method executed by a computer used for communication in a virtual space, comprising: an acquiring step of acquiring first information regarding the user's offline communication participation; a generating step of generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed based on the first information; The present invention may be an information processing method including the above.

[0104] Another aspect of the present disclosure is An information processing system used for communication in a virtual space, an acquisition means for acquiring first information regarding the user's offline communication participation; a generating means for generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed, based on the first information; The information processing system may include: [Explanation of symbols]

[0105] 1 server 11 Control section 60 Input operation information acquisition unit 61 Virtual Space Management Department 62 Image and audio information acquisition unit 63 Offline information acquisition unit 64 Offline Avatar Management Department 65 Howling prevention setting section 66 Avatar Position Management Unit 2. User terminal 100 control section 120 Input operation information acquisition unit 121 Avatar Information Management Department 122 Virtual Space Management Department 123 Offline Information Management Department 124 Video and audio control unit 125 Output control section

Claims

1. Computers used for communication in virtual space acquiring first information regarding the user's offline communication participation; a generating step of generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed based on the first information; A program that executes processing including

2. an execution step of executing a prevention process for preventing feedback in the offline communication; The program according to claim 1 , further comprising:

3. the prevention process is a process of setting audio input and output settings of the information processing terminal of the target user to be equal to or lower than predetermined values ​​when starting the communication; The program according to claim 2.

4. further executing a process including a canceling step of canceling the display of the second information in the virtual space when a predetermined condition is satisfied; The program according to claim 1.

5. the condition is that the target user performs a predetermined input operation; The program according to claim 4.

6. the acquiring step acquires the first information by operating on an identifier arranged at a predetermined location. The program according to claim 1.

7. The virtual space includes a virtual space area corresponding to a real space and a virtual space area not corresponding to a real space. The program according to claim 1.

8. a first change step of changing a display method of the avatar corresponding to each of the users in accordance with a method of participation of the users in the virtual space; The program according to claim 1 , further comprising:

9. a second change step of changing a display method of the avatar corresponding to each of the users according to a state of the user; The program according to claim 1 , further comprising:

10. a calling step of executing a process of prompting other users who are not participating in the communication to participate in the communication; The program according to claim 1 , further comprising:

11. a setting step of setting the plurality of devices as main terminals that can use any function related to the communication or auxiliary terminals that are used only for setting the output or input of images or sounds related to the communication when the user uses a plurality of devices to perform the communication; The program according to claim 1 , further comprising:

12. The auxiliary terminal and the main terminal can be switched at will; The program according to claim 11.

13. An information processing method executed by a computer used for communication in a virtual space, comprising: acquiring first information regarding the user's offline communication participation; a generating step of generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed based on the first information; An information processing method including:

14. An information processing system used for communication in a virtual space, an acquisition means for acquiring first information regarding the user's offline communication participation; a generating means for generating second information regarding a position in the virtual space where an avatar corresponding to the user is to be placed, based on the first information; An information processing system comprising:

Images