Virtual space system, management device, and method for dealing with nuisance behavior

Abstract

To provide a virtual space system, management device, and method for dealing with nuisance behavior that quickly and efficiently reduces nuisance behaviors in virtual spaces.SOLUTION: In the virtual space system, when detection means, via an AI-operated avatar, discovers nuisance behavior between general-use avatars, notification means notifies a dispatch order to a security base with the largest number of available personnel. For example, if the number of available personnel at a branch A is the largest at 6, the dispatch order is notified to the branch A, security guards at the branch A who receive the dispatch order log in to the virtual space system, carry out security guard by replacing the AI-operated avatar with a security guard-operated avatar operated by the security guards at the branch A.SELECTED DRAWING: Figure 14

Description

[Technical field]

[0001] The present invention relates to a virtual space system, a management device, and a method for dealing with nuisance behavior that can quickly and efficiently reduce nuisance behavior in a virtual space. [Background technology]

[0002] Conventionally, a multi-user virtual space (metaverse) configured on a network has been known. Such a virtual space is also called a metaverse or a VRSNS (Virtual Reality Social Networking Service). Users communicate with other users and conduct transactions in the virtual space using alter egos called avatars. Such a virtual space is a world in which users can live a social life on the Web, similar to the real world.

[0003] In recent years, such nuisance behavior in virtual space has become evident, and techniques for taking self-defense measures against such nuisance behavior are known. For example, Patent Document 1 discloses a technique for registering an avatar designated by a user as a filtering target and filtering data related to the registered avatar so that it cannot be seen or heard. Patent Document 2 discloses a technique for filtering out NG words detected in a virtual space using an NG filter and notifying the information terminal of a person in charge. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 4441979 [Patent Document 2] JP 2011-204178 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the above-mentioned Patent Documents 1 and 2 are necessarily post-facto measures, making it difficult to prevent the damage from spreading. Even if the nuisance perpetrator of a nuisance against the user is prevented from being seen or heard, it is not possible to prevent the nuisance perpetrator from making abusive remarks, slanderous statements, or spreading falsehoods. For this reason, it is an important issue to quickly and efficiently reduce nuisance behavior in virtual space.

[0006] The present invention has been made to solve the problems (issues) of the prior art described above, and aims to provide a virtual space system, management device, and method for dealing with nuisance behavior that can quickly and efficiently reduce nuisance behavior in virtual space. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention is a virtual space system having a management device that manages a virtual space in which general avatars operated by multiple users are active, wherein the management device is characterized by comprising: an AI avatar control means that controls an AI avatar that automatically patrols or stands guard in the virtual space; a detection means that detects the occurrence of nuisance behavior in the virtual space via the AI ​​avatar; a notification means that, when the occurrence of the nuisance behavior is detected by the detection means, notifies a specified security guard management device of information related to the nuisance behavior; a determination means that determines whether or not a nuisance behavior has occurred in the virtual space via a security guard avatar operated by a security guard who has received a dispatch command from the security guard management device; and a nuisance behavior dealing means that deals with the nuisance behavior when the determination means determines that a nuisance behavior has occurred in the virtual space.

[0008] In addition, in the above invention, the notification means notifies the security guard management device of information related to the nuisance behavior, including at least one of the location of the nuisance behavior in the virtual space, the time of occurrence, and the urgency, when the occurrence of the nuisance behavior is detected by the AI ​​avatar.

[0009] In addition, in the above invention, the security guard management device is characterized in that it comprises a reception means for receiving information relating to the nuisance behavior from the management device, a selection means for selecting a security base corresponding to the nuisance behavior received by the reception means, and a dispatch command means for issuing a command to a security terminal of the security base selected by the selection means to dispatch into the virtual space.

[0010] In addition, in the above invention, the security guard management device further includes a memory means for storing the number of available personnel in correspondence with a plurality of security bases, and the selection means identifies the security base stored in the memory means with the largest number of available personnel, and selects the identified security base.

[0011] In addition, in the above invention, the security guard management device further includes a change control means for controlling a first security guard operating a security guard avatar to switch operation of the security guard avatar to a second security guard belonging to a second security base when it becomes necessary for the first security guard to stop operating the security guard avatar.

[0012] In the present invention, in the above-mentioned invention, the shift control means specifies a security base stored in the storage means that has a large number of available personnel as the second security base.

[0013] The present invention also provides a management device for managing a virtual space in which general avatars operated by multiple users are active, comprising an AI avatar control means for controlling an AI avatar that automatically patrols or stands guard within the virtual space, a detection means for detecting the occurrence of nuisance behavior within the virtual space via the AI ​​avatar, a notification means for notifying a specified security guard management device of information relating to the nuisance behavior when the detection means detects the occurrence of the nuisance behavior, a determination means for determining whether or not a nuisance behavior has occurred within the virtual space via a security guard avatar operated by a security guard who has received a dispatch command from the security guard management device, and a nuisance behavior dealing means for dealing with the nuisance behavior when the determination means determines that a nuisance behavior has occurred in the virtual space.

[0014] The present invention also provides a method for dealing with nuisance behavior in a virtual space system having a management device that manages a virtual space in which general avatars operated by a plurality of users are active, and is characterized by including an AI avatar control process for controlling an AI avatar that automatically patrols or stands guard within the virtual space, a detection process for detecting the occurrence of nuisance behavior within the virtual space via the AI ​​avatar, a notification process for notifying a specified security guard management device of information related to the nuisance behavior when the occurrence of the nuisance behavior is detected in the detection process, a determination process for determining whether or not a nuisance behavior has occurred in the virtual space via a security guard avatar operated by a security guard who has received a dispatch command from the security guard management device, and a nuisance behavior dealing process for dealing with the nuisance behavior when it is determined by the determination process that a nuisance behavior has occurred in the virtual space. Effect of the Invention

[0015] According to the present invention, nuisance behavior in a virtual space can be reduced quickly and efficiently. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is an explanatory diagram of an overview of a virtual space system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing the system configuration of the virtual space system according to the first embodiment. [Diagram 3] FIG. 3 is a functional block diagram showing a configuration of the server shown in FIG. [Figure 4] FIG. 4 is a functional block diagram showing the configuration of the virtual space control unit shown in FIG. [Diagram 5] FIG. 5 is a functional block diagram showing a configuration of the user management unit shown in FIG. [Figure 6] FIG. 6 is a functional block diagram showing a configuration of the general avatar unit shown in FIG. [Figure 7] FIG. 7 is a functional block diagram showing a configuration of the security guard operation avatar unit shown in FIG. [Figure 8] FIG. 8 is a functional block diagram showing the configuration of the AI ​​operation avatar unit shown in FIG. [Figure 9] FIG. 9 is a diagram showing an example of the user data and the security log data shown in FIG. [Figure 10] FIG. 10 is a diagram showing an example of a display relating to a first-person perspective image and a third-person perspective image according to the first embodiment. [Figure 11] FIG. 11 is a flowchart showing a processing procedure regarding security by the security guard avatar according to the first embodiment. [Figure 12] FIG. 12 is a flowchart showing a processing procedure regarding security guarding by an AI-operated avatar according to the first embodiment. [Figure 13] FIG. 13 is an explanatory diagram of an outline of a virtual space system according to a modified example. [Figure 14] FIG. 14 is an explanatory diagram (part 1) of an overview of a virtual space system according to the second embodiment. [Figure 15] FIG. 15 is an explanatory diagram (part 2) of the outline of the virtual space system according to the second embodiment. [Figure 16] FIG. 16 is a diagram showing a system configuration of a virtual space system according to the second embodiment. [Figure 17] FIG. 17 is a functional block diagram showing the configuration of the server shown in FIG. [Figure 18] FIG. 18 is a functional block diagram showing a configuration of the security guard avatar unit shown in FIG. [Figure 19] FIG. 19 is a functional block diagram showing a configuration of the AI ​​operation avatar unit shown in FIG. [Figure 20] FIG. 20 is a functional block diagram showing a configuration of the avatar exchange control unit shown in FIG. [Figure 21] FIG. 21 is a diagram showing an example of the avatar exchange takeover data shown in FIG. [Figure 22] FIG. 22 is a functional block diagram showing the configuration of the security guard management server shown in FIG. [Figure 23] FIG. 23 is a diagram showing an example of the security guard management data shown in FIG. [Figure 24] FIG. 24 is a flowchart showing a process for exchanging avatars according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] [Embodiment 1] The virtual space system, management device, and nuisance behavior countermeasure method according to the present embodiment 1 will be described in detail below with reference to the drawings. In this embodiment, for the sake of convenience, "receiving data including AA information" will be simply described as "receiving AA information", "receiving data including BB instructions" will be simply described as "receiving BB instructions", and "receiving CC image data" will be simply described as "receiving CC images".

[0018] In the virtual space system of this embodiment 1, an avatar operated by a general user (hereinafter referred to as a "general avatar") can converse with other general avatars in the virtual space and communicate with each other through the movements of this general avatar.

[0019] When general avatars communicate with each other, they may engage in nuisance behavior, such as verbal abuse or violent behavior. For this reason, avatars (hereinafter referred to as "security avatars") are used to detect nuisance behavior in the virtual space early and prevent the trouble from escalating, and the virtual space is guarded. In the virtual space system according to the first embodiment, the virtual space is guarded by a security avatar operated by a security guard (hereinafter referred to as "security guard avatar") and a security avatar operated by an AI (hereinafter referred to as "AI-operated avatar").

[0020] <Outline of the virtual space system according to the first embodiment> Fig. 1 is an explanatory diagram for explaining an overview of the virtual space system according to the embodiment 1. As shown in Fig. 1, if an AI-operated avatar discovers a nuisance caused by a general avatar, the AI-operated avatar is replaced with a security guard-operated avatar.

[0021] The security guard avatar speaks to the general avatar that is engaging in the nuisance and checks the status of the nuisance. If the security guard operating the security guard avatar determines that the nuisance is a violation of regulations, the security guard exercises the authority to impose a penalty on the general avatar that engaged in the nuisance.

[0022] In this way, in the virtual space system of this embodiment 1, if an AI-operated avatar discovers nuisance behavior by a general avatar, the security avatar is replaced from the AI-operated avatar to a security guard-operated avatar, and if the security guard operating this security guard-operated avatar determines that the nuisance behavior is a violation of the regulations, the virtual space system is configured to exercise penalty authority against the general avatar that committed the nuisance behavior, thereby making it possible to quickly and efficiently reduce nuisance behavior within the virtual space.

[0023] <System configuration according to the first embodiment> Next, a description will be given of the system configuration of the virtual space system according to the present embodiment 1. Fig. 2 is a diagram showing the system configuration of the virtual space system according to the present embodiment 1. As shown in Fig. 2, a server 100, a security terminal 200, and a plurality of user terminals 300 are connected to each other so as to be able to communicate with each other via the Internet.

[0024] The server 100 is a management device that controls the virtual space and avatars, and manages users who use the virtual space system. The server 100 sets up the virtual space, and controls the objects placed in the virtual space and the sounds generated. The server 100 manages user data related to users who use the virtual space system.

[0025] Furthermore, when the server 100 receives a login instruction from the security terminal 200 or the user terminal 300, it performs login processing and notifies the security terminal 200 or the user terminal 300 of an avatar startup screen.

[0026] Furthermore, server 100 places a security guard avatar in the virtual space when it receives a security guard avatar activation instruction from security terminal 200, and places an AI-operated avatar in the virtual space when it receives an AI-operated avatar activation instruction. Server 100 places a general avatar in the virtual space when it receives a general avatar activation instruction from user terminal 300.

[0027] Server 100 also acquires viewpoint images and audio information relating to general avatars and security avatars (hereinafter simply referred to as "avatars"), and notifies security terminal 200 or user terminal 300 relating to these avatars of the acquired viewpoint images and audio information. Upon receiving an action instruction and audio information relating to an avatar from security terminal 200 or user terminal 300, server 100 controls the action and speech of this avatar.

[0028] In addition, server 100 performs a process of determining whether the AI-operated avatar has engaged in a nuisance behavior and exchanging the security guard avatar for the AI-operated avatar based on the result of this determination. When server 100 receives a penalty instruction from security terminal 200, server 100 exercises penalty authority for the user ID included in the penalty instruction.

[0029] In addition, when the server 100 receives a logout instruction from the security terminal 200 or the user terminal 300, it performs logout processing such as erasing the security guard avatar, AI-operated avatar, or general avatar related to the logout instruction from the virtual space.

[0030] Security terminal 200 is a terminal through which a security guard controls a security avatar. Security terminal 200 notifies server 100 of a login instruction including a user ID and password, and upon receiving an avatar startup screen from server 100, displays the avatar startup screen.

[0031] Furthermore, when security terminal 200 receives an instruction to activate a security guard avatar or an AI-operating avatar on the avatar activation screen, it notifies server 100 of the security guard avatar activation instruction or AI-operating avatar activation instruction. Note that the security guard avatar activation instruction and AI-operating avatar activation instruction include a user ID.

[0032] Furthermore, when security terminal 200 notifies server 100 of an instruction to activate a security guard-operated avatar, security terminal 200 permits the reception of an operation on the security guard-operated avatar.

[0033] Furthermore, when security terminal 200 receives a viewpoint image and audio information from server 100, it displays the viewpoint image and outputs the audio information from a speaker.

[0034] Furthermore, when security terminal 200 receives an operation instruction for an avatar to be operated by a security guard from an input device such as a mouse, it notifies server 100 of this operation instruction. When security terminal 200 receives audio information from a microphone, it adds position information and volume information of the avatar to be operated by the security guard to this audio information and notifies server 100 of the audio information.

[0035] Furthermore, upon receiving a penalty instruction, security terminal 200 notifies server 100 of the penalty instruction. The penalty instruction includes the user ID of the general avatar that is the target of the penalty.

[0036] Furthermore, when the security terminal 200 receives a logout operation, it notifies the server 100 of a logout instruction and releases the connection to the virtual space.

[0037] The user terminal 300 is a terminal where a general user operates a general avatar. The user terminal 300 notifies the server 100 of a login instruction including a user ID and a password, and upon receiving an avatar start-up screen from the server 100, displays the avatar start-up screen.

[0038] Furthermore, when the user terminal 300 receives a general avatar activation instruction on the avatar activation screen, the user terminal 300 notifies the server 100 of the general avatar activation instruction. Then, the server 100 permits the reception of operations on the general avatar. The notified general avatar activation instruction includes the user ID.

[0039] Furthermore, when the user terminal 300 receives a viewpoint image and audio information from the server 100, it displays the viewpoint image and outputs the audio information from a speaker.

[0040] Furthermore, when the user terminal 300 receives an operation instruction for the general avatar from an input device such as a mouse, the user terminal 300 notifies the server 100 of the operation instruction. When the user terminal 300 receives audio information from a microphone, the user terminal 300 adds position information and volume information of the general avatar to the audio information and notifies the server 100 of the audio information.

[0041] Furthermore, upon receiving a logout operation, the user terminal 300 notifies the server 100 of a logout instruction and releases the connection to the virtual space.

[0042] <Server 100 Configuration> Next, a description will be given of the configuration of the server 100 shown in Fig. 2. Fig. 3 is a functional block diagram showing the configuration of the server 100 shown in Fig. 2. As shown in Fig. 3, the server 100 is connected to a display unit 101 and an input unit 102, and has a communication unit 103, a storage unit 110, and a control unit 120.

[0043] The display unit 101 is a liquid crystal panel, a display device, etc. The input unit 102 is a keyboard, a mouse, etc. The communication unit 103 is an interface unit for data communication with the security terminal 200 and the user terminal 300 via the Internet.

[0044] The storage unit 110 is a storage device such as a hard disk drive or a non-volatile memory, and stores space data 111 , object data 112 , user data 113 and security log data 114 .

[0045] The space data 111 is data indicating a template defined for providing a virtual space. The object data 112 is data indicating objects used in the virtual space and content to be played. This content includes, for example, events such as live shows, content showing scenery similar to that of the real world, and information on avatars set for each user.

[0046] User data 113 is data showing information about a user who operates a general avatar or a security avatar. This user information includes a user ID and a password. Security log data 114 is data showing information about a nuisance detected by a security avatar and information about a response to the nuisance.

[0047] Control unit 120 is a control unit that performs overall control of server 100, and has a virtual space control unit 130, a user management unit 140, a general-use avatar unit 150, a security guard operation avatar unit 160, and an AI operation avatar unit 170. In practice, these programs are loaded into a CPU (Central Processing Unit) and executed, causing virtual space control unit 130, user management unit 140, general-use avatar unit 150, security guard operation avatar unit 160, and AI operation avatar unit 170 to execute processes corresponding thereto.

[0048] The virtual space control unit 130 is a processing unit that sets the virtual space and controls the objects placed in this virtual space and the sounds generated. The user management unit 140 is a processing unit that manages the user data 113 and controls login and logout to the virtual space system.

[0049] The general avatar unit 150 is a processing unit that controls operations on general avatars. The security guard operation avatar unit 160 is a processing unit that controls operations on the security guard operation avatar and exercises penalty authority. The AI ​​operation avatar unit 170 is a processing unit that operates the AI ​​operation avatar, judges nuisance behavior, and requests an avatar exchange.

[0050] <Configuration of virtual space control unit 130> Next, a description will be given of the configuration of the virtual space control unit 130 shown in Fig. 3. Fig. 4 is a functional block diagram showing the configuration of the virtual space control unit 130 shown in Fig. 3. As shown in Fig. 4, the virtual space control unit 130 has a virtual space setting unit 131, a virtual object control unit 132, an operation object control unit 133, and a sound control unit 134.

[0051] The virtual space setting unit 131 is a processing unit that sets the virtual space. The virtual space setting unit 131 uses the space data 111 to set the virtual space.

[0052] The virtual object control unit 132 is a processing unit that sets and controls objects to be placed in the virtual space. The virtual object control unit 132 uses the object data 112 to place in the virtual space an event such as a live performance, content showing scenery similar to that of the real world, and an avatar set for each user.

[0053] The operation object control unit 133 is a processing unit that places an operation object for operating an object placed in the virtual space in the virtual space. The operation object control unit 133 places a hand object corresponding to the hand of the user operating the avatar, a finger object corresponding to the user's finger, and the like in the virtual space. The user can use the operation object to touch the object placed in the virtual space.

[0054] The audio control unit 134 is a processing unit that controls the audio generated in the virtual space. The audio control unit 134 performs the following processes on the audio information of the audio generated from the objects arranged in the virtual space, and the audio information received from the security terminal 200 and the user terminal 300. The audio control unit 134 specifies the range in which the audio can reach from the position information and volume information included in the audio information, and passes the audio information including the position information of the audio to the general avatar unit 150, the security guard operation avatar unit 160, and the AI ​​operation avatar unit 170, which are associated with the avatars present within this range.

[0055] <Configuration of user management unit 140> Next, a description will be given of the configuration of the user management unit 140 shown in Fig. 3. Fig. 5 is a functional block diagram showing the configuration of the user management unit 140 shown in Fig. 3. As shown in Fig. 5, the user management unit 140 has a user data management unit 141 and a login control unit 142.

[0056] The user data management unit 141 is a processing unit that manages the user data 113. When the user data management unit 141 receives information about a user from the input unit 102, the user data management unit 141 stores the received information in the user data 113. This user information includes a user ID and a password.

[0057] The login control unit 142 is a processing unit that controls login and logout to the virtual space system. When the login control unit 142 receives a login instruction from the security terminal 200 or the user terminal 300, it performs login processing using the user ID and password included in the login instruction, as well as the user data 113. Then, it notifies the security terminal 200 or the user terminal 300 that received the login instruction of an avatar startup screen.

[0058] Furthermore, the login control unit 142 performs a logout process when it receives a logout instruction from the security terminal 200 or the user terminal 300. This logout process includes a process of erasing from the virtual space the avatar operated by the security terminal 200 or the user terminal 300 that received the logout instruction.

[0059] <Configuration of the general avatar section 150> Next, a configuration of general use avatar unit 150 shown in Fig. 3 will be described. Fig. 6 is a functional block diagram showing a configuration of general use avatar unit 150 shown in Fig. 3. As shown in Fig. 6, general use avatar unit 150 has startup unit 151, image acquisition unit 152, voice acquisition unit 153, operation unit 154, and speech unit 155.

[0060] The activation unit 151 is a processing unit that activates a general avatar. Upon receiving a general avatar activation instruction from the user terminal 300, the activation unit 151 places the general avatar in the virtual space.

[0061] The image acquisition unit 152 is a processing unit that acquires a viewpoint image of the general avatar. The image acquisition unit 152 acquires a viewpoint image from the general avatar based on the position and direction of the general avatar in the virtual space, and notifies the user terminal 300. The viewpoint image includes a first person viewpoint image that does not include an image of the general avatar itself, and a third person viewpoint image that includes an image of the general avatar itself.

[0062] The voice acquisition unit 153 is a processing unit that acquires voice information heard from the position of the general avatar. The voice acquisition unit 153 acquires the voice information heard from the position of the general avatar using the voice information received from the voice control unit 134 and the position information of the general avatar, and notifies the user terminal 300 of the voice information.

[0063] The operation unit 154 is a processing unit that controls the operation of the general avatar. When the operation unit 154 receives an operation instruction related to the general avatar from the user terminal 300, the operation unit 154 causes the general avatar to operate based on the received operation instruction.

[0064] The speech unit 155 is a processing unit that controls speech of the general avatar. When the speech unit 155 receives voice information from the user terminal 300, the speech unit 155 passes the voice information to the voice control unit 134. Note that the voice information includes voice position information and volume information.

[0065] <Configuration of security guard operation avatar unit 160> Next, a description will be given of the configuration of security guard operation avatar unit 160 shown in Fig. 3. Fig. 7 is a functional block diagram showing the configuration of security guard operation avatar unit 160 shown in Fig. 3. As shown in Fig. 7, security guard operation avatar unit 160 has a common function unit 161 and a dedicated function unit 162 for security guard operation.

[0066] The common function unit 161 has an image acquisition unit 152, a voice acquisition unit 153, an operation unit 154, and a speech unit 155. The common function unit 161 is a function unit common to the general avatar unit 150, and detailed description thereof will be omitted. Note that while the terminal associated with the general avatar unit 150 as a transmission / reception destination terminal is the user terminal 300, the terminal associated with the common function unit 161 is the security terminal 200.

[0067] The security guard operation dedicated function unit 162 includes a starting unit 163 , an avatar exchange request receiving unit 164 , an avatar exchange unit 165 , and a penalty authority unit 166 .

[0068] Activation unit 163 is a processing unit that activates the security guard avatar. Upon receiving a security guard avatar activation instruction from security terminal 200, activation unit 163 places the security guard avatar in the virtual space in association with the user ID included in the security guard avatar activation instruction.

[0069] The avatar exchange request receiving unit 164 is a processing unit that receives an avatar exchange request. When the avatar exchange request receiving unit 164 receives an avatar exchange request from the AI-operating avatar unit 170, the avatar exchange request receiving unit 164 transfers the location information included in the avatar exchange request (hereinafter, referred to as “exchange request location information”) to the avatar exchange unit 165.

[0070] The avatar exchange unit 165 is a processing unit that performs avatar exchange processing. When the avatar exchange unit 165 receives exchange request position information from the avatar exchange request receiving unit 164, the avatar exchange unit 165 passes an AI operation instruction including the position information of the security guard avatar to the AI ​​operation avatar unit 170. Then, the avatar exchange unit 165 erases the security guard avatar at the current position, and places the security guard avatar at the position in the virtual space indicated by the exchange request position information.

[0071] The penalty authority unit 166 is a processing unit that enforces a penalty. When the penalty authority unit 166 receives a penalty instruction from the security terminal 200, it enforces a predetermined penalty against the user ID included in the penalty instruction. For example, the penalty enforced may be suspension of use of the target user ID for a predetermined period of time, or prohibition of entry to a highly public facility object such as a live music venue. In addition, the penalty authority unit 166 may notify an administrator terminal that manages the virtual space of the occurrence of a nuisance behavior.

[0072] In addition, if the penalty authority unit 166 exercises a penalty, it will store and update "penalty exists" in the penalty item of the user data 113 and the determination item of the security log data 114 in association with the target user ID, and store the content of the exercised penalty. When a general-purpose avatar attempts to log in, by referring to the user data 113, if there is a penalty, processing according to the content (such as login restriction) will be performed.

[0073] <Configuration of the AI operation avatar unit 170> Next, the configuration of the AI operation avatar unit 170 shown in FIG. 3 will be described. FIG. 8 is a functional block diagram showing the configuration of the AI operation avatar unit 170 shown in FIG. 3. As shown in FIG. 8, the AI operation avatar unit 170 has a common function unit 171 and an AI operation dedicated function unit 172.

[0074] The common function unit 171 has an image acquisition unit 152 and an audio acquisition unit 153. The common function unit 171 is a function unit common to the general-purpose avatar unit 150, and detailed description is omitted. The acquired perspective image and audio information are not notified to other terminals.

[0075] The AI operation dedicated function unit 172 has a startup unit 173, a movement control unit 174, a nuisance behavior determination unit 175, an avatar exchange request unit 178, and an avatar exchange unit 179.

[0076] The startup unit 173 is a processing unit that starts the AI operation avatar. If the startup unit 173 receives an AI operation avatar startup instruction from the security terminal 200, it installs the AI operation avatar in the virtual space in association with the user ID included in this AI operation avatar startup instruction.

[0077] The movement control unit 174 is a processing unit that controls the behavior of the AI-operated avatar. The movement control unit 174 patrols the AI-operated avatar along a predetermined route in the virtual space. At this time, it can also be made to stay at a predetermined location and stand guard. The AI-operated avatar is operated by the AI. For example, when making the AI-operated avatar patrol and stand guard, the AI ​​operates it so as not to interfere with the actions of the general avatar.

[0078] The nuisance behavior determination unit 175 is a processing unit that determines whether a nuisance behavior is present, and includes a behavior determination unit 176 and a voice determination unit 177. When the behavior determination unit 176 or the voice determination unit 177 determines that the behavior of the general avatar is present as a nuisance behavior, the nuisance behavior determination unit 175 stores the date, time, location, and situation in the security log data 114 in association with the user ID of the target general avatar. The security log data 114 stores the determination item as "no penalty." The system can also be configured to determine whether text information issued from a general avatar is present as a nuisance behavior.

[0079] The behavior determination unit 176 is a processing unit that determines whether the behavior of a general avatar is a nuisance behavior. The behavior determination unit 176 determines whether the behavior of a general avatar is a nuisance behavior by using the viewpoint image acquired by the image acquisition unit 152 of the common function unit 171 and an image AI (not shown). For example, if the distance between the general avatars is closer than a predetermined distance, or if the image AI detects the movement of the hands and feet as a violent behavior, it determines that the behavior is a nuisance behavior.

[0080] The voice determination unit 177 is a processing unit that determines whether the speech of the general avatar is a nuisance. The voice determination unit 177 determines whether the speech of the general avatar is a nuisance by using the voice information acquired by the voice acquisition unit 153 of the common function unit 171 and a voice AI (not shown). For example, if the voice AI detects speech equivalent to abusive language or a volume of voice exceeding a predetermined value, it determines that the speech is a nuisance.

[0081] The avatar exchange request unit 178 is a processing unit that issues an avatar exchange request. If the nuisance behavior determination unit 175 determines that the behavior of the general avatar is a nuisance behavior, the avatar exchange request unit 178 passes an avatar exchange request including the position information of the AI-operated avatar to the security guard-operated avatar unit 160.

[0082] The avatar exchange unit 179 is a processing unit that performs avatar exchange processing. When the avatar exchange unit 179 receives an AI operation instruction from the security guard operation avatar unit 160, it erases the AI ​​operation avatar at the current position. Then, it places the AI ​​operation avatar at the position in the virtual space indicated by the position information included in the received AI operation instruction.

[0083] Next, a specific example of data stored in storage unit 110 of server 100 shown in Fig. 3 will be described. Fig. 9 is a diagram showing an example of user data 113 and security log data 114 shown in Fig. 3.

[0084] The user data 113 shown in FIG. 9(a) associates a state in which the user category is "general", the nickname is "TARO", the name is "Patent Taro", and the penalty is "Yes" with the user ID "NAB1234", a state in which the user category is "general", the nickname is "HANA", the name is "Development Hanako", and the penalty is "No" with the user ID "NAB1567", and a state in which the user category is "security", the nickname is "security guard", the name is "ABC security", and the penalty is "-" with the user ID "KAB2345". When the penalty is "Yes", the content of the penalty that was exercised is also stored. Here, the situation in which the exercised penalty is "Login Restriction" is shown.

[0085] The security log data 114 shown in Figure 9 (b) associates the user ID "NAB1567", the location "Lobby", the situation "Loud" and the judgment "No penalty" with the date and time "2023 / 05 / 01 14:20:15", and associates the user ID "NAB1234", the location "Cafe XYZ", the situation "Abusive language" and the judgment "Penalty" with the date and time "2023 / 05 / 01 14:35:50".

[0086] <Example of display related to first-person viewpoint image and third-person viewpoint image according to embodiment 1> Next, a description will be given of an example of a display relating to the first person perspective image and the third person perspective image according to the embodiment 1. Fig. 10 is a diagram showing an example of a display relating to the first person perspective image and the third person perspective image according to the embodiment 1.

[0087] As shown in FIG. 10(a), the first-person perspective image displays the virtual space seen from the viewpoint of the avatar, and does not display an image of the avatar itself.

[0088] As shown in Fig. 10(b), in a third-person perspective image, the virtual space seen from the viewpoint of the avatar is displayed including the image of the avatar itself. In a third-person perspective image, the viewpoint is placed behind the avatar, and the virtual space including the avatar is displayed.

[0089] <Processing procedure related to security by the security guard avatar according to the first embodiment> Next, there will be described a processing procedure relating to security by the security guard avatar according to the present embodiment 1. Fig. 11 is a flowchart showing a processing procedure relating to security by the security guard avatar according to the present embodiment 1.

[0090] When a security guard in charge of security of the virtual space performs a login operation by inputting a user ID and password into security terminal 200, a login instruction including the user ID and password is sent from security terminal 200 to server 100. When server 100 receives the login instruction from security terminal 200 (step S101; Yes), it performs login processing and sends an avatar startup screen to security terminal 200.

[0091] When security terminal 200 receives an avatar startup screen from server 100, it displays the avatar startup screen, and when it receives an instruction from a security guard to start up an avatar for operation by a security guard or an avatar for operation by an AI, it notifies server 100 of the instruction to start up an avatar for operation by a security guard or an instruction to start up an avatar for operation by an AI. Furthermore, when security terminal 200 notifies server 100 of an instruction to start up an avatar for operation by a security guard, it permits the security guard to operate the avatar for operation by the security guard. When server 100 receives an instruction to start up an avatar for operation by an AI from security terminal 200 (step S102; Yes), it places the avatar for operation by an AI in the virtual space (step S103), and starts patrol or standing guard by the AI.

[0092] If server 100 does not receive a login instruction from security terminal 200 in step S101 (step S101; No), server 100 waits until a login instruction is received. If server 100 does not receive an instruction to activate an AI-operating avatar in step S102 (step S102; No), server 100 does not place an AI-operating avatar in the virtual space and proceeds to step S104.

[0093] Next, if server 100 receives an instruction to activate an avatar to be operated by a security guard from security terminal 200 (step S104; Yes), it places the avatar to be operated by a security guard in the virtual space (step S105), and starts security operations by the security guard, such as patrolling and standing guard (step S106).If server 100 has not received an instruction to activate an avatar to be operated by a security guard in step S104 (step S104; No), it waits until it receives an instruction to activate an avatar to be operated by a security guard.

[0094] Server 100 acquires viewpoint images and audio information relating to the AI-operated avatar and the security guard-operated avatar installed in the virtual space, and notifies security terminal 200 relating to the avatars. Upon receiving the viewpoint images and audio information from server 100, security terminal 200 displays the viewpoint images and outputs the audio information from a speaker.

[0095] Furthermore, when security terminal 200 receives an action instruction or voice information from a security guard to an avatar to be operated by the security guard, it notifies server 100 of the action instruction or voice information. When server 100 receives the action instruction or voice information from security terminal 200, it controls the action and speech of the avatar to be operated by the security guard.

[0096] When the server 100 judges that the actions and remarks of the general avatar correspond to nuisance behavior based on the viewpoint image and audio information related to the AI-operated avatar installed in the virtual space, it judges that there is a request for avatar exchange (step S107; Yes). Then, it erases the security guard avatar at the current position, installs the security guard avatar at the position in the virtual space indicated by the position information of the AI-operated avatar that has acquired the viewpoint image and audio information corresponding to the nuisance behavior, and installs the AI-operated avatar at the position in the virtual space indicated by the position information when the security guard avatar was erased, thereby performing avatar exchange processing between the security guard avatar and the AI-operated avatar (step S108). Note that, in step S107, if there is no request for avatar exchange (step S107; No), it proceeds to step S109.

[0097] The security guard operating the security guard avatar monitors whether the general avatar placed in the virtual space is engaging in nuisance behavior, based on the viewpoint image and audio information related to the security guard avatar displayed or output on security terminal 200. If the security guard does not find any nuisance behavior by the general avatar (step S109; No), the process proceeds to step S112.

[0098] If a security guard discovers a nuisance caused by a general avatar (step S109; Yes), he or she operates the avatar operated by the security guard to talk to the nuisance perpetrator and persuade them to stop the nuisance. If persuasion is successful (step S110; Yes), it is determined that the nuisance has been resolved and the process moves to step S112. If persuasion is unsuccessful and the nuisance continues (step S110; No), the security guard exercises penalty authority against the operator of the general avatar causing the nuisance, and notifies the operator of the general avatar of a penalty instruction including the user ID of the general avatar and the details of the penalty (step S111).

[0099] When the security guard operating the security guard-operated avatar ends patrolling or standing guard in the virtual space with the security guard-operated avatar, the security guard performs a logout operation on security terminal 200. Upon receiving the logout operation, security terminal 200 notifies server 100 of a logout instruction including the user IDs of the security guard-operated avatar and the AI-operated avatar, and stops accepting operations by the security guard on the security guard-operated avatar.

[0100] When the server 100 receives a logout instruction (step S112; Yes), it performs a logout process to erase the corresponding security guard avatar and AI avatar from the virtual space based on the user ID included in the logout instruction (step S113), and ends the process. If the server 100 has not received a logout instruction from the security terminal 200 (step S112; No), it proceeds to step S106.

[0101] <Procedure for security guarding using an AI-operated avatar according to the first embodiment> Next, a description will be given of a processing procedure relating to security guarding by the AI-operated avatar according to the present embodiment 1. Fig. 12 is a flowchart showing a processing procedure relating to security guarding by the AI-operated avatar according to the present embodiment 1.

[0102] In step S102 of the flowchart shown in Figure 11, if the server 100 receives an instruction to activate an avatar for operating an AI from the security terminal 200 (step S102; Yes), it places the avatar for operating an AI in the virtual space (step S103) and begins patrols and guard duty operated by the AI. When the server 100 activates the AI-operated avatar and starts patrolling or standing guard (step S201; Yes), it performs security by operating the AI ​​(step S202). If the AI-operated avatar has not been activated in step S201 (step S104; No), it waits until the AI-operated avatar is activated.

[0103] The server 100 acquires viewpoint images and audio information related to an AI-operated avatar installed in the virtual space, and judges whether the speech of the general avatar is a nuisance behavior using the acquired audio information and audio AI (step S203). The server 100 also judges whether the action of the general avatar is a nuisance behavior using the acquired viewpoint images and image AI (step S204). If neither the audio judgment nor the image judgment judges the behavior as a nuisance behavior (step S203; No, step S204; No), the server 100 proceeds to step S208.

[0104] If the server 100 determines that the behavior of the general avatar is a nuisance based on the audio judgment (step S203; Yes), or if the behavior is determined to be a nuisance based on the image judgment (step S203; No, step S204; Yes), it determines that a security guard needs to check the situation and take action, and requests an avatar exchange between the avatar to be operated by the AI ​​and the avatar to be operated by the security guard (step S205).

[0105] Then, the server 100 deletes the AI-operated avatar, places an AI-operated avatar at the position in the virtual space indicated by the position information when the security guard-operated avatar was deleted, and when the avatar exchange process between the AI-operated avatar and the security guard-operated avatar is completed (step S206; Yes), the server 100 performs security by operating the AI ​​with the exchanged AI-operated avatar (step S207).If the avatar exchange process is not completed in step S206 (step S206; No), the server 100 waits until the avatar exchange process is completed.

[0106] If the server 100 has not received a logout instruction from the security terminal 200 (step S208; No), it proceeds to step S202. If the server 100 has received a logout instruction (step S208; Yes), it performs a logout process to erase the corresponding AI-operating avatar from the virtual space based on the user ID included in the logout instruction (step S209), and ends the process.

[0107] As described above, in the virtual space system according to the first embodiment, when an AI-operated avatar finds a nuisance caused by a general avatar, the security avatar is replaced from the AI-operated avatar to a security guard-operated avatar, and if the security guard operating the security guard-operated avatar determines that the nuisance is a violation of regulations, the system exercises a penalty authority against the general avatar that committed the nuisance. This allows for a rapid and efficient reduction in nuisances in the virtual space while maintaining a degree of freedom, without uniformly filtering out the same actions or words as nuisances. In addition, a crime deterrent effect can be obtained by having the AI-operated avatar patrol and stand guard in the virtual space.

[0108] In the above embodiment 1, the configuration has been described in which the processing related to security of the virtual space and the management of data are concentrated on a server, but the present invention is not limited to this. In Web 3.0 utilizing blockchain technology, it is also possible to configure a virtual space system for the virtual space. In Web 3.0, various data are distributed and managed by blockchain technology, which can reduce the risks of unauthorized access, information leakage, data tampering, etc.

[0109] In addition, in the above embodiment 1, a configuration was described in which an AI-operated avatar automatically detects nuisance behavior using image AI and voice AI, but the present invention is not limited to this, and an avatar operated by a security guard can also be configured to automatically detect nuisance behavior using image AI and voice AI.

[0110] In addition, in the above embodiment 1, a configuration was described in which security of a virtual space is performed using an avatar operated by a security guard and an avatar operated by an AI, but the present invention is not limited to this, and it is also possible to configure security of a virtual space to be performed using only an avatar operated by a security guard.

[0111] [Variations] In the above embodiment 1, the configuration in which the AI-operated avatar performs security in the virtual space by AI operation has been described, but the present invention is not limited to this. It can also be configured to perform security using a drone avatar and a security camera object operated by AI. In this modified example, a virtual space system that performs security using a drone avatar and a security camera object operated by AI as an avatar for AI operation will be described.

[0112] <Overview of Virtual Space System According to Modification> An overview of the virtual space system according to this modified example will be described below. Fig. 13 is an explanatory diagram showing the overview of the virtual space system according to this modified example.

[0113] As shown in Fig. 13, in the virtual space system according to this modification, an AI-operated drone avatar moves through the air in the virtual space to provide security. In addition, security camera objects installed in facility objects in the virtual space provide security at fixed positions.

[0114] By using drone avatars and security camera objects to provide security, it is possible to directly detect nuisance behavior and it is expected that this will have a deterrent effect on nuisance behavior toward general avatars.

[0115] As described above, the virtual space system of this modified example is configured to provide security using AI-operated drone avatars and security camera objects, making it possible to quickly and efficiently reduce nuisance behavior within the virtual space.

[0116] [Embodiment 2] Incidentally, in the above embodiment 1, a configuration was described in which when an AI-operated avatar discovers nuisance behavior by a general avatar, the security avatar is replaced from an AI-operated avatar to an avatar operated by a logged-in security guard, but the present invention is not limited to this.

[0117] When an AI-operated avatar discovers a nuisance caused by a general avatar, it can be configured to select an appropriate security base from among the security bases of a security company, etc., notify the avatar of the nuisance, and request a response, thereby replacing the avatar with an avatar operated by a security guard at this security base. In this second embodiment, a virtual space system is described in which an appropriate security base is selected from the security bases of a security organization, notify the avatar of the nuisance caused by a nuisance, and request a response, thereby replacing the avatar with an avatar operated by a security guard at this security base.

[0118] <Outline of the virtual space system according to the second embodiment> 14 and 15 are explanatory diagrams for explaining an overview of the virtual space system according to the second embodiment. As shown in Fig. 14, if the AI-operated avatar determines that a nuisance is occurring due to a general avatar, a dispatch request is sent to the security base with the largest number of available personnel. For example, in the example of Fig. 14, the number of security guards on standby at branch office A who are available to respond to the nuisance (hereinafter referred to as the "available number") is the largest at six, so a dispatch request is sent to branch office A.

[0119] When a security guard from Branch A receives a call for deployment, he logs into the virtual reality system, replaces his AI-operated avatar with a security guard-operated avatar operated by a security guard from Branch A, and deals with the general avatar that is causing a nuisance.

[0120] Also, as shown in Fig. 15, if a task arises in the real world while a security guard from branch C is using the security guard avatar to deal with a nuisance perpetrator, a dispatch request is sent to the security base with the largest number of staff available to deal with the situation. For example, as branch A has the largest number of staff available to deal with the situation, six, a dispatch request is sent to branch A.

[0121] The security guard from branch A who receives the call logs into the virtual world system and takes over the response from the security guard from branch C. For example, the conversation log reads "You are..." and the response is "The fact of the abusive language has been confirmed."

[0122] Then, the security avatar is replaced with a security guard avatar operated by a security guard at branch A, and the security guard at branch A uses the security guard avatar to deal with the general avatar that is causing a nuisance. The handover content is displayed on the screen while being inserted into the viewpoint image of the security guard avatar, and the security guard at branch A continues to deal with the general avatar that is causing a nuisance by operating the security guard avatar while checking the handover content displayed on the screen.

[0123] In this way, in the virtual space system of this embodiment 2, when replacing a security avatar, an appropriate security base is selected from among the security bases of a security company, etc., and a security guard waiting at this security base is configured to deal with the general avatar that is causing a nuisance, thereby making it possible to quickly and efficiently reduce nuisance behavior within the virtual space.

[0124] <System configuration according to the second embodiment> Next, the system configuration of the virtual space system according to the second embodiment will be described. Fig. 16 is a diagram showing the system configuration of the virtual space system according to the second embodiment. As shown in Fig. 16, a server 400, a security guard management server 500, a plurality of security terminals 600, and a plurality of user terminals 300 are communicatively connected via the Internet. Note that a description of functions similar to those of the virtual space system according to the first embodiment shown in Fig. 2 will be omitted.

[0125] The server 400 is a management device that controls the virtual space and avatars, and manages users who use the virtual space system. When the server 400 receives avatar exchange handover information from the security terminal 600, the server 400 stores the avatar exchange handover information in avatar exchange handover data.

[0126] Furthermore, when the server 400 receives an avatar exchange request from the security terminal 600, it notifies the security guard management server 500 of the avatar exchange request. When the AI-operated avatar determines that the behavior of the general avatar is a nuisance, the server 400 sets the ID of the AI-operated avatar (hereinafter referred to as the "AI avatar ID") as the requester ID, and notifies the security guard management server 500 of the avatar exchange request including the requester ID.

[0127] Furthermore, when server 400 receives an instruction to activate a security guard avatar from security terminal 600, server 400 erases the avatar associated with the requester ID included in the instruction to activate a security guard avatar, and places a security guard avatar associated with the dispatcher ID in the virtual space at a position in the virtual space indicated by the position information of the avatar associated with the requester ID. If the requester ID included in the instruction to activate a security guard avatar is the user ID of the security guard avatar, server 400 displays the avatar exchange handover data associated with the requester ID at a predetermined position in the viewpoint image of the security guard avatar. If the requester ID included in the instruction to activate a security guard avatar is an AI avatar ID, server 400 places a new AI avatar at a predetermined position in the virtual space.

[0128] The security guard management server 500 is a security guard management device that is installed in the facilities of a security company or the like and manages security guards. When the security guard management server 500 receives security guard management information from the security terminal 600, it stores the security guard management information in the security guard management data and updates it.

[0129] Furthermore, when the security guard management server 500 receives an avatar exchange request from the server 400, it identifies the user ID of the security base with the largest number of available personnel from the security guard management data, and includes this user ID as the dispatcher ID and the requester ID included in the avatar exchange request in a dispatch command, and notifies the server 400. It also notifies the dispatch command to the security terminal 600 associated with the dispatcher ID.

[0130] Security terminal 600 is a terminal with which a security guard controls a security avatar. When security terminal 600 receives an avatar exchange request and avatar exchange handover information operated by a security guard, it includes the user ID of its own terminal as a requester ID in the avatar exchange request and avatar exchange handover information, and notifies server 400 of each piece of information. The avatar exchange request includes a level of urgency, which is specified as high / medium / low, for example.

[0131] Furthermore, when the security terminal 600 receives a dispatch command from the security guard management server 500, it displays the contents of the dispatch command on the dispatch command screen. When the security terminal 600 accepts a dispatch operation on the dispatch command screen, it notifies the server 400 of the dispatch command received from the security guard management server 500 as an instruction to activate a security guard operation avatar.

[0132] Furthermore, when the security terminal 600 receives the available number of people for security in the virtual space, it notifies the security guard management server 500 of the available number of people, the user ID of its own device, and the security base name as security guard management information.

[0133] The user terminal 300 is the same as the user terminal 300 shown in FIG. 2, and detailed description thereof will be omitted.

[0134] <Configuration of Server 400> Next, the configuration of server 400 shown in Fig. 16 will be described. Fig. 17 is a functional block diagram showing the configuration of server 400 shown in Fig. 16. As shown in Fig. 17, server 400 is connected to display unit 101 and input unit 102, and has communication unit 103, storage unit 410, and control unit 420. Note that a description of functional units similar to those of server 100 shown in Fig. 3 will be omitted.

[0135] The storage unit 410 is a storage device such as a hard disk drive or a non-volatile memory, and stores the space data 111, the object data 112, the user data 113, the security log data 114, and the avatar exchange handover data 415. The avatar exchange handover data 415 is data indicating the contents that are carried over when an avatar exchange is performed.

[0136] Control unit 420 is a control unit that performs overall control of server 400, and has virtual space control unit 130, user management unit 140, general use avatar unit 150, security guard operation avatar unit 460, AI operation avatar unit 470, and avatar exchange control unit 480. In practice, these programs are loaded into a CPU and executed, causing virtual space control unit 130, user management unit 140, general use avatar unit 150, security guard operation avatar unit 460, AI operation avatar unit 470, and avatar exchange control unit 480 to execute processes corresponding thereto.

[0137] The security guard operation avatar unit 460 is a processing unit that controls the operation of the security guard operation avatar, requests an avatar exchange, and exercises penalty authority. The AI ​​operation avatar unit 470 is a processing unit that operates the AI ​​operation avatar, judges nuisance behavior, and requests an avatar exchange. The avatar exchange control unit 480 is a processing unit that performs avatar exchange processing and handover processing when exchanging avatars.

[0138] <Configuration of security guard operation avatar unit 460> Next, the configuration of security guard operation avatar unit 460 shown in Fig. 17 will be described. Fig. 18 is a functional block diagram showing the configuration of security guard operation avatar unit 460 shown in Fig. 17. As shown in Fig. 18, security guard operation avatar unit 460 has common function unit 161 and security guard operation dedicated function unit 462. Note that a description of the same function units as those in security guard operation avatar unit 160 shown in Fig. 7 will be omitted.

[0139] The security guard operation dedicated function unit 462 has a start-up unit 463 , an avatar exchange request receiving unit 164 , an avatar exchange unit 165 , a penalty authority unit 166 , an avatar exchange request unit 467 , and an avatar exchange takeover unit 468 .

[0140] The activation unit 463 is a processing unit that activates the avatar for security guard operation. When the activation unit 463 receives an avatar activation instruction for security guard operation from the security terminal 600, it installs the avatar for security guard operation in the virtual space in association with the dispatcher ID included in this avatar activation instruction for security guard operation. At this time, it is installed at a position in the virtual space based on the position information of the avatar related to the requester ID included in the avatar activation instruction for security guard operation.

[0141] Also, if the requester ID included in the avatar activation instruction for security guard operation received from the security terminal 600 is the user ID of the avatar for security guard operation (for example, the first three characters of the user ID are "KAB"), the handover request including the requester ID and the dispatcher ID is passed to the avatar exchange control unit 480.

[0142] The avatar exchange request unit 467 is a processing unit that makes an avatar exchange request. When the avatar exchange request unit 467 receives an avatar exchange request and avatar exchange handover information from the security terminal 600, it includes the position information and time information of the avatar for security guard operation in each received piece of information, and notifies the security guard management server 500 of the avatar exchange request, and passes the avatar exchange handover information to the avatar exchange control unit 480.

[0143] The avatar exchange handover unit 468 is a processing unit that controls the display of avatar exchange handover information. When the avatar exchange handover unit 468 receives a handover instruction from the avatar exchange control unit 480, it extracts the requester ID included in this handover instruction and specifies the data of the avatar exchange handover data 415 related to this requester ID. Then, the data of the specified avatar exchange handover data 415 is pasted at a predetermined position of the viewpoint image acquired by the image acquisition unit 152.

[0144] <Configuration of the <AI operation avatar unit 470>> Next, the configuration of AI operation avatar unit 470 shown in Fig. 17 will be described. Fig. 19 is a functional block diagram showing the configuration of AI operation avatar unit 470 shown in Fig. 17. As shown in Fig. 19, AI operation avatar unit 470 has common function unit 171 and AI operation dedicated function unit 472. Note that a description of the same functional units as those in AI operation avatar unit 170 shown in Fig. 8 will be omitted.

[0145] The dedicated function unit for AI operation 472 has a startup unit 173, a movement control unit 174, a nuisance behavior determination unit 175, an avatar exchange request unit 478, and an avatar exchange unit 479.

[0146] The avatar exchange request unit 478 is a processing unit that issues an avatar exchange request. If the nuisance behavior determination unit 175 determines that the behavior of the general avatar is a nuisance, the avatar exchange request unit 478 notifies the security guard management server 500 of an avatar exchange request. This avatar exchange request includes the AI ​​avatar ID as the requester ID, location information of the AI-operated avatar, time information, and urgency. The urgency is specified based on the determination of the nuisance behavior determination unit 175. For example, it is specified as high / medium / low based on the behavior and voice volume of the general avatar that is the target of the nuisance behavior.

[0147] Avatar exchange unit 479 is a processing unit that performs avatar exchange processing. When avatar exchange unit 479 receives an avatar exchange instruction from avatar exchange control unit 480, it deletes the AI ​​operation avatar corresponding to the AI ​​avatar ID included in the avatar exchange instruction from the virtual space, and places a new AI operation avatar at a predetermined position in the virtual space.

[0148] <Configuration of Avatar Exchange Control Unit 480> Next, a configuration of the avatar exchange control unit 480 shown in Fig. 17 will be described. Fig. 20 is a functional block diagram showing a configuration of the avatar exchange control unit 480 shown in Fig. 17. As shown in Fig. 20, the avatar exchange control unit 480 has an avatar exchange processing unit 481 and an avatar exchange handover unit 482.

[0149] The avatar exchange processing unit 481 is a processing unit that performs avatar exchange processing. The avatar exchange processing unit 481 receives a dispatch command from the security guard management server 500, and if the requester ID included in the dispatch command is an AI avatar ID, passes an avatar exchange instruction including the AI ​​avatar ID to the AI-operation avatar unit 470.

[0150] The avatar exchange takeover unit 482 is a processing unit that transfers avatar exchange takeover information. When the avatar exchange takeover unit 482 receives the avatar exchange takeover information from the security guard avatar unit 460, the avatar exchange takeover unit 482 stores the avatar exchange takeover information in the avatar exchange takeover data 415.

[0151] Furthermore, when the avatar exchange handover unit 482 receives a handover request from the security guard avatar unit 460, it extracts the requester ID and the dispatched person ID included in the handover request, and stores the dispatched person ID in the avatar exchange handover data 415 associated with this requester ID. Then, it passes a handover instruction including the requester ID to the security guard avatar unit 460 associated with this dispatched person ID.

[0152] Next, a specific example of data stored in the storage unit 410 of the server 400 shown in Fig. 17 will be described. Fig. 21 is a diagram showing an example of the avatar exchange takeover data 415 shown in Fig. 17.

[0153] The avatar exchange handover data 415 shown in Figure 21 associates the date and time "2023 / 05 / 01 14:40:20" with a requester ID of "KAB6789," a dispatcher ID of "KAB2345," a location of "Cafe XYZ," a target user ID of "NAB1234," and handover content of "identity verification completed regarding abusive language."

[0154] <Configuration of security guard management server 500> Next, a description will be given of the configuration of the security guard management server 500 shown in Fig. 16. Fig. 22 is a functional block diagram showing the configuration of the security guard management server 500 shown in Fig. 16. As shown in Fig. 22, the security guard management server 500 is connected to a display unit 501 and an input unit 502, and has a communication unit 503, a storage unit 510, and a control unit 520.

[0155] The display unit 501 is a liquid crystal panel, a display device, etc. The input unit 502 is a keyboard, a mouse, etc. The communication unit 503 is an interface unit for data communication with the security terminal 600 and the server 400 via the Internet.

[0156] The storage unit 510 is a storage device such as a hard disk drive or non-volatile memory, and stores security guard management data 511. The security guard management data 511 is data indicating the number of personnel that can be handled at each security base.

[0157] The control unit 520 is a control unit that performs overall control of the security guard management server 500, and has a security guard management unit 521, an avatar exchange request receiving unit 522, an avatar exchange destination selection unit 523, and a dispatch command unit 524. In practice, by loading these programs into a CPU and executing them, the security guard management unit 521, avatar exchange request receiving unit 522, avatar exchange destination selection unit 523, and dispatch command unit 524 will each execute a process corresponding to the program.

[0158] The security guard management unit 521 is a processing unit that manages the security guard management data 511. When the security guard management unit 521 receives security guard management information from the security terminal 600, it stores this security guard management information in the security guard management data 511 to update it.

[0159] The avatar exchange request receiving unit 522 is a processing unit that receives an avatar exchange request. Upon receiving an avatar exchange request from the server 400, the avatar exchange request receiving unit 522 passes a selection instruction to an avatar exchange destination selecting unit 523.

[0160] The avatar exchange destination selection unit 523 is a processing unit that selects a security base to be dispatched in response to an avatar exchange request. Upon receiving a selection instruction from the avatar exchange request reception unit 522, the avatar exchange destination selection unit 523 identifies the user ID of the security base with the largest number of available personnel from the security guard management data 511, and passes this user ID to the dispatch command unit 524 as a dispatcher ID.

[0161] The dispatch command unit 524 is a processing unit that notifies a dispatch command. When the dispatch command unit 524 receives a dispatcher ID from the avatar exchange destination selection unit 523, the dispatch command unit 524 includes the dispatcher ID and the requester ID included in the avatar exchange request in a dispatch command and notifies the server 400. The dispatch command unit 524 also notifies the security terminal 600 associated with the dispatcher ID of the dispatcher ID.

[0162] Next, a specific example of data stored in the storage unit 510 of the security guard management server 500 shown in Fig. 22 will be described. Fig. 23 is a diagram showing an example of the security guard management data 511 shown in Fig. 22.

[0163] The security guard management data 511 shown in FIG. 23 associates the user ID "KAB2345" with a state in which the base name is "Branch A" and the number of available staff is "6", the user ID "KAB4567" with a state in which the base name is "Branch B" and the number of available staff is "3", and the user ID "KAB6789" with a state in which the base name is "Branch C" and the number of available staff is "0".

[0164] <Avatar exchange process according to the second embodiment> Next, a description will be given of a process procedure relating to avatar exchange according to the present embodiment 2. Fig. 24 is a flowchart showing a process procedure relating to avatar exchange according to the present embodiment 2.

[0165] Server 400 places an AI-operated avatar in the virtual space as necessary, performs patrols and sentry duties using the AI, and determines whether any of the words or actions of the general-use avatar constitute nuisance behavior based on the viewpoint images and audio information related to the AI-operated avatar placed in the virtual space. In addition, in the security terminal 600, when a general avatar is determined to be causing a nuisance, a security guard operates an avatar for security guard operation to talk to the nuisance perpetrator and persuade them to stop the nuisance.

[0166] Incidentally, when a response task arises in the real space for a security guard who is dealing with a nuisance in the virtual space, the security terminal 600 notifies the server 400 of an avatar exchange request in response to an operation by the security guard. When the server 400 receives an avatar exchange request from the security terminal 600, or when it determines that the behavior of the general avatar is a nuisance based on the viewpoint image and audio information of the AI-operated avatar and a request for an avatar exchange is necessary (step S301; Yes), it notifies the security guard management server 500 of the avatar exchange request (step S302). Note that, when the server 400 does not receive an avatar exchange request from the security terminal 600 in step S301 and does not determine that the behavior of the general avatar is a nuisance based on the viewpoint image and audio information of the AI-operated avatar (step S301; No), it waits until it receives an avatar exchange request or until it determines that the behavior of the general avatar is a nuisance by the AI-operated avatar.

[0167] The security guard management server 500 uses the security guard management data 511 to select a security base for avatar exchange (step S303), and notifies the security terminal 600 and server 400 associated with the selected security base of a dispatch command (step S304).

[0168] When the security terminal 600 receives a dispatch command from the security guard management server 500, it notifies the server 400 of the dispatch command as a security guard operation avatar activation command. When the server 400 receives a security guard operation avatar activation command from the security terminal 600 (step S305; Yes), it erases the avatar corresponding to the requester ID included in the security guard operation avatar activation command from the virtual space, and places the security guard operation avatar at a position in the virtual space based on the position information included in the security guard operation avatar activation command. Furthermore, if the requester ID is an AI avatar ID, the server 400 places a new AI operation avatar at a predetermined position in the virtual space. Note that, in step S305, if the server 400 has not received a security guard operation avatar activation command (step S305; No), it waits until it receives a security guard operation avatar activation command.

[0169] If the requester ID included in the instruction to activate the security guard avatar is a security guard ID (step S306; Yes), the server 400 displays the avatar exchange handover information at a predetermined position on the viewpoint image of the security guard avatar (step S307) and terminates the processing.

[0170] As described above, in the virtual space system according to the second embodiment, when replacing a security avatar, an appropriate security base is selected from the security bases of the security organization, and the avatar is replaced with an avatar operated by a security guard at the security base, so that nuisance behavior in the virtual space can be reduced quickly and efficiently. Also, even if a security guard who is dealing with a nuisance by operating a security guard avatar is unable to continue dealing with the nuisance for some reason, another security guard can continue dealing with the nuisance.

[0171] In the above-mentioned second embodiment, when a response task arises in the real world while a security guard is responding to a nuisance with a security guard-operated avatar, a request is made to the security base with the largest number of available personnel, and the security guard at the security base that receives the request continues guarding using the security guard-operated avatar, but the present invention is not limited to this. It is also possible to configure the system so that when a response task arises in the real world while a security guard is on guard duty with a security guard-operated avatar, the security guard's role with the security guard-operated avatar is handed over to an AI-operated avatar.

[0172] In the above second embodiment, when a response task arises in the real world while a security guard is responding to a nuisance using a security guard avatar, a security base with the largest number of available personnel is selected and a request is made for dispatch, and a specific security guard at the security base that received the request continues to respond to the nuisance using a security guard avatar, but the present invention is not limited to this. The security guard management server can also be configured to store the number of available personnel for each security base and the priority order of available security guards, and to select a security base and a security guard based on the number of available personnel and the priority order and to request dispatch.

[0173] In addition, the configurations illustrated in the above embodiments are merely functional schematics, and are not necessarily physically configured as illustrated. In other words, the form of distribution and integration of each device is not limited to that illustrated, and all or part of the devices can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc. [Industrial Applicability]

[0174] The virtual space system, management device, and method for dealing with nuisance behavior according to the present invention are suitable for quickly and efficiently reducing nuisance behavior within a virtual space. [Explanation of symbols]

[0175] 100 Servers 101 Display section 102 Input section 103 Communications Department 110 Storage section 111 Spatial Data 112 Object Data 113 User Data 114 Security log data 120 Control section 130 Virtual space control section 131 Virtual Space Setting Section 132 Virtual Object Control Section 133 Operation object control section 134 Audio control section 140 User Management Department 141 User Data Management Department 142 Login control section 150 General Avatar Section 151 Starting section 152 Image acquisition unit 153 Voice Acquisition Unit 154 Operation section 155 Speech section 160 Avatar section for operating security guards 161 Common Functions 162 Security guard operation dedicated function unit 163 Starting part 164 Avatar Exchange Request Reception Department 165 Avatar Exchange 166 Penalty Authority Division 170 AI operation avatar section 171 Common Functions 172 AI operation dedicated function unit 173 Starting part 174 Movement control section 175 Nuisance Determination Department 176 Behavior Judgment Department 177 Voice Judgment Section 178 Avatar Exchange Request Department 179 Avatar Exchange 200 Security terminal 300 User terminals 400 Servers 410 Storage section 415 Avatar Exchange Transfer Data 420 Control Unit 460 Avatar section for operating security guards 462 Security guard operation dedicated function unit 463 Starting part 467 Avatar Exchange Request Department 468 Avatar Exchange Handover Department 470 AI Operation Avatar Section 472 AI operation dedicated function unit 478 Avatar Exchange Request Department 479 Avatar Exchange 480 Avatar exchange control section 481 Avatar Exchange Processing Unit 482 Avatar Exchange Handover Department 500 Security guard management server 501 Display section 502 Input section 503 Communications Department 510 Storage section 511 Security Guard Management Data 520 Control Unit 521 Security Guard Management Department 522 Avatar Exchange Request Reception Department 523 Avatar Exchange Selection Section 524 Dispatch Command Department 600 Security terminal

Claims

1. A virtual space system having a management device that manages a virtual space in which general avatars operated by a plurality of users are active, comprising: The management device includes: An AI avatar control means for controlling an AI avatar that automatically patrols or stands guard in the virtual space; A detection means for detecting the occurrence of a nuisance behavior in the virtual space via the AI ​​avatar; a notification means for notifying a predetermined security guard management device of information related to the nuisance behavior when the occurrence of the nuisance behavior is detected by the detection means; a determination means for determining whether or not a nuisance has occurred in the virtual space via a security guard avatar operated by a security guard who has received a dispatch command from the security guard management device; a nuisance behavior dealing means for dealing with a nuisance behavior when the determining means determines that a nuisance behavior has occurred in the virtual space; A virtual space system comprising:

2. The notification means is The virtual space system described in claim 1, characterized in that when the AI ​​avatar detects the occurrence of the nuisance behavior, the security guard management device is notified of information related to the nuisance behavior, including at least one of the location of the nuisance behavior in the virtual space, the time of occurrence, and the urgency.

3. The security guard management device includes: a receiving means for receiving information relating to the nuisance from the management device; a selection means for selecting a security base corresponding to the nuisance act accepted by the acceptance means; a dispatch command means for issuing a command to dispatch a security terminal of the security base selected by the selection means to the virtual space; 2. The virtual space system according to claim 1, further comprising:

4. The security guard management device includes: Further, a storage means is provided for storing the number of available personnel in association with the plurality of security bases, The selection means is A security base having a large number of available personnel stored in the storage means is identified, and the identified security base is selected.

4. The virtual space system according to claim 3.

5. The security guard management device includes: The virtual space system described in claim 1, further comprising a change control means for controlling the operation of the security guard avatar to be handed over to a second security guard belonging to a second security base when a first security guard operating the security guard avatar needs to stop operating the security guard avatar.

6. 6. The virtual space system according to claim 5, wherein said rotation control means specifies a security base stored in said storage means that has a large number of available personnel as said second security base.

7. A management device that manages a virtual space in which general avatars operated by a plurality of users are active, comprising: An AI avatar control means for controlling an AI avatar that automatically patrols or stands guard in the virtual space; A detection means for detecting the occurrence of a nuisance behavior in the virtual space via the AI ​​avatar; a notification means for notifying a predetermined security guard management device of information related to the nuisance behavior when the occurrence of the nuisance behavior is detected by the detection means; a determination means for determining whether or not a nuisance has occurred in the virtual space via a security guard avatar operated by a security guard who has received a dispatch command from the security guard management device; a nuisance behavior dealing means for dealing with a nuisance behavior when the determining means determines that a nuisance behavior has occurred in the virtual space; A management device comprising:

8. A method for dealing with nuisance behavior in a virtual space system having a management device for managing a virtual space in which general avatars operated by a plurality of users are active, comprising the steps of: An AI avatar control process for controlling an AI avatar that automatically patrols or stands guard in the virtual space; A detection step of detecting an occurrence of a nuisance behavior in the virtual space via the AI ​​avatar; a notification step of notifying a predetermined security guard management device of information related to the nuisance behavior when the occurrence of the nuisance behavior is detected in the detection step; a determination step of determining whether or not a nuisance has occurred in the virtual space via a security guard avatar operated by a security guard who has received a dispatch command from the security guard management device; a nuisance behavior dealing step for dealing with the nuisance behavior when it is determined by the determination step that a nuisance behavior has occurred in the virtual space; A method for dealing with nuisance behavior, comprising:

Images