Information processing device, information processing method, and computer program

By employing NPCs to mimic participant behavior within the Metaverse, the challenge of low event attendance is addressed, creating a more engaging and immersive experience, ensuring the success of virtual events.

WO2024236726A1PCT designated stage expired Publication Date: 2024-11-21SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/018239
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-16
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

As the number of Metaverses and events within them increases, some events may struggle to attract enough participants, leading to a lack of liveliness and potential failure, which is crucial for their success.

Method used

An information processing device and method that utilizes non-player characters (NPCs) to be placed and controlled at event locations within the Metaverse, mimicking the behavior of real-world participants, such as performers and audience members, to create a more engaging atmosphere.

Benefits of technology

This solution enhances the perceived liveliness of events by simulating participant behavior, thereby attracting more users and maintaining immersion for existing participants, reducing the likelihood of discomfort with NPCs and enhancing the overall virtual event experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023018239_21112024_PF_FP_ABST
    Figure JP2023018239_21112024_PF_FP_ABST
Patent Text Reader

Abstract

In the present invention, a metabase server disposes, as an event participant, a non-player character (NPC 106) at a place where the event is held in a virtual space. The metabase server controls the NPC 106 such as to perform an operation simulating the operations of the event participants (for example, an avatar 102 and a spectator avatar 104) that correspond to persons in the real world.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and computer program

[0001] The present invention relates to data processing technology, and more particularly to an information processing device, an information processing method, and a computer program.

[0002] The Metaverse, a three-dimensional virtual space service provided by computers, is expected to become even more popular in the future. For example, users can operate their own avatars in the Metaverse to interact with other users and participate in events (e.g., concerts) held within the Metaverse.

[0003] For an event to be successful in the Metaverse, it is important to attract many people to the event. For example, an event that brings together many avatars creates a lively atmosphere, which can attract more people and lead to the success of the event. However, with the number of Metaverses and the number of events held in the Metaverse expected to increase, it is possible that some events will not be able to attract enough people. One object of the present invention is to provide technology that supports the creation of a lively atmosphere at events in virtual space.

[0004] In order to solve the above problem, an information processing device according to one aspect of the present invention includes an NPC placement unit that places non-player characters (NPCs) as event participants at the event location in a virtual space, and an NPC control unit that controls the NPCs to behave in a manner that mimics the actions of event participants corresponding to people in the real world.

[0005] Another aspect of the present invention is an information processing method, which is executed by a computer, including the steps of placing non-player characters (NPCs) as event participants at a location in a virtual space where the event is held, and controlling the NPCs to perform actions that mimic the actions of event participants corresponding to people in the real world.

[0006] Any combination of the above components, and conversion of the present invention between a system, a computer program, a recording medium storing a computer program, etc. are also valid aspects of the present invention.

[0007] According to the present invention, it is possible to help create a lively atmosphere at an event in a virtual space.

[0008] 1 is a diagram illustrating a configuration of a metaverse system according to an embodiment; FIG. 2 is a block diagram illustrating main functional blocks of a user device; FIG. 3 is a block diagram illustrating main functional blocks of a metaverse server; FIG. 4 is a flowchart illustrating an operation of the metaverse system according to an embodiment; FIG. 5 is a diagram illustrating a first example of a metaverse image; and FIG. 6 is a diagram illustrating a second example of a metaverse image.

[0009] An overview of the embodiment will be described. For an event to be successful in the metaverse, it is important to attract many people to the event. However, as the number of metaverses and the number of events held in the metaverse are expected to increase, it is conceivable that some events will not be able to attract enough people. Therefore, in the embodiment, a technology is proposed to help foster a lively atmosphere at events in the metaverse.

[0010] Specifically, in the metaverse system of the embodiment, non-player characters (hereinafter referred to as "NPCs") are placed at the location where an event is held in the metaverse. NPCs are characters that are not controlled by the user, but are characters that are automatically operated by the system. In the metaverse system of the embodiment, the NPCs placed at the location where the event is held are made to perform movements that mimic the movements of the event performers or spectators (e.g., Metaverse users).

[0011] In the embodiment, the event held in the metaverse is a concert, a musical event. However, the technical concepts described in the embodiment can be applied to various events in the metaverse, not just concerts, and can help foster lively atmosphere and attract customers. Unless otherwise specified, appropriate values ​​for the various thresholds in the following embodiments and variations may be determined based on the developer's knowledge or experiments using the metaverse system.

[0012] 1 shows the configuration of a metaverse system 10 according to an embodiment. The metaverse system 10 is an information processing system that provides metaverse services to multiple users. The metaverse system 10 includes a metaverse server 12 and multiple user systems.

[0013] The metaverse server 12 is an information processing device that executes processes related to management of the metaverse. Of the systems of multiple users, the system of user A includes a user device 14a, an HMD (head-mounted display) 16a, and a controller 18a. The system of user B includes a user device 14b, an HMD 16b, and a controller 18b. The system of user C includes a user device 14c, an HMD 16c, and a controller 18c.

[0014] User device 14a, user device 14b, and user device 14c (collectively referred to as "user device 14") are information processing devices operated by users who use the metaverse. In the embodiment, the users are participants in a metaverse event, including, for example, performers and spectators of the event. User device 14 may be a PC, smartphone, tablet terminal, or game console. User device 14 communicates with metaverse server 12 via a communication network 20, which may include a LAN, a WAN, or the Internet.

[0015] HMD 16a, HMD 16b, and HMD 16c (collectively referred to as "HMD 16") are head-mounted displays worn on the user's head. In the embodiment, the user's display device is HMD 16, and the metaverse image is displayed on HMD 16. Alternatively, the metaverse image may be displayed on a television or computer display. HMD 16 is connected to user device 14 by wire or wirelessly.

[0016] The controllers 18a, 18b, and 18c (collectively referred to as "controllers 18") are operation devices to which user operations are input. The controllers 18 may include multiple buttons and analog sticks. The controllers 18 are connected to the user device 14 via a wired or wireless connection. The functions of the user device 14, the function of the HMD 16 (display function), and the function of the controllers 18 may be integrated into a single information processing device.

[0017] 2 is a block diagram showing the main functional blocks of the user device 14. Each block shown in the block diagram in this specification can be realized in hardware terms by computer processors, CPUs, memory, and other elements, electronic circuits, and mechanical devices, or in software terms by computer programs loaded into memory, but the functional blocks shown here are realized by the cooperation of these elements. Therefore, those skilled in the art will understand that these functional blocks can be realized in various ways by combining hardware and software.

[0018] The user device 14 includes a processing unit 60 and a communication unit 62. The processing unit 60 executes data processing and controls the operation of the user device 14. The communication unit 62 communicates with external devices according to a predetermined communication protocol. The processing unit 60 transmits and receives data to and from the metaverse server 12, the HMD 16, and the controller 18 via the communication unit 62.

[0019] The processing unit 60 includes an operation reception unit 70, a display control unit 72, and a metaverse application unit 74. The functions of the multiple functional blocks included in the processing unit 60 may be implemented in a computer program (e.g., system software or application software). This computer program may be stored on a recording medium and installed in the storage of the user device 14 via the recording medium. Alternatively, this computer program may be downloaded via a network and installed in the storage of the user device 14. The processor of the user device 14 may perform the functions of the multiple functional blocks by reading this computer program into main memory and executing it.

[0020] The operation receiving unit 70 receives information about an operation input to the controller 18, which is transmitted from the controller 18. The display control unit 72 controls the display content on the HMD 16. In the embodiment, the display control unit 72 transmits image data showing the state of the metaverse (a metaverse image, described later) generated by an image generation unit 80, described later, to the HMD 16, and causes the metaverse image to be displayed on the HMD 16.

[0021] The metaverse application unit 74 executes user-side processing related to the display of the metaverse. The metaverse application unit 74 includes an avatar operation information transmission unit 76, a user metaverse information reception unit 78, and an image generation unit 80.

[0022] The avatar operation information transmitter 76 transmits avatar operation information, which is information about user operations on avatars placed in the metaverse and which has been received by the operation receiver 70, in other words, information about the movements of the avatars, to the metaverse server 12. The avatar operation information in the embodiment includes skeletal information (also called bone data) that indicates the movement of the avatar's skeleton. As a variation, the avatar operation information may include information indicating the type of button pressed on the controller 18, or information indicating the direction and amount that the analog stick of the controller 18 has been tilted.

[0023] The user metaverse information receiving unit 78 receives user metaverse information transmitted from the metaverse server 12. The user metaverse information is information about the metaverse currently being used by the user, in other words, information about the virtual space in which the user's avatar is located. The user metaverse information includes information necessary for generating a metaverse image to be displayed on the HMD 16.

[0024] The image generation unit 80 generates a metaverse image to be presented to the user in accordance with the user metaverse information received by the user metaverse information reception unit 78. The metaverse image is an image of the metaverse that the user is using as seen from the user's viewpoint, in other words, an image of the virtual space that the user's avatar has entered. The metaverse image of the embodiment is a video showing a virtual concert (virtual live performance) with performer avatars placed on a stage and audience avatars placed in the audience seats.

[0025] 3 is a block diagram showing the main functional blocks of the metaverse server 12. The metaverse server 12 includes a processing unit 30, a storage unit 32, and a communication unit 34. The processing unit 30 executes information processing for metaverse management. The storage unit 32 stores data referenced or updated by the processing unit 30. The communication unit 34 communicates with external devices according to a predetermined communication protocol. The processing unit 30 transmits and receives data to and from the user device 14 via the communication unit 34.

[0026] The storage unit 32 includes a user information storage unit 36 ​​and a metaverse information storage unit 38. The user information storage unit 36 ​​stores user information, which is information about users who use the metaverse managed by the metaverse server 12. The user information includes (1) user identification information and (2) information about the user's avatar (appearance data, etc.).

[0027] The metaverse information storage unit 38 stores metaverse information, which is information about the metaverse currently being used by multiple users. The metaverse information includes (1) identification information of the metaverse, (2) information about objects placed in the metaverse (such as data on their positions and appearances), (3) identification information of users who have entered the metaverse, and (4) the placement positions of each user's avatar in the metaverse.

[0028] The processing unit 30 includes a login processing unit 40, an avatar operation information acquisition unit 42, a metaverse management unit 44, and a user metaverse information transmission unit 56. The functions of the multiple functional blocks included in the processing unit 30 may be implemented in a computer program (e.g., system software or application software). This computer program may be stored on a recording medium and installed in the storage of the metaverse server 12 via the recording medium. Alternatively, this computer program may be downloaded via a network and installed in the storage of the metaverse server 12. The processor of the metaverse server 12 may perform the functions of the multiple functional blocks by reading this computer program into main memory and executing it.

[0029] The login processing unit 40 accepts a login request to the metaverse sent from the user device 14 and executes login processing (authentication processing, etc.). If the user authentication is successful, the login processing unit 40 decides to allow the user to enter the metaverse specified by the user and updates the metaverse information in the metaverse information storage unit 38.

[0030] The avatar operation information acquisition unit 42 receives avatar operation information transmitted from the user device 14. The avatar operation information acquisition unit 42 inputs the avatar operation information to the metaverse management unit 44.

[0031] The metaverse management unit 44 executes processing related to each metaverse based on the multiple pieces of metaverse information stored in the metaverse information storage unit 38. The metaverse management unit 44 includes an avatar setting unit 46, an avatar control unit 48, an NPC placement unit 50, an NPC control unit 52, and a user metaverse information generation unit 54.

[0032] The avatar setting unit 46 places multiple avatars corresponding to multiple users in the metaverse. The avatar setting unit 46 records the placement positions of the avatars of each user in the metaverse in the metaverse information of the metaverse information storage unit 38.

[0033] The avatar control unit 48 controls the behavior of each user's avatar in the metaverse based on the avatar skeleton information indicated by the avatar operation information received by the avatar operation information acquisition unit 42 .

[0034] The NPC placement unit 50 places NPCs as event participants at the event location in the Metaverse. In the embodiment, the NPC placement unit 50 places NPCs as audience members in the audience seats of a virtual concert venue. The NPCs may have the same appearance and shape as the user's avatar (which can also be called the player character).

[0035] The NPC control unit 52 controls the NPC to perform actions that mimic the actions of event participants corresponding to people in the real world. In an embodiment, the event participants corresponding to people in the real world include avatars of concert performers and avatars of concert audience members. In an embodiment, when the avatars of the event participants corresponding to people in the real world perform an action, the NPC control unit 52 causes the NPC to perform the same action.

[0036] The user metaverse information generation unit 54 generates user metaverse information, which is information related to the display of the metaverse for each user, based on (1) metaverse information related to the metaverse the user has entered, (2) avatar information (appearance, position, and movement) of the user and other users, and (3) the placement position and movement of NPCs. For example, the user metaverse information generation unit 54 generates user metaverse information to be provided to the user device 14a of the above-mentioned user A, which includes information on the positions, appearances, and movements of various objects (including avatars and NPCs) in the metaverse visible from the viewpoint position of user A.

[0037] The user metaverse information transmission unit 56 transmits the user metaverse information for each user generated by the user metaverse information generation unit 54 to the user device 14 of each user.

[0038] 4 is a flowchart showing the operation of the metaverse system 10 of the embodiment. The operation of the metaverse system 10 will be described below with reference to FIG.

[0039] Based on a user operation, the user device 14 transmits a login request to the metaverse to the metaverse server 12. The login processing unit 40 of the metaverse server 12 accepts the login request to the metaverse transmitted from the user device 14. When the login request is accepted, the avatar setting unit 46 of the metaverse server 12 places in the metaverse an avatar that the user has previously registered and that is stored in the user information storage unit 36 ​​(S10).

[0040] In the embodiment, the avatar setting unit 46 places avatars of users participating in the event as performers (hereinafter also referred to as "performer avatars") on the stage of the event venue. The avatar setting unit 46 also places avatars of users participating in the event as spectators (hereinafter also referred to as "spectator avatars") in the audience seats of the event venue.

[0041] The NPC placement unit 50 also places NPCs with appearances that mimic event audience members in the audience seats at the event venue (S12). That is, in the metaverse of the embodiment, both avatars corresponding to real people (audience avatars) and NPCs are placed in the audience seats at the event venue. Hereinafter, performer avatars and audience avatars are collectively referred to as "participant avatars."

[0042] The avatar operation information acquisition unit 42 of the metaverse server 12 receives avatar operation information related to the participant avatar transmitted from the user device 14. When the avatar operation information is received (Y in S14), the avatar control unit 48 of the metaverse server 12 determines the movement of the participant avatar in the metaverse based on the skeletal information of the participant avatar indicated by the avatar operation information (S16). The avatar control unit 48 may use known technology to reflect the skeletal movement indicated by the skeletal information of the participant avatar in the movement of the participant avatar in the metaverse. The movement of the participant avatar may include, for example, raising a hand, clapping, jumping, shaking the body, etc.

[0043] The NPC control unit 52 of the metaverse server 12 determines the behavior of the NPC so as to imitate the behavior of the participant avatar (S18). For example, the NPC control unit 52 may detect the behavior of the participant avatar in cooperation with the avatar control unit 48 and determine the same behavior as the participant avatar as the behavior of the NPC. If no operation is input to the participant avatar (N in S14), the processes of S16 and S18 are skipped.

[0044] The user metaverse information generating unit 54 of the metaverse server 12 generates user metaverse information including information on the positions and actions of participant avatars and information on the positions and actions of NPCs, and indicating the state of the metaverse as seen from the user's viewpoint. The user metaverse information transmitting unit 56 of the metaverse server 12 transmits the user metaverse information to the user device 14 (S20).

[0045] The image generation unit 80 of the user device 14 generates a metaverse image (including video) of the metaverse based on the user metaverse information transmitted from the metaverse server 12 (S22). The display control unit 72 of the user device 14 displays the metaverse image on the HMD 16 connected to the user device 14 (S24).

[0046] FIG. 5 shows a first example of a metaverse image. The metaverse image 100 shows the venue of a concert held within the metaverse. The metaverse image 100 is provided to a user as an audience member of the concert. The avatar setting unit 46 of the metaverse server 12 places multiple performer avatars 102 (shaded) corresponding to multiple performers on the stage of the concert venue, and multiple audience avatars 104 (framed with solid lines) corresponding to multiple audience members in the audience seats below the stage. The NPC placement unit 50 of the metaverse server 12 also places multiple NPCs 106 (framed with dashed lines) representing audience members in the audience seats below the stage.

[0047] The NPC control unit 52 of the metaverse server 12 controls some of the NPCs 106 to operate in a first pattern. The NPC control unit 52 also controls another part of the NPCs 106 to operate in a second pattern different from the first pattern.

[0048] 5 includes NPC 106a, NPC 106b, and NPC 106c. The NPC control unit 52 controls NPC 106a to perform actions that mimic the actions of the performer avatar 102. For example, the NPC control unit 52 may obtain information about the actions of the performer avatar 102 from the avatar control unit 48 and control NPC 106a to perform the same actions as the performer avatar 102.

[0049] Furthermore, the NPC control unit 52 controls the NPC 106b to perform actions that mimic the actions of the spectator avatar 104. For example, the NPC control unit 52 may obtain information regarding the actions of the spectator avatar 104 from the avatar control unit 48 and control the NPC 106b to perform the same actions as the spectator avatar 104.

[0050] The NPC control unit 52 also controls the NPC 106c to perform movements that match the music (songs) played at the concert. For example, the metaverse management unit 44 may include a music analysis unit (not shown) that analyzes the rhythm, melody, chords, and genre of the music. The NPC control unit 52 may determine the movements of the NPC 106c according to the analysis results of the music analysis unit. For example, if the music is rock, the NPC control unit 52 may cause the NPC 106c to sway its body vertically. If the music is funk, the NPC control unit 52 may cause the NPC 106c to sway its body sideways. If the music is an idol song, the NPC control unit 52 may cause the NPC 106c to perform choreography that is pre-associated with the song.

[0051] The NPC control unit 52 increases the proportion of NPCs 106 that behave in a pattern that imitates the movements of the performer avatar 102 among the multiple NPCs 106 compared to the proportion of NPCs 106 that behave in other patterns. For example, the NPC control unit 52 may arrange an NPC 106a that imitates the movements of the performer avatar 102, an NPC 106b that imitates the movements of the audience avatar 104, and an NPC 106c that behaves in time with the music in a ratio of 2:1:1 in a concert venue in the metaverse.

[0052] The NPC control unit 52 controls the NPC 106b to perform actions that mimic the actions of spectator avatars 104 that are within a predetermined distance from the NPC 106b. This range may be determined in advance using coordinate values ​​in the metaverse. For example, when placing an NPC 106b, the NPC placement unit 50 may associate spectator avatars 104 that are within a predetermined distance from the NPC 106b with the NPC 106b and record them in the metaverse information in the metaverse information storage unit 38. The NPC control unit 52 may determine, as the action of a certain NPC 106b, the same action as the action of the spectator avatar 104 associated with the NPC 106b in the metaverse information.

[0053] The NPC placement unit 50 places multiple NPCs 106 in the concert venue so that the density of NPCs 106 increases the closer they are to the performer avatar 102. For example, a first range, a second range, and a third range may be defined in order from the closest to the performer avatar 102. The first range may be less than a first distance from the position of the performer avatar 102. The second range may be equal to or greater than the first distance and less than a second distance from the position of the performer avatar 102 (where the first distance is less than the second distance). The third range may be equal to or greater than the second distance from the position of the performer avatar 102.

[0054] In this case, the NPC placement unit 50 may place one NPC 106 per square meter (in the area within the Metaverse) in the first range. The NPC placement unit 50 may place one NPC 106 per two square meters in the second range. The NPC placement unit 50 may place one NPC 106 per four square meters in the third range. This allows for audience placement that is closer to that of a real concert, and also effectively expresses the excitement of the concert.

[0055] 6 shows a second example of a metaverse image. The metaverse image 110 includes an event image 112 depicting a concert held in the real world. The event image 112 is footage captured at a concert venue in the real world, depicting performers 114 and audience 116 in the real world. The event image 112 is screened at the concert venue. The event image 112 may be live footage or recorded footage. The avatar setting unit 46 places audience avatars 104 of users viewing the event image 112 at the concert venue in the metaverse.

[0056] The NPC placement unit 50 places a plurality of NPCs 106, which are modeled after audience members viewing the event image 112, in a concert venue in the metaverse. The plurality of NPCs 106 include a first NPC 106, a second NPC 106, a third NPC 106, and a fourth NPC 106, each having a different behavior pattern.

[0057] The NPC control unit 52 controls the first NPC 106 to perform actions that mimic the actions of the performer 114 depicted in the event image 112. For example, the metaverse management unit 44 may further include a performer estimation unit (not shown) that identifies a performer (e.g., a person on stage) depicted in the event image 112 using publicly known technology and estimates the performer's actions. The NPC control unit 52 may control the first NPC 106 to perform the same actions as the performer's actions estimated by the performer estimation unit.

[0058] The NPC control unit 52 controls the second NPC 106 to perform actions that mimic the actions of the spectators 116 shown in the event image 112. For example, the metaverse management unit 44 may further include an audience estimation unit (not shown) that uses publicly known technology to identify spectators (e.g., people in the audience seats below the stage) shown in the event image 112 and estimate the actions of the spectators. The NPC control unit 52 may control the second NPC 106 to perform the same actions as the actions of the spectators estimated by the audience estimation unit.

[0059] The NPC control unit 52 controls the third NPC 106 to perform actions that mimic the actions of the audience avatars 104 placed in the concert venue. For example, the NPC control unit 52 may obtain information about the actions of the audience avatars 104 from the avatar control unit 48 and control the third NPC 106 to perform the same actions as the audience avatars 104.

[0060] The NPC control unit 52 controls the fourth NPC 106 to perform actions that match the music (songs) played at the concert. As shown in Figure 5, the target whose actions the NPC 106 imitates may be a performer's avatar or an audience member's avatar located in the metaverse. Also, as shown in Figure 6, the target whose actions the NPC 106 imitates may be a performer or audience member in the real world shown in the video.

[0061] According to the metaverse system 10 of the embodiment, NPCs participating in an event in a virtual space can be made to behave in a way that suits the event. This allows the NPCs to create a lively atmosphere for the event. Furthermore, users participating in the same event are less likely to feel uncomfortable with the NPCs, which prevents a decrease in the sense of immersion in the event in the virtual space.

[0062] The present invention has been described above based on the embodiments. These embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of each component and each treatment process, and that such modifications are also within the scope of the present invention.

[0063] A first modification will be described. The NPC control unit 52 of the metaverse server 12 may control the NPC placed in the metaverse so that it imitates the action performed by the largest number of participants among a plurality of event participants (e.g., performers or their avatars, or audience members or their avatars) corresponding to people in the real world.

[0064] As described in the embodiment, the NPC control unit 52 may control the NPC to perform movements that mimic the movements of spectator avatars that are within a predetermined distance from the NPC. When multiple spectator avatars are present within a predetermined distance from the NPC, the NPC control unit 52 may classify the movements of each of the multiple spectator avatars into one of multiple predetermined movement patterns. The multiple movement patterns may include raising a hand, shaking vertically, shaking horizontally, clapping, etc. The NPC control unit 52 may derive the number of occurrences of each movement pattern based on the classification results of the movements of the multiple spectator avatars. The NPC control unit 52 may determine the movement pattern with the most occurrences as the NPC's movement.

[0065] A second modification will now be described. As described in the embodiment, the NPC placement unit 50 may place NPCs that move in time with the music in the metaverse image. In this case, the NPC control unit 52 may determine the movement of each NPC according to the tempo of the music (the speed of the music), or may change the movement of each NPC. This allows the NPCs to move in a manner that matches the music playing in the metaverse.

[0066] Specifically, the metaverse management unit 44 of the metaverse server 12 may further include an audio analysis unit (not shown). The audio analysis unit may analyze the music (audio) of a metaverse concert to obtain the tempo (BPM (Beats Per Minute)) of the music (audio). If the BPM of the music is below a predetermined threshold, the NPC control unit 52 may determine that the NPC's action is to sway the body from side to side. If the BPM of the music is equal to or greater than the threshold, the NPC control unit 52 may determine that the NPC's action is to sway the body vertically. If the volume of the music is equal to or greater than a predetermined threshold, the NPC control unit 52 may determine that the NPC's action is to make a larger gesture (such as raising a hand).

[0067] A third modified example will be described. Here, the avatar whose actions the NPC imitates is referred to as the "imitation target avatar." As partially described in the embodiment, the NPC control unit 52 may determine the NPC's actions so that the NPC performs the same actions as the imitation target avatar based on skeletal information of the imitation target avatar transmitted from the user device 14. The NPC control unit 52 may also determine the NPC's actions based on operations on the imitation target avatar input to the controller 18 transmitted from the user device 14 (such as information about pressed buttons or stick operation information). Furthermore, when an image showing the imitation target avatar is transmitted and received, the NPC control unit 52 may detect the actions of the imitation target avatar by analyzing the image using a known method and determine the actions of the imitation target avatar as the NPC's actions.

[0068] A fourth modified example will be described. The functions provided in the user device 14 in the above embodiment may be provided in the metaverse server 12. In this case, the metaverse server 12 may generate a metaverse image and provide it to the user device 14. The user device 14 may execute a process to display the metaverse image data provided from the metaverse server 12 on the HMD 16. Furthermore, the user device 14 may be provided with the functions provided in the metaverse server 12 in the above embodiment. In this case, a process that requires synchronization between multiple users, such as the placement of avatars of multiple event participants in the metaverse, may be realized by multiple user devices 14 communicating and cooperating with each other.

[0069] Any combination of the above-described examples and modifications is also useful as an embodiment of the present invention. A new embodiment resulting from a combination combines the effects of the combined examples and modifications. It will also be understood by those skilled in the art that the functions to be performed by each component described in the claims can be realized by each component described in the examples and modifications, either individually or in combination. When terms such as "first" and "second" are used in this specification or claims, unless otherwise specified, they do not represent any order or importance, but are used to distinguish one configuration from another.

[0070] The technical concepts described in the above embodiments and modified examples can be expressed as the following techniques. [Technology 1] An information processing device comprising: an NPC placement unit that places non-player characters (NPCs) as participants in an event at a location in a virtual space where the event is held; and an NPC control unit that controls the NPCs to act in a manner that mimics the actions of participants in the event corresponding to people in the real world. This information processing device can cause NPCs as participants in an event in a virtual space to act in a manner that is consistent with the event. This makes it possible to create a lively atmosphere for the event using NPCs. It also makes it less likely that users participating in the same event will feel uncomfortable with the NPCs, thereby preventing a decrease in the sense of immersion in the event in a virtual space. [Technology 2] The information processing device described in Technology 1, in which the participants in the event corresponding to the people in the real world are performers of the event or avatars of the performers. This information processing device can cause NPCs as participants in an event in a virtual space to act in a manner that is consistent with the event. [Technology 3] The information processing device described in Technology 1 or 2, in which the participants in the event corresponding to the people in the real world are spectators of the event or avatars of the spectators. An NPC as a participant in an event in a virtual space can be made to behave in a way that is suited to the event. [Technology 4] The information processing device according to Technology 3, wherein the NPC control unit controls the NPC to behave in a way that imitates the behavior of an avatar of one of the spectators who is within a predetermined threshold distance from the NPC in the virtual space. This information processing device can cause an NPC as a participant in an event in a virtual space to behave in a way that is suited to the event and its position. [Technology 5] The information processing device according to any of Technology 1 to 4, wherein the NPC placement unit places a plurality of NPCs at a location where an event is to be held in the virtual space, and the NPC control unit controls some of the plurality of NPCs to behave in a first pattern and controls another portion of the plurality of NPCs to behave in a second pattern different from the first pattern.According to this information processing device, by varying the movement patterns of multiple NPCs, users participating in the same event are less likely to feel uncomfortable with the NPCs. [Technology 6] The information processing device described in Technology 5, wherein the NPC control unit increases the proportion of NPCs among the multiple NPCs that move in patterns that mimic the movements of the event performers or the performers' avatars, compared to the proportion of NPCs that move in other patterns. This information processing device can create a sense of unity between performers and audience at an event. [Technology 7] The information processing device described in any of Technology 1 to 6, wherein the NPC placement unit places multiple NPCs at a location where an event is held in a virtual space, and the NPC placement unit places the multiple NPCs so that the density of the NPCs increases the closer they are to the event performers or the performers' avatars. According to this information processing device, NPCs are placed in the same manner as in a real event, making it less likely that users participating in the same event will feel uncomfortable. [Technology 8] The information processing device according to Technology 1, wherein the NPC control unit controls the NPC to imitate the action performed by the most common participant among multiple participants corresponding to people in the real world. This information processing device allows the NPC to perform actions that fit the event. [Technology 9] An information processing method executed by a computer, comprising the steps of: placing a non-player character (NPC) as a participant in the event at a location in a virtual space where the event is held; and controlling the NPC to perform actions that imitate the actions of the participants in the event corresponding to people in the real world. This information processing method allows the NPC as a participant in an event in a virtual space to perform actions that fit the event. This makes it possible to create a lively atmosphere for the event using the NPC. Furthermore, it is less likely that users participating in the same event will feel uncomfortable with the NPC, thereby preventing a decrease in immersion in the event in the virtual space.[Technology 10] A computer program for causing a computer to implement the following functions: placing non-player characters (NPCs) as participants in a virtual event at the location where the event is held in the virtual space; and controlling the NPCs to act in a manner that mimics the actions of participants in the event corresponding to real-world people. This computer program allows the NPCs as participants in the virtual space to act in a manner that is in keeping with the event. This makes it possible to create a lively atmosphere for the event using the NPCs. Furthermore, it is less likely that users participating in the same event will feel uncomfortable with the NPCs, thereby preventing a decrease in the sense of immersion in the event in the virtual space.

[0071] The technology of the present disclosure can be applied to information processing systems, information processing devices, and the like.

[0072] 10 Metaverse system, 12 Metaverse server, 14 User device, 36 User information storage unit, 38 Metaverse information storage unit, 46 Avatar setting unit, 48 Avatar control unit, 50 NPC placement unit, 52 NPC control unit, 72 Display control unit, 80 Image generation unit.

Claims

1. An information processing device comprising: an NPC placement unit that places non-player characters (NPCs) as participants in an event at a location in a virtual space where the event is held; and an NPC control unit that controls the NPCs to act in a manner that imitates the actions of participants in the event corresponding to people in the real world.

2. The information processing device according to claim 1, wherein the participants of the event corresponding to the people in the real world are performers of the event or avatars of the performers.

3. The information processing device according to claim 1, wherein the participants of the event corresponding to the people in the real world are spectators of the event or avatars of the spectators.

4. The information processing device according to claim 3, wherein the NPC control unit controls the NPC to perform actions that mimic the actions of avatars of spectators who are within a predetermined threshold distance from the NPC in the virtual space.

5. The information processing device of claim 1, wherein the NPC placement unit places a plurality of NPCs at a location in a virtual space where an event is to be held, and the NPC control unit controls a portion of the plurality of NPCs to behave in a first pattern and controls another portion of the plurality of NPCs to behave in a second pattern different from the first pattern.

6. The information processing device according to claim 5, wherein the NPC control unit increases the proportion of NPCs among the plurality of NPCs that behave in a pattern that imitates the movements of a performer of the event or the performer's avatar, compared to the proportion of NPCs that behave in other patterns.

7. The information processing device according to claim 1, wherein the NPC placement unit places a plurality of NPCs at a location in a virtual space where an event is held, and the NPC placement unit places the plurality of NPCs so that the density of the NPCs is higher the closer they are to a performer of the event or an avatar of the performer.

8. The information processing device according to claim 1, wherein the NPC control unit controls the NPC to imitate an action performed by the most participants among a plurality of participants corresponding to people in the real world.

9. An information processing method executed by a computer, comprising the steps of: placing non-player characters (NPCs) as participants in an event at a location in a virtual space where the event is held; and controlling the NPCs to perform actions that mimic the actions of participants in the event corresponding to people in the real world.

10. A computer program for enabling a computer to perform the following functions: placing non-player characters (NPCs) as participants in an event at the location of the event in a virtual space; and controlling the NPCs to act in a manner that imitates the actions of participants in the event corresponding to people in the real world.

Citation Information

Patent Citations

  • Program for providing virtual space by head mount device, method, and information processing device for executing program

    JP2019050576A

  • Program and information processing apparatus

    JP2023092332A