Information processing device, information processing method, and program

The information processing device addresses the limitations of existing avatar technologies by dynamically editing avatars based on performer actions and event manager inputs, enhancing the interactive experience for viewers.

JP7660727B2Active Publication Date: 2025-04-11KDDI CORP
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024004444
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-01-16
Publication Date
2025-04-11
Estimated Expiration
2043-02-20

AI Technical Summary

Technical Problem

Existing technologies for generating moving images of avatars are limited in their ability to edit avatars dynamically based on the situation of the event they appear in.

Method used

An information processing device that acquires operation information from a performer's actions, edits information from an event manager, and generates display information to synchronize the avatar's actions and appearance with the edited content, which is then transmitted to viewer terminals.

Benefits of technology

Enables dynamic editing of avatars to reflect changes in the event situation, providing a more interactive and responsive avatar presentation experience for viewers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007660727000001
    Figure 0007660727000001
  • Figure 0007660727000002
    Figure 0007660727000002
  • Figure 0007660727000003
    Figure 0007660727000003
Patent Text Reader

Abstract

To provide a mechanism for editing an avatar.SOLUTION: An information processing device 4 includes: a first acquisition part 441 that acquires operation information indicating an operation of a performer detected by a predetermined sensor connected to a performer terminal from the performer terminal used by the performer who performs an operation of an avatar appearing in a predetermined event; an operation control part 442 that controls the operation of the avatar on the basis of operation information acquired by the first acquisition part 441; a second acquisition part 443 that acquires edition information indicating an edition content obtained by editing the avatar by an event manager from an event management terminal used by the event manager who manages the predetermined event; a display information generation part 444 that generates display information for displaying the avatar of which the operation is controlled by the operation control part 442 in the edit content indicated by the edit information acquired by the second acquisition part 443; and a transmission part 446 that transmits the display information generated by the display information generation part 444 to a viewer terminal used by a viewer who views the predetermined event.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, a system that controls a three-dimensional model according to the movement of a person is known. Patent Document 1 discloses a technology for generating a moving image in which a three-dimensional character (hereinafter, referred to as an "avatar") moves according to the movement of a person. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-184689 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above technology, moving images are generated based on pre-set information (such as three-dimensional information about the avatar and three-dimensional information about the avatar's background), so it was not possible to edit the avatar according to the situation of the event in which the avatar was appearing, for example.

[0005] The present invention has been made in consideration of these points, and aims to provide a mechanism for editing avatars. [Means for solving the problem]

[0006] An information processing device according to a first aspect of the present invention comprises a first acquisition unit that acquires, from a performer terminal used by a performer performing the movements of an avatar appearing at a specified event, movement information indicating the movements of the performer detected by a specified sensor connected to the performer terminal; a movement control unit that controls the movement of the avatar based on the movement information acquired by the first acquisition unit; a second acquisition unit that acquires editing information indicating the editing content with which the event manager has edited the avatar from an event management terminal used by an event manager who manages the specified event; a display information generation unit that generates display information for displaying the avatar whose movement has been controlled by the movement control unit, with the editing content indicated by the editing information acquired by the second acquisition unit; and a transmission unit that transmits the display information generated by the display information generation unit to a viewer terminal used by a viewer watching the specified event.

[0007] The transmission section may distribute the display information generated by the display information generation section to a plurality of the viewer terminals.

[0008] The movement control unit may synchronize the movement of the performer indicated by the movement information acquired by the first acquisition unit with the movement of the avatar, and the display information generation unit may generate the display information for displaying the avatar, which has been synchronized with the movement of the performer by the movement control unit, with the editing content indicated by the editing information acquired by the second acquisition unit.

[0009] The information processing device may further have a decision unit that determines the quality level to be applied to the viewer terminal from among multiple quality levels based on a selected level selected by the viewer from among multiple quality levels each having a different display quality of the avatar displayed on the viewer terminal, or based on the usage status of a communication service used by the viewer, and the transmission unit may transmit the display information based on the quality level determined by the decision unit.

[0010] The first acquisition unit may acquire the movement information in association with performer identification information for identifying the performer, the second acquisition unit may acquire the editing information including the performer identification information corresponding to the specified performer, and the display information generation unit may generate the display information for displaying the avatar identified by the performer identification information included in the editing information acquired by the second acquisition unit.

[0011] The editing information may include position information indicating a position in the virtual space at which the avatar is to be placed, and the display information generation unit may generate the display information for displaying the avatar placed at a position in the virtual space specified by the position information.

[0012] The editing information may include appearance information indicating an appearance of the avatar, and the display information generation unit may generate the display information for displaying the avatar with an appearance indicated by the appearance information.

[0013] The editing information may include part setting information for setting a correspondence between parts of the performer that move and parts of the avatar that are to move, and the movement control unit may apply the movement of the performer's part indicated by the movement information to the part of the avatar that is associated with the performer's part in the part setting information.

[0014] An information processing method according to a second aspect of the present invention is executed by a computer and includes the steps of acquiring, from a performer terminal used by a performer performing the movements of an avatar appearing at a specified event, movement information indicating the movements of the performer detected by a specified sensor connected to the performer terminal, controlling the movement of the avatar based on the acquired movement information, acquiring, from an event management terminal used by an event manager managing the specified event, editing information indicating the editing content with which the event manager has edited the avatar, generating display information for displaying the avatar whose movement has been controlled with the editing content indicated by the acquired editing information, and transmitting the generated display information to a viewer terminal used by a viewer watching the specified event.

[0015] A program according to a third aspect of the present invention causes a computer to function as a first acquisition unit that acquires, from a performer terminal used by an performer performing the movements of an avatar appearing at a specified event, movement information indicating the movements of the performer detected by a specified sensor connected to the performer terminal; a movement control unit that controls the movement of the avatar based on the movement information acquired by the first acquisition unit; a second acquisition unit that acquires, from an event management terminal used by an event manager who manages the specified event, editing information indicating the editing content with which the event manager has edited the avatar; a display information generation unit that generates display information for displaying the avatar whose movement has been controlled by the movement control unit, with the editing content indicated by the editing information acquired by the second acquisition unit; and a transmission unit that transmits the display information generated by the display information generation unit to a viewer terminal used by a viewer watching the specified event. Effect of the Invention

[0016] The present invention has an effect of providing a mechanism for editing an avatar. [Brief description of the drawings]

[0017] [Figure 1]FIG. 1 is a diagram for explaining an overview of an information processing system. [Diagram 2] FIG. 2 is a diagram illustrating a functional configuration of an information processing device. [Diagram 3] 1 is a diagram illustrating a process of generating display information by an information processing device. [Figure 4] 10 is a flowchart showing a flow of processing in the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] [Outline of Information Processing System S] 1 is a diagram for explaining an overview of an information processing system S. The information processing system S is a system used for providing an avatar presentation service to a user. The avatar presentation service is a service for presenting an avatar corresponding to a performer P to viewers with content edited by an event manager.

[0019] A performer P is, for example, a person (user) who performs the movements of an avatar appearing in a specific event. An event manager is, for example, a user who manages a specific event in which an avatar appears and edits the avatar. A viewer is, for example, a user who watches a specific event. The information processing system S has a performer terminal 1, a viewer terminal 2, an event management terminal 3, and an information processing device 4.

[0020] The performer terminal 1 is a terminal managed (used) by the performer P. The performer terminal 1 is, for example, a smartphone, a tablet terminal, a personal computer, etc. A specific sensor is connected to the performer terminal 1. The specific sensor is a sensor for detecting the movements of the performer P, for example, a camera for capturing an image of a subject. The performer terminal 1 is capable of communicating with an information processing device 4.

[0021] The viewer terminal 2 is a terminal used by a viewer. For example, a dedicated application program used to use the avatar presentation service is installed in the viewer terminal 2. The viewer terminal 2 is, for example, a smartphone, a tablet terminal, a personal computer, etc. The viewer terminal 2 has a display unit such as a display for displaying information, and an operation unit such as a touch panel, a controller, a keyboard, etc. for accepting operations by the viewer. The viewer terminal 2 is capable of communicating with the information processing device 4.

[0022] The event management terminal 3 is a terminal that manages a specific event, and is, for example, a terminal used by an event manager. The event management terminal 3 is, for example, a smartphone, a tablet terminal, a personal computer, etc. The event management terminal 3 has a display unit such as a display that displays information, and an operation unit such as a touch panel, a controller, a keyboard, etc. that accepts operations by the event manager. The event management terminal 3 is capable of communicating with the information processing device 4.

[0023] The information processing device 4 is a device that manages the avatar display service. The information processing device 4 is, for example, a server. The information processing device 4 is capable of communicating with the performer terminal 1, the viewer terminal 2, and the event management terminal 3. The processes executed by the information processing system S will be described below.

[0024] First, the performer terminal 1 transmits movement information to the information processing device 4 ((1) in FIG. 1). The movement information is information indicating the movement of performer P detected by a specified sensor connected to the performer terminal 1, and is, for example, point cloud data of the entire body of performer P. The movement information may also be point cloud data of a part of performer P (for example, face, upper body, lower body, etc.). The specified sensor is, for example, a camera, but may be any sensor capable of detecting the movement of performer P.

[0025] The event management terminal 3 transmits editing information to the information processing device 4 ((2) in FIG. 1). The editing information is information indicating the editing content for editing the avatar. The editing information includes, for example, information for identifying the avatar, information indicating the position of the avatar to be placed in the virtual space, and information indicating the appearance of the avatar. For example, when the event manager performs an operation to edit an avatar on the event management terminal 3, the event management terminal 3 transmits editing information indicating the editing content operated by the event manager to the information processing device 4.

[0026] The information processing device 4 generates display information ((3) in FIG. 1) based on the movement information acquired from the performer terminal 1 and the editing information acquired from the event management terminal 3. The display information is information for displaying an avatar whose movement is controlled based on the movement information with editing contents indicated by the editing information, and is, for example, a display image including the avatar.

[0027] Then, the information processing device 4 transmits the generated display information to the viewer terminal 2 ((4) in FIG. 1). After that, when the viewer terminal 2 acquires the display information from the information processing device 4, it displays the avatar based on the display information.

[0028] In this way, the information processing system S can reflect the editing contents by the event manager in the avatar whose action it controls. This allows the information processing system S to present to the viewer an avatar that corresponds to the editing contents by the event manager. As a result, the information processing system S can provide a mechanism for editing avatars. The configuration of the information processing device 4 will be described below.

[0029] [Configuration of information processing device 4] FIG. 2 is a diagram showing a schematic functional configuration of an information processing device 4. The information processing device 4 includes a communication unit 41, a storage unit 42, and a control unit 43. In FIG. 2, arrows indicate main data flows, and there may be data flows not shown in FIG. 2. In FIG. 2, each functional block indicates a functional unit configuration, not a hardware (device) unit configuration. Therefore, the functional blocks shown in FIG. 2 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between functional blocks via any means, such as a data bus, a network, or a portable storage medium.

[0030] The communication unit 41 is a communication interface for connecting to a network, and includes a communication controller for receiving data from an external terminal and an external server.

[0031] The memory unit 42 is a large-capacity storage device such as a ROM (Read Only Memory) that stores the BIOS (Basic Input Output System) of the computer that realizes the information processing device 4, a RAM (Random Access Memory) that serves as the working area of ​​the information processing device 4, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores the OS (Operating System), application programs, and various information referenced when the application programs are executed.

[0032] The storage unit 42 stores information about users who use the avatar presentation service. The information about the users includes, for example, the user's ID, the user's name, and the like.

[0033] The control unit 43 is a processor such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) of the information processing device 4, and functions as a first acquisition unit 441, an operation control unit 442, a second acquisition unit 443, a display information generation unit 444, a third acquisition unit 445, a transmission unit 446, and a determination unit 447 by executing programs stored in the memory unit 42.

[0034] The first acquisition unit 441 acquires, from each of one or more performer terminals 1, motion information indicating the motions of performer P detected by a predetermined sensor connected to the performer terminal 1. For example, when the performer terminal 1 detects the motions of performer P at a predetermined interval by a predetermined sensor, the performer terminal 1 transmits detection information indicating the detected motion of performer P (e.g. a frame image in a moving image) to a data generating server (not shown) each time a motion of performer P is detected. The data generating server generates point cloud data based on the detection information acquired from the performer terminal 1. Then, the first acquisition unit 441 acquires, for each piece of detection information, the point cloud data generated by the data generating server based on the detection information as motion information.

[0035] The performer terminal 1 may have a function of a data generating server and generate point cloud data based on detection information detected by a specific sensor. The first acquisition unit 441 may have a function of a data generating server and acquire motion information by generating point cloud data based on detection information acquired from the performer terminal 1.

[0036] The first acquiring unit 441 may acquire the motion information in association with the ID of the performer P. The ID of the performer P is performer identification information (user ID) for identifying the performer P.

[0037] The movement control unit 442 controls the movement of the avatar based on the movement information acquired by the first acquisition unit 441. Specifically, the movement control unit 442 controls the movement of the avatar by reflecting, in the avatar, the movement of the performer P indicated by the movement information acquired by the first acquisition unit 441. The movement control unit 442 reflects, in the avatar, the movement of the performer P indicated by the movement information, for example, by using a known technique.

[0038] The display information generating unit 444 generates display information based on the operation information acquired by the first acquiring unit 441 and editing information indicating the editing content for editing the avatar. Specifically, first, the second acquiring unit 443 acquires the editing information from the event management terminal 3. Then, the display information generating unit 444 generates display information for displaying the avatar whose operation has been controlled by the operation control unit 442 based on the operation information, with the editing content indicated by the editing information acquired by the second acquiring unit 443 from the event management terminal 3.

[0039] The display information generating unit 444 generates display information for displaying an avatar corresponding to a performer P designated by, for example, the event manager. Specifically, first, the second acquiring unit 443 acquires editing information including the ID of the performer P corresponding to the designated performer P. Then, the display information generating unit 444 generates display information for displaying an avatar (the avatar corresponding to the performer P) identified by the ID of the performer P included in the editing information acquired by the second acquiring unit 443. In this way, the information processing device 4 can present to the viewers an avatar corresponding to the performer P designated by the event manager.

[0040] The display information generating unit 444 may generate display information for displaying an avatar placed at a position set by the event manager in the virtual space. Specifically, first, the second acquiring unit 443 acquires editing information including position information of the avatar. The position information is information indicating a position in the virtual space where the avatar is placed. Then, the display information generating unit 444 generates display information for displaying the avatar placed at a position in the virtual space specified by the position information included in the editing information acquired by the second acquiring unit 443. In this way, the information processing device 4 can present the avatar to the viewers by placing it at a position in the virtual space specified by the event manager.

[0041] The display information generating unit 444 may generate display information for displaying an avatar with an appearance set by the event manager. Specifically, first, the second acquiring unit 443 acquires editing information including appearance information of the avatar. The appearance information is information indicating the appearance of the avatar. The appearance information is, for example, the type of avatar (human, animal, robot, etc.), costume, size, etc. The display information generating unit 444 generates display information for displaying an avatar with an appearance indicated by the appearance information included in the editing information acquired by the second acquiring unit 443. In this way, the information processing device 4 can present the avatar to the viewers with the appearance specified by the event manager.

[0042] Here, when the information processing device 4 presents a type of avatar other than a human, such as an animal or a robot, to the viewer, it is desirable to associate a body part of the performer P that moves (e.g., an arm, a leg, etc.) with a body part of the avatar that moves (e.g., a front leg, a back leg, a tail, etc. when the type of avatar is a "dog"). Therefore, the information processing device 4 may apply the movement of the body part of the performer P to the body part of the avatar that is associated with the body part of the performer P.

[0043] Specifically, first, the second acquisition unit 443 acquires editing information including body part setting information. The body part setting information is information for setting a correspondence between a body part moving in the performer P and a body part to be moved in the avatar. Then, the display information generation unit 444 generates display information for displaying an avatar in which the movement control unit 442 applies the movement of the body part of the performer P indicated by the movement information to the body part of the avatar associated with the body part of the performer P in the body part setting information included in the editing information acquired by the second acquisition unit 443. In this way, the information processing device 4 can cause the avatar to perform the movement desired by the event manager according to the type of avatar.

[0044] The display information generating unit 444 may generate display information including an avatar reflecting the movement of the performer P in real time. Specifically, first, the movement control unit 442 synchronizes the movement of the performer P indicated by the movement information acquired by the first acquisition unit 441 with the movement of the avatar. For example, every time the first acquisition unit 441 acquires new movement information, the movement control unit 442 reflects the movement of the performer P indicated by the movement information in the movement of the avatar.

[0045] Then, the display information generating unit 444 generates display information for displaying the avatar synchronized with the movement of the performer P by the movement control unit 442 with the editing content indicated by the editing information acquired by the second acquiring unit 443. In this way, the information processing device 4 can present to the viewers the avatar reflecting the movement of the performer P in real time with the editing content edited in real time by the event manager.

[0046] The display information generating unit 444 may generate display information based on the angle (the virtual viewpoint for viewing the avatar) set by the event manager and the edited content including the background of the avatar edited by the event manager.

[0047] The transmission unit 446 transmits the display information generated by the display information generation unit 444 to the viewer terminal 2. Specifically, the transmission unit 446 distributes the display information generated by the display information generation unit 444 to a plurality of viewer terminals 2.

[0048] More specifically, first, the third acquisition unit 445 acquires a display request from each of the multiple viewer terminals 2. Then, the transmission unit 446 transmits the display information generated by the display information generation unit 444 based on the display request acquired by the third acquisition unit 445 to each of the multiple viewer terminals 2. Thereafter, each of the multiple viewer terminals 2 causes a display image based on the display information to be displayed on the display unit.

[0049] Fig. 3 is a diagram showing a schematic representation of the process in which the information processing device 4 generates display information. Fig. 3(a) is a diagram showing a schematic representation of the movements of a performer P indicated by movement information. In the example shown in Fig. 3(a), the movements of a performer P1 indicated by movement information acquired from a first performer terminal 1 and the movements of a performer P2 indicated by movement information acquired from a second performer terminal 1 are shown.

[0050] Fig. 3(b) is a diagram showing the edited content edited by the event manager. In the example shown in Fig. 3(b), avatar A1 corresponding to performer P1 designated by the event manager and avatar A2 corresponding to performer P2 designated by the event manager are shown. In the example shown in Fig. 3(b), each avatar placed at a position set by the event manager in space V, which is a virtual space, is shown with an appearance edited by the event manager.

[0051] Fig. 3(c) is a diagram showing a schematic representation of avatars displayed based on display information. In the example shown in Fig. 3(c), each avatar reflecting the action of each performer P shown in Fig. 3(a) is shown with the edited content shown in Fig. 3(b). Also, in the example shown in Fig. 3(c), each avatar is shown as viewed from an angle (position and direction of a virtual viewpoint) set by the event manager.

[0052] Here, the information processing device 4 may present the avatar with the second edited content to the viewers after presenting the avatar with the first edited content to the viewers. The second edited content is another edited content changed by the event manager from the first edited content, and is, for example, content in which at least one of the avatar (performer P), the position of the avatar in the virtual space, the appearance of the avatar, the background of the avatar, and the angle is different from the first edited content.

[0053] Specifically, first, the second acquisition unit 443 acquires second editing information indicating the second editing content from the event management terminal 3 after the transmission unit 446 transmits display information based on the first editing information indicating the first editing content to the viewer terminal 2. Then, the transmission unit 446 transmits display information generated based on the second editing information to the viewer terminal 2. In this manner, the information processing device 4 can present to the viewer, for example, a space including an avatar edited according to the event situation.

[0054] The information processing device 4 may present the avatar with a quality appropriate for the viewer. Specifically, the information processing device 4 presents the avatar with a quality appropriate for the viewer by executing the following two steps.

[0055] As a first step, the determination unit 447 determines a quality level appropriate to the viewer to be applied to the viewer terminal 2 from among a plurality of quality levels. The quality level is the display quality of the avatar displayed on the viewer terminal 2, such as the number of pixels of the display image of the avatar, the frame rate of the display image of the avatar, etc. The information processing device 4 has a plurality of quality levels set with different display qualities of the avatar, such as "high", "medium", "low", etc.

[0056] Specifically, the determination unit 447 determines the quality level to be applied to the viewer terminal 2 based on the selection level selected by the viewer using the viewer terminal 2. For example, first, the third acquisition unit 445 acquires a display request including level information indicating the selection level selected by the viewer from among multiple quality levels. Then, the determination unit 447 determines the selection level indicated by the level information included in the display request acquired by the third acquisition unit 445 as the quality level to be applied to the viewer terminal 2.

[0057] The determination unit 447 may determine the quality level to be applied to the viewer terminal 2 based on the usage state of the communication service used by the viewer. For example, the administrator who manages the information processing device 4 is a communication carrier that provides the communication service, and the storage unit 42 stores information about the users who use the communication service. The information about the users includes, for example, the user's ID, the user's usage history of the communication service, the usage plan of the communication service subscribed by the user, etc.

[0058] In this case, the determination unit 447 determines the quality level to be applied to the viewer terminal 2 based on the usage state of the communication service used by the viewer specified by the information on the user stored in the storage unit 42. For example, when the viewer is using the communication service, the determination unit 447 determines the quality level to be applied to the viewer terminal 2 to be high, and when the viewer is not using the communication service, the determination unit 447 determines the quality level to be applied to the viewer terminal 2 to be low.

[0059] Furthermore, the determination unit 447 may determine a higher quality level to be applied to the viewer terminal 2 as the degree of use of the communication service specified by the usage history of the viewer using the communication service (e.g., the amount of communication used by the viewer or the amount paid by the viewer, etc.) is higher, and may determine a lower quality level to be applied to the viewer terminal 2 as the degree of use of the communication service is lower. For example, when the degree of use of the communication service exceeds a usage threshold of a predetermined standard (e.g., a predetermined amount of communication or a predetermined amount), the determination unit 447 determines a high quality level to be applied to the viewer terminal 2, and when the degree of use of the communication service does not exceed the usage threshold, the determination unit 447 determines a low quality level to be applied to the viewer terminal 2.

[0060] Furthermore, the determination unit 447 may determine a higher quality level to be applied to the viewer terminal 2 as the utilization plan of the viewer using the communication service is a higher plan (e.g., a plan with a higher fee), and may determine a lower quality level to be applied to the viewer terminal 2 as the utilization plan of the viewer is a lower plan (e.g., a plan with a lower fee). For example, when the utilization plan of the viewer is a plan higher than a predetermined standard plan threshold (e.g., a predetermined plan), the determination unit 447 determines a higher quality level to be applied to the viewer terminal 2, and when the utilization plan of the viewer is not a plan higher than the plan threshold, the determination unit 447 determines a lower quality level to be applied to the viewer terminal 2.

[0061] As a second step, the transmission unit 446 transmits the display information based on the quality level determined by the determination unit 447. For example, the display information generation unit 444 generates display information corresponding to each quality level, and the transmission unit 446 transmits the display information corresponding to the quality level determined by the determination unit 447 to the viewer terminal 2. In this way, the information processing device 4 can present an avatar at a quality level according to the viewer.

[0062] [Processing of information processing device 4] Next, the process flow of the information processing device 4 will be described. Fig. 4 is a flowchart showing the process flow of the information processing device 4. The first acquisition unit 441 acquires motion information from the performer terminal 1 every time the performer terminal 1 detects a motion of the performer P. In this case, this process starts when the second acquisition unit 443 acquires editing information from the event management terminal 3 (S1).

[0063] The display information generating unit 444 generates display information based on the action information acquired by the first acquiring unit 441 from the performer terminal 1 and the editing information acquired by the second acquiring unit 443 from the event management terminal 3 (S2).

[0064] The third acquisition unit 445 acquires a display request from the viewer terminal 2 (S3). Then, the transmission unit 446 transmits the display information generated by the display information generation unit 444 based on the display request acquired by the third acquisition unit 445 to the viewer terminal 2 (S4). After that, the viewer terminal 2 causes the display unit to display a display image based on the display information.

[0065] [Effects of this embodiment] As described above, the information processing device 4 generates display information for displaying an avatar whose action is controlled based on the action information with the editing content indicated by the editing information, and transmits the generated display information to the viewer terminal 2. In this way, the information processing device 4 can reflect the editing content by the event manager in the avatar whose action is being controlled. This allows the information processing device 4 to present to the viewer an avatar that corresponds to the editing content by the event manager. As a result, the information processing device 4 can provide a mechanism for editing an avatar.

[0066] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0067] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0068] 1 Performer terminal 2. Viewer terminal 3 Event Management Terminal 4. Information processing equipment 41 Communications Department 42 Storage section 43 Control Unit 441 First acquisition part 442 Motion control section 443 Second Acquisition Department 444 Display information generation section 445 Third Acquisition Department 446 Transmitter 447 Decision Section S Information Processing System

Claims

1. a first acquisition unit that acquires, from a first performer terminal that is a performer terminal used by a performer performing the movements of an avatar appearing at a specified event, first movement information that is movement information indicating the movement of the performer detected by a specified sensor connected to the first performer terminal, and acquires, from a second performer terminal that is the performer terminal and different from the first performer terminal, second movement information that is the movement information; an operation control unit that controls an operation of a first avatar, which is the avatar, based on the first operation information acquired by the first acquisition unit, and controls an operation of a second avatar, which is the avatar and is different from the first avatar, based on the second operation information acquired by the first acquisition unit; a second acquisition unit that acquires, from an event management terminal used by an event manager that manages the predetermined event, first editing information indicating first editing content that an event manager has edited on the first avatar; a display information generating unit that generates first display information for displaying the first avatar, the action of which is controlled by the action control unit, in the first editing content indicated by the first editing information acquired by the second acquisition unit; a transmission unit that transmits the first display information generated by the display information generation unit to a viewer terminal used by a viewer who is viewing the predetermined event; having the second acquisition unit acquires second editing information indicating second editing content in which the event manager edits the second avatar after the transmission unit transmits the first display information to the viewer terminal, the second editing content being a second editing content in which the avatar is switched from the first avatar to the second avatar; the display information generation unit generates second display information for displaying the second avatar, whose action is controlled by the action control unit, in the second editing content indicated by the second editing information acquired by the second acquisition unit; The transmission unit transmits the second display information generated by the display information generation unit to the viewer terminal. Information processing device.

2. The transmission unit distributes the first display information or the second display information generated by the display information generation unit to a plurality of the viewer terminals. The information processing device according to claim 1 .

3. the movement control unit synchronizes a movement of the performer indicated by the first movement information acquired by the first acquisition unit with a movement of the first avatar, and synchronizes a movement of the performer indicated by the second movement information acquired by the first acquisition unit with a movement of the second avatar; the display information generation unit generates the first display information for displaying the first avatar, which is synchronized with the movement of the performer by the movement control unit, in the first editing content indicated by the first editing information acquired by the second acquisition unit, and generates the second display information for displaying the second avatar, which is synchronized with the movement of the performer by the movement control unit, in the second editing content indicated by the second editing information acquired by the second acquisition unit. The information processing device according to claim 1 .

4. the information processing device further comprises a determination unit which determines a quality level to be applied to the viewer terminal from among a plurality of quality levels, based on a selected level selected by the viewer from among a plurality of quality levels in which the display quality of the first avatar or the second avatar displayed on the viewer terminal is different, or based on a usage state of a communication service used by the viewer; The transmission unit transmits the first display information or the second display information based on the quality level determined by the determination unit. The information processing device according to claim 1 .

5. the first acquisition unit acquires the first movement information or the second movement information in association with performer identification information for identifying the performer; the second acquisition unit acquires the first editing information including the performer identification information corresponding to the specified performer, and acquires the second editing information including the performer identification information corresponding to the specified performer, the display information generation unit generates the first display information for displaying the first avatar identified by the performer identification information included in the first editing information acquired by the second acquisition unit, and generates the second display information for displaying the second avatar identified by the performer identification information included in the second editing information acquired by the second acquisition unit. The information processing device according to claim 1 .

6. the first editing information includes position information indicating a position in a virtual space at which the first avatar is to be placed, the second editing information includes the position information corresponding to the second avatar; the display information generation unit generates the first display information for displaying the first avatar placed at a position in a virtual space specified by the position information, and generates the second display information for displaying the second avatar placed at a position in a virtual space specified by the position information. The information processing device according to claim 1 .

7. the first editing information includes appearance information indicating an appearance of the first avatar; the second editing information includes the appearance information corresponding to the second avatar; the display information generation unit generates the first display information for displaying the first avatar having an appearance indicated by the appearance information, and generates the second display information for displaying the second avatar having an appearance indicated by the appearance information. The information processing device according to claim 1 .

8. the first editing information includes body part setting information for setting a correspondence between a body part to be moved in the performer and a body part to be moved in the first avatar, the second editing information includes the body part setting information corresponding to the second avatar, the movement control unit applies a movement of the part of the performer indicated by the first movement information to a part of the first avatar that is associated with the part of the performer in the part setting information, and applies a movement of the part of the performer indicated by the second movement information to a part of the second avatar that is associated with the part of the performer in the part setting information; The information processing device according to claim 1 .

9. The computer executes A step of acquiring, from a first performer terminal which is a performer terminal used by a performer performing the movements of an avatar appearing at a specified event, first movement information which is movement information indicating the movement of the performer detected by a specified sensor connected to the performer terminal, and acquiring, from a second performer terminal which is the performer terminal and different from the first performer terminal, second movement information which is the movement information; controlling a motion of a first avatar, which is the avatar, based on the acquired first motion information, and controlling a motion of a second avatar, which is the avatar and is different from the first avatar, based on the acquired second motion information; acquiring, from an event management terminal used by an event manager who manages the predetermined event, first editing information indicating first editing content in which the event manager has edited the first avatar; generating first display information for displaying the first avatar whose action has been controlled with the first editing content indicated by the acquired first editing information; transmitting the generated first display information to a viewer terminal used by a viewer who is viewing the predetermined event; acquiring second editing information indicating second editing content in which the event manager edits the second avatar after transmitting the first display information to the viewer terminal, the second editing content being a second editing content in which the avatar is switched from the first avatar to the second avatar; generating second display information for displaying the second avatar whose action has been controlled with the second editing content indicated by the acquired second editing information; transmitting the generated second display information to the viewer terminal; An information processing method comprising the steps of:

10. Computer, a first acquisition unit that acquires, from a first performer terminal that is a performer terminal used by a performer performing the movements of an avatar appearing at a specified event, first movement information that is movement information indicating the movement of the performer detected by a specified sensor connected to the performer terminal, and acquires second movement information that is the movement information from a second performer terminal that is the performer terminal and is different from the first performer terminal; a motion control unit that controls a motion of a first avatar, which is the avatar, based on the first motion information acquired by the first acquisition unit, and controls a motion of a second avatar, which is the avatar and is different from the first avatar, based on the second motion information acquired by the first acquisition unit; a second acquisition unit that acquires, from an event management terminal used by an event manager who manages the predetermined event, first editing information indicating first editing content in which the event manager edited the first avatar; a display information generating unit that generates first display information for displaying the first avatar, the action of which is controlled by the action control unit, in the first editing content indicated by the first editing information acquired by the second acquisition unit; and a transmission unit that transmits the first display information generated by the display information generation unit to a viewer terminal used by a viewer who is viewing the predetermined event; Function as a the second acquisition unit acquires second editing information indicating second editing content in which the event manager edits the second avatar after the transmission unit transmits the first display information to the viewer terminal, the second editing content being a second editing content in which the avatar is switched from the first avatar to the second avatar; the display information generation unit generates second display information for displaying the second avatar, whose action is controlled by the action control unit, in the second editing content indicated by the second editing information acquired by the second acquisition unit; The transmission unit transmits the second display information generated by the display information generation unit to the viewer terminal. program.

Citation Information

Patent Citations

  • Virtual space broadcasting apparatus

    JP2009093478A

  • Moving image generation device and program

    JP2015184689A

  • Engagement estimation device, engagement estimation method, and program

    JP2020136923A

  • Program, method and terminal device

    JP2021035454A

  • Receiver and program

    JP2021132259A