PROGRAM, INFORMATION MANAGEMENT SYSTEM AND INFORMATION MANAGEMENT METHOD

The program and information management system address the challenge of authenticating avatars in virtual spaces by converting video data into motion encoded data and generating unique authentication tokens, ensuring authenticity and efficient management of virtual space rights while enhancing event safety.

JP7591218B2Active Publication Date: 2024-11-28NEXT SYST CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021095456
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-07
Publication Date
2024-11-28
Estimated Expiration
2041-06-07

AI Technical Summary

Technical Problem

Existing virtual social systems struggle to authenticate the legitimacy of avatars in virtual spaces, allowing impersonation and unauthorized use of virtual space rights, leading to inefficiencies in managing and trading these rights.

Method used

A program and information management system that converts video data into motion encoded data, generates authentication tokens based on unique motion data, and uses hash functions to ensure authenticity and manage avatar identities, allowing for efficient authentication and management of virtual space rights.

Benefits of technology

Ensures the authenticity of avatars, facilitates efficient management and trading of virtual space rights, and enhances safety during events by preventing unauthorized actions and collisions in virtual environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591218000001
    Figure 0007591218000001
  • Figure 0007591218000002
    Figure 0007591218000002
  • Figure 0007591218000003
    Figure 0007591218000003
Patent Text Reader

Abstract

To provide a program, an information management system and an information management method that can guarantee the authenticity of an avatar in a virtual space and also contribute to efficient management on or dealings of the right to use the virtual space.SOLUTION: An information management system A which uses one example of a program and an information management method according to the present invention to perform ID management on an avatar in an event in a virtual space comprises a management server 1. The management server 1 has a video information processing unit 10, an information recording unit 11 and an information transmission / reception unit 12. The management server 1 further has a hash value generation unit 13, an authentication token generation unit 14 and an authentication processing unit 15.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a program, an information management system, and an information management method, and more particularly to a program, an information management system, and an information management method that can guarantee the authenticity of an avatar in a virtual space and contribute to efficiently managing or trading the right to use the virtual space. [Background technology]

[0002] 2. Description of the Related Art In recent years, virtual society systems have become widespread, in which a virtual space is constructed on a network such as the Internet, and in which a character called an avatar is displayed as a user's alter ego within the virtual space, enabling communication with other users.

[0003] Communication via avatars in this virtual space is usually carried out by around three or four users, who play back motion data for the avatars, displaying various movements with the avatars, and having conversations in the virtual space.

[0004] In addition, a service that distributes live content via a network, known as Internet live broadcasting, is becoming popular. In such Internet live broadcasting, a technology is used in which a broadcaster appears as a broadcaster avatar in a virtual space and broadcasts the video as live content.

[0005] In such live content, motion capture technology is used to synthesize the distributor's movements as the movements of the distributor's avatar, resulting in the distributed video.

[0006] There is also a system in which performers and spectators wearing HMDs (Head Mount Displays) participate as avatars in games, movies, etc., and the images are shot from multiple viewpoints and distributed over multiple channels. In this system, viewers watching the distribution can also have characters they have developed on a game device related to the distribution participate in the distribution as viewer avatars (see, for example, Patent Document 1).

[0007] Furthermore, in order to efficiently communicate with other users using avatars, a system has been proposed that records user information including at least one of appearance information representing the user's external characteristics and personality information representing the user's personality characteristics in association with an avatar (see, for example, Patent Document 2).

[0008] In addition to live content, it is also possible to hold large-scale events, such as sporting events like the Olympics, in a virtual space, and display avatars of performers such as athletes and a large number of spectator avatars within the event. [Prior art documents] [Patent documents]

[0009] [Patent Document 1] Japanese Patent Application Publication No. 2002-271693 [Patent Document 2] Japanese Patent Application Publication No. 2008-217255 Summary of the Invention [Problem to be solved by the invention]

[0010] Here, when holding an event in a virtual space with spectator avatars, there is a demand to be able to distinguish whether the participating spectator avatars are genuine spectator avatars who have purchased tickets and are participating, or avatars who are masquerading as spectator avatars through hacking or other means.

[0011] Previous technology managed and authenticated the right to use virtual space by avatars on a personal ID basis, such as by using a user's biometric information (such as date of birth) at the time of logging in to identify the user, but this method was unable to detect a fraudulent avatar after logging in. In addition, authentication on a personal ID basis also had the problem that it was easy for someone to violate the contract and use the system illegally, for example, by using a VIP seat despite having a ticket for general seating.

[0012] Furthermore, given the premise that an avatar will be displayed in a virtual space, there is little point in authenticating the user's identity in the first place, and authentication using the user's biometric information makes it difficult to determine whether the avatar in question has the right to use the time and space provided in the virtual space, i.e., to prove the authenticity of the avatar.

[0013] Furthermore, there was considerable room for improvement in avatar-based virtual society systems, such as efficiently managing or trading the rights to use avatars in the virtual space, ensuring safety during events, and making it possible to accommodate a large number of avatars.

[0014] The present invention has been devised in consideration of the above points, and aims to provide a program, information management system, and information management method that can guarantee the authenticity of avatars within a virtual space and contribute to efficiently managing or trading rights to use the virtual space. [Means for solving the problem]

[0015] In order to achieve the above-mentioned objective, the program of the present invention is a program for managing or trading the rights of avatars to use space within a virtual space, and is configured as a program for causing a computer to function as an encoding processing means that encodes specified video data into character data and processes it into motion-coded data, which is information arranged in chronological order, and as an authentication token generation means that generates an authentication token corresponding to the avatar based on the motion-coded data.

[0016] Here, by making the computer function as an encoding processing means that character-encodes specified video data and processes it into movement-encoded data, which is information arranged in chronological order, the movement data that is to be linked to the avatar's authentication token can be converted into character-encoded data with a small data size, and can be used as information with a small amount of data based on the movement data.

[0017] Furthermore, by making the computer function as an authentication token generating means for generating an authentication token corresponding to an avatar based on the motion coding data, the unique data derived from the motion data can be used as an authentication token for each avatar. The motion data of the object that is the source of this motion coding data is information in which the motion is perfectly consistent, that is, it is difficult to obtain identical data, and it is easy to ensure uniqueness. Therefore, by generating an authentication token for an avatar based on such motion data and managing the ID of the avatar, the authenticity of the avatar can be guaranteed.

[0018] In addition, when the computer is made to function as a hash value generating means for generating a predetermined hash value from the motion-encoded data using a hash function, the amount of data obtained by character-encoding the motion data can be further compressed for use. This makes it easier to reduce the amount of data required to generate authentication tokens corresponding to each avatar, even if there are a large number of avatars, and makes it easier to use a large number of avatars. In addition, the use of a hash function makes it difficult to identify the motion-encoded data or motion video data that are the source of the hash value, making it easier to ensure uniqueness.

[0019] In addition, when the computer is made to function as a hash value generating means for generating a predetermined hash value from the motion coding data using a hash function, and the authentication token generating means generates an authentication token by combining the predetermined symbol information, which is unique symbol information, with the predetermined hash value, the data of the hash value generated based on the motion data can be easily managed by the predetermined symbol information. That is, for example, the predetermined symbol information can be used to classify avatars by numbers, or as information indicating the position or type of spectator seats set up in the virtual space where an event is held. Note that the predetermined symbol information here includes, for example, a serial number of numbers, symbol information combining numbers and letters, etc.

[0020] In addition, when the computer functions as an information recording means for recording an authentication token and an authentication processing means for performing authentication processing of an avatar by comparing information presented by an avatar user with the authentication token recorded in the information recording means, it becomes possible to record an authentication token based on movement data, and compare the recorded authentication token with the authentication token presented by the avatar user to authenticate whether or not the avatar has been legitimately granted an authentication token.

[0021] In addition, the avatars include spectator avatars at an event held in a virtual space, and when the authentication token specifies the type of seats for spectators in the virtual space in which the event is held, the authentication token can be used not only for ID management of the spectator avatars, but also as a ticket to the spectator seats to be located at the event.

[0022] In addition, when the motion coding data linked to the authentication token includes information obtained by character-coding predetermined video data related to the movements performed by the avatar during an event in the virtual space or the event-related movements related to the reward of the event, the authentication token can be used to manage the avatars participating in the event in the virtual space, assuming the movements performed by the avatar during the event. In addition, the authentication token can be used to manage the avatars by including information that serves as a reward slip for the performer avatar appearing in the event. Here, the movements performed by the avatar are, for example, cheering movements or movements to liven up the event in the case of a spectator avatar. In addition, the movements performed by the avatar are, for example, movements of a performance during an event or movements during a sports match in the case of a performer avatar. In addition, the movements related to the reward of the event are, for example, movements that specify the amount of reward to be paid to the performer avatar depending on the content, such as the winning move in a sumo event between avatars.

[0023] Furthermore, when a computer is made to function as a voxel avatar generating means for generating a voxel avatar for reproducing an event-related action, and an interference calculation means for reproducing an event-related action using a voxel avatar within a certain time and within a certain range in a virtual space and performing interference calculation of the voxel avatar in the voxel space, it is possible to grasp the range of the space-time region required according to the position and the content of the movement of the avatar during the event, and to design a space-time in which no voxel collision occurs between avatars. That is, it is possible to reproduce an event-related action using a voxel avatar in a virtual space, and to perform interference calculation as to whether or not the avatars occupy the same lattice range in the voxel space at the same time (occurrence of a voxel collision). Based on the result of this interference calculation, it is possible to design the venue for an event in a virtual space, taking into consideration the space-time range that each avatar can use during the event. For example, it is possible to design the number and size of seats, the range of seats with different types, etc., assuming the number and movement of spectator avatars. It is also possible to design the size of a stage, a ring, a match court, etc., according to the content of the event and the movement of the performer avatars. It can also be used as reference information for formulating conditions for seat usage (conditions such as prohibited movements of audience avatars) and for creating seating charts and numbering.

[0024] Furthermore, when the computer is made to function as a motion monitoring means for monitoring the motion of an avatar participating in an event during an event held in a virtual space by comparing actual space-time voxels, which are spatial information on the size and position of a voxel space at a certain time based on the motion of an avatar participating in the event, with predicted space-time voxels, which are spatial information on the size and position of a voxel space at a certain time based on an event-related motion by a voxel avatar, and determining whether the actual space-time voxels exceed the range of the predicted space-time voxels or whether interference occurs between the actual space-time voxels and an adjacent avatar, it becomes possible to detect whether an avatar is making a motion that violates the rules during the event. Also, it becomes possible to determine the win or lose of a performer avatar in a match, competition, or the like.

[0025] That is, for example, by observing the movements of spectator avatars during an event, and comparing the actual time-space voxels resulting from the movements that the spectator avatars are actually making during the event with the delayed time-space voxels resulting from the movements that the spectator avatars were scheduled to make during the event, it is possible to detect unplanned movements and take action such as warning or expulsion for avatars that are considered to be violating the rules. Also, for example, it is possible to detect the movements or movements of spectator avatars that exceed the time-space range of the seats assigned to the spectator avatars and take action such as warning or expulsion. Furthermore, in the case of performer avatars, for example, it is possible to detect when a performer avatar goes outside the range of the ring during a sumo match and determine the winner. In this way, the safety of avatars during an event and the operation of the event can be managed via the operation monitoring means.

[0026] In addition, when the avatar includes a performer avatar in an event held in a virtual space, and the action monitoring means compares the actual time-space voxels of the performer avatar with the predicted time-space voxels based on a plurality of movements ranked according to different movements related to the reward of the event, and determines whether the movement of the performer avatar corresponds to any of the ranked movements, the action monitoring means can determine the movement of the performer avatar during the event and authenticate which of the ranked movements was performed. That is, for example, it can be used for assessing the reward for the performer avatar. In addition, for example, in an event related to figure skating or gymnastics, it is possible to set a plurality of ranked movements and the difficulty level of each movement, and use the authentication token as a rule book for scoring the performance of the performer avatar.

[0027] Furthermore, when the encoding processing means detects moving object region data from the predetermined video data in the first process, it can detect a region in the captured image of the video data where there is movement. Note that the predetermined video data referred to here may be high-resolution video data, or data obtained by cutting out a part of the video data from a surveillance camera or the like that moves the viewpoint in the horizontal direction. Furthermore, the detection of moving object region data referred to here means detecting difference pixels whose values ​​change from the previous frame to the next frame in the frames that constitute the video data.

[0028] Furthermore, when the encoding processing means performs noise removal processing on the moving object region data in the second processing, it becomes possible to extract moving object region data from the captured image with difference pixels due to noise removed. Furthermore, by performing noise removal processing, it becomes possible to avoid subdivision of the moving object region due to noise and to perform rectangular region division with a small number of iterative applications of the binary tree algorithm.

[0029] Furthermore, when the encoding processing means divides and classifies the data into at least five rectangular area data based on a binary tree algorithm in the second process, it is possible to extract a range with large movement from the imaging range of the video data as at least five rectangular area data. This allows rectangular area data with a small data capacity to be generated from the predetermined video data and used as information reflecting the characteristics of the movement. Furthermore, by generating at least five rectangular area data, it is possible to identify and distinguish each individual rectangular area. This allows each distinguished rectangular area to be associated and used as information reflecting the characteristics of the overall movement of the object.

[0030] Furthermore, when the encoding processing means extracts coordinate data of a predetermined boundary point of each rectangular area from the rectangular area data in the third process and arranges the coordinate data of the predetermined boundary points at a constant frame rate in a time series, it becomes possible to express the movement of each rectangular area data only by the time series change of two-dimensional information called the coordinate data of the boundary point. That is, the movement of each rectangular area data can be expressed as an array of two-dimensional coordinate values ​​of X coordinates and Y coordinates. This makes it possible to handle the movement information as numerical information with a smaller data capacity than the rectangular area data. Note that the predetermined boundary point here is, for example, the corner that is farthest from the center of gravity calculated from the area weight of each rectangular area among the four corners of the rectangular area in the imaging range of the predetermined video data.

[0031] Furthermore, when the encoding processing means arranges the coordinate data of the predetermined boundary points at a certain frame rate in a time series, character-codes the data, and converts the data into motion-coded data in the third process, a series of movements appearing in the video data is character-coded to reduce the size of the data, and can be handled as a single data. That is, the motion information can be collected into a single segment and recorded, saved, or played back as a single data.

[0032] In addition, in order to achieve the above-mentioned objective, the information management system of the present invention is an information management system for managing or trading the rights of avatars to use space within a virtual space, and is equipped with an encoding processing unit that character-encodes specified video data and processes it into motion-encoded data, which is information arranged in chronological order, and an authentication token generation unit that generates an authentication token corresponding to the avatar based on the motion-encoded data.

[0033] Here, the encoding processing unit converts the movement data that is to be linked to the avatar's authentication token into character-encoded data with a small data size by character-encoded processing that encodes the specified video data and processes it into movement-encoded data, which is information arranged in chronological order, so that the movement data can be used as information with a small data volume based on this movement data.

[0034] Furthermore, the authentication token generating unit generates an authentication token corresponding to an avatar based on the motion coding data, and the unique data derived from the motion data can be used as an authentication token for each avatar. The motion data of the object that is the source of this motion coding data is difficult to obtain such that the motion is completely consistent, i.e., it is difficult to obtain identical data, and it is easy to ensure uniqueness. Therefore, by generating an authentication token for an avatar based on such motion data and managing the ID of the avatar, the authenticity of the avatar can be guaranteed.

[0035] In addition, in order to achieve the above-mentioned objective, the information management method of the present invention is an information management method for managing or trading the rights of an avatar to use a space within a virtual space, and includes an encoding processing step of character-encoding specified video data and processing it into motion-encoded data, which is information arranged in chronological order, and an authentication token generation step of generating an authentication token corresponding to the avatar based on the motion-encoded data.

[0036] Here, in an encoding process in which specific video data is character-encoded and processed into movement-encoded data, which is information arranged in chronological order, the movement data to be linked to the avatar's authentication token is converted into character-encoded data with a small data size, making it possible to use the movement data as small-volume information.

[0037] In addition, based on the motion coding data, an authentication token corresponding to the avatar is generated. Generate By the authentication token generation process, unique data derived from the motion data can be used as an authentication token for each avatar. The motion data of the object that is the source of this motion coding data is difficult to obtain because the motion is completely identical, i.e., it is difficult to obtain identical data, and it is easy to ensure uniqueness. Therefore, by generating an authentication token for the avatar based on such motion data and managing the avatar's ID, the authenticity of the avatar can be guaranteed. Effect of the Invention

[0038] The program, information management system, and information management method according to the present invention can guarantee the authenticity of avatars in a virtual space, and contribute to the efficient management or trading of rights to use the virtual space. [Brief description of the drawings]

[0039] [Figure 1] 1 is a schematic diagram showing a configuration of an information processing system A to which the present invention is applied. [Diagram 2] 1 is a schematic diagram showing the work procedures of a host, participants, and certified business operators when running an event using information processing system A. FIG. [Diagram 3] This is an image diagram showing the movements of a prototype sitting cross-legged using an anthropomorphized model avatar, and an image diagram of the time and space of a virtual sumo venue. [Figure 4] FIG. 2 is a schematic diagram showing an example of the types of spectator seats set up at an event. [Diagram 5] FIG. 13 is an illustration of interference calculation using voxel avatar B. [Figure 6] FIG. 1 is a schematic diagram showing a spectator avatar performing a violating move at a sumo event. [Figure 7] FIG. 1 is a schematic diagram showing an example of an anthropomorphic model generated from five extracted rectangular area data and two-dimensional time-series data of boundary points. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0040] Hereinafter, embodiments of the present invention will be described with reference to the drawings for the purpose of understanding the present invention. FIG. 1 is a schematic diagram showing the configuration of an information management system that performs avatar ID management in an event in a virtual space using an example of a program and information management method to which the present invention is applied.

[0041] [1. Overall system configuration] An information management system A, which uses an example of a program and an information management method to which the present invention is applied and performs ID management of avatars in an event in a virtual space, has a management server 1 (see FIG. 1).

[0042] This management server 1 is a server equipped with various management functions for conducting authentication business, such as issuing motion authentication tokens T, managing avatar IDs by ticket inspection, recording information related to avatar ID management, calculating interference when setting up an event venue in a virtual space, and managing safety during the event. Details of the motion authentication tokens T will be described later.

[0043] The management server 1 is a server that is mainly used by an authentication business operator (administrator) who runs an authentication business.

[0044] Moreover, the information management system A has a host server 2 (see FIG. 1).

[0045] This organizer server 2 is a server equipped with various functions for hosting and executing an event in a virtual space, such as providing a virtual space for the event, providing event-related information to users participating in the event (selling tickets, concluding performance contracts, etc.), receiving information from participating users, setting time and space in the virtual space, implementing and managing the event, and managing safety during the event.

[0046] The host server 2 is a server that is mainly used by the host or the advertiser who hosts the event in the virtual space. The host server 2 is connected to the management server 2 via the Internet 4, and executes various functions in cooperation with the management server 2.

[0047] The information management system A also has a participant terminal 3 (see FIG. 1). The participant terminal 3 is made up of a plurality of audience terminals 30 and a plurality of performer terminals 31.

[0048] This spectator terminal 30 is a terminal on the user side that uses a spectator avatar to purchase tickets (motion authentication token T) for events held in virtual space, participate in events as a spectator avatar, and perform cheering actions with the avatar during the event.

[0049] In addition, the performer terminal 31 is a terminal on the user's side that uses a performer avatar to enter into a performance contract (movement authentication token T) for an event held in a virtual space, participate in the event as a performer (athlete) avatar, and perform acting or competitive movements during the event.

[0050] The audience terminal 30 or the performer terminal 31 is connected to the management server 1 or the organizer server 2 via the Internet 4, and transmits and receives information to and from various servers.

[0051] Furthermore, the various functions performed by the management server 1 and the host server 2 in this management information system A can also be introduced into general-purpose information processing equipment, and the incorporated information processing equipment performs the various information processing functions necessary to implement the present invention. Note that an information processing equipment is equipped with a calculation unit such as a CPU, a storage unit such as a RAM or a ROM, a display screen such as an LCD screen, an input unit such as a keyboard and a camera, a sound source playback unit such as a speaker, a communication unit that controls communication with the Internet, etc. For example, it is a personal computer with high three-dimensional processing capabilities.

[0052] Furthermore, the structure shown below is a system configuration for implementing an example of a program, information management system, and information management method to which the present invention is applied, and the content of the present invention is not limited to this, and the design can be modified as appropriate.

[0053] In the embodiment of the present invention using the information management system A described below, a case in which a sumo tournament event is held in a virtual space using performer avatars will be described as an example.

[0054] As shown in Fig. 1, the management server 1 has a video information processing unit 10, an information recording unit 11, and an information transmitting / receiving unit 12 (see Fig. 1). Note that the video information processing unit 10 here corresponds to the encoding processing means in the claims of the present application.

[0055] As shown in FIG. 1, the management server 1 includes a hash value generation unit 13, an authentication token generation unit 14, and an authentication processing unit 15.

[0056] The hash value generation unit 13 referred to here corresponds to the hash value generation means in the claims of the present application. The authentication token generation unit 14 referred to here corresponds to the authentication token generation means in the claims of the present application. Furthermore, the authentication processing unit 15 referred to here corresponds to the authentication processing means in the claims of the present application.

[0057] As shown in FIG. 1, the management server 1 also includes a voxel avatar generator 16, an interference calculator 17, a motion monitor 18, and a motion determiner 19.

[0058] The voxel avatar generation unit 16 referred to here corresponds to the voxel avatar generation means in the claims of the present application. The interference calculation unit 17 referred to here corresponds to the interference calculation means in the claims of the present application. Furthermore, the motion monitoring unit 18 and the motion determination unit 19 referred to here correspond to the motion monitoring means in the claims of the present application.

[0059] Here, the video information processing unit 10 is a part that extracts five two-dimensional time series data reflecting the characteristics of the motion data from the motion data to be encoded, which is acquired by imaging the motion of an object with an imaging means, and generates character coded data (hereinafter, referred to as "skeletal motion coded data"). The generation of character coded data from the motion data will be described in detail later.

[0060] Here, "video data of the movement to be encoded" refers to video data that serves as the information source that imparts uniqueness (uniqueness) to the movement authentication token T, which is used to manage the IDs of multiple audience avatars and multiple performer avatars displayed at an event in a virtual space.

[0061] For example, even if a person sits cross-legged, it is difficult to obtain exactly the same data, and the uniqueness of the motion video data is easy to ensure. Therefore, by generating a motion authentication token T for an avatar based on such motion data and managing the avatar's ID, the authenticity of the avatar can be guaranteed.

[0062] Furthermore, the movements of the "movie data of movements to be encoded" may be those of a template prepared by the organizer or those prepared by an audience avatar or performer avatar. It is also possible to adopt a template movement prepared by the organizer plus another movement desired by an audience avatar. In this way, video information processing unit 10 processes video data of some movement and encodes it into characters.

[0063] Moreover, the movement of the "movie data of the movement to be encoded" is configured to be processed as one piece of movie data by the video information processing unit 1. Therefore, movie data of a single movement can be used as is, and even if there are multiple pieces of movie data of movements, they are edited and combined into one movie data, and processed into skeletal movement encoded data via the video information processing unit 10.

[0064] The information recording unit 11 is a unit that records the skeleton movement encoded data that has been character-encoded by the video information processing unit 10. The information recording unit 11 is a unit that records a hash value and a movement authentication token T, which will be described later.

[0065] The information transmitting / receiving unit 12 is a unit that transmits and receives information between the management server 1 and the organizer server 2 via the Internet 4. The information transmitting / receiving unit 12 also transmits and receives information with the audience terminal 30 and the performer terminal 31 as necessary.

[0066] The hash value generating unit 13 is a part that outputs a motion hash value via a hash function in response to input of skeleton motion coded data that has been character coded by the video information processing unit 10 .

[0067] This movement hash value is a fixed-length value calculated by using a hash function to convert skeletal movement coding data (digital data).The amount of data is smaller than the original skeletal movement coding data, and the data is converted into a character code that is completely different from the original character code.

[0068] In addition, if the character code in the input skeletal movement coding data differs even slightly, the character code of the output motion hash value will be a completely different character code.

[0069] This makes it possible to convert the skeleton movement code data into short, fixed-length digital data and output it as unique information converted from the original video data with different movements.

[0070] Furthermore, since it is difficult to generate the original skeletal movement coding data from the motion hash value, it is not possible to restore the skeletal movement coding data or motion video data based on the motion hash value, which prevents tampering with the motion authentication token T.

[0071] The authentication token generating unit 14 is a part that generates a movement authentication token T for ID management of a plurality of audience avatars and a plurality of performer avatars participating in an event in a virtual space.

[0072] Furthermore, the authentication token generating unit 14 combines the "movement hash value" with a "serial number" that is set based on the event content, etc., to generate a token made up of combined symbol information.

[0073] Here, the serial number constituting the motion authentication token T can be set corresponding to the order of the spectator seats in the event venue designed in the virtual space, the type (rank) of the seats, etc., when the motion authentication token T is used as a ticket for a spectator avatar. Also, the serial number is composed of only numbers, or a character string of numbers and alphabets, etc.

[0074] Furthermore, when the motion authentication token T is used as a digital participation contract for a performer avatar, the serial number constituting the motion authentication token T can be set according to the order of appearance in the event, the ranking of the performers in the event (yokozuna, ozeki, etc.), the size order of the avatar, etc. Furthermore, the serial number is composed of only numbers or a character string of numbers and alphabets, etc.

[0075] This motion authentication token T is used for ID management of avatars and can be issued as an event ticket that audience avatars purchase to participate in the event. It can also be issued as a digital participation contract that performer avatars sign with the organizer when participating in the event.

[0076] In this way, it is possible to manage via the movement authentication token T that an avatar has the right to use the time-space of the virtual space in an event held by the organizer.

[0077] Furthermore, the motion authentication token can be used as a reward slip for the performer avatar according to the performance at the event, or as a rule book for the competition held at the event. This will be described in detail later.

[0078] In addition, the authentication processing unit 15 is the part that performs authentication processing by comparing the information on the ticket using the motion authentication token T and the digital participation contract presented by each avatar user at the time of the event with the motion authentication token T issued by the management server 1 and recorded in the information recording unit 11.

[0079] An avatar having a movement authentication token T authenticated by this authentication processing unit 15 becomes able to participate in an event in a virtual space.

[0080] The voxel avatar generating unit 16 generates a voxel avatar B, which is an anthropomorphic model of a standard body type, based on skeletal movement code data generated from video data of movements.

[0081] This voxel avatar B is an avatar for reproducing the movements that are the origin of the video data, for which skeletal movement code data has been generated from video data of various movements, as the movements of an anthropomorphic model avatar.

[0082] The interference calculation unit 17 reproduces the movements of the skeleton motion code data, which have different movements, in the virtual space using the voxel avatar B, and calculates the spatiotemporal interference from the movements during reproduction.

[0083] More specifically, a lattice-like voxel space is constructed in a virtual space, and multiple voxel avatars B are placed within a certain range of that voxel space. Their movements are then played back, and the interference calculation unit 17 verifies whether or not a voxel collision has occurred between the voxel avatars B within a certain period of time.

[0084] Then, the interference calculation unit 17 reproduces the movement of the voxel avatar B and calculates a space-time where no voxel collision occurs, that is, where the number of non-interfering space-time voxels can be secured. Based on the verification results of the interference calculation unit 17, the organizer etc. can design the space-time of the virtual space required for the event on the organizer server 2.

[0085] Furthermore, the movement monitoring unit 18 is a part that monitors the movements of the audience avatars or performer avatars during an event in the virtual space to determine whether or not they are making any illegal movements.

[0086] In addition, the illegal movements referred to here are, for example, in the case of a spectator avatar, movements registered for each spectator avatar linked to the movement authentication token T. In other words, they are movements other than those that the avatar can take within the specified time-space range in the virtual space.

[0087] For example, when a certain spectator avatar is registered (tied to a ticket) for sitting cross-legged within the box seating area of ​​a sumo wrestling match, the motion monitoring unit 18 monitors the virtual space. If the spectator avatar moves outside of the box seating area, cheers by holding up a towel with a sumo wrestler's name on it, throws a cushion into the ring, or stands up and cheers, the motion monitoring unit 18 detects this and determines that the spectator is engaging in a violation of the rules.

[0088] In addition, the violating movements monitored by the action monitoring unit 18 are not limited to the registered movements linked to the movement authentication token T; it is also possible to set other movements that the organizers consider to be disruptive to the safe running of the event as movements to be monitored separately.

[0089] When the action monitoring unit 18 detects a violation, it issues a warning to the spectator avatar or notifies him or her of the withdrawal based on the judgment, or notifies the organizer server 2 of the judgment result.

[0090] In addition, the motion monitoring unit 18 detects and determines whether a movement is illegal by comparing the space-time voxels (actual space-time voxels) used by the spectator avatar being monitored during the event with the space-time voxels (predicted space-time voxels) used when playing back the movement of voxel avatar B based on the skeletal movement code data from which the movement authentication token T corresponding to that spectator avatar is derived, and detecting the difference between the two space-time voxels.

[0091] Furthermore, the motion monitoring unit 18 can also detect and determine whether a voxel collision has occurred based on the movements of spectator avatars during an event, and determine this as a violating motion.

[0092] The monitoring by the action monitoring unit 18 is configured to monitor the movements of performer avatars in a sumo match between two performer avatars (sumo wrestler avatars) to determine the winner. In this monitoring, the performer avatars can determine the winner by monitoring interfering movements such as one of the performer avatars going out of the ring or touching the ground with its hands or body.

[0093] Furthermore, the operation monitoring unit 18 digitally manages the time limits for match-ups and water-intermissions during sumo events, judges delays, and manages the timing of the event.

[0094] Here, the motion monitoring unit 18 compares the motion of the performer avatar measured in the virtual space with the motion during the sumo bout, including the winning move, as defined by the motion authentication token T. This makes it possible to measure the cumulative time of the match state, which is measured and identified as the motion before the bout, and the cumulative time of the motion while still grappling after the bout. In this way, the motion monitoring unit 18 can also function as a part that manages the time of the event.

[0095] The movement determination unit 19 is a part that uses the movement authentication token T as movement identification data for the performance of the performer avatar at the event or the movement during the competition, and determines which movement has been made.

[0096] Here, a number of movements with different levels of difficulty are ranked for the competitions held at the event. Then, for each ranked movement with different levels of difficulty, the video data of the movement is skeletal motion coded to generate a hash value, which is then clearly indicated in the digital participation contract. This digital participation contract is also a type of movement authentication token T.

[0097] In addition, the motion determination unit 19, in cooperation with the motion monitoring unit 18, determines which of the motions identified in the digital participation contract the performance of the performer avatar in the event and the motions during the competition correspond to, and authenticates them. This makes it possible to use the amount of remuneration to be paid to the performer avatar according to the rank, depending on the motions performed by the performer avatar.

[0098] More specifically, in the case of a sumo event held in a virtual space, standard winning moves in sumo matches between avatars can be skeletal motion coded and hashed, and a digital participation contract can be created that specifies the compensation for those moves.

[0099] Furthermore, if it is detected via the action determination unit 19 and the action monitoring unit 18 that the outcome of a sumo match is decided by a movement that deviates from the movements clearly identified in the digital participation contract, it is also possible to mediate and authenticate the establishment of an additional contract to pay a reward to the performer avatar or to collect a fine.

[0100] Furthermore, if the digital participation contract were used as a rulebook for scoring figure skating or gymnastics performances, for example, it could be used as a judging system based on objective digital data.

[0101] As shown in FIG. 1, the organizer server 2 has a space-time arrangement unit 20, a payment processing unit 21, a space monitoring unit 22, an event notification unit 23, an information recording unit 24, and an information transmitting / receiving unit 25 (see FIG. 1).

[0102] Here, the space-time arrangement unit 20 is a part that designs the space-time that will be the venue of the event in the virtual space. The space-time arrangement unit 20 is a part that allocates resources to the design of the required space-time according to the competition content, scale, number of participating avatars, etc. of the event based on the result of the interference calculation by the interference calculation unit 17 of the management server 1.

[0103] The settlement processing unit 21 is a part that performs various settlement processes between the organizer and the users of the audience avatars or performer avatars, such as selling tickets to an event, concluding a participation contract, and paying remuneration for performance. A motion authentication token T is used as the ticket, the digital participation contract, and the remuneration slip.

[0104] The time-space monitoring unit 22 is a part that monitors the virtual space during the event on the organizer's side, and is responsible for safety management during the event in conjunction with the operation monitoring unit 18 of the management server 1.

[0105] The event notification unit 23 is a unit that discloses information about events held in a virtual space by the organizer, etc., to the users of the avatars. The event notification unit 23 discloses information such as the date and time of the event, the content of the competition, and the size of the venue, as well as the movements of the voxel avatar B in a template prepared by the organizer, etc., to the users of the spectator avatars.

[0106] The event announcement unit 23 also serves as a part that displays to the users of the performer avatars the movements of the event competitions and the like by reproducing them with the movements of the voxel avatar B. The event announcement unit 23 also serves as a part that displays information such as the rules of the event competitions and the like, rewards, and the like.

[0107] The information recording unit 24 is a unit for recording the movement authentication token T which serves as the ticket, the digital participation contract, and the reward slip.

[0108] The information transmitting / receiving unit 25 is a unit that transmits and receives information between the management server 1 and the organizer server 2 via the Internet 4. The information transmitting / receiving unit 25 is also a unit that transmits and receives information between the audience terminal 30 and the performer terminal 31.

[0109] In addition, the spectator terminal 30 is a terminal that can be used to make ticket purchase requests to the organizer server 2, present purchased tickets, receive notification of ticket authentication, provide information on participating spectator avatars, and request registration of desired avatar movements desired by the user during the event.

[0110] In addition, the performer terminal 31 is a terminal through which the organizer server 2 is contacted to apply to participate in the event, enter into a participation contract, present the concluded digital participation contract, provide information on the participating performer avatar, and request registration of the desired avatar movements that the user desires during the event.

[0111] The information management system A, which is an example of the embodiment of the present invention, has the configuration described above.

[0112] [Generating character encoding data from video data]

[0113] Next, an example of a flow of encoding motion video data into characters to generate skeletal motion encoded data in the information management system A to which the present invention is applied will be described. Note that the character encoding process from video in the present invention is not limited to the following content, and any means capable of encoding motion video data into characters can be appropriately adopted.

[0114] First, the video information processing unit 10 detects a moving object area where the subject is moving within the imaging range from the moving image data of the "target movement" and extracts low-resolution moving image data (128 x 128 pixels). In addition, a noise reduction process is performed on the detected moving object area data.

[0115] In addition, the image information processing unit 10 divides the noise-removed moving object area data into five rectangular area data, classifies these into five parts of the subject, namely the head, right hand, left hand, right foot, and left foot, and trims and extracts five rectangular area data 120 of the anthropomorphized model (see the upper diagram of Figure 7).

[0116] Next, the video information processing unit 10 extracts the coordinates of the boundary points of each of the five classified rectangular area data 120. For each frame constituting video data of a series of movements of the subject, the video information processing unit 10 extracts the coordinates of the boundary points of the five rectangular area data 120. The video information processing unit 10 also arranges the coordinates of the boundary points of the five extracted rectangular area data 120 in chronological order (generation of two-dimensional time series data).

[0117] Furthermore, when the imaging means is a moving camera, it is also possible to extract coordinate data of the camera viewpoint of the imaging means and camera viewpoint movement data from the video signal of the imaging means.

[0118] Then, the video information processing unit 10 converts information on the coordinates of the boundary points of the five rectangular area data 120 in each frame constituting the video data of a series of movements of the subject into character codes and performs compression coding (character coding).

[0119] When the coordinate data of the camera viewpoint of the image capturing means and the camera viewpoint movement data are extracted, the coordinate information can also be converted into character codes and compressed and encoded.

[0120] By following the steps described above, two-dimensional time-series data of the boundary points of the five rectangular area data 120 that reflect the characteristics of a series of movements, and character-encoded data can be generated from the video data of the series of movements.

[0121] In this way, the coordinates of the boundary points of the five rectangular area data 120 are converted into character codes for each frame, and then linked and recorded for the number of frames of the series of movements, making it possible to compress the video data capturing the series of movements of the subject as character-coded information. By handling the information as this character-coded information, it becomes possible to record, store, communicate, or play back the movement information with less data capacity and less computational processing.

[0122] In addition, two-dimensional time series data of the boundary points and the like can be received, and based on this data, a series of detected movements can be reproduced and displayed as the movements of the anthropomorphic model 30 (see the lower diagram in FIG. 7). A voxel avatar B can be generated based on this anthropomorphic model 30.

[0123] The anthropomorphic model 30 is a simulator imitating a human form, in which the coordinates of the boundary points of the rectangular area data 120 of the head, both hands, and both feet are connected by lines to a circle centered on the coordinates. The anthropomorphic model 30 may also be displayed with intermediate joint areas such as elbows, chest, waist, and knees supplemented. A series of detected movements can be reproduced and displayed as the movements of the anthropomorphic model 30 or the voxel avatar B.

[0124] Next, we will explain the flow of managing an event using this information management system A. There are two possible patterns for managing an event using the information management system A, depending on the timing of setting up the venue. Each pattern will be explained below.

[0125] [1. Flow of trading usage rights after setting up the venue] First, the participants' avatars' motion templates are registered, the event venue is set up in the virtual space, and then the time and space usage rights for the event are traded. The work procedures for the organizer, participants, and certified business operators in this pattern are shown in Figure 2.

[0126] [A. Setting up the venue] First, during the procedure stages, when setting up the venue, in "1. Design stage," the organizers make available to users of the avatars (players, performers, or supporters and spectators) the "template movements" of the avatars that they have prepared in advance via the event announcement unit 23 (see symbol P1 in Figure 2).

[0127] For example, for player and performer avatars, multiple template movements related to performances on the competition stage or game movements will be made public. Also, for cheering squad and spectator avatars, multiple template movements related to seat types such as reserved seats, unreserved seats, and group seats, as well as cheering movements for each seat will be made public.

[0128] Moreover, the movement of the template is reproduced and displayed as the movement of the voxel avatar B (or the anthropomorphic model) generated by the voxel avatar generating unit 16 of the management server 1.

[0129] In addition, when setting up the venue, the certified business operator generates skeletal movement coding data from each of the avatar "template movements" presented to the avatar user in "1. Design stage" (see symbol B1 in FIG. 2). This operation is performed via the video information processing unit 10 of the management server 1.

[0130] Here, for a sumo match event in a virtual space, the announcement of the sumo "VR venue" and the terms of use are disclosed. For example, the positions of the box seats and the movement of an anthropomorphized model avatar sitting cross-legged as a template movement in the box seats are made public to spectator avatars (see Figure 3). In addition, the conditions under which up to four avatars can sit in the area of ​​one box seat are also made public. This allows users of spectator avatars to view the seats and movements during the event.

[0131] Also, while sumo wrestling box seats have been given as an example of seat types here, at an event venue, in addition to a stage for athletes, the seat types can be further divided into VIP seats, advertising seats, outfield seats, general seats, infield seats, and broadcast seats, as shown in Figure 4. Also, for each seat type, the number of seats, size, number of available avatars, permitted avatar movements, etc. can be set.

[0132] Also, when setting up the venue, in "2. Construction Stage", the certified business operator plays back the skeletal movement coding data relating to the template's movement using voxel avatar B, and the interference calculation unit 17 performs space-time region calculations in the virtual space required for the avatar's movement (see symbol B2 in Figure 2).

[0133] The interference calculation unit 17 also plays back the movements of the voxel avatar B, verifies whether or not a voxel collision occurs between the voxel avatars B within a certain range and time, and performs interference calculations to ensure the number of non-interfering space-time voxels (see symbol B2 in FIG. 2). FIG. 5 shows an image of the interference calculations.

[0134] Furthermore, when the venue is being set up, in "3. Completion Inspection", the interference calculation unit 17 performs safety compatibility calculations for the skeletal movement coding data relating to the movement of the template based on the results of the interference calculations, with respect to the competition stage in the virtual space and spectator seats such as reserved seats (see symbol B3 in Figure 2).

[0135] The information on the results of these interference calculations and safety compliance calculations will be used by organizers and others for space-time design.

[0136] In addition, when setting up the venue, in "1. Design Phase," the organizer specifies the spatial and temporal scale of the competition stages and other equipment to be used for the event in the virtual space, as well as the reserved seats and other spectator seating (see symbol O1 in Figure 2).

[0137] In "2. Construction Stage", the organizer arranges the time-space of the competition stage and the reserved seats for the event in the virtual space based on the specified contents (see symbol O2 in FIG. 2). This work is performed via the time-space arrangement unit 20 of the organizer server 2.

[0138] Furthermore, in the time-space arrangement by the time-space arrangement unit 20, the result of the interference calculation performed by the certified business operator via the interference calculation unit 17 is used.

[0139] Furthermore, in "3. Completion Inspection", the organizer checks the time-space safety of the competition stage and spectator seats such as reserved seats arranged in the virtual space (see symbol O3 in Fig. 2). Here, the results of the safety conformity calculation performed by the certified business operator via the interference calculation unit 17 are used.

[0140] In addition, in conjunction with "2. Construction Stage" or "3. Completion Inspection" by the organizer, the conditions of use for each type of seat are established, for example, the permitted avatar movements are set according to the type of seat. Also, at this stage, the seating chart is created and numbered. This numbering is used to set the serial number to be included in the movement authentication token T.

[0141] In this manner, the venue for an event in a virtual space is set up. In this pattern, the movement of a template avatar prepared in advance by the organizer or the like is disclosed to the user of the avatar. Based on the movement of the template, the movement is reproduced by the voxel avatar B, and area calculations, interference calculations, or safety compatibility calculations in the virtual space are performed to design space-time. In this manner, the information management system A of the present invention functions as a venue set-up system for an event in a virtual space.

[0142] [B. When trading usage rights] Next, after the venue is set up, the rights to use the time and space for the event to be held in virtual space are traded. Here, when trading usage rights, in "4. Supply Management", the certified business operator creates a digital participation contract for the performer avatar (see symbol B4 in FIG. 2).

[0143] This digital contract contains character codes generated as motion hash values ​​by generating skeletal motion coding data from video data for multiple template movements that the athlete / performer avatars will perform at the event. This digital contract also contains a serial number set based on information such as the athlete's order of appearance.

[0144] In addition, the digital participation contract is created via the video information processing unit 10, the hash value generating unit 13, and the authentication token generating unit 14 of the management server 1.

[0145] This combination of the movement hash value and the serial number is used to manage the IDs of the player and performer avatars. In other words, the movement authentication token T, which contains the movement hash value generated based on the template movement, is used to prove that the player or performer avatar is a player or performer avatar of the event and can perform the registered movement in the event.

[0146] In other words, this digital participation contract is created, and the avatar that enters into this contract is obligated to perform the registered movements on the competition stage, etc. (see symbol P2 in Figure 2).

[0147] In addition, as described above, this digital participation contract can include information on the skeletal movement coding of video data of multiple movements ranked at different levels of difficulty in the competitions held at the event, generating a movement hash value, and clearly indicating the identification.

[0148] As a result, during the event, the action determination unit 19 of the management server 1, in conjunction with the action monitoring unit 18, can determine which of the actions identified in the digital participation contract the performances and movements made by the athlete / performer avatars during the competition correspond to, and authenticate them. As a result, the amount of remuneration to be paid to the performer avatar according to its rank can be assessed based on the movements made by the performer avatar.

[0149] Furthermore, when trading usage rights, in "5. Sales Management", the authenticated business operator creates tickets for the cheering squad and spectator avatars (see symbol B5 in Figure 2).

[0150] This ticket contains character codes generated as motion hash values ​​by generating skeletal motion coding data from video data for multiple template movements such as cheering that the cheering squad and spectator avatars make at the event. This ticket also contains a serial number set based on information such as the type of cheering section and seat number.

[0151] Furthermore, for spectator avatars in groups such as cheering squads, a character code indicating that they are in the same group may be used.

[0152] The ticket is generated via the video information processing unit 10 , the hash value generating unit 13 , and the authentication token generating unit 14 of the management server 1 .

[0153] This combination of the movement hash value and the serial number is used to manage the IDs of cheerleading and spectator avatars. In other words, the movement authentication token T, which contains the movement hash value generated based on the template movement, is used to prove that the cheerleading and spectator avatar is a member of the event's cheerleading and spectator avatars and can perform the registered cheering movements at the event.

[0154] In other words, when this ticket is created and purchased, the avatar who owns it will have the right to perform the registered movements in the audience seats at the event (see symbol P3 in Figure 2). In addition, the right to use the time and space of the cheering section will be acquired.

[0155] Also, when trading usage rights, in "4. Supply Management" and "5. Sales Management", the organizer etc. will present the digital participation contract and ticket to the avatar user (see symbol O4 in Figure 2).

[0156] Also, at the time of trading usage rights, in "6. Ticket Issuance Management", if an application to participate in an event is made to the organizer server 2 from a performer terminal 31, or an application to purchase a ticket is made from an audience terminal 30, a sales contract is concluded between the organizer and the avatar user (see symbol O5 in Figure 2).

[0157] When the sales contract is concluded, the user of the athlete / contestant avatar receives a digital participation contract, and the user of the cheerleader / spectator avatar receives a ticket (see symbol P4 in FIG. 2).

[0158] Furthermore, once the sales contract is concluded, in "7. Accounting Processing", the organizer performs a settlement process via the settlement processing unit 21 of the organizer server 2 (see reference symbol O6 in FIG. 2).

[0159] Here, the organizers pay the athlete and performer avatars a fee based on the digital participation contract, and the athlete and performer avatars generate income. Also, based on the tickets, the supporters and spectators avatars pay the ticket fees to the organizers, and the supporters and spectators avatars incur expenses (see P5 in Figure 2).

[0160] Furthermore, after the event has ended, if the movements performed by the athlete / performer avatars at the event were special movements that were clearly identified in the Digital Participation Contract, it may be possible to process the accounts separately.

[0161] Furthermore, when the right of use is traded, in "7. Accounting Processing", the certified business operator records the concluded participation contract and the ticket in the information recording unit 11 (see symbol B7 in FIG. 2).

[0162] As described above, the transaction of the time-space usage rights of the event in the virtual space is executed via the digital participation contract or ticket, which is a kind of the motion authentication token T. In this way, the information management system A of the present invention functions as a contract or ticket issuing system for the event in the virtual space.

[0163] [C. During the event] Next, after the usage rights transaction, an event will be held in the virtual space. Here, when the event is held, in “8. Usage Management”, when the avatar participates in the event, the player / performer avatar will present the issued digital participation contract to the organizer (see P6 in Figure 2).

[0164] Additionally, the supporter / spectator avatars will present the purchased tickets to the organizer (see symbol P6 in Figure 2).

[0165] The authentication business operator performs authentication processing on the presented information of this digital participation contract or ticket via the authentication processing unit 15 of the management server 1 (see reference symbol B8 in FIG. 2).

[0166] That is, the information on the digital participation contract or ticket recorded in the information recording unit 11 is compared with the information on the digital participation contract or ticket presented by the avatar user to verify whether or not the movement authentication token T is genuine.

[0167] In this authentication process, if the authentication processing unit 15 confirms that the presented digital participation contract or ticket is recorded in the information recording unit 11, it accepts it as a genuine token, and if it cannot be confirmed, it rejects it as an invalid token. The result of acceptance or rejection by the authentication processing unit 15 is notified to the organizer, and the avatar in possession of the accepted digital participation contract or ticket becomes able to participate in the event.

[0168] Furthermore, in "8. Usage Management", the organizer can check whether the information presented by the avatar user is a legitimate token based on the authentication results of the authentication processing unit 15, and identify any fraudulent use (see symbol O7 in Figure 2).

[0169] Also, when the event is held, in “9. Quality Control,” the athlete / performer avatars will disclose the registered movements linked to the digital participation contract as their performance during the event (see P7 in Figure 2).

[0170] In addition, in addition to the registered movements linked to the digital participation contract, the user of the athlete / performer avatar can also reproduce and display any movement on the avatar using a web camera, motion capture software, etc. The movements of each avatar are also subject to monitoring by the movement monitoring unit 18.

[0171] When the event is held, the sumo bout will take place on a virtual competition stage - in the case of sumo, on the sumo ring - with the athlete or performer avatars displaying both registered movements linked to the digital participation contract and optional movements.

[0172] Also, when the event is held, in “9. Quality Control”, the cheering squad / spectator avatars will disclose the registered movements linked to the tickets as cheering movements during the event (see P7 in Figure 2).

[0173] In addition, in addition to the registered movements linked to the ticket, the users of the cheering squad and spectator avatars can also replay and display any movement on the avatar using a web camera, motion capture software, etc. The movements of each avatar are also subject to monitoring by the movement monitoring unit 18.

[0174] When an event is being held, in the spectator seats around the ring (for example, in the box seats), cheering squad / spectator avatars will display both registered movements linked to their tickets and optional movements to cheer on the sumo matches.

[0175] Also, when the event is being held, in “9. Quality Control”, the organizer grasps the progress and utilization rate of the event, i.e., the utilization rate of time and space and the rate of movement execution, via the space-time monitoring unit 22 (see symbol O8 in Figure 2).

[0176] Furthermore, during the event, in "9. Quality Control", the certified business operator monitors the movements of each avatar during the event (see symbol B9 in FIG. 2).

[0177] More specifically, the difference between the registered movements linked to the digital participation contract or ticket and the movements actually displayed by the avatar in the virtual space is monitored via the movement monitoring unit 18 of the management server 1. That is, the movement monitoring unit 18 monitors whether or not the avatar during the event is making any movements that violate the rules.

[0178] In this monitoring and judgment, for example, the space-time voxels used by a spectator avatar (actual space-time voxels) are compared with the space-time voxels (predicted space-time voxels) used when playing back the movement of voxel avatar B based on the skeletal movement code data of the movement linked to the ticket corresponding to that spectator avatar, and the difference between the two space-time voxels is detected to judge whether the movement is violating.

[0179] The motion monitoring unit 18 can also detect whether a voxel collision has occurred in the movements of spectator avatars during an event and determine this as a violation.

[0180] In "10. Safety Management", when the behavior monitoring unit 18 detects a violation, the certified business operator issues a warning or safety instruction to the avatar (see symbol B10 in FIG. 2).

[0181] The certified business operator issues warnings and safety instructions to the avatar, and the avatar user follows these instructions (see symbol P8 in FIG. 2). The management server 1 also reports the warnings and other instructions to the organizer server 2, and the organizer grasps the safety situation (see symbol O9 in FIG. 2).

[0182] For example, at a sumo event, a spectator avatar whose ticket has been registered as sitting with their legs crossed may then move outside their own area of ​​the box seat, cheer on a wrestler by holding up a towel with the wrestler's name on it, throw a cushion onto the ring, or stand up and cheer (see Figure 6).

[0183] The motion monitoring unit 18 then detects the difference in the movement, determines that the movement is a violation, and issues a warning or instructs the spectator to sit down. Also, if the violation is significant or if no improvement is seen in the movement, the motion monitoring unit 18 can issue an exit command to the spectator avatar, causing the avatar to leave the venue.

[0184] Also, the outcome of a sumo match can be determined via the motion monitoring unit 18. The motion monitoring unit 18 is configured to monitor the motions of performer avatars in a sumo match between two performer avatars (sumo wrestler avatars) to determine the outcome of the match. In this monitoring, the performer avatars monitor interfering motions such as one of the performers going out of the ring or touching the ground with their hands or body, and determine the outcome.

[0185] As described above, when an event is held in a virtual space, ticket inspection and safety management during the event are performed via the digital participation contract and ticket, which are a type of motion authentication token T. That is, the information management system A of the present invention functions as a contract or ticket inspection system for the event in the virtual space. The information management system A also functions as a safety management system for the event in the virtual space.

[0186] In the process described above for trading usage rights after the venue is set up, first the prototype movements of the participating avatars are registered, the event venue is set up in the virtual space, and then the usage rights for the event's time and space are traded.

[0187] [2. Procedure for setting up the venue after the rights transaction] The second pattern is to register the desired movements provided by the participating avatar users, trade the time-space usage rights for the event, and then set up the event venue in the virtual space according to the avatar movements. In other words, the organizers do not provide template movements, but the avatar users provide specific movements, which are used for the movement authentication token T.

[0188] Therefore, in this pattern, when an event is held, the organizer first solicits the movements that users want to register. The users of the player / performer avatars or the cheering squad / spectator avatars provide the organizer with the movements that they want to register.

[0189] The certified business operator also generates skeletal motion coding data from the motion video data provided by the avatar user, and outputs a motion hash value. The digital participation contract or ticket reflects a combination of the motion hash value based on the motion provided by the avatar user and a serial number.

[0190] In addition, when designing the time-space of a virtual space competition stage, audience seating, etc., movements are reproduced by a boxe avatar B using skeletal motion coding data based on video data of movements provided by the avatar user, and area calculations, interference calculations, and safety compatibility calculations are performed.

[0191] In addition, for safety management during events, skeletal movement coding data based on video data of movements provided by avatar users will be used to monitor the movements of avatars participating in the event and detect and judge any violations.

[0192] In addition, in the present invention, the motion associated with the motion authentication token T may be a combination of a template motion prepared by the organizer and a motion provided by the user of the avatar to generate a motion hash value. For example, a special ticket can be created by adding a special motion desired by the user to the template motion prepared by the organizer.

[0193] [Advantages of the invention] By using the program, information management system, and information management method to which the present invention is applied, the following advantages are obtained.

[0194] First, when holding an event in which avatars are displayed in a virtual space, a digital participation contract or ticket can be created as a motion authentication token T to manage the ID of each avatar and ensure the authenticity of the avatar.

[0195] In other words, by generating skeletal movement coding data based on movement data, for which it is difficult to obtain identical data and it is easy to ensure uniqueness, and outputting a movement hash value, and using this as a token, it is possible to generate an authentication token that is difficult to tamper with.

[0196] In addition, by further converting the character-encoded skeletal movement encoded data into a hash value, the amount of data can be reduced, making it easier to use as an authentication token for a large number of avatars.

[0197] In addition, the authentication token can be used to design the time and space required for events in virtual space, manage safety during the event, and can also be used to determine the winner of events, enforce rules, and manage rewards for participant avatars.

[0198] In this way, this authentication token can be used to achieve unified avatar ID management across multiple service systems involved in hosting events in virtual space.

[0199] Furthermore, ID management using authentication tokens has the potential to become a new business model that can be run as a business separate from event organizers.

[0200] For example, a business model could be established that provides a service to store and manage video data and skeletal movement coding data, together with motion hash values, as a single data set.

[0201] Another possible service would be to convert video data into skeletal movement coding data, and then use a hash function, which converts the data into a hash value, to store and manage the data separately and independently as a private key.

[0202] Furthermore, in order to ensure the authenticity of video data that includes information on the movements of people, animals, plants, machines, etc. and to detect tampering, a service can be considered in which the hash values ​​of skeletal movement coding data recognized by image recognition models are created, stored, and managed as public keys.

[0203] As described above, the program, information management system, and information management method to which the present invention is applied can guarantee the authenticity of avatars within a virtual space, and contribute to the efficient management or trading of usage rights in the virtual space. [Explanation of symbols]

[0204] A Information Management System 1 Management Server 10. Video information processing section 11 Information Recording Section 12 Information transmission and reception section 13 Hash value generator 14 Authentication token generator 15 Authentication processing section 16 Voxel Avatar Generation Unit 17 Interference Calculation Section 18 Operation monitoring section 19 Operation judgment section 2 Host Server 20 Space-time arrangement part 21 Payment processing section 22 Space Monitoring Department 23 Event Announcement Department 24 Information Recording Section 25 Information transmission and reception section 3 Participant terminals 30 Spectator terminal 31 Performer terminal 4. Internet

Claims

1. A program for managing or trading rights for avatars to use virtual space, Computer, An encoding processing means for encoding predetermined moving image data into character code and processing the encoded data into motion coded data which is information arranged in a time series; an authentication token generating means for generating an authentication token corresponding to the avatar based on the motion coding data; a program for causing the program to function as a hash value generating means for generating a predetermined hash value from the motion encoded data by using a hash function, The authentication token generating means generates the authentication token by combining predetermined symbol information, which is unique symbol information, with the predetermined hash value. program.

2. A computer, an information recording means for recording the authentication token; The authentication token is stored in the information storage means, and the authentication token is stored in the information storage means. The program according to claim 1.

3. The avatar includes a spectator avatar at an event held in the virtual space, The authentication token defines a type of seating for spectators within the virtual space in which the event will take place. The program according to claim 1 or 2.

4. The motion-encoded data associated with the authentication token includes information obtained by character-encoding video data relating to a motion performed by the avatar during an event in the virtual space, or an event-related motion that is a motion related to a reward for the event. The program according to claim 1, 2 or 3.

5. A computer comprising: a voxel avatar generating means for generating a voxel avatar for reproducing the event-related action; In the virtual space, the event-related action is reproduced within a certain period of time and a certain range by using the voxel avatar, and the event-related action is caused to function as an interference calculation means for performing interference calculation of the voxel avatar in a voxel space. The program according to claim 4.

6. A computer comprising: During an event held in the virtual space, comparing actual spatiotemporal voxels, which are spatial information on the size and position of a voxel space at a certain time based on the movement of an avatar participating in the event, with predicted spatiotemporal voxels, which are spatial information on the size and position of a voxel space at a certain time based on an event-related action by the voxel avatar, and determining whether or not the actual spatiotemporal voxels exceed the range of the predicted spatiotemporal voxels; Alternatively, determining whether or not interference occurs in the actual measured space-time voxel between the avatar and an adjacent avatar, Functioning as a motion monitoring means for monitoring the motions of avatars participating in the event The program according to claim 5.

7. The avatar includes a performer avatar in an event held in the virtual space, The motion monitoring means compares the actual spatiotemporal voxels of the performer avatar with the predicted spatiotemporal voxels based on a plurality of motions ranked according to different motions related to the reward of the event, and determines whether the motion of the performer avatar corresponds to any one of the plurality of ranked motions. The program according to claim 6.

8. The encoding processing means: A first process of detecting moving object region data from the predetermined video data; a second process of performing a noise removal process on the moving object region data and dividing and classifying the moving object region data into at least five rectangular region data based on a binary tree algorithm; A third process is performed in which coordinate data of a predetermined boundary point of each rectangular region is extracted from the rectangular region data, and the coordinate data of the predetermined boundary points at a certain frame rate is arranged in a time series, character-coded, and converted into the motion-coded data. The program according to claim 1, claim 2, claim 3 or claim 4.

9. An information management system for managing or trading rights for avatars to use a virtual space, comprising: an encoding processing unit that encodes predetermined moving image data into character data and processes the data into motion-encoded data that is information arranged in a time series; an authentication token generator that generates an authentication token corresponding to the avatar based on the motion coding data; a hash value generation unit that generates a predetermined hash value from the motion encoded data by using a hash function; The authentication token generating unit generates the authentication token by combining predetermined symbol information, which is unique symbol information, with the predetermined hash value. Information management system.

10. An information management method for managing or trading rights of an avatar to use a virtual space, comprising: An encoding process step of encoding predetermined moving image data into character code and processing the encoded data into motion coded data which is information arranged in a time series; generating an authentication token corresponding to the avatar based on the motion coding data; a hash value generating step of generating a predetermined hash value from the motion encoded data using a hash function; The authentication token generating step generates the authentication token by combining predetermined symbol information, which is unique symbol information, with the predetermined hash value. Information management method.

Citation Information

Patent Citations

  • Image processing unit, image processing method, and control program

    JP2002271693A

  • Management method for virtual social system and virtual society providing device

    JP2008217255A

  • Management server, virtual space management method and program

    JP2011008774A

  • Action instructing program, action instructing method and image generation device

    JP2018073204A