3D model utilization device, control method and program for the 3D model utilization device

Abstract

This invention provides a 3D model utilization device that enables the appropriate use of objects corresponding to products such as books and CDs in a virtual space. [Solution] The 3D model utilization device comprises an acquisition means, a generation means, and a utilization means. The acquisition means acquires appearance information and genre information related to digital content corresponding to the product purchased by the user. The generation means generates a 3D model corresponding to the digital content based on the acquired appearance information and genre information. The utilization means uses the generated 3D model in the metaverse space.

Description

Technical Field

[0001] The present invention relates to a 3D model utilization device, a control method for the 3D model utilization device, and a program.

Background Art

[0002] There is a technology for associating an image with a predetermined item that can be used in a virtual space.

[0003] For example, Patent Document 1 describes associating a suitable image or the like with a predetermined item that can be used in a virtual space. The information processing system of Patent Document 1 includes a user input acquisition unit, an image acquisition unit, and an association processing unit. The user input acquisition unit acquires a predetermined input from the user. The image acquisition unit acquires a specific image obtained by inputting the predetermined input into a first machine learning model constructed by artificial intelligence using the first machine learning model. The association processing unit associates the specific image with a predetermined item that can be used in the virtual space.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

[31] ]

Summary of the Invention

Problems to be Solved by the Invention

[0005] When purchasing products such as books, CDs, and DVDs, there are users who want to use an object corresponding to the purchased book or the like in a virtual space such as a metaverse. However, a server or the like that realizes the virtual space cannot know the appearance or type of the product purchased by the user. As a result, the server or the like cannot appropriately use the object corresponding to the book or the like.

[0006] Furthermore, Patent Document 1 merely discloses a technique for associating images with items usable in a virtual space. Therefore, applying the technique disclosed in Patent Document 1 will not solve the above problem.

[0007] The primary objective of this invention is to provide a 3D model utilization device, a control method for the 3D model utilization device, and a program that contribute to the appropriate use of objects corresponding to products such as books and CDs in a virtual space. [Means for solving the problem]

[0008] According to a first aspect of the present invention, a 3D model utilization device is provided, comprising: an acquisition means for acquiring appearance information and genre information relating to digital content corresponding to a product purchased by a user; a generation means for generating a 3D model corresponding to the digital content based on the acquired appearance information and genre information; and a utilization means for utilizing the generated 3D model in a metaverse space.

[0009] A second aspect of the present invention provides a control method for a 3D model utilization device, which acquires appearance information and genre information relating to digital content corresponding to a product purchased by a user, generates a 3D model corresponding to the digital content based on the acquired appearance information and genre information, and utilizes the generated 3D model in a metaverse space.

[0010] A third aspect of the present invention is provided, which causes a computer mounted on a 3D model utilization device to perform the following processes: acquiring appearance information and genre information relating to digital content corresponding to a product purchased by a user; generating a 3D model corresponding to the digital content based on the acquired appearance information and genre information; and utilizing the generated 3D model in a metaverse space. [Effects of the Invention]

[0011] According to each aspect of the present invention, a 3D model utilization device, a control method for the 3D model utilization device, and a program are provided that contribute to making objects corresponding to products such as books and CDs appropriately available in a virtual space. However, the effects of the present invention are not limited to those described above. The present invention may produce other effects in lieu of or in conjunction with the effects described above. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a diagram illustrating the outline of one embodiment. [Figure 2] Figure 2 is a flowchart showing the operation of one embodiment. [Figure 3] Figure 3 shows an example of a schematic configuration of an information processing system according to the embodiment of this disclosure. [Figure 4] Figure 4 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 5] Figure 5 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 6] Figure 6 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 7] Figure 7 shows an example of the processing configuration of the integrated management server according to the embodiment of this disclosure. [Figure 8] Figure 8 shows an example of a user management database according to an embodiment of this disclosure. [Figure 9] Figure 9 shows an example of the display of a terminal according to the embodiment of this disclosure. [Figure 10] Figure 10 shows an example of the display of a terminal according to the embodiment of this disclosure. [Figure 11] Figure 11 shows an example of the processing configuration of an NFT management server according to an embodiment of this disclosure. [Figure 12] Figure 12 is a flowchart showing an example of the operation of the sales control unit according to the present disclosure. [Figure 13]FIG. 13 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 14] FIG. 14 is a diagram showing an example of the processing configuration of a metaverse server according to an embodiment of the present disclosure. [Figure 15] FIG. 15 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 16] FIG. 16 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 17] FIG. 17 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 18] FIG. 18 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 19] FIG. 19 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 20] FIG. 20 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 21] FIG. 21 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 22] FIG. 22 is a diagram showing an example of the display of a terminal according to an embodiment of the present disclosure. [Figure 23] FIG. 23 is a sequence diagram showing an example of the operation of an information processing system according to an embodiment of the present disclosure. [Figure 24] FIG. 24 is a diagram showing an example of the hardware configuration of an NFT management server according to the present disclosure. MODE FOR CARRYING OUT THE INVENTION

[0013] First, an overview of one embodiment will be described. The reference numerals in the drawings attached to this overview are provided for convenience as examples to aid understanding, and this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. The connecting lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows schematically indicate the flow of the main signal (data) and do not exclude bidirectional flow. In this specification and in the drawings, elements that can be similarly described are given the same reference numerals to avoid redundant explanation.

[0014] One embodiment of the 3D model utilization device 100 comprises an acquisition means 101, a generation means 102, and a utilization means 103 (see Figure 1). The acquisition means 101 acquires appearance information and genre information related to digital content corresponding to a product purchased by the user (step S1 in Figure 2). The generation means 102 generates a 3D model corresponding to the digital content based on the acquired appearance information and genre information (step S2). The utilization means 103 uses the generated 3D model in the metaverse space (step S3).

[0015] The 3D model utilization device 100 acquires information regarding the appearance and genre of a product when the user utilizes an object corresponding to a product such as a book or CD purchased by the user in the metaverse space. For example, the 3D model utilization device 100 acquires the appearance and genre information from a server that manages the intellectual property rights related to the product, such as a book. The 3D model utilization device 100 uses the acquired appearance and genre information to generate a 3D model (a 3D model for display in the metaverse space) corresponding to the book, etc. purchased by the user. The 3D model utilization device 100 then utilizes the generated 3D model in the metaverse space. At that time, the appearance and genre information includes appropriate appearances and genres set by the rights holders of the books, etc., so the object corresponding to the book, etc. will not be used with an appearance unintended by the rights holders. As a result, objects corresponding to products such as books and CDs are used appropriately in the virtual space.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] [First Embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0018] The information processing system according to the first embodiment issues NFTs (Non-Fungible Tokens) of digital content corresponding to products purchased by the user. For example, if a user purchases a figurine, an NFT is issued for the 3D data (3D model) of the figurine. Alternatively, if a user purchases a character in a game, an NFT is issued for the 3D model of the character.

[0019] [System Configuration] As shown in Figure 3, the information processing system according to the first embodiment includes a plurality of service servers 10-1 and 10-2, an integrated management server 20, a content management server 30, an NFT management server 40, a wallet server 50, and a metaverse server 60.

[0020] In the following explanation, unless there is a particular reason to distinguish between service servers 10-1 and 10-2, they will simply be referred to as "service server 10".

[0021] Users possess a device 70, such as a smartphone or HMD (Head Mounted Display). Users access various servers, etc., by operating the device 70.

[0022] Service server 10 is a server managed and operated by a service provider that provides various services to users.

[0023] Service server 10-1 provides an e-commerce (Electronic Commerce) site that sells physical goods such as figurines (digital figurines in games or virtual spaces), CDs, and DVDs. Alternatively, service server 10-1 may sell books and e-books.

[0024] Service server 10-2 provides, for example, an online game. Service server 10-2 (game server) not only controls the progress of the game but also sells characters (people) used in the game to users. Users can progress through the game using the characters they have purchased. In other words, service server 10-2 sells users the right to use characters in the game.

[0025] In the first embodiment, the configuration and operation of the information processing system will be explained using the example of a case where the service server 10-2 provides a 3D game. However, this does not mean that the games targeted by the information processing system are limited to 3D games. The games disclosed in this application include FPS (First Person Shooter), action games, fighting games, RPG (Role Playing Game), etc.

[0026] The integrated management server 20 is a server managed and operated by a platform provider that provides a platform for managing purchased goods across multiple service providers (service servers 10). The integrated management server 20 provides cross-platform management services (management services related to purchased goods, etc.) for at least one service server 10 for which a user has an account.

[0027] Furthermore, the term "product" in this application includes not only tangible objects such as figures, CDs, and DVDs, but also intangible objects such as characters used in games. In other words, the term "product" in this application includes not only tangible objects in the real world, but also characters and items in 3D space. In the example above, the right to use characters appearing in the game, sold by the game server, also falls under the category of "product." Services provided by service providers to users are also included in the definition of "product." Moreover, the term "product" in this application is not limited to items transferred for a fee, but also includes items transferred free of charge.

[0028] The integrated management server 20 is linked to accounts on each service server 10. Specifically, users can log in to accounts created on each service provider (service server 10) via the integrated management server 20. Users can then purchase products or play games on the service server 10 they are logged into.

[0029] The integrated management server 20 can obtain the user's activity history on the service server 10. More specifically, the integrated management server 20 can obtain purchase history of products, game play history, etc. Based on the purchase history of products purchased on the e-commerce site and the game play history of games played on the game server, the integrated management server 20 generates a list of the user's purchased products.

[0030] The content management server 30 is a server that controls and manages digital content such as figures, CDs, and DVDs sold to general consumers, as well as digital content such as characters sold to game users.

[0031] For example, a content management server 30 is a server managed and operated by an IP (Intellectual Property) holder such as a record company, a figure manufacturer, or a game manufacturer, which controls and manages its own IP (intellectual property rights).

[0032] The NFT management server 40 is a server managed and operated by a business that issues NFTs (Non-Fungible Tokens). The NFT management server 40 issues (generates) NFTs of digital content corresponding to products purchased by users from service providers (businesses that operate e-commerce sites or online games). The NFT management server 40 also functions as an NFT generation device that generates NFTs.

[0033] Furthermore, the NFT management server 40 implements a so-called marketplace. The NFT management server 40 facilitates the buying and selling of NFT-enabled digital content (digital assets) through the marketplace.

[0034] Wallet Server 50 is a server that provides wallet services for tokens such as NFTs and SBTs (SoulBound Tokens). Users can prove ownership of NFTs and SBTs by opening an account (wallet) with Wallet Server 50.

[0035] The metaverse server 60 is a server that provides a virtual space to users. The metaverse server 60 is a virtual space control device that controls the virtual space. Users access the metaverse server 60 using an HMD or similar device and engage in activities within the metaverse space provided by the metaverse server 60. The metaverse server 60 has the functionality of an NFT utilization device that uses NFT-converted digital content, and the functionality of a 3D model utilization device.

[0036] Each device shown in Figure 3 is connected to a network. Specifically, the service server 10, integrated management server 20, content management server 30, NFT management server 40, wallet server 50, metaverse server 60, and terminal 70 are connected to the network by wired or wireless communication means.

[0037] The configuration of the information processing system shown in Figure 3 is illustrative and not intended to limit the possible configurations. For example, the system may include multiple integrated management servers 20. Load balancing and redundancy may be achieved by using multiple integrated management servers 20.

[0038] [General operation] Next, we will describe the general operation of the information processing system according to the first embodiment.

[0039] <Create an account> Users create accounts with each service provider to purchase figures and other items, play online games, use integrated management services, use marketplaces, and enjoy wallet services.

[0040] Specifically, the user operates terminal 70 to access wallet server 50 and create an account (wallet). The user operates terminal 70 to create an account on an e-commerce site that sells the product they wish to purchase or on a game server for a game they wish to play. The user operates terminal 70 to create an account on integrated management server 20. The user operates terminal 70 to create an account (marketplace account) on NFT management server 40.

[0041] <Account Linking> Users configure their login information for each service server 10 on the integrated management server 20. For example, users configure their login information (ID, password) for logging into an e-commerce site and their login information for logging into a game server on the integrated management server 20.

[0042] Furthermore, the user sets their wallet address (the wallet address generated by the wallet server 50) on the service server 10, the integrated management server 20, the NFT management server 40, and the metaverse server 60, respectively.

[0043] Each server stores the user's wallet address along with their login information (ID, password, etc.).

[0044] <Purchase of Products> Here, we will explain the operation of the information processing system using the example of a user logging into an e-commerce site (service server 10-1) and purchasing a figurine.

[0045] To purchase a figure, the user logs into an account on the integrated management server 20 (step S01 in Figure 4). The integrated management server 20 displays a list of e-commerce sites on the terminal 70, allowing the user to select an e-commerce site.

[0046] The integrated management server 20 redirects the terminal 70 to the login page of the e-commerce site selected by the user (step S02). Specifically, the integrated management server 20 sends a URL (Uniform Resource Locator) to the terminal 70 for logging into the e-commerce site account selected by the user.

[0047] The URL sent to terminal 70 is a redirect URL for connecting terminal 70 to the login page of the e-commerce site, and the user's login information (ID, password) is embedded in this redirect URL.

[0048] When terminal 70 receives a redirect URL, it accesses the login page of the e-commerce site according to that URL. At that time, since the redirect URL contains login information, the e-commerce site (service server 10) obtains the user's login information and authenticates them.

[0049] Users purchase figures on the e-commerce site they are logged into.

[0050] The e-commerce site stores the purchase history of the products (figures) that users have purchased. Specifically, the e-commerce site (service server 10-1) stores information such as the product name, product code, price, purchase date, and manufacturer name of the products sold as the purchase history.

[0051] Furthermore, the person in charge of the e-commerce site obtains information such as the product name and product code from the product manufacturer, etc., and registers the obtained information on the service server 10.

[0052] The integrated management server 20 retrieves the purchase history of products purchased by users on e-commerce sites. For example, the integrated management server 20 periodically or at predetermined intervals accesses e-commerce sites where users have logged in and retrieves the purchase history of products purchased by users on those e-commerce sites.

[0053] For example, the integrated management server 20 retrieves the purchase history, which includes information about the purchased items (e.g., product name, product code, price, purchase date, manufacturer name, etc.) (step S03). The integrated management server 20 stores the user's purchase history in the user's account.

[0054] The integrated management server 20 acquires the user's game play history for items sold in the online game, and extracts the purchase history of items purchased by the user from that play history. The integrated management server 20 stores the extracted purchase history (character purchase history) in the user's account.

[0055] <Purchase of NFT content for purchased items> Users who purchase a product can purchase the corresponding digital content. For example, if a user purchases a figurine, they can purchase the 3D model (3D data) of that figurine. Or, if a user purchases a character for use in a game, they can purchase the 3D model of that character.

[0056] A 3D model is a three-dimensional graphic used in 3D games and metaverse spaces, representing three-dimensional shape data. A 3D model is 3D shape information such as a polygon model consisting of combinations of faces, edges, and vertices, or a sculpted model consisting of numerous polygons. A 3D model is data whose shape is variable; it allows for changes to the positional relationships and angles of objects, and changes to the surface texture of objects while maintaining their shape.

[0057] Alternatively, if a user purchases a CD or DVD, they can purchase the audio data of each song included on the CD or the video data of movies, etc., included on the DVD. Similarly, if a user purchases a book or e-book, they can purchase the digital book data containing the contents of that book.

[0058] Digital content corresponding to products purchased by users will be converted into NFTs. In the following explanation, NFT-converted digital content corresponding to products purchased by users will be referred to as "NFT content."

[0059] Users who wish to purchase NFT content log in to the integrated management server 20. The user requests the integrated management server 20 (platform operator) to issue a purchase certificate for the product corresponding to the NFT content they wish to purchase. Specifically, when the user performs a predetermined action (for example, pressing the purchase certificate issuance button), the integrated management server 20 displays a list of products that the user has already purchased on the terminal 70. The user selects the NFT content they wish to purchase from the displayed list of products.

[0060] When a user selects a product, the integrated management server 20 issues a purchase certificate for the product selected by the user. Specifically, the integrated management server 20 issues a product purchase certificate that includes information identifying the purchaser of the product and information about the product, with the platform operator as the issuer.

[0061] For example, the integrated management server 20 sets the wallet address as information to identify the purchaser of the product and issues a product purchase certificate that includes product name, product code, price, purchase date, manufacturer name, etc. as information about the product.

[0062] In the first embodiment, we will describe a case where the integrated management server 20 issues a product purchase certificate as an SBT (SoulBound Token).

[0063] First, the platform operator's representative generates a smart contract to issue a product purchase certificate as described above, and then deploys the generated smart contract to the blockchain.

[0064] When the integrated management server 20 needs to issue a product purchase certificate, it calls a function of the smart contract and inputs the information necessary to issue the product purchase certificate (wallet address, product information, platform operator ID, etc.).

[0065] When the smart contract is executed, the user's wallet (wallet address) is associated with the SBT issued as proof of purchase.

[0066] Thus, the integrated management server 20 issues an SBT as a product purchase certificate, with the platform operator as the issuer and the product purchaser as the owner (step S04).

[0067] By obtaining a product purchase certificate, users can purchase NFT content. In this case, the user logs in to the marketplace provided by the NFT management server 40 (step S11 in Figure 5).

[0068] When a user performs a predetermined action (for example, pressing the NFT content purchase button), the NFT management server 40 uses the user's wallet address to obtain a product purchase certificate from the user's wallet (step S12). The NFT management server 40 displays a list of products corresponding to the product purchase certificates owned by the user on the terminal 70.

[0069] The user selects the NFT content they wish to purchase from the displayed list of products.

[0070] When a user selects a product, the NFT management server 40 verifies the product purchase certificate corresponding to the product selected by the user. For example, the NFT management server 40 determines whether the issuer of the product purchase certificate is a predetermined issuer (determining whether the issuer is a trustworthy platform provider).

[0071] Upon successful verification of the product purchase certificate, the NFT management server 40 retrieves the digital content to be sold (digital content to be converted into an NFT) and its associated information from the content management server 30. Specifically, the NFT management server 40 retrieves the digital content and associated information from the content management server 30 of the IP holder of the product corresponding to the NFT content.

[0072] For example, if a user wishes to purchase NFT content corresponding to a figure they have purchased, the NFT management server 40 retrieves the digital content (3D model) related to that figure from the content management server 30 managed by the figure's manufacturer.

[0073] Alternatively, if a user wishes to purchase NFT content corresponding to a CD they have purchased, the NFT management server 40 retrieves the digital content (audio data) of that CD from the content management server 30 managed by the record company.

[0074] Alternatively, if a user wishes to purchase NFT content corresponding to a character used in the game, the NFT management server 40 retrieves the digital content (3D model) of that character from the content management server 30 managed by the game manufacturer.

[0075] Specifically, the NFT management server 40 sends information to the content management server 30 that identifies the product corresponding to the NFT content that the user wishes to purchase. For example, the NFT management server 40 sends a "content provision request" to the content management server 30 that includes product codes such as figures, CDs, and characters (step S13).

[0076] When the content management server 30 receives a content provision request, it sends the digital content corresponding to the product code included in the request and its associated information to the NFT management server 40 (step S14). For example, the content management server 30 sends a response to the NFT management server 40 that includes a 3D model such as a figurine or character and its associated information.

[0077] Examples of supplementary information for digital content include information referenced when using the digital content (e.g., 3D models or sound data) and information regarding restrictions on the use of the digital content. A more detailed explanation of supplementary information for digital content will be provided later.

[0078] Furthermore, figure manufacturers, record companies, game manufacturers, etc., register the product codes of the products they handle, digital content (for example, 3D models of characters, CD audio data, etc.), and related information in advance on the content management server 30. Manufacturers, etc., register the digital content and related information on the content management server 30 based on their own policies, etc.

[0079] Before or after acquiring the digital content, once the payment for the NFT content has been settled, the NFT management server 40 issues an NFT with the purchaser of the NFT content as the owner (step S15). Specifically, the NFT management server 40 uses a smart contract to issue (generate) an NFT with the purchaser as the owner and the NFT issuer as the issuer.

[0080] More specifically, the NFT management server 40 issues an NFT that includes metadata such as information about the underlying product of the NFT content (e.g., product name, product code, price, etc.) and a description of the NFT content (type of NFT content; e.g., 3D model).

[0081] When an NFT for NFT content is issued, the user's wallet (wallet address) is associated with the NFT of the NFT content. The NFT content (digital content) and its associated information are stored in the storage of the NFT management server 40. A link (URL) to access the storage location of the NFT content is written on the NFT itself.

[0082] Users can log in to the marketplace and view the NFT content (digital content) stored on the NFT management server 40.

[0083] <Using NFT content in the metaverse space> Users who purchase NFT content can use that NFT content in the metaverse space.

[0084] A user who wishes to use NFT content in the metaverse space logs in to the metaverse server 60 (step S21 in Figure 6). The user instructs the logged-in metaverse server 60 to retrieve the NFT content. In response to this instruction, the metaverse server 60 accesses the user's wallet and retrieves the NFT corresponding to the NFT content owned by the user (step S22).

[0085] When an NFT is acquired, the metaverse server 60 displays a list of information related to the NFT content corresponding to the acquired NFT on the terminal 70, allowing the user to select the NFT content (the NFT content they wish to use on the metaverse). For example, the metaverse server 60 displays a list of product names corresponding to the NFT content (e.g., figure names, CD titles, character names) on the terminal 70.

[0086] Subsequently, the metaverse server 60 accesses the NFT management server 40 and retrieves the NFT content corresponding to the NFT selected by the user (step S23). The user can then use the retrieved NFT content in the metaverse space.

[0087] For example, the metaverse server 60 obtains information from the user regarding how they intend to use the acquired NFT content. For instance, if a user owns NFT content of a figurine, they can display that figurine in their room in the metaverse. Alternatively, if a user owns NFT content of a CD, they can play the corresponding audio data in their room. Or, if a user owns NFT content of a game character, they can place that character in their room in the metaverse space.

[0088] In this process, the metaverse server 60 uses the accompanying information obtained along with the NFT content to utilize the NFT content (for example, a 3D model of a character used in a game) in the metaverse space. For example, the metaverse server 60 models the character in the metaverse space with the height specified by the game maker. Alternatively, the metaverse server 60 models the CD jacket obtained from the accompanying information in the metaverse space. Furthermore, if the usage of the NFT content is specified by the rights holder as accompanying information, the user can only use the NFT content in the specified usage form. For example, if the usage form of a 3D model of a character is specified as only for display in space, the user cannot use the 3D model as an avatar. For example, if the usage form of a 3D model of a weapon is specified as only for use as an accessory, the user cannot place the 3D model in space.

[0089] Next, we will describe the details of each device included in the information processing system according to the first embodiment.

[0090] [Integrated Management Server] Figure 7 shows an example of the processing configuration (processing module) of the integrated management server 20 according to the embodiment disclosed herein. Referring to Figure 7, the integrated management server 20 comprises a communication control unit 201, a user management unit 202, a purchase certificate control unit 203, and a storage unit 204.

[0091] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from terminal 70. The communication control unit 201 also transmits data to terminal 70. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data with other devices via the communication control unit 201. The communication control unit 201 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0092] The user management unit 202 is a means of controlling and managing users.

[0093] The user management unit 202 obtains information such as name, gender, date of birth, and login information (ID, password) from users who access a designated website (for example, a user registration site). Furthermore, the user management unit 202 obtains the user's wallet address and login information for logging into each service server 10 where the user created an account.

[0094] The user management unit 202 stores the acquired name, wallet address, login information for logging into the service server 10, etc., in the user management database (see Figure 8). The user management unit 202 stores the login information associated with the service server 10 (EC site, game server) for each user's account. Note that the user management database shown in Figure 8 is an example and is not intended to limit the items to be stored. For example, the user management database may also store the user's biometric information (e.g., facial image).

[0095] When a logged-in user wishes to purchase a product or play a game, the user management unit 202 displays a list of e-commerce sites and game servers that the user can log into on the terminal 70 that the user possesses. For example, the user management unit 202 displays a GUI (Graphical User Interface) as shown in Figure 9 on the terminal 70, allowing the user to select an e-commerce site or online game.

[0096] When a user selects an e-commerce site or online game to log in to, the user management unit 202 redirects the terminal 70 to the login page of the e-commerce site or online game selected by the user. At that time, the user management unit 202 sends a redirect URL to the terminal 70 that contains the login information of the user who has logged into their account (login information corresponding to the e-commerce site or online game being logged into).

[0097] The purchase certificate control unit 203 is a means for controlling the purchase certificate of a product purchased by a user. Specifically, the purchase certificate control unit 203 issues a purchase certificate of the product (e.g., a figurine, CD, or game character) as an SBT to a user who has purchased the product. More specifically, the purchase certificate control unit 203 uses the user's wallet address to issue an SBT to the user that proves the user has purchased the product.

[0098] The purchase certificate control unit 203 periodically or at predetermined intervals accesses each e-commerce site and game server (service server 10) where login information is registered in the user's account. The purchase certificate control unit 203 logs in to the e-commerce site, etc., using the login information corresponding to each e-commerce site and game server.

[0099] The purchase certificate control unit 203 retrieves the purchase history of products purchased by the user from the product purchase history page of the service server 10 to which the user has logged in. Alternatively, the purchase certificate control unit 203 retrieves the play history of games played by the user from the play history page of the service server 10 to which the user has logged in.

[0100] Alternatively, the purchase certificate control unit 203 may, while logged into the service server 10, obtain the user's purchase history and play history using an API (Application Programming Interface) or the like predetermined by the service provider.

[0101] When the purchase history of a product is obtained, the purchase certificate control unit 203 stores information about the product purchased by the user (e.g., product name, product code, price, purchase date, manufacturer name, etc.) and information about the e-commerce site where the product was purchased in the purchased product list field of the user management database.

[0102] Alternatively, when the game play history is obtained, the purchase certificate control unit 203 extracts the purchase history of products (for example, characters, weapons, accessories, items, skins (armor, clothing, underwear), etc.) from the history and stores the information of those products in the user management database.

[0103] If the acquired purchase history is already stored in the user management database, the purchase certificate control unit 203 may discard the acquired product purchase history or overwrite it with the corresponding purchase history.

[0104] When a user who has logged into their account requests the issuance of a purchase certificate, the purchase certificate control unit 203 displays a list of products that the user has purchased (products listed in the purchased product list) and identifies the product for which the user requests the purchase certificate. For example, the purchase certificate control unit 203 displays a GUI as shown in Figure 10 to identify the product for which the user requests the purchase certificate.

[0105] When a user identifies a product for which they wish to obtain a purchase certificate, the purchase certificate control unit 203 calls a function of a smart contract deployed on a node on the blockchain to issue a smart purchase certificate (SBT).

[0106] For example, the purchase certificate control unit 203 inputs the wallet address as the recipient's address for the SBT and the platform operator's wallet address as the issuer's ID for the SBT into the smart contract. Furthermore, the purchase certificate control unit 203 may input information about the product purchased by the user, such as the product name, product code, price, purchase date, and manufacturer's name, into the smart contract.

[0107] The smart contract uses this information to issue a Smart Trust (SBT) as a proof of purchase, with the purchaser of the goods as the owner and the platform operator as the issuer, and the SBT containing metadata about the purchased goods.

[0108] Furthermore, since the issuance of SBTs using smart contracts is contrary to the intent of this disclosure, a more detailed explanation will be omitted.

[0109] The memory unit 204 is a means for storing information necessary for the operation of the integrated management server 20. For example, the memory unit 204 stores the names of e-commerce sites and online games in association with the URLs of their login pages.

[0110] [NFT Management Server] Figure 11 is a diagram showing an example of the processing configuration (processing module) of the NFT management server 40 according to the embodiment disclosed herein. Referring to Figure 11, the NFT management server 40 comprises a communication control unit 301, a user management unit 302, a sales control unit 303, a provision control unit 304, and a storage unit 305.

[0111] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from terminal 70. The communication control unit 301 also transmits data to terminal 70. The communication control unit 301 passes the data received from other devices to other processing modules. The communication control unit 301 transmits the data acquired from other processing modules to other devices. In this way, other processing modules send and receive data with other devices via the communication control unit 301. The communication control unit 301 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0112] The user management unit 302 is a means of controlling and managing users.

[0113] The user management unit 302 obtains information such as name, gender, date of birth, and login information (ID, password) from users who access a designated website (for example, a user registration site). Furthermore, the user management unit 302 obtains the wallet address. The user management unit 302 stores the obtained name, login information, wallet address, etc. in a designated database.

[0114] The sales control unit 303 is a means for performing controls related to the sale of NFT content.

[0115] Figure 12 is a flowchart showing an example of the operation of the sales control unit 303 according to the embodiment disclosed herein. The operation of the sales control unit 303 will be explained with reference to Figure 12.

[0116] When a user who has logged into the marketplace wishes to purchase NFT content, the sales control unit 303 connects to the user's wallet using the user's wallet address. The sales control unit 303 obtains the Item Purchase Certificate (SBT) associated with the user's wallet (step S101).

[0117] The sales control unit 303 obtains information about the product purchased by the user (e.g., product name, product code, price, purchase date, manufacturer name, etc.) from the acquired product purchase certificate. Using the acquired product information, the sales control unit 303 identifies the product corresponding to the NFT content that the user wishes to purchase (step S102).

[0118] For example, the sales control unit 303 displays a GUI as shown in Figure 13 on the terminal 70 to identify the product corresponding to the NFT content that the user wishes to purchase. At that time, the sales control unit 303 may also present the price of the NFT content to the user, as shown in Figure 13.

[0119] The sales control unit 303 may obtain the price of the NFT content by querying the content management server 30. Alternatively, the price of the NFT content may be set to a price obtained by multiplying the price of the corresponding product by a predetermined coefficient.

[0120] Once the user has finished selecting the NFT content to purchase, the sales control unit 303 verifies the product purchase certificate corresponding to the NFT content selected by the user (step S103).

[0121] Specifically, the sales control unit 303 verifies the issuer of the product purchase certificate. For example, the sales control unit 303 determines whether the ID of the issuer of the product purchase certificate (e.g., the platform operator's wallet address) is pre-registered as the ID of the platform operator with whom the transaction is taking place.

[0122] If the issuer's ID is registered, the sales control unit 303 determines that the product purchase certificate corresponding to the NFT content the user wishes to purchase is legitimate (determines that the verification of the product purchase certificate was successful). If the issuer's ID is not registered, the sales control unit 303 determines that the product purchase certificate corresponding to the NFT content the user wishes to purchase is invalid (determines that the verification of the product purchase certificate failed).

[0123] If the product purchase certificate is invalid (step S104, No branch), the sales control unit 303 notifies the user that the NFT content cannot be sold (notification of non-sale; step S105).

[0124] If the product purchase certificate is valid (step S104, Yes branch), the sales control unit 303 obtains the digital content to be sold to the user and its associated information from the content management server 30. Specifically, the sales control unit 303 sends a content provision request, including the product code of the product corresponding to the digital content, to the content management server 30 of the manufacturer or game manufacturer listed on the product purchase certificate (step S106).

[0125] The sales control unit 303 identifies the content management server 30 to which the content provision request will be sent by referring to table information that stores the IP holder (manufacturer, game manufacturer) name and the information of the content management server 30 (e.g., address) in association with each other.

[0126] The sales control unit 303 receives responses (affirmative responses, negative responses) to content provision requests from the content management server 30.

[0127] If a negative response indicating that the digital content cannot be provided is received (step S107, No branch), the sales control unit 303 notifies the user that the NFT content cannot be sold (notification of unavailability; step S105).

[0128] If an affirmative response indicating that the digital content is available is received (step S107, Yes branch), the NFT content is sold to the user (step S108).

[0129] Users can pay for NFT content using cryptocurrencies such as Bitcoin or Ethereum. Alternatively, credit cards or electronic money may be used to pay for NFT content.

[0130] Furthermore, all or part of the payment for NFT content made by the user will be paid to the corresponding IP holder (manufacturer, game developer, etc.).

[0131] Once payment for the NFT content is completed, the sales control unit 303 issues an NFT for the NFT content (step S109). The sales control unit 303 issues an NFT for the digital content obtained from the content management server 30 using a smart contract.

[0132] Here, the platform operator's representatives create a smart contract in advance to issue NFTs for NFT content. These representatives then deploy the smart contract to the blockchain.

[0133] The sales control unit 303 issues NFTs of NFT content using a smart contract for NFT issuance.

[0134] The smart contract for issuing NFTs designates the purchaser of the NFT content as the owner and issues an NFT that includes information about the NFT content (e.g., the name of the corresponding product, the name of the manufacturer, etc.) as metadata. The NFT content and its associated information are stored in the storage of the NFT management server 40, which is accessible from the outside. When the smart contract for issuing NFTs is executed, a link to the storage where the NFT content is stored is written to the NFT.

[0135] Thus, the sales control unit 303 has functions as both an acquisition means and a generation means. The acquisition means acquires a 3D model and its associated information corresponding to the product purchased by the user. The associated information includes, for example, size information, which is reference information for the size of the product in the metaverse space. The generation means uses the acquired 3D model and associated information (e.g., size information) to generate (issue) an NFT (Non-Fungible Token) for the acquired 3D model. For example, the generation means manages the 3D model and associated information (size information) acquired from the content management server 30 so that it can be provided externally, and generates an NFT with the product purchaser as the owner.

[0136] Furthermore, the sales control unit 303 may generate an NFT for the 3D model obtained from the IP holder (content management server 30) using not only size information but also full-body information and appearance information, which will be described later.

[0137] The provision control unit 304 is a means for performing control over the provision of NFT content and its associated information. When an external server (e.g., a metaverse server 60) accesses the storage according to the link described in the NFT of the NFT content, the provision control unit 304 provides the NFT content and associated information stored in the storage to the external server.

[0138] In other words, the provision control unit 304 has the function of a means of utilization, which controls the 3D model from which the NFT has been generated so that it can be used in the metaverse space. The provision control unit 304 provides the 3D model from which the NFT has been generated and its associated information to the metaverse server 60 in response to a request from the metaverse server 60. The provided 3D model and its associated information (e.g., size information) are used by the metaverse server 60.

[0139] The memory unit 305 is a means for storing information necessary for the operation of the NFT management server 40.

[0140] The NFT management server 40 is equipped with a processing module for users to view NFT content they have purchased. A more detailed explanation of the processing module for users to view NFT content they have purchased is omitted.

[0141] [Metaverse Server] Figure 14 shows an example of the processing configuration (processing module) of a metaverse server 60 according to the embodiment disclosed herein. Referring to Figure 14, the metaverse server 60 comprises a communication control unit 401, a user management unit 402, a metaverse control unit 403, and a storage unit 404.

[0142] The communication control unit 401 is a means for controlling communication with other devices. For example, the communication control unit 401 receives data (packets) from terminal 70. The communication control unit 401 also transmits data to terminal 70. The communication control unit 401 passes data received from other devices to other processing modules. The communication control unit 401 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data with other devices via the communication control unit 401. The communication control unit 401 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0143] The User Management Unit 402 is a means of controlling and managing user-related matters.

[0144] The user management unit 402 obtains information such as name, gender, date of birth, and login information (ID, password) from users who access a designated website (for example, a user registration site). Furthermore, the user management unit 402 obtains the wallet address. The user management unit 302 stores the obtained name, login information, wallet address, etc. in a designated database.

[0145] The metaverse control unit 403 is a means for controlling the metaverse (virtual space). Specifically, the metaverse control unit 403 realizes a metaverse platform. The metaverse control unit 403 generates a user avatar and makes the generated avatar move according to the user's actions.

[0146] Furthermore, the metaverse control unit 403 performs control to enable users to utilize NFT content purchased by the user in the metaverse space (metaverse platform).

[0147] When a user who has logged into an account performs a predetermined action (for example, pressing the NFT content acquisition button), the metaverse control unit 403 acquires the NFT content owned by that user.

[0148] Specifically, the metaverse control unit 403 connects to the user's wallet using the user's wallet address. The sales control unit 303 retrieves the NFTs of each NFT content associated with the user's wallet.

[0149] When the metaverse control unit 403 acquires at least one NFT owned by the user, it uses the information obtained from the acquired NFT to display a list of NFT content owned by the user on the terminal 70. For example, the metaverse control unit 403 displays a GUI as shown in Figure 15 on the terminal 70, allowing the user to select the NFT content they wish to bring into the metaverse space.

[0150] When a user selects NFT content to bring into the metaverse space, the metaverse control unit 403 accesses the storage linked to the NFT corresponding to the NFT content acquired by the user, and retrieves the NFT content and associated information.

[0151] Upon acquiring NFT content and associated information, the metaverse control unit 403 utilizes the acquired NFT content and associated information in the metaverse space.

[0152] Specific examples of the use of NFT content will be described later.

[0153] Note that a detailed explanation of the realization of the metaverse space (metaverse platform) by the metaverse control unit 403 is omitted. This is because the realization of the metaverse space is obvious to those skilled in the art and is different from the gist of the present application disclosure.

[0154] The storage unit 404 is a means for storing information necessary for the operation of the metaverse server 60.

[0155] <Specific Example 1 of NFT Content Use> Subsequently, specific examples of the use of NFT content will be described. Here, the case where the user utilizes the character purchased in the 3D game in the metaverse space will be described.

[0156] Before and after acquiring the NFT content, the metaverse control unit 403 acquires from the user the usage method (usage form) of the NFT content selected by the user. For example, when the NFT content (3D model) corresponding to the character in the game is selected, the metaverse control unit 403 displays a GUI as shown in FIG. 16 on the terminal 70.

[0157] The metaverse control unit 403 presents options of usage forms corresponding to the type of NFT content selected by the user to the user. For example, when acquiring the NFT content (3D model) of the character, the metaverse control unit 403 presents options regarding the usage forms of the NFT content such as "decorate in the self-room" and "use as an avatar" to the user.

[0158] The metaverse control unit 403 utilizes the NFT content selected by the user on the metaverse according to the usage form selected by the user.

[0159] Specifically, the metaverse control unit 403 controls the use of 3D character models obtained from IP holders via the NFT management server 40 in the metaverse space. More specifically, the metaverse control unit 403 converts the NFT-converted 3D models so that they can be used in the metaverse space.

[0160] In this process, the metaverse control unit 403 utilizes the 3D model of the character in the metaverse space, using not only the character's 3D model but also information regarding the character's size when modeling it in the metaverse space (size information).

[0161] In other words, the metaverse control unit 403 obtains the NFT content (a 3D model of a character) and its associated size information from the IP holder of the NFT content.

[0162] Here, size information refers to the reference size of a character's 3D model in the metaverse space. For example, size information is set to a value that assumes the character exists in the real world. For instance, a humanoid character might have size information = 180cm, while a monster character might have size information = 3m.

[0163] In this way, the metaverse control unit 403 acquires 3D shape information of a character used in a 3D game (data for displaying the character in 3D) and size information regarding the size of the character when it is brought into the metaverse space.

[0164] When the user obtains the 3D shape information and size information of a character purchased in the game, the metaverse control unit 403 uses this 3D shape information and size information to utilize the NFT-converted content (3D model of the character) in the metaverse space.

[0165] For example, the metaverse control unit 403 converts the acquired 3D model of the character into a 3D model having the size specified by the size information. In the metaverse space, the user's height is often used as the avatar's height, so the metaverse control unit 403 can determine the size of the character to be brought into the metaverse space using the ratio of the user's height to the avatar's height (number of pixels), and then convert it into a 3D model for use in the metaverse space.

[0166] For example, if the user's height is 180cm and the character's size information is set to 180cm, the metaverse control unit 403 should convert the NFT-converted 3D model into a 3D model (a character used in the metaverse space) that is the same height as the user's avatar.

[0167] Once a 3D model for use in the metaverse space is obtained, the metaverse control unit 403 uses the 3D model in the usage mode specified by the user.

[0168] For example, as mentioned above, when a user displays a character purchased in a game in their room, the metaverse control unit 403 displays a screen on the terminal 70 as shown in Figure 17. In Figure 17, the user's room is shown, and the character 81 is placed in that room.

[0169] The metaverse control unit 403 may allow the user to move the character 81 placed in the room to any location they like. Alternatively, the metaverse control unit 403 may use the NFT content in a different form of use than the original form, depending on the user's operation (request), etc. For example, the metaverse control unit 403 may shrink a life-sized character and place the character in the room like a figurine in the real world.

[0170] As described above, the metaverse server 60 may use NFT content purchased by the user (for example, a 3D model of a character) as the user's avatar.

[0171] In this case, the metaverse control unit 403 generates an avatar having a height similar to that of the user using the 3D model purchased by the user. The metaverse control unit 403 uses the generated avatar (an avatar having the appearance of a character) as the user's avatar in the metaverse space.

[0172] Note that the metaverse server 60 can change the size of the NFT content (3D model) purchased by the user in the metaverse space. In this case, an IP holder such as a game company may use the restriction information regarding the change in the size as the attached information of the NFT content.

[0173] For example, the content management server 30 may transmit restriction information such as permitting the change in the size of the 3D model within the range of X times to Y times but not permitting the change in the size outside the range to the NFT management server 40 together with the 3D model.

[0174] The metaverse control unit 403 changes the size of the 3D model within the range permitted by the IP holder and uses the newly generated 3D model in the metaverse space. For example, the metaverse control unit 403 may place a character of the same size in the user's room according to the user's selection or operation, or place a character of 1 / 10 scale like a figure in the metaverse space.

[0175] As described above, when using the NFT content (for example, a 3D model of a figure or a character) in the metaverse space, the metaverse control unit 403 may change the size of the NFT content (it may be changed from the size determined by the IP holder). In this case, the metaverse control unit 403 may obtain the range in which the change in the size of the NFT content in the metaverse space is permitted. The metaverse control unit 403 may change the size of the NFT content within the range in which the change in the size is permitted.

[0176] <Specific Example 2 of NFT Content Use> The content management server 30 may provide full-body information and multiple appearance information as supplementary information associated with the 3D model to the metaverse server 60 via the NFT management server 40.

[0177] The full-body information of a 3D model includes, for example, information about the character's height and weight if the character were to exist in the real world. Alternatively, the full-body information may include all or part of the information regarding height (size information), weight, hairstyle (head), hair texture, face, clothing, UV (UV mapping), textures, shape keys, rigging, etc.

[0178] The appearance information of a 3D model includes information about the facial expressions and poses of the 3D model (e.g., a character). Information about a character's facial expressions includes the character's face when happy, angry, etc. Information about a character's pose includes information about the angles and positions of each part (arms, legs, etc.) of the character in each pose (e.g., raising hands, sitting). Thus, the accompanying information of a 3D model may include multiple appearance information corresponding to multiple facial expressions and multiple poses.

[0179] Alternatively, the accompanying information for a 3D model may include effect information. Character effect information refers to information displayed in the background of a character according to the character's emotions or situation. For example, background information corresponding to the character's state and emotions, such as when the character is angry, sad, or determined, may be included in the effect information.

[0180] The metaverse server 60 can use this accompanying information (full body information, appearance information, effect information) to make digital content (3D models of characters) available in the metaverse space. For example, the metaverse control unit 403 may further use the acquired full body information to convert NFT content (e.g., 3D models of figures or characters) into 3D models (NFT objects) for use in the metaverse space.

[0181] Alternatively, the metaverse control unit 403 may further use the acquired appearance information to generate an NFT object corresponding to the NFT content. Specifically, the metaverse control unit 403 determines the display state of the 3D model corresponding to the NFT content (3D model of the character) based on the full-body information and one of the appearance information pieces. This 3D model is then used in the metaverse space by the metaverse control unit 403.

[0182] Alternatively, the metaverse control unit 403 may use multiple appearance information to allow the user to change the pose or expression of the NFT content (e.g., a 3D model of a figure or character). Specifically, the metaverse control unit 403 may change the appearance of the 3D model (character) displayed in the metaverse space in response to the user's (user's avatar's) actions in the metaverse space. The metaverse control unit 403 may also deform the 3D model using multiple appearance information.

[0183] For example, the metaverse control unit 403 may use multiple appearance information (pose information) to enable the character to switch poses in the metaverse space like a movable figure. In this case, the metaverse control unit 403 may provide an interface that allows the user to grasp various parts of the character with their hands (user's avatar) and change them to their desired angle (pose).

[0184] For example, the metaverse control unit 403 may change the character's facial expression by modifying shape keys based on pose A.

[0185] Alternatively, the metaverse control unit 403 may randomly select one piece of appearance information (pose information) from among multiple pieces of appearance information and use that selected piece of appearance information to determine the display state of the 3D model (the 3D model of the character used in the metaverse space).

[0186] Furthermore, the accompanying information for NFT content may include only one set of appearance information. In such a situation, if a user wishes to use a character in the metaverse space with a different pose than the one set of appearance information, the user can obtain different appearance information by re-acquiring the NFT content of the same purchased product. In other words, a user who wishes to use a character in the metaverse space with different appearance information than the appearance information of an already issued NFT content can simply purchase the NFT again for the same product. In this case, the content management server 30 can send the NFT management server 40 with appearance information randomly selected from a pre-prepared set of appearance information. Thus, an element of lottery may be added to the appearance information accompanying NFT content. Alternatively, the content management server 30 may send specific appearance information to the NFT management server 40 according to the season (a specific season, period, time of day (daytime, nighttime), etc.).

[0187] Alternatively, each joint of the 3D model of the figure or character may be given a range of motion, and the metaverse control unit 403 may determine the pose of the figure or character by randomly determining an angle from within the range of motion for each joint.

[0188] Furthermore, IP holders such as figure manufacturers and game developers can pre-include information such as poses and facial expressions that can be set in the metaverse space as supplementary information to the digital content (3D model). For example, an IP holder may stipulate that their products cannot be modified with inappropriate combinations of 3D models.

[0189] For example, the IP holder may make it impossible to implement combinations of expressions and poses that would damage the character's image if cropped in a screenshot or similar. Alternatively, the IP holder (content management server 30) may provide information about possible expressions and poses as supplementary information.

[0190] <Specific Example 3 of NFT Content Usage> When the acquired NFT content is book data, audio source data, video data, etc., the metaverse control unit 403 may place an NFT object corresponding to the book data, etc. in the metaverse space.

[0191] In this case, the IP holder (content management server 30) that provides NFT content corresponding to books, CDs, DVDs, etc. may externally provide appearance information and genre information regarding the NFT content of the book, etc. as accompanying information.

[0192] Appearance information is information regarding the appearance (outer packaging) of the product that is the basis of the NFT content. Appearance information includes, for example, image data regarding the front cover or back cover of a book. Alternatively, appearance information includes image data regarding the jacket or back cover of a CD or DVD.

[0193] Genre information is information regarding the genre of the product that is the basis of the NFT content. For example, genre information indicates whether the product corresponding to the NFT content is a CD or a DVD. Alternatively, genre information indicates which of manga, general books, paperback books, etc. the product corresponding to the NFT content belongs to.

[0194] When the metaverse control unit 403 places the acquired NFT content (for example, digital content corresponding to books, CDs, DVDs, etc.) in its own room, it uses the acquired appearance information and genre information.

[0195] Specifically, the metaverse control unit 403 generates a new NFT object (3D model) to be used in the metaverse space based on the appearance information and genre information of the NFT content.

[0196] The metaverse control unit 403 selects a predetermined template (3D model template) according to the genre information. For example, the metaverse control unit 403 selects a template from among templates for manga, paperback books, CDs, and DVDs that matches the genre information.

[0197] The metaverse control unit 403 generates a 3D model corresponding to the NFT content that the user wishes to bring into the metaverse space by mapping the appearance information of the NFT content (image data of the cover, image data of the spine) to the selected template.

[0198] The metaverse control unit 403 utilizes the generated 3D models (3D models corresponding to books, CDs, DVDs, etc.) in the metaverse space. For example, as shown in Figure 18, the metaverse control unit 403 places a 3D model 85 corresponding to a book on the bookshelf 83.

[0199] Alternatively, the metaverse control unit 403 may arrange 3D models corresponding to CDs and DVDs in a CD rack or the like in a manner that allows the CD or DVD jackets to be visible to the user.

[0200] Furthermore, the appearance information may include multiple image data. In addition, the appearance information may include information (instructions) on how to handle each image data. For example, the appearance information may include information such as "Image data A = spine, Image data B = front cover."

[0201] Thus, the metaverse control unit 403 may have functions as an acquisition means, a generation means, and a utilization means. As an acquisition means, the metaverse control unit 403 acquires appearance information and genre information relating to the NFT-converted digital content that corresponds to the product purchased by the user. As a generation means, the metaverse control unit 403 generates a 3D model corresponding to the digital content based on the acquired appearance information and genre information. As a utilization means, the metaverse control unit 403 utilizes the generated 3D model in the metaverse space.

[0202] The metaverse control unit 403 may rearrange books (3D models corresponding to books, etc.) placed in the metaverse space in response to user (user's avatar) operations. For example, if the user performs an action to grab a book and the grabbed book is placed in another location or between other books, the metaverse control unit 403 may place the grabbed book (image data corresponding to the book) in another location or elsewhere.

[0203] Thus, the metaverse control unit 403 may arrange the generated 3D models in a predetermined area (for example, a bookshelf) according to instructions or requests from the user.

[0204] Alternatively, the metaverse control unit 403 may rearrange books, CDs, etc., according to a predetermined rule in response to user instructions or requests. For example, the metaverse control unit 403 may rearrange books, etc., in alphabetical order by book title, etc. Alternatively, the metaverse control unit 403 may rearrange books, etc., in order of purchase date of the product corresponding to the NFT content.

[0205] Alternatively, the metaverse control unit 403 may rearrange and arrange multiple 3D models based on at least one of the market price, transaction count, and sales figures of the NFT content. In this case, the metaverse control unit 403 may obtain the market price and sales figures of each NFT content by sending the token ID of the NFT content corresponding to each NFT object arranged on the bookshelf, etc., to the NFT management server 40. Alternatively, the NFT management server 40 may obtain the transaction count from the transaction history of the NFT corresponding to each NFT content.

[0206] Alternatively, the metaverse control unit 403 may present the user with the differences between NFT content owned by the user (for example, audio data corresponding to a CD) and similar NFT content owned by others. For example, the metaverse control unit 403 may present the user with the differences between a CD owned by the user (audio data corresponding to a purchased CD) and a CD owned by the user's friends or a well-known person.

[0207] Specifically, the metaverse control unit 403 presents the user with information (for example, the title of the work and the cover art) of CDs (audio data) owned by a person specified by the user but not owned by the user. In this case, the metaverse control unit 403 may also present the user with the market price of the NFT content (audio data) corresponding to the CDs that the user does not own.

[0208] Furthermore, if the NFT content is book data, audio data, video data, etc., the metaverse control unit 403 may make such book data, audio data, etc. viewable or playable in the metaverse space. In this case, when a user (user's avatar) touches a 3D model corresponding to a book or CD, the metaverse control unit 403 displays the corresponding book data on the display or plays the audio data from the speaker.

[0209] As described above, the metaverse server 60 acquires digital content corresponding to the products purchased by the user, appearance information regarding the appearance of the products, and genre information regarding the genre of the products. The metaverse server 60 generates a 3D model corresponding to the acquired digital content based on the acquired appearance information and genre information. The metaverse server 60 controls the acquired digital content to be available in the metaverse space using the generated 3D model.

[0210] <Specific Example 4 of NFT Content Use> The metaverse server 60 may make the NFT content available for use by a third party other than the owner of the NFT content. For example, the metaverse server 60 may control the content such that users other than the owner of the sound source data or video data can also view it.

[0211] For example, the metaverse control unit 403 may control the content such that the user (the user's avatar) and the user's friend (the friend's avatar) can view the NFT content together. For example, while a friend listed in the user's friend list is staying in the user's private room, the metaverse control unit 403 may control the content such that the friend can also view sound source data such as CDs and DVDs, and video data.

[0212] For example, as shown in FIG. 19, the metaverse control unit 403 may play the video data of a DVD selected by the user 87 on the display 91 placed in the room of the user 87 where the user 87 and his friend 89 are staying together.

[0213] IP holders such as CDs and DVDs may set information regarding the reproduction conditions of the NFT content corresponding to the CD etc. in the accompanying information of the NFT content. For example, the content management server 30 may set reproduction condition information regarding the conditions for permitting the reproduction of the NFT content in the accompanying information.

[0214] For example, the content management server 30 provides playback condition information, such as "viewable only by the owner," "viewable by the owner and one other person," or "no restrictions on who can view it," along with the NFT content.

[0215] When playback condition information for NFT content (audio data, video data) is obtained, the metaverse control unit 403 plays the NFT content according to the playback condition information. For example, if a friend of the owner (a second friend) enters the owner's room while NFT content set to "viewable by the owner and one other person" is playing, the metaverse control unit 403 stops playing the NFT content according to the playback condition information for that NFT content.

[0216] Alternatively, the metaverse control unit 403 may prohibit a second or subsequent friend from entering the owner's room while the NFT content is being played. That is, the metaverse control unit 403 may control the system so that a third person cannot enter the owner's room while the NFT content for which the above-mentioned playback condition information is set is being played.

[0217] Thus, the metaverse control unit 403 may acquire playback condition information regarding the playback conditions of NFT-converted sound source data or video data, and play back the NFT-converted sound source data or video data according to the acquired playback condition information.

[0218] The IP holder may allow only the owner of the NFT content to control the playback of the NFT content (e.g., play, pause, fast forward, etc. of video data), or may allow friends or others who are viewing the NFT content to do so. The content management server 30 may set playback permission information regarding the playback rights of the NFT content in the accompanying information of the NFT content.

[0219] For example, the content management server 30 provides external access to playback permission information along with the NFT content, such as "Only the owner can control playback" or "People other than the owner can also control playback."

[0220] The metaverse control unit 403 controls the playback of NFT content according to the playback permission information of the acquired NFT content. For example, the metaverse control unit 403 displays a video data operation panel on the display 91 shown in Figure 19. The metaverse control unit 403 determines whether the person (avatar) operating the operation panel is a person authorized by the IP holder to control the playback of the NFT content. The metaverse control unit 403 controls the playback of the NFT content according to the determination result.

[0221] Alternatively, the playback rights for NFT content may be set at the user's discretion. For example, the metaverse control unit 403 may grant playback rights for NFT content to certain friends (users who have been added as friends) and deny playback rights to other friends. This operation of the metaverse control unit 403 enables friends to simultaneously watch anime or dramas in the metaverse space.

[0222] The metaverse control unit 403 may control the user or their friends so that they can move the display 91, which is placed in the metaverse space (the user's room), to their preferred position.

[0223] The IP holder may set rental information regarding the lending and borrowing of NFT content as supplementary information. For example, the content management server 30 may provide rental information such as "no rental restrictions," "not available for rental," "rental permitted only once," "rental permitted only to friends," and "rental period is within one week" to external parties along with the NFT content.

[0224] The metaverse server 60 determines whether an NFT content can be rented based on rental information acquired along with the NFT content. The metaverse control unit 403 manages the lender, the number of times it can be borrowed, the loan period, etc. for each NFT content, and realizes the lending and borrowing of NFT content in accordance with the rental information.

[0225] Thus, the metaverse control unit 403 may acquire rental information regarding the lending and borrowing of NFT-converted sound source data or video data. The metaverse control unit 403 may determine whether a user can lend the NFT-converted sound source data or video data to a third party other than the user according to the acquired rental information.

[0226] Alternatively, the metaverse control unit 403 may notify the owner of the status of the lent NFT content. For example, when the lent NFT content is played, the metaverse control unit 403 may notify the owner to that effect.

[0227] In addition, when the owner of the NFT content lends out the NFT content, the metaverse control unit 403 may obtain consent from the user that the lending of the NFT content is for non-profit purposes. Similarly, when the owner of the NFT content and another third party watch the NFT content together, the metaverse control unit 403 may obtain consent from the user that the viewing (playing) of the NFT content is for non-profit purposes.

[0228] <Specific Example 5 of NFT Content Usage> The metaverse server 60 may automatically acquire digital content corresponding to products such as books, CDs, DVDs, etc.

[0229] In this case, when the integrated management server 20 acquires the purchase history of books, CDs, etc. from the service server 10-1 (EC site), it transmits a product purchase certificate including information about the purchased product and the wallet address of the purchaser, etc. to the metaverse server 60. The product purchase certificate does not have to be SBT-converted.

[0230] The metaverse control unit 403 of the metaverse server 60 identifies the product purchaser from the wallet address included in the received product purchase certificate. In addition, the metaverse control unit 403 identifies the IP holder of the product (e.g., books, CDs, etc.) purchased by the user based on the information about the purchased product included in the product purchase certificate.

[0231] Similar to the NFT management server 40, the metaverse control unit 403 sends a content provision request to the content management server 30 of the specified IP holder. The metaverse control unit 403 acquires digital content and accompanying information (appearance information, genre information) from the content management server 30.

[0232] When the metaverse control unit 403 acquires digital content and accompanying information, it uses this information in the metaverse space. For example, the metaverse control unit 403 generates a 3D model corresponding to a book or CD from the accompanying information and arranges the generated 3D model on the shelf or the like in the user's private room (my room).

[0233] Note that the metaverse control unit 403 may use the digital content (for example, arrange a 3D model of a book or the like on the shelf) after obtaining the consent of the user, or may automatically use the digital content.

[0234] When the content management server 30 of the IP holder receives a content provision request from the metaverse server 60, it may send only the accompanying information (appearance information, accompanying information) of the digital content to the metaverse server 60. The metaverse server 60 may arrange a 3D model corresponding to a book, CD, or the like in the user's private room using the received accompanying information.

[0235] <Specific Example 6 of NFT Content Use> The metaverse control unit 403 may control an object (NFT object) corresponding to the NFT content arranged in the metaverse space to be distinguishable from other objects. More specifically, the metaverse control unit 403 may明示 that the NFT object is an object permitted by the right holder of the digital content NFT -ified in a manner recognizable by the user.

[0236] For example, if an object within the user's field of view is an NFT object, the metaverse control unit 403 will display the above fact in the vicinity of the NFT object, either continuously or temporarily.

[0237] For example, in Figure 20, when a user (a user of the metaverse space, including users of NFT content) stares at button 93 for a predetermined time, the metaverse control unit 403 displays information about the corresponding NFT object (character 81).

[0238] For example, the metaverse control unit 403 displays a popup 95, as shown in Figure 21. In the popup 95, the metaverse control unit 403 displays, for example, that the NFT object is content approved by a legitimate IP holder.

[0239] Furthermore, the metaverse control unit 403 will erase the displayed popup 95 after a predetermined time has elapsed since its display. Here, the time the user stares at the button 93 shown in Figure 20 to display the popup 95, and the time the popup 95 is displayed, can be set by the user in the settings menu or similar.

[0240] Alternatively, when button 93 for displaying information about NFT content becomes active (when the user stares at button 93 for a predetermined time), the metaverse control unit 403 may remove the color from objects other than NFT objects and display them in monochrome. The metaverse control unit 403 may also indicate that an NFT object is an object recognized by the rights holder by removing the color from at least one object visible to the user that is not an NFT object.

[0241] Alternatively, when button 93 is activated, the metaverse control unit 403 may illuminate the corresponding NFT object. In the example in Figure 20, the metaverse control unit 403 may illuminate character 81. The metaverse control unit 403 may indicate that the NFT object is an object authorized by the rights holder by illuminating and displaying the NFT object.

[0242] Thus, the metaverse control unit 403 may have functions as an acquisition means and functions as a display means. As an acquisition means, the metaverse control unit 403 acquires NFT-converted digital content. As a display means, the metaverse control unit 403 displays an NFT object corresponding to the NFT-converted digital content in the metaverse space. At that time, the metaverse control unit 403 (display means) indicates in a manner recognizable by the user that the NFT object is an object authorized by the rights holder of the NFT-converted digital content.

[0243] Furthermore, the metaverse control unit 403 may also function as a detection means. As a detection means, the metaverse control unit 403 detects predetermined actions by the user in the metaverse space. For example, the metaverse control unit 403 detects whether the user has gazed at a predetermined object (button 93) for a predetermined time or longer. If the user has gazed at the predetermined object for a predetermined time or longer, the metaverse control unit 403 displays that the NFT object is an object recognized by the rights holder. For example, the metaverse control unit 403 displays a pop-up 95 for displaying information about the NFT-enabled digital content.

[0244] The metaverse control unit 403 may, in place of or in addition to the button 93, display a predetermined mark near the NFT object that certifies that the source of the NFT content is an official IP holder. The metaverse control unit 403 may also use the predetermined mark to indicate that the NFT object is an object recognized by the rights holder.

[0245] For example, the metaverse control unit 403 displays the official proof mark 97 near the character 81, as shown in Figure 22.

[0246] Note that button 93 and official certification mark 97, which are used to display pop-ups, will appear not only on characters but also on other NFT objects. For example, if NFT content is used in a user's avatar, button 93 and official certification mark 97 will appear near the user's avatar. Alternatively, if NFT content is used in an accessory worn by the user (avatar), button 93, etc., will appear near that accessory.

[0247] Thus, the metaverse control unit 403 may use an official certification mark to indicate that an object in the metaverse space is official NFT content generated based on a product purchase certificate that proves that an official product was purchased on an e-commerce site or the like. This official certification mark proves that the user actually owns the product corresponding to the NFT content.

[0248] In other words, content that is not backed by the purchase of a product may be illegally generated content. Therefore, when content is used in the metaverse space, it is important that users are informed that it has been approved by the IP holder that owns the intellectual property rights of the content. Against this backdrop, the metaverse control unit 403 controls the system so that users can see that the content being used in the metaverse space has been approved by the IP holder that owns the intellectual property rights of the NFT content.

[0249] The metaverse server 60 places objects corresponding to NFT-enabled digital content in the metaverse space. The metaverse server 60 displays in the metaverse space that the placed objects are authorized by the rights holder who owns the intellectual property rights to the corresponding product. Furthermore, when the metaverse server 60 detects a predetermined action by a user in the metaverse space, it displays in the metaverse space that the placed objects are authorized by the rights holder who owns the intellectual property rights to the corresponding product.

[0250] Furthermore, NFT-enabled content is digital content that corresponds to products purchased by users in the real world, and is digital content generated as a result of the user actually purchasing a product (service).

[0251] Furthermore, regarding the use of the metaverse space for products such as CDs, it was explained that this could involve arranging the CDs in a room or playing the corresponding audio data. However, the use of CDs is not limited to these forms; for example, the appearance of the CDs may be used as the design for clothing (e.g., T-shirts) or towels worn by the user's avatar. Alternatively, the appearance information of the CDs may be used, such as for acrylic stands.

[0252] [Service Server] A detailed explanation of the configuration and operation of service server 10 is omitted. Service server 10-1 only needs to store the purchase history of the product sold to the user. Alternatively, service server 10-2 only needs to store the user's game play history (including play history such as purchase history of characters and items).

[0253] [Wallet Server] A detailed explanation of the configuration and operation of the wallet server 50 is omitted. The wallet server 50 only needs to issue wallet addresses to users.

[0254] [Content Management Server] A detailed explanation of the configuration and operation of the content management server 30 is omitted. The content management server 30 stores the digital content and associated information of each product handled by the company, and transmits the digital content and associated information in accordance with requests from the NFT management server 40.

[0255] More specifically, if the digital content, etc., associated with the product code included in the content provision request does not exist, the content management server 30 sends a negative response to the NFT management server 40 indicating this. If the digital content, etc., associated with the product code included in the content provision request does exist, the content management server 30 sends an affirmative response to the NFT management server 40 indicating this, which includes the digital content and its associated information.

[0256] Furthermore, figure manufacturers and other companies register their product codes, digital content, and associated information with their products in the content management server 30 beforehand.

[0257] [Terminal] Examples of terminal 70 include mobile devices such as smartphones, HMDs, mobile phones, game consoles, and tablets, as well as computers (personal computers, laptops). Terminal 70 can be any device or equipment as long as it can receive user input and communicate with the integrated management server 20, etc. Furthermore, the configuration of terminal 70 is obvious to those skilled in the art, so a detailed explanation is omitted.

[0258] [System operation] Next, the operation of the information processing system according to the first embodiment will be described.

[0259] Figure 23 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment disclosed herein. The operation of the information processing system according to the first embodiment will be described with reference to Figure 23.

[0260] When a user requests the issuance of a product purchase certificate, the NFT management server 40 retrieves the product purchase certificate from the user's wallet (step S31).

[0261] Furthermore, the NFT management server 40 obtains the digital content and associated information of the product corresponding to the product purchase certificate that the user wishes to issue from the content management server 30, and issues an NFT corresponding to the obtained digital content (step S32).

[0262] When a user requests to use NFT content in the metaverse space, the metaverse server 60 obtains the NFT content and associated information from the NFT management server 40 (step S33).

[0263] The metaverse server 60 uses the acquired NFT content and associated information to make the NFT content available in the metaverse space (step S34).

[0264] Next, a modified example of the first embodiment will be described.

[0265] <Example 1> In the above embodiment, the operation of the information processing system was explained using a game as an example of a service provided using a 3D model. However, services using 3D models are not limited to games. For example, providing a metaverse space is also included in services using 3D models.

[0266] In other words, NFT content such as products purchased by a user in the metaverse space may be sold to the user. That is, the service server 10 may have the functions of the metaverse server 60, or the metaverse server 60 may have the functions of the service server 10.

[0267] More specifically, NFT content (3D models) of products purchased in the first metaverse space may be used in the second metaverse space.

[0268] In addition, the target of the content to be NFT-ized is not limited to characters in games or the metaverse, and may be items such as weapons used in games, or buildings that appear in the metaverse.

[0269] <Variant Example 2> NFT content (3D model) may be sold targeting characters obtained by a user through paid lottery draws (so-called gacha) within the game.

[0270] Alternatively, when the appearance of a character (so-called skin) is sold within the game, a 3D model of a character with the appearance of the sold skin may be sold as NFT content.

[0271] <Variant Example 3> The products corresponding to the NFT content that can be purchased by the user may be characters, items, etc. obtained by the user for free within the game. In this case, when the integrated management server 20 issues a product purchase certificate for the character, etc. obtained for free, it may request the user to pay a certificate issuance fee.

[0272] Alternatively, when the NFT management server 40 sells NFT content corresponding to characters, etc. obtained by the user for free, it may request the user to pay an NFT issuance fee.

[0273] Alternatively, for some characters, etc., NFT content may be sold (transferred) to the user completely for free. That is, the integrated management server 20 may not request the user to pay a certificate issuance fee for the product purchase certificate, and the NFT management server 40 may not request the user to pay an NFT issuance fee, and free NFT content may be sold to the user.

[0274] <Variant Example 4> Even without a request from the user, NFT content may be automatically distributed to the product purchaser for all or part of the purchased product. In other words, NFT content may be distributed to the user free of charge without the user having to request the integrated management server 20 to issue a product purchase certificate.

[0275] In this case, the metaverse server 60 may use NFT content purchased by the user and NFT content distributed free of charge in the metaverse space without distinction. If NFT content is distributed free of charge, the metaverse server 60 may periodically or at predetermined intervals access the user's wallet to determine whether or not newly distributed NFT content exists. If newly distributed NFT content exists, the metaverse server 60 may inquire with the user about the availability of such NFT content.

[0276] <Modification 5> To prevent the practice of creating and deleting accounts on the game server (so-called "reset marathon"), it may be possible to set a condition that players must have progressed through the game for a certain amount of time before purchasing NFT content such as game characters.

[0277] In this case, the integrated management server 20 retrieves the play history from the service server 10-2 (game server) and calculates the game's play time based on the retrieved play history. If the play time has not exceeded a predetermined time, the integrated management server 20 will not issue a purchase certificate for the corresponding game's characters, items, etc.

[0278] Furthermore, the integrated management server 20 may determine whether to issue a product purchase certificate based not on the total game play time, but on the play time during matches (battles) in the game, or the time spent actually controlling a character in the game. In other words, the issuance of product purchase certificates for characters appearing in the game may be determined based on the amount of time spent actively playing the game. This operation of the integrated management server 20 prevents so-called idle play that artificially inflates play time. In other words, the NFT management server 40 may determine whether to issue an NFT corresponding to a specific character based on the usage time (time spent by the user) of that character.

[0279] Alternatively, the integrated management server 20 may set the purchase requirements for NFT content (requirements for issuing a purchase certificate) as the story (completion of predetermined events), trophy completion (acquisition of titles, medals, etc.), or the player reaching a specific rank (level). Alternatively, the integrated management server 20 may set the purchase requirements for NFT content by combining multiple elements from among multiple elements such as play time, story progression, trophy completion, and player rank. Alternatively, the integrated management server 20 may issue an NFT corresponding to a specific character or weapon when the number of times a specific character is used, the number of times a weapon is used, the number of times a specific technique is used, the number of damages dealt, the number of kills, etc., reaches a predetermined threshold value.

[0280] <Variation 6> The NFT management server 40 may impose time restrictions on users' purchases of NFT content. For example, the NFT management server 40 may sell NFT content for all or some products only for a predetermined period after the purchase of the product.

[0281] For example, the NFT management server 40 may sell NFT content (corresponding 3D models of characters, etc.) to users for a limited period after they have purchased game characters or skins obtained through a paid lottery. For example, a restriction may be set that users can only purchase NFT content (3D models) within one month of the lottery being held.

[0282] In this case, the sales control unit 303 of the NFT management server 40 may refer to the sales date obtained from the product purchase certificate to determine whether or not the NFT content can be sold, or it may use dynamic NFTs or time-limited parameters to implement the above restrictions.

[0283] <Example 7> The NFT content available to users may change in accordance with changes in the underlying product of the NFT content. For example, if a character purchased by a user in a game grows as the game progresses, the user may be able to purchase the grown-up 3D model as NFT content, rather than the 3D model at the time of purchase.

[0284] For example, a user performs a predetermined operation (e.g., pressing the status update button) on the game server (service server 10-2) they are logged into. The game server updates the play history with this operation. At that time, the game server sets the product code and level (status) of the character updated to the latest state in the play history.

[0285] The integrated management server 20 retrieves play history from the game server. When the integrated management server 20 receives a request for the issuance of a product purchase certificate for a character whose "status has been updated" in the play history, it issues a product purchase certificate that includes the latest product code and level for the character.

[0286] When selling NFT content, the NFT management server 40 sends the character's product code and level (status) to the game maker's content management server 30. The content management server 30 sends a 3D model corresponding to the acquired product code and level back to the NFT management server 40. The NFT management server 40 then sells the 3D model corresponding to the character's latest state (level) to the user as NFT content.

[0287] <Differentiation Example 8> The metaverse server 60 may utilize NFT content in a two-dimensional manner rather than three-dimensionally. For example, the metaverse control unit 403 may convert a 3D model into photographic data (image data) using a photo mode or the like. Furthermore, after converting the 3D model into photographic data, the metaverse control unit 403 may further crop the photographic data into an arbitrary shape. The metaverse control unit 403 can obtain photographic data cropped into an arbitrary shape and use this cropped photographic data in the metaverse space. Furthermore, the metaverse control unit 403 may display the photographic data on the metaverse as an acrylic stand, holo spray, or the like. Alternatively, the metaverse control unit 403 may use the photographic data or the photographic data cropped into an arbitrary shape as an icon for a user account. Through such operation of the metaverse control unit 403, users can use images as icons whose copyright and other rights are officially clarified, rather than images that have been stolen.

[0288] <Modification 9> An IP holder may set whether or not to permit derivative works of their products with respect to digital content. For example, the content management server 30 sends information about derivative works along with the digital content to the NFT management server 40 as supplementary information. The metaverse server 60 obtains permission or denial for derivative works of NFT content (e.g., 3D models of figures or characters) acquired via the NFT management server 40.

[0289] The metaverse control unit 403 of the metaverse server 60 displays information related to secondary creation (secondary creation permission, secondary creation prohibition). For example, the metaverse control unit 403 displays information related to secondary creation in the pop-up 95 shown in FIG. 21.

[0290] Alternatively, the information related to secondary creation may be described in the product purchase certificate of the corresponding product. Specifically, an IP holder such as a figure manufacturer transmits information related to secondary creation to an EC site or the like together with information about its own product (for example, product name and product code). The EC site or the like stores the purchase history including the information related to the secondary creation.

[0291] When the integrated management server 20 acquires the purchase history including the information related to secondary creation, it issues a product purchase certificate (SBT) including the information related to the secondary creation.

[0292] The NFT management server 40 that sells NFT content issues an NFT in which the information related to secondary creation is described in the metadata if the information related to secondary creation is described in the product purchase certificate.

[0293] The metaverse server 60 may display the information related to secondary creation described in the NFT of the NFT content in the pop-up 95.

[0294] <Modified Example 10> The NFT content may be content generated by an operator other than the IP holder. For example, an operator licensed by the IP holder may generate NFT content. Further, when an operator licensed generates NFT content, information indicating that may be provided to the metaverse server 60 or the like together with the NFT content as accompanying information.

[0295] In this case, the metaverse control unit 403 of the metaverse server 60 may display a message to that effect (that the NFT content was generated by a licensed service provider) in a pop-up 95 or the like shown in Figure 21. That is, the metaverse server 60 may display the fact that the NFT content was generated by a licensed service provider in a manner that is visible to the user.

[0296] <Variation 11> An IP holder may set character tag information (attribute information) as supplementary information to the NFT content (3D model of the character). For example, an IP holder may set information such as the character's strength in battle (e.g., strength level) or information about the character's origin (e.g., game title) as tag information to the supplementary information of the NFT content. Alternatively, the supplementary information may include the number of times the character has been drawn in the social game (number of times the character's level cap has been exceeded (limit break count)), parameters (character color variations, personality, individual values, size (minimum value, maximum value), weight), or elements listed on the game's banner (e.g., number of kills per weapon, number of gameplays, number of kills, number of damage, etc.).

[0297] The metaverse control unit 403 of the metaverse server 60 may display this strength information and tag information related to origin in a way that is visible to the user. For example, the metaverse control unit 403 may display strength information, etc., in the popup 95 shown in Figure 21.

[0298] <Variation 12> The metaverse server 60 is fundamentally designed to display NFT content that is visible to the user (the user's avatar). In other words, the metaverse control unit 403 does not display NFT content that is beyond a wall in a way that is visible to the user. However, by changing the settings, the metaverse control unit 403 may display NFT content (for example, a 3D model of a character) that is beyond the wall in a way that makes its presence known to the user.

[0299] For example, the metaverse control unit 403 may display an NFT character that is behind a wall faintly (displaying it with an ambiguous boundary). Alternatively, the metaverse control unit 403 may display the NFT content faintly. Alternatively, the metaverse control unit 403 may display a shadow of the NFT content. Alternatively, the metaverse control unit 403 may highlight the NFT content through the wall in a conspicuous color such as red, yellow, or blue. In other words, the metaverse control unit 403 may emphasize the NFT content that is behind the wall to improve its visibility. Alternatively, the metaverse control unit 403 may make the NFT content stand out relatively by lowering the brightness and saturation of other objects other than the NFT content.

[0300] Alternatively, considering the case of a user with color blindness, the metaverse control unit 403 may be able to change the colors used for NFT content visible through a wall to more easily viewable colors. This change may be customizable by the user.

[0301] Alternatively, the metaverse control unit 403 may control the official certification mark so that it is visible through walls. In this case, the metaverse control unit 403 may change the size of the official certification mark according to the distance between the user and the NFT content. The user may understand the distance to the NFT content by the size of the official certification mark. That is, the official certification mark of NFT content located farther from the user will be displayed smaller, and the official certification mark of NFT content located closer to the user will be displayed larger.

[0302] <Example 13> In the above embodiment, the NFT management server 40 described a case where it converts the digital content of a product purchased by a user (for example, a figurine or character) into an NFT. That is, the NFT management server 40 issues an NFT of the digital content (for example, a 3D model) corresponding to the product purchased by the user.

[0303] However, the NFT management server 40 may issue an SBT corresponding to the digital content corresponding to the product purchased by the user, instead of an NFT. The NFT management server 40 may generate an SBT for the product purchased by the user (e.g., a figurine or character) instead of NFT-enabled content (e.g., a 3D model of a character). In other words, the digital content (3D model) purchased by the user may be prohibited from resale.

[0304] Alternatively, the NFT management server 40 may allow users to choose whether to convert the digital content of a purchased product into an NFT or into an SBT. In this case, the NFT management server 40 may set a price difference between the NFT-converted digital content and the SBT-converted digital content. For example, the NFT management server 40 may set the price of the NFT-converted digital content higher than the price of the SBT-converted digital content.

[0305] <Example 14> The metaverse server 60 may notify the IP holder, etc., if it discovers an object infringing intellectual property rights within the metaverse space. For example, the metaverse server 60 inputs an object in the metaverse space into a learning model and determines whether the object is similar to an existing character, etc. If the metaverse server 60 finds that an object used in the metaverse space is similar to an existing character, etc., it may notify the IP holder (content management server 30) of this fact. The IP holder investigates the notified object and takes appropriate action (for example, issuing a warning to the user) based on the investigation results.

[0306] <Example 15> In the above embodiment, the operation of the information processing system was described assuming that the service server 10 is a server that provides an e-commerce site or a game server. However, the service server 10 may also be a server that provides a video distribution service.

[0307] In this case, the 3D model of the streamer's avatar (a so-called VTuber) may be sold to viewers as NFT content. In this case, the purchase of the 3D model may be determined based on the streaming service's membership rank, or the 3D models that can be purchased may be restricted. For example, only users who have been subscribed to the highest rank for a certain period of time (e.g., 3 months) may be able to purchase NFT content corresponding to the streamer's avatar.

[0308] <Variation 16> In the above embodiment, the integrated management server 20 was described as obtaining product purchase history and game play history by logging into the service server 10, which is linked to the account. However, the integrated management server 20 may also obtain purchase history and play history from the service server 10 without linking accounts. For example, when a user purchases a product, the service server 10 sends information about the purchased product and the user's wallet address to the integrated management server 20. The integrated management server 20 can then identify the user using the received wallet address and store the purchase history in the identified user's account.

[0309] <Example 17> In the above embodiment, the case in which the integrated management server 20 issues a product purchase certificate in response to a request from a user was described. However, the integrated management server 20 may also issue a product purchase certificate in response to obtaining the product purchase history from the service server 10. That is, the purchase certificate control unit 203 of the integrated management server 20 may issue a product purchase certificate automatically.

[0310] <Variation 18> The NFT management server 40 may set a limit on the number of times NFT content can be purchased. Specifically, the NFT management server 40 may sell one NFT content per product.

[0311] In this case, the NFT management server 40 should set "NFT content sold" to the product purchase certificate corresponding to the product that sold the NFT content. The NFT management server 40 should then disable the sale of NFT content based on the product purchase certificate that has "NFT content sold" set to it.

[0312] <Modification Example 19> In the above embodiment, the case in which the integrated management server 20 issues a product purchase certificate as an SBT (Service-Based Purchase Certificate) was described. However, the integrated management server 20 may issue product purchase certificates in other formats.

[0313] Specifically, the purchase certificate control unit 203 of the integrated management server 20 may issue a digital certificate using a public key infrastructure (PKI) as a product purchase certificate. Alternatively, the purchase certificate control unit 203 may issue a verifiable credential certificate (VCs) whose contents can be verified online as a product purchase certificate.

[0314] When a digital certificate or credential certificate is issued as proof of purchase, the NFT management server 40 verifies the electronic signature attached to these certificates. If the electronic signature verification is successful, the NFT management server 40 issues an NFT of the NFT content.

[0315] Furthermore, if digital certificates or credential certificates issued via PKI are used as proof of purchase, these certificates may be managed by the user's wallet or by an account on the integrated management server 20 or the NFT management server 40.

[0316] When the integrated management server 20 manages the user's product purchase certificate, the NFT management server 40 requests the integrated management server 20 to provide the product purchase certificate. Specifically, the sales control unit 303 of the NFT management server 40 sends the user's wallet address to the integrated management server 20. The integrated management server 20 uses the wallet address to identify the user who wishes to purchase NFT content and sends the product purchase certificate stored in the account of the identified user to the NFT management server 40.

[0317] When the NFT management server 40 manages a user's product purchase certificate, the purchase certificate control unit 203 of the integrated management server 20 sends the issued product purchase certificate along with the user's wallet address to the NFT management server 40. The user management unit 202 of the NFT management server 40 identifies the user who received the product purchase certificate using the wallet address and stores the received product purchase certificate in the account of the identified user.

[0318] <Modification 20> The system configuration shown in Figure 3 is illustrative. For example, an integrated management server 20 operated by a platform provider may provide a wallet service. That is, the integrated management server 20 may also have the functionality of a wallet server 50.

[0319] Alternatively, the above embodiment described a case in which the NFT management server 40 issues NFTs of NFT content. However, the integrated management server 20 may issue NFTs of NFT content. That is, the integrated management server 20 may have the same functions as the NFT management server 40.

[0320] As described above, the metaverse server 60 according to the first embodiment acquires information regarding the size of a product, such as a figurine, purchased by a user, when it is brought into the metaverse space. For example, the metaverse server 60 acquires this size information from the content management server 30 of the IP holder that manages the intellectual property rights related to the figurine or other product. The metaverse server 60 uses the acquired size information to convert the 3D model corresponding to the figurine or other product into a 3D model for use in the metaverse space, and then uses the converted 3D model in the metaverse space. At that time, the size information is set to an appropriate size determined by the rights holder of the figurine or other product (the appropriate size of the figurine or other product in the metaverse space), so that the figurine or other product is not used at a size unintended by the rights holder. As a result, products such as figurines and characters used in games are used appropriately in the virtual space.

[0321] Furthermore, the metaverse server 60 retrieves NFT-enabled digital content (e.g., 3D models) corresponding to products such as figurines purchased by users from the IP holder. The metaverse server 60 displays objects corresponding to the retrieved digital content in the metaverse space. At that time, the metaverse server 60 clearly indicates that the objects displayed in the metaverse space are objects authorized by the rights holder of the NFT-enabled digital content. Through this operation of the metaverse server 60, rights holders who possess intellectual property rights to figurines and other products can monitor whether their product characters, etc., are being used illegally in the metaverse space. As a result, content corresponding to products such as figurines and characters used in games is prevented from being used illegally in the virtual space.

[0322] Furthermore, when a user brings purchased items such as books and CDs into the metaverse space, the metaverse server 60 obtains information about the appearance and genre of those items. For example, the metaverse server 60 obtains this appearance and genre information from the content management server 30, which manages the intellectual property rights related to the books and other items. The metaverse server 60 uses the obtained appearance and genre information to generate a 3D model corresponding to the books and other items purchased by the user. The metaverse server 60 then uses this generated 3D model in the metaverse space. At that time, the appearance and genre information is set to reflect the appropriate appearance and genre determined by the rights holder of the books and other items, so that the books and other items are not used with an appearance unintended by the rights holder. As a result, items such as books and CDs are used appropriately in the virtual space.

[0323] Next, we will describe the hardware of each device that makes up the information processing system. Figure 24 shows an example of the hardware configuration of the NFT management server 40.

[0324] The NFT management server 40 can be configured using an information processing device (a so-called computer), and has the configuration illustrated in Figure 24. For example, the NFT management server 40 includes a processor 311, memory 312, input / output interface 313, and communication interface 314, etc. The components such as the processor 311 are connected by an internal bus or the like and are configured to communicate with each other.

[0325] However, the configuration shown in Figure 24 is not intended to limit the hardware configuration of the NFT management server 40. The NFT management server 40 may include hardware not shown, and may not have an input / output interface 313 if necessary. Furthermore, the number of processors 311, etc., included in the NFT management server 40 is not limited to the example in Figure 24; for example, multiple processors 311 may be included in the NFT management server 40.

[0326] The processor 311 is a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or DSP (Digital Signal Processor). Alternatively, the processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). The processor 311 executes various programs, including an operating system (OS).

[0327] Memory 312 includes RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc. Memory 312 stores the OS program, application programs, and various data.

[0328] The input / output interface 313 is an interface for a display device or input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user input such as a keyboard or mouse.

[0329] The communication interface 314 is a circuit, module, etc., that communicates with other devices. For example, the communication interface 314 includes a NIC (Network Interface Card), etc.

[0330] The functions of the NFT management server 40 are realized by various processing modules. These processing modules are realized, for example, by the processor 311 executing a program stored in memory 312. The program can also be recorded on a computer-readable storage medium. The storage medium can be a non-transitory material such as semiconductor memory, hard disk, magnetic recording medium, or optical recording medium. In other words, the present invention can also be embodied as a computer program product. Furthermore, the program can be downloaded via a network or updated using the storage medium on which the program is stored. Moreover, the processing module may be realized by a semiconductor chip.

[0331] Furthermore, the service server 10, integrated management server 20, content management server 30, wallet server 50, and metaverse server 60 can also be configured using information processing devices, similar to the NFT management server 40. Since their basic hardware configurations are identical to those of the NFT management server 40, a detailed explanation is omitted.

[0332] The NFT management server 40, which is an information processing device, is equipped with a computer, and its functions can be realized by having the computer execute a program. Furthermore, the NFT management server 40 executes a control method for the NFT management server 40 using this program. Similarly, the integrated management server 20 is equipped with a computer, and its functions can be realized by having the computer execute a program. Furthermore, the integrated management server 20 executes a control method for the integrated management server 20 using this program.

[0333] [Differentiation] The configuration and operation of the information processing system described in the above embodiment are illustrative examples and are not intended to limit the system configuration.

[0334] In the above embodiment, the configuration and operation of the information processing system were explained using the case where NFT-enabled content is used in the metaverse space as an example. However, digital content used in the metaverse space does not have to be NFT-enabled. If a user has the authority to use a product in the metaverse space, the metaverse server 60 may use the digital content (3D model) corresponding to that product in the metaverse space. In this case, the metaverse server 60 may obtain a product purchase certificate from the user's wallet and request the content management server 30 to provide the digital content corresponding to the product code described in the product purchase certificate.

[0335] In the above embodiment, it was explained that the user logs in to the e-commerce site or game server via the integrated management server 20. However, the user may log in to the e-commerce site, etc., directly.

[0336] The above embodiment described a case where the integrated management server 20 issues a product purchase certificate. However, the e-commerce site or game server where the user purchased the product may also issue the product purchase certificate.

[0337] In the above embodiment, when a user wishes to purchase NFT content, the NFT management server 40 verifies the product purchase certificate corresponding to the product selected by the user. However, the NFT management server 40 may also perform prior verification for each of the multiple product purchase certificates owned by the user and display a list of products for which the user can purchase NFT content. That is, the NFT management server 40 may exclude NFT content that the user cannot purchase and enable the user to select NFT content (selection of NFT content to purchase) using a GUI similar to that shown in Figure 13.

[0338] In the above embodiment, the case in which the NFT management server 40 stores the main data (actual data) and associated information of the NFT content was described. However, the main data of the NFT content may also be stored in the IP holder's content management server 30 or in the integrated management server 20. Alternatively, the main data of the NFT content may be stored in the blockchain. Alternatively, the associated information of the NFT content may be described in the NFT's metadata.

[0339] The integrated management server 20 may manage the issuance status of product purchase certificates (purchase status of NFT content) for each user's account. By managing the issuance status of product purchase certificates for users, the integrated management server 20 may display products for which certificates have not yet been issued and products for which certificates have been issued in the GUI shown in Figure 10 in a way that allows users to distinguish between them. For example, the integrated management server 20 may display "Certificate Issued" near the product name (product name) for which a product purchase certificate has been issued. Alternatively, the integrated management server 20 may display the title of a product for which a product purchase certificate has not been issued in bold.

[0340] The integrated management server 20 may perform user authentication before issuing a product purchase certificate. For example, if the integrated management server 20 successfully performs biometric authentication of a user who wishes to issue a product purchase certificate, it may display a GUI as shown in Figure 10 on the terminal 70. In this case, the integrated management server 20 obtains the user's (account holder's) biometric information (e.g., facial image) when the user's account is created. When a user (a user logged into the account) wishes to issue a product purchase certificate, the integrated management server 20 obtains the user's biometric information via the terminal 70. For example, the integrated management server 20 instructs the user to take a selfie using the terminal 70. The terminal 70 transmits the obtained biometric information to the integrated management server 20. If the biometric information stored in the account and the biometric information obtained from the terminal 70 substantially match, the integrated management server 20 determines that it has successfully authenticated the user who wishes to issue a product purchase certificate. Upon successful authentication of the user who wishes to issue a product purchase certificate, the integrated management server 20 displays the GUI shown in Figure 10 on the terminal 70.

[0341] In the flowcharts (sequence diagrams) used in the above description, multiple processes (processes) are shown in order, but the execution order of the processes performed in the embodiment is not limited to the order in which they are shown. In the embodiment, the order of the illustrated processes can be changed to the extent that it does not impair the content, for example, by executing each process in parallel.

[0342] The embodiments described above are explained in detail to facilitate understanding of the disclosure, and it is not intended that all the configurations described above are necessary. Furthermore, when multiple embodiments are described, each embodiment may be used individually or in combination. For example, it is possible to replace parts of the configuration of one embodiment with those of another embodiment, or to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace parts of the configuration of one embodiment with those of another.

[0343] As described above, the industrial applicability of the present invention is clear, and it is particularly suitable for use in information processing systems that sell digital content corresponding to products purchased by users.

[0344] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0345] [Note 1] A means for acquiring appearance information and genre information related to digital content corresponding to products purchased by users, A generation means that generates a 3D model corresponding to the digital content based on the acquired appearance information and genre information, A means of utilizing the generated 3D model in the metaverse space, A 3D model utilization device equipped with the following features.

[0346] [Note 2] The aforementioned utilization means is a 3D model utilization device as described in Appendix 1, which arranges the generated 3D models in a predetermined area according to instructions from the user.

[0347] [Note 3] The aforementioned utilization means is a 3D model utilization device as described in Appendix 2, which arranges the plurality of generated 3D models in a line based on at least one of the market price, number of transactions, and number of sales of each of the aforementioned digital contents.

[0348] [Note 4] The means of use is a 3D model utilization device as described in Appendix 1, which enables a third party other than the user to use the digital content.

[0349] [Note 5] The product purchased by the aforementioned user is a CD or DVD, The aforementioned means of use is a 3D model utilization device as described in Appendix 1, which plays audio data or video data corresponding to the CD or DVD in the metaverse space.

[0350] [Note 6] The acquisition means acquires playback condition information relating to the playback conditions of the sound source data or video data, The aforementioned means of use is a 3D model utilization device as described in Appendix 5, which plays back the sound source data or video data in accordance with the acquired playback condition information.

[0351] [Note 7] The acquisition means acquires rental information relating to the lending and borrowing of the sound source data or video data, The aforementioned means of use is a 3D model utilization device as described in Appendix 5, which determines whether the user can lend the sound source data or video data to a third party other than the user, in accordance with the rental information obtained.

[0352] [Note 8] The aforementioned digital content is generated as an NFT (Non-Fungible Token) when the user purchases the corresponding product in the real world, and is a 3D model utilization device as described in any one of the appendices 1 to 7.

[0353] [Note 9] In a 3D model utilization device, We obtain appearance information and genre information related to the digital content corresponding to the product purchased by the user. Based on the acquired appearance information and genre information, a 3D model corresponding to the digital content is generated. A method for controlling a 3D model utilization device that uses the generated 3D model in a metaverse space.

[0354] [Note 10] The computer installed in the 3D model utilization device, A process for obtaining appearance information and genre information related to digital content corresponding to products purchased by the user, A process to generate a 3D model corresponding to the digital content based on the acquired appearance information and genre information, The process of using the generated 3D model in the metaverse space, A program to execute.

[0355] Furthermore, some or all of the configurations described in Appendices 2 to 8, which are dependent on Appendice 1 above, may also be dependent on Appendices 9 and 10 in the same way as those described in Appendices 2 to 8. Moreover, not limited to Appendices 1, 9 and 10, some or all of the configurations described as appendices may also be dependent on various hardware, software, various recording means for recording software, or systems, without departing from the embodiments described above.

[0356] Furthermore, each disclosure of the above-mentioned prior art documents cited herein is incorporated herein by reference. Although embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. That is, the present invention naturally includes the entire disclosure, including the claims, and various modifications and alterations that can be made by those skilled in the art in accordance with the technical idea. [Explanation of symbols]

[0357] 10 Service Servers 10-1 Service Server 10-2 Service Server 20. Integrated Management Server 30 Content Management Server 40 NFT Management Server 50 Wallet Servers 60 Metaverse Servers 70 devices 81 kHz 83 bookshelves 85 3D models 87 User 89 Friend 91 displays 93 buttons 95 Pop-up 97 Official certification mark 100 3D model utilization devices 101 Acquisition method 102 Generation means 103 Means of use 201 Communication Control Unit 202 User Management Department 203 Purchase Certificate Control Unit 204 Storage section 301 Communication Control Unit 302 User Management Department 303 Sales Control Department 304 Service Control Unit 305 Storage section 311 Processors 312 memory 313 Input / Output Interfaces 314 Communication Interface 401 Communication Control Unit 402 User Management Department 403 Metaverse Control Unit 404 Storage section

Claims

1. A means for acquiring appearance information and genre information related to digital content corresponding to products purchased by users, A generation means generates a 3D model corresponding to the digital content based on the acquired appearance information and genre information. A means for utilizing the generated 3D model in the metaverse space, A 3D model utilization device equipped with the following features.

2. The 3D model utilization device according to claim 1, wherein the utilization means arranges the generated 3D models in a predetermined area according to instructions from the user.

3. The 3D model utilization device according to claim 2, wherein the utilization means arranges the plurality of generated 3D models in a line based on at least one of the market price, number of transactions, and number of sales of each of the digital contents.

4. The 3D model utilization device according to claim 1, wherein the means of use allows a third party other than the user to use the digital content.

5. The product purchased by the user is a CD or DVD, The 3D model utilization device according to claim 1, wherein the utilization means plays back sound source data or video data corresponding to the CD or DVD in the metaverse space.

6. The acquisition means acquires playback condition information relating to the playback conditions of the sound source data or video data, The 3D model utilization device according to claim 5, wherein the utilization means plays back the sound source data or video data in accordance with the acquired playback condition information.

7. The acquisition means acquires rental information relating to the lending and borrowing of the sound source data or video data, The 3D model utilization device according to claim 5, wherein the utilization means determines, in accordance with the acquired rental information, whether the user can lend the sound source data or video data to a third party other than the user.

8. The 3D model utilization device according to any one of claims 1 to 7, wherein the digital content is generated as an NFT (Non-Fungible Token) when the user purchases the corresponding product in the real world.

9. In a 3D model utilization device, We obtain appearance information and genre information related to the digital content corresponding to the product purchased by the user. Based on the acquired appearance information and genre information, a 3D model corresponding to the digital content is generated. A method for controlling a 3D model utilization device that uses the generated 3D model in a metaverse space.

10. The computer installed in the 3D model utilization device, A process for obtaining appearance information and genre information related to digital content corresponding to products purchased by the user, A process to generate a 3D model corresponding to the digital content based on the acquired appearance information and genre information, The process of using the generated 3D model in the metaverse space, A program to execute.

Images