Information processing device, information processing method, and program

The information processing apparatus generates new content data by synchronizing and reproducing multiple pieces of user-owned content data, addressing the lack of such methods in existing technologies and ensuring creator rights are protected.

JP2024157738APending Publication Date: 2024-11-08CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023072276
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-26
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing methods do not enable the creation of new content data using a plurality of content data owned by a user as material data.

Method used

An information processing apparatus that includes a user information acquisition unit, a data acquisition unit, and a data generation means to generate output control data for rendering results of multiple content data as time-series signals, utilizing non-fungible tokens (NFTs) to manage ownership and rights in a blockchain system.

Benefits of technology

Enables the generation of new content data by synchronizing and reproducing multiple pieces of content data, while protecting the rights of the creators and providing users with a novel method to experience the content data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024157738000001_ABST
    Figure 2024157738000001_ABST
Patent Text Reader

Abstract

To generate new contents data by using, as raw material data, a plurality of pieces of contents data possessed by a user.SOLUTION: An information processing device according to the present disclosure acquires user information indicating a user, acquires a plurality of pieces of contents data with the user as a current owner on the basis of the user information, and generates output control data indicating a content for output-controls, as a time series signal, a rendering result of at least two pieces of contents data among the plurality of pieces of the contents-data.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to techniques for generating digital content data. [Background technology]

[0002] There is a blockchain technology that assigns a non-fungible token (hereinafter referred to as "NFT (Non-Fungible-Token)") to the data of digital content such as digital items in a virtual space or a computer game, or digital artwork. For example, a creator of digital content (hereinafter referred to simply as "content") can transfer the ownership of the content data to another person by assigning an NFT to the content data (hereinafter referred to as "content data") and transferring the content data to which the NFT has been assigned to the other person. On the other hand, a person who has acquired the ownership of the content data (hereinafter referred to as the "owner") can prove the ownership of the content data by the fact that the NFT has been assigned. In addition, the owner can, for example, use, appreciate, listen to, or watch the content that he or she owns. Patent Document 1 discloses a method of setting ownership rights to the data of a digital item, and a method of controlling the actions of a character in a game according to the ownership rights of multiple digital items. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] U.S. Pat. No. 1,114,8058 Summary of the Invention [Problem to be solved by the invention]

[0004] However, Patent Document 1 does not disclose a method for creating new content data by using multiple content data owned by a user as material data. [Means for solving the problem]

[0005] The information processing device according to the present disclosure includes a user information acquisition means for acquiring user information indicating a user, a data acquisition means for acquiring multiple content data of which the user is the current owner based on the user information, and a data generation means for generating output control data indicating the content of output control of the rendering results of at least two of the multiple content data as a time series signal. Effect of the Invention

[0006] According to the present disclosure, new content data can be generated by using multiple content data owned by a user as material data. [Brief description of the drawings]

[0007] [Figure 1] 1 is a block diagram showing an example of a configuration of an information processing system according to a first embodiment. [Diagram 2] 1 is a block diagram showing an example of a hardware configuration of a content control device according to a first embodiment. [Diagram 3] 4 is a sequence diagram showing an example of a processing flow of the information processing system according to the first embodiment. FIG. [Figure 4] FIG. 2 is a diagram illustrating an example of a data structure of a blockchain according to the first embodiment. [Diagram 5] 4 is a sequence diagram showing an example of a processing flow of the information processing system according to the first embodiment. FIG. [Figure 6] 4 is a sequence diagram showing an example of a processing flow of the information processing system according to the first embodiment. FIG. [Figure 7] FIG. 4 is a diagram showing an example of a purchase screen displayed by the content control device according to the first embodiment. [Figure 8] 4 is a sequence diagram showing an example of a processing flow of the information processing system according to the first embodiment. FIG. [Figure 9] FIG. 2 is a diagram showing an example of a viewing screen displayed by a content control device according to the first embodiment. [Figure 10] 4 is a sequence diagram showing an example of a processing flow of the information processing system according to the first embodiment. FIG. [Figure 11] FIG. 4 is a diagram showing an example of a generated screen displayed by the content control device according to the first embodiment. [Figure 12] FIG. 13 is a diagram showing an example of a viewing screen displayed by a content control device according to a third modification of the first embodiment. [Figure 13] FIG. 13 is a diagram showing an example of a generated screen displayed by a content control device according to a third modification of the first embodiment. [Figure 14] FIG. 11 is a diagram illustrating an example of a functional configuration of a content control device according to a second embodiment. [Figure 15] FIG. 11 is a sequence diagram showing an example of a processing flow of an information processing system according to the second embodiment. [Figure 16] FIG. 11 is a diagram showing an example of a generated screen displayed by a content control device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the disclosure according to the claims. Although the embodiments describe a plurality of features, not all of these features are essential to the disclosure, and the plurality of features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0009] [Embodiment 1] In the first embodiment, a form will be described in which output control data indicating the content of output control of rendering results of at least two of the multiple audio data as a time-series signal is generated based on multiple audio data, their owner information, and user information. The owner information is information indicating the owner of data (hereinafter referred to as "content data") of digital content (hereinafter referred to as "content") such as audio data. In the first embodiment, the owner information will be described as being set and managed in a non-fungible token (hereinafter referred to as "NFT (Non-Fungible Token)") in a blockchain. By utilizing NFT, it is possible to give the content data a unique value. An example of the format of NFT is a token standard called ERC-721 or ERC-1155. Note that the method of setting and managing the owner information is not limited to NFT.

[0010] The audio data is created using an existing tool, for example, and is represented in a well-known file format such as WAV (RIFF waveform Audio Format). Examples of audio data include, in the case of a music event such as a concert, vocal voice, musical instrument performance sound, or sound emitted by an audience, etc., which are collected and converted into data. In addition, in the case of sports, the audio data may be collected and converted into data from sounds emitted by players, balls, or audience. In addition, the audio data may be created using a synthesizer or sampler that does not involve sound collection. In the first embodiment, as an example, a user is assumed to own four pieces of audio data, which are collected and converted into data from vocal voice, guitar, bass, and drum performance sounds.

[0011] <System configuration> An information processing system according to embodiment 1 will be described with reference to the drawings. Fig. 1 is a block diagram showing an example of the configuration of the information processing system according to embodiment 1. The information processing system includes a database system 1, a block chain system 2, a content providing device 3, and a content control device 4.

[0012] The database system 1 stores and manages a plurality of content data such as audio data and metadata corresponding to each content data. Here, the content data is the audio data or image data itself, and the metadata is data associated with the content data. For example, the metadata includes information such as the date on which the content data was registered in the blockchain system 2, the date on which the content data was created, and the name of the creator of the audio data. When the content data is audio data, for example, the metadata includes information indicating the name of the performer or vocalist. The metadata also includes information indicating the sales status of the content data, such as whether the content data can be sold or the selling price. For example, the sales status is set to "unsellable" as an initial value, and the sales status information can be changed by the current owner of the content data (hereinafter referred to as the "current owner"). Note that by setting the sales status to be automatically changed to "unsellable" after a transfer transaction by buying and selling the content data between users, unintended transactions such as buying and selling or transfer of the content data can be suppressed.

[0013] In response to a request from the content providing device 3, the blockchain system 2 records information on new content data and information indicating the owner of the content data (owner information) in the blockchain system 2. Specifically, the blockchain system 2 records content identification information such as a content ID (identifier) ​​for identifying the content data, user identification information such as a user ID for identifying the user of the current owner, and an NFT to be assigned to the content data. When the content data information and the owner information are recorded in the blockchain system 2, NFTs are issued for the content data in a quantity determined by the creator of the content data. For example, if 500 NFTs are issued, a maximum of 500 users can own the content data. For example, in order to increase the asset value of the content data, the quantity of NFTs can be limited and the content data can be managed by a serial number or the like, thereby making the content data rare.

[0014] The content providing device 3 registers and stores content data in the database system 1, and acquires content data stored in the database system 1 from the database system 1. As shown in FIG. 1, for example, the content providing device 3 has a user management unit 130, a request receiving unit 131, a registration unit 132, a data acquisition unit 133, and a data transmission unit 134 as functional configurations. The user management unit 130 newly registers, edits, deletes, and manages user accounts for uniquely identifying users. Examples of information managed by the user management unit 130 include user IDs, user names, user roles, and account information for buying and selling content. Examples of the user roles include a seller who creates and sells content data, a user who uses content data, or a distributor who distributes content data.

[0015] The request receiving unit 131 receives various requests from the content control device 4, and distributes processing corresponding to the received request to the registration unit 132 or the data acquisition unit 133. For example, when the request from the content control device 4 is a request to register content data created by a user in the database system 1, the request receiving unit 131 transmits the registration request to the registration unit 132. When the registration unit 132 receives the registration request from the request receiving unit 131, the registration unit 132 transmits the content data and metadata corresponding to the content data to the database system 1, and stores them in the database system 1. When the request information is a purchase request for content data from the content control device 4 used by a user who wishes to purchase the content data, the request receiving unit 131 transmits a purchase request to the data acquisition unit 133. The data acquisition unit 133 acquires the content data and metadata corresponding to the purchase request received from the request receiving unit 131 from the database system 1, and transmits them to the data transmission unit 134. The data transmission unit 134 transmits information on the content data based on the content data and metadata received from the data acquisition unit 133 to the content control device 4 used by the user.

[0016] The content control device 4 provides the user with a GUI (Graphical User Interface) for registering and purchasing content data, controlling the viewing and the like of content included in the content data, and creating output control data. The user can use the GUI provided by the content control device 4 to, for example, view content included in content data owned by the user. As shown in Fig. 1, the content control device 4 has, as its functional configuration, a display control unit 140, a request transmission unit 141, a content acquisition unit 142, a user information acquisition unit 143, a control unit 144, a video generation unit 145, an audio generation unit 146, an audio output unit 147, and an import unit 148.

[0017] The request transmission unit 141 transmits various requests to the content providing device 3, such as new registration and management of a user account, and new registration, acquisition, and purchase of content data. The display control unit 140 controls the display of various screens, such as a viewing screen of the content included in the content data, a purchase screen of the content data, and a registration screen of the content data, on the display. The viewing screen includes an area for displaying an image that is a rendering result of the content data, and a GUI for controlling display or sound output, etc. The purchase screen includes an area for displaying a list of purchasable content data, and a GUI for selecting the content data to be purchased, etc. The registration screen includes a GUI for inputting information such as the location where the content data to be registered is held and the purchase price. Information input by the user on these screens is sent to the content providing device 3 by the request transmission unit 141 together with the corresponding request.

[0018] The content acquisition unit 142 acquires content data and metadata corresponding to the content data acquisition request from the data transmission unit 134 of the content providing device 3. The user information acquisition unit 143 acquires user information managed by the user management unit 130 of the content providing device 3 from the user management unit 130. The control unit 144 performs control for viewing and the like of content based on the owner information included in the metadata acquired by the content acquisition unit 142 and the user information acquired by the user information acquisition unit 143. For example, the control unit 144 transmits content data to the video generation unit 145 or the audio generation unit 146 in response to a selection operation by the user.

[0019] Specifically, when the content data is image data, the control unit 144 transmits the content data to the video generation unit 145, and when the content data is audio data, the control unit 144 transmits the content data to the audio generation unit 146. The control unit 144 also generates output control data in response to an editing operation by a user. Here, the output control data is content data indicating the content of output control of the rendering result of at least two of the plurality of content data acquired by the content acquisition unit 142 as a time-series signal. The content of the output control specifies the viewing method, listening method, viewing method, etc. of at least two of the plurality of content data acquired by the content acquisition unit 142 (hereinafter referred to as "material data"). The time-series signal is also a signal for audio output or display output of the rendering result of the material data.

[0020] Specifically, for example, when all of the material data is audio data, the output control data includes information that specifies how to listen to the material data. When all of the material data is image data, the output control data includes information that specifies how to view the material data, and when the material data includes audio data and image data, the output control data includes information that specifies how to view the material data. More specifically, the output control data is information for synchronously playing two or more content data constituting the material data and outputting them as one video or audio, or video with audio. The output control data is written in a markup language such as XML, and does not include any part or all of each content data constituting the material data. By providing such output control data to the viewer, the information processing system can provide the viewer with video or audio, etc. that is in line with the intention of the creator of the output control data, while protecting the rights of the creator of the content data constituting the material data.

[0021] The video generation unit 145 renders the content data as image data acquired by the content acquisition unit 142 based on a user operation, and generates a video as a rendering result. The generated video is transmitted from the video generation unit 145 to the display control unit 140. For example, the video generation unit 145 performs rendering based on the output control content indicated by the output control data, using material data and output control data corresponding to the material data. The display control unit 140 generates a viewing screen for the content based on the rendering result received from the video generation unit 145, and transmits a signal corresponding to the viewing screen to the display. The viewing screen corresponding to the signal is displayed on the display.

[0022] The sound generation unit 146 renders the content data as sound data acquired by the content acquisition unit 142 based on a user operation, and transmits the rendering result to the sound output unit 147. For example, the sound generation unit 146 performs rendering based on the output control content indicated by the output control data, using material data and output control data corresponding to the material data. The sound output unit 147 receives the rendering result, generates a sound signal, and outputs the generated sound signal to an audio output device such as a speaker to output sound waves.

[0023] The import unit 148 imports content data such as audio data or image data prepared in advance by the user, and transmits it to the control unit 144. The content data imported by the import unit 148 and the content data generated by the control unit 144 are stored in the database system 1 via the request transmission unit 141 and the content providing device 3. In addition, information indicating the owner of this content data (owner information) and content identification information, etc. are recorded in the block chain system 2 via the request transmission unit 141 and the content providing device 3.

[0024] The hardware configuration of the content control device 4 will be described with reference to FIG. 2. FIG. 2 is a block diagram showing an example of the hardware configuration of the content control device 4 according to the first embodiment. The content control device 4 includes a CPU 211, a ROM 212, a RAM 213, an auxiliary storage device 214, a display unit 215, an audio output unit 216, an operation unit 217, a communication I / F 218, and a bus 219. The CPU 211 realizes each function of the content control device 4 shown in FIG. 1 by controlling the entire content control device 4 using programs and data stored in the ROM 212 or the RAM 213. Note that the content control device 4 may include one or more dedicated hardware devices different from the CPU 411, and at least a part of the processing by the CPU 211 may be executed by the dedicated hardware devices. An example of the dedicated hardware device is an application specific integrated circuit (ASIC). The ROM 212 stores programs that do not require modification. The RAM 213 temporarily stores programs and data supplied from the ROM 212 or the auxiliary storage device 214, and data supplied from the outside via the communication I / F 218.

[0025] The auxiliary storage device 214 is, for example, a hard disk drive or the like, and stores various data such as image data or audio data. The display unit 215 is, for example, a display output device such as a liquid crystal display or an LED (light-emitting diode), and displays a GUI or the like for the user to operate the content control device 4. The audio output unit 216 is, for example, a sound output device such as a speaker or a headphone, and receives an audio signal and outputs a sound wave. The operation unit 217 is, for example, a keyboard, a mouse, a joystick, a touch panel, or the like, and inputs various instructions to the CPU 211 in response to an operation by the user. The CPU 211 operates as a display control unit that controls the display unit 215 and an operation control unit that controls the operation unit 217. The communication I / F 218 is used for communication with an external device. For example, when the content control device 4 is connected to an external device by wire, a communication cable is connected to the communication I / F 218. When the communication I / F 218 has a function of wireless communication with an external device, the communication I / F 218 is provided with an antenna.

[0026] The bus 219 connects each unit to transmit information. In the first embodiment, the display unit 215 and the operation unit 217 are assumed to exist inside the content control device 4, but at least one of the display unit 215 and the operation unit 217 may exist as a separate device outside the content control device 4. The hardware configurations of the database system 1, the block chain system 2, and the content providing device 3 are similar to that of the content control device 4, so description thereof will be omitted.

[0027] <System Operation> The operation of the information processing system will be described with reference to Figs. 3, 5, 6, 8, and 10. Fig. 3 is a sequence diagram showing an example of the process flow of the information processing system according to the first embodiment, and is a sequence diagram showing the process flow of the information processing system when registering content data in the database system 1. In the first embodiment, it is assumed that the account of the user who registers the content data is registered in advance, and Fig. 3 shows the process flow after the completion of the login process based on the input of the user ID and password by the user operation. In the following, it is assumed that the information of the user ID for which the login process has been completed is held by the user management unit 130 of the content providing device 3. In addition, it is assumed that the content data to be registered in the database system 1 is acquired in advance via the import unit 148 or generated by the control unit 144 and held in the content control device 4.

[0028] First, in S300, the request sending unit 141 of the content control device 4 sends a registration request for the content data to be registered, together with the content data to be registered and metadata corresponding to the content data, to the content providing device 3. The request receiving unit 131 of the content providing device 3 receives this. Note that the metadata includes information indicating the number of NFTs to be issued for the content data to be registered.

[0029] Next, in S301, the request receiving unit 131 of the content providing device 3 determines whether the content data and metadata to be registered received in S300 satisfy a predetermined condition. Specifically, for example, the request receiving unit 131 determines whether the metadata contains information indicating the data type and the number of NFTs to be issued, and if this information is included, determines that the predetermined condition is satisfied. The determination of whether the predetermined condition is satisfied is not limited to this.

[0030] For example, the request receiving unit 131 may determine whether or not data identical to the received content data to be registered has already been registered in the database system 1, and if not, determine that the predetermined condition is satisfied. In this case, for example, the request receiving unit 131 compares the hash value of the received content data to be registered with the hash value of the content data already registered in the database system 1. Specifically, if a hash value identical to the hash value of the received content data to be registered exists, the request receiving unit 131 determines that data identical to the received content data to be registered has already been registered in the database system 1. On the other hand, if a hash value identical to the hash value of the received content data to be registered does not exist, the request receiving unit 131 determines that data identical to the received content data to be registered has not yet been registered in the database system 1. The request receiving unit 131 may determine whether or not data identical to the content data to be registered has already been registered in the database system 1 based on an inference result by a trained model that infers whether or not it is a similar product. Hereinafter, it will be described assuming that it is determined that the predetermined condition is satisfied.

[0031] After S301, in S302, the registration unit 132 of the content providing device 3 transmits the content data and metadata determined to satisfy the conditions in S301 to the database system 1, and the database system 1 receives them. Next, in S303, the database system 1 registers the content data and metadata received in S302 in association with each other, and holds the content data and metadata in the database. When registering the content data and metadata, the database system 1 issues a content ID that can uniquely identify the content data. The content ID is a serial number or the like assigned to the content data, and is used when searching for or identifying the content data in the database system 1. In addition, the sales status of the content data is set to an initial value. By the processing of S303, the content data and metadata to be registered are registered in the database system 1.

[0032] Next, in S304, the database system 1 transmits the content ID corresponding to the content data to be registered, i.e., the content ID issued in S303, to the content providing device 3, and the data acquisition unit 133 of the content providing device 3 receives this. Next, in S305, the registration unit 132 of the content providing device 3 transmits information indicating the number of NFTs issued, which is included in the metadata received in S300, to the blockchain system 2, and the blockchain system 2 receives this. In addition, the registration unit 132 also transmits information on the user ID held in the content providing device 3 and information on the content ID corresponding to the content data to be registered to the blockchain system 2, and the blockchain system 2 receives this.

[0033] Next, in S306, the blockchain system 2 issues the number of NFTs to be issued for the content data based on the information on the number of NFTs to be issued received in S305, and records the transaction. The transaction includes at least the NFT, user ID information as owner information, and content ID information corresponding to the content data. In the first embodiment, the user ID of the user who performed the process of registering the content data is recorded as the initial value in the owner information of the transaction as the first owner. The process of S306 makes it possible to identify the owner of the content data registered in the database system 1. After S306, the information processing system ends the process of the sequence diagram shown in FIG. 3.

[0034] FIG. 4 is a diagram showing an example of a data structure of a blockchain according to the first embodiment. Each of blocks 400 and 401 indicates a block corresponding to each NFT issued in S306, and although not shown in FIG. 4, there are blocks equal to the number of NFTs received in S300. Each block (e.g., block 401) includes a hash value 410 of the previous block (e.g., block 400), a nonce value 420, and a transaction 430. The nonce value is used to generate a block. The transaction 430 holds information on one or more transactions. Specifically, the transaction 430 includes, as information indicating a transaction of content data, an NFT corresponding to the content data, a content ID, and information indicating the owner of the content data, such as a user ID (owner information). The transaction 430 also includes information such as an IP (Internet Protocol) address of the database system 1 for identifying the location of the content data.

[0035] The transaction may also include the user ID of the creator of the content data. By including the user ID of the creator of the content data in the transaction, the creator of the content data can be identified even if the owner changes due to a transaction such as buying and selling. Information regarding the smart contract (automatic contract execution for NFT purchasers) may be stored and registered in the blockchain system 2. For example, by describing the user ID of the creator and information indicating whether or not the right of pursuit has been exercised in the smart contract, it can be set up so that compensation is paid to the creator each time the content data is bought, sold, or used.

[0036] 5 is a sequence diagram showing an example of a process flow of the information processing system according to the first embodiment, and is a sequence diagram showing a process flow of the information processing system when setting the sales status of content data owned by a user. First, in S500, the request sending unit 141 of the content control device 4 sends an acquisition request for information on content data owned by the user to the content providing device 3, and the request receiving unit 131 of the content providing device 3 receives this. Note that the acquisition request does not need to request information on all content data owned by the user, and may request information on some of the multiple content data owned by the user, for example.

[0037] Next, in S501, the data acquisition unit 133 of the content providing device 3 transmits the user ID to the block chain system 2 and collates it with the owner information included in the transaction recorded in the block chain system 2. This identifies the content data owned by the user. At this time, the data acquisition unit 133 acquires the content ID as information of the identified content data.

[0038] Next, in S502, the data acquisition unit 133 of the content providing device 3 transmits the content ID acquired in S501 to the database system 1, and the database system 1 receives it. Next, the database system 1 transmits content data and metadata corresponding to the received content ID to the content providing device 3, and the data acquisition unit 133 of the content providing device 3 receives it.

[0039] Next, in S503, the data transmission unit 134 of the content providing device 3 transmits the image data indicating the metadata received in S502 to the content control device 4 as content data information, and the content acquisition unit 142 of the content control device 4 receives this. Note that, in the first embodiment, the data transmission unit 134 is described as transmitting image data indicating the metadata, but the data transmission unit 134 may transmit metadata or content data to the content control device 4 instead of the image data indicating the metadata.

[0040] Next, in S504, the display control unit 140 of the content control device 4 generates a sales status setting screen using the image data indicating the metadata received in S503, and displays this on the display unit 215. The user performs an operation to set the sales status of the content data using the setting screen displayed on the display unit 215. Next, in S505, the request sending unit 141 of the content control device 4 sends an update request for the sales status of the content data to the content providing device 3 based on a user operation, and the request receiving unit 131 of the content providing device 3 receives this.

[0041] Next, in S506, the request receiving unit 131 of the content providing device 3 determines whether or not the sales status update request received in S505 satisfies a predetermined condition. For example, the content providing device 3 holds information indicating conditions such as the minimum or maximum selling price of the content data, and the request receiving unit 131 determines whether or not the selling price information included in the sales status update request satisfies the above-mentioned condition. In the following, a description will be given assuming that the sales status update request is determined to satisfy the predetermined condition.

[0042] Next, in S507, the registration unit 132 of the content providing device 3 transmits the update request determined to satisfy the conditions in S506 to the database system 1, and the database system 1 receives it. Next, in S508, the database system 1 updates the sales status information of the content data based on the sales status update request received in S507. After S508, the information processing system ends the processing of the sequence diagram shown in Fig. 5. By executing the processing of this sequence diagram, the user can set the sales status of the content data that he or she owns.

[0043] 6 is a sequence diagram showing an example of a process flow of the information processing system according to the first embodiment, and is a sequence diagram showing a process flow of the information processing system when a user purchases content data. First, in S600, the request sending unit 141 of the content control device 4 sends a request to send information on purchasable content data to the content providing device 3, and the request receiving unit 131 of the content providing device 3 receives this. Note that the request to send information on the content data may include information indicating search conditions for the content data, such as the type or name of the content data.

[0044] Next, in S601, the request receiving unit 131 of the content providing device 3 checks the purchase conditions of the user managed by the user management unit 130 based on the user's account. For example, the content providing device 3 checks the user's purchase history and restricts some of the purchasable content data when the number of times content data has been purchased is two or less. Note that, in the first embodiment, it is described that the purchase conditions are set for each user's account in the user management unit 130, but setting the purchase conditions is not essential. For example, the purchase conditions do not need to be set, and the purchasable content data may be determined according to the user's activities using fan tokens or the like.

[0045] Next, in S602, the data acquisition unit 133 of the content providing device 3 includes the information on the purchase conditions confirmed in S601 in the transmission request received in S600, and then transmits the transmission request to the database system 1, which receives it. Next, in S603, the database system 1 identifies content data whose sales status is "available for sale." If the transmission request includes information indicating search conditions for content data, the database system 1 identifies content data that is available for sale and satisfies the search conditions. For example, if the name of a song is set as the search condition, audio data of the song with that name, or captured image data obtained by capturing an image of an artist performing the song with that name, are identified as content data that meets or is related to the search conditions.

[0046] Next, in S604, the database system 1 transmits the content data identified in S603 and metadata corresponding to the content data to the content providing device 3, and the data acquisition unit 133 of the content providing device 3 receives this. Next, in S605, the data transmission unit 134 of the content providing device 3 generates image data indicating the content data from the content data and metadata received in S604, and transmits this to the content control device 4, which receives it. The data transmission unit 134 may generate the image indicating the content data using both the content data and the metadata, or may generate the image using only one of them.

[0047] For example, when the content data is sound data and the metadata includes information on the creation date and selling price of the sound data, the data transmission unit 134 generates an icon indicating the sound data, and an image indicating the creation date and selling price as an image indicating the content data. Note that in the first embodiment, the data transmission unit 134 is described as transmitting image data indicating the content data to the content control device 4, but this is not limited thereto, and a numerical value such as a selling price may be transmitted in place of the image data. Also, for example, when the content data is sound data, the data transmission unit 134 may transmit the metadata including a part of the sound data. Similarly, when the content data is image data, the data transmission unit 134 may transmit the metadata including thumbnail data corresponding to the image data.

[0048] Next, in S606, the display control unit 140 of the content control device 4 generates a purchase screen for the content data using the image showing the purchasable content data received in S605, and displays this on the display unit 215. Note that, when a plurality of content data are purchasable, the display control unit 140 may generate a purchase screen that displays a list of the content data. Details of the purchase screen will be described later with reference to FIG. 7. Next, in S607, the request transmission unit 141 of the content control device 4 transmits a purchase request for the content data to the content providing device 3 based on a user operation, and the request reception unit 131 of the content providing device 3 receives this. Next, in S608, the request reception unit 131 determines whether or not a purchase of the content data has been established. For example, it is assumed that a purchase has been established when a purchase process from the user has been completed. An explanation of the purchase process will be omitted. In the following, it is assumed that a purchase of the content data has been established. Next, in S609, the registration unit 132 of the content providing device 3 transmits information on the content data for which a purchase has been established to the database system 1, and the database system 1 receives this information.

[0049] Next, in S610, the database system 1 sets the sales status of the content data for which a sale has been concluded to an initial value based on the information of the content data received in S609. Next, in S611, the registration unit 132 of the content providing device 3 transmits the user ID of the purchaser to the blockchain system 2, which receives it. Next, in S612, the blockchain system 2 adds the user ID received in S611 to the transaction information as information for identifying the current owner. After S612, the information processing system ends the processing of the sequence diagram shown in FIG. 6. By executing the processing of the sequence diagram, when the user purchases the content data, the sales status of the database system 1 is updated and a new transaction is recorded in the blockchain system 2.

[0050] FIG. 7 is a diagram showing an example of a purchase screen 700 for content data displayed by the content control device 4 according to the first embodiment. In the first embodiment, as an example, a mode in which content data is sold for each piece of content data will be described, but the present invention is not limited to this. Specifically, a plurality of content data may be sold collectively as one piece of content data. For example, the name of the registered content data (hereinafter referred to as "content name"), the registration date of the content data, and information on the data type of the content included in the content data are displayed on the purchase screen 700. Also, for example, if the content data is content data related to a specific sporting event or a music event such as a concert, information indicating the date of the event is displayed on the purchase screen 700.

[0051] If an NFT is attached to the content data, information on the total number of content data to be sold and the remaining number available for sale may be displayed on the purchase screen 700. The total number of content data to be sold is set based on the number of NFTs issued for the content data. When a user such as a viewer performs a user operation to select content data that he or she wishes to purchase on the purchase screen 700 and confirm the purchase, the control unit 144 transmits a purchase request and purchase information for the content data to the request transmission unit 141. In the following description, the purchase information is assumed to be the content ID of the content data that has been confirmed for purchase.

[0052] Icon 701 indicates that the data type of the content is audio data. Icon 702 indicates that metadata corresponding to the content data includes information indicating a position. Icon 710 indicates that the data type of the content is output control data. Here, the output control data is data indicating the content of output control of the rendering results of at least two pieces of content data as a time-series signal. Hereinafter, in the first embodiment, the output control data will be described as data indicating the content of output control of the rendering results of at least two pieces of audio data as a time-series signal.

[0053] For example, content data with the content name "Guitar" includes audio data of guitar performance from among the audio of a song. Similarly, content data with the content names "Bass", "Drums", and "Vocal" include audio data of bass performance, drum performance, and vocal performance from among the audio of a song. Furthermore, content data with the content name "Vocal Practice" includes information for synchronizing the rendering results of each of the content data with the content names "Guitar", "Bass", and "Drums" and controlling the output as a time-series signal.

[0054] For example, a user who owns content data with the content names "Guitar", "Bass", "Drums", and "Vocal Practice" can do the following. For example, by using the content data "Vocal Practice", the user can listen to audio that is synthesized by synchronizing the rendering results of the content data "Guitar", "Bass", and "Drums". This allows the user to, for example, practice singing while listening to this synthesized audio. The output control data will be described in detail later.

[0055] When a user performs a user operation to select an icon on the purchase screen 700, for example, the content control device 4 may output detailed information of the content data corresponding to the icon. For example, when an icon indicating that the data type is audio data is selected, the audio generation unit 146 of the content control device 4 renders a part or all of the audio data corresponding to the selected icon. An audio signal that is the rendering result is transmitted to the audio output unit 216 and is output as audio from the audio output unit 216 for a predetermined period, such as 20 seconds. Also, for example, when an icon indicating that the data type is output control data is selected, the content control device 4 renders a part or all of the corresponding audio data and outputs the above-mentioned synthesized audio from the audio output unit 216 for a predetermined period. By outputting the detailed information, the user can easily grasp the details of the content data being sold.

[0056] Although not shown in FIG. 7, the data type of the content included in the content data is not limited to audio data and output control data. For example, the content may be an image, a skeleton model showing the skeleton of an object, or data showing the three-dimensional shape of an object such as a polygon mesh. For example, the content may be virtual camera path information used when generating a virtual viewpoint image. The virtual camera path indicates the change over time of the position of the virtual viewpoint in the virtual space and the direction of the line of sight at the virtual viewpoint when generating a virtual viewpoint image. For example, the content included in the content data may be a background model showing the shape of the background in the virtual space where the object exists. Details of the virtual viewpoint image and the virtual camera path information will be described later.

[0057] For example, when an icon indicating that the data type is image data is selected, the video generation unit 145 of the content control device 4 renders the image data and displays an image resulting from the rendering on the display unit 215. Also, when an icon indicating that the data type is three-dimensional shape data is selected, the video generation unit 145 displays an image of the shape of an object indicated by the three-dimensional shape data on the display unit 215. The aspects using these content data will be described later.

[0058] 8 is a sequence diagram showing an example of a processing flow of the information processing system according to the first embodiment, and is a sequence diagram showing a processing flow of the information processing system when a user listens to, watches, or watches content included in content data owned by the user. First, in the information processing system, processing similar to the processing from S500 to S503 shown in the sequence diagram of FIG. 5 is executed. After S503, in S801, the display control unit 140 of the content control device 4 generates a viewing screen for viewing or the like of the content data owned by the user using the image data indicating the metadata received in S503, and causes the display unit 215 to display this.

[0059] 9 is a diagram showing an example of a viewing screen 900 of content data displayed by the content control device 4 according to embodiment 1. A user can use the viewing screen 900 to perform control for listening to, viewing, or watching content included in the content data owned by the user. The viewing screen 900 includes an image display area 901, a content selection GUI 902, and a content playback GUI 903.

[0060] The content selection GUI 902 includes an area 910 that displays the content name, and icons 911 and 912. The icon 911 indicates the data type of the content data, and also serves as a button for controlling whether or not to render the content data. The icon 912 indicates that metadata corresponding to the content data includes information indicating a position, and also serves as a button for controlling whether or not to use the position information when rendering the content data. The content playback GUI 903 includes a button 915 that controls the display output or audio output of the content included in the content data, and a seek bar 916 that controls the rendering position of the content data (hereinafter referred to as "playback time").

[0061] After S801, in S802, the user performs a user operation to select content data to be used for listening or the like, and the control unit 144 of the content control device 4 specifies the content data to be used for listening or the like based on the user operation. The user can control the start, end, pause, etc. of display output or audio output by performing a user operation on the button 915. When the user operation on the button 915 is performed, in S803, the video generation unit 145 or audio generation unit 146 of the content control device 4 controls the rendering of the content data specified in S802 based on the user operation, and controls the display output or audio output. Specifically, for example, when a user operation to start playback (output) is performed on the button 915 with content data with a content name of "Vocal" selected, the audio generation unit 146 renders the content data. An audio signal that is the rendering result is transmitted to the audio output unit 216 and output as audio.

[0062] Furthermore, when content data having a content name of "Vocal Practice" is selected as output control data and a user operates button 915 to start playback (output), the content control device 4 performs the following process. The sound generation unit 146 of the content control device 4 renders each piece of content data as sound data having content names of, for example, "Guitar", "Bass", and "Drams" based on the output control data. Furthermore, the content control device 4 generates a composite sound signal by synchronizing and synthesizing sound signals that are the rendering results of each piece of content data based on the output control data. The composite sound signal is transmitted to the audio output unit 216 and output as sound.

[0063] The output control data may include information on the position at which the sound corresponding to the synthetic sound signal is listened to (hereinafter referred to as the "listening position"). For example, if the metadata of each piece of sound data on which the synthetic sound signal is based includes information on the position at which each sound was picked up (hereinafter referred to as the "sound pickup position"), the content control device 4 may generate a synthetic sound signal, for example, as follows. In this case, the content control device 4 generates a synthetic sound signal at the listening position, taking into consideration sound delay due to the propagation of sound waves from the sound pickup position to the listening position, or attenuation of sound waves due to this propagation, etc. The method of generating such a synthetic sound signal at a listening position is well known, so a detailed description will be omitted.

[0064] By executing the process of the sequence diagram shown in FIG. 8, the user can select content data that he / she owns and listen to the selected content data. Furthermore, by using the information on the sound collection position and the listening position, the user can listen to more realistic sound. Note that, if the content data selected by the user in S802 is image data, skeletal model data, three-dimensional shape data, virtual camera path information, or the like, a rendering result based on the content data is displayed as an image in the image display area 901. That is, by executing the process of the sequence diagram shown in FIG. 8, the user can select content data that he / she owns and watch or listen to the selected content data.

[0065] Fig. 10 is a sequence diagram showing an example of a process flow of the information processing system according to the first embodiment, and is a sequence diagram showing a process flow of the information processing system when generating output control data. First, in the information processing system, the same process as the process from S500 to S503 shown in the sequence diagram of Fig. 5 is executed. After S503, in S1001, the display control unit 140 of the content control device 4 generates a generation screen for generating output control data using the image data indicating the metadata received in S503, and displays this on the display unit 215. For example, the content data owned by the user is displayed in a list on the generation screen generated in S1001.

[0066] 11 is a diagram showing an example of a generation screen 1100 displayed by the content control device 4 according to the first embodiment. The user can use the generation screen 1100 to edit the output control data based on the content data owned by the user. The generation screen 1100 includes an image display area 1101, a content selection GUI 1102, and an edit button 1103. The content selection GUI 1102 includes an area 1110 for displaying a content name, a button 1111 for selecting content data to be used when editing the output control data, and a button 1112 for controlling whether or not to use position information when editing the output control data.

[0067] After S1001, in S1002, the user performs a user operation to select content data to be used when editing the output control data, and the control unit 144 of the content control device 4 specifies the selected content data based on the user operation. The user can display an editing screen for the output control data (not shown) by performing a user operation on the edit button 1103. When the user performs a user operation on the edit button 1103, in S1003, the display control unit 140 of the content control device 4 generates an editing screen for the output control data and displays it on the display unit 215. Here, the editing screen (not shown) has, for example, a GUI similar to that of a general music editing software application, and for example, the editing screen displays signals of each piece of audio data as material data as signals of a track. The user uses the editing screen to perform editing to synchronize the signals of each piece of audio data. Note that editing to synchronize the signals includes, for example, settings of the delay period, tempo, volume, audio synthesis ratio, or listening position of each signal.

[0068] When a save button or a complete button is pressed by a user operation on an editing screen (not shown), in S1004, the control unit 144 of the content control device 4 generates output control data corresponding to the editing content at the time of pressing. The output control data includes information (content ID) for identifying material data. The output control data may also include synchronization information such as a delay period and tempo for synchronizing each rendering result with each other. If the material data includes audio data, the output control data may include synthesis information such as a volume level of audio corresponding to each audio data included in the material data, or a synthesis ratio of each audio when synthesizing a plurality of audio. The output control data may also include information indicating a listening position. For example, the control unit 144 generates output control data in which the information to be described is written in a markup language. Note that the markup language is merely an example, and the output control data is not limited to data written in a markup language.

[0069] As described above, according to the content control device 4, the user can use a plurality of content data owned by the user as material data to generate output control data as new content data. Note that, in the above description, the output control data is generated based on the editing operation of the user using an editing screen (not shown), but the method of generating the output control data is not limited to this. For example, the control unit 144 may generate the output control data by inputting a plurality of acoustic data, which are material data, into a trained model created in advance by machine learning or the like, and acquiring the output control data output by the trained model.

[0070] After S1004, the generated output control data is registered in the database system 1 by performing the process of the sequence diagram shown in Fig. 3 as the content data to be registered. Furthermore, the sales status of the output control data is set in the blockchain system 2 by performing the process of the sequence diagram shown in Fig. 5. As a result, the output control data is made public in a transferable state to viewers including the owner of the material data.

[0071] If a viewer has ownership of the output control data and the material data corresponding to the output control data, the viewer can perform audio output or display output based on the output control data. Here, output control data is generated that does not include part or all of the content data that constitutes the material data. This makes it possible to provide the viewer with a new method of playing back content data based on the material data while protecting the rights, such as copyright, of the creator of the material data.

[0072] Up to this point, the output control data has been described as not including a part or all of each content data constituting the material data, but the output control data may include a part or all of at least one content data constituting the material data. In this case, for example, the blockchain system 2 may be set so that when a sale of output control data including a part or all of at least one content data constituting the material data is concluded, a suitable compensation is paid to the creator of the material data. For example, the smart contract describes the user ID of the creator of the material data and information indicating whether or not the right of pursuit is exercised. This makes it possible to set so that a compensation is paid to the creator of the material data every time a sale of output control data including a part or all of at least one content data constituting the material data is made. As a result, it is possible to provide a viewer with a new method of playing back content data based on the material data while protecting the rights such as copyright of the creator of the material data.

[0073] [Modification 1 of the first embodiment] In the first embodiment, the case where the material data is sound data is described as an example. In the first modification of the first embodiment, the case where the material data is image data, particularly the case where the material data is still image data, is described. In this case, for example, in S1003, the display control unit 140 of the content control device 4 generates an editing screen having a GUI similar to that of a general slideshow editing software application, and displays this on the display unit 215. Using the editing screen, the user edits the timing of displaying and outputting still images that are rendering results of each still image data included in the material data. In the editing screen, the user may also edit the display effect, subtitles, transitions, or BGM (background music), etc., when displaying the still images. In addition, the BGM data may be content data as sound data owned by the user, selected as one of the material data.

[0074] When the material data is still image data, the output control data includes, for example, information indicating the timing for controlling the display of the rendering results of the multiple still image data included in the material data. The output control data may also include information such as display effects, subtitles, transitions, or background music when displaying still images. The material data may also include video data. In this case, the output control data includes, for example, information indicating the timing for controlling the display of the rendering results of the video data included in the material data.

[0075] In the above description, the output control data is generated based on the editing operation of the user using an editing screen (not shown), but the method of generating the output control data is not limited to this. For example, the control unit 144 may generate the output control data by inputting a plurality of image data or a plurality of image data and audio data included in the material data to a trained model created in advance by machine learning or the like, and acquiring the output control data output by the trained model.

[0076] If a viewer has ownership of the output control data and the material data corresponding to the output control data, the viewer can perform a display output such as a slide show based on the output control data. Here, the output control data is generated so as not to include a part or all of each content data constituting the material data. This makes it possible to provide the viewer with a new method of reproducing the content data based on the material data while protecting the rights such as copyright of the creator of the material data. The output control data may include a part or all of at least one content data constituting the material data. In this case, for example, the block chain system 2 may be set so that when the sale of the output control data including a part or all of at least one content data constituting the material data is concluded, a suitable compensation is paid to the creator of the material data. This makes it possible to provide the viewer with a display such as a slide show as a new method of reproducing the content data based on the material data while protecting the rights such as copyright of the creator of the material data.

[0077] [Modification 2 of the first embodiment] In the first modification of the first embodiment, the case where the material data is a still image is described as an example. In the second modification of the first embodiment, the case where the material data is moving image data is described. In this case, for example, in S1003, the display control unit 140 of the content control device 4 generates an editing screen having a GUI similar to that of a general video editing software application, and displays this on the display unit 215. The user uses the editing screen to edit the timing of displaying and outputting moving images that are rendering results of each moving image data included in the material data. In the editing screen, the user may also edit display effects, subtitles, transitions, and the like when displaying the moving images. When the material data is moving image data, the output control data includes, for example, information indicating the timing of display control of rendering results of multiple moving image data included in the material data. In addition, the output control data may include information such as display effects, subtitles, and transitions when displaying moving images.

[0078] In the above description, the output control data is generated based on the editing operation of the user using an editing screen (not shown), but the method of generating the output control data is not limited to this. For example, the control unit 144 may generate the output control data by inputting a plurality of video data, which are material data, to a trained model created in advance by machine learning or the like, and acquiring the output control data output by the trained model.

[0079] If a viewer has ownership of the output control data and the material data corresponding to the output control data, the viewer can view multiple moving images as if they were a single moving image based on the output control data. Also, if the material data is moving image data with audio data, the viewer can view multiple moving images with audio data as if they were a single moving image with audio data. Specifically, for example, if the moving image data included in the material data is obtained by synchronous imaging using multiple imaging devices, the viewer can view a moving image with a multi-angle perspective based on the output control data.

[0080] Here, output control data is generated that does not include a part or all of each content data constituting the material data. This makes it possible to provide viewers with a new method of playing back content data based on the material data while protecting the rights, such as copyright, of the creator of the material data. The output control data may include a part or all of at least one of the content data constituting the material data. In this case, for example, the block chain system 2 may be set so that when a sale of output control data including a part or all of at least one of the content data constituting the material data is concluded, a reasonable compensation is paid to the creator of the material data. This makes it possible to provide viewers with a new method of playing back content data based on the material data, in which multiple videos are displayed as if they were one video, while protecting the rights, such as copyright, of the creator of the material data.

[0081] [Modification 3 of embodiment 1] In the first embodiment, the material data is audio data, and the content control device 4 generates output control data indicating the content of output control of a synthetic audio signal obtained by synthesizing the rendering result of the material data as a time-series signal. In contrast, in the third modification of the first embodiment, the material data is data of digital content used to generate a virtual viewpoint image, and the content control device 4 generates virtual camera path information as output control data. Hereinafter, data of digital content used to generate a virtual viewpoint image (hereinafter referred to as "virtual viewpoint content") will be described as "virtual viewpoint data". A virtual viewpoint image is also called a free viewpoint video, and the virtual viewpoint image according to the third modification of the first embodiment is not limited to an image corresponding to a view from a virtual viewpoint freely (arbitrarily) designated by the user. For example, the virtual viewpoint image according to the third modification of the first embodiment also includes an image corresponding to a view from a virtual viewpoint selected by the user from a plurality of candidates.

[0082] The virtual viewpoint image is generated, for example, by the following method. First, data of a plurality of images (hereinafter referred to as "multiple viewpoint images") obtained by imaging from different directions by a plurality of imaging devices is acquired. Next, a foreground image in which an image region corresponding to a predetermined object such as a person or a ball is extracted as a foreground region, and a background image in which an image region other than the foreground region is extracted as a background region are acquired from the multiple viewpoint images. Next, based on the foreground image, three-dimensional shape data (hereinafter referred to as "foreground model") showing the three-dimensional shape of the predetermined object and texture data for coloring the foreground model are generated. Also, based on the background image, texture data for coloring three-dimensional shape data (hereinafter referred to as "background model") showing the three-dimensional shape of the background of a stadium or the like is generated. Next, textures based on the texture data are mapped onto the foreground model and background model, and rendering is performed according to line-of-sight information to generate a virtual viewpoint image. That is, the virtual viewpoint data may include data of the multiple viewpoint images, the foreground model, the background model, texture data, viewpoint information, and the like.

[0083] The method of generating the virtual viewpoint image is not limited to the above-mentioned method, and a well-known method such as a method of generating a virtual viewpoint image by projective transformation of a captured image without using a three-dimensional model can be used for generating the virtual viewpoint image. The viewpoint information is information indicating the position of a virtual viewpoint (hereinafter referred to as the "position of the virtual viewpoint") and the direction of the line of sight from the virtual viewpoint (hereinafter referred to as the "direction of the virtual viewpoint"). Specifically, the viewpoint information includes a parameter set consisting of a parameter indicating the position of the virtual viewpoint in the virtual space and a parameter indicating the direction of the virtual viewpoint in each of the pan, tilt, and roll directions. The viewpoint information is not limited to the above, and for example, the parameter set as the viewpoint information may include a parameter indicating the width of the field of view at the virtual viewpoint, that is, the angle of view. The viewpoint information may include a plurality of parameter sets. For example, the viewpoint information may have a parameter set corresponding to each of a plurality of frames constituting the virtual viewpoint image of the moving image, and may be information indicating the position and direction of the virtual viewpoint at each of a plurality of consecutive time points.

[0084] The virtual camera is a virtual camera different from the imaging device actually installed around the imaging area, and is a concept for conveniently explaining the virtual viewpoint related to the generation of the virtual viewpoint image. That is, the virtual viewpoint image can be considered to be an image obtained by imaging with the virtual camera from the position of the virtual viewpoint set in the virtual space associated with the imaging area. Therefore, the position and orientation of the virtual viewpoint can be expressed as the position and orientation of the virtual camera. In other words, it can be said that the virtual viewpoint image is an image simulating an image obtained by imaging with the imaging device when it is assumed that an imaging device exists at the position of the virtual viewpoint set in the space. In addition, the virtual camera path information is information indicating the change over time of at least one of the position and orientation of the virtual viewpoint, that is, the contents of the transition. By using the virtual camera path information as the viewpoint information, data of the virtual viewpoint image as a moving image, that is, a time-series image signal, is output. It is not essential to use the concept of the virtual camera to realize the configuration of the modified example 3 of the first embodiment. That is, it is sufficient that at least information indicating a specific position and information indicating a direction in the space are set, and the virtual viewpoint image is generated according to the set information.

[0085] 12 is a diagram showing an example of a viewing screen 1200 of content data displayed by the content control device 4 according to the third modification of the first embodiment. The viewing screen 1200 is displayed on the display unit 215 by the content control device 4 performing the process of S801 shown in FIG. 8. The user can use the viewing screen 1200 to perform control for listening to, viewing, or watching content included in the content data owned by the user. The viewing screen 1200 includes an image display area 1201, a content selection GUI 1202, and a content playback GUI 1203. The screen configuration of the viewing screen 1200 is the same as that of the viewing screen 900 shown in FIG. 9, and therefore description thereof will be omitted. The content selection GUI 1202 includes an area 1210 for displaying a content name, and icons 1211 and 1212.

[0086] Icon 1211 indicates the data type of the content data, and also serves as a button for controlling whether rendering is performed. Specifically, icon 1211a indicates that the content data includes a foreground model, icon 1211b indicates that the content data includes texture data for coloring the foreground model, icon 1211c indicates that the content data includes virtual camera path information, and icon 1211d indicates that the content data includes audio data.

[0087] Furthermore, icon 1212 indicates that metadata corresponding to the content data includes information indicating a position, and also serves as a button for controlling whether or not to use the position information when rendering the content data. The configuration of the content selection GUI 1202 is similar to that of the content selection GUI 902 shown in Fig. 9, and therefore a description thereof will be omitted. The content playback GUI 1203 includes a button 1215 for controlling the display output or audio output of the content included in the content data, and a seek bar 1216 for controlling the playback time of the content data. The configuration of the content playback GUI 1203 is similar to that of the content playback GUI 903 shown in Fig. 9, and therefore a description thereof will be omitted.

[0088] For example, when a user performs a user operation to select virtual camera path information, the control unit 144 of the content control device 4 specifies content data to be used for viewing, etc., based on the user operation. Furthermore, when a user performs a user operation on the button 1215, the virtual camera path information, the foreground model, and the texture data are transmitted to the video generation unit 145, and the video generation unit 145 generates a virtual viewpoint image based on this information and data. In addition, the virtual camera path information and the audio data are transmitted to the audio generation unit 146, and the audio generation unit 146 renders the audio data based on this information and data to generate an audio signal. The generated virtual viewpoint image signal and the audio signal are output to the display unit 215 and the audio output unit 216 in synchronization with each other, and display output and audio output are performed.

[0089] In addition, the virtual camera path information is not essential for the generation of the audio signal in the audio generation unit 146. However, the virtual camera path information includes information indicating the position and direction of the virtual viewpoint at each time point. Therefore, for example, when the metadata of each piece of audio data on which the synthetic audio signal is based includes information on the respective sound collection positions, the audio generation unit 146 can generate a synthetic audio signal with the position of the virtual viewpoint as the listening position. Specifically, the audio generation unit 146 generates a synthetic audio signal at the listening position, taking into consideration the delay of the audio due to the propagation of the sound wave from the sound collection position to the listening position, or the attenuation of the sound wave due to the propagation. This allows the user to listen to a more realistic sound in accordance with the virtual viewpoint image.

[0090] Furthermore, if the audio output unit 216 is capable of outputting stereo or surround sound, the audio generation unit 146 may generate a stereo audio signal or the like using information on the sound collection position of each piece of audio data and information on the position and direction of the virtual viewpoint included in the virtual camera path information. A method for generating a stereo audio signal is well known, so a description thereof will be omitted. This allows the user to hear a more realistic sound in accordance with the virtual viewpoint image. Note that the signal generated by the audio generation unit 146 is not limited to a stereo audio signal, and for example, a binaural audio signal may be generated.

[0091] FIG. 13 is a diagram showing an example of a content data generation screen 1300 displayed by the content control device 4 according to the third modification of the first embodiment. The user can use the generation screen 1300 to edit the output control data based on the content data owned by the user. Specifically, the user can use the generation screen 1300 to edit the virtual camera path information based on the material data used to generate the virtual viewpoint image. The generation screen 1300 includes an image display area 1301, a content selection GUI 1302, and an edit button 1303. The content selection GUI 1302 includes an area 1310 for displaying the content name, a button 1311 for selecting the content data used when editing the output control data, and a button 1312 for controlling whether or not to use the position information when editing the output control data. The screen configuration of the generation screen 1300 is the same as that of the generation screen 1100 shown in FIG. 11, and therefore a description thereof will be omitted.

[0092] In S1002, the user performs a user operation to select content data to be used when editing the output control data, and the content control device 4 identifies the selected content data based on the user operation. Specifically, the user presses button 1311 corresponding to the foreground model and texture data. In addition to button 1311 corresponding to the foreground model and texture data, the user may also press button 1311 corresponding to audio data to specify audio data to be output as audio when viewing a virtual viewpoint image.

[0093] When the user presses the edit button 1303, in S1003, the display control unit 140 of the content control device 4 displays an edit screen for the virtual camera path on the display unit 215. For example, the user sets the position and orientation of an initial virtual viewpoint to be used when generating a virtual viewpoint image on an edit screen (not shown). The position and orientation of the virtual viewpoint are set, for example, as follows.

[0094] First, the video generation unit 145 of the content control device 4 generates a virtual viewpoint image corresponding to the appearance of an object in a virtual space based on a preset position and orientation of a virtual viewpoint, based on a foreground model and texture data selected by a user. In addition, the display control unit 140 displays the virtual viewpoint image generated by the video generation unit 145 on an editing screen. The user changes the virtual viewpoint to a desired position and orientation by operating a mouse, a keyboard, a joystick, or the like, and sets the position and orientation of an initial virtual viewpoint. Next, the user sets the position and orientation of the virtual viewpoint after a predetermined period of time has elapsed. The method of setting the position and orientation of the virtual viewpoint after a predetermined period of time has elapsed is the same as the method of setting the position and orientation of the initial virtual viewpoint, so a description thereof will be omitted. The user sets the position and orientation of the virtual viewpoint at a plurality of discrete points of time by repeating the setting of the position and orientation of the virtual viewpoint every time a predetermined period of time has elapsed.

[0095] The position and orientation of the virtual viewpoint are not limited to the setting of the position and orientation of the virtual viewpoint at a plurality of discrete time points, and may be set by a trajectory of the movement of the position and orientation of the virtual viewpoint based on the operation of a mouse or the like. When a save button or a complete button or the like is pressed by a user operation on an editing screen (not shown), in S1004, the control unit 144 of the content control device 4 generates virtual camera path information corresponding to the position and orientation of the virtual viewpoint set so far as output control data. When the positions and orientations of the virtual viewpoint at a plurality of discrete time points are set, the control unit 144 may generate virtual camera path information corresponding to a trajectory that linearly or nonlinearly connects the positions and orientations of the virtual viewpoint from now on. In addition, in the above description, it has been described that the virtual camera path information is generated based on the editing operation of the user using an editing screen (not shown), but the method of generating the virtual camera path information is not limited to this. For example, the control unit 144 may generate the virtual camera path information by inputting a foreground model or the like, which is material data, into a learned model created in advance by machine learning or the like, and acquiring the virtual camera path information output by the learned model.

[0096] After S1004, the generated virtual camera path information is registered in the database system 1 by performing the process of the sequence diagram shown in Fig. 3 as the content data to be registered. Furthermore, the sales status of the virtual camera path information is set in the blockchain system 2 by performing the process of the sequence diagram shown in Fig. 5. As a result, the virtual camera path information is made public in a transferable state to viewers including the owner of the material data.

[0097] If a viewer has ownership of the virtual camera path information, which is output control data, and the foreground model and texture data, which are material data corresponding to the output control data, the viewer can display and output a virtual viewpoint image based on the virtual camera path information. Here, the virtual camera path information does not include a part or all of the foreground model and texture data, which are material data. Therefore, it is possible to provide a virtual viewpoint image based on the virtual camera path information while protecting the rights such as copyright of the creator of the material data. In addition, as described above, a synthetic audio signal can be generated using the virtual camera path information. This allows the viewer to listen to a synthetic audio with the position of the virtual viewpoint as the listening position together with the virtual viewpoint image. That is, the viewer can watch a virtual viewpoint image with synthetic audio, and thus watch a more realistic virtual viewpoint image.

[0098] [Embodiment 2] In the first embodiment and each of the modifications of the first embodiment, a configuration has been described in which the content control device 4 generates output control data indicating the content of output control of the rendering result of the material data as a time-series signal. In contrast, in the second embodiment, a configuration will be described in which the material data is data of a multi-viewpoint image, and the content control device 4 generates a foreground model. FIG. 14 is a diagram showing an example of the functional configuration of the content control device 4 according to the second embodiment (hereinafter, simply referred to as the "content control device 4"). The content control device 4 is applied to an information processing system, and the information processing system according to the second embodiment has a database system 1, a block chain system 2, a content providing device 3, and a content control device 4. The database system 1, block chain system 2, and content providing device 3 according to the second embodiment are similar to the corresponding systems or devices according to the first embodiment, and therefore will not be described.

[0099] The content control device 4 includes a display control unit 140, a request transmission unit 141, a content acquisition unit 142, a user information acquisition unit 143, a control unit 144, a video generation unit 145, a sound generation unit 146, a sound output unit 147, a capture unit 148, and a model generation unit 1449. The content control device 4 has a hardware configuration shown in FIG. 2, and each unit that the content control device 4 has as a functional configuration is realized by the overall control of the content control device 4 by the CPU 211. The display control unit 140, the request transmission unit 141, the content acquisition unit 142, the user information acquisition unit 143, the control unit 144, the video generation unit 145, the sound generation unit 146, the sound output unit 147, and the capture unit 148 are the same as the corresponding units according to the first embodiment, and therefore description thereof will be omitted. The model generation unit 1449 uses data of the multiple viewpoint images as material data to generate three-dimensional shape data (foreground model) indicating the three-dimensional shape of an object appearing in a captured image.

[0100] Fig. 15 is a sequence diagram showing an example of a process flow of the information processing system according to the second embodiment, and is a sequence diagram showing a process flow of the information processing system when generating a foreground model. First, in the information processing system, processes similar to those from S500 to S503 shown in the sequence diagram of Fig. 5 are executed. After S503, in S1501, the content control device 4 generates a generation screen for generating a foreground model using image data indicating the metadata received in S503, and displays it on the display unit 215. On the generation screen generated in S1501, for example, a list of data of a plurality of captured images included in data of a multi-viewpoint image owned by a user is displayed.

[0101] FIG. 16 is a diagram showing an example of a generation screen 1600 for generating a foreground model, displayed by the content control device 4 according to the second embodiment. A user can use the generation screen 1600 to generate a foreground model based on data of a multi-viewpoint image owned by the user. The generation screen 1100 includes an image display area 1601, a content selection GUI 602, and a generation button 1603. The content selection GUI 1602 includes an area 1610 for displaying a content name, and icons 1611 and 1612. The icon 1611 indicates the data type of the content data, and also serves as a button for selecting whether or not to use the content data as material data when generating a foreground model. Specifically, the icon 1611 indicates that the content data is data of a captured image constituting data of a multi-viewpoint image. The icon 1612 indicates that metadata corresponding to the captured image data includes information indicating an imaging position, that is, the position of an imaging device corresponding to the captured image.

[0102] After S1501, in S1502, the user performs a user operation to select data of a captured image to be used for generating a foreground model from data of a plurality of captured images included in the data of the multi-viewpoint image, and the content control device 4 specifies the data of the selected captured image. When the user presses the generate button 1603, in S1503, the model generation unit 1449 of the content control device 4 generates a foreground model based on the captured image data selected in S1502. Specifically, the model generation unit 1449 first extracts a foreground image and a background image from each captured image based on the data of the selected plurality of captured images. Next, the model generation unit 1449 generates a foreground model indicating a three-dimensional shape of a predetermined object based on the foreground image. As described above, according to the content control device 4, the user can generate a foreground model as new content data by using the data of the multi-viewpoint image owned by the user as material data. A method of generating a foreground model using a foreground image is well known, so a description thereof will be omitted. In addition, the model generation unit 1449 generates texture data for coloring the generated foreground model based on the foreground image. As described above, according to the content control device 4, a user can use the multi-viewpoint image data that the user owns as material data to generate texture data for coloring a foreground model as new content data.

[0103] After S1503, the generated foreground model and texture data are registered in the database system 1 by performing the process of the sequence diagram shown in FIG. 3 as the content data to be registered. Furthermore, the sales status of the foreground model and texture data is set in the blockchain system 2 by performing the process of the sequence diagram shown in FIG. 5. This makes the foreground model and texture data available to viewers including the owner of the material data. The viewers can view the virtual viewpoint image using the foreground model and texture data. The creator of the foreground model and texture data may generate virtual camera path information by the method described in the third modification of the first embodiment, and make the generated virtual camera path information available to viewers together with the foreground model and texture data.

[0104] The foreground model does not include any data of the multiple viewpoint images used as the material data. Therefore, it is possible to provide the viewer with a foreground model based on the material data while protecting the rights such as copyright of the creator of the data of the multiple viewpoint images that are the material data. The texture data may include some information of the data of the captured image, or may not include any data of the captured image. Texture data that does not include any data of the captured image is, for example, written in a markup language such as XML, and includes information indicating the crop position of the captured image, the method of transforming the cropped image area, and the corresponding points between the foreground model and the image area. Such texture data does not include any data of the captured image. Therefore, if the viewer owns the data of the multiple viewpoint images, the texture data, and the foreground model, he or she can view the virtual viewpoint image while protecting the rights such as copyright of the creator of the data of the multiple viewpoint images that are the material data.

[0105] Furthermore, if the texture data includes information on a portion of the captured image data, the blockchain system 2 can be set up so that an appropriate compensation is paid to the creator of the multi-viewpoint image data, which is the material data, when the texture data is sold. This makes it possible to make the texture data including information on a portion of the captured image data available to viewers while protecting the rights, such as copyright, of the creator of the material data.

[0106] [Other embodiments] The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) for implementing one or more functions.

[0107] It should be noted that, within the scope of the present disclosure, the embodiments may be freely combined, any component of each embodiment may be modified, or any component of each embodiment may be omitted.

[0108] [Configuration of this disclosure] The present disclosure includes the following configurations, methods, and programs.

[0109] <Configuration 1> A user information acquisition means for acquiring user information indicating a user; a data acquisition means for acquiring a plurality of content data items currently owned by the user based on the user information; a data generating means for generating output control data indicating how to control an output of a rendering result of at least two of the plurality of content data as a time-series signal; 13. An information processing device comprising:

[0110] <Configuration 2> The output control data includes content identification information for identifying each of the at least two content data. 2. The information processing device according to configuration 1,

[0111] <Configuration 3> The output control data is written in a markup language. 3. The information processing device according to configuration 1 or 2,

[0112] <Configuration 4> The output control data does not include a part or all of each of the at least two content data. 4. The information processing device according to any one of configurations 1 to 3,

[0113] <Component 5> the at least two pieces of content data are different acoustic data; The output control data indicates content for controlling output of a composite audio signal obtained by synchronizing and synthesizing the rendering results of at least two pieces of audio data as the time-series signal. 5. The information processing device according to any one of configurations 1 to 4,

[0114] <Component 6> Each of the at least two pieces of acoustic data includes sound collection position information indicating a position where the sound indicated by the acoustic data was collected, The output control data includes listening position information indicating a position for listening to the sound corresponding to the synthetic sound signal. 6. The information processing device according to configuration 5,

[0115] <Component 7> The output control data includes synchronization information used to synchronize the rendering results of the at least two pieces of audio data with each other as content for controlling the output of the synthesized audio signal as the time-series signal. 7. The information processing device according to configuration 5 or 6,

[0116] <Component 8> The output control data includes synthesis information used when synthesizing the rendering results of the at least two pieces of audio data as content for controlling output of the synthesized audio signal as the time-series signal. 8. The information processing device according to any one of configurations 5 to 7,

[0117] <Component 9> the at least two pieces of content data are different image data; The output control data includes information indicating timing for controlling output of the rendering results of at least two pieces of image data as the time-series signal. 9. The information processing device according to any one of configurations 1 to 8,

[0118] <Component 10> At least one of the at least two content data is virtual viewpoint image data capable of generating a virtual viewpoint image; The output control data includes, as the content to be output-controlled as the time-series signal, virtual camera path information indicating transitions in the position and orientation of a virtual viewpoint used when generating the virtual viewpoint image. 10. The information processing device according to any one of configurations 1 to 9.

[0119] <Component 11> The virtual viewpoint image data is three-dimensional shape data indicating a three-dimensional shape of an object. 11. The information processing device according to configuration 10,

[0120] <Component 12> The three-dimensional shape data is a colored three-dimensional shape. 12. The information processing device according to configuration 11,

[0121] <Component 13> The at least two content data include, as the virtual viewpoint image data, three-dimensional shape data indicating a three-dimensional shape of an object and texture data for coloring the three-dimensional shape. 11. The information processing device according to configuration 10,

[0122] <Component 14> an output control means for controlling, when the user is a current owner of the output control data and the at least two pieces of content data whose rendering results are output-controlled as the time-series signal by the output control data, to output the rendering results of the at least two pieces of content data based on the output control data; 14. The information processing device according to any one of configurations 1 to 13, further comprising:

[0123] <Component 15> A user information acquisition means for acquiring user information indicating a user; a data acquisition means for acquiring a plurality of content data items currently owned by the user based on the user information; a data generating means for generating content data based on the plurality of content data; having The plurality of content data are data of a plurality of captured images obtained by synchronously capturing images using a plurality of image capture devices, and the content data generated based on the plurality of content data are three-dimensional shape data indicating the three-dimensional shapes of objects appearing in the plurality of captured images. An information processing device comprising:

[0124] <Component 16> The content data generated based on the plurality of content data includes the three-dimensional shape data and texture data for coloring the three-dimensional shape. 16. The information processing device according to configuration 15,

[0125] <Component 17> The texture data includes information indicating the position of an image area used to color the three-dimensional shape in each of the plurality of captured images, and does not include a part or all of the data of the plurality of captured images. 17. The information processing device according to claim 16,

[0126] <Component 18> The data generating means generates output control data indicating how to control output of the three-dimensional shape data and the rendering results of at least two of the plurality of content data as a time-series signal. 18. The information processing device according to any one of configurations 15 to 17.

[0127] <Component 19> The output control data includes, as the content to be output-controlled as the time-series signal, virtual camera path information indicating transitions in the position and orientation of a virtual viewpoint used when generating a virtual viewpoint image based on the three-dimensional shape data. 19. The information processing device according to configuration 18,

[0128] <Component 20> an image generating means for generating a virtual viewpoint image based on the three-dimensional shape data when the user is a current owner of the three-dimensional shape data; an output control means for controlling the output of the virtual viewpoint image; 20. The information processing device according to any one of configurations 15 to 19, further comprising:

[0129] <Component 21> A first acquisition means for acquiring user information of a first user; A first output means outputs information indicating the acoustic data currently owned by the first user in a plurality of acoustic data including a position where the acoustic data was acquired, the acoustic data including one or more acoustic data currently owned by the first user and one or more acoustic data currently owned by a second user being recorded in a blockchain; a second acquisition means for acquiring information indicating the acoustic data selected by the user from information indicating the acoustic data output by the first output means; a second output means for outputting an acoustic signal generated based on information indicating the acoustic data acquired by the second acquisition means and viewpoint information specifying a position of a virtual viewpoint in a virtual space; 13. An information processing device comprising:

[0130] <Method 1> A user information acquisition step of acquiring user information indicating a user; a data acquisition step of acquiring a plurality of content data items currently owned by the user based on the user information; a data generating step of generating output control data indicating how to control an output of a rendering result of at least two of the plurality of content data as a time-series signal; 13. An information processing method comprising:

[0131] <Method 2> A user information acquisition step of acquiring user information indicating a user; a data acquisition step of acquiring a plurality of content data items currently owned by the user based on the user information; a data generating step of generating content data based on the plurality of content data; having The plurality of content data are data of a plurality of captured images obtained by synchronously capturing images using a plurality of image capture devices, and the content data generated based on the plurality of content data are three-dimensional shape data indicating the three-dimensional shapes of objects appearing in the plurality of captured images. 13. An information processing method comprising:

[0132] <Method 3> A first acquisition step of acquiring user information of a first user; a first output step of outputting information indicating the acoustic data currently owned by the first user in a plurality of acoustic data including a position where the acoustic data was acquired, the acoustic data including one or more acoustic data currently owned by the first user and one or more acoustic data currently owned by a second user being recorded in a blockchain; a second acquisition step of acquiring information indicating the acoustic data selected by the first user from information indicating the acoustic data output by the first output step; a second output step of outputting an acoustic signal generated based on information indicating the acoustic data acquired by the second acquisition step and viewpoint information specifying a position of a virtual viewpoint in a virtual space; 13. An information processing method comprising:

[0133] <Program> A program for causing a computer to function as the information processing device according to any one of configurations 1 to 20. [Explanation of symbols]

[0134] 4 Content Control Device 142 Content acquisition unit 142 143 User information acquisition unit 143 144 Control Unit

Claims

1. A user information acquisition means for acquiring user information indicating a user; a data acquisition means for acquiring a plurality of content data items currently owned by the user based on the user information; a data generating means for generating output control data indicating how to control an output of a rendering result of at least two of the plurality of content data as a time-series signal; 13. An information processing device comprising:

2. The output control data includes content identification information for identifying each of the at least two content data.

2. The information processing apparatus according to claim 1,

3. The output control data is written in a markup language.

2. The information processing apparatus according to claim 1,

4. The output control data does not include a part or all of each of the at least two content data.

2. The information processing apparatus according to claim 1,

5. the at least two pieces of content data are different acoustic data; The output control data indicates content for controlling output of a composite audio signal obtained by synchronizing and synthesizing the rendering results of at least two pieces of audio data as the time-series signal.

2. The information processing apparatus according to claim 1,

6. Each of the at least two pieces of acoustic data includes sound collection position information indicating a position where the sound indicated by the acoustic data was collected, The output control data includes listening position information indicating a position for listening to the sound corresponding to the synthetic sound signal.

6. The information processing device according to claim 5,

7. The output control data includes synchronization information used to synchronize the rendering results of the at least two pieces of audio data with each other as content for controlling the output of the synthesized audio signal as the time-series signal.

6. The information processing device according to claim 5,

8. The output control data includes synthesis information used when synthesizing the rendering results of the at least two pieces of audio data as content for controlling output of the synthesized audio signal as the time-series signal.

6. The information processing device according to claim 5,

9. the at least two content data are different image data from each other; The output control data includes information indicating timing for controlling output of the rendering results of at least two pieces of image data as the time-series signal.

2. The information processing apparatus according to claim 1,

10. At least one of the at least two content data is virtual viewpoint image data capable of generating a virtual viewpoint image, The output control data includes, as the content to be output-controlled as the time-series signal, virtual camera path information indicating transitions in the position and orientation of a virtual viewpoint used when generating the virtual viewpoint image.

2. The information processing apparatus according to claim 1,

11. The virtual viewpoint image data is three-dimensional shape data representing a three-dimensional shape of an object. The information processing device according to claim 10 .

12. The three-dimensional shape data is a colored three-dimensional shape. The information processing device according to claim 11 .

13. The at least two content data include, as the virtual viewpoint image data, three-dimensional shape data indicating a three-dimensional shape of an object and texture data for coloring the three-dimensional shape. The information processing device according to claim 10 .

14. an output control means for controlling, when the user is a current owner of the output control data and the at least two pieces of content data whose rendering results are output-controlled as the time-series signal by the output control data, to output the rendering results of the at least two pieces of content data based on the output control data; Further possessing 2. The information processing apparatus according to claim 1,

15. A user information acquisition means for acquiring user information indicating a user; a data acquisition means for acquiring a plurality of content data items currently owned by the user based on the user information; a data generating means for generating content data based on the plurality of content data; having The plurality of content data are data of a plurality of captured images obtained by synchronously capturing images using a plurality of image capture devices, and the content data generated based on the plurality of content data are three-dimensional shape data indicating a three-dimensional shape of an object appearing in the plurality of captured images. An information processing device comprising:

16. The content data generated based on the plurality of content data includes the three-dimensional shape data and texture data for coloring the three-dimensional shape. The information processing device according to claim 15 .

17. The texture data includes information indicating the position of an image area used to color the three-dimensional shape in each of the plurality of captured images, and does not include a part or all of the data of the plurality of captured images. The information processing device according to claim 16 .

18. The data generating means generates output control data indicating how to control output of the three-dimensional shape data and the rendering results of at least two of the plurality of content data as a time-series signal. The information processing device according to claim 15 .

19. The output control data includes, as the content to be output-controlled as the time-series signal, virtual camera path information indicating transitions in the position and orientation of a virtual viewpoint used when generating a virtual viewpoint image based on the three-dimensional shape data. The information processing device according to claim 18 .

20. an image generating means for generating a virtual viewpoint image based on the three-dimensional shape data when the user is a current owner of the three-dimensional shape data; an output control means for controlling the output of the virtual viewpoint image; Further possessing The information processing device according to claim 15 .

21. A first acquisition means for acquiring user information of a first user; a first output means for outputting information indicating the acoustic data currently owned by the first user in a plurality of acoustic data including a position where the acoustic data was acquired, the acoustic data including one or more acoustic data currently owned by the first user and one or more acoustic data currently owned by a second user being recorded in a blockchain; a second acquiring means for acquiring information indicating the acoustic data selected by the first user from information indicating the acoustic data output by the first output means; a second output means for outputting an acoustic signal generated based on information indicating the acoustic data acquired by the second acquisition means and viewpoint information specifying a position of a virtual viewpoint in a virtual space; 13. An information processing device comprising:

22. A user information acquisition step of acquiring user information indicating a user; a data acquisition step of acquiring a plurality of content data items currently owned by the user based on the user information; a data generating step of generating output control data indicating how to control an output of a rendering result of at least two of the plurality of content data as a time-series signal; 13. An information processing method comprising:

23. A user information acquisition step of acquiring user information indicating a user; a data acquisition step of acquiring a plurality of content data items currently owned by the user based on the user information; a data generating step of generating content data based on the plurality of content data; having The plurality of content data are data of a plurality of captured images obtained by synchronously capturing images using a plurality of image capture devices, and the content data generated based on the plurality of content data are three-dimensional shape data indicating a three-dimensional shape of an object appearing in the plurality of captured images.

13. An information processing method comprising:

24. A first acquisition step of acquiring user information of a first user; a first output step of outputting information indicating the acoustic data currently owned by the first user in a plurality of acoustic data including a position where the acoustic data was acquired, the acoustic data including one or more acoustic data currently owned by the first user and one or more acoustic data currently owned by a second user being recorded in a blockchain; a second acquisition step of acquiring information indicating the acoustic data selected by the first user from information indicating the acoustic data output by the first output step; a second output step of outputting an acoustic signal generated based on information indicating the acoustic data acquired by the second acquisition step and viewpoint information specifying a position of a virtual viewpoint in a virtual space; 13. An information processing method comprising:

25. A program for causing a computer to function as the information processing device according to any one of claims 1 to 21.

Citation Information

Patent Citations

  • Systems and methods for gated in-game access based on collections of unique digital articles

    US11148058B1