Information processing method, program, and information processing device

Abstract

To provide an information processing method, or the like, for distributing a video that a user can sufficiently enjoy in the same atmosphere as an event venue without actual presence in the event venue.SOLUTION: An information processing method includes the steps of: receiving a purchase of a seat ticket in a virtual space, the ticket corresponding to a seat in an event venue; obtaining video data from a plurality of imaging devices disposed in the event venue; and outputting video data corresponding to the seat of the purchased seat ticket to a user terminal. Preferably, in receiving a purchase of the seat ticket, the method includes the step of receiving the purchase of the same seat from multiple people.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing method, a program, and an information processing device. [Background technology]

[0002] A system has been proposed that delivers video to users that gives them the same sense of realism as if they were watching the video at an event venue (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-51169 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the system of Patent Document 1, although different images can be provided for each selected area, the same images are still provided to viewers in the same area. For example, even within the same area, the view differs between the front row seats and the last row seats, or between the center seats and the seats at both ends. In such a case, if the same images are provided within the same area, the user cannot get the same sense of realism as when watching at an event venue.

[0005] In one aspect, an object of the present invention is to provide an information processing method and the like for delivering video that allows a user to fully enjoy the same sense of realism as if they were at an event venue, even if the user does not actually go to the event venue. [Means for solving the problem]

[0006] The information processing method includes accepting a purchase of a seat ticket in a virtual space corresponding to a seat in an event venue, acquiring video data from a plurality of imaging devices arranged at the seat in the event venue, and, if the imaging devices are arranged at the seat of the purchased seat ticket, outputting the video data acquired from the imaging devices to a user terminal, and, if the imaging devices are not arranged at the seat of the purchased seat ticket, generating video data of the seat corresponding to the purchased seat ticket by inputting the seat coordinates of the purchased seat ticket and the line of sight direction as seen from the seat to a model that has been trained to generate video data corresponding to the seat when the seat coordinates and the line of sight direction as seen from the seat to a stage of the event venue are input, and outputting the generated video data to the user terminal. When accepting the purchase of the seat ticket, the system outputs a selectable seat ticket in the virtual space with an NFT (Non-fungible token) related to the performer of the event, which NFT executes a smart contract that grants a portion of the transfer fee to the event related parties when the NFT is transferred to a third party, and a seat ticket in the virtual space without the NFT, and outputs a benefit for the event to the user terminal of the user who holds the NFT. The processing is carried out by a computer. Effect of the Invention

[0007] In one aspect, it is possible to provide an information processing method or the like that distributes video that a user can fully enjoy with the same sense of realism as if he or she were at the event venue, even if the user does not actually go to the event venue. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram illustrating a configuration of an information processing system. [Diagram 2] FIG. 2 is an explanatory diagram illustrating a configuration of a server. [Diagram 3] FIG. 13 is an explanatory diagram illustrating the record layout of a sales DB. [Figure 4] FIG. 13 is an explanatory diagram illustrating the record layout of a seat DB. [Diagram 5] FIG. 2 is an explanatory diagram illustrating a configuration of a user terminal. [Figure 6] FIG. 2 is an explanatory diagram illustrating the placement of cameras. [Figure 7] FIG. 1 is an explanatory diagram of a learning model. [Figure 8] FIG. 2 is an explanatory diagram illustrating an example of the arrangement of cameras and speakers. [Figure 9] 13 is an example of a ticket purchase screen. [Figure 10] 13 is a screen example of an event viewing screen. [Figure 11] 13 is a flowchart illustrating the flow of program processing when purchasing a seat ticket. [Figure 12] 11 is a flowchart illustrating the flow of program processing when an event is being held. [Figure 13] FIG. 11 is an explanatory diagram illustrating the configuration of a user terminal in the second embodiment. [Figure 14] 13 is an example of a ticket selection screen. [Figure 15] FIG. 13 is an explanatory diagram illustrating the record layout of a sales DB in the third embodiment. [Figure 16] FIG. 13 is an explanatory diagram illustrating the placement of cameras in the fourth embodiment. [Figure 17] 13 is a screen example of a ticket purchase screen in the fourth embodiment. [Figure 18] 13 is a screen example of a ticket selection screen in the fifth embodiment. [Figure 19] An explanatory diagram showing an overview of an NFT transfer system in embodiment 5. [Figure 20] FIG. 1 is an explanatory diagram illustrating the configuration of an NFT. [Figure 21] FIG. 13 is an explanatory diagram illustrating the process of granting a portion of the transfer fee to an event participant through a smart contract. [Figure 22] 1 is a flowchart explaining the processing flow when issuing an NFT. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [Embodiment 1] 1 is an explanatory diagram illustrating the configuration of an information processing system. In this embodiment, an information processing system is described that can provide users with the same sense of realism as at the event venue by distributing images captured by cameras 3 arranged at each seat in the event venue to users. The information processing system includes an information processing device 1, a user terminal 2, multiple cameras (imaging devices) 3, and a speaker 4. Each device is communicatively connected to a network N such as the Internet.

[0010] The information processing device 1 is an information processing device capable of various information processing and transmitting and receiving information, such as a server computer, a personal computer, etc. In this embodiment, the information processing device 1 is assumed to be a server computer, and for simplicity in the following description, it will be referred to as the server 1. As will be described later, the server 1 accepts purchases of seat tickets for an event venue from user terminals 2, and distributes video data captured by a camera 3 installed at a position corresponding to the seat to the user terminal 2 of the user who purchased the seat ticket.

[0011] The user terminal 2 is a terminal device owned by each user, and is, for example, a smartphone, a tablet terminal, a personal computer, etc. Each user purchases tickets and views video data via the user terminal 2.

[0012] The camera 3 is an imaging device installed on a seat in the event venue, and is connected to the server 1 via a controller (not shown, for example, a personal computer installed in the venue). The speaker 4, like the camera 3, is a speaker device installed in the event venue, and is connected to the server 1 via a controller (not shown).

[0013] 2 is an explanatory diagram illustrating the configuration of the server 1. The server 1 includes a control unit 11, a main memory unit 12, an auxiliary memory unit 13, a communication unit 14, a display unit 15, an input unit 16, and a bus. The control unit 11 is an arithmetic processing device such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), or a GPU (Graphics Processing Unit), and is connected via a bus to each hardware component constituting the server 1. The main memory unit 12 is a temporary storage device such as an SRAM (Static Random Access Memory) or a DRAM (Dynamic Random Access Memory), and temporarily stores information required during processing performed by the control unit 11 and programs being executed by the control unit 11.

[0014] The auxiliary storage unit 13 is a large-capacity storage device such as a hard disk. The auxiliary storage unit 13 stores programs to be executed by the control unit 11 and various data necessary for executing the programs. The auxiliary storage unit 13 also stores a sales DB 75 and a seat DB 77. The sales DB 75 is a database that stores information regarding sales of seat tickets. The seat DB 77 is a database that stores information about each seat in the event venue.

[0015] The communication unit 14 is an interface for performing communication between the server 1 and the network N. The display unit 15 is a liquid crystal display panel, an organic EL display panel, etc. The input unit 16 is a keyboard, a mouse, etc.

[0016] The server 1 may be configured with a plurality of computers performing distributed processing. For example, the server 1 may be configured with a server that sells tickets and a server that distributes video data separately.

[0017] 3 is an explanatory diagram explaining the record layout of the sales DB 75. The sales DB 75 includes a user ID column, a ticket ID column, a purchase date column, a ticket type column, and a seat column. The user ID column stores a user ID for identifying a user who purchased a seat ticket. The ticket ID column, purchase date column, ticket type column, and seat column each store, in association with the user ID, the ticket ID of the seat ticket purchased by the user, the purchase date of the seat ticket, the ticket type, and the seat number corresponding to the ticket.

[0018] More specifically, the ticket type column stores two types of information as ticket types: "streaming" or "venue." "Streaming" indicates that the ticket purchased by the user is the right to receive streaming of video data. "Venue" indicates that the ticket purchased by the user is the right to attend the venue and watch the event from a particular seat. For the sake of convenience in the following explanation, the former type of ticket will be referred to as a "streaming ticket" and the latter type of ticket will be referred to as a "venue ticket" to distinguish between the two.

[0019] In addition, in the sales DB75 in Fig. 3, the seat row of the record in which "AAAA" is recorded in the user ID column is recorded as "1st floor, row F, no. 6". On the other hand, the seat row of the record in which "EEEE" is recorded in the user ID column is also recorded as "1st floor, row F, no. 6". In this way, in this embodiment, a distribution ticket specifying the same seat can be transferred to multiple people.

[0020] FIG. 4 is an explanatory diagram for explaining the record layout of the seat DB 77. The seat DB 77 includes a seat row, a coordinate row, an image row, and a speaker row. The seat row stores the seat number of each seat. The coordinate row, image row, and speaker row each store, in association with the seat number, the coordinates of each seat (three-dimensional coordinates (x, y, z) and line of sight direction (θ, φ) described later), the method of acquiring video data corresponding to each seat (whether the image captured by the camera 3 is directly distributed or an image is generated by a learning model 73 described later), and the speaker corresponding to each seat.

[0021] 5 is an explanatory diagram illustrating the configuration of the user terminal 2. The user terminal 2 includes a control unit 21, a main memory unit 22, an auxiliary memory unit 23, a communication unit 24, a touch panel 25, an audio input unit 26, an audio output unit 27, and a bus. The control unit 21 is an arithmetic and control device such as one or more CPUs, MPUs, GPUs, etc., and is connected via a bus to each hardware unit constituting the user terminal 2. The main memory unit 22 is a temporary storage device such as SRAM or DRAM, and temporarily stores information required during processing performed by the control unit 21 and programs being executed by the control unit 21. The auxiliary memory unit 23 is a storage device such as a hard disk, and stores programs to be executed by the control unit 21 and various data required for executing the programs.

[0022] The communication unit 24 is an interface for communicating between the user terminal 2 and the network N. The touch panel 25 is a liquid crystal display panel or the like, and functions as a display unit 251 that displays images and an input unit 252 that accepts operational input. The audio input unit 26 is a device such as a microphone that converts audio into an electrical signal. The audio output unit 27 is a device such as a speaker that converts an electrical signal into audio.

[0023] 6 is an explanatory diagram explaining the placement location of camera 3. The event venue in this embodiment is a venue where musical events such as bands, orchestras, operas, concerts, or performances, sporting events, movies, sumo, rakugo, or kabuki, or other various events take place. Camera 3 is a camera capable of transmitting video data to server 1. Video data includes still images, videos, or a combination thereof, and may also include sound. Performers in this embodiment are performers at an event or athletes in a sporting event.

[0024] In this embodiment, live streaming distribution will be described as an example, but streaming distribution such as on-demand distribution, progressive download distribution, DRM (Digital rights management) distribution, or the like may also be used.

[0025] A plurality of cameras 3 are placed near the seats in the event venue. Specifically, one camera 3 is placed for each area 5 consisting of a plurality of seats (four in FIG. 6). Similarly, one speaker 4 is placed for each area 5.

[0026] The camera 3 and the speaker 4 may be arranged, for example, for each seat, or may be arranged for each area 5 created by various partitioning methods.

[0027] The cameras 3 capture images of the stage at the event venue from their respective positions and transfer the captured images (video data) to the server 1. As described below, the server 1 distributes the video data captured by the cameras 3 to the user terminals 2 of users who have purchased seat tickets within the area 5 to which the cameras 3 belong.

[0028] Here, the server 1 may distribute the images captured by the camera 3 as they are, but in this embodiment, it further converts them into images from new viewpoints corresponding to each seat and distributes them to the user terminal 2.

[0029] 7 is an explanatory diagram of a learning model 73. Although the image conversion method is not particularly limited, in this embodiment, the image is converted using a machine learning model called NeRF (Neural Radiance Fields). NeRF is an MLP (Multi Layer Perceptron) that outputs four-dimensional parameters of density and color when the coordinates of interest (x, y, z) in a three-dimensional space and the camera direction (θ, φ) at those coordinates are input.

[0030] In this embodiment, it is assumed that the server 1 has acquired in advance the three-dimensional coordinates (x, y, z) and the orientation (θ, φ) of each camera 3. The server 1 constructs a learning model 73 using pairs of images captured by each camera 3 and these five-dimensional parameters as training data.

[0031] When actually generating (converting) an image from a viewpoint corresponding to each seat, the server 1 inputs the seat coordinates and the line of sight direction from that seat toward the stage into the learning model 73 constructed above, and generates an image of the stage as seen from that seat.

[0032] As described above, by using the learning model 73, it is possible to deliver images for each seat, rather than simply delivering images of the seats installed in each area 5 consisting of multiple seats.

[0033] Fig. 8 is an explanatory diagram for explaining an example of the arrangement of the cameras 3 and the speakers 4. Fig. 8 illustrates the arrangement of the cameras 3 and the speakers 4 in seats 1 to 3 of rows A to C.

[0034] For example, in Fig. 8, a camera 3 of "camA" is installed in seat 1 of row A. In this case, the server 1 refers to the seat DB 77 and distributes an image captured by the camera 3 of "camA" to the user terminal 2 of the user who has purchased a seat ticket for seat 1 of row A. In addition, a speaker 4 of "spkA" is installed near seat 1 of row A. In this case, the server 1 refers to the seat DB 77 and outputs sound from the speaker 4 of "spkA" when outputting a reaction from the user as described below.

[0035] On the other hand, no camera 3 is installed in seat B, number 1. In this case, the server 1 refers to the seat DB 77 and determines that the image to be distributed to the user in seat B, number 1 is generated by the learning model 73 (see FIG. 4). In this case, the server 1 generates an image of the stage visible from seat B, number 1 by inputting the three-dimensional coordinates (x, y, z) and line of sight direction (θ, φ) of seat B, number 1 into the learning model 73. The server 1 distributes the generated image to the user terminal 2 of the corresponding user. As for the audio, it is output from the speaker 4 of "spkA" in the same way as for seat A, number 1.

[0036] In this way, the server 1 delivers to the user terminal 2 an image captured by the camera 3 for a seat where the camera 3 is installed, and an image generated by the learning model 73 for a seat where the camera 3 is not installed.

[0037] Note that NeRF is an example of an image conversion method, and the present embodiment is not limited to this. For example, the learning model 73 may use a generative model other than MLP (NeRF) (e.g., CNN (Convolutional Neural Network), U-NET, GAN (Generative Adversarial Network), etc.) to generate video data corresponding to each seat by synthesizing the video data captured by each camera 3.

[0038] Specifically, the server 1 uses training data in which the video data of each camera 3 and the video data of a specific seat are paired as input and output to construct a model that generates video data by combining the video data of each camera 3 when the video data of each camera 3 is input. The server 1 inputs the video data of each camera 3 into the constructed model to generate video data corresponding to the seat purchased by the user and distributes it to the user terminal 2.

[0039] In this way, the server 1 may synthesize video data captured by a plurality of cameras 3 into video data from the viewpoint of each seat.

[0040] Next, the processes on the user terminal 2 side (screen operations when purchasing a ticket and when viewing a distributed video) will be described with reference to FIGS.

[0041] Fig. 9 is an example of a ticket purchase screen. Fig. 9 illustrates an example of a screen displayed by the user terminal 2 when purchasing a ticket. The portion displayed on the left side of the ticket purchase screen in Fig. 9A is a seat selection section 51. The user can select a seat by pressing a seat displayed in the seat selection section 51.

[0042] Seats for which a venue ticket has already been purchased are marked with an X mark in the seat selection section 51. It is not possible to purchase a venue ticket for a seat marked with an X mark in the seat selection section 51. On the other hand, when purchasing a distribution ticket, it is possible to select a seat marked with an X mark.

[0043] The portion displayed in the upper right corner of the screen in Fig. 9A is a preview display section 52. A preview of actual video data that can be viewed from the seat selected in the seat selection section 51 is displayed. The video data displayed in the preview display section 52 is highlight scenes of a past event that were captured by a camera 3 located near the seat.

[0044] The user can watch past highlight scenes by tapping the play button on the preview display area 52. At the same time, the user can check the view from the selected seat, which can be used as a reference for selecting a seat.

[0045] Once a preview display is selected by the user, it is recorded in memory as a selection history. When the user taps the open list button 54, the screen transitions to the ticket purchase screen of FIG. 9B. On the ticket purchase screen of FIG. 9B, thumbnails of preview displays of multiple seats are displayed in a list display section 56. The thumbnails of the preview displays displayed in the list display section 56 are the user's past selection history recorded in memory.

[0046] The user can select a seat not only from the seat selection section 51 in the ticket purchase screen in Fig. 9A but also from the preview display in the list display section 56. A plurality of preview displays may be registered as favorites by the user as candidates for seat selection. In this case, the favorite preview displays may be displayed as a list.

[0047] The portion displayed at the bottom right of the screen in FIG. 9A and at the bottom left of the screen in FIG. 9B is seat information display section 53. Seat information and ticket prices for the seat selected in seat selection section 51 or list display section 56 are displayed in seat information display section 53. In addition, the user can select a ticket type from a pull-down menu by pressing a ticket type field in seat information display section 53. Ticket types include distribution tickets and venue tickets. The user can purchase a ticket for the selected seat by pressing a purchase button in seat information display section 53.

[0048] Generally, only one person can sit in one seat at an event venue. Therefore, tickets for the same seat at an event venue cannot be sold to multiple people. However, in this embodiment, video data for the event is distributed according to the seat, and distribution tickets are sold for each seat. Therefore, tickets for the same seat can be sold to multiple people, and a profitable event can be held without requiring a large event venue.

[0049] 10 is an example of an event viewing screen 60. The event viewing screen 60 is displayed on the user terminal 2 of a user who has purchased a seat ticket. The portion displayed in the center of the event viewing screen is an event video display section 61.

[0050] The video displayed on the event video display unit 61 is video data corresponding to the seat of the seat ticket purchased by the user. That is, the video on the event video display unit 61 is video data acquired from a camera 3 arranged near the seat of the seat ticket purchased by the user. In addition, the video on the event video display unit 61 may be video data generated by the learning model 73 as described above.

[0051] The portion displayed at the bottom left of the event viewing screen 60 is a comment sending section 62. The user can send a comment expressing their impressions of the event by operating the input section 252. The sent comments are sequentially output to a large monitor (not shown) installed at the event venue.

[0052] The audience and performers at the event venue can enjoy the event while viewing the transmitted comments. The transmitted comments may be output to a comment section (not shown) on the event viewing screen 60.

[0053] The button displayed at the bottom right of the event viewing screen 60 is a cheer sending section 63. By pressing the cheer sending section 63, the user can send cheers, i.e., reactions, to the event via the audio input section 26.

[0054] The transmitted reaction is output to the speaker 4 corresponding to the seat of the seat ticket purchased by the user, among multiple speakers 4 installed at the event venue. The cheer transmitting unit 63 enables users to sing together or do call and response, etc., and to feel a sense of unity with the performers and the event venue even without going to the event venue.

[0055] Fig. 11 is a flowchart for explaining the flow of processing of a program when purchasing a seat ticket. The program of Fig. 11 is started by the user operating the user terminal 2 when purchasing a seat ticket.

[0056] The control unit 11 transmits a ticket purchase screen (step S211). The control unit 21 receives the ticket purchase screen (step S311). The control unit 21 displays the ticket purchase screen (step S312). The control unit 21 accepts a seat selection (step S313). The control unit 21 outputs a preview display corresponding to the selected seat (step S314).

[0057] The control unit 21 accepts the selection of the ticket type (step S315). Specifically, the control unit 21 accepts the selection of a distribution ticket or a venue ticket. The control unit 21 accepts the purchase of a seat ticket (step S316). The control unit 21 transmits information about the purchased seat ticket to the server 1 (step S317).

[0058] The control unit 11 receives information about the purchased seat ticket (step S212). The control unit 11 generates a ticket ID based on the received seat ticket information (step S213). Here, the ticket ID is a URL for enabling specific distributed video data to be viewed during a specific time period, and is an example of ticket information in this embodiment. The control unit 11 transmits the ticket ID to the user terminal 2 (step S214). The control unit 11 transmits the ticket ID to the user terminal 2, for example, via email or SMS.

[0059] The control unit 11 creates a new record in the sales DB 75, and records the user ID, ticket ID, purchase date and time, ticket type, and seat number that uniquely correspond to the ticket information (step S215).

[0060] The control unit 21 receives the ticket ID (step S318). The control unit 21 notifies the user that the ticket ID has been received (step S319). After that, the user terminal 2 ends the process.

[0061] 12 is a flowchart explaining the flow of processing of a program when an event is held. The camera 3 generates video data (step S411). The camera 3 transmits the generated video data to the server 1 (step S412). The control unit 11 receives the video data (step S251).

[0062] The control unit 11 refers to the seat row, image row, and speaker row in the seat DB 77, and identifies the method of acquiring image data corresponding to the seat and the speaker 4 that acquired the audio data (step S252).

[0063] The control unit 11 edits the received video data based on the specified image data acquisition method and speaker 4 (step S253). The control unit 11 transmits the edited video data to the user terminal 2 (step S254).

[0064] The control unit 21 receives the video data (step S351). The control unit 21 outputs the received video data to the display unit 251 (step S352). The control unit 21 accepts the user's reaction (step S353). The reaction is input via the voice input unit 26 by pressing a cheer transmission unit 63 (see FIG. 12) described later.

[0065] The control unit 21 transmits the input reaction to the server 1 (step S354). The control unit 11 receives the reaction (step S255). The control unit 11 transmits the received reaction to the speaker 4 corresponding to the seat (step S256).

[0066] The speaker 4 receives the reaction (step S511). The speaker 4 outputs the reaction (step S512). After the event ends, the control unit 11 ends the process.

[0067] As described above, according to the first embodiment, it is possible to distribute video that a user can fully enjoy with the same sense of realism as if the user were at the event venue, even if the user does not actually go to the event venue.

[0068] [Embodiment 2] This embodiment relates to an information processing system that allows a user to view video data using VR (Virtual Reality). Description of parts common to the first embodiment will be omitted.

[0069] 13 is an explanatory diagram illustrating the configuration of the user terminal 2 in the second embodiment. A VR device 28 is connected to the user terminal 2 in the second embodiment. The VR device 28 is a device such as VR goggles that allows a user to experience virtual reality by peering through it. The VR device 28 is connected to the user terminal 2 by wire or wirelessly. The VR device 28 has a playback unit 281 and a detection unit 282.

[0070] The playback unit 281 is a display built into the inside of the VR device 28. Two displays are installed side by side inside the VR device 28. A right-eye image is output to the right display, and a left-eye image is output to the left display. In addition, if headphones are built into the VR device 28, the playback unit 281 also includes the headphones.

[0071] The detection unit 282 is a sensor or the like that detects the movement of the user wearing the VR device 28. The detection unit 282 has a head tracking function and an eye tracking function. The head tracking function is a function that tracks the movement of the head of the user wearing the VR device 28. The head tracking function makes it possible to output an image that is linked to the movement of the head.

[0072] The eye tracking function is a function that captures the eye movement and focus of the user wearing the VR device 28 and reflects the movement in the image. The detection unit 282 may have a position tracking function that tracks the whole body movement of the user wearing the VR device 28. The detection unit 282 may have only either the head tracking function or the eye tracking function.

[0073] In this embodiment, camera 3 is a camera that can capture images in wide directions, up, down, left and right, at once. The wide directions, up, down, left and right, are, for example, 360 degrees. The wide direction video data acquired by camera 3 is transmitted to user terminal 2 via communication unit 24 and output to playback unit 281. Furthermore, when outputting to playback unit 281, a dynamic line of sight corresponding to the movement of the user's head or line of sight, etc., detected by detection unit 282, is added to the video data.

[0074] The video data output to the playback unit 281 may be video data obtained by synthesizing wide-angle video data acquired from a plurality of cameras 3 using the learning model 73. The VR device 28 and the camera 3 installed in the corresponding seat may be linked, and the camera 3 may move in response to the movement of the user's head. When the user wearing the VR device 28 turns his / her head left or right, the face of the spectator in the seat next to him / her at the actual event venue may be visible.

[0075] For example, if there are multiple performers on stage or if a performer moves, the user can follow the performers with his or her eyes, which means that the performer the user wants to watch will not be out of frame, causing the user to feel frustrated.

[0076] According to this embodiment, it is possible to provide an information processing system that enables a user to fully enjoy an event with the same sense of realism as if he or she were at the event venue, without actually going to the event venue.

[0077] [Embodiment 3] This embodiment relates to an information processing system that sells a venue ticket (a seat ticket in the real world) and a venue ticket with a distribution ticket (a seat ticket in the real world with a seat ticket in the virtual world). Explanations of parts common to the first and second embodiments will be omitted.

[0078] 14 is an example of a ticket selection screen 84. In the center of the ticket selection screen 84, a venue ticket button 85, a distribution ticket button 86, and a venue ticket with distribution button 87 are displayed.

[0079] Pressing the venue ticket button 85 transitions to a venue ticket purchase screen, where a venue ticket can be purchased. A venue ticket is a seat ticket at the event venue, and only one seat ticket can be purchased for the same seat. With only a venue ticket, video data is not distributed via the user terminal 2.

[0080] Pressing the distribution ticket button 86 transitions to a distribution ticket purchase screen (see FIG. 9) where a seat can be selected. A distribution ticket can be sold to multiple people for the same seat. A distribution ticket is a seat ticket in a virtual space that corresponds to a seat at the event venue. Video data corresponding to the seat is distributed to the user terminal 2 of the user who purchased the distribution ticket.

[0081] Pressing the Venue Ticket with Streaming button 87 transitions to a purchase screen for a venue ticket with a streaming ticket attached. The seat in the virtual space of the streaming ticket corresponds to the seat in the real space of the venue ticket. A user who purchases a venue ticket with streaming can choose to actually go to the event venue, or to watch the stream without going to the event venue. It may also be possible to actually go to the event venue and watch an archived stream after the event ends. For example, if the event venue is outdoors and it rains on the day of the event, the user can enjoy the event without going to the event venue.

[0082] 15 is an explanatory diagram illustrating the record layout of the sales DB 75 in the third embodiment. In the ticket type field of the sales DB 75 in the third embodiment, in addition to "streaming" and "venue", "streaming-venue" is recorded. "Streaming-venue" is recorded in the ticket type field of the record created when a user purchases a venue ticket with streaming.

[0083] [Embodiment 4] This embodiment relates to an information processing system that allows viewing of video data from a special seat where spectators who support a particular performer gather. Explanation of parts common to the first to third embodiments will be omitted.

[0084] FIG. 16 is an explanatory diagram explaining the placement of camera 3 in embodiment 4. In this embodiment, seats at the event venue are assigned to each performer. As shown in FIG. 16, seat 81 is assigned to an optimal position for viewing performer 80b moving around on stage during the event, and audience members cheering on performer 80b gather at seat 81. Multiple cameras 3b are placed near seat 81. Camera 3b tracks and captures only performer 80b. Similarly, seats dedicated to audience members cheering on performers 80a, 80c, and 80d, and multiple cameras 3 that track and capture only specific performers are placed.

[0085] Camera 3 may be labeled with a color (member color) that symbolizes a particular performer in a group of performers. By finding the sign of his / her member color, the performer can identify the seats of the audience cheering for him / her and the location of camera 3. Therefore, the performer can perform while looking toward the audience cheering for him / her and camera 3, and can wave, etc.

[0086] Fig. 17 is an example of a ticket purchase screen in the fourth embodiment. The screen in Fig. 17 is displayed on the display unit 251. Seats are displayed for each performer in the seat selection unit 91. The user can select a seat specialized for watching the performer they are supporting. Furthermore, by pressing the play button in the preview display unit 92, the user can view highlight scenes of past events from the selected seat, which can be used as a reference for seat selection.

[0087] The seat information and ticket price of the selected seat are displayed in the seat information display section 93. The user can purchase a ticket for the selected seat by pressing a purchase button in the seat information display section 93.

[0088] According to this embodiment, it is possible to provide an information processing system that allows a person to enjoy an event in close proximity to the performers without having to go to the event venue. Furthermore, seat tickets for the same seat can be sold to multiple people. Therefore, the performance evaluation of each performer in group activities can be measured based on the number of seat tickets purchased. Therefore, by purchasing a seat ticket for a performer, it is possible to support the activities of the performer you support.

[0089] [Embodiment 5] This embodiment relates to a form of selling tickets with NFT (Non-fungible token). Explanations of parts common to the first to fourth embodiments will be omitted.

[0090] FIG. 18 is an example of a ticket selection screen 94 in the fifth embodiment. The ticket selection screen 94 is displayed on the display unit 251. A distribution ticket button 95 and an NFT-attached distribution ticket button 96 are displayed on the ticket selection screen 94. In this embodiment, when purchasing a ticket, it is possible to select whether to purchase a distribution ticket or an NFT-attached distribution ticket. It is also possible to select a venue ticket, an NFT-attached venue ticket, or a venue ticket with an NFT-attached distribution ticket.

[0091] When the user presses the delivery ticket button 95, the screen transitions to a ticket purchase screen for the delivery ticket (see FIG. 9) where the user can select a seat. On the other hand, when the user presses the NFT-attached delivery ticket button 96, the screen transitions to a ticket purchase screen for the NFT-attached delivery ticket where the user can purchase an NFT-attached delivery ticket. The price of the NFT-attached delivery ticket is set higher than the price of the delivery ticket. NFT-attached delivery tickets may be sold in limited quantities.

[0092] In this embodiment, the NFT-attached distribution ticket is a distribution ticket that comes with an NFT. The NFT is digital data that comes with a certificate of authenticity or a certificate of ownership, and like virtual currency, blockchain technology is used for data management, making it difficult to tamper with or counterfeit. The distribution ticket is issued by the server 1. The NFT is issued on the blockchain system separately from the distribution ticket.

[0093] In addition, the NFT-attached distribution ticket is not limited to a distribution ticket with an NFT attached, and for example, the ticket and the NFT may be integrated. In addition, it is not limited to a distribution ticket, and an NFT may be attached to a venue ticket in the real world. Furthermore, an NFT may be attached to a venue ticket with a distribution ticket.

[0094] In this embodiment, the NFT is issued in association with a digital bromide of the performer participating in the event. The digital bromide may be one in which the performer is photographed alone or in which multiple performers are photographed. The NFT is not limited to the digital bromide, and may be associated with, for example, a limited video in which the performer is photographed, a painting drawn by the performer, or audio data of the performer's singing.

[0095] If digital photos of each performer are linked to NFTs and attached to streaming tickets, users can select and purchase streaming tickets that come with NFTs corresponding to the performers they support. By comparing the sales of streaming tickets with NFTs for each performer, it is also possible to measure the performance evaluation of each performer in group activities. Therefore, by purchasing streaming tickets with NFTs, users can support the success of the performers they support.

[0096] In addition, a distribution ticket with an NFT may be purchased, and a privilege may be given to a user who owns the NFT. For example, a privilege video related to an event may be output to the user terminal 2 of the user who owns the NFT.

[0097] 19 is an explanatory diagram showing an overview of an NFT transfer system in embodiment 5. The system of this embodiment has a server 1, a blockchain system 6, and a user terminal 2. Each device transmits and receives information via a network N such as the Internet.

[0098] The blockchain system 6 is a distributed ledger technology or a distributed network. The blockchain system 6 is composed of multiple nodes 7 that execute a consensus process. Each node 7 holds a copy of the blockchain data through the execution of the consensus process. The blockchain system 6 generates units of data called blocks at regular intervals and stores the data by linking them like a chain.

[0099] Fig. 20 is an explanatory diagram illustrating the configuration of an NFT. The configuration of the NFT in Fig. 20 will be explained using an example of ERC721 in Ethereum (registered trademark).

[0100] The index data is composed of a token ID, an owner ID, and a token URI (Uniform Resource Identifier). The token ID is an identifier that uniquely corresponds to the owned token. The owner ID is an identifier that identifies the token owner on the blockchain system6. The token URI is the storage location for the metadata of the NFT.

[0101] The token URI is managed in a file on the blockchain system6, and when linked to the token ID, it constitutes the functionality of the NFT. When linked to the owner ID, it constitutes proof that the user owns the NFT.

[0102] The metadata includes the name of the NFT, a description of the NFT, and the URL (Uniform Resource Locator) of the target data. The name of the NFT is the name given to the NFT. The description of the NFT is a description of the type of NFT.

[0103] The URL of the target data is a string that indicates the location on the Internet of the data that is the target of the NFT. The data that is the target of the NFT is, for example, an image or a video. In the example of Figure 20, a digital photo of member C, a performer who will be participating in the event, is linked to the NFT.

[0104] Fig. 21 is an explanatory diagram explaining the process of granting a part of the transfer fee to the event related parties by smart contract. Fig. 21 illustrates the transfer of NFT of user A who purchased a seat ticket with NFT to user B.

[0105] As described above, the server 1 sells a seat ticket with an NFT to a user. The NFT can, of course, be transferred to a third party. The transfer fee (price) is paid, for example, in virtual currency.

[0106] In this embodiment, when an NFT is transferred to a third party, a portion of the transfer fee is given to the event participants. The event participants include, but are not limited to, the performers and event organizers.

[0107] The granting of the transfer fee is executed, for example, by defining it in a smart contract that the node 7 calls when transferring the NFT. That is, the server 1 generates a smart contract that describes the necessary execution conditions for processing the grant of fees to the event participants, the contract contents, and the wallet addresses of the event participants, and broadcasts it to the blockchain system 6. When the NFT is transferred, the node 7 calls the smart contract and generates a transaction that grants a portion of the transfer fee (for example, 10% of the transfer fee) to the event participants. As a result, a portion of the transfer fee is paid to the event participants.

[0108] Fig. 22 is a flowchart explaining the process flow when issuing an NFT. The program in Fig. 22 is started by the user operating the user terminal 2 when purchasing a ticket.

[0109] The control unit 11 transmits a ticket selection screen 94 (see FIG. 18) to the user terminal 2 (step S271). The control unit 21 receives the ticket selection screen 94 via the communication unit 24 (step S371). The control unit 21 displays the ticket selection screen 94 on the display unit 251 (step S372). The control unit 21 accepts the selection of an NFT-attached distribution ticket (step S373). The control unit 21 accepts the purchase of an NFT-attached distribution ticket (step S374). In step S374, the control unit 21 may accept the purchase of an NFT-attached venue ticket or a venue ticket with an NFT-attached distribution ticket.

[0110] The control unit 21 transmits purchase information of the purchased NFT-attached delivery ticket to the server 1 (step S375). The control unit 11 receives the purchase information (step S272). The control unit 11 generates a ticket ID based on the received purchase information (step S273).

[0111] The control unit 11 issues an NFT to be granted to the user based on the purchase information (step S274). The NFT is data indicating the owner of the event benefit (e.g., a digital bromide). The control unit 11 broadcasts the issued NFT to the blockchain system 6 (step S275).

[0112] The control unit 11 transmits the ticket ID and the benefit (digital bromide) linked to the NFT to the user terminal 2 (step S276). The control unit 11 adds a new record to the sales DB 75 and records the user ID, ticket ID, purchase date, ticket type, and seat (step S277).

[0113] The control unit 21 receives the ticket ID and the benefit (step S376). The control unit 21 notifies the user that the ticket ID and the benefit have been received (step S377). The control unit 21 displays the received benefit (digital bromide) on the display unit 251 in response to a user operation (step S378). The control unit 21 then ends the process.

[0114] According to this embodiment, it is possible to provide an information processing system that allows a user to enjoy an event while getting a sense of exclusivity even without going to the venue.

[0115] The technical features (constitutive elements) described in each embodiment can be combined with each other, and by combining them, new technical features can be formed. The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the scope and meaning equivalent to the claims.

[0116] Independent claims and dependent claims described in the claims may be combined with each other in any combination, regardless of the reference format. Furthermore, the claims may be written in a format in which a claim references two or more other claims (multiple claim format), but this is not limited to this format. The claims may be written in a format in which a multiple claim references at least one other claim (multiple multiple claim format). [Explanation of symbols]

[0117] 1. Server (information processing device) 11 Control section 12 Main memory 13 Auxiliary storage 14 Communications Department 15 Display section 16 Input section 2. User terminal 21 Control section 22 Main memory 23 Auxiliary storage 24 Communications Department 25 Touch Panel 26 Audio input section 27 Audio output section 28 VR equipment 3. Camera 4 Speakers 6. Blockchain System 7 Node

Claims

1. Accepting the purchase of seat tickets in a virtual space corresponding to seats at an event venue; Acquire video data from a plurality of imaging devices arranged at seats in the event venue; If the imaging device is located at the seat of the purchased seat ticket, video data acquired from the imaging device is output to a user terminal; If the imaging device is not installed in the seat of the purchased seat ticket, a model that has been trained with video data acquired from the multiple imaging devices, and that has been trained to generate video data corresponding to the seat when the seat coordinates and the line of sight direction as seen from the seat to the stage of the event venue are input, generates video data of the seat corresponding to the purchased seat ticket by inputting the seat coordinates of the purchased seat ticket and the line of sight direction as seen from the seat to the stage; Outputting the generated video data to the user terminal; When accepting the purchase of the seat ticket, a seat ticket in the virtual space with an NFT (Non-fungible token) related to a performer of the event, which executes a smart contract to grant a part of the transfer fee to the event related person when the NFT is transferred to a third party, is selectively output, and a seat ticket in the virtual space without the NFT attached; A benefit for an event is output to the user terminal of the user who holds the NFT. An information processing method in which processing is performed by a computer.

2. When accepting the purchase of the seat ticket, the purchase of the seat ticket for the same seat is accepted from a plurality of people. The information processing method according to claim 1 .

3. receiving a user's reaction from the user terminal; The reaction is output to the event venue. The information processing method according to claim 1 .

4. The user terminal is a virtual reality (VR) device, The video data is output via the VR device. The information processing method according to claim 1 .

5. When accepting the purchase of the seat ticket, a preview display of past video data corresponding to the seat to be purchased is output to the user terminal. The information processing method according to claim 1 .

6. When accepting the purchase of the seat ticket, outputting a selection of seats for which the seat ticket can be purchased; The preview display corresponding to the seat selected by the user is output to the user terminal. The information processing method according to claim 5.

7. Allocating the seats to positions specialized for viewing a specific performer among a plurality of performers at the event venue; When accepting the purchase of the seat ticket, the assigned seat of each performer is output in an identifiable manner. The information processing method according to claim 1 .

8. When accepting the purchase of the seat ticket, a seat ticket in the real space and a seat ticket in the real space with a seat ticket in the virtual space attached are outputted in a selectable manner. The information processing method according to claim 1 .

9. Accepting the purchase of seat tickets in a virtual space corresponding to seats at an event venue; Acquire video data from a plurality of imaging devices arranged at seats in the event venue; If the imaging device is located at the seat for which the purchased ticket is assigned, video data acquired from the imaging device is output to the user terminal; If the imaging device is not installed in the seat of the purchased seat ticket, a model that has been trained with video data acquired from the multiple imaging devices, and that has been trained to generate video data corresponding to the seat when the seat coordinates and the line of sight direction as seen from the seat to the stage of the event venue are input, generates video data of the seat corresponding to the purchased seat ticket by inputting the seat coordinates of the purchased seat ticket and the line of sight direction as seen from the seat to the stage; Outputting the generated video data to the user terminal; When accepting the purchase of the seat ticket, a seat ticket in the virtual space with an NFT related to an event performer, which NFT executes a smart contract to grant a portion of the transfer fee to a person involved in the event when the NFT is transferred to a third party, is selectively output, and a seat ticket in the virtual space without the NFT; A benefit for an event is output to the user terminal of the user who holds the NFT. A program that causes a computer to carry out processing.

10. An information processing device including a control unit, The control unit is Accepting the purchase of seat tickets in a virtual space corresponding to seats at an event venue; Acquire video data from a plurality of imaging devices arranged at seats in the event venue; If the imaging device is located at the seat of the purchased seat ticket, video data acquired from the imaging device is output to a user terminal; If the imaging device is not installed in the seat of the purchased seat ticket, a model that has been trained with video data acquired from the multiple imaging devices, and that has been trained to generate video data corresponding to the seat when the seat coordinates and the line of sight direction as seen from the seat to the stage of the event venue are input, generates video data of the seat corresponding to the purchased seat ticket by inputting the seat coordinates of the purchased seat ticket and the line of sight direction as seen from the seat to the stage; Outputting the generated video data to the user terminal; When accepting the purchase of the seat ticket, a seat ticket in the virtual space with an NFT related to an event performer, which NFT executes a smart contract to grant a portion of the transfer fee to a person involved in the event when the NFT is transferred to a third party, is selectively output, and a seat ticket in the virtual space without the NFT; A benefit for an event is output to the user terminal of the user who holds the NFT. Information processing device.

11. a real-space seat ticket for a seat in a real space at an event venue where a plurality of imaging devices are arranged at the seats, a seat ticket in a virtual space corresponding to the seat at the event venue, or a seat ticket in the virtual space accompanied by an NFT related to an event performer, which, when transferred to a third party, executes a smart contract to grant a portion of the transfer fee to a person involved in the event, is displayed so as to be selectable for purchase; When a purchase of a seat ticket in the virtual space is accepted, if the imaging device is placed in the seat of the purchased seat ticket, video data at the time of the event acquired from the imaging device placed in the seat is displayed in real time; When the imaging device is not placed at the seat of the purchased seat ticket, the video data of the seat corresponding to the purchased seat ticket is displayed, the video data being generated by inputting the seat coordinates of the purchased seat ticket and the line of sight direction as seen from the seat to a model that has been trained with video data acquired from the multiple imaging devices and that has been trained to generate video data corresponding to the seat when the seat coordinates and the line of sight direction as seen from the seat to the stage of the event venue are input. A program that causes a computer to carry out processing.

12. Allocating the seats to positions specialized for viewing a plurality of performers at the event venue; When accepting the purchase of the seat ticket, the assigned seat of each performer is output in an identifiable manner. The program according to claim 11, which causes a computer to execute the process.

Images