Information processing device, user terminal, and information processing method

Abstract

[Problem] Conventionally, a video which is taken by means of a mobile terminal of a performer has not been usable during performance of the performer. [Solution] The present invention makes it possible to use a video which is taken by means of a mobile terminal of a performer during performance of the performer, by using an information processing device 1 comprising: a video reception unit 122 for receiving a video from one or more mobile terminals provided to a performer: a query reception unit 123 for receiving a query from a user terminal 3; a video acquisition unit 133 for acquiring a video corresponding to the performer who is matched with the query; and a video transmission unit 142 for transmitting, to the user terminal 3, the video acquired by the video acquisition unit 133.

Description

[Technical field]

[0001] The present invention relates to an information processing device or the like that receives video captured by a camera attached to a performer such as a soccer player or a theater performer, and provides the video in response to an instruction from a user. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been a technique for providing a user with image data captured by an on-board camera at a position and environment desired by the user (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-83034 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the prior art, it was not possible to utilize the video captured by the performer's mobile terminal while the performer was performing. [Means for solving the problem]

[0005] The information processing device of the first invention is an information processing device comprising a video receiving unit that receives video from one or more mobile terminals installed in the performers, a query receiving unit that receives queries from user terminals, a video acquisition unit that acquires video corresponding to performers that match the queries, and a video transmission unit that transmits the video acquired by the video acquisition unit to the user terminal.

[0006] With this configuration, video captured by the performer's mobile terminal during the performer's performance can be utilized.

[0007] In addition, the information processing device of the second invention, compared to the first invention, further includes an attribute value acquisition unit that acquires an attribute value of a performer, the inquiry receiving unit receives an inquiry including a performer condition related to the attribute value of the performer, the video acquisition unit acquires a video corresponding to a performer having an attribute value that matches the performer condition, and the video transmission unit transmits the video acquired by the video acquisition unit to a user terminal.

[0008] This configuration allows for videos of appropriate performers to be used.

[0009] In addition, the information processing device of the third invention is an information processing device according to the first or second invention, further comprising a video receiving unit that receives videos from a plurality of mobile terminals, a query receiving unit that receives a query including performer conditions that identify a plurality of performers, a video acquisition unit that acquires videos corresponding to each of a plurality of performers that match the performer conditions, and a video composition unit that composes one video using the plurality of videos acquired by the video acquisition unit, and a video sending unit that transmits the video composed by the video composition unit to a user terminal.

[0010] With this configuration, a single video can be created from videos of multiple performers.

[0011] In addition, compared to the third invention, the information processing device of the fourth invention is an information processing device in which the moving image composition unit combines multiple moving images in time or fuses multiple moving images spatially to compose a single moving image.

[0012] With this configuration, a single video can be created from videos of multiple performers.

[0013] In addition, the information processing device of the fifth invention is an information processing device according to any one of the first to fourth inventions, further comprising a processing unit which stores the video received by the video receiving unit, the video corresponding to time information which specifies the time when the video was taken, the inquiry receiving unit receives an inquiry including a time condition relating to the time when the video was taken, the video acquisition unit acquires from the videos accumulated by the processing unit those which satisfy the time condition, and the video transmission unit transmits the video acquired by the video acquisition unit to a user terminal.

[0014] This arrangement allows for video of the performer at the appropriate time to be available.

[0015] In addition, the information processing device of the sixth invention is an information processing device according to any one of the first to fifth inventions, further comprising a location receiving unit that receives location information from one or more mobile terminals, an object configuration unit that configures an operation object including the one or more location information received by the location receiving unit and for selecting a performer corresponding to each of the one or more location information, and an object sending unit that sends the operation object to the user terminal, wherein the query receiving unit receives a query based on the selection of one or more performers for the operation object, and the video acquisition unit acquires videos corresponding to the one or more performers that match the query.

[0016] This configuration can help the user to easily select a video.

[0017] In addition, the information processing device of the seventh invention is an information processing device in which, compared to any one of the first to sixth inventions, the video acquired by the video acquisition unit is associated with a right holder identifier that identifies the right holder of the video, and the information processing device further includes a right holder processing unit that performs right holder processing, which is processing related to the right holder identified by the right holder identifier associated with the video.

[0018] With this configuration, appropriate processing regarding the rights holder of the video can be carried out.

[0019] Further, the information processing apparatus of the eighth invention, with respect to the seventh invention, is an information processing apparatus comprising reward means for performing reward processing, which is processing for giving a reward to the performer identified by the performer identifier to which the video is associated, for the performer identified by the performer identifier.

[0020] With such a configuration, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.

[0021] Further, the information processing apparatus of the ninth invention, with respect to the eighth invention, is an information processing apparatus in which the reward means determines the reward for the previous performer using the video attribute value corresponding to the video and performs reward processing, which is processing for giving a reward.

[0022] With such a configuration, it is possible to give an appropriate reward to the rights holder of the video captured by the mobile terminal.

[0023] Further, the information processing apparatus of the tenth invention, with respect to the seventh invention, is an information processing apparatus comprising first preservation means for performing first preservation processing of associating and storing the video with a set of attribute values associated with the video.

[0024] With such a configuration, the video can be preserved.

[0025] Further, the information processing apparatus of the eleventh invention, with respect to the seventh invention, is an information processing apparatus comprising second preservation means for performing second preservation processing of associating and storing the video with a performer identifier corresponding to the video.

[0026] With such a configuration, the rights holder of the video can be made an appropriate rights holder.

[0027] Further, the information processing apparatus of the twelfth invention, with respect to the seventh invention, is an information processing apparatus comprising third preservation means for associating and storing the video with a rights holder identifier for identifying the user of the user terminal.

[0028] With this configuration, the rights holder of the video can become the rights holder who needs the video.

[0029] In addition, the information processing device of the thirteenth invention is an information processing device in which, with respect to any one of the tenth to twelfth inventions, the rights holder processing unit is equipped with a fourth preservation means that performs a fourth preservation process of storing preservation information including access information for accessing the video in a blockchain.

[0030] With this configuration, it is possible to preserve management information for moving images that need to be preserved.

[0031] In addition, the user terminal of the fourteenth invention is a user terminal comprising a screen acquisition unit that acquires an operation screen indicating a position specified by position information of one or more mobile terminals installed in the performer, a screen output unit that outputs the operation screen, a user reception unit that accepts video instructions, which are instructions to the mobile terminal in the operation screen, a user acquisition unit that acquires video shot by the mobile terminal in response to the video instructions, and a user output unit that outputs the video acquired by the user acquisition unit.

[0032] With this configuration, the user can easily select a video.

[0033] In addition, the user terminal of the fifteenth invention is a user terminal as described in claim 14, in comparison with the sixth invention, further comprising a user receiving unit that receives an operation object from an information processing device, and a screen acquisition unit that acquires an operation screen using the operation object, the user acquisition unit that constructs a query using a video instruction, transmits the query to the information processing device, and receives the video from the information processing device in response to the transmission of the query.

[0034] With this configuration, the user can easily select a video. Effect of the Invention

[0035] According to the information processing device of the present invention, video captured by the mobile terminal of the performer can be used while the performer is performing. [Brief description of the drawings]

[0036] [Figure 1] Conceptual diagram of information system A in embodiment 1. [Diagram 2] Block diagram of Information System A [Diagram 3] Block diagram of the information processing device 1 [Figure 4] A flowchart illustrating an example of the operation of the information processing device 1. [Diagram 5] A flowchart illustrating an example of the video transmission process. [Figure 6] A flowchart illustrating an example of the moving image fusion process. [Figure 7] A flowchart illustrating an example of the multiple window process. [Figure 8] A flowchart illustrating an example of the object configuration process. [Figure 9] A flowchart illustrating an example of the past video transmission process. [Figure 10] A flowchart illustrating an example of the maintenance process. [Figure 11] A flowchart illustrating an example of the fourth maintenance process. [Figure 12] A flowchart illustrating an example of the compensation process. [Figure 13] A flowchart for explaining an example of the operation of the mobile terminal 2 [Figure 14] A flowchart for explaining an example of the operation of the user terminal 3. [Figure 15] A diagram showing the terminal management table [Figure 16] The user management table [Figure 17] FIG. 13 shows an example of the operation screen. [Figure 18] A diagram showing an example of the output [Figure 19] Overview of the computer system [Figure 20] Block diagram of the computer system DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0037] Hereinafter, an embodiment of an information processing device and the like will be described with reference to the drawings. Note that, in the embodiments, components with the same reference numerals perform similar operations, and therefore repeated description may be omitted.

[0038] (Embodiment 1) <Outline of First Embodiment>

[0039] In this embodiment, an information processing device is described that receives video captured by a camera installed on a performer and provides the video in response to an instruction from a user terminal. Note that the performer may be, for example, a sports player such as a soccer player or a baseball player, a musician or a performer who performs in front of an audience, a horse racer, a jockey, a car racer, a boat racer, etc.

[0040] In this embodiment, an information processing device that transmits videos captured by the mobile terminals of one or more performers who meet the performer conditions to a user terminal will be described.

[0041] In the present embodiment, an information processing device is described that composes one moving image from multiple moving images of multiple performers and transmits the one moving image to a user terminal. Note that the one moving image is a moving image obtained by temporally or spatially synthesizing the multiple moving images.

[0042] In the present embodiment, an information processing device that receives an inquiry including time information for specifying a time and transmits a past video in response to the inquiry will be described. Note that the past video is a video that was shot and stored in the past.

[0043] In addition, in this embodiment, an information processing device that receives position information of a performer, configures an operational object that clearly indicates the position of the performer indicated by the position information, and transmits the operation object to a user terminal will be described.

[0044] In addition, in this embodiment, an information processing device that performs right holder processing, which is processing related to the right holder of the output video, will be described. The right holder processing is, for example, a remuneration process described later and various security processes described later. The right holder is, for example, a performer or a user who has requested the video.

[0045] Furthermore, in this embodiment, a user terminal that outputs a screen that enables the user to easily select a video of a performer will be described.

[0046] In this embodiment, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>

[0047] 1 is a conceptual diagram of an information system A according to the present embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.

[0048] The information processing device 1 is a server that provides a user terminal 3 with video transmitted from one or more mobile terminals 2. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type is not important. The information processing device 1 may also be a device that constitutes a blockchain.

[0049] In this specification, the time interval between the capture of each of the multiple still images included in the moving image does not matter. The moving image is, for example, a 60 frame / second moving image or a 30 frame / second moving image, but it may also be a collection of multiple still images captured with an interval of a predetermined time (for example, one minute) or more, or a collection of multiple still images captured when a predetermined condition is satisfied. The still images may also be called fields or frames.

[0050] The mobile terminal 2 is a terminal that can move. The mobile terminal 2 is a terminal installed on the performer. A terminal installed on the performer is a terminal installed on something worn by the performer (e.g., glasses, uniform, helmet) or an object operated by the performer (e.g., automobile, motorcycle). The mobile terminal 2 is a terminal that shoots video. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, glasses with a camera, or a smart watch with a camera. Furthermore, "installed" usually means "fixed," but it may also be considered to include being in contact with or held to the extent that it is held.

[0051] The user terminal 3 is a terminal used by a user. A user is someone who watches videos or needs videos. The user terminal 3 may have the functions of the mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may be, for example, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and the type of the terminal is not important.

[0052] The information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3 are generally capable of communicating with each other via a network such as the Internet.

[0053] Fig. 2 is a block diagram of an information system A according to the present embodiment, and Fig. 3 is a block diagram of an information processing device 1.

[0054] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a terminal management unit 111, and a user management unit 112. The receiving unit 12 includes a location receiving unit 121, a video receiving unit 122, and an inquiry receiving unit 123. The processing unit 13 includes an attribute value acquiring unit 131, an object composing unit 132, a video acquiring unit 133, a video composing unit 134, and a right holder processing unit 135. The right holder processing unit 135 includes a first security means 1351, a second security means 1352, a third security means 1353, a fourth security means 1354, and a remuneration means 1355. The transmitting unit 14 includes an object transmitting unit 141, and a video transmitting unit 142.

[0055] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, a moving transmitting unit 24, and a moving output unit 25. The moving processing unit 23 includes a position acquisition unit 231, a shooting unit 232, an attribute value acquisition unit 233, and a configuration unit 234. The moving transmitting unit 24 includes a position transmission unit 241 and a moving video transmission unit 242. The moving output unit 25 includes a video output unit 251.

[0056] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit 34, a user reception unit 35, and a user output unit 36. The user processing unit 33 includes a screen acquisition unit 331 and a user acquisition unit 332. The user output unit 36 ​​includes a screen output unit 361. <Details of components of information processing device 1>

[0057] Various types of information are stored in the storage unit 11. The various types of information are, for example, terminal information, which will be described later, user information, which will be described later, a moving image, and an additional moving image. An additional moving image is a moving image and one or more moving image attribute values ​​associated with the moving image. It is preferable that the additional moving image is a moving image associated with one or more moving image attribute values. It is preferable that a terminal identifier is associated with the additional moving image.

[0058] The video attribute value is an attribute value of the video. The video attribute value is, for example, environmental information. The environmental information is information about the environment in which the video was taken. The environmental information is, for example, location information and time information, which will be described later. The environmental information may include, for example, weather information, temperature information, season information, and the like. The time information is information that specifies the time when the video was taken. The time when the video was taken may be a time around the time when the video was taken, and accuracy is not required. The time information is, for example, the time, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / date, and month / day. In other words, the granularity of the time indicated by the time information does not matter. The weather information is information that specifies the weather at the location (or region) where the video was taken. The weather information is, for example, "sunny", "rain", "snow", and "cloudy". The temperature information is information that specifies the temperature at the location where the video was taken at the time when the video was taken. The temperature information is, for example, "25 degrees" and "above 30 degrees". The season information is information that specifies the season at the location where the video was taken. The season information is, for example, "spring", "summer", "early summer", and "winter".

[0059] The video attribute value may be a tag. A tag is information that indicates the content of a video. It is preferable that a tag is the result of analyzing one or more still images included in a video. For example, a tag is "goal" indicating that a goal has been scored in a soccer game, or "home run" indicating that a home run has been hit in a baseball game.

[0060] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information related to the mobile terminal 2. The terminal information here usually includes a terminal identifier that is an identifier of the mobile terminal 2, and one or more pieces of location information. It is preferable that the one or more pieces of location information are the latest location information of the mobile terminal 2. The terminal information may include terminal communication information. The terminal information may have one or more attribute values.

[0061] The terminal identifier is information for identifying the mobile terminal 2. The terminal identifier may be a performer identifier for identifying a performer who is a user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2. The performer identifier is, for example, the ID of the performer, the name of the performer, the email address of the performer, or the telephone number of the performer.

[0062] Location information is information that identifies a location. For example, location information is (latitude, longitude) or (movement, longitude, altitude). Location information may be information that indicates the relative position of a venue (e.g., a soccer field) where a sport is being played.

[0063] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of a communication application installed in the mobile terminal 2.

[0064] An attribute value is an attribute value of a performer. An attribute value may be, for example, a static attribute value or a dynamic attribute value. A static attribute value is a static attribute value of a performer. An example of a static attribute value is a position in soccer or baseball (e.g., "goalkeeper," "forward," or "catcher"), or an instrument played by a performer. A dynamic attribute value is an attribute value that changes dynamically during a performance. An example of a dynamic attribute value is position information of a performer, a role during the progress of a game in soccer or baseball (e.g., "ball holder," "penalty kicker," "batter," or "pitcher"), or information indicating whether or not a performer is holding the ball.

[0065] The user management unit 112 stores one or more pieces of user information. The user information is information related to a user. The user information includes, for example, a user identifier. The user information includes, for example, a performer condition. The user information includes, for example, one or more user attribute values.

[0066] A user identifier is information for identifying a user. The user identifier is, for example, an ID, a telephone number, an email address, a name, or an identifier of the user terminal 3. The identifier of the user terminal 3 is, for example, an IP address or a MAC address.

[0067] A performer condition is a condition for determining a video to be provided to a user. A performer condition is, for example, an attribute value condition or a specific condition. An attribute value condition is a condition related to the attribute value of a performer. An attribute value condition is, for example, "goalkeeper," "penalty kicker," or "ball holder." A specific condition is a condition for identifying a specific performer. A specific condition typically has one or more performer identifiers. For example, a specific condition is "performer identifier=101" or "performer identifier=101, 102."

[0068] The user attribute value is, for example, gender, age, and payment information. The payment information is information for paying a fee for enjoying services such as viewing videos and purchasing videos. The payment information is, for example, a bank account number, a credit card number, and a payment application ID.

[0069] The receiving unit 12 receives various information and instructions from the mobile terminal 2 or the user terminal 3. The various information and instructions are, for example, location information, inquiries, videos, additional videos described later, stop instructions described later, and purchase instructions described later.

[0070] The receiver 12 may receive video from one or more mobile terminals 2 in pairs with the location information. In such a case, it is preferable for the receiver 12 to continuously receive the video. Continuous reception means, for example, receiving periodically or receiving all the time. The intervals between periods may vary slightly.

[0071] The receiving unit 12 continuously receives, for example, position information of a ball during a match. In this case, a module for acquiring position information and transmitting the position information is embedded in the ball.

[0072] The location receiving unit 121 receives location information from one or more mobile terminals 2. It is preferable that the location receiving unit 121 continuously receives the latest location information from one or more mobile terminals 2. The location receiving unit 121 may receive from the mobile terminal 2 one or more sets of location information corresponding to videos stored in the mobile terminal 2. The location receiving unit 121 normally receives the location information in association with a terminal identifier. It is preferable that the location information is associated with one or more still images in the video.

[0073] The video receiving unit 122 receives video from one or more mobile terminals 2 installed in the performer. It is preferable that the video receiving unit 122 receives video from a plurality of mobile terminals 2. It is preferable that the video receiving unit 122 continuously receives video from one or more mobile terminals 2. It is preferable that such video is associated with one or more video attribute values. Such video is usually associated with location information and a performer identifier. It is preferable that time information is associated with the video.

[0074] The inquiry receiving unit 123 receives an inquiry from the user terminal 3. A inquiry is a request for a video. A query typically includes a performer condition. A query may be for retrieving a current video or for retrieving a past video. A query may include a performer condition that identifies multiple performers. A query may include a time condition relating to when the video was shot. It is preferable that a query is based on a selection of one or more performers for an operation object output on the user terminal 3.

[0075] The current video is a video that is immediately transmitted after being captured by the mobile terminal 2. The past video is a video that was previously captured by the mobile terminal 2, received by the information processing device 1, and stored once in a recording medium.

[0076] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by an attribute value acquisition unit 131, an object configuration unit 132, a moving image acquisition unit 133, a moving image configuration unit 134, and a right holder processing unit 135. The processing unit 13 accumulates the moving image received by the moving image receiving unit 122, for example.

[0077] The attribute value acquisition unit 131 acquires one or more attribute values ​​of a performer. The attribute value may be a static attribute value or a dynamic attribute value.

[0078] The attribute value acquisition unit 131 reads, for example, static attribute values ​​associated with the mobile terminal 2 from the terminal management unit 111. Association with the mobile terminal 2 usually means association with a performer identifier.

[0079] The attribute value acquisition unit 131 acquires, for example, a dynamic attribute value. For example, the attribute value acquisition unit 131 acquires, in a pair with the received ball position information, the attribute value "ball holder" of the performer identified by the performer identifier that is paired with position information that satisfies a similarity condition with the received ball position information, in a pair with the performer identifier. The similarity condition is, for example, that the two pieces of position information are within a threshold value, or that the position information is the one that has the smallest distance from the ball position information.

[0080] The attribute value acquisition unit 131 acquires, for example, the attribute value "PK kicker" of the performer corresponding to the position information of the position where the penalty kick is taken and the position information that satisfies the similarity condition. For example, when the attribute value acquisition unit 131 detects that the difference between the received position information of the ball and the position information of the position where the penalty kick is taken is within a threshold (for example, within 30 cm) for a period of time or longer, the attribute value acquisition unit 131 acquires the attribute value "PK kicker" of the performer corresponding to the position information of the position where the penalty kick is taken and the position information that satisfies the similarity condition. It is assumed that the position information of the position where the penalty kick is taken is stored in the storage unit 11 in advance.

[0081] The attribute value acquiring section 131 may perform, for example, the same processing as that performed by the attribute value acquiring section 233 described later to acquire tags from a video.

[0082] The object configuration unit 132 configures an operation object for selecting a performer corresponding to each of the one or more pieces of position information, including one or more pieces of position information of the performers received by the position receiving unit 121. The operation object is, for example, a screen or window including a moving object (e.g., a button) that can be selected by each of the one or more pieces of position information received by the position receiving unit 121.

[0083] The video acquisition unit 133 acquires videos corresponding to one or more performers who match the received inquiry. Note that a performer who matches the inquiry can also be referred to as a mobile terminal 2 that matches the inquiry. A video corresponding to a performer is a video transmitted by the mobile terminal 2 of the performer.

[0084] It is preferable that the video acquisition unit 133 acquires a video corresponding to a performer having an attribute value that matches the performer condition. The video acquisition unit 133 may acquire a video corresponding to each of a plurality of performers that match the performer condition.

[0085] The video acquisition unit 133 acquires past videos that match the query from among the past videos accumulated by the processing unit 13. The video acquisition unit 133 may acquire past videos that satisfy a time condition from among the past videos accumulated by the processing unit 13. For example, the video acquisition unit 133 acquires past videos that match a time condition that specifies the time when player A scores a goal from the accumulated past videos, and that are X seconds before and after that time.

[0086] The moving image composing unit 134 composes one moving image using the multiple moving images acquired by the moving image acquiring unit 133 .

[0087] The video composition unit 134, for example, combines the multiple videos acquired by the video acquisition unit 133 in time to compose one video. It is preferable that each of the multiple videos is a video taken by a different mobile terminal 2. Note that one video combined in time is one video that connects multiple original videos. When the multiple videos that are the source of one video combined in time are taken, it is preferable that they are continuous in time, but they may be separated in time. For example, the time when one video that is the source of one video was taken may be, for example, 8:20, and the day when another video that is the source of one video was taken may be, for example, 8:25. The multiple videos that are the source of one video combined in time are, for example, videos corresponding to the attribute value "ball holder". One video combined in time is appropriately called a combined video.

[0088] Furthermore, the moving image composition unit 134, for example, spatially fuses the multiple moving images acquired by the moving image acquisition unit 133 to compose one moving image. A spatially fused moving image is a moving image that is constructed by constructing a frame using some or all of the frames that constitute each of the multiple original moving images for each of the multiple frames that constitute each of the multiple original moving images, and connecting the constructed frames in time. At least one of the frames that constitute the single moving image is a frame that has some or all of the frames of each of the multiple original moving images. A spatially fused moving image is appropriately called a fused moving image.

[0089] The process of spatially fusing frames included in each of a plurality of moving images is, for example, the following processes (a) and (b). (a) Image processing-based methods

[0090] The moving image composing unit 134 performs, for example, a process of aligning the directions of the multiple frames that are the subject of the spatial connection process. Next, the moving image composing unit 134 detects, for example, identical regions in the multiple frames. Next, the moving image composing unit 134 performs, for example, a process of overlapping multiple frames having the same region to compose one wide-area frame. Note that it is possible to detect the same region in multiple frames using publicly known technology. (b) Machine learning-based methods

[0091] The video composition unit 134, for example, provides a plurality of frames and a learning model to a module that performs machine learning prediction processing, executes the module, and acquires one wide-area frame.

[0092] The learning model is obtained by providing multiple teacher data sets, which have multiple frames as explanatory variables and a wide-area frame composed of the multiple frames as the objective variable, to a module that performs machine learning learning processing, executing the module, and so on.

[0093] The learning model may be called a learner, a classifier, a classification model, etc. The machine learning algorithm is preferably deep learning, but may be random forest, etc. For machine learning, various machine learning functions such as the TensorFlow library and the random forest module of the R language, and various existing libraries may be used.

[0094] The moving image composing unit 134 may perform processing up to passing one moving image acquired by the moving image acquiring unit 133 to the moving image transmitting unit 142. Such processing may also be considered as processing for composing one moving image. The processing up to passing to the moving image transmitting unit 142 is usually processing for sequentially arranging the moving images in a buffer for transmitting the moving images.

[0095] The right holder processing unit 135 performs right holder processing. The right holder processing is processing related to a right holder identified by a right holder identifier associated with a video. The right holder identifier is usually a performer identifier, but may be a user identifier. The right holder processing unit 135 performs right holder processing, which is processing in response to the video transmission unit 142 transmitting a video, for example, and is processing related to a right holder identified by a right holder identifier associated with the video. The right holder processing is, for example, a first security processing described below, a second security processing described below, a third security processing described below, a fourth security processing described below, and a remuneration processing described below.

[0096] The right holder identifier associated with a video is, for example, a right holder identifier associated with one or more videos that are the source of the video, or an identifier of a user who requested the video. The user who requested the video is the user of the user terminal 3 that sent the inquiry.

[0097] The first maintenance means 1351 performs a first maintenance process of storing a moving image composed by the moving image composition unit 134 in association with an attribute value set corresponding to one or more original moving images. The first maintenance means 1351 may also perform a first maintenance process of storing a moving image received from the mobile terminal 2 in association with an attribute value set corresponding to the moving image. The attribute value set is one or more moving image attribute values.

[0098] The second security means 1352 performs a second security process of storing one moving image composed by the moving image composition unit 134 in association with a right holder identifier corresponding to one or more original moving images that are the basis of the one moving image.

[0099] In addition, the first maintenance means 1351 or the second maintenance means 1352 may store a video composed by the video composition unit 134 in association with a set of attribute values ​​corresponding to one or more videos that were the basis of the video, and with a rights holder identifier corresponding to one or more videos that were the basis of the video.

[0100] The third security means 1353 stores one video composed by the video composition unit 134 in association with a right holder identifier that identifies the user of the user terminal 3. The user of the user terminal 3 here is a person who watches one video. The user terminal 3 here is, for example, a terminal that has sent an inquiry. The right holder identifier here is a user identifier.

[0101] Also, the destination where one video is stored is, for example, the storage unit 11, but it may also be another device, such as another device that constitutes a blockchain.

[0102] The fourth security means 1354 performs a fourth security process to store security information. The security information includes access information for accessing one stored video. The order of storing a video and performing the fourth security process on the security information corresponding to that video does not matter.

[0103] The fourth maintenance means 1354 performs a fourth maintenance process, for example, of storing maintenance information including access information for accessing one stored video composed by the video composition unit 134 in the blockchain.

[0104] In addition, it is preferable that the fourth maintenance means 1354 accumulates the maintenance information in a blockchain. That is, it is preferable that the fourth maintenance means 1354 accumulates the maintenance information in a distributed ledger of the blockchain. It is preferable that the fourth maintenance means 1354 registers the maintenance information as an NFT (non-fungible token). It is preferable that the fourth maintenance means 1354 registers the maintenance information in a distributed file system in an IPFS (Inter Planetary File System) network.

[0105] The preservation information is information for ensuring the originality of a video. It can be said that the preservation information is heading information for a video. The preservation information is, for example, access information and a set of attribute values. It is preferable that the preservation information has, for example, one or more right holder identifiers. When the preservation information has multiple right holder identifiers, the right holder of the video may be shared, and the multiple right holder identifiers may be right holder history information. The right holder history information is a set of right holder identifiers and is information indicating the history of the right holder. The fourth preservation process can ensure the originality of the preservation information of the registered video. By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. The access information is information for accessing a video. The access information is information that identifies the storage destination of the video. The access information is, for example, a URL or a URI.

[0106] It is preferable that the security information includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.

[0107] The remuneration means 1355 performs remuneration processing for each right holder identified by a right holder identifier associated with one or more moving images that are the basis of one moving image composed by the moving image composition unit 134 .

[0108] The reward process is a process of giving a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more right holder identifiers corresponding to a video. The reward process is, for example, a process of making a payment to a right holder identified by one or more right holder identifiers corresponding to a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a right holder identified by one or more right holder identifiers corresponding to a video. The reward process may be of any kind as long as it gives a merit to a right holder identified by one or more right holder identifiers corresponding to a video. The reward may be, for example, money, points, goods, content, or the like, and the content may be of any kind.

[0109] It is preferable that the reward means 1355 performs reward processing, which is a process of acquiring one or more video attribute values ​​corresponding to one or more videos that are the basis of a video transmitted by the video transmission unit 142, determining rewards for each of multiple rights holders using the one or more video attribute values, and awarding the rewards.

[0110] Here, the one or more moving image attribute values ​​are, for example, the amount of data of the moving image, the duration of the moving image, the number of frames of the moving image, and the resolution of the moving image.

[0111] It is preferable that the reward means 1355 performs a reward process, which is a process of acquiring a reward amount corresponding to a service identifier that identifies a service provided to a target video, and giving a reward corresponding to the reward amount. The service identifier is, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.

[0112] The reward means 1355 performs reward processing, which is a process of acquiring a reward amount using, for example, one or more pieces of information among one or more video attribute values ​​and one or more service identifiers, and giving a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of the multiple service identifiers is stored in the storage unit 11. The arithmetic expression is an expression for calculating the reward amount using one or more video attribute values ​​as parameters. The correspondence table is a table having multiple pieces of correspondence information for managing reward amounts corresponding to one or more video attribute values.

[0113] The remuneration means 1355 normally performs a process of charging a user who has enjoyed a service related to the target video with a remuneration. The process of charging a remuneration is, for example, a process of charging the amount of remuneration acquired. The process of charging a remuneration is, for example, a process of charging the amount of remuneration acquired and the amount of profit obtained by the management of the information processing device 1. The process of charging a remuneration is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc.

[0114] The transmission unit 14 transmits various types of information or instructions to the mobile terminal 2 or the user terminal 3. The various types of information or instructions are, for example, an operation object or a moving image. Note that the moving image may be an additional moving image.

[0115] The object transmitting unit 141 transmits the operation object constructed by the object constructing unit 132 to the user terminal 3 .

[0116] The video sending unit 142 sends the video acquired by the video acquiring unit 133 to the user terminal 3. Such a user terminal 3 is usually the user terminal 3 that has sent the inquiry. It is preferable that the video sending unit 142 sends the video composed by the video composing unit 134 to the user terminal 3. <Details of components of mobile terminal 2>

[0117] Various types of information are stored in the movement storage unit 21. The various types of information are, for example, a moving image, an attribute value set, a performer identifier, and a camera attribute value. The camera attribute value is an attribute value of a camera. The camera attribute value is, for example, an angle of view, direction information, and resolution.

[0118] For example, one or more moving image attribute values ​​constituting an attribute value set correspond to one or more still images constituting a moving image. The one or more moving image attribute values ​​may correspond to all still images, may correspond to some of the still images, or may correspond to multiple still images.

[0119] The mobile receiving unit 22 receives various types of information. The various types of information are, for example, a transmission instruction. The mobile instruction receiving unit 221 receives a transmission instruction from the information processing device 1. The transmission instruction is an instruction to transmit a moving image.

[0120] The movement processing unit 23 performs various types of processing. The various types of processing are, for example, processing performed by the position acquisition unit 231, the shooting unit 232, the attribute value acquisition unit 233, and the composition unit 234. Note that the movement processing unit 23 does not necessarily have to include the attribute value acquisition unit 233 and the composition unit 234.

[0121] The position acquisition unit 231 acquires position information. The position acquisition unit 231 usually acquires position information that specifies the position of the mobile terminal 2. The position acquisition unit 231 acquires the position information by, for example, a GPS receiver. However, the means and algorithm by which the position acquisition unit 231 acquires the position information are not important.

[0122] The photographing unit 232 photographs a moving image. For example, the photographing unit 232 photographs a moving image while the mobile terminal 2 is moving. It is preferable that the photographed moving image is associated with location information acquired by the location acquisition unit 231. It is preferable that the photographed moving image is associated with one or more moving image attribute values ​​acquired by the attribute value acquisition unit 233 described later. It is preferable that the mobile terminal 2 is moving when a performer is moving.

[0123] It is preferable that the imaging unit 232 stores the captured video in the moving storage unit 21. When storing video in the moving storage unit 21 with a limited storage capacity, it is preferable that the imaging unit 232 overwrites new video in the area in which the old video is stored. In other words, it is preferable that the structure of the moving storage unit 21 is a ring buffer structure.

[0124] The attribute value acquisition unit 233 acquires one or more camera attribute values ​​including direction information indicating the direction in which the image is captured by the image capture unit 232. It is preferable that the attribute value acquisition unit 233 acquires one or more video attribute values ​​including the camera attribute value.

[0125] The attribute value acquisition unit 233 acquires, for example, one or more moving image attribute values. The one or more moving image attribute values ​​may be called an attribute value set.

[0126] The attribute value acquisition unit 233 acquires time information, which is the time, from a clock (not shown), for example. The attribute value acquisition unit 233 acquires time information, which is the time from the start of a match, from a timer (not shown), for example. The attribute value acquisition unit 233 acquires time information, which is the time, from a timer (not shown), for example. The attribute value acquisition unit 233 acquires time information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.

[0127] The attribute value acquisition unit 233 acquires time information from a clock (not shown) during shooting, for example, and acquires seasonal information corresponding to the time information. The attribute value acquisition unit 233 acquires weather information during shooting, for example. Even if the shooting location is indoors, the weather information may be information about the weather in the same area as the indoor location. The movement processing unit 23 acquires weather information corresponding to the location information from a server (not shown), for example. The movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied. The attribute value acquisition unit 233 acquires temperature information during shooting, for example. The movement processing unit 23 acquires temperature information corresponding to the location information from a server (not shown), for example. The movement processing unit 23 acquires temperature information from a temperature sensor installed in a moving object, for example. The movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied. The acquisition condition is, for example, when the analysis result of the video satisfies a predetermined condition.

[0128] The attribute value acquisition unit 233 acquires, for example, one or more tags for the moving image captured by the shooting unit 232, and associates the tags with the moving image. Note that a tag can also be considered as a moving image attribute value.

[0129] The attribute value acquisition unit 233, for example, analyzes a moving image captured by the image capture unit 232, and acquires one or more tags for the moving image.

[0130] The attribute value acquisition unit 233, for example, determines one or more still images that match the video tag condition, and acquires a tag that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.

[0131] For example, if the video tag condition is "the size of the ball in the still image is equal to or larger than a threshold value," the attribute value acquisition unit 233 analyzes frames of the video, recognizes the ball, acquires the size of the ball, and determines whether the size matches the video tag condition. If the video tag condition is satisfied, the attribute value acquisition unit 233 acquires a tag "ball holder" that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "ball holder" with the analyzed frame of the video.

[0132] The composition unit 234 associates the acquired position information with the moving image and acquires the additional moving image. Note that association with a moving image usually means association with one or more still images in the moving image. For example, the composition unit 234 associates the acquired position information with one or more still images acquired at the same timing as the acquisition of the position information.

[0133] The configuration unit 234 acquires an additional moving image in which, for example, one or more camera attribute values ​​acquired by the attribute value acquisition unit 233 are also associated with the moving image.

[0134] The configuration unit 234 acquires an additional moving image in which, for example, one or more moving image attribute values ​​acquired by the attribute value acquisition unit 233 are also associated with the moving image. The additional moving image is a moving image to which one or more moving image attribute values ​​are added. Such one or more moving image attribute values ​​usually include position information. Each of the one or more moving image attribute values ​​usually corresponds to one or more still images in the moving image.

[0135] The mobile transmission unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, position information, moving images, and additional moving images. It is preferable that the mobile transmission unit 24 continuously transmits the moving images acquired by the shooting unit 232 to the information processing device 1. In such a case, it is preferable that the moving images are associated with position information and a performer identifier.

[0136] The position transmission unit 241 transmits the position information acquired by the position acquisition unit 231 to the information processing device 1. Such position information is usually associated with a performer identifier.

[0137] It is preferable that the location transmission unit 241 continuously transmits the location information to the information processing device 1. "Continuously" may include "always" or "periodically." "Periodic" means that the transmission interval may vary to some extent. There is no restriction on the frequency or interval at which the location transmission unit 241 transmits the location information.

[0138] The moving video transmission unit 242 transmits the video. It is preferable that the moving video transmission unit 242 continuously transmits the video to the information processing device 1. Note that such a video may be an additional video. Also, a performer identifier is usually associated with the video.

[0139] The movement video transmitting section 242 may transmit the video captured by the imaging section 232 in response to the movement instruction receiving section 221 receiving the transmission instruction.

[0140] The mobile output unit 25 outputs various types of information. The various types of information are, for example, a moving image, an additional moving image, and a set of attribute values. Note that the mobile terminal 2 does not necessarily have to include the mobile output unit 25.

[0141] Output is a concept that includes displaying on a display, projecting using a projector, printing on a printer, outputting sound, transmitting to an external device, storing on a recording medium, and passing on the processing results to other processing devices or other programs.

[0142] The video output unit 251 outputs a video. It is preferable that the video output unit 251 outputs an additional video. The output here may be accumulation in the moving storage unit 21. <Details of components of user terminal 3>

[0143] Various types of information are stored in the user storage unit 31. The various types of information include, for example, a user identifier, a video, an inquiry, and background information.

[0144] Background information is information that includes information that constitutes an image of the place where the performer is performing. Background information includes, for example, a background image of a soccer field or a baseball stadium. Background information includes, for example, objects for inputting performer conditions. Objects are, for example, buttons, check boxes, and menu items. Background information is, for example, an image, but the data type is not important.

[0145] The user reception unit 32 receives various instructions and information. The various instructions and information are, for example, an inquiry, a video instruction, and a stop instruction. Note that an inquiry may include a video instruction or a purchase instruction.

[0146] Reception is a concept that includes the reception of information input from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.

[0147] The means for inputting various instructions and information may be any means, such as a touch panel, a keyboard, a mouse, or a menu screen.

[0148] The inquiry may include a rights owner transfer flag, which is information indicating that the rights owner of the video is to be transferred.

[0149] An animation instruction is an instruction to output an animation. An animation instruction is an instruction to the mobile terminal 2 on the operation screen. An animation instruction usually includes a performer condition. Note that the mobile terminal 2 on the operation screen may be said to be a performer on the operation screen.

[0150] The stop instruction is an instruction to stop transmission of video.

[0151] A purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information identifying the video. The purchase instruction has, for example, a video identifier. The purchase instruction has, for example, time information. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, a purchase amount. The purchase conditions include, for example, information identifying the rights period.

[0152] The user processing unit 33 performs various processes. For example, the various processes are processes for creating a data structure for transmitting various instructions and information received by the user receiving unit 32. For example, the various processes are processes for creating a structure for transmitting information received by the user receiving unit 35.

[0153] The user processing unit 33 uses the received video instruction to construct a query that includes, as a performer condition, the performer identifier to which the video instruction corresponds.

[0154] When a video instruction for the screen based on the operation object is accepted, the user processing unit 33 configures an inquiry including, for example, a flag indicating that real-time video is to be acquired.

[0155] When an inquiry to acquire a past video is accepted, the user processing unit 33 constructs an inquiry including, for example, a flag to acquire a past video.

[0156] The screen acquisition unit 331 acquires an operation screen indicating a position specified by the position information of each of one or more mobile terminals 2. For example, the screen acquisition unit 331 acquires the operation screen by using the received operation object. For example, the screen acquisition unit 331 configures a screen indicating the received one or more pieces of position information in the background information of the user storage unit 31.

[0157] The user acquisition unit 332 acquires a video captured by the mobile terminal 2 in response to a video instruction accepted by the user acceptance unit 32. The user acquisition unit 332 acquires a video received by the user reception unit 35, for example.

[0158] The user acquisition unit 332, for example, composes an inquiry using the video instruction accepted by the user acceptance unit 32. Next, the user acquisition unit 332, for example, transmits the inquiry to the information processing device 1. Next, the user acquisition unit 332 receives the video from the information processing device 1 in response to the transmission of the inquiry, for example.

[0159] The user transmission unit 34 transmits various instructions and information to the information processing device 1. The various instructions and information are, for example, an inquiry, a video instruction, a stop instruction, and a purchase instruction.

[0160] The user receiving unit 35 receives an operation object from the information processing device 1.

[0161] The user receiving unit 35 receives the moving image in response to the transmission of the inquiry. The user receiving unit 35 normally receives the moving image from the information processing device 1. Note that the moving image may be an additional moving image.

[0162] The user output unit 36 ​​outputs the video acquired by the user acquisition unit 332. The user output unit 36 ​​outputs the video received by the user reception unit 35, for example.

[0163] Here, output is a concept that includes display on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and handing over the processing results to other processing devices or other programs, etc.

[0164] The screen output unit 361 outputs the operation screen acquired by the screen acquisition unit 331 .

[0165] The storage unit 11, the terminal management unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.

[0166] There is no restriction on the process by which information is stored in the storage unit 11, etc. For example, information may be stored in the storage unit 11, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 11, etc., or information inputted via an input device may be stored in the storage unit 11, etc.

[0167] The receiving unit 12, the location receiving unit 121, the video receiving unit 122, the inquiry receiving unit 123, the mobile receiving unit 22, and the user receiving unit 35 are typically realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.

[0168] The processing unit 13, the attribute value acquisition unit 131, the object configuration unit 132, the video acquisition unit 133, the video configuration unit 134, the right holder processing unit 135, the first security means 1351, the second security means 1352, the third security means 1353, the fourth security means 1354, the reward means 1355, the movement processing unit 23, the user processing unit 33, the screen acquisition unit 331, and the user acquisition unit 332 can usually be realized by a processor, a memory, or the like. The processing procedure of the processing unit 13, etc. is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). The processor is a CPU, an MPU, a GPU, etc., and the type does not matter.

[0169] The transmitting unit 14, the object transmitting unit 141, the video transmitting unit 142, the moving transmitting unit 24, the position transmitting unit 241, the moving video transmitting unit 242, and the user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.

[0170] The position acquisition unit 231 is realized by, for example, a GPS receiver.

[0171] The image capturing unit 232 includes a camera capable of capturing moving images. Note that any type of camera may be used.

[0172] The movement output unit 25, the video output unit 251, the user output unit 36, and the screen output unit 361 may be considered to include or not include output devices such as a display, a speaker, etc. The movement output unit 25 may be realized by driver software for an output device, or a combination of driver software for an output device and an output device, etc.

[0173] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen. <Operation>

[0174] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described with reference to the flowchart of Fig. 4. Note that "S" in each flowchart used in the following description indicates a step.

[0175] (S401) The receiving unit 12 judges whether or not additional moving images have been received from the mobile terminal 2. If additional moving images have been received, the process proceeds to S402, and if additional moving images have not been received, the process proceeds to S407. The received additional moving images are associated with a performer identifier.

[0176] (S402) The processing unit 13 stores the additional moving image received in S401 in association with the performer identifier.

[0177] (S403) The processing unit 13 acquires the position information contained in the additional moving image.

[0178] (S404) The processing unit 13 stores the position information acquired in S403 in pairs with the performer identifier that pairs with the additional moving image. Note that the storage destination of the position information is, for example, the storage unit 11, but is not limited thereto.

[0179] (S405) The processing unit 13 judges whether or not to transmit the location information accumulated in S404 to one or more user terminals 3. If it is to be transmitted, the process proceeds to S406, and if it is not to be transmitted, the process returns to S401.

[0180] The location information is transmitted, for example, when user information is managed by the user management unit 112. The location information is transmitted in order to inform the user terminal 3 of the latest location information of the performer.

[0181] (S406) The transmission unit 14 transmits the position information accumulated in S404 in pairs with the performer identifier to one or more user terminals 3. Return to S401.

[0182] The one or more user terminals 3 to which the location information is transmitted are the user terminals 3 corresponding to the user information managed by the user management unit 112.

[0183] (S407) The inquiry receiving unit 123 judges whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S408; if an inquiry has not been received, the process proceeds to S416. Note that an inquiry is usually associated with the user identifier of the user who sent the inquiry. The inquiry here may also be an indication of an intention to set performer conditions. If the inquiry is an indication of an intention to set performer conditions, the performer conditions do not need to be stored in S409.

[0184] (S408) The processing unit 13 judges whether the inquiry received in S407 is an instruction to transmit real-time video or an instruction to transmit past video. If it is an instruction to transmit real-time video, the process proceeds to S409, and if it is an instruction to transmit past video, the process proceeds to S414.

[0185] Here, the processing unit 13 judges, for example, whether the flag in the inquiry is a flag indicating that a real-time video is to be acquired or a flag indicating that a past video is to be acquired.

[0186] (S409) The processing unit 13 stores in the user management unit 112 the performer condition included in the received inquiry in a pair with the user identifier paired with the inquiry.

[0187] (S410) The processing unit 13 determines whether or not to transmit moving images to the user terminal 3 that has sent the inquiry. If the moving images are to be transmitted, the process proceeds to S411. If the moving images are not to be transmitted, the process proceeds to S412.

[0188] Note that a video is usually transmitted when a performance is in progress. A video is transmitted when, for example, a flag indicating that a performance is in progress is stored in storage unit 11. Note that the flag is information used for judgment.

[0189] (S411) The moving image acquiring unit 133 and the like perform a moving image transmission process to the user terminal 3 that has sent the inquiry. Return to S401. An example of the moving image transmission process will be described with reference to the flowchart in FIG.

[0190] (S412) Object configuration unit 132 performs object configuration processing. An example of the object configuration processing will be described with reference to the flowchart in Fig. 8. Note that the object configuration processing is processing for configuring an operation object used in user terminal 3.

[0191] (S413) The object transmitting unit 141 transmits the operation object constructed in S412 to the user terminal 3 that transmitted the inquiry. Return to S401.

[0192] (S414) The processing unit 13 and the like perform a past video transmission process. An example of the past video transmission process will be described with reference to the flowchart in Fig. 9. Note that the past video transmission process is a process of acquiring and transmitting a video that has been accumulated in the past and that matches the inquiry.

[0193] (S415) The processing unit 13 judges whether or not to transfer the right owner of the video acquired in S414. If the right owner is to be transferred, the process proceeds to S427, and if the right owner is not to be transferred, the process returns to S401.

[0194] In addition, the right owner of the video is transferred when, for example, the inquiry includes a right owner transfer flag, but the method for determining whether or not to transfer the right owner is not important.

[0195] (S416) The processing unit 13 judges whether or not it is a period for transmitting moving images to one or more user terminals 3. If it is a period for transmitting moving images, the process proceeds to S417, and if it is not a period for transmitting moving images, the process proceeds to S421. Note that the moving images are real-time moving images.

[0196] The processing unit 13 determines that it is a period for transmitting a moving image when, for example, terminal information exists in the terminal management unit 111. The processing unit 13 determines that it is a period for transmitting a moving image when, for example, a flag indicating that a performance (for example, a soccer match) is in progress exists in the storage unit 11. There is no restriction on the method by which the processing unit 13 determines that it is a period for transmitting a moving image.

[0197] (S417) The processing unit 13 assigns 1 to the counter i.

[0198] (S418) The processing unit 13 judges whether or not the i-th user information exists in the user management unit 112. If the i-th user information exists, the process proceeds to S419, and if not, the process proceeds to S401.

[0199] (S419) The moving image acquiring unit 133 and the like perform a moving image transmission process to the user terminal 3 corresponding to the i-th user information. An example of the moving image transmission process will be described with reference to the flowchart in FIG.

[0200] (S420) The processing unit 13 increments the counter i by 1. The process returns to S418.

[0201] (S421) The receiving unit 12 judges whether or not a stop instruction has been received from the user terminal 3. If a stop instruction has been received, the process proceeds to S422, and if a stop instruction has not been received, the process proceeds to S424. The stop instruction is associated with a user identifier.

[0202] (S422) The processing unit 13 deletes the performer conditions paired with the user identifier corresponding to the stop instruction received in S421 from the user management unit 112. Here, the processing unit 13 may also delete the user information corresponding to the user identifier corresponding to the stop instruction received in S421 from the user management unit 112. By deleting such performer conditions or user information including the performer conditions, no video is transmitted to the user terminal 3 of the user.

[0203] (S423) The rights holder processing unit 135 performs preservation processing. An example of the preservation processing will be described using the flowchart of FIG. 10. Note that the video subject to such preservation processing is the video transmitted to the user terminal 3 corresponding to the stop instruction received in S421.

[0204] (S424) The receiving unit 12 determines whether a purchase instruction has been received from the user terminal 3. If a purchase instruction is received, the process proceeds to S425; if no purchase instruction is received, the process returns to S401.

[0205] (S425) The video acquisition unit 133 acquires the video corresponding to the purchase instruction. Note that the video acquisition unit 133 acquires, for example, the video corresponding to the purchase instruction from among the videos accumulated by the rights holder processing unit 135.

[0206] (S426) The fourth preservation means 1354 acquires the user identifier corresponding to the user terminal 3 that transmitted the purchase instruction. Note that this user identifier becomes the rights holder identifier for the purchased video. The user terminal 3 that transmitted the purchase instruction may also be the user terminal 3 that transmitted an inquiry including the rights holder transfer flag.

[0207] (S427) The fourth preservation means 1354 performs fourth preservation processing using the user identifier acquired in S427. An example of the fourth preservation processing will be described using the flowchart of FIG. 11.

[0208] (S428) The compensation means 1355 performs compensation processing for the original rights holder of the purchased video. Return to S401. An example of the compensation processing will be described with reference to the flowchart in FIG.

[0209] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt is issued to end the process.

[0210] Next, an example of the video transmission process in S411 will be described with reference to the flowchart in FIG.

[0211] (S501) The moving image obtaining unit 133 obtains, from the user management unit 112, a performer condition paired with the user identifier of the user terminal 3 that transmits the moving image.

[0212] (S502) The video acquisition unit 133 acquires one or more performer identifiers that match the performer conditions acquired in S501.

[0213] (S503) The video acquisition unit 133 acquires the video that is paired with each of the one or more performer identifiers acquired in S502 and that has been accumulated in S402. Note that the length of the video acquired by the video acquisition unit 133 does not matter. The video acquired by the video acquisition unit 133 is the stored video, and it is preferable that it is all unsent video. Also, it is preferable that the acquired video is an additional video, but it may be only a video.

[0214] (S504) The moving image composing unit 134 judges whether or not a plurality of moving images have been acquired in S503. If a plurality of moving images have been acquired, the process proceeds to S505, and if one moving image has been acquired, the process proceeds to S508.

[0215] (S505) The moving image composition unit 134 judges whether or not to spatially fuse the multiple moving images acquired in S503. If the multiple moving images are to be spatially fuse, the process proceeds to S506. If the multiple moving images are not to be spatially fuse, the process proceeds to S507.

[0216] It should be noted that the moving image composition unit 134 determines that the moving images are spatially fused when there is spatial overlap among the multiple moving images. For example, the moving image composition unit 134 performs image recognition on the first frame of each of the multiple moving images, and determines that the moving images are spatially fused when it is determined that all frames overlap with one or more other frames. For example, the moving image composition unit 134 determines that the moving images are spatially fused when all the position information corresponding to each of the multiple moving images acquired in S503 is within a threshold value. It should be noted that the method by which the moving image composition unit 134 determines that the moving images are spatially fused is not important.

[0217] (S506) The moving image constructing unit 134 performs moving image fusion processing to spatially fuse the multiple moving images acquired in S503. An example of the moving image fusion processing will be described with reference to the flowchart of FIG.

[0218] (S507) The moving image composition unit 134 performs a multiple window process. The multiple window process is a process in which each of the multiple moving images acquired in S503 is arranged in a separate window. An example of the multiple window process will be described with reference to the flowchart in FIG. 7.

[0219] (S508) The video sending unit 142 sends, to the user identifier, one video acquired in S503, the fusion video acquired in S506, or the multiple window video acquired in S507. Then, the process returns to the upper processing.

[0220] Next, an example of the moving image fusion process in S506 will be described with reference to the flowchart in FIG.

[0221] (S601) The moving image composing unit 134 assigns 1 to a counter i.

[0222] (S602) The moving image composition unit 134 judges whether or not the i-th frame exists in each of the acquired multiple moving images. If the i-th frame exists, the process proceeds to S603, and if not, the process proceeds to S606.

[0223] (S603) The moving image composing unit 134 acquires the i-th frame from each of the acquired multiple moving images.

[0224] (S604) The moving image composition unit 134 combines the multiple frames acquired in S603 to obtain one frame. Note that an example of the technique for spatially combining multiple frames to compose one frame has been described above.

[0225] (S605) The moving image composing unit 134 increments the counter i by 1. The process returns to S602.

[0226] (S606) The moving image constructing unit 134 temporally combines the multiple frames acquired in S604 in the order in which they were acquired to acquire a fused moving image, and then returns to the upper level processing.

[0227] In the flowchart of FIG. 6, it is assumed that the multiple acquired moving images are synchronized in time.

[0228] Next, an example of the multiple window processing in S507 will be described with reference to the flowchart in FIG.

[0229] (S701) The moving image composing unit 134 acquires the number (n) of acquired moving images.

[0230] (S702) The moving image composition unit 134 acquires frame information having n window frames. Note that the frame information is background information that constitutes a frame.

[0231] (S703) The moving image composing unit 134 assigns 1 to a counter i.

[0232] (S704) Moving image composition unit 134 judges whether or not the i-th frame of each of the multiple moving images exists. If the i-th frame exists, the process proceeds to S705, and if not, the process proceeds to S711.

[0233] (S705) The moving image composing unit 134 assigns 1 to a counter j.

[0234] (S706) Moving image composition unit 134 judges whether or not the j-th moving image is present among the acquired moving images. If the j-th moving image is present, the process proceeds to S707, and if not, the process proceeds to S710.

[0235] (S707) The moving image composition unit 134 obtains the i-th frame of the j-th moving image.

[0236] (S708) The moving image composing unit 134 places the frame acquired in S707 in the j-th window in the frame information.

[0237] (S709) The moving image composing unit 134 increments the counter j by 1. The process returns to S706.

[0238] (S710) The moving image composition unit 134 increments the counter i by 1. The process returns to S704.

[0239] (S711) The moving image composing unit 134 chronologically connects the multiple frames acquired in S708 in the order in which they were acquired to compose a moving image. The process returns to the upper level process. Note that this moving image is a multiple window moving image.

[0240] In the flowchart of FIG. 7, it is assumed that the multiple acquired moving images are synchronized in time.

[0241] Next, an example of the object configuration process in S412 will be described with reference to the flowchart in FIG.

[0242] (S801) Object configuration unit 132 obtains background information from storage unit 11.

[0243] (S802) Object configuration unit 132 assigns 1 to counter i.

[0244] (S803) The object component 132 determines whether the i-th performer exists. If the i-th performer exists, it proceeds to S804; if not, it returns to the upper-level process. Note that the i-th performer is usually a performer during a performance (for example, during a game appearance).

[0245] The object component 132 determines whether the i-th performer exists, for example, based on whether the i-th terminal information exists in the terminal management unit 111. The object component 132 determines whether the i-th performer exists, for example, by referring to the terminal management unit 111 and determining whether the i-th performer with the performance flag ON (for example, "1") exists. The performance flag is information J indicating whether it is during a performance. Note that the method for determining whether the i-th performer exists is not limited.

[0246] (S804) The object component 132 acquires the latest position information of the i-th performer from the terminal management unit 111.

[0247] (S805) The object component 132 arranges the selection icon, which is an icon for selecting the i-th performer, at the position indicated by the position information acquired in S804 and within the position in the background image composed of the background information. Note that the selection icon is a selectable object. The selection icon is, for example, a pattern, but it can also be a character string. The selection icon is stored in the storage unit 11, for example.

[0248] (S806) The object component 132 increments the counter i by 1. In the flowchart of S8043 return 8, through the process in S805, a user interface simulating a performance venue with a selectable icon arranged at the current position of the performer is configured. Such a user interface is an operation object.

[0249] Next, an example of the past video transmission process of S414 will be described using the flowchart of FIG. 9.

[0250] (S801) The moving image acquiring unit 133 acquires a moving image identifier of a previously stored moving image that matches the inquiry. The moving image identifier is information for identifying a moving image, and may be, for example, an ID or a moving image name, but is not limited thereto.

[0251] (S802) The video obtaining unit 133 obtains a time condition included in the inquiry.

[0252] (S803) The moving image acquiring unit 133 acquires moving images within a range that matches the time condition from among moving images that are among the moving images previously stored by the right holder processing unit 135 and that are identified by moving image identifiers.

[0253] (S804) The video transmission unit 142 transmits the video acquired in S803 to the user terminal 3 that has transmitted the inquiry, and then returns to the upper-level processing.

[0254] Next, an example of the security process in S423 will be described with reference to the flowchart in FIG.

[0255] (S1001) Rights holder processing unit 135 stores the transmitted moving image in association with a set of attribute values ​​corresponding to one or more original moving images from which the transmitted moving image is based.

[0256] It is preferable that the right holder processing unit 135 stores the video in a pair with a right holder identifier that identifies one or more right holders. The right holder identifier here is, for example, one or more performer identifiers of the video that is the source of the stored video. The right holder identifier here is, for example, a user identifier that identifies the user who made the inquiry.

[0257] Furthermore, the right holder processing unit 135 accumulates the video in, for example, the storage unit 11 or a device other than the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.

[0258] (S1002) The fourth maintenance means 1354 performs the fourth maintenance process. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.

[0259] (S1003) The right holder processing unit 135 assigns 1 to a counter i.

[0260] (S1004) Right holder processing unit 135 determines whether or not the i-th moving image that was the source of the stored moving image exists. If the i-th moving image exists, the process proceeds to S1005, and if not, the process returns to the upper process.

[0261] (S1005) Reward means 1355 performs reward processing. An example of the reward processing will be described with reference to the flowchart in Fig. 12. The reward processing here is a processing for paying reward to the right holder of the i-th moving image that is the basis of the accumulated moving image.

[0262] (S1006) Rights holder processing unit 135 determines whether or not to change the rights holder of the i-th moving image that is the source of the stored moving image. If the rights holder is to be changed, the process proceeds to S1007. If the rights holder is not to be changed, the process proceeds to S1008.

[0263] In addition, whether or not to change the rights holder may be based on a flag corresponding to the i-th video, or may be decided in advance, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder."

[0264] (S1007) The right holder processing unit 135 acquires the user identifier of the user terminal 3. This user identifier becomes a new right holder identifier.

[0265] (S1008) The first maintenance unit 1351 stores the i-th moving image that is the source of the stored moving images.

[0266] (S1009) The fourth maintenance means 1354 performs a fourth maintenance process on the i-th moving image that is the source of the stored moving image. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.

[0267] (S1010) The right holder processing unit 135 increments the counter i by 1. The process returns to S1004.

[0268] In the flowchart of Figure 10, when a combined video is constructed, a process (S1008) of storing the multiple videos that are the basis of the combined video and a fourth preservation process (S1009) are performed, but such processes do not have to be performed.

[0269] Next, an example of the fourth security process of S427, S1002, and S1009 will be described with reference to the flowchart of FIG.

[0270] (S1101) The fourth security unit 1354 acquires access information that identifies a storage destination of a moving image. The moving image is, for example, a fused moving image or a combined moving image. The access information is, for example, a URL.

[0271] (S1102) The fourth maintenance means 1354 acquires an attribute value set corresponding to the accumulated moving image. If the accumulated moving image is a moving image composed of multiple original moving images, the attribute value set corresponding to the moving image is the attribute value set of each of the multiple original moving images.

[0272] (S1103) The fourth security means 1354 configures security information having the access information acquired in S1101, the attribute value set acquired in S1102, and the right holder identifier of the video. Note that if a new right holder identifier has been acquired, the fourth security means 1354 configures security information including, for example, the new right holder identifier and the original right holder identifier. (S1104) The fourth maintenance means 1354 accumulates the maintenance information configured in S1103, and returns to the upper level processing.

[0273] In addition, in S1104, if the preservation information of the video corresponding to the preservation information to be stored is stored, the preservation information configured in S1103 is overwritten with the preservation information. In this way, for example, the transition of the right holder of the video can be managed. In addition, the fourth preservation means 1354 stores the preservation information in, for example, a block chain.

[0274] Next, an example of the reward process in S428 and S1005 will be described with reference to the flowchart in FIG.

[0275] (S1201) Reward means 1355 acquires one or more right holder identifiers of a target video. Reward means 1355 may acquire right holder identifiers of previous right holders of the target video.

[0276] (S1202) The reward means 1355 acquires a set of attribute values ​​of the target video.

[0277] (S1203) The reward means 1355 acquires a service identifier that identifies a service provided to the target video. The service identifier is, for example, “view” or “purchase.”

[0278] (S1204) The reward means 1355 acquires a reward amount using one or more pieces of information among the attribute value set acquired in S1202 and the service identifier acquired in S1203.

[0279] If multiple right holder identifiers are obtained, the remuneration means 1355 obtains a remuneration amount for each right holder identifier. If the right holder history information including multiple right holder identifiers is obtained, the remuneration means 1355 may obtain a remuneration amount for each right holder identifier.

[0280] In addition, it is preferable that the remuneration means 1355, for example, acquires a moving image attribute value corresponding to each of the multiple moving images that are the source of the moving image transmitted by the moving image transmission unit 142, and determines the amount of remuneration for each of the multiple right holders using the moving image attribute value. It is preferable that the remuneration means 1355, for example, determines a larger amount of remuneration as the data amount, the duration of the moving image, or the number of frames of the original moving image adopted in the moving image transmitted by the moving image transmission unit 142 increases. It is preferable that the remuneration means 1355, for example, determines a larger amount of remuneration as the resolution of the original moving image adopted in the moving image transmitted by the moving image transmission unit 142 increases.

[0281] (S1205) The reward means 1355 performs a process of giving a reward of the reward amount acquired in S1204 to the right holder identified by the right holder identifier acquired in S1201.

[0282] (S1206) Reward means 1355 performs a process of charging the user who has enjoyed the service related to the target video with a reward. The process returns to the upper level process. Note that the target video is usually a video transmitted to user terminal 3.

[0283] In the flowchart of FIG. 12, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.

[0284] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.

[0285] (S1301) Position acquisition unit 231 acquires position information. Note that position information is also a video attribute value.

[0286] (S1302) The attribute value acquisition unit 233 acquires one or more moving image attribute values. Note that the one or more moving image attribute values ​​include, for example, time information.

[0287] (S1303) The imaging unit 232 captures a moving image. Note that the length of the moving image captured here does not matter.

[0288] (S1304) The movement processing unit 23 acquires a performer identifier from the movement storage unit 21.

[0289] (S1305) Movement processing unit 23 composes an additional moving image having a moving image, position information, one or more moving image attribute values, and a performer identifier.

[0290] (S 1306 ) The moving moving image transmission unit 242 transmits the additional moving image constructed in S 1305 to the information processing device 1 .

[0291] (S1307) The movement processing unit 23 judges whether or not to end the process. If it is judged that the process should be ended, the process ends, and if it is judged that the process should not be ended, the process returns to S1301.

[0292] The process is terminated, for example, when an end instruction is received from the performer, or when a threshold time or more has elapsed since the start of the process.

[0293] 13, the mobile terminal 2 may continuously acquire location information and transmit the location information in a pair with the performer identifier to the information processing device 1. In this case, when the mobile terminal 2 receives an instruction to transmit a moving image from the information processing device 1, the mobile terminal 2 may transmit the moving image to the information processing device 1.

[0294] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.

[0295] (S1401) The user receiving unit 35 determines whether or not an operation object has been received from the information processing device 1. If an operation object has been received, the process proceeds to S1402, and if not, the process proceeds to S1404.

[0296] (S1402) The screen acquisition unit 331 creates an operation screen using the operation objects received in S1401.

[0297] (S1403) The screen output unit 361 outputs the operation screen constructed in S1402. The process returns to S1401.

[0298] (S1404) The user reception unit 32 determines whether or not a video instruction has been received. If a video instruction has been received, the process proceeds to S1405, and if a video instruction has not been received, the process proceeds to S1411.

[0299] (S1405) The user processing unit 33 acquires a performer condition corresponding to the accepted video instruction. Next, the user processing unit 33 composes an inquiry including the performer condition and the user identifier. Next, the user transmission unit 34 transmits the inquiry to the information processing device 1.

[0300] (S1406) The user receiving unit 35 determines whether or not a moving image has been received from the information processing device 1. If a moving image has been received, the process proceeds to S1407, and if a moving image has not been received, the process returns to S1406. Note that the moving image here may be, for example, an additional moving image.

[0301] (S1407) The video output unit 251 outputs the video received in S1406.

[0302] (S1408) User reception unit 32 determines whether or not a new video instruction has been received. If a new video instruction has been received, the process proceeds to S1405, and if a new video instruction has not been received, the process proceeds to S1409.

[0303] (S1409) The user acceptance unit 32 determines whether or not a stop instruction has been accepted. If a stop instruction has been accepted, the process proceeds to S1410, and if a stop instruction has not been accepted, the process returns to S1406.

[0304] (S1410) The user processing unit 33 acquires a user identifier from the user storage unit 31. Next, the user processing unit 33 configures a stop instruction having the user identifier. The user transmission unit 34 transmits the stop instruction to the information processing device 1. Return to S1401.

[0305] (S1411) The user reception unit 32 determines whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to S1412, and if an inquiry has not been received, the process proceeds to S1415.

[0306] (S1412) The user processing unit 33 acquires a user identifier from the user storage unit 31. Next, the user processing unit 33 composes a query having the user identifier. The user transmission unit 34 transmits the query to the information processing device 1.

[0307] (S1413) In response to the transmission of the inquiry, the user receiving unit 35 determines whether or not a moving image has been received from the information processing device 1. If a moving image has been received, the process proceeds to S1414, and if a moving image has not been received, the process returns to S1413.

[0308] (S1414) The user output unit 36 ​​outputs the video received in S1413. The process returns to S1401.

[0309] (S1415) The user reception unit 32 determines whether or not a purchase instruction has been received. If a purchase instruction has been received, the process proceeds to S1165, and if a purchase instruction has not been received, the process returns to S1401. Note that the purchase instruction includes, for example, an inquiry specifying the video to be purchased.

[0310] (S1416) The user processing unit 33 composes a purchase instruction to be transmitted. Next, the user transmitting unit 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.

[0311] (S1417) The user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1120, and if information has not been received, the process returns to S1119. The information is, for example, a moving image, information indicating that the transfer of the rights holder has been completed, and a set of attribute values ​​of the moving image.

[0312] (S1418) User processing unit 33 uses the received information to compose information to be output. User output unit 36 ​​outputs the information. Return to S1101.

[0313] In the flowchart of FIG. 14, the process ends when the power is turned off or an interrupt occurs to end the process.

[0314] A specific example of the operation of the information system A in this embodiment will be described below.

[0315] It is assumed that a terminal management table having the structure shown in Fig. 15 is stored in the terminal management unit 111 of the information processing device 1. The terminal management table is a table for managing the mobile terminal 2. Here, it is assumed that the mobile terminal 2 is a terminal attached to the uniform of a player playing a soccer game.

[0316] The terminal management table manages records having "ID", "terminal identifier", "team name", "performer flag", "position", "location information", "terminal communication information", and "video". "ID" is information for identifying a record. "Team name" is an identifier of the team to which the performer (here, a player) belongs. "Performer flag" is information indicating whether or not the player is participating in a soccer match, with "1" indicating that the player is participating in the match and "0" indicating that the player is not participating in the match. "Position" is the player's position. "Location information" is the latest location information of the player. Note that all of the received location information may be stored in the "location information". "Terminal communication information" is information for communicating with the mobile terminal 2. "Video" is the name of the video file transmitted from the player's mobile terminal 2. Note that the video file is temporarily stored in the storage unit 11.

[0317] It is assumed that the user management unit 112 stores a user management table having the structure shown in FIG. 16. The user management table manages records having an "ID", "user identifier", "performer condition", and "user attribute value". The "user attribute value" has a "purchase flag" and a "payment information". The "purchase flag" is information indicating whether or not a video is to be purchased, with "1" indicating that the video is to be purchased and "0" indicating that the video is not to be purchased. The "payment information" is information for paying the cost of purchasing or viewing a video. Here, the "payment information" is a credit card number, bank account information, or a user ID of a payment app. The "payment information" is, for example, information registered by a user when purchasing a ticket for a soccer game.

[0318] Now, assume that before a soccer match, a large number of supporters (users) set performer conditions using a performer condition setting screen (which may be called an operation screen) shown in FIG. 17, which is displayed on the user terminal 3. In order for the operation screen to be output to the user terminal 3, the following process is performed. That is, the user accepting unit 32 and the user receiving unit 35 of the user terminal 3 receive an operation object from the information processing device 1. Next, the screen acquisition unit 331 uses the operation object to configure an operation screen. Next, the screen output unit 361 outputs the operation screen (FIG. 17).

[0319] The operation screen (FIG. 17) has various buttons (for example, 1701 to 1706) for setting performer conditions, a send button 1700, and purchase flags, a "Purchase" button 1707 and a "Do not purchase" button 1708. When the "Purchase" button 1707 is pressed, the purchase flag sent is "1," and when the "Do not purchase" button 1708 is pressed, the purchase flag sent is "0."

[0320] Assume that user 1 identified by user identifier "U101" selects the icon of player A02 in 1701 of FIG. 17, selects the "Purchase" button 1707, and then selects the "Send" button 1700. Then, the user receiving unit 32 receives a video instruction "<performer condition> T102 <purchase flag> 1". Next, the user processing unit 33 composes a query "<user identifier> U101 <performer condition> T102 <purchase flag> 1 <video type> real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0321] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to transmit real-time video from "<video type> real-time" included in the inquiry. Next, the processing unit 13 stores the performer condition "T102" and purchase flag "1" of the received inquiry in the user management table (FIG. 16) in a pair with the user identifier "U101" included in the inquiry. Such a record is the record of "ID=1" in FIG. 16.

[0322] Also, assume that user 1 identified by user identifier "U102" selects two icons of players A01 and A02 in 1701 in FIG. 17, selects the "Do not purchase" button 1708, and then selects the "Send" button 1700. Then, the user receiving unit 32 receives a video instruction "<performer condition> T101, T102 <purchase flag> 0". Next, the user processing unit 33 composes a query "<user identifier> U102 <performer condition> T101, T102 <purchase flag> 0 <video type> real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0323] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to transmit real-time video from "<video type> real-time" included in the inquiry. Next, the processing unit 13 stores the performer conditions "T101, T102" and purchase flag "0" of the received inquiry in the user management table (FIG. 16) in pairs with the user identifier "U102" included in the inquiry. Such a record is the record "ID=2" in FIG. 16.

[0324] Also, assume that the user 1 identified by the user identifier "U103" designates "Team B" 1703 in FIG. 17, designates the position "MF" 1704, designates the "Do not purchase" button 1708, and then designates the "Send" button 1700. Then, the user receiving unit 32 accepts the video instruction "<performer condition> Team name = Team B & position = MF <purchase flag> 0". Next, the user processing unit 33 composes a query "<user identifier> U103 <performer condition> Team name = Team B & position = MF <purchase flag> 0 <video type> real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0325] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to transmit real-time video from the "<video type> real-time" included in the inquiry. Next, the processing unit 13 stores the performer condition "Team name=Team B & Position=MF" and purchase flag "0" contained in the received inquiry in the user management table (FIG. 16) in a pair with the user identifier "U103" included in the inquiry. Such a record is the record of "ID=3" in FIG. 16.

[0326] Also, assume that the user 1 identified by the user identifier "U104" selects "Ball holder" 1703 in FIG. 17, selects the "Purchase" button 1707, and then selects the "Send" button 1700. The user receiving unit 32 then receives the video instruction "<Performer condition> Ball holder <Purchase flag> 1". Next, the user processing unit 33 composes a query "<User identifier> U104 <Performer condition> Ball holder <Purchase flag> 1 <Video type> Real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0327] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to transmit real-time video from "<video type> real-time" included in the inquiry. Next, the processing unit 13 stores the performer condition "ball holder" and purchase flag "1" of the received inquiry in the user management table (FIG. 16) in a pair with the user identifier "U104" included in the inquiry. Such a record is the record of "ID=4" in FIG. 16.

[0328] Furthermore, assume that the user 1 identified by the user identifier "U105" selects "PK kicker" 1706 in FIG. 17, selects the "Purchase" button 1707, and then selects the "Send" button 1700. The user receiving unit 32 then receives the video instruction "<performer condition>PK kicker <purchase flag>1". Next, the user processing unit 33 composes a query "<user identifier>U105 <performer condition>PK kicker <purchase flag>1 <video type>real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0329] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to transmit real-time video from "<video type> real-time" included in the inquiry. Next, the processing unit 13 stores the performer condition "PK kicker" and purchase flag "1" of the received inquiry in the user management table (FIG. 16) in a pair with the user identifier "U105" included in the inquiry. Such a record is the record of "ID=5" in FIG. 16.

[0330] It is assumed that a soccer match has started under the above circumstances. It is assumed that during the soccer match, position information identifying the position of the soccer ball is continuously transmitted to information processing device 1 from a device embedded in the soccer ball. Then, it is assumed that information processing device 1 receives the position information of the soccer ball and accumulates it in storage unit 11. It is also assumed that storage unit 11 stores penalty kick position information identifying the position for kicking a penalty kick.

[0331] Also, during a soccer match, additional videos of 22 players participating in the match are continuously transmitted from the mobile terminals 2 to the information processing device 1. Then, the information processing device 1 receives the additional videos, and stores the videos and position information in the storage unit 11 in pairs with the terminal identifiers.

[0332] Furthermore, the processing unit 13 of the information processing device 1 determines that the soccer game is a period for transmitting moving images to one or more user terminals 3. Then, the information processing device 1 continues transmitting moving images to the user terminals 3 according to the performer conditions of each user.

[0333] For example, the information processing device 1 continues to transmit a video corresponding to a terminal identifier "T102" to a user terminal 3 corresponding to a user identifier "U101". Then, the user terminal 3 receives and outputs the video. An image of such a video is shown in FIG.

[0334] In addition, the user identified by the user identifier "U101" can change the performer conditions at any time during the match by operating the setting screen of Fig. 17. In other words, the user can set new performer conditions at any time during the match by operating the setting screen of Fig. 17.

[0335] Since the purchase flag paired with the user identifier "U101" is "1", the user purchases the video viewed during the game. As a result, the information processing device 1 performs the fourth preservation process and the reward process described above on the video viewed by the user.

[0336] Furthermore, for example, to a user terminal 3 corresponding to a user identifier "U103", the information processing device 1 continues to transmit one fusion video or multiple window videos obtained by spatially fusing videos transmitted from two mobile terminals 2 identified by terminal identifiers "T201, T203" paired with "team name=team B" and "position=MF". Then, the user terminal 3 receives and outputs the videos.

[0337] And since the purchase flag paired with the user identifier "U103" is "0", the fourth security process and reward process are not performed on the video viewed by that user during the match.

[0338] Also, for example, for the user terminal 3 corresponding to the user identifier "U104", the video acquisition unit 133 of the information processing device 1 constantly acquires a video paired with the terminal identifier corresponding to the position information closest to the ball's position information, and acquires a combined video by combining the videos in time. Then, the video transmission unit 142 continues to transmit the combined video. Then, the user terminal 3 receives and outputs the video.

[0339] Since the purchase flag paired with the user identifier "U104" is "1", the user purchases the combined video viewed during the match. As a result, the information processing device 1 performs the fourth preservation process and the reward process for the combined video viewed by the user.

[0340] As described above, according to this embodiment, video captured by the mobile terminal 2 of the performer while the performer is performing can be used.

[0341] Furthermore, according to this embodiment, videos of appropriate performers can be used.

[0342] Furthermore, according to this embodiment, a single video can be composed from videos of multiple performers.

[0343] Furthermore, according to this embodiment, video of the performer at the appropriate time can be used.

[0344] Moreover, according to the present embodiment, it is possible to assist the user in easily selecting a video.

[0345] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.

[0346] Furthermore, according to this embodiment, a reward can be given to the rights holder of the video captured by the mobile terminal 2.

[0347] The various processes of the various devices in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments in this specification.

[0348] Fig. 19 shows the appearance of a computer that executes the programs described in this specification to realize the information processing device 1, mobile terminal 2, and user terminal 3 of the various embodiments described above. The above-mentioned embodiments can be realized by computer hardware and a computer program executed thereon. Fig. 19 is an overview of this computer system 300, and Fig. 20 is a block diagram of the system 300.

[0349] In FIG. 19, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0350] 20, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.

[0351] A program for causing computer system 300 to execute the functions of information processing device 1 and the like of the above-mentioned embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and further transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 at the time of execution. The program may be loaded directly from CD-ROM 3101 or the network.

[0352] The program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-mentioned embodiment. The program only needs to include an instruction portion that calls appropriate functions (modules) in a controlled manner to obtain a desired result. How the computer system 300 operates is well known, and a detailed description will be omitted.

[0353] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmitting step (processing that is performed only by hardware).

[0354] The program may be executed by a single computer or a plurality of computers. That is, the program may be executed by a centralized processing or a distributed processing.

[0355] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be realized physically by one medium.

[0356] In each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.

[0357] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]

[0358] As described above, the information processing device 1 according to the present invention has an effect of being able to use video captured by a mobile terminal of a performer while the performer is performing, and is useful as a video providing server or the like.

Claims

1. A receiving unit that receives images from one or more mobile terminals installed in the performers; An inquiry receiving unit that receives an inquiry from a user terminal; an acquisition unit that acquires the images corresponding to the performers that match the query; a transmission unit that transmits the image acquired by the acquisition unit to the user terminal; The image acquired by the acquisition unit is associated with a rights holder identifier that identifies a rights holder of the image, a right holder processing unit that performs right holder processing related to a right holder identified by a right holder identifier associated with the image; An information processing device comprising:

2. The right holder processing unit, 2. An information processing apparatus according to claim 1, further comprising a third security means for storing said image in association with a right holder identifier for identifying a user of said user terminal.

3. The receiving unit is receiving images from a plurality of mobile terminals; The inquiry receiving unit is receiving a query including a performer term that identifies a plurality of performers; The acquisition unit is acquiring an image corresponding to each of a plurality of performers that meet the performer criteria; A configuration unit that configures one image using the multiple images acquired by the acquisition unit, The transmission unit is 3. The information processing apparatus according to claim 1, wherein the image constructed by the construction unit is transmitted to the user terminal.

4. The component comprises:

4. The information processing apparatus according to claim 3, wherein the plurality of images are combined in time or the plurality of images are spatially fused to form one image.

5. An information processing method realized by a receiving unit, an inquiry receiving unit, an acquisition unit, a transmitting unit, and a rights holder processing unit, comprising: A receiving step in which the receiving unit receives images from one or more mobile terminals installed in the performers; an inquiry receiving step in which the inquiry receiving unit receives an inquiry from a user terminal; an acquisition step in which the acquisition unit acquires the images corresponding to the performers that match the query; a transmission step in which the transmission unit transmits the image acquired in the acquisition step to the user terminal; The image acquired by the acquisition unit is associated with a rights holder identifier that identifies a rights holder of the image, a right holder processing step in which the right holder processing unit performs right holder processing related to a right holder identified by a right holder identifier associated with the image; An information processing method comprising:

Images