Information processing apparatus, user terminal, and information processing method

Abstract

To solve such a problem that, in a conventional technique, it was not possible to utilize videos captured by a mobile terminal of a performer during a performance of the performer.SOLUTION: Videos captured by a mobile terminal of a performer can be utilized during a performance of the performer by an information processing apparatus 1 that comprises: a video receiving unit 122 that receives videos from one or more mobile terminals installed on the performer; an inquiry receiving unit 123 that receives an inquiry from a user terminal 3; a video acquisition unit 133 that acquires a video corresponding to a performer matching the inquiry; and a video transmitting unit 142 that transmits the video acquired by the video acquisition unit 133 to the user terminal 3.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device or the like that receives video captured by a camera installed on a performer such as a soccer player or a theater performer, and provides the video in response to an instruction from a user. [Background technology]

[0002] BACKGROUND ART Conventionally, there has been a technique for providing a user with image data taken by an in-vehicle camera at a location and environment desired by the user (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-83034 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the prior art, it was not possible to utilize the video captured by the performer's mobile terminal while the performer was performing. [Means for solving the problem]

[0005] The information processing device of this first invention is an information processing device that includes a video receiving unit that receives video from one or more mobile terminals installed in the performers, an inquiry receiving unit that receives inquiries from user terminals, a video acquisition unit that acquires video corresponding to performers that match the inquiries, and a video transmission unit that transmits the video acquired by the video acquisition unit to the user terminal.

[0006] This configuration allows for the use of video captured by the performer's mobile terminal while the performer is performing.

[0007] In addition, the information processing device of the second invention, compared to the first invention, further includes an attribute value acquisition unit that acquires the attribute values ​​of a performer, the query receiving unit receives a query including a performer condition regarding the attribute values ​​of the performer, the video acquisition unit acquires a video corresponding to a performer whose attribute values ​​match the performer conditions, and the video sending unit transmits the video acquired by the video acquisition unit to a user terminal.

[0008] This configuration allows for the use of videos of appropriate performers.

[0009] Furthermore, the information processing device of the third invention is an information processing device according to the first or second invention, wherein the video receiving unit receives videos from a plurality of mobile terminals, the query receiving unit receives a query including performer conditions that identify a plurality of performers, the video acquisition unit acquires videos corresponding to each of a plurality of performers that match the performer conditions, and further includes a video composition unit that composes a single video using the plurality of videos acquired by the video acquisition unit, and the video sending unit transmits the video composed by the video composition unit to the user terminal.

[0010] This configuration allows videos of multiple performers to be combined into one video.

[0011] In addition, the information processing device of the fourth invention is an information processing device in which, compared to the third invention, the video composition unit combines multiple videos temporally or fuses multiple videos spatially to compose a single video.

[0012] This configuration allows videos of multiple performers to be combined into one video.

[0013] Furthermore, the information processing device of the fifth invention is an information processing device that, compared to any one of the first to fourth inventions, further includes a processing unit that stores the video received by the video receiving unit, the video is associated with time information that specifies when the video was taken, the query receiving unit receives a query including a time condition regarding when the video was taken, the video acquisition unit acquires videos that satisfy the time condition from the videos accumulated by the processing unit, and the video sending unit sends the videos acquired by the video acquisition unit to a user terminal.

[0014] Such a configuration allows for the use of video of the performer at the appropriate time.

[0015] In addition, the information processing device of the sixth invention is an information processing device according to any one of the first to fifth inventions, further comprising a location receiving unit that receives location information from one or more mobile terminals, an object configuration unit that configures an operation object including one or more location information received by the location receiving unit and for selecting a performer corresponding to each of the one or more location information, and an object sending unit that sends the operation object to the user terminal, wherein the query receiving unit receives a query based on the selection of one or more performers for the operation object, and the video acquisition unit acquires videos corresponding to one or more performers that match the query.

[0016] This configuration can help the user to easily select a video.

[0017] In addition, the information processing device of the seventh invention is an information processing device in which, compared to any one of the first to sixth inventions, the video acquired by the video acquisition unit is associated with a rights holder identifier that identifies the rights holder of the video, and further includes a rights holder processing unit that performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier associated with the video.

[0018] This configuration allows appropriate processing regarding the rights holder of the video.

[0019] In addition, the information processing device of the eighth invention is an information processing device in which, compared to the seventh invention, the video is associated with a performer identifier that identifies the performer, and the rights holder processing unit is equipped with a reward means that performs reward processing, which is a process of giving a reward to the performer identified by the performer identifier.

[0020] With this configuration, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.

[0021] In addition, the information processing device of the ninth invention is an information processing device in which, compared to the eighth invention, the reward means performs reward processing, which is a process of determining a reward for a previous performer using a video attribute value corresponding to the video and awarding the reward.

[0022] With this configuration, appropriate compensation can be given to the rights holder of the video captured by the mobile terminal.

[0023] In addition, the information processing device of the tenth invention is an information processing device in which, compared to the seventh invention, the rights holder processing unit is equipped with a first security means that performs a first security processing in which the video is stored in association with a set of attribute values ​​corresponding to the video.

[0024] With this configuration, the video can be preserved.

[0025] In addition, the information processing device of the eleventh invention is an information processing device in which, compared to the seventh invention, the rights holder processing unit is equipped with a second security means that performs a second security process of storing the video in association with a performer identifier corresponding to the video.

[0026] With this configuration, the rights holder of the video can be the appropriate rights holder.

[0027] In addition, the information processing device of the twelfth invention is an information processing device in which, compared to the seventh invention, the rights holder processing unit is equipped with a third security means for storing the video in association with a rights holder identifier that identifies the user of the user terminal.

[0028] With this configuration, the rights holder of the video can become the rights holder who needs the video.

[0029] In addition, the information processing device of the thirteenth invention is an information processing device in which, compared to any one of the tenth to twelfth inventions, the rights holder processing unit is equipped with a fourth security means that performs a fourth security process that accumulates security information including access information for accessing the video in a blockchain.

[0030] With this configuration, it is possible to preserve management information for videos that need to be preserved.

[0031] In addition, the user terminal of the fourteenth invention is a user terminal that includes a screen acquisition unit that acquires an operation screen that clearly shows the position specified by the position information of one or more mobile terminals installed in the performer, a screen output unit that outputs the operation screen, a user reception unit that accepts video instructions that are instructions to the mobile terminal on the operation screen, a user acquisition unit that acquires video taken by the mobile terminal in response to the video instructions, and a user output unit that outputs the video acquired by the user acquisition unit.

[0032] This configuration allows the user to easily select a video.

[0033] Furthermore, the user terminal of the fifteenth invention is a user terminal according to claim 14, in comparison with the sixth invention, which includes a user receiving unit that receives an operation object from an information processing device, a screen acquisition unit that acquires an operation screen using the operation object, the user acquisition unit that constructs a query using a video instruction, transmits the query to the information processing device, and receives the video from the information processing device in response to the transmission of the query.

[0034] This configuration allows the user to easily select a video. [Effects of the Invention]

[0035] According to the information processing device of the present invention, video captured by the mobile terminal of the performer can be used while the performer is performing. [Brief explanation of the drawings]

[0036] [Figure 1] Conceptual diagram of information system A in embodiment 1 [Figure 2] Block diagram of Information System A [Figure 3] Block diagram of the information processing device 1 [Figure 4] A flowchart illustrating an example of the operation of the information processing device 1. [Figure 5] A flowchart illustrating an example of the video transmission process [Figure 6] Flowchart illustrating an example of the moving image fusion process [Figure 7] Flowchart illustrating an example of the multiple window process [Figure 8] A flowchart illustrating an example of the object configuration process. [Figure 9] A flowchart illustrating an example of the past video transmission process. [Figure 10] A flowchart illustrating an example of the maintenance process [Figure 11] 10 is a flowchart illustrating an example of the fourth maintenance process. [Figure 12] A flowchart illustrating an example of the reward process [Figure 13] A flowchart illustrating an example of the operation of the mobile terminal 2 [Figure 14] A flowchart illustrating an example of the operation of the user terminal 3 [Figure 15] A diagram showing the terminal management table [Figure 16] The user management table [Figure 17] FIG. 10 shows an example of the operation screen. [Figure 18] Figure showing an example of the output [Figure 19] Overview of the computer system [Figure 20] Block diagram of the computer system DETAILED DESCRIPTION OF THE INVENTION

[0037] Hereinafter, embodiments of an information processing device and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.

[0038] (Embodiment 1) <Outline of First Embodiment>

[0039] In this embodiment, an information processing device is described that receives video captured by a camera installed on a performer and provides the video in response to instructions from a user terminal. The performer may be, for example, a sports player such as a soccer player or a baseball player, a musician or a performer who performs in front of an audience, a horse racer, a jockey, a car racer, a boat racer, etc.

[0040] In this embodiment, an information processing device that transmits videos taken by the mobile terminals of one or more performers who meet the performer conditions to a user terminal will be described.

[0041] In this embodiment, an information processing device is described that composes a single moving image from multiple moving images of multiple performers and transmits the single moving image to a user terminal. Note that the single moving image is a moving image that is a temporally or spatially composite of multiple moving images.

[0042] In this embodiment, an information processing device will be described that receives an inquiry including time information that specifies a time and transmits a past video in response to the inquiry. Note that the past video is a video that was shot and stored in the past.

[0043] In addition, in this embodiment, an information processing device will be described that receives position information of a performer, constructs an operation object that clearly indicates the position of the performer indicated by the position information, and transmits the operation object to a user terminal.

[0044] In this embodiment, an information processing device that performs rights holder processing, which is processing related to the rights holder of the output video, will be described. The rights holder processing is, for example, a compensation processing described later and various security processing described later. The rights holder is, for example, a performer or a user who requested the video.

[0045] Furthermore, in this embodiment, a user terminal that outputs a screen that allows the user to easily select a video of a performer will be described.

[0046] In this embodiment, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>

[0047] 1 is a conceptual diagram of an information system A according to this embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.

[0048] The information processing device 1 is a server that provides video transmitted from one or more mobile terminals 2 to a user terminal 3. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type is not important. The information processing device 1 may also be a device that constitutes a blockchain.

[0049] In this specification, the interval between the capture times of the multiple still images included in a moving image does not matter. A moving image is, for example, a moving image at 60 frames per second or 30 frames per second, but it may also be a collection of multiple still images captured at intervals of a predetermined time (for example, one minute) or more, or a collection of multiple still images captured when predetermined conditions are met. Still images may also be called fields or frames.

[0050] The mobile terminal 2 is a terminal that can move. The mobile terminal 2 is a terminal that is installed on the performer. A terminal that is installed on the performer is a terminal that is installed on something that the performer wears (for example, glasses, a uniform, a helmet) or a terminal that is installed on something that the performer operates (for example, a car, a motorcycle). The mobile terminal 2 is a terminal that shoots video. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, glasses with a camera, or a smart watch with a camera. Furthermore, "installed" usually means that it is fixed, but it may also be considered to include being in contact with or held by the performer.

[0051] The user terminal 3 is a terminal used by a user. A user is someone who watches videos or needs videos. The user terminal 3 may have the functions of a mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may be, for example, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and its type does not matter.

[0052] The information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3 are generally capable of communicating via a network such as the Internet.

[0053] 2 is a block diagram of an information system A according to the present embodiment, and FIG.

[0054] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a terminal management unit 111 and a user management unit 112. The receiving unit 12 includes a location receiving unit 121, a video receiving unit 122, and an inquiry receiving unit 123. The processing unit 13 includes an attribute value acquiring unit 131, an object configuring unit 132, a video acquiring unit 133, a video configuring unit 134, and a right holder processing unit 135. The right holder processing unit 135 includes a first security means 1351, a second security means 1352, a third security means 1353, a fourth security means 1354, and a remuneration means 1355. The transmitting unit 14 includes an object transmitting unit 141 and a video transmitting unit 142.

[0055] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, a moving transmitting unit 24, and a moving output unit 25. The moving processing unit 23 includes a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234. The moving transmitting unit 24 includes a position transmission unit 241 and a moving video transmission unit 242. The moving output unit 25 includes a video output unit 251.

[0056] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit 34, a user reception unit 35, and a user output unit 36. The user processing unit 33 includes a screen acquisition unit 331 and a user acquisition unit 332. The user output unit 36 ​​includes a screen output unit 361. <Details of Components of Information Processing Device 1>

[0057] Various types of information are stored in the storage unit 11. The various types of information include, for example, terminal information (described later), user information (described later), videos, and additional videos. An additional video is a video and one or more video attribute values ​​associated with the video. It is preferable that the additional video is a video associated with one or more video attribute values. It is preferable that a terminal identifier is associated with the additional video.

[0058] Video attribute values ​​are attribute values ​​of a video. Video attribute values ​​are, for example, environmental information. Environmental information is information about the environment in which a video was shot. Environmental information is, for example, location information and time information, which will be described later. Environmental information may include, for example, weather information, temperature information, seasonal information, etc. Time information is information that identifies the time when a video was shot. The time when a video was shot may be a time around the time the video was shot, and accuracy is not required. Time information is, for example, the time, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / date, or month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that identifies the weather at the location (or region) where the video was shot. Weather information is, for example, "sunny," "rain," "snow," or "cloudy." Temperature information is information that identifies the temperature at the location where the video was shot. Temperature information is, for example, "25 degrees" or "above 30 degrees." Seasonal information is information that identifies the season at the location where the video was shot. The season information is, for example, "spring," "summer," "early summer," and "winter."

[0059] The video attribute value may be a tag. A tag is information that indicates the content of a video. Preferably, a tag is the result of analyzing one or more still images contained in the video. For example, a tag could be "goal" indicating that a goal was scored in a soccer game, or "home run" indicating that a home run was hit in a baseball game.

[0060] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information relating to the mobile terminal 2. The terminal information here typically includes a terminal identifier that is an identifier of the mobile terminal 2, and one or more pieces of location information. It is preferable that the one or more pieces of location information are the latest location information of the mobile terminal 2. The terminal information may include terminal communication information. The terminal information may have one or more attribute values.

[0061] The terminal identifier is information that identifies the mobile terminal 2. The terminal identifier may be a performer identifier that identifies the performer who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2. The performer identifier is, for example, the ID of the performer, the name of the performer, the email address of the performer, or the telephone number of the performer.

[0062] Location information is information that identifies a location. The location information is, for example, (latitude, longitude) or (movement, longitude, altitude). The location information may also be information that indicates the relative position of a venue (e.g., a soccer field) where a game is being played.

[0063] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of the communication application installed in the mobile terminal 2.

[0064] An attribute value is an attribute value of a performer. The attribute value may be, for example, a static attribute value or a dynamic attribute value. A static attribute value is a static attribute value of a performer. Examples of static attribute values ​​include a position in soccer or baseball (e.g., "goalkeeper," "forward," or "catcher"), or an instrument played by a performer. A dynamic attribute value is an attribute value that changes dynamically during a performance. Examples of dynamic attribute values ​​include position information of a performer, a role during a game in soccer or baseball (e.g., "ball holder," "penalty kicker," "batter," or "pitcher"), or information indicating whether or not a performer is holding the ball.

[0065] The user management unit 112 stores one or more pieces of user information. User information is information about a user. The user information includes, for example, a user identifier. The user information includes, for example, a performer condition. The user information includes, for example, one or more user attribute values.

[0066] A user identifier is information that identifies a user. The user identifier is, for example, an ID, a telephone number, an email address, a name, or an identifier of the user terminal 3. The identifier of the user terminal 3 is, for example, an IP address or a MAC address.

[0067] A performer condition is a condition for determining the video to be provided to a user. The performer condition is, for example, an attribute value condition or a specific condition. The attribute value condition is a condition related to the attribute value of a performer. Examples of the attribute value condition are "goalkeeper," "penalty kicker," and "ball holder." The specific condition is a condition for specifying a specific performer. A specific condition usually has one or more performer identifiers. Examples of the specific condition are "performer identifier = 101" and "performer identifier = 101, 102."

[0068] User attribute values ​​include, for example, gender, age, and payment information. Payment information is information used to pay for services such as viewing and purchasing videos. Payment information includes, for example, a bank account number, a credit card number, and a payment app ID.

[0069] The receiving unit 12 receives various types of information and instructions from the mobile terminal 2 or the user terminal 3. The various types of information and instructions include, for example, location information, inquiries, videos, additional videos (described later), stop instructions (described later), and purchase instructions (described later).

[0070] The receiver 12 may receive video from one or more mobile terminals 2 in pairs with location information. In such a case, it is preferable that the receiver 12 continuously receives the video. Continuous reception means, for example, receiving periodically or receiving constantly. The periodic interval may vary slightly.

[0071] The receiving unit 12 continuously receives, for example, position information of the ball in a match. In this case, a module that acquires and transmits position information is embedded in the ball.

[0072] The location receiving unit 121 receives location information from one or more mobile terminals 2. It is preferable that the location receiving unit 121 continuously receives the latest location information from one or more mobile terminals 2. The location receiving unit 121 may receive from the mobile terminal 2 one or more sets of location information corresponding to videos stored in the mobile terminal 2. The location receiving unit 121 normally receives location information in association with a terminal identifier. It is preferable that the location information is associated with one or more still images in the video.

[0073] The video receiving unit 122 receives video from one or more mobile terminals 2 installed in the performer. It is preferable that the video receiving unit 122 receives video from a plurality of mobile terminals 2. It is preferable that the video receiving unit 122 continuously receives video from one or more mobile terminals 2. It is preferable that such video is associated with one or more video attribute values. Such video is usually associated with location information and a performer identifier. It is preferable that time information is associated with the video.

[0074] The query receiving unit 123 receives a query from the user terminal 3. A query is a request for a video. A query typically includes a performer condition. A query may be for retrieving a current video or a past video. A query may include a performer condition that specifies multiple performers. A query may include a time condition related to when the video was captured. Preferably, a query is based on a selection of one or more performers for an operation object output on the user terminal 3.

[0075] The current video is a video that is transmitted immediately after being captured by the mobile terminal 2. The past video is a video that was captured by the mobile terminal 2 in the past, received by the information processing device 1, and stored once in a recording medium.

[0076] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by the attribute value acquisition unit 131, the object configuration unit 132, the video acquisition unit 133, the video configuration unit 134, and the right holder processing unit 135. The processing unit 13 accumulates the video received by the video receiving unit 122, for example.

[0077] The attribute value acquisition unit 131 acquires one or more attribute values ​​of a performer. The attribute values ​​may be static attribute values ​​or dynamic attribute values.

[0078] The attribute value acquisition unit 131 reads, for example, static attribute values ​​associated with the mobile terminal 2 from the terminal management unit 111. Association with the mobile terminal 2 usually means association with a performer identifier.

[0079] The attribute value acquisition unit 131 acquires, for example, dynamic attribute values. For example, the attribute value acquisition unit 131 acquires, in pairs with the performer identifier, the attribute value "ball holder" of the performer identified by the performer identifier that pairs with the received ball position information and position information that satisfies a similarity condition. The similarity condition is, for example, that the two pieces of position information are within a threshold, or that the position information is the one that has the smallest distance from the ball position information.

[0080] The attribute value acquisition unit 131 acquires, for example, the attribute value "PK kicker" of the performer corresponding to the position information of the penalty kick position and the position information that satisfies the approximation condition. For example, when the attribute value acquisition unit 131 detects that the difference between the received position information of the ball and the position information of the penalty kick position is within a threshold (for example, within 30 cm) for a period of time or longer, the attribute value acquisition unit 131 acquires the attribute value "PK kicker" of the performer corresponding to the position information of the penalty kick position and the position information that satisfies the approximation condition. It is assumed that the position information of the penalty kick position is stored in the storage unit 11 in advance.

[0081] The attribute value acquisition unit 131 may perform the same processing as that performed by the attribute value acquisition unit 233 described later to acquire tags from a video.

[0082] The object configuration unit 132 configures an operation object for selecting a performer corresponding to each of the one or more pieces of position information received by the position receiving unit 121, including one or more pieces of position information of the performers. The operation object is, for example, a screen or window including moving objects (e.g., buttons) that can be selected by each of the one or more pieces of position information received by the position receiving unit 121.

[0083] The video acquisition unit 133 acquires videos corresponding to one or more performers that match the received query. Note that a performer that matches the query can also be referred to as a mobile terminal 2 that matches the query. A video corresponding to a performer is a video transmitted by the mobile terminal 2 of the performer.

[0084] The video acquisition unit 133 preferably acquires a video corresponding to a performer whose attribute value matches the performer condition. The video acquisition unit 133 may acquire a video corresponding to each of a plurality of performers who match the performer condition.

[0085] The video acquisition unit 133 acquires past videos that match the query from among the past videos accumulated by the processing unit 13. The video acquisition unit 133 may acquire past videos that satisfy a time condition from among the past videos accumulated by the processing unit 13. For example, the video acquisition unit 133 acquires past videos that match a time condition that specifies when player A scores a goal, and that are X seconds before and after that moment, from the accumulated past videos.

[0086] The moving image composing unit 134 composes one moving image using the multiple moving images acquired by the moving image acquiring unit 133 .

[0087] The video composition unit 134, for example, temporally combines the multiple videos acquired by the video acquisition unit 133 to create a single video. Preferably, each of the multiple videos is captured by a different mobile terminal 2. A single video combined in time is a single video created by connecting multiple original videos. While it is preferable that the multiple original videos from which a single video is combined in time be captured consecutively in time, they may also be separated in time. For example, the time at which one original video was captured may be, for example, 8:20, and the day on which another original video was captured may be, for example, 8:25. The multiple original videos from which a single video is combined in time are, for example, videos corresponding to the attribute value "ball carrier." A single video combined in time is appropriately referred to as a combined video.

[0088] Furthermore, the video composition unit 134, for example, spatially fuses the multiple videos acquired by the video acquisition unit 133 to compose a single video. A single spatially fused video is a video constructed by constructing a frame using some or all of the frames that make up each of the multiple original videos for each of the multiple frames that make up each of the multiple original videos, and then connecting the constructed frames in time. Note that at least one of the frames that make up the single video is a frame that contains some or all of the frames of each of the multiple original videos. A single spatially fused video is appropriately referred to as a fused video.

[0089] The process of spatially fusing frames included in each of a plurality of moving images is, for example, the following processes (a) and (b). (a) Image processing-based methods

[0090] The moving image composition unit 134, for example, performs a process of aligning the orientation of each of the multiple frames that are the subject of spatial connection processing. Next, the moving image composition unit 134, for example, detects identical areas in each of the multiple frames. Next, the moving image composition unit 134, for example, performs a process of overlapping multiple frames that have identical areas to compose a single wide-area frame. Note that detecting identical areas in each of the multiple frames is possible using publicly known technology. (b) Machine learning-based methods

[0091] For example, the video composition unit 134 provides a plurality of frames and a learning model to a module that performs machine learning prediction processing, executes the module, and acquires one wide-area frame.

[0092] The learning model is obtained by providing multiple training data sets, each with multiple frames as explanatory variables and a single wide-area frame composed of the multiple frames as the objective variable, to a module that performs machine learning learning processing, and then executing the module.

[0093] The learning model may also be referred to as a learner, classifier, classification model, etc. Deep learning is preferable as a machine learning algorithm, but random forests and other algorithms are also acceptable. For machine learning, various machine learning functions, such as the TensorFlow library and the random forest module of the R language, and various existing libraries can be used.

[0094] The moving image composing unit 134 may perform processing up to passing one moving image acquired by the moving image acquiring unit 133 to the moving image transmitting unit 142. Such processing may also be considered to be processing for composing one moving image. The processing up to passing to the moving image transmitting unit 142 is usually processing for sequentially arranging the moving images in a buffer for transmitting the moving images.

[0095] The rights holder processing unit 135 performs rights holder processing. The rights holder processing is processing related to the rights holder identified by the rights holder identifier associated with the video. The rights holder identifier is usually a performer identifier, but may be a user identifier. The rights holder processing unit 135 performs rights holder processing, which is processing in response to the video transmission unit 142 transmitting a video, and is processing related to the rights holder identified by the rights holder identifier associated with the video. The rights holder processing is, for example, a first security processing described below, a second security processing described below, a third security processing described below, a fourth security processing described below, and a compensation processing described below.

[0096] The rights holder identifier associated with a video is, for example, the rights holder identifier associated with one or more videos that are the basis for the video, or the identifier of the user who requested the video. The user who requested the video is the user of the user terminal 3 that sent the inquiry.

[0097] The first maintenance means 1351 performs a first maintenance process of storing a moving image composed by the moving image composition unit 134 in association with a set of attribute values ​​corresponding to one or more moving images that are the basis of the moving image. The first maintenance means 1351 may also perform a first maintenance process of storing a moving image received from the mobile terminal 2 in association with a set of attribute values ​​corresponding to the moving image. The set of attribute values ​​is one or more moving image attribute values.

[0098] The second security means 1352 performs a second security process of storing one video composed by the video composition unit 134 in association with a right holder identifier corresponding to one or more videos that are the basis of the one video.

[0099] In addition, the first preservation means 1351 or the second preservation means 1352 may store a video composed by the video composition unit 134 in association with a set of attribute values ​​corresponding to one or more videos that formed the basis of the video, and with a rights holder identifier corresponding to one or more videos that formed the basis of the video.

[0100] The third security means 1353 stores one video composed by the video composition unit 134 in association with a rights holder identifier that identifies the user of the user terminal 3. The user of the user terminal 3 here is the person who watches one video. The user terminal 3 here is, for example, the terminal that sent the inquiry. The rights holder identifier here is a user identifier.

[0101] Furthermore, the destination where one video is stored is, for example, the storage unit 11, but it may also be another device, another device that constitutes a blockchain, etc.

[0102] The fourth security means 1354 performs a fourth security process to store security information. The security information includes access information for accessing a stored video. The order of storing a video and performing the fourth security process on the security information corresponding to that video does not matter.

[0103] The fourth security means 1354 performs a fourth security process, for example, of storing security information including access information for accessing one video that has been composed and stored by the video composition unit 134 in the blockchain.

[0104] It is preferable that the fourth security means 1354 stores the security information in a blockchain. That is, it is preferable that the fourth security means 1354 stores the security information in a distributed ledger of the blockchain. It is preferable that the fourth security means 1354 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1354 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.

[0105] Preservation information is information for ensuring the originality of a video. Preservation information can be said to be header information for a video. Preservation information is, for example, access information and a set of attribute values. It is preferable that preservation information has, for example, one or more rights holder identifiers. When preservation information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information. Rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder. The fourth preservation process can ensure the originality of the preservation information of a registered video. By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. Note that access information is information for accessing a video. Access information is information that identifies the storage location of a video. Access information is, for example, a URL or URI.

[0106] The security information preferably includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.

[0107] The remuneration means 1355 performs remuneration processing for each right holder identified by a right holder identifier associated with one or more moving images that are the basis of one moving image composed by the moving image composition unit 134.

[0108] The reward process is a process of providing a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more rights holder identifiers associated with a video. The reward process is, for example, a process of depositing money to a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a rights holder identified by one or more rights holder identifiers associated with a video. The reward process only needs to provide a benefit to a rights holder identified by one or more rights holder identifiers associated with a video, and the content of the benefit is not important. The reward may be, for example, money, points, goods, content, etc., and the content is not important.

[0109] It is preferable that the reward means 1355 acquires one or more video attribute values ​​corresponding to one or more videos that are the basis for a video transmitted by the video transmission unit 142, and performs reward processing, which is a process of determining rewards for each of multiple rights holders using the one or more video attribute values ​​and awarding the rewards.

[0110] Here, the one or more moving image attribute values ​​are, for example, the amount of moving image data, the length of moving image, the number of frames of moving image, and the resolution of moving image.

[0111] The reward means 1355 preferably acquires a reward amount corresponding to a service identifier that identifies a service provided for a target video, and performs a reward process that awards a reward corresponding to the reward amount. The service identifier may be, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.

[0112] The reward means 1355 performs a reward process, which is a process of obtaining a reward amount using, for example, one or more pieces of information from one or more video attribute values ​​and one or more service identifiers, and providing a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of a plurality of service identifiers is stored in the storage unit 11. The arithmetic expression is a formula for calculating the reward amount using one or more video attribute values ​​as parameters. The correspondence table is a table having a plurality of correspondence information for managing the reward amounts corresponding to one or more video attribute values.

[0113] The reward means 1355 normally performs a process of charging a reward to a user who has enjoyed a service related to the target video. The process of charging a reward is, for example, a process of charging the amount of reward obtained. The process of charging a reward is, for example, a process of charging the amount of reward obtained and the amount of profit obtained by the operator of the information processing device 1. The process of charging a reward is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc.

[0114] The transmitter 14 transmits various types of information or instructions to the mobile terminal 2 or the user terminal 3. The various types of information or instructions are, for example, operation objects and moving images. Note that the moving images may also be additional moving images.

[0115] The object transmitting unit 141 transmits the operation object constructed by the object constructing unit 132 to the user terminal 3 .

[0116] The video sending unit 142 sends the video acquired by the video acquiring unit 133 to the user terminal 3. This user terminal 3 is usually the user terminal 3 that has sent the inquiry. It is preferable that the video sending unit 142 sends the video composed by the video composition unit 134 to the user terminal 3. <Details of components of mobile terminal 2>

[0117] Various types of information are stored in the movement storage unit 21. The various types of information include, for example, a moving image, a set of attribute values, a performer identifier, and a camera attribute value. The camera attribute value is an attribute value of a camera. The camera attribute value is, for example, an angle of view, direction information, and resolution.

[0118] For example, one or more still images constituting a moving image correspond to one or more moving image attribute values ​​constituting an attribute value set. The one or more moving image attribute values ​​may correspond to all still images, some still images, or multiple still images.

[0119] The mobile receiving unit 22 receives various types of information. The various types of information are, for example, transmission instructions. The mobile instruction receiving unit 221 receives the transmission instructions from the information processing device 1. The transmission instructions are instructions to transmit a moving image.

[0120] The movement processing unit 23 performs various types of processing. The various types of processing are, for example, processing performed by the position acquisition unit 231, the photographing unit 232, the attribute value acquisition unit 233, and the composition unit 234. Note that the movement processing unit 23 does not necessarily have to include the attribute value acquisition unit 233 and the composition unit 234.

[0121] The position acquisition unit 231 acquires position information. The position acquisition unit 231 normally acquires position information that specifies the position of the mobile terminal 2. The position acquisition unit 231 acquires the position information by, for example, a GPS receiver. However, the means or algorithm by which the position acquisition unit 231 acquires the position information is not important.

[0122] The photographing unit 232 photographs a video. For example, the photographing unit 232 photographs a video while the mobile terminal 2 is moving. It is preferable that the photographed video be associated with location information acquired by the location acquisition unit 231. It is preferable that the photographed video be associated with one or more video attribute values ​​acquired by the attribute value acquisition unit 233, which will be described later. It is preferable that the mobile terminal 2 is moving when the performer is moving.

[0123] It is preferable that the imaging unit 232 stores the captured video in the mobile storage unit 21. When the imaging unit 232 stores video in the mobile storage unit 21, which has a limited storage capacity, it is preferable that the imaging unit 232 overwrites new video in an area where old video is stored. In other words, it is preferable that the structure of the mobile storage unit 21 is a ring buffer structure.

[0124] The attribute value acquisition unit 233 acquires one or more camera attribute values ​​including direction information indicating the direction in which the image is captured by the image capture unit 232. It is preferable that the attribute value acquisition unit 233 acquires one or more video attribute values ​​including the camera attribute value.

[0125] The attribute value acquisition unit 233 acquires, for example, one or more moving image attribute values. The one or more moving image attribute values ​​may be called an attribute value set.

[0126] The attribute value acquisition unit 233 acquires time information, which is the time, from a clock (not shown), for example. The attribute value acquisition unit 233 acquires time information, which is the time from the start of a match, from a timer (not shown), for example. The attribute value acquisition unit 233 acquires time information, which is the time, for example, constantly, at predetermined intervals, or when an acquisition condition is met.

[0127] The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting, and acquires seasonal information corresponding to the time information. The attribute value acquisition unit 233 acquires weather information, for example, during shooting. Note that even if the shooting location is indoors, the weather information may be information about the weather in the same area as the indoor location. The movement processing unit 23 acquires weather information corresponding to the location information, for example, from a server (not shown). The movement processing unit 23 acquires weather information, for example, continuously, at predetermined intervals, or when an acquisition condition is met. The attribute value acquisition unit 233 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to the location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information from a temperature sensor installed in a moving object, for example. The movement processing unit 23 acquires temperature information, for example, continuously, at predetermined intervals, or when an acquisition condition is met. Note that the acquisition condition is, for example, when a video analysis result meets a predetermined condition.

[0128] The attribute value acquisition unit 233 acquires, for example, one or more tags for the video captured by the shooting unit 232 and associates them with the video. Note that the tags can also be considered as video attribute values.

[0129] The attribute value acquisition unit 233, for example, analyzes the video captured by the shooting unit 232 and acquires one or more tags for the video.

[0130] The attribute value acquisition unit 233, for example, determines one or more still images that match the video tag condition and acquires a tag that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.

[0131] For example, if the video tag condition is "the size of the ball in the still image is equal to or greater than a threshold value," the attribute value acquisition unit 233 analyzes frames of the video, recognizes the ball, acquires the size of the ball, and determines whether the size matches the video tag condition. If the size matches the video tag condition, the attribute value acquisition unit 233 acquires a tag "ball holder" that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "ball holder" with the analyzed frame of the video.

[0132] The composition unit 234 associates the acquired location information with the video and acquires the additional video. Note that associating with a video usually means associating with one or more still images in the video. For example, the composition unit 234 associates the acquired location information with one or more still images acquired at the same time as the acquisition of the location information.

[0133] The composition unit 234 acquires an additional moving image in which, for example, one or more camera attribute values ​​acquired by the attribute value acquisition unit 233 are also associated with the moving image.

[0134] The composition unit 234 acquires an additional moving image in which, for example, one or more moving image attribute values ​​acquired by the attribute value acquisition unit 233 are also associated with the moving image. The additional moving image is a moving image to which one or more moving image attribute values ​​are added. Such one or more moving image attribute values ​​usually include position information. Each of the one or more moving image attribute values ​​usually corresponds to one or more still images in the moving image.

[0135] The mobile transmission unit 24 transmits various types of information to the information processing device 1. The various types of information include, for example, location information, moving images, and additional moving images. It is preferable that the mobile transmission unit 24 continuously transmits moving images acquired by the shooting unit 232 to the information processing device 1. In such a case, it is preferable that the moving images are associated with location information and a performer identifier.

[0136] The position transmitting unit 241 transmits the position information acquired by the position acquiring unit 231 to the information processing device 1. Such position information is usually associated with a performer identifier.

[0137] It is preferable that the location transmission unit 241 continuously transmits the location information to the information processing device 1. "Continuously" may include always or periodically. "Periodic" means that the transmission intervals may vary slightly. There is no restriction on the frequency or intervals at which the location transmission unit 241 transmits the location information.

[0138] The moving video transmitting unit 242 transmits the video. It is preferable that the moving video transmitting unit 242 continuously transmits the video to the information processing device 1. Note that such a video may be an additional video. Furthermore, a performer identifier is usually associated with the video.

[0139] The moving video transmitting unit 242 may transmit the video captured by the capturing unit 232 in response to the movement instruction receiving unit 221 receiving the transmission instruction.

[0140] The mobile output unit 25 outputs various types of information. The various types of information are, for example, moving images, additional moving images, and attribute value sets. Note that the mobile terminal 2 does not necessarily have to include the moving output unit 25.

[0141] Output is a concept that includes displaying on a display, projecting using a projector, printing on a printer, outputting sound, transmitting to an external device, storing on a recording medium, and handing over processing results to other processing devices or other programs.

[0142] The video output unit 251 outputs a video. It is preferable that the video output unit 251 outputs an additional video. The output here may be storage in the moving storage unit 21. <Details of components of user terminal 3>

[0143] Various types of information are stored in the user storage unit 31. The various types of information include, for example, a user identifier, a video, an inquiry, and background information.

[0144] Background information is information that includes information that constitutes an image of the location where the performer is performing. Background information includes, for example, a background image of a soccer field or a baseball stadium. Background information includes, for example, objects for inputting performer conditions. Objects are, for example, buttons, check boxes, and menu items. Background information is, for example, an image, but the data type is not important.

[0145] The user receiving unit 32 receives various instructions and information. The various instructions and information are, for example, an inquiry, a video instruction, and a stop instruction. Note that an inquiry may include a video instruction or a purchase instruction.

[0146] Reception is a concept that includes the reception of information entered from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.

[0147] The means for inputting various instructions and information may be any means, such as a touch panel, keyboard, mouse, or menu screen.

[0148] The inquiry may include a rights holder transfer flag, which is information indicating that the rights holder of the video is being transferred.

[0149] An animation instruction is an instruction to output an animation. An animation instruction is an instruction to the mobile terminal 2 on the operation screen. An animation instruction usually includes a performer condition. Note that the mobile terminal 2 on the operation screen may also be referred to as a performer on the operation screen.

[0150] The stop instruction is an instruction to stop transmission of video.

[0151] A purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information that identifies the video. The purchase instruction has, for example, a video identifier. The purchase instruction has, for example, time information. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, the purchase price. The purchase conditions include, for example, information that identifies the rights period.

[0152] The user processing unit 33 performs various types of processing. For example, the various types of processing are processing for creating a data structure for transmitting various instructions and information received by the user receiving unit 32. For example, the various types of processing are processing for creating a structure for transmitting information received by the user receiving unit 35.

[0153] The user processing unit 33 uses the received video instruction to construct a query that includes the performer identifier corresponding to the video instruction as a performer condition.

[0154] When a video instruction for the screen based on the operation object is accepted, the user processing unit 33 generates a query including, for example, a flag indicating that real-time video is to be acquired.

[0155] When an inquiry to acquire past videos is received, the user processing unit 33 constructs an inquiry including, for example, a flag indicating that past videos are to be acquired.

[0156] The screen acquisition unit 331 acquires an operation screen that clearly indicates the position specified by the position information of one or more mobile terminals 2. The screen acquisition unit 331 acquires the operation screen, for example, by using the received operation object. The screen acquisition unit 331 creates a screen that clearly indicates the received one or more pieces of position information in the background information of the user storage unit 31, for example.

[0157] The user acquisition unit 332 acquires a video captured by the mobile terminal 2 in response to a video instruction accepted by the user acceptance unit 32. The user acquisition unit 332 acquires a video received by the user reception unit 35, for example.

[0158] The user acquisition unit 332, for example, composes an inquiry using the video instruction accepted by the user acceptance unit 32. Next, the user acquisition unit 332, for example, transmits the inquiry to the information processing device 1. Next, the user acquisition unit 332, for example, receives the video from the information processing device 1 in response to the transmission of the inquiry.

[0159] The user transmission unit 34 transmits various instructions and information to the information processing device 1. The various instructions and information are, for example, an inquiry, a video instruction, a stop instruction, and a purchase instruction.

[0160] The user receiving unit 35 receives an operation object from the information processing device 1.

[0161] The user receiving unit 35 receives the moving image in response to the transmission of the inquiry. The user receiving unit 35 normally receives the moving image from the information processing device 1. Note that the moving image may be an additional moving image.

[0162] The user output unit 36 ​​outputs the video acquired by the user acquisition unit 332. The user output unit 36 ​​outputs the video received by the user reception unit 35, for example.

[0163] Here, output is a concept that includes displaying on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and delivery of processing results to other processing devices or other programs.

[0164] The screen output unit 361 outputs the operation screen acquired by the screen acquisition unit 331 .

[0165] The storage unit 11, the terminal management unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.

[0166] There is no restriction on the process by which information is stored in the storage unit 11 etc. For example, information may be stored in the storage unit 11 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 11 etc., or information input via an input device may be stored in the storage unit 11 etc.

[0167] The receiving unit 12, the location receiving unit 121, the video receiving unit 122, the inquiry receiving unit 123, the mobile receiving unit 22, and the user receiving unit 35 are typically realized by wireless or wired communication means, but may also be realized by means of receiving broadcasts.

[0168] The processing unit 13, attribute value acquisition unit 131, object configuration unit 132, video acquisition unit 133, video configuration unit 134, rights holder processing unit 135, first security means 1351, second security means 1352, third security means 1353, fourth security means 1354, reward means 1355, movement processing unit 23, user processing unit 33, screen acquisition unit 331, and user acquisition unit 332 can typically be realized by a processor, memory, etc. The processing procedures of the processing unit 13, etc. are typically realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.

[0169] The transmitting unit 14, the object transmitting unit 141, the video transmitting unit 142, the mobile transmitting unit 24, the location transmitting unit 241, the mobile video transmitting unit 242, and the user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.

[0170] The position acquisition unit 231 is realized by, for example, a GPS receiver.

[0171] The image capturing unit 232 includes a camera capable of capturing video, but the type of camera is not important.

[0172] The movement output unit 25, the video output unit 251, the user output unit 36, and the screen output unit 361 may or may not include output devices such as a display, a speaker, etc. The movement output unit 25 may be realized by driver software for an output device, or by a combination of driver software for an output device and the output device, etc.

[0173] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen. <Operation>

[0174] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described using the flowchart in Fig. 4. Note that "S" in each flowchart used in the following description indicates a step.

[0175] (S401) The receiving unit 12 determines whether or not additional moving images have been received from the mobile terminal 2. If additional moving images have been received, the process proceeds to S402; if not, the process proceeds to S407. The received additional moving images are associated with a performer identifier.

[0176] (S402) The processing unit 13 stores the additional moving image received in S401 in association with the performer identifier.

[0177] (S403) The processing unit 13 acquires the position information contained in the additional moving image.

[0178] (S404) The processing unit 13 stores the location information acquired in S403 in pairs with the performer identifier paired with the additional video. The location information may be stored in the storage unit 11, for example, but is not limited to this.

[0179] (S405) The processing unit 13 determines whether or not to transmit the location information accumulated in S404 to one or more user terminals 3. If it is to be transmitted, the process proceeds to S406, and if it is not to be transmitted, the process returns to S401.

[0180] It should be noted that the location information is transmitted, for example, when user information is managed by the user management unit 112. The reason for transmitting the location information is to inform the user terminal 3 of the latest location information of the performer.

[0181] (S406) The transmission unit 14 transmits the location information accumulated in S404 in pairs with the performer identifier to one or more user terminals 3. Return to S401.

[0182] The one or more user terminals 3 to which the location information is transmitted are the user terminals 3 corresponding to the user information managed by the user management unit 112.

[0183] (S407) The inquiry receiving unit 123 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S408; if an inquiry has not been received, the process proceeds to S416. Note that an inquiry is usually associated with the user identifier of the user who sent the inquiry. The inquiry here may also be an expression of intent to set performer conditions. If the inquiry is an expression of intent to set performer conditions, the performer conditions do not need to be stored in S409.

[0184] (S408) The processing unit 13 determines whether the inquiry received in S407 is an instruction to transmit real-time video or an instruction to transmit past video. If it is an instruction to transmit real-time video, the process proceeds to S409, and if it is an instruction to transmit past video, the process proceeds to S414.

[0185] Here, the processing unit 13 determines, for example, whether the flag in the inquiry is a flag indicating that real-time video is to be acquired or a flag indicating that past video is to be acquired.

[0186] (S409) The processing unit 13 stores the performer conditions included in the received inquiry in the user management unit 112 in pairs with the user identifier paired with the inquiry.

[0187] (S410) The processing unit 13 determines whether or not to transmit video to the user terminal 3 that has sent the inquiry. If the video is to be transmitted, the process proceeds to S411, and if the video is not to be transmitted, the process proceeds to S412.

[0188] Note that video is usually transmitted when a performance is in progress. Video is transmitted when, for example, a flag indicating that a performance is in progress is stored in storage unit 11. Note that the flag is information used for judgment.

[0189] (S411) The video acquisition unit 133 and the like perform a video transmission process to the user terminal 3 that has sent the inquiry. Return to S401. An example of the video transmission process will be described with reference to the flowchart in FIG.

[0190] (S412) Object configuration unit 132 performs object configuration processing. An example of the object configuration processing will be described with reference to the flowchart in Fig. 8. Note that the object configuration processing is processing for configuring an operation object to be used in user terminal 3.

[0191] (S413) The object sending unit 141 sends the operation object constructed in S412 to the user terminal 3 that sent the inquiry. Return to S401.

[0192] (S414) The processing unit 13 and the like perform a past video transmission process. An example of the past video transmission process will be described with reference to the flowchart in Fig. 9. The past video transmission process is a process of acquiring and transmitting videos that have been accumulated in the past and that match the query.

[0193] (S415) The processing unit 13 determines whether or not to transfer the rights holder of the video acquired in S414. If the rights holder is to be transferred, the process proceeds to S427, and if the rights holder is not to be transferred, the process returns to S401.

[0194] The right holder of the video is transferred when, for example, the inquiry includes a right holder transfer flag, but the method for determining whether or not to transfer the right holder is not important.

[0195] (S416) The processing unit 13 determines whether or not it is a period for transmitting video to one or more user terminals 3. If it is a period for transmitting video, the process proceeds to S417, and if it is not a period for transmitting video, the process proceeds to S421. Note that the video is a real-time video.

[0196] For example, the processing unit 13 determines that it is a period for transmitting a video when terminal information exists in the terminal management unit 111. For example, the processing unit 13 determines that it is a period for transmitting a video when a flag indicating that a performance (for example, a soccer match) is in progress exists in the storage unit 11. There is no restriction on the method by which the processing unit 13 determines that it is a period for transmitting a video.

[0197] (S417) The processing unit 13 assigns 1 to the counter i.

[0198] (S418) The processing unit 13 determines whether or not the i-th user information exists in the user management unit 112. If the i-th user information exists, the process proceeds to S419; if not, the process proceeds to S401.

[0199] (S419) The video acquisition unit 133 and the like perform a video transmission process to the user terminal 3 corresponding to the i-th user information. An example of the video transmission process will be described with reference to the flowchart in FIG.

[0200] (S420) The processing unit 13 increments the counter i by 1. The process returns to S418.

[0201] (S421) The receiving unit 12 determines whether or not a stop instruction has been received from the user terminal 3. If a stop instruction has been received, the process proceeds to S422, and if a stop instruction has not been received, the process proceeds to S424. The stop instruction is associated with a user identifier.

[0202] (S422) The processing unit 13 deletes the performer condition paired with the user identifier corresponding to the stop instruction received in S421 from the user management unit 112. Note that here, the processing unit 13 may also delete the user information corresponding to the user identifier corresponding to the stop instruction received in S421 from the user management unit 112. By deleting such performer condition or user information including the performer condition, videos will no longer be transmitted to the user terminal 3 of the user.

[0203] (S423) The rights holder processing unit 135 performs a preservation process. An example of the preservation process will be described with reference to the flowchart in Fig. 10. The video that is the target of the preservation process is the video that was sent to the user terminal 3 in response to the stop instruction received in S421.

[0204] (S424) The receiving unit 12 determines whether or not a purchase instruction has been received from the user terminal 3. If a purchase instruction has been received, the process proceeds to S425, and if a purchase instruction has not been received, the process returns to S401.

[0205] (S425) The video acquisition unit 133 acquires the video corresponding to the purchase instruction. Note that the video acquisition unit 133 acquires the video corresponding to the purchase instruction from the videos accumulated by the rights holder processing unit 135, for example.

[0206] (S426) The fourth security means 1354 acquires a user identifier corresponding to the user terminal 3 that sent the purchase instruction. This user identifier becomes the rights holder identifier for the purchased video. The user terminal 3 that sent the purchase instruction may be the user terminal 3 that sent the inquiry including the rights holder transfer flag.

[0207] (S427) The fourth security means 1354 performs the fourth security process using the user identifier acquired in S427. An example of the fourth security process will be described with reference to the flowchart in FIG.

[0208] (S428) The compensation means 1355 performs compensation processing for the original rights holder of the purchased video. Return to S401. An example of the compensation processing will be described using the flowchart in FIG.

[0209] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt occurs to end the process.

[0210] Next, an example of the video transmission process in S411 will be described with reference to the flowchart in FIG.

[0211] (S501) The video acquisition unit 133 acquires, from the user management unit 112, performer conditions paired with the user identifier of the user terminal 3 that transmits the video.

[0212] (S502) The video acquisition unit 133 acquires one or more performer identifiers that match the performer conditions acquired in S501.

[0213] (S503) The video acquisition unit 133 acquires the video that is paired with each of the one or more performer identifiers acquired in S502 and that was accumulated in S402. Note that the length of the video acquired by the video acquisition unit 133 does not matter. The video acquired by the video acquisition unit 133 is the stored video, and it is preferable that it is all unsent video. Furthermore, it is preferable that the acquired video is an additional video, but it may be only a video.

[0214] (S504) The moving image composition unit 134 determines whether or not multiple moving images were acquired in S503. If multiple moving images were acquired, the process proceeds to S505, and if one moving image was acquired, the process proceeds to S508.

[0215] (S505) The moving image composition unit 134 determines whether or not to spatially fuse the multiple moving images acquired in S503. If to fuse them spatially, proceed to S506, and if not to fuse them spatially, proceed to S507.

[0216] The moving image composition unit 134 determines that multiple moving images are spatially merged when there is spatial overlap among the multiple moving images. For example, the moving image composition unit 134 performs image recognition on the first frame of each of the multiple moving images, and determines that all frames overlap with one or more other frames, and determines that the multiple moving images are spatially merged. For example, the moving image composition unit 134 determines that the multiple moving images are spatially merged when all of the position information corresponding to each of the multiple moving images acquired in S503 is within a threshold value. The method by which the moving image composition unit 134 determines that the multiple moving images are spatially merged is not important.

[0217] (S506) The moving image composition unit 134 performs moving image fusion processing to spatially fuse the multiple moving images acquired in S503. An example of the moving image fusion processing will be described with reference to the flowchart in FIG.

[0218] (S507) The moving image composition unit 134 performs multiple window processing. The multiple window processing is processing in which each of the multiple moving images acquired in S503 is arranged in a separate window. An example of the multiple window processing will be described with reference to the flowchart in FIG. 7.

[0219] (S508) The video sending unit 142 sends the single video acquired in S503, the fusion video acquired in S506, or the multi-window video acquired in S507 to the user identifier, and then returns to the upper processing.

[0220] Next, an example of the moving image fusion process in S506 will be described with reference to the flowchart in FIG.

[0221] (S601) The moving image composition unit 134 assigns 1 to a counter i.

[0222] (S602) The moving image composition unit 134 determines whether the i-th frame exists in each of the acquired multiple moving images. If the i-th frame exists, the process proceeds to S603, and if not, the process proceeds to S606.

[0223] (S603) The moving image composition unit 134 acquires the i-th frame from each of the acquired multiple moving images.

[0224] (S604) The moving image composition unit 134 combines the frames acquired in S603 to obtain one frame. Note that an example of the technique for spatially combining multiple frames to compose one frame has been described above.

[0225] (S605) The moving image composition unit 134 increments the counter i by 1. The process returns to S602.

[0226] (S606) The moving image composition unit 134 temporally combines the multiple frames acquired in S604 in the order in which they were acquired to acquire a fused moving image, and then returns to the upper-level processing.

[0227] In the flowchart of FIG. 6, it is assumed that the acquired multiple moving images are synchronized in time.

[0228] Next, an example of the multiple window processing in S507 will be described with reference to the flowchart in FIG.

[0229] (S701) The moving image composition unit 134 acquires the number (n) of acquired moving images.

[0230] (S702) The moving image composition unit 134 acquires frame information having n window frames. Note that the frame information is information about the background that constitutes the frame.

[0231] (S703) The moving image composition unit 134 assigns 1 to a counter i.

[0232] (S704) The moving image composition unit 134 determines whether or not the i-th frame of each of the multiple moving images exists. If the i-th frame exists, the process proceeds to S705, and if not, the process proceeds to S711.

[0233] (S705) The moving image composition unit 134 assigns 1 to a counter j.

[0234] (S706) The moving image composition unit 134 determines whether the j-th moving image is present among the acquired moving images. If the j-th moving image is present, the process proceeds to S707, and if not, the process proceeds to S710.

[0235] (S707) The moving image composition unit 134 obtains the i-th frame of the j-th moving image.

[0236] (S708) The moving image composition unit 134 arranges the frame acquired in S707 in the j-th window in the frame information.

[0237] (S709) The moving image composition unit 134 increments the counter j by 1. The process returns to S706.

[0238] (S710) The moving image composition unit 134 increments the counter i by 1. The process returns to S704.

[0239] (S711) The moving image composition unit 134 temporally connects the multiple frames acquired in S708 in the order in which they were acquired to compose a moving image. The process returns to the upper-level processing. Note that this moving image is a multi-window moving image.

[0240] In the flowchart of FIG. 7, it is assumed that the acquired multiple moving images are synchronized in time.

[0241] Next, an example of the object configuration process in S412 will be described with reference to the flowchart in FIG.

[0242] (S801) The object configuration unit 132 acquires background information from the storage unit 11.

[0243] (S802) The object configuration unit 132 assigns 1 to a counter i.

[0244] (S803) The object configuration unit 132 determines whether the i-th performer exists. If the i-th performer exists, the process proceeds to S804; if not, the process returns to the upper level processing. The i-th performer is usually a performer currently performing (e.g., participating in a match).

[0245] The object configuration unit 132 determines whether the i-th performer exists, for example, based on whether the i-th terminal information exists in the terminal management unit 111. The object configuration unit 132, for example, references the terminal management unit 111 and determines whether the i-th performer exists whose performance flag is ON (for example, "1"). The performance flag is information J that indicates whether a performance is in progress. Note that the method for determining whether the i-th performer exists is not important.

[0246] (S804) The object configuration unit 132 acquires the latest location information of the i-th performer from the terminal management unit 111.

[0247] (S805) The object configuration unit 132 places a selection icon, which is an icon for selecting the i-th performer, at a position indicated by the position information acquired in S804, in a position within the background image configured by the background information. Note that the selection icon is a selectable object. The selection icon is, for example, a design, but may also be a character string. The selection icon is stored, for example, in the storage unit 11.

[0248] (S806) The object configuration unit 132 increments the counter i by 1. In the flowchart of S8043, the process of S805 configures a user interface that resembles a performance venue where selectable icons are placed at the performer's current position. This user interface is an operation object.

[0249] Next, an example of the past video transmission process in S414 will be described with reference to the flowchart in FIG.

[0250] (S801) The video acquisition unit 133 acquires a video identifier of a video that matches the query and that has been saved in the past. The video identifier is information that identifies a video, and may be, for example, an ID or a video name, but is not limited thereto.

[0251] (S802) The video acquisition unit 133 acquires the time conditions included in the inquiry.

[0252] (S803) The video acquisition unit 133 acquires videos within a range that matches the time condition from among the videos previously stored by the rights holder processing unit 135 and identified by video identifiers.

[0253] (S804) The video transmission unit 142 transmits the video acquired in S803 to the user terminal 3 that has transmitted the inquiry, and then returns to the upper-level processing.

[0254] Next, an example of the security process in S423 will be described with reference to the flowchart in FIG.

[0255] (S1001) Rights holder processing unit 135 stores the transmitted moving image in association with a set of attribute values ​​associated with one or more moving images that are the basis of the transmitted moving image.

[0256] It is preferable that the rights holder processing unit 135 stores the video in pairs with a rights holder identifier that identifies one or more rights holders. The rights holder identifier here is, for example, one or more performer identifiers of the video that is the source of the stored video. The rights holder identifier here is, for example, a user identifier that identifies the user who made the inquiry.

[0257] Furthermore, the rights holder processing unit 135 stores the video in, for example, the storage unit 11 or a device other than the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.

[0258] (S1002) The fourth maintenance means 1354 performs the fourth maintenance process. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.

[0259] (S1003) The rights holder processing unit 135 assigns 1 to the counter i.

[0260] (S1004) Rights holder processing unit 135 determines whether the i-th video that was the source of the stored video exists. If the i-th video exists, the process proceeds to S1005, and if not, the process returns to the upper process.

[0261] (S1005) Reward means 1355 performs reward processing. An example of the reward processing will be described using the flowchart in Fig. 12. The reward processing here is a process of rewarding the rights holder of the i-th video that is the basis of the accumulated video.

[0262] (S1006) Rights holder processing unit 135 determines whether or not to change the rights holder of the i-th video that is the source of the stored video. If the rights holder is to be changed, proceed to S1007; if the rights holder is not to be changed, proceed to S1008.

[0263] Whether or not to change the rights holder may be based on a flag corresponding to the i-th video, may be predetermined, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder."

[0264] (S1007) The rights holder processing unit 135 acquires the user identifier of the user terminal 3. This user identifier becomes a new rights holder identifier.

[0265] (S1008) The first maintenance unit 1351 stores the i-th moving image that is the source of the stored moving images.

[0266] (S1009) The fourth maintenance means 1354 performs a fourth maintenance process on the i-th video that is the source of the stored video. An example of the fourth maintenance process has been described using the flowchart in FIG.

[0267] (S1010) The rights holder processing unit 135 increments the counter i by 1. The process returns to S1004.

[0268] In the flowchart of Figure 10, when a combined video is constructed, a process (S1008) of storing the multiple videos that formed the combined video and a fourth maintenance process (S1009) are performed, but such processes do not have to be performed.

[0269] Next, an example of the fourth maintenance process of S427, S1002, and S1009 will be described with reference to the flowchart of FIG.

[0270] (S1101) The fourth security unit 1354 acquires access information that identifies a storage location of a moving image. The moving image may be, for example, a fused moving image or a combined moving image. The access information may be, for example, a URL.

[0271] (S1102) The fourth maintenance means 1354 acquires a set of attribute values ​​corresponding to the stored video. If the stored video is a video composed of multiple original videos, the set of attribute values ​​corresponding to the video is the set of attribute values ​​of each of the multiple original videos.

[0272] (S1103) The fourth security means 1354 constructs security information having the access information acquired in S1101, the attribute value set acquired in S1102, and the rights holder identifier of the video. Note that if a new rights holder identifier has been acquired, the fourth security means 1354 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. (S1104) The fourth maintenance means 1354 stores the maintenance information configured in S1103, and returns to the upper level processing.

[0273] In addition, in S1104, if preservation information for a video corresponding to the preservation information to be stored has been stored, the preservation information configured in S1103 is overwritten with the preservation information. This makes it possible to manage, for example, the transition of rights holders of the video. Furthermore, the fourth preservation means 1354 stores the preservation information in, for example, a blockchain.

[0274] Next, an example of the reward process in S428 and S1005 will be described with reference to the flowchart in FIG.

[0275] (S1201) Reward means 1355 acquires one or more right holder identifiers of the target video. Reward means 1355 may also acquire right holder identifiers of previous right holders of the target video.

[0276] (S1202) The reward means 1355 acquires a set of attribute values ​​of the target video.

[0277] (S1203) The reward unit 1355 acquires a service identifier that identifies the service provided for the target video. The service identifier is, for example, "view" or "purchase."

[0278] (S1204) The reward means 1355 acquires a reward amount using one or more pieces of information from the attribute value set acquired in S1202 and the service identifier acquired in S1203.

[0279] If multiple right holder identifiers are acquired, the remuneration means 1355 acquires a remuneration amount for each right holder identifier. If history information of a right holder including multiple right holder identifiers is acquired, the remuneration means 1355 may acquire a remuneration amount for each right holder identifier.

[0280] Furthermore, it is preferable that the remuneration means 1355, for example, acquires a video attribute value corresponding to each of the multiple videos that were the basis for the video transmitted by the video transmission unit 142, and uses the video attribute value to determine a remuneration amount for each of the multiple rights holders. It is preferable that the remuneration means 1355, for example, determines a larger remuneration amount the greater the data amount, video duration, or number of frames of the original video used in the video transmitted by the video transmission unit 142. It is preferable that the remuneration means 1355, for example, determines a larger remuneration amount the greater the resolution of the original video used in the video transmitted by the video transmission unit 142.

[0281] (S1205) The reward means 1355 performs processing to give a reward of the amount of reward acquired in S1204 to the right holder identified by the right holder identifier acquired in S1201.

[0282] (S1206) The remuneration means 1355 performs a process of charging the user who has enjoyed the service related to the target video with a remuneration. The process returns to the upper level process. Note that the target video is usually a video transmitted to the user terminal 3.

[0283] In the flowchart of FIG. 12, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.

[0284] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.

[0285] (S1301) The position acquisition unit 231 acquires position information. Note that the position information is also a video attribute value.

[0286] (S1302) The attribute value acquisition unit 233 acquires one or more moving image attribute values. Note that the one or more moving image attribute values ​​include, for example, time information.

[0287] (S1303) The image capturing unit 232 captures a moving image. Note that the length of the moving image captured here does not matter.

[0288] (S1304) The movement processing unit 23 acquires the performer identifier from the movement storage unit 21.

[0289] (S1305) Movement processing unit 23 composes an additional moving image having a moving image, position information, one or more moving image attribute values, and a performer identifier.

[0290] (S1306) The moving moving image transmission unit 242 transmits the additional moving image constructed in S1305 to the information processing device 1.

[0291] (S1307) The movement processing unit 23 determines whether or not to end the process. If it is determined that the process should be ended, the process ends, and if it is determined that the process should not be ended, the process returns to S1301.

[0292] The process is terminated when, for example, an instruction to terminate is received from the performer, or when a threshold time or more has elapsed since the start of the process.

[0293] 13, the mobile terminal 2 may continuously acquire location information and transmit the location information paired with a performer identifier to the information processing device 1. In this case, the mobile terminal 2 may transmit the video to the information processing device 1 when receiving an instruction to transmit the video from the information processing device 1.

[0294] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.

[0295] (S1401) The user receiving unit 35 determines whether or not an operation object has been received from the information processing device 1. If an operation object has been received, the process proceeds to S1402, and if not, the process proceeds to S1404.

[0296] (S1402) The screen acquisition unit 331 creates an operation screen using the operation objects received in S1401.

[0297] (S1403) The screen output unit 361 outputs the operation screen created in S1402. The process returns to S1401.

[0298] (S1404) The user reception unit 32 determines whether or not a video instruction has been received. If a video instruction has been received, the process proceeds to S1405, and if a video instruction has not been received, the process proceeds to S1411.

[0299] (S1405) The user processing unit 33 acquires the performer conditions corresponding to the accepted video instruction. Next, the user processing unit 33 constructs a query including the performer conditions and the user identifier. Next, the user transmission unit 34 transmits the query to the information processing device 1.

[0300] (S1406) The user receiving unit 35 determines whether or not a moving image has been received from the information processing device 1. If a moving image has been received, the process proceeds to S1407, and if a moving image has not been received, the process returns to S1406. Note that the moving image here may be, for example, an additional moving image.

[0301] (S1407) The video output unit 251 outputs the video received in S1406.

[0302] (S1408) The user reception unit 32 determines whether or not a new video instruction has been received. If a new video instruction has been received, the process proceeds to S1405, and if a new video instruction has not been received, the process proceeds to S1409.

[0303] (S1409) The user reception unit 32 determines whether or not a stop instruction has been received. If a stop instruction has been received, the process proceeds to S1410, and if a stop instruction has not been received, the process returns to S1406.

[0304] (S1410) The user processing unit 33 acquires a user identifier from the user storage unit 31. Next, the user processing unit 33 composes a stop instruction having the user identifier. The user transmission unit 34 transmits the stop instruction to the information processing device 1. Return to S1401.

[0305] (S1411) The user reception unit 32 determines whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to S1412, and if an inquiry has not been received, the process proceeds to S1415.

[0306] (S1412) The user processing unit 33 acquires a user identifier from the user storage unit 31. Next, the user processing unit 33 composes a query having the user identifier. The user transmission unit 34 transmits the query to the information processing device 1.

[0307] (S1413) In response to the transmission of the inquiry, the user receiving unit 35 determines whether or not a video has been received from the information processing device 1. If a video has been received, the process proceeds to S1414, and if a video has not been received, the process returns to S1413.

[0308] (S1414) The user output unit 36 ​​outputs the video received in S1413. The process returns to S1401.

[0309] (S1415) The user receiving unit 32 determines whether or not a purchase instruction has been received. If a purchase instruction has been received, the process proceeds to S1165, and if a purchase instruction has not been received, the process returns to S1401. Note that the purchase instruction includes, for example, an inquiry specifying the video to be purchased.

[0310] (S1416) The user processing unit 33 composes a purchase instruction to be transmitted. Next, the user transmitting unit 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.

[0311] (S1417) The user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1120, and if information has not been received, the process returns to S1119. The information may be, for example, a video, information indicating that the transfer of rights holders has been completed, and a set of attribute values ​​of the video.

[0312] (S1418) User processing unit 33 uses the received information to compose information to be output. User output unit 36 ​​outputs the information. Return to S1101.

[0313] In the flowchart of FIG. 14, the process ends when the power is turned off or an interrupt occurs to end the process.

[0314] A specific example of the operation of the information system A in this embodiment will be described below.

[0315] It is assumed that the terminal management unit 111 of the information processing device 1 stores a terminal management table having the structure shown in Fig. 15. The terminal management table is a table for managing mobile terminals 2. Here, it is assumed that the mobile terminals 2 are terminals attached to the uniforms of players playing in a soccer match.

[0316] The terminal management table manages records having "ID," "terminal identifier," "team name," "performer flag," "position," "location information," "terminal communication information," and "video." "ID" is information that identifies a record. "Team name" is the identifier of the team to which the performer (here, a player) belongs. "Performer flag" is information that indicates whether or not the performer is participating in a soccer match, with "1" indicating that the performer is participating in the match and "0" indicating that the performer is not participating in the match. "Position" is the player's position. "Location information" is the player's latest location information. Note that all received location information may be stored in "location information." "Terminal communication information" is information for communicating with the mobile terminal 2. "Video" is the name of the video file sent from the player's mobile terminal 2. Note that the video file is temporarily stored in storage unit 11.

[0317] It is assumed that the user management unit 112 stores a user management table having the structure shown in FIG. 16. The user management table manages records having an "ID," "user identifier," "performer conditions," and "user attribute value." The "user attribute value" has a "purchase flag" and "payment information." The "purchase flag" is information indicating whether or not to purchase a video, with "1" indicating to purchase the video and "0" indicating not to purchase the video. The "payment information" is information for paying the cost of purchasing or viewing a video. In this case, the "payment information" is a credit card number, bank account information, or a user ID for a payment app. The "payment information" is, for example, information registered by a user when purchasing tickets for a soccer game.

[0318] Now, let us assume that before a soccer match, a large number of supporters (users) set performer conditions using a performer condition setting screen (which may also be called an operation screen) shown in FIG. 17 displayed on the user terminal 3, for example. In order for the operation screen to be output to the user terminal 3, the following processing is performed. That is, the user receiving unit 35 of the user terminal 3 receives an operation object from the information processing device 1. Next, the screen acquisition unit 331 uses the operation object to construct an operation screen. Next, the screen output unit 361 outputs the operation screen (FIG. 17).

[0319] The operation screen (FIG. 17) has various buttons (for example, 1701 to 1706) for setting performer conditions, a send button 1700, and purchase flags, "Purchase" button 1707 and "Do not purchase" button 1708. When the "Purchase" button 1707 is pressed, the purchase flag sent is "1," and when the "Do not purchase" button 1708 is pressed, the purchase flag sent is "0."

[0320] Assume that user 1, identified by user identifier "U101," selects the icon of player A02 in 1701 in FIG. 17, selects the "Purchase" button 1707, and then selects the "Send" button 1700. The user accepting unit 32 then accepts the video instruction "<performer condition> T102 <purchase flag> 1." Next, the user processing unit 33 constructs a query "<user identifier> U101 <performer condition> T102 <purchase flag> 1 <video type> real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0321] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to send real-time video from the "<video type> real-time" included in the inquiry. Next, the processing unit 13 pairs the performer condition "T102" and purchase flag "1" included in the received inquiry with the user identifier "U101" included in the inquiry and stores them in the user management table (FIG. 16). This record is the record "ID=1" in FIG. 16.

[0322] Also, assume that user 1, identified by user identifier "U102," selects two icons of players A01 and A02 in 1701 in FIG. 17, selects the "Do not purchase" button 1708, and then selects the "Send" button 1700. The user accepting unit 32 then accepts the video instruction "<performer condition> T101, T102 <purchase flag> 0." Next, the user processing unit 33 generates a query corresponding to the video instruction: "<user identifier> U102 <performer condition> T101, T102 <purchase flag> 0 <video type> real time." The user transmitting unit 34 transmits the query to the information processing device 1.

[0323] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to send real-time video from the "<video type> real-time" included in the inquiry. Next, the processing unit 13 pairs the performer conditions "T101, T102" and purchase flag "0" included in the received inquiry with the user identifier "U102" included in the inquiry and stores them in the user management table (FIG. 16). This record is the record "ID=2" in FIG. 16.

[0324] 17, the user 1 identified by the user identifier "U103" selects "Team B" 1703, selects the position "MF" 1704, selects the "Do not purchase" button 1708, and then selects the "Send" button 1700. The user accepting unit 32 then accepts the video instruction "<Performer condition> Team name = Team B & Position = MF <Purchase flag> 0". The user processing unit 33 then generates a query corresponding to the video instruction: "<User identifier> U103 <Performer condition> Team name = Team B & Position = MF <Purchase flag> 0 <Video type> Real time". The user transmitting unit 34 transmits the query to the information processing device 1.

[0325] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to send real-time video from the "<video type> real-time" included in the inquiry. Next, the processing unit 13 pairs the performer condition "Team name = Team B & Position = MF" and the purchase flag "0" included in the received inquiry with the user identifier "U103" included in the inquiry and stores them in the user management table (FIG. 16). This record is the record "ID=3" in FIG. 16.

[0326] Also, assume that user 1 identified by user identifier "U104" selects "Ball holder" 1703 in FIG. 17, selects the "Purchase" button 1707, and then selects the "Send" button 1700. The user receiving unit 32 then receives the video instruction "<Performer condition> Ball holder <Purchase flag> 1". The user processing unit 33 then generates a query corresponding to the video instruction: "<User identifier> U104 <Performer condition> Ball holder <Purchase flag> 1 <Video type> Real time". The user transmitting unit 34 transmits the query to the information processing device 1.

[0327] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to transmit real-time video from the "<video type> real-time" included in the inquiry. Next, the processing unit 13 pairs the performer condition "ball holder" and purchase flag "1" included in the received inquiry with the user identifier "U104" included in the inquiry and stores them in the user management table (FIG. 16). This record is the record "ID=4" in FIG. 16.

[0328] Furthermore, assume that user 1, identified by user identifier "U105," selects "PK kicker" 1706 in FIG. 17, selects the "Purchase" button 1707, and then selects the "Send" button 1700. The user accepting unit 32 then accepts the video instruction "<performer condition>PK kicker <purchase flag>1." Next, the user processing unit 33 constructs a query "<user identifier>U105 <performer condition>PK kicker <purchase flag>1 <video type>real time" corresponding to the video instruction. The user transmitting unit 34 transmits the query to the information processing device 1.

[0329] Next, the inquiry receiving unit 123 of the information processing device 1 receives an inquiry from the user terminal 3. Next, the processing unit 13 determines that the received inquiry is an instruction to send real-time video from the "<video type> real-time" included in the inquiry. Next, the processing unit 13 pairs the performer condition "PK kicker" and purchase flag "1" included in the received inquiry with the user identifier "U105" included in the inquiry and stores them in the user management table (FIG. 16). This record is the record "ID=5" in FIG. 16.

[0330] It is assumed that a soccer match has started under the above circumstances. During the soccer match, position information specifying the position of the soccer ball is continuously transmitted from a device embedded in the soccer ball to the information processing device 1. The information processing device 1 then receives the soccer ball's position information and accumulates it in the storage unit 11. It is also assumed that the storage unit 11 stores penalty kick position information specifying the position where the penalty kick will be kicked.

[0331] Also, during a soccer match, additional videos are successively transmitted from the mobile terminals 2 of the 22 players playing in the match to the information processing device 1. Then, the information processing device 1 receives the additional videos, and stores the videos and location information in the storage unit 11 in pairs with the terminal identifiers.

[0332] Furthermore, the processing unit 13 of the information processing device 1 determines that the soccer match is a period during which moving images are to be transmitted to one or more user terminals 3. Then, the information processing device 1 continues to transmit to the user terminals 3 moving images that conform to the performer conditions of each user.

[0333] For example, the information processing device 1 continues to transmit a video corresponding to the terminal identifier "T102" to the user terminal 3 corresponding to the user identifier "U101." The user terminal 3 then receives and outputs the video. An image of such a video is shown in FIG. 18.

[0334] The user identified by the user identifier "U101" can change the performer conditions at any time during the match by operating the setting screen in Fig. 17. In other words, the user can set new performer conditions at any time during the match by operating the setting screen in Fig. 17.

[0335] Since the purchase flag paired with the user identifier "U101" is "1," the user purchases the video viewed during the game. As a result, the information processing device 1 performs the fourth preservation process and the reward process described above on the video viewed by the user.

[0336] Furthermore, for example, to the user terminal 3 corresponding to the user identifier "U103," the information processing device 1 continues to transmit a single fusion video or a multi-window video that spatially fuses videos transmitted from two mobile terminals 2 identified by terminal identifiers "T201, T203" that are paired with "team name=Team B" and "position=MF." Then, the user terminal 3 receives and outputs the video.

[0337] Furthermore, since the purchase flag paired with the user identifier "U103" is "0", the fourth preservation process and reward process are not performed on the videos that the user viewed during the match.

[0338] Furthermore, for example, for the user terminal 3 corresponding to user identifier "U104," the video acquisition unit 133 of the information processing device 1 constantly acquires a video paired with the terminal identifier corresponding to the position information closest to the ball's position information, and acquires a combined video by combining the videos in time. Then, the video transmission unit 142 continues to transmit the combined video. Then, the user terminal 3 receives and outputs the video.

[0339] Since the purchase flag paired with the user identifier "U104" is "1," the user purchases the combined video viewed during the match. As a result, the information processing device 1 performs the fourth preservation process and the reward process described above on the combined video viewed by the user.

[0340] As described above, according to this embodiment, video captured by the mobile terminal 2 of the performer while the performer is performing can be used.

[0341] Furthermore, according to this embodiment, videos of appropriate performers can be used.

[0342] Furthermore, according to this embodiment, a single video can be created from videos of multiple performers.

[0343] Furthermore, according to this embodiment, videos of performers at appropriate times can be used.

[0344] Furthermore, according to this embodiment, it is possible to assist the user in easily selecting a video.

[0345] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.

[0346] Furthermore, according to this embodiment, a reward can be given to the rights holder of the video captured by the mobile terminal 2.

[0347] The various processes performed by the various devices in this embodiment may be implemented by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments in this specification.

[0348] 19 shows the appearance of a computer that executes the programs described herein to realize the information processing device 1, mobile terminal 2, and user terminal 3 of the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 19 is an overview of this computer system 300, and FIG. 20 is a block diagram of the system 300.

[0349] In FIG. 19, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0350] 20, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.

[0351] A program that causes computer system 300 to execute the functions of information processing device 1 and the like of the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and then transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may also be loaded directly from CD-ROM 3101 or the network.

[0352] The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-described embodiment. The program only needs to include instructions that call appropriate functions (modules) in a controlled manner and achieve desired results. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.

[0353] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).

[0354] The computer that executes the program may be a single computer or a plurality of computers, that is, it may perform centralized processing or distributed processing.

[0355] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be physically realized by one medium.

[0356] Furthermore, in each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.

[0357] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]

[0358] As described above, the information processing device 1 according to the present invention has the effect of being able to use video captured by a mobile terminal of a performer while the performer is performing, and is useful as a video providing server or the like.

Claims

1. a video receiving unit that receives video from one or more mobile terminals installed in the performers; an inquiry receiving unit that receives an inquiry from a user terminal; a video acquisition unit that acquires the video corresponding to the performer that matches the query; and a video transmission unit that transmits the video acquired by the video acquisition unit to the user terminal.

2. Further comprising an attribute value acquisition unit that acquires the attribute value of the performer; The inquiry receiving unit receiving a query including a performer condition regarding attribute values ​​of the performers; The video acquisition unit Obtaining videos corresponding to performers with attribute values ​​that match the performer conditions; The video transmission unit The information processing apparatus according to claim 1 , wherein the video acquisition unit transmits the acquired video to the user terminal.

3. The video receiving unit receiving video from multiple mobile terminals; The inquiry receiving unit receiving a query including a performer condition that identifies a plurality of performers; The video acquisition unit Obtaining videos corresponding to each of a plurality of performers that meet the performer conditions; a moving image composition unit that composes one moving image using the plurality of moving images acquired by the moving image acquisition unit; The video transmission unit 3. The information processing apparatus according to claim 1, wherein the moving image constructed by the moving image construction unit is transmitted to the user terminal.

4. The video composition unit 4. The information processing apparatus according to claim 3, wherein the plurality of moving images are combined temporally or spatially fused to form one moving image.

5. a processing unit that stores the video received by the video receiving unit, The video is associated with time information that identifies the time when the video was taken, The inquiry receiving unit receiving a query including a time condition regarding when the video was captured; The video acquisition unit The processing unit acquires a video that satisfies the time condition from among the videos stored therein; The video transmission unit The information processing device according to claim 1 , wherein the video acquired by the video acquisition unit is transmitted to the user terminal.

6. a location receiving unit that receives location information from each of the one or more mobile terminals; an object configuration unit that configures an operation object including the one or more pieces of location information received by the location receiving unit and that is used to select a performer corresponding to each of the one or more pieces of location information; an object sending unit that sends the operation object to the user terminal; The inquiry receiving unit receiving the query based on one or more performer selections for the control object; The video acquisition unit The information processing device according to claim 1 , further comprising: acquiring videos corresponding to the one or more performers that match the query.

7. The video acquired by the video acquisition unit is associated with a rights holder identifier that identifies the rights holder of the video, 7. The information processing device according to claim 1, further comprising a right holder processing unit that performs right holder processing related to a right holder identified by a right holder identifier associated with the video.

8. The right holder processing unit:

8. The information processing apparatus according to claim 7, further comprising a third security means for storing the video in association with a right holder identifier that identifies the user of the user terminal.

9. a screen acquisition unit that acquires an operation screen indicating a position identified by the position information of each of one or more mobile devices installed in the performer; a screen output unit that outputs the operation screen; a user reception unit that receives a video instruction, which is an instruction to the mobile terminal on the operation screen; a user acquisition unit that acquires the video captured by the mobile terminal in response to the video instruction; a user output unit that outputs the video acquired by the user acquisition unit.

10. a user receiving unit that receives the operation object from the information processing device according to claim 6; The screen capture unit Using the operation object, the operation screen is acquired; The user acquisition unit The user terminal according to claim 9 , wherein the user terminal forms a query using the video instruction, transmits the query to the information processing device, and receives the video from the information processing device in response to the transmission of the query.

11. An information processing method realized by a video receiving unit, an inquiry receiving unit, a video acquiring unit, and a video transmitting unit, a video receiving step in which the video receiving unit receives videos from one or more mobile terminals installed in the performers; an inquiry receiving step in which the inquiry receiving unit receives an inquiry from a user terminal; a video acquisition step in which the video acquisition unit acquires the video corresponding to the performer who matches the query; a video transmission step in which the video transmission unit transmits the video acquired in the video acquisition step to the user terminal.

12. An information processing method realized by a screen acquisition unit, a screen output unit, a user reception unit, a user acquisition unit, and a user output unit, a screen acquisition step in which the screen acquisition unit acquires an operation screen indicating a position specified by the position information of each of one or more mobile terminals installed in the performer; a screen output step in which the screen output unit outputs the operation screen; a user receiving step in which the user receiving unit receives a video instruction, which is an instruction to the mobile terminal on the operation screen; a user acquisition step in which the user acquisition unit acquires a video captured by the mobile terminal in response to the video instruction; a user output step in which the user output unit outputs the video acquired in the user acquisition step.

Images