Information processing device, mobile terminal, user terminal, and information processing method

Abstract

To solve a problem that motion pictures at points on a path cannot be properly acquired.SOLUTION: An information processing apparatus 1 according to the present invention has an inquiry receiving unit 122 for receiving an inquiry including path specifying information for use in specifying a path from a user terminal 3, a motion picture acquiring unit 133 for acquiring a motion picture captured by each of one or more mobile terminals satisfying a path condition of corresponding to positional information for use in specifying at least a part of the path specified by the path specifying information, and a motion picture transmission unit 141 for transmitting the motion picture to the user terminal 3. The motion picture acquiring unit 133 acquires a first motion picture corresponding to the positional information specifying a first partial path of the path specified by the path specifying information, and acquires a second motion picture corresponding to the positional information specifying a second partial path beyond the first partial path of the path specified by the path specifying information. The motion picture transmission unit 141 transmits the first motion picture and the second motion picture. The information processing apparatus 1 makes it possible to properly acquire the motion pictures at each of the positions on the path.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device or the like that can serve as a platform for providing video along a route. [Background technology]

[0002] BACKGROUND ART Conventionally, there has been a technique for providing a user with image data taken by an in-vehicle camera at a location and environment desired by the user (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-83034 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, it was not possible to properly acquire videos captured by a mobile terminal at points along a route. [Means for solving the problem]

[0005] The information processing device of the first invention is an information processing device that includes an inquiry receiving unit that receives an inquiry including route identification information that identifies a route from a user terminal, a video acquisition unit that acquires a first video corresponding to location information that identifies a first partial route corresponding to location information that identifies at least a part of the route identified by the route identification information, and acquires a second video corresponding to location information that identifies a second partial route beyond the first partial route of the route identified by the route identification information, and a video transmission unit that transmits the first video and the second video to the user terminal.

[0006] This configuration provides a platform for appropriately providing videos taken by multiple mobile terminals at points along the route.

[0007] Furthermore, compared to the first invention, the information processing device of the second invention further comprises a terminal management unit in which terminal information including location information that identifies the location of each mobile terminal is stored, associated with each of one or more mobile terminals; a location receiving unit that receives location information from each of one or more mobile terminals; and a terminal determination unit that uses the location information received by the location receiving unit to determine one or more mobile terminals that were present on at least a portion of the route identified by the route identification information, and the video acquisition unit is an information processing device that acquires videos taken by each of the one or more mobile terminals determined by the terminal determination unit.

[0008] This configuration makes it possible to provide a platform that places a low load on mobile terminals for providing video of points along a route.

[0009] Furthermore, the information processing device of the third invention is an information processing device that, compared to the first invention, includes an inquiry sending unit that sends an inquiry to each of a plurality of mobile terminals, and the video acquisition unit receives video from one or more mobile terminals that are determined to satisfy a route condition, which is a condition that the route identification information corresponds to location information that identifies at least a part of the route identified, in response to the sending of the inquiry.

[0010] This configuration reduces the load on the platform for appropriately providing videos captured by mobile terminals at points along the route.

[0011] In addition, the information processing device of the fourth invention is an information processing device in which, compared to any of the first to fourth inventions, the video acquired by the video acquisition unit is associated with a rights holder identifier that identifies the rights holder of the video, and further includes a rights holder processing unit that performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier associated with the video.

[0012] This configuration allows appropriate processing regarding the rights holder of the video.

[0013] In addition, the information processing device of the fifth invention is an information processing device in which, compared to the fourth invention, the rights holder processing unit is equipped with a third security means for storing the video in association with a rights holder identifier that identifies the user of the user terminal.

[0014] With this configuration, the rights holder of the video can become the rights holder who needs the video.

[0015] In addition, the mobile terminal of the sixth invention is a mobile terminal that includes a location acquisition unit that acquires location information that identifies the location of the mobile terminal, a shooting unit that shoots video, a mobile receiving unit that receives an inquiry including route identification information, a mobile determination unit that determines whether the location information acquired by the location acquisition unit satisfies a route condition that corresponds to location information that identifies at least a part of the route identified by the route identification information, and a mobile video transmission unit that transmits the video when the location determination unit determines that the route condition is met.

[0016] With this configuration, it is possible to realize a mobile terminal that appropriately provides video of points along a route.

[0017] In addition, the user terminal of the seventh invention includes a user output unit that outputs a map that clearly shows the route, a user transmitting unit that transmits an inquiry including route identification information that identifies the route, a user receiving unit that receives a video in response to the transmission of the inquiry, a user receiving unit that receives a point instruction that is an instruction for a point on the route on the map, and a user processing unit that acquires a video corresponding to location information that indicates the point for the point instruction, and the user output unit is a user terminal that outputs the video acquired by the user processing unit.

[0018] With this configuration, it is possible to realize a user terminal that can appropriately acquire videos of points along a route. [Effects of the Invention]

[0019] According to the information processing device of the present invention, video images of each point on the route can be appropriately acquired. [Brief explanation of the drawings]

[0020] [Figure 1] Conceptual diagram of information system A in embodiment 1 [Figure 2] Block diagram of Information System A [Figure 3] Block diagram of the information processing device 1 [Figure 4] A flowchart illustrating an example of the operation of the information processing device 1. [Figure 5] Flowchart illustrating an example of the terminal determination process [Figure 6] A flowchart illustrating an example of the past video acquisition process. [Figure 7] A flowchart illustrating an example of the maintenance process [Figure 8] 10 is a flowchart illustrating an example of the fourth maintenance process. [Figure 9] A flowchart illustrating an example of the reward process [Figure 10] A flowchart illustrating an example of the operation of the mobile terminal 2 [Figure 11] A flowchart illustrating an example of the operation of the user terminal 3 [Figure 12] A diagram showing the terminal management table [Figure 13] Figure showing an example of the output [Figure 14] Figure showing an example of the output [Figure 15] Figure showing an example of the output [Figure 16] Block diagram of information system B in embodiment 2 [Figure 17] Block diagram of the information processing device 4 [Figure 18] A flowchart illustrating an example of the operation of the information processing device 4 [Figure 19] A flowchart illustrating an example of the operation of the mobile terminal 5 [Figure 20] Overview of the computer system in the above embodiment [Figure 21] Block diagram of the computer system DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, embodiments of an information processing device and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.

[0022] (Embodiment 1) <Outline of First Embodiment>

[0023] In this embodiment, an information processing device that serves as a platform for acquiring and providing one or more videos using route identification information that identifies a route will be described.

[0024] In this embodiment, an information processing device that performs right holder processing related to the right holder of the output video will be described. The right holder processing includes, for example, a compensation processing described later and various security processing described later.

[0025] In this embodiment, a mobile terminal that transmits acquired location information to an information processing device and transmits a captured video to the information processing device in response to a transmission instruction received from the information processing device will be described.

[0026] Furthermore, in this embodiment, a user terminal that receives an instruction for a specific point on a route and outputs a video of that point will be described.

[0027] In this specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>

[0028] 1 is a conceptual diagram of an information system A according to this embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.

[0029] The information processing device 1 is a server that provides video transmitted from one or more mobile terminals 2 to a user terminal 3. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type is not important. The information processing device 1 may also be a device that constitutes a blockchain.

[0030] In this specification, the interval between the capture times of the multiple still images included in a moving image does not matter. A moving image is, for example, a moving image at 60 frames per second or 30 frames per second, but it may also be a collection of multiple still images captured at intervals of a predetermined time (for example, one minute) or more, or a collection of multiple still images captured when predetermined conditions are met. Still images may also be called fields or frames.

[0031] The mobile terminal 2 is a terminal that can move. The mobile terminal 2 is a terminal that is installed on a moving object and that captures video. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, camera-equipped glasses, or a smart watch with a camera. Furthermore, "installed" usually means fixed, but it may also be considered to include being in contact with or held by something. The mobile object is a moving object, such as a piece of equipment that moves underground, or a living thing. The living thing is usually a person, but it may also be a dog, cat, etc.

[0032] The user terminal 3 is a terminal used by a user. A user is someone who watches videos or needs videos. The user terminal 3 may have the functions of a mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may be, for example, a navigation terminal, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and its type does not matter.

[0033] The information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3 are generally capable of communicating via a network such as the Internet.

[0034] 2 is a block diagram of an information system A according to the present embodiment, and FIG.

[0035] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a terminal management unit 111. The receiving unit 12 includes a location receiving unit 121 and an inquiry receiving unit 122. The processing unit 13 includes a location accumulation unit 131, a terminal determination unit 132, a video acquisition unit 133, a video composition unit 134, and a right holder processing unit 135. The right holder processing unit 135 includes a first security means 1351, a second security means 1352, a third security means 1353, a fourth security means 1354, and a remuneration means 1355. The transmitting unit 14 includes a video sending unit 141.

[0036] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, a moving transmitting unit 24, and a moving output unit 25. The moving processing unit 23 includes a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234. The moving transmitting unit 24 includes a position transmission unit 241 and a moving video transmission unit 242. The moving output unit 25 includes a video output unit 251.

[0037] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit , a user reception unit 35, and a user output unit . <Details of Components of Information Processing Device 1>

[0038] Various types of information are stored in the storage unit 11. The various types of information are, for example, terminal information (to be described later), a video, and one or more video attribute values associated with the video.

[0039] Video attribute values are attribute values of a video. Video attribute values are, for example, environmental information. Environmental information is information about the environment in which a video was shot. Environmental information includes, for example, location information, time information, weather information, temperature information, and seasonal information, which will be described later. Time information is information that identifies the time when a video was shot. The time when a video was shot may be around the time the video was shot, and accuracy is not required. Time information includes, for example, the time of day, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / date, and month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that identifies the weather at the location (or region) where the video was shot. Weather information includes, for example, "sunny," "rain," "snow," and "cloudy." Temperature information is information that identifies the temperature at the location where the video was shot. Temperature information includes, for example, "25 degrees" or "above 30 degrees." Seasonal information is information that identifies the season at the location where the video was shot. The season information is, for example, "spring," "summer," "early summer," and "winter."

[0040] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information relating to the mobile terminal 2. The terminal information here typically includes a terminal identifier that is an identifier of the mobile terminal 2, location information, and terminal communication information. The mobile terminal 2 here is typically a terminal that can transmit video. The terminal information is associated with the mobile terminal 2.

[0041] The terminal identifier is information that identifies the mobile terminal 2. The terminal identifier may be a rights holder identifier that identifies the rights holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.

[0042] A rights holder is someone who has some right to the video captured by the mobile terminal 2. A rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that captured the video, or the person with the right to dispose of the video. A rights holder is, for example, the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it can be anyone who has the rights to the video captured by the mobile terminal 2.

[0043] The rights holder identifier may be a terminal identifier. The rights holder identifier is, for example, the rights holder's ID, name, email address, or telephone number. The rights holder's ID is, for example, a user identifier.

[0044] Location information is information that identifies a location. The location information is, for example, (latitude, longitude) or (movement, longitude, altitude).

[0045] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of the communication application installed in the mobile terminal 2.

[0046] The receiving unit 12 receives various types of information and instructions from the mobile terminal 2 or the user terminal 3. The various types of information and instructions include, for example, location information, inquiries, videos, and additional videos, which will be described later.

[0047] The receiver 12 may receive video from one or more mobile terminals 2 in pairs with location information. In such a case, it is preferable that the receiver 12 continuously receives the video. Continuous reception means, for example, receiving periodically or receiving constantly. The periodic interval may vary slightly.

[0048] The location receiving unit 121 receives location information from one or more mobile terminals 2. It is preferable that the location receiving unit 121 continuously receives the latest location information from one or more mobile terminals 2. The location receiving unit 121 may receive, from the mobile terminal 2, one or more sets of location information corresponding to videos stored in the mobile terminal 2. The location receiving unit 121 normally receives location information in association with a terminal identifier.

[0049] The inquiry receiving unit 122 receives an inquiry from the user terminal 3. The inquiry can be said to be a request for video captured at one or more points on a route. The inquiry includes route identification information. The inquiry includes, for example, a timing flag.

[0050] Route specification information is information that specifies a route. Route specification information may be route information including multiple location information, information on a departure point and a destination, or a set of three or more location names. Route specification information may be any information that can specify a route, and its structure and content are not important.

[0051] The timing flag is information that specifies the type of video to be acquired. The timing flag can be "real time," which instructs the transmission of video being shot in real time, or "past," which instructs the transmission of video that was shot and stored in the past.

[0052] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by a location accumulation unit 131, a terminal determination unit 132, a video acquisition unit 133, a video composition unit 134, and a rights holder processing unit 135.

[0053] The processing unit 13 may store the videos continuously received by the receiving unit 12 in association with the location information and the terminal identifier.

[0054] The processing unit 13 determines whether the latest location information of the mobile terminal 2 transmitting the video, which is the location information received by the receiving unit 12, has deviated from the route indicated by the route identification information.

[0055] The location accumulation unit 131 accumulates the location information received by the location receiving unit 121 from the mobile terminal 2 in the terminal management unit 111 in association with the mobile terminal 2. The location accumulation unit 131 accumulates the location information in the terminal management unit 111, for example, in pairs with a terminal identifier. It is preferable that the location accumulation unit 131 add the location information to the terminal management unit 111 in association with the mobile terminal 2.

[0056] In response to the received inquiry, the terminal determination unit 132 determines one or more mobile terminals 2 that satisfy the route conditions.

[0057] The route condition is a condition that corresponds to location information that identifies at least a part of the route identified by the route identification information. The route condition is that the mobile terminal 2 is capturing an image at any point on the route identified by the route identification information, that the mobile terminal 2 is present at any point on the route identified by the route identification information, or that the mobile terminal 2 has video captured at one or more points on the route identified by the route identification information.

[0058] The terminal determination unit 132 determines, for example, one or more mobile terminals 2 corresponding to the location information that identifies at least a part of the route identified by the route identification information included in the received inquiry.

[0059] When the terminal determination unit 132 determines multiple mobile terminals 2 corresponding to location information that identifies at least part of the route identified by the route identification information contained in the received inquiry, the terminal determination unit 132 may select only one or more mobile terminals 2 that satisfy the selection conditions.

[0060] The selection condition is, for example, that the mobile terminal 2 corresponds to a plurality of pieces of location information for which the ratio of support for the route specified by the route specification information is equal to or greater than a threshold. The selection condition is, for example, that the ratio of support for the route specified by the route specification information is the largest.

[0061] When the terminal determination unit 132 determines a plurality of mobile terminals 2 corresponding to location information that identifies at least a portion of the route identified by the route identification information contained in the received inquiry, the terminal determination unit 132 may use sorting information as a key to sort the plurality of mobile terminals 2. The sorting information is, for example, the proportion of the route identified by the plurality of location information associated with the mobile terminal 2 that supports the route identified by the route identification information.

[0062] The video acquisition unit 133 acquires videos taken by one or more mobile terminals 2 that satisfy the route conditions.

[0063] The video acquisition unit 133 acquires, for example, a first video corresponding to location information that identifies a first partial route of the route identified by the route identification information, and acquires a second video corresponding to location information that identifies a second partial route other than the first partial route of the route identified by the route identification information. Note that the first partial route and the second partial route are parts of the route identified by the route identification information. It is preferable that the first partial route and the second partial route are continuous routes. It is also preferable that the first partial route and the second partial route are routes that do not overlap. In the route identified by the route identification information, for example, the second partial route is a route that follows the first partial route.

[0064] The video acquisition unit 133 acquires, for example, videos taken by one or more mobile terminals 2 determined by the terminal determination unit 132.

[0065] The video acquisition unit 133 transmits a transmission instruction to, for example, one or more mobile terminals 2 determined by the terminal determination unit 132. Then, the video acquisition unit 133 receives video from, for example, the one or more mobile terminals 2. Such video is usually video that is transmitted immediately after being captured by the mobile terminal 2. Such video is appropriately referred to as real-time video.

[0066] For example, the video acquisition unit 133 transmits a transmission instruction having the route identification information to one or more mobile terminals 2 determined by the terminal determination unit 132. Then, the video acquisition unit 133 receives, from each mobile terminal 2, video that has been captured by the one or more mobile terminals 2 along the route specified by the route identification information and that has been stored in each mobile terminal 2. Such video is video that has been captured and stored by the mobile terminal 2, and is appropriately referred to as past video.

[0067] The video acquisition unit 133 acquires, for example, videos stored by the rights holder processing unit 135 described later, which are videos taken at one or more points on the route specified by the route identification information. Such videos are also referred to as past videos as appropriate. For example, the video acquisition unit 133 checks location information paired with the past videos stored by the rights holder processing unit 135, and acquires videos corresponding to the location information of one or more points on the route specified by the route identification information. For example, the video acquisition unit 133 acquires videos using access information described later.

[0068] The video composition unit 134, for example, temporally combines multiple videos acquired by the video acquisition unit 133 to compose a single video. Preferably, each of the multiple videos is a video captured at a different point on the route identified by the route identification information. A single video combined in time is a single video created by connecting multiple original videos. While it is preferable that the multiple original videos from which a single video is combined in time be captured, they may also be separated in time. For example, the time at which one original video was captured may be, for example, 8:20, and the day on which another original video was captured may be, for example, 8:25. Preferably, the video composition unit 134 combines multiple videos in the order of points on the route identified by the route identification information to compose a single video. A combined video is appropriately referred to as a combined video.

[0069] Furthermore, the video composition unit 134, for example, spatially fuses the multiple videos acquired by the video acquisition unit 133 to compose a single video. A single spatially fused video is a video constructed by constructing a frame using some or all of the frames that make up each of the multiple original videos for each of the multiple frames that make up each of the multiple original videos, and then connecting the constructed frames in time. Note that at least one of the frames that make up the single video is a frame that contains some or all of the frames of each of the multiple original videos. A single spatially fused video is appropriately referred to as a fused video.

[0070] The moving image composing unit 134 may perform processing up to passing one moving image acquired by the moving image acquiring unit 133 to the moving image transmitting unit 141. Such processing may also be considered to be processing for composing one moving image. The processing up to passing to the moving image transmitting unit 141 is usually processing for sequentially arranging the moving images in a buffer for transmitting the moving images.

[0071] For example, the video composition unit 134 combines multiple videos acquired by the video acquisition unit 133 in the order of the time information corresponding to the videos to compose a single video. For example, the video composition unit 134 acquires portions of multiple videos acquired by the video acquisition unit 133 and combines the portions of the videos in order to compose a single video. Combining multiple videos in time typically means combining portions of videos captured by multiple mobile terminals 2 in the order in which they were captured. Combining portions of videos in order may also mean passing portions of the videos in order to the video transmission unit 141. Furthermore, combining videos in the order of time corresponding to the videos means combining the videos in the order of time indicated by the time information corresponding to the videos, or combining the videos in the order in which they were received. Combining multiple videos in time to compose a single video is sufficient as long as the user sees the video as a single video.

[0072] The moving image composition unit 134 composes one moving image, for example, by spatially fusing parts of each of the multiple moving images that have different position information associated with each of the multiple moving images acquired by the moving image acquisition unit 133. The moving image composition unit 134 composes one frame using, for example, some or all of the frames that compose each of the multiple moving images acquired by the moving image acquisition unit 133, and connects the frames in time to compose one moving image.

[0073] The process of spatially fusing frames included in each of a plurality of moving images is, for example, the following processes (a) and (b). (a) Image processing-based methods

[0074] The moving image composition unit 134, for example, performs a process of aligning the orientation and scale of each of the multiple frames that are the subject of the spatial connection process. Next, the moving image composition unit 134, for example, detects identical areas in each of the multiple frames. Next, the moving image composition unit 134, for example, performs a process of overlapping multiple frames that have identical areas to compose a single wide-area frame. Note that detecting identical areas in each of the multiple frames is possible using publicly known technology. (b) Machine learning-based methods

[0075] For example, the video composition unit 134 provides a plurality of frames and a learning model to a module that performs machine learning prediction processing, executes the module, and acquires one wide-area frame.

[0076] The learning model is obtained by providing multiple training data sets, each with multiple frames as explanatory variables and a single wide-area frame composed of the multiple frames as the objective variable, to a module that performs machine learning learning processing, and then executing the module.

[0077] The learning model may also be referred to as a learner, classifier, classification model, etc. Deep learning is preferable as a machine learning algorithm, but random forests and other algorithms are also acceptable. For machine learning, various machine learning functions, such as the TensorFlow library and the random forest module of the R language, and various existing libraries can be used.

[0078] The rights holder processing unit 135 performs rights holder processing. The rights holder processing is processing related to a rights holder identified by a rights holder identifier associated with a video. The rights holder processing unit 135 performs, for example, processing in response to the video transmission unit 141 transmitting a video, and is processing related to a rights holder identified by a rights holder identifier associated with the video. The rights holder processing is, for example, a first security processing described below, a second security processing described below, a third security processing described below, a fourth security processing described below, and a compensation processing described below.

[0079] The rights holder identifier associated with a video is, for example, the rights holder identifier associated with one or more videos that are the basis for the video, or the identifier of the user who requested the video. The user who requested the video is the user of the user terminal 3 that sent the inquiry.

[0080] The first maintenance means 1351 performs a first maintenance process of storing a moving image composed by the moving image composition unit 134 in association with a set of attribute values corresponding to one or more moving images that are the basis of the moving image. The first maintenance means 1351 may also perform a first maintenance process of storing a moving image received from the mobile terminal 2 in association with a set of attribute values corresponding to the moving image. The set of attribute values is one or more moving image attribute values.

[0081] The second security means 1352 performs a second security process of storing one video composed by the video composition unit 134 in association with a right holder identifier corresponding to one or more videos that are the basis of the one video.

[0082] In addition, the first preservation means 1351 or the second preservation means 1352 may store a video composed by the video composition unit 134 in association with a set of attribute values corresponding to one or more videos that formed the basis of the video, and with a rights holder identifier corresponding to one or more videos that formed the basis of the video.

[0083] The third security means 1353 stores one video composed by the video composition unit 134 in association with a rights holder identifier that identifies the user of the user terminal 3. The user of the user terminal 3 here is the person who watches one video. The user terminal 3 here is, for example, the terminal that sent the inquiry.

[0084] Furthermore, the destination where one video is stored is, for example, the storage unit 11, but it may also be another device, another device that constitutes a blockchain, etc.

[0085] The fourth security means 1354 performs a fourth security process to store security information. The security information includes access information for accessing a stored video. The order of storing a video and performing the fourth security process on the security information corresponding to the video does not matter.

[0086] The fourth security means 1354 performs a fourth security process, for example, of storing security information including access information for accessing one video that has been composed and stored by the video composition unit 134 in the blockchain.

[0087] It is preferable that the fourth security means 1354 stores the security information in a blockchain. That is, it is preferable that the fourth security means 1354 stores the security information in a distributed ledger of the blockchain. It is preferable that the fourth security means 1354 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1354 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.

[0088] Preservation information is information for ensuring the originality of a video. Preservation information can be said to be header information for a video. Preservation information is, for example, access information and a set of attribute values. It is preferable that preservation information has, for example, one or more rights holder identifiers. When preservation information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information. Rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder. The fourth preservation process can ensure the originality of the preservation information of a registered video. By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. Note that access information is information for accessing a video. Access information is information that identifies the storage location of a video. Access information is, for example, a URL or URI.

[0089] The security information preferably includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.

[0090] The remuneration means 1355 performs remuneration processing for each right holder identified by a right holder identifier associated with one or more moving images that are the basis of one moving image composed by the moving image composition unit 134.

[0091] The reward process is a process of providing a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more rights holder identifiers associated with a video. The reward process is, for example, a process of depositing money to a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a rights holder identified by one or more rights holder identifiers associated with a video. The reward process only needs to provide a benefit to a rights holder identified by one or more rights holder identifiers associated with a video, and the content of the benefit is not important. The reward may be, for example, money, points, goods, content, etc., and the content is not important.

[0092] It is preferable that the reward means 1355 acquires one or more video attribute values corresponding to one or more videos that are the basis for a video transmitted by the video transmission unit 141, and performs reward processing, which is a process of determining rewards for each of multiple rights holders using the one or more video attribute values and awarding the rewards.

[0093] Here, the one or more moving image attribute values are, for example, the amount of moving image data, the length of moving image, the number of frames of moving image, and the resolution of moving image.

[0094] The reward means 1355 preferably acquires a reward amount corresponding to a service identifier that identifies a service provided for a target video, and performs a reward process that awards a reward corresponding to the reward amount. The service identifier may be, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.

[0095] The reward means 1355 performs a reward process, which is a process of obtaining a reward amount using, for example, one or more pieces of information from one or more video attribute values and one or more service identifiers, and providing a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of a plurality of service identifiers is stored in the storage unit 11. The arithmetic expression is a formula for calculating the reward amount using one or more video attribute values as parameters. The correspondence table is a table having a plurality of correspondence information for managing the reward amounts corresponding to one or more video attribute values.

[0096] The reward means 1355 normally performs a process of charging a reward to a user who has enjoyed a service related to the target video. The process of charging a reward is, for example, a process of charging the amount of reward obtained. The process of charging a reward is, for example, a process of charging the amount of reward obtained and the amount of profit obtained by the operator of the information processing device 1. The process of charging a reward is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc.

[0097] The transmitter 14 transmits various types of information or instructions to the mobile terminal 2 or the user terminal 3. The various types of information or instructions are, for example, moving images, transmission instructions, and stop instructions. Note that the stop instruction is an instruction to stop transmission of moving images.

[0098] When it is determined that the latest location information of the mobile terminal 2 transmitting the video has deviated from the route indicated by the route identification information, the transmission unit 14 transmits a stop instruction to the mobile terminal 2.

[0099] The moving image sending unit 141 transmits the moving image composed by the moving image composition unit 134 to the user terminal 3. The moving image composed by the moving image composition unit 134 may be the moving image acquired by the moving image acquisition unit 133 itself.

[0100] The video transmitting unit 141 transmits, for example, the first video and the second video acquired by the video acquiring unit 133 to the user terminal 3. It is preferable that the video transmitting unit 141 transmits the videos in the order of their positions on the route identified by the route identification information. <Details of components of mobile terminal 2>

[0101] Various types of information are stored in the moving storage unit 21. The various types of information include, for example, a video, an attribute value set, a rights holder identifier, and a camera attribute value. The camera attribute value is an attribute value of a camera. The camera attribute value is, for example, an angle of view, direction information, and resolution.

[0102] For example, one or more still images constituting a moving image correspond to one or more moving image attribute values constituting an attribute value set. The one or more moving image attribute values may correspond to all still images, some still images, or multiple still images.

[0103] The mobile receiving unit 22 receives various types of information. The various types of information are, for example, a transmission instruction and a stop instruction. The mobile instruction receiving unit 221 receives a transmission instruction from the information processing device 1.

[0104] The movement processing unit 23 performs various types of processing. The various types of processing are, for example, processing performed by a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234.

[0105] The position acquisition unit 231 acquires position information. The position acquisition unit 231 normally acquires position information that specifies the position of the mobile terminal 2. The position acquisition unit 231 acquires the position information by, for example, a GPS receiver. However, the means or algorithm by which the position acquisition unit 231 acquires the position information is not important.

[0106] The photographing unit 232 photographs a moving image. For example, the photographing unit 232 photographs a moving image while the mobile terminal 2 is moving. It is preferable that the photographed moving image is associated with location information acquired by the location acquisition unit 231. It is also preferable that the photographed moving image is associated with one or more moving image attribute values acquired by the attribute value acquisition unit 233, which will be described later.

[0107] It is preferable that the imaging unit 231 stores the captured video in the mobile storage unit 21. When the imaging unit 231 stores video in the mobile storage unit 21, which has a limited storage capacity, it is preferable that the imaging unit 231 overwrites new video in an area where old video is stored. In other words, it is preferable that the structure of the mobile storage unit 21 is a ring buffer structure.

[0108] The attribute value acquisition unit 233 acquires one or more camera attribute values including direction information indicating the direction in which the image is captured by the image capture unit 232. It is preferable that the attribute value acquisition unit 233 acquires one or more video attribute values including the camera attribute value.

[0109] The attribute value acquisition unit 233 acquires, for example, one or more video attribute values. The one or more video attribute values may be referred to as an attribute value set. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting. The attribute value acquisition unit 233 acquires time information, for example, constantly, at predetermined intervals, or when acquisition conditions are met. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting, and acquires seasonal information corresponding to the time information. The attribute value acquisition unit 233 acquires weather information, for example, during shooting. Note that even if the shooting location is indoors, the weather information may be information about the weather in a region similar to the indoor location. The movement processing unit 23 acquires weather information corresponding to the location information, for example, from a server (not shown). The movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when acquisition conditions are met. The attribute value acquisition unit 233 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to the location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed on the moving object. The movement processing unit 23 acquires the temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is met. Note that the acquisition condition is, for example, when the analysis result of the video satisfies a predetermined condition.

[0110] The attribute value acquisition unit 233 acquires, for example, one or more tags for the video captured by the shooting unit 231 and associates them with the video. Note that the tags can also be considered as video attribute values.

[0111] The attribute value acquisition unit 233, for example, analyzes the video captured by the imaging unit 231 and acquires one or more tags for the video.

[0112] The attribute value acquisition unit 233 acquires one or more tags, for example, using one or more moving object attribute values acquired during shooting by the shooting unit 231. The moving object attribute values are, for example, CAN data.

[0113] The attribute value acquisition unit 233, for example, determines one or more still images that match the video tag condition and acquires a tag that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.

[0114] For example, if the video tag condition is "the number of cars with a distance between them within a threshold is equal to or greater than a threshold and the car's moving speed is equal to or less than a threshold," and the tag paired with the video tag condition is "traffic jam," the attribute value acquisition unit 233 analyzes frames of the video, recognizes multiple cars, and acquires the distances between each of the multiple cars. The attribute value acquisition unit 233 also acquires the number of cars with a distance between them within a threshold. The attribute value acquisition unit 233 also acquires the moving distance and frame rate of a single car in multiple frames, and acquires the car's speed. The attribute value acquisition unit 233 then determines whether the video tag condition is met using the number of cars with a distance between them within a threshold and the car's speed. If the video tag condition is met, the attribute value acquisition unit 233 acquires the tag "traffic jam" paired with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.

[0115] The attribute value acquisition unit 233 may, for example, determine one or more moving object attribute values that match the attribute value tag condition, and acquire a tag that pairs with the attribute value tag condition. The attribute value acquisition unit 233 may also associate the tag with a video that pairs with the one or more moving object attribute values.

[0116] For example, if the attribute value tag condition is "driving time at a speed of less than 30 km for 10 minutes or more and the proportion of the driving time at a speed less than 30% is 80% or more," and the tag paired with the attribute value tag condition is "traffic jam," the attribute value acquisition unit 233 uses the speed history contained in the CAN data associated with each field of the video to detect CAN data that matches the attribute value tag condition, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is CAN data acquired at the same time that the field was captured.

[0117] The composition unit 234 associates the acquired location information with the video and acquires an additional video. The composition unit 234, for example, acquires an additional video in which one or more camera attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. The composition unit 234, for example, acquires an additional video in which one or more video attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. The additional video is a video to which one or more video attribute values have been added. Such one or more video attribute values usually include location information.

[0118] The mobile transmitting unit 24 transmits various types of information to the information processing device 1. The various types of information include, for example, location information, moving images, and additional moving images. The mobile transmitting unit 24 may continuously transmit moving images acquired by the photographing unit 232 to the information processing device 1. In such cases, the moving images are usually associated with location information.

[0119] Preferably, the mobile transmitter 24 stops transmitting the video when a stop instruction is received.

[0120] The position transmitting unit 241 transmits the position information acquired by the position acquiring unit 231 to the information processing device 1.

[0121] It is preferable that the location transmission unit 241 continuously transmits the location information to the information processing device 1. "Continuously" may include always or periodically. "Periodic" means that the transmission intervals may vary slightly. There is no restriction on the frequency or intervals at which the location transmission unit 241 transmits the location information.

[0122] For example, the moving video transmitting unit 242 transmits the video captured by the imaging unit 232 in response to the movement instruction receiving unit 221 receiving a transmission instruction. It is preferable that the moving video transmitting unit 242 transmits an additional video.

[0123] For example, in response to the movement instruction receiving unit 221 receiving a transmission instruction, the movement processing unit 23 acquires from the movement storage unit 21 past videos paired with one or more pieces of location information corresponding to the route specified by the route specifying information included in the transmission instruction, and the movement video sending unit 242 sends the past videos. It is preferable that the movement video sending unit 242 sends additional videos.

[0124] The movement output unit 25 outputs various types of information, such as a moving image, an additional moving image, and a set of attribute values.

[0125] Output is a concept that includes displaying on a display, projecting using a projector, printing on a printer, outputting sound, transmitting to an external device, storing on a recording medium, and handing over processing results to other processing devices or other programs.

[0126] The video output unit 251 outputs a video. It is preferable that the video output unit 251 outputs an additional video. The output here may be storage in the moving storage unit 21. <Details of components of user terminal 3>

[0127] Various types of information are stored in the user storage unit 31. The various types of information include, for example, a user identifier, a video, an inquiry, and map information.

[0128] The user reception unit 32 receives various instructions and information. The various instructions and information include, for example, an inquiry, a location instruction, a purchase instruction, and route specification information. Note that an inquiry may include a purchase instruction. The route specification information may also be a destination.

[0129] Reception is a concept that includes the reception of information entered from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.

[0130] The point instruction is an instruction to output a video of a point on the route shown on the output map.

[0131] A purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information that identifies the video. The purchase instruction has, for example, a video identifier. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, a purchase price. The purchase conditions include, for example, information that identifies the rights period.

[0132] The means for inputting various instructions and information may be any means, such as a touch panel, keyboard, mouse, or menu screen.

[0133] The user processing unit 33 performs various types of processing. For example, the various types of processing are processing for creating a data structure for transmitting various instructions and information received by the user receiving unit 32. For example, the various types of processing are processing for creating a structure for transmitting information received by the user receiving unit 35.

[0134] The user processing unit 33 acquires a video corresponding to the position information indicating the location corresponding to the location instruction received by the user receiving unit 32. This video is a part or all of the videos received by the user receiving unit 35.

[0135] For example, when a destination is accepted, the user processing unit 33 acquires route specification information using the current position and the destination. Note that this processing is well known processing in navigation terminals.

[0136] The user transmission unit 34 transmits various instructions and information to the information processing device 1. The various instructions and information are, for example, inquiries and purchase instructions.

[0137] The user transmission unit 34 transmits, for example, a query including route identification information that identifies a route. The timing or trigger for the user transmission unit 34 to transmit the query does not matter. For example, when a route is set, the user transmission unit 34 transmits a query including route identification information that identifies the route.

[0138] The user receiving unit 35 receives the video in response to the transmission of an inquiry. The user receiving unit 35 usually receives the video from the information processing device 1. For example, in response to the transmission of an inquiry, the user receiving unit 35 receives location information of a mobile terminal 2 that is located at a point on the route specified by the route identification information. For example, in response to the transmission of an inquiry, the user receiving unit 35 receives thumbnail images that constitute the video captured by a mobile terminal 2 that is located at a point on the route specified by the route identification information.

[0139] The user output unit 36 outputs a map using the map information in the user storage unit 31. The user output unit 36 outputs a map that clearly shows the route indicated by the route identification information acquired by the user processing unit 33.

[0140] The user output unit 36 outputs a map that indicates locations along the route where videos can be acquired. The locations where videos can be acquired are locations indicated by the location information of one or more mobile terminals 2 received by the user receiving unit 35. The user output unit 36 outputs, for example, thumbnail images received by the user receiving unit 35. It is preferable that the user output unit 36 output the thumbnail images in association with the locations indicated by the location information associated with the thumbnail images.

[0141] The user output unit 36 outputs the video received by the user receiving unit 35 .

[0142] The storage unit 11, the terminal management unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.

[0143] There is no restriction on the process by which information is stored in the storage unit 11 etc. For example, information may be stored in the storage unit 11 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 11 etc., or information input via an input device may be stored in the storage unit 11 etc.

[0144] The receiving unit 12, the location receiving unit 121, the inquiry receiving unit 122, the mobile receiving unit 22, and the user receiving unit 35 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.

[0145] The processing unit 13, location accumulation unit 131, terminal determination unit 132, video acquisition unit 133, video composition unit 134, rights holder processing unit 135, first security means 1351, second security means 1352, third security means 1353, fourth security means 1354, reward means 1355, movement processing unit 23, attribute value acquisition unit 233, composition unit 234, and user processing unit 33 can typically be realized by a processor, memory, etc. The processing procedures of the processing unit 13, etc. are typically realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.

[0146] The transmitting unit 14, video transmitting unit 141, mobile transmitting unit 24, location transmitting unit 241, mobile video transmitting unit 242, and user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.

[0147] The position acquisition unit 231 is realized by, for example, a GPS receiver.

[0148] The image capturing unit 232 includes a camera capable of capturing video, but the type of camera is not important.

[0149] The movement output unit 25, the video output unit 251, and the user output unit 36 may or may not include output devices such as a display, a speaker, etc. The movement output unit 25 may be realized by driver software for an output device, or by a combination of driver software for an output device and the output device, etc.

[0150] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen. <Operation>

[0151] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described using the flowchart in Fig. 4. Note that "S" in each flowchart used in the following description indicates a step.

[0152] (S401) The location receiving unit 121 determines whether or not location information has been received from the mobile terminal 2. If location information has been received, the process proceeds to S402; if location information has not been received, the process proceeds to S403. The received location information is associated with a terminal identifier. Here, the receiving unit 12 may receive video from the mobile terminal 2 in pairs with one or more pieces of location information. The receiving unit 12 may also receive location information and one or more video attribute values.

[0153] (S402) Location accumulation unit 131 associates the location information received in S401 with the terminal identifier and adds it to terminal management unit 111. Return to S401. Note that processing unit 13 may accumulate videos paired with one or more pieces of location information.

[0154] (S403) The inquiry receiving unit 122 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S404, and if an inquiry has not been received, the process returns to S401. Note that an inquiry is usually associated with the user identifier of the user who sent the inquiry.

[0155] (S404) The terminal determination unit 132 acquires route information included in the inquiry received in S403. Alternatively, the terminal determination unit 132 acquires route information using route specification information included in the inquiry. Note that the route information is a collection of multiple pieces of location information.

[0156] (S405) The terminal determination unit 132 determines whether the inquiry received in S403 is an inquiry indicating the acquisition of real-time video (appropriately referred to as "real-time") or an inquiry indicating the acquisition of video that may include video stored in the past (appropriately referred to as "past") If it is an inquiry indicating real-time acquisition, the process proceeds to S406, and if it is an inquiry indicating past acquisition, the process proceeds to S413.

[0157] The terminal determining unit 132 determines whether the inquiry is "real time" or "past" based on the value of a timing flag included in the inquiry, for example.

[0158] (S406) The terminal determination unit 132 determines one or more mobile terminals 2 to which real-time video can be transmitted. An example of such terminal determination processing will be described using the flowchart in Fig. 5. Note that the mobile terminals 2 that can transmit real-time video are mobile terminals 2 that are capturing video at any point on the route specified by the route information.

[0159] (S407) The moving image acquiring unit 133 assigns 1 to a counter i.

[0160] (S408) The video acquisition unit 133 determines whether or not the i-th mobile terminal 2 exists among the mobile terminals 2 determined in S406. If the i-th mobile terminal 2 exists, the process proceeds to S409, and if not, the process returns to S401.

[0161] (S409) The video acquisition unit 133 acquires the terminal communication information of the i-th mobile terminal 2 from the terminal management unit 111. The video acquisition unit 133 transmits a video transmission instruction to the i-th mobile terminal 2 using the terminal communication information.

[0162] (S410) The receiving unit 12 determines whether or not a video has been received from the i-th mobile terminal 2. If a video has been received, the process proceeds to S411, and if a video has not been received, the process returns to S410. Note that it is preferable to wait here until a video is received from the mobile terminal 2 that sent the transmission instruction.

[0163] Here, the receiving unit 12 may receive only the location information, or may receive the location information and a thumbnail image, from the i-th mobile terminal 2 instead of the video.

[0164] (S411) The processing unit 13 composes information including the location information of the i-th mobile terminal 2, to be transmitted to the user terminal 3. The transmission unit 14 transmits the information to the user terminal 3.

[0165] This information is, for example, the location information of the i-th mobile terminal 2 and a still image (for example, a thumbnail image) included in the video from the mobile terminal 2. This information is, for example, the location information of the i-th mobile terminal 2 and the video.

[0166] (S412) The moving image acquiring unit 133 increments the counter i by 1. The process returns to S408.

[0167] (S413) The video acquisition unit 133 performs a process to acquire past videos. An example of such past video acquisition process will be described with reference to the flowchart in Fig. 6. The past videos are videos stored by the information processing device 1 or videos stored by the mobile terminal 2 in the mobile storage unit 21 of the mobile terminal 2.

[0168] (S414) The video transmission unit 141 transmits the video acquired in S413 to the user terminal 3. Return to S401.

[0169] (S415) The receiving unit 12 determines whether or not a video or the like has been received from the mobile terminal 2. If a video or the like has been received, the process proceeds to S416, and if a video or the like has not been received, the process proceeds to S421. The video or the like may be, for example, a video, a terminal identifier, or a set of attribute values.

[0170] (S416) The processing unit 13 temporarily stores the video etc. received in S415 in a buffer (not shown). Note that the destination for storing the video etc. may be, for example, the storage unit 11, and is not restrictive.

[0171] (S417) The processing unit 13 determines whether the video received from the mobile terminal 2 identified by the terminal identifier included in the video etc. received in S415 is currently being transmitted to the user terminal 3. If it is currently being transmitted, the process proceeds to S418, and if it is not currently being transmitted, the process returns to S401.

[0172] (S418) The processing unit 13 determines whether or not the path condition is satisfied. If the path condition is satisfied, the process proceeds to S419, and if the path condition is not satisfied, the process proceeds to S420.

[0173] The route condition here is that the latest location information paired with the terminal identifier included in the video etc. received in S415 is location information of a point on the route indicated by the route information corresponding to the inquiry. If the route condition is not satisfied, it is preferable that the transmitter 14 transmits a stop instruction to the mobile terminal 2.

[0174] (S419) The video transmission unit 141 transmits the video received in S415 to the user terminal 3.

[0175] (S420) Rights holder processing unit 135 performs security processing. An example of the security processing will be described with reference to the flowchart in FIG.

[0176] (S421) The receiving unit 12 determines whether or not a location instruction has been received from the user terminal 3. If a location instruction has been received, the process proceeds to S422, and if a location instruction has not been received, the process proceeds to S425.

[0177] (S422) The video acquisition unit 133 acquires location information corresponding to the location instruction. The video acquisition unit 133 acquires a video of the location indicated by the location information.

[0178] The video acquisition unit 133 acquires, for example, a terminal identifier corresponding to the acquired location information, and acquires a video paired with the terminal identifier from a buffer (not shown).

[0179] The video acquisition unit 133 acquires, for example, a terminal identifier corresponding to the acquired location information, and transmits a transmission instruction to the mobile terminal 2 identified by the terminal identifier. Then, the video acquisition unit 133 receives the video from the mobile terminal 2.

[0180] (S423) The video transmission unit 141 transmits the video acquired in S422 to the user terminal 3 that transmitted the location instruction.

[0181] (S424) The processing unit 13 determines whether or not to end the transmission of the video to the user terminal 3. If the transmission is to be ended, the process proceeds to S420, and if not, the process returns to S422. Note that the transmission is to be ended, for example, when an instruction to end the transmission is received from the user terminal 3.

[0182] (S425) The receiving unit 12 determines whether or not a purchase instruction has been received from the user terminal 3. If a purchase instruction has been received, the process proceeds to step S426; if not, the process returns to step S401.

[0183] (S426) The video acquisition unit 133 acquires the video corresponding to the purchase instruction. Note that the video acquisition unit 133 acquires the video corresponding to the purchase instruction from the videos accumulated by the rights holder processing unit 135, for example.

[0184] (S427) The fourth security unit 1354 acquires the user identifier corresponding to the user terminal 3 that sent the purchase instruction. This user identifier becomes the right holder identifier for the purchased video.

[0185] (S428) The fourth security means 1354 performs the fourth security process using the user identifier acquired in S427. An example of the fourth security process will be described with reference to the flowchart in FIG.

[0186] (S429) The compensation means 1355 performs compensation processing for the original rights holder of the purchased video. Return to S401. An example of the compensation processing will be described using the flowchart in FIG.

[0187] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt occurs to end the process.

[0188] Next, an example of the terminal determination process in S406 will be described with reference to the flowchart in FIG.

[0189] (S501) The terminal determination unit 132 assigns 1 to a counter i.

[0190] (S502) The terminal determination unit 132 determines whether the i-th location information exists in the route information acquired in S404. If the i-th location information exists, the process proceeds to S503; if not, the process returns to the upper processing.

[0191] (S503) The terminal determination unit 132 assigns 1 to a counter j.

[0192] (S504) Terminal determination unit 132 determines whether j-th terminal information exists in terminal management unit 111. If j-th terminal information exists, the process proceeds to S505, and if not, the process proceeds to S509.

[0193] (S505) The terminal determination unit 132 acquires the latest location information included in the j-th terminal information.

[0194] (S506) The terminal determination unit 132 determines whether the i-th location information in the route information satisfies the approximation condition with the latest location information of the mobile terminal 2. If the approximation condition is satisfied, the process proceeds to S507, and if the approximation condition is not satisfied, the process proceeds to S508.

[0195] The approximation condition is that the two pieces of location information are close to each other. For example, the approximation condition is that the distance between the two points indicated by the two pieces of location information is within a threshold or is smaller than a threshold.

[0196] (S507) The terminal determination unit 132 calculates the distance between the two points using the two pieces of location information. The terminal determination unit 132 temporarily stores the distance in pairs with the terminal identifier of the mobile terminal 2.

[0197] (S508) The terminal determination unit 132 increments the counter j by 1. The process returns to S504.

[0198] (S509) The terminal determination unit 132 determines whether or not a mobile terminal 2 that satisfies the approximation condition is present. If a mobile terminal 2 is present, the process proceeds to S508, and if not, the process proceeds to S511.

[0199] (S510) The terminal determination unit 132 acquires the terminal identifier of the mobile terminal 2 with the shortest distance.

[0200] (S511) The terminal determination unit 132 adds α to the counter i, where α is a natural number equal to or greater than 1. The process returns to S502.

[0201] In addition, if the terminal identifier of mobile terminal 2 can be acquired in S510, α is preferably a multiple large numerical value, and if the terminal identifier of mobile terminal 2 cannot be acquired, α is preferably a smaller numerical value such as 1 than when the terminal identifier of mobile terminal 2 can be acquired.

[0202] Next, an example of the past video acquisition process in S413 will be described with reference to the flowchart in FIG.

[0203] (S601) The moving image acquiring unit 133 assigns 1 to a counter i.

[0204] (S602) The video acquisition unit 133 determines whether the i-th location information exists in the route information acquired in S404. If the i-th location information exists, the process proceeds to S603; if not, the process returns to the upper processing.

[0205] (S603) The moving image acquiring unit 133 assigns 1 to a counter j.

[0206] (S604) Video acquisition unit 133 determines whether or not there is a j-th mobile terminal 2 (j-th terminal information) to which video can potentially be transmitted, by referring to terminal management unit 111. If there is a j-th mobile terminal 2, the process proceeds to S605; if there is not, the process proceeds to S610.

[0207] (S605) The video acquisition unit 133 acquires a group of location information paired with the terminal identifier of the j-th mobile terminal 2 from the terminal management unit 111. The group of location information is one or more pieces of location information. It is also assumed that the video corresponding to the group of location information has been shot by the mobile terminal 2 and stored in the video storage unit 21.

[0208] (S606) The video acquisition unit 133 determines whether the i-th location information satisfies the route condition for the group of location information acquired in S605. If the route condition is satisfied, the process proceeds to S607, and if the route condition is not satisfied, the process proceeds to S609. Note that the route condition here is that the i-th location information is information indicating a point on the route specified by the group of location information.

[0209] (S607) The video acquisition unit 133 acquires a group of location information, which is one or more pieces of location information from the group of location information acquired in S605, which is a group of location information from the route information acquired in S404, and which is a collection of one or more pieces of location information from the i-th location information onwards in the route information. This group of location information is information that identifies the route on which the j-th mobile terminal 2 has video.

[0210] (S608) The video acquisition unit 133 calculates the distance of the route specified by the group of positional information acquired in S607.

[0211] (S609) The moving image acquisition unit 133 increments the counter j by 1. The process returns to S604.

[0212] (S610) The moving image acquiring unit 133 assigns 1 to a counter k.

[0213] (S611) The video acquisition unit 133 determines whether or not the k-th previous video exists among the previous videos that are videos stored in S420. If the k-th previous video exists,

[0214] (S612) The video acquisition unit 133 acquires a group of position information corresponding to past videos.

[0215] (S613) The video acquisition unit 133 determines whether the i-th location information satisfies the route condition for the group of location information acquired in S125. If the route condition is satisfied, the process proceeds to S614, and if the route condition is not satisfied, the process proceeds to S616. Note that the route condition here is that the i-th location information is information indicating a point on the route specified by the group of location information acquired in S612.

[0216] (S614) The video acquisition unit 133 acquires a group of position information, which is one or more pieces of position information from the group of position information acquired in S612, a group of position information from the route information acquired in S404, and a set of one or more pieces of position information from the i-th position information onwards in the route information. This group of position information is a set of position information that identifies routes that overlap with the route indicated by the route information among routes corresponding to the past video.

[0217] (S615) The video acquisition unit 133 calculates the distance of the route specified by the group of positional information acquired in S614.

[0218] (S616) The moving image acquiring unit 133 increments the counter k by 1. The process returns to S613.

[0219] (S617) The video acquisition unit 133 determines whether the path condition has been satisfied at least once in either S606 or S614. If the path condition is satisfied, the process proceeds to S618, and if the path condition is not satisfied, the process proceeds to S619.

[0220] (S618) The video acquisition unit 133 acquires the terminal identifier of the mobile terminal 2 with the longest distance calculated in S608 or S615, or an identifier of the past video. When the video acquisition unit 133 acquires the terminal identifier, it transmits a video transmission instruction including a group of position information corresponding to the distance to the mobile terminal 2 identified by the terminal identifier, and receives the video along the route indicated by the group of position information from the mobile terminal 2. Furthermore, when the video acquisition unit 133 acquires the identifier of the past video, it acquires the video, etc. identified by the identifier from the storage area indicated by the access information of the video.

[0221] (S619) The video acquisition unit 133 increments the value of the counter i. The process returns to S602.

[0222] If the path condition is not satisfied, the video acquisition unit 133 preferably increments the value of the counter i by 1. If the path condition is satisfied, the video acquisition unit 133 preferably increments the value of the counter i by 2 or more.

[0223] Next, an example of the security process in S420 will be described with reference to the flowchart in FIG.

[0224] (S701) The rights holder processing unit 135 stores the transmitted moving image in association with a set of attribute values associated with one or more moving images that are the basis of the transmitted moving image.

[0225] It is preferable that the rights holder processing unit 135 stores the video in pairs with a rights holder identifier that identifies one or more rights holders. The rights holder identifier here is, for example, one or more rights holder identifiers of the videos that are the source of the stored video. The rights holder identifier here is, for example, a single rights holder identifier that identifies the user who made the inquiry.

[0226] Furthermore, the rights holder processing unit 135 stores the video in, for example, the storage unit 11 or a device other than the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.

[0227] (S702) The fourth maintenance means 1354 performs the fourth maintenance process. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.

[0228] (S703) The rights holder processing unit 135 assigns 1 to the counter i.

[0229] (S704) The rights holder processing unit 135 determines whether the i-th video that was the source of the stored video exists. If the i-th video exists, the process proceeds to S705, and if not, the process returns to the upper process.

[0230] (S705) Reward means 1355 performs reward processing. An example of the reward processing will be described using the flowchart in Fig. 9. The reward processing here is a processing for rewarding the rights holder of the i-th video that is the basis of the accumulated video.

[0231] (S706) The rights holder processing unit 135 determines whether or not to change the rights holder of the i-th video that is the source of the stored video. If the rights holder is to be changed, the process proceeds to S707; if the rights holder is not to be changed, the process proceeds to S708.

[0232] Whether or not to change the rights holder may be based on a flag corresponding to the i-th video, may be predetermined, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder."

[0233] (S707) The rights holder processing unit 135 acquires the user identifier of the user terminal 3. This user identifier becomes a new rights holder identifier.

[0234] (S708) The first maintenance unit 1351 stores the i-th moving image that is the source of the stored moving images.

[0235] (S709) The fourth maintenance means 1354 performs the fourth maintenance process on the i-th video that is the source of the stored video. An example of the fourth maintenance process has been described using the flowchart in FIG.

[0236] (S710) The rights holder processing unit 135 increments the counter i by 1. The process returns to S704.

[0237] In the flowchart of Figure 7, when a combined video is constructed, a process (S708) of storing the multiple videos that formed the combined video and a fourth preservation process (S709) are performed, but such processes do not have to be performed.

[0238] Next, an example of the fourth maintenance process in S702 and S709 will be described with reference to the flowchart in FIG.

[0239] (S801) The fourth security unit 1354 acquires access information that identifies the storage location of a moving image. The moving image is, for example, a fused moving image or a combined moving image.

[0240] (S802) The fourth maintenance means 1354 acquires a set of attribute values corresponding to the stored video. If the stored video is a video composed of multiple original videos, the set of attribute values corresponding to the video is the set of attribute values of each of the multiple original videos.

[0241] (S803) The fourth security means 1354 constructs security information having the access information acquired in S801, the attribute value set acquired in S802, and the rights holder identifier of the video. Note that if a new rights holder identifier has been acquired, the fourth security means 1354 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. (S804) The fourth maintenance means 1354 stores the maintenance information configured in S803, and returns to the upper level processing.

[0242] In addition, in S804, if preservation information for a video corresponding to the preservation information to be stored has been stored, the preservation information configured in S803 is overwritten with the preservation information. This makes it possible to manage, for example, the transition of rights holders of the video. Furthermore, the fourth preservation means 1354 stores the preservation information in, for example, a blockchain.

[0243] Next, an example of the reward process in S705 will be described with reference to the flowchart in FIG.

[0244] (S901) The reward means 1355 acquires one or more right holder identifiers of the target video. The reward means 1355 may also acquire right holder identifiers of previous right holders of the target video.

[0245] (S902) The reward means 1355 acquires a set of attribute values of the target video.

[0246] (S903) The reward unit 1355 acquires a service identifier that identifies the service provided for the target video. The service identifier is, for example, "view" or "purchase."

[0247] (S904) The reward means 1355 acquires a reward amount using one or more pieces of information from the attribute value set acquired in S902 and the service identifier acquired in S903.

[0248] If multiple right holder identifiers are acquired, the remuneration means 1355 acquires a remuneration amount for each right holder identifier. If history information of a right holder including multiple right holder identifiers is acquired, the remuneration means 1355 may acquire a remuneration amount for each right holder identifier.

[0249] Furthermore, it is preferable that the remuneration means 1355, for example, acquires a video attribute value corresponding to each of the multiple videos that were the basis for the video transmitted by the video transmission unit 141, and uses the video attribute value to determine a remuneration amount for each of the multiple rights holders. It is preferable that the remuneration means 1355, for example, determines a larger remuneration amount the greater the data amount, video duration, or number of frames of the original video used in the video transmitted by the video transmission unit 141. It is preferable that the remuneration means 1355, for example, determines a larger remuneration amount the greater the resolution of the original video used in the video transmitted by the video transmission unit 141.

[0250] (S905) The reward means 1355 performs processing to give a reward of the amount of reward acquired in S904 to the right holder identified by the right holder identifier acquired in S901.

[0251] (S906) The remuneration means 1355 performs a process of charging the user who has enjoyed the service related to the target video with a remuneration. The process returns to the upper level process. Note that the target video is usually a video transmitted to the user terminal 3.

[0252] In the flowchart of FIG. 9, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.

[0253] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.

[0254] (S1001) The mobile terminal 2 determines whether or not a start instruction has been received. If a start instruction has been received, the process proceeds to S1002, and if not, the process proceeds to S1011. The start instruction may be, for example, an instruction to launch a video transmission application or to power on the mobile terminal 2.

[0255] (S1002) The location acquisition unit 231 acquires location information.

[0256] (S1003) The attribute value acquisition unit 233 acquires one or more moving image attribute values excluding the position information.

[0257] (S1004) The configuration unit 234 acquires a terminal identifier from the movement storage unit 21.

[0258] (S1005) Composition unit 234 composes information to be transmitted, which is information having location information, one or more video attribute values, and a terminal identifier. Location transmission unit 241 transmits the information composed in S1005 to information processing device 1.

[0259] (S1006) The photographing unit 232 photographs and acquires a moving image.

[0260] (S1007) Composition unit 234 composes an additional moving image having a moving image, location information, one or more moving image attribute values, and a terminal identifier. Composition unit 234 stores the additional moving image in transfer storage unit 21.

[0261] (S1008) The moving video sending unit 242 determines whether or not to send the video to the information processing device 1. If the video is to be sent, the process proceeds to S1009, and if not, the process proceeds to S1010. Note that when sending a video, for example, the sending flag may be "ON." Also, the initial value of the sending flag is "OFF."

[0262] (S1009) The moving moving image transmission unit 242 transmits the additional image accumulated in S1007 to the information processing device 1. Note that there is no limit to the amount of moving images that can be transmitted at one time.

[0263] (S1010) The movement processing unit 23 determines whether or not to end the transmission of the position information, etc. If the transmission is to be ended, the process returns to S1001, and if the transmission is not to be ended, the process returns to S1002. The transmission of the position information, etc. is ended, for example, when an end instruction is received from the user.

[0264] (S1011) The movement instruction receiving unit 221 determines whether or not a video transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S1002, and if not, the process returns to S1001.

[0265] (S1012) The movement processing unit 23 determines whether the transmission instruction received in S1011 is a transmission instruction for real-time video or a transmission instruction for past video. If it is a transmission instruction for real-time video, the process proceeds to S1013, and if it is a transmission instruction for past video, the process proceeds to S1014.

[0266] The movement processing unit 23 may determine whether the transmission instruction is a transmission instruction for real-time video or a transmission instruction for past video based on a timing flag included in the transmission instruction. The movement processing unit 23 may determine that the transmission instruction is a transmission instruction for real-time video when the transmission instruction does not include a position information group, and may determine that the transmission instruction is a transmission instruction for past video when the transmission instruction includes a position information group.

[0267] (S1013) The movement processing unit 23 sets the transmission flag to “ON.” The process returns to S1002.

[0268] (S1014) The movement processing unit 23 acquires a group of location information included in the transmission instruction.

[0269] (S1015) The movement processing unit 23 acquires, from the movement storage unit 21, moving images etc. corresponding to the plurality of pieces of position information corresponding to the group of position information acquired in S1014. The moving images etc. are preferably so-called additional moving images, but may be moving images only.

[0270] (S1016) The moving moving image transmission unit 242 transmits the additional moving image acquired in S1015 to the information processing device 1.

[0271] (S1017) The mobile receiving unit 22 determines whether or not a stop instruction has been received from the information processing device 1. If a stop instruction has been received, the process proceeds to S1018, and if not, the process returns to S1001.

[0272] (S1018) The movement processing unit 23 turns the transmission flag “OFF.” The process returns to S1002.

[0273] In the flowchart of FIG. 10, the process ends when the power is turned off or an interrupt occurs to end the process.

[0274] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.

[0275] (S1101) The user reception unit 32 determines whether or not route identification information has been received. If route identification information has been received, the process proceeds to S1102, and if not, the process proceeds to S1117.

[0276] (S1102) The user processing unit 33 acquires route identification information. Note that the route identification information accepted in S1101 is the destination, and the acquired route identification information may be a collection of multiple location information pieces resulting from a route search using the current location and the destination. In other words, the route identification information accepted in S1101 and the route identification information acquired here do not have to be the same information.

[0277] (S1103) The user processing unit 33 acquires map information from the user storage unit 31. Next, the user processing unit 33 generates map information on the map information that clearly indicates the route identified by the route identification information. The user output unit 36 uses the map information to output a map on which the route is clearly indicated.

[0278] (S1104) The user processing unit 33 composes a query including the route specification information acquired in S1102. The user transmission unit 34 transmits the query to the information processing device 1.

[0279] Here, the user processing unit 33 may perform the processes from S1104 to S1116 only when the inquiry flag in the user storage unit 31 is "ON". In other words, when the inquiry flag is "OFF", the video is not output to the user terminal 3. The inquiry flag is also changeable.

[0280] (S1105) In response to the transmission of the inquiry, the user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1106, and if information has not been received, the process proceeds to S1113.

[0281] (S1106) The user processing unit 33 determines whether or not the information received in S1105 includes a moving image. If a moving image is included, the process proceeds to S1107, and if a moving image is not included, the process proceeds to S1109.

[0282] (S1107) User output unit 36 outputs one or more videos from the information received in S1105. It is preferable that user output unit 36 clearly displays on a map the location indicated by the location information corresponding to the video.

[0283] (S1108) The user processing unit 33 determines whether or not to end the output of information. If the output is to be ended, the process returns to S1101, and if not, the process returns to S1105.

[0284] (S1109) User processing unit 33 acquires the location information group from the information received in S1105.

[0285] (S1110) The user processing unit 33 creates a map that clearly shows the points indicated by each piece of location information included in the group of location information acquired in S1109. The user output unit 36 outputs the map.

[0286] (S1111) The user processing unit 33 determines whether or not a thumbnail image is present in the information received in S1105. If a thumbnail image is present, the process proceeds to S1112; if not, the process returns to S1105. Note that a thumbnail image is one image in a video.

[0287] (S1112) User output unit 36 outputs one or more thumbnail images from the information received in S1105. It is preferable that user output unit 36 outputs the thumbnail images in a manner that clearly indicates the location indicated by the location information paired with the thumbnail images.

[0288] (S1113) The user processing unit 33 determines whether or not a timeout has occurred. If a timeout has occurred, the process returns to S1101, and if not, the process proceeds to S1114. A timeout occurs when a time equal to or greater than a threshold has elapsed since the transmission of the query.

[0289] (S1114) The user reception unit 32 determines whether or not a location instruction has been received. If a location instruction has been received, the process proceeds to S1115, and if not, the process returns to S1105.

[0290] (S1115) The user processing unit 33 and the like acquire a video paired with the location information corresponding to the location instruction.

[0291] The user transmitting unit 34 transmits a transmission instruction to the mobile terminal 2 corresponding to the location information corresponding to the location instruction, for example. Then, the user receiving unit 35 receives the video from the mobile terminal 2. Then, the user processing unit 33 acquires the video.

[0292] (S1116) The user output unit 36 outputs the video acquired in S1115.

[0293] (S1117) The user receiving unit 32 determines whether or not a purchase instruction has been received from the user. If a purchase instruction has been received, the process proceeds to S1118, and if not, the process returns to S1101. The purchase instruction may include, for example, an inquiry.

[0294] (S1118) The user processing unit 33 composes a purchase instruction to be transmitted. Next, the user transmitting unit 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.

[0295] (S1119) The user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1120, and if information has not been received, the process returns to S1119. The information may be, for example, a video, information indicating that the transfer of rights holders has been completed, and a set of attribute values of the video.

[0296] (S1120) User processing unit 33 uses the received information to compose information to be output. User output unit 36 outputs the information. Return to S1101.

[0297] In the flowchart of FIG. 11, the process ends when the power is turned off or an interrupt occurs to end the process.

[0298] Specific examples of the operation of the information system A in this embodiment will be described below. Two specific examples will be described below. Specific example 1 is a case where real-time video based on route identification information is output by the user terminal 3. Specific example 2 is a case where past video based on route identification information is output by the user terminal 3.

[0299] (Example 1) Now, it is assumed that the terminal management unit 111 of the information processing device 1 stores a terminal management table having the structure shown in Fig. 12. The terminal management table is a table that manages one or more pieces of terminal information. The terminal management table manages one or more records that have an "ID," "terminal identifier," "terminal communication information," and an "attribute value set." In this case, the "attribute value set" includes "time" and "location information."

[0300] Then, after the mobile terminal 2, which is a drive recorder mounted on a car, receives a start instruction from user A, the position acquisition unit 231 acquires position information (x, y). The attribute value acquisition unit 233 acquires one or more video attribute values such as time. The composition unit 234 then composes information to be transmitted, which is information having the position information, one or more video attribute values, and a terminal identifier. Next, the position transmission unit 241 transmits the composed information to the information processing device 1. The shooting unit 232 also shoots and acquires the video. Next, the composition unit 234 composes an additional video having the video, the position information, one or more video attribute values, and a terminal identifier. The composition unit 234 accumulates the additional video in the mobile storage unit 21. The mobile terminal 2 repeats the above processes.

[0301] Furthermore, many other mobile terminals 2 also perform the same process as the above mobile terminal 2. The many other mobile terminals 2 may be drive recorders mounted on automobiles, camera-equipped eyeglasses worn by people, or smartphones mounted on bicycles.

[0302] Then, the location receiving unit 121 of the information processing device 1 receives location information, etc. from each mobile terminal 2. Then, the location accumulation unit 131 associates the received location information, etc. with the terminal identifier and adds it to the terminal management table. As a result, the terminal management table shown in FIG. 12 is constructed.

[0303] In the above situation, it is assumed that user A inputs a destination into user terminal 3, which is a navigation terminal installed in a car.

[0304] Next, the user receiving unit 32 of the user terminal 3 receives route identification information that is the destination. Next, the user processing unit 33 acquires the current location using the GPS receiver. Next, the user processing unit 33 performs a route search using the current location and the destination, and acquires route information that identifies the route from the current location to the destination and includes multiple location information. Then, as shown in FIG. 13, a map with the route drawn on it is output to the user terminal 3.

[0305] Next, the user processing unit 33 of the user terminal 3 acquires the inquiry flag stored in the user storage unit 31. Next, the user processing unit 33 detects that the "inquiry flag = ON" in the user storage unit 31, and composes an inquiry having the acquired route information and a timing flag that is "real time." Next, the user transmission unit 34 transmits the inquiry to the information processing device 1.

[0306] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry from the user terminal 3. Next, the terminal determination unit 132 acquires the route information contained in the received inquiry. In addition, the terminal determination unit 132 determines that the received inquiry includes the timing flag "real time."

[0307] Next, terminal determination unit 132 refers to the terminal management table (FIG. 12) and determines one or more mobile terminals 2 to which real-time video can be transmitted on the route indicated by the route information included in the query. That is, by the process described using the flowchart in FIG. 5, terminal determination unit 132 determines, from the location information paired with the latest time of each mobile terminal 2 in the terminal management table, one or more pieces of location information that satisfy the proximity condition for any of the location information indicating a position on the route indicated by the location information group included in the received query, and obtains, from the terminal management table (FIG. 12), the terminal identifier and terminal communication information paired with each piece of location information.

[0308] Next, the video acquisition unit 133 uses one or more pieces of terminal communication information to transmit a video transmission instruction to one or more mobile terminals 2. The video acquisition unit 133 transmits the transmission instruction including the timing flag "real time".

[0309] Next, the movement instruction receiving unit 221 of each of the one or more mobile terminals 2 receives the transmission instruction. Next, the movement processing unit 23 of each mobile terminal 2 determines that the received transmission instruction is a transmission instruction for real-time video based on the timing flag "real-time" included in the transmission instruction.

[0310] Next, the position acquisition unit 231 of each mobile terminal 2 acquires position information. Furthermore, the attribute value acquisition unit 233 of each mobile terminal 2 acquires one or more video attribute values. The composition unit 234 acquires a terminal identifier from the moving storage unit 21. The composition unit 234 composes information having the position information, one or more video attribute values, and a terminal identifier. The shooting unit 232 shoots and acquires the video. Next, the composition unit 234 composes an additional video having the video, the position information, one or more video attribute values, and a terminal identifier. The composition unit 234 accumulates the additional video in the moving storage unit 21. Next, the moving video transmission unit 242 transmits information having the position information, one or more video attribute values, and a terminal identifier, as well as a thumbnail image, which is a still image in the video, to the information processing device 1. Note that here, the moving video transmission unit 242 of each mobile terminal 2 may also transmit the additional image to the information processing device 1. Furthermore, it is preferable that the location transmission unit 241 of each mobile terminal 2 repeatedly transmits to the information processing device 1 location information, one or more video attribute values, and information including a terminal identifier.

[0311] Next, the receiving unit 12 of the information processing device 1 receives information including location information, one or more video attribute values, a terminal identifier, and a thumbnail image from each mobile terminal 2. Next, the processing unit 13 composes information including the location information and thumbnail image of each mobile terminal 2, to be transmitted to the user terminal 3. The transmitting unit 14 transmits the information to the user terminal 3.

[0312] Next, the user receiving unit 35 of the user terminal 3 receives information including the location information and thumbnail images of each mobile terminal 2 from the information processing device 1. The user processing unit 33 creates a map that clearly shows the points indicated by each piece of location information. Next, the user output unit 36 outputs the map. The user output unit 36 also outputs one or more thumbnail images in association with the positions indicated by the location information. An example of such output is shown in FIG. 14.

[0313] Next, suppose that the user designates a location (here, a car icon) 1401 or a thumbnail image 1402 on the output screen in Fig. 14. Then, the user accepting unit 32 of the user terminal 3 accepts the location designation. Next, the user transmitting unit 34 transmits a transmission instruction having a timing flag of "real time" to the mobile terminal 2 identified by the terminal identifier corresponding to the location designation.

[0314] Next, the mobile receiving unit 22 of the mobile terminal 2 receives the transmission instruction. Next, the mobile processing unit 23 checks whether the timing flag is "real time." Then, the shooting unit 232 acquires the video currently being shot. Next, the moving video sending unit 242 transmits the video to the information processing device 1.

[0315] Next, the receiving unit 12 of the information processing device 1 receives the video. Next, the video sending unit 141 sends the video to the user terminal 3.

[0316] Next, the user receiving unit 35 of the user terminal 3 receives the video. Next, the user output unit 36 outputs the video. An example of such output is shown in FIG. 15. The output video is 1501.

[0317] Moreover, the rights holder processing unit 135 of the information processing device 1 performs the preservation processing explained using the flowchart of FIG.

[0318] As described above, according to this specific example, real-time video of the route can be provided to the user based on the route identification information.

[0319] (Example 2) It is assumed that the terminal management table shown in FIG. 12 is currently stored in the terminal management unit 111 of the information processing device 1.

[0320] Then, it is assumed that user B walks while holding user terminal 3, which is a smartphone. As a result, route information specifying the route walked by user B is stored in user storage unit 31 of user terminal 3. It is assumed that route information is a collection of multiple pieces of location information.

[0321] Next, assume that user B inputs a query including the location information group to the user terminal 3. Next, the user accepting unit 32 of the user terminal 3 accepts the query. The user processing unit 33 acquires the user identifier from the user storage unit 31 and constructs a query including the user identifier, route information, and a timing flag "past." Next, the user transmitting unit 34 transmits the query to the information processing device 1.

[0322] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry. Next, the terminal determining unit 132 acquires the route information included in the received inquiry.

[0323] Next, the video acquisition unit 133 performs a process of acquiring past videos based on the timing flag "past" using the process described using the flowchart in Figure 6. That is, the video acquisition unit 133 acquires one or more videos that satisfy the route conditions from videos stored in the mobile terminal 2 managed in the terminal management table (Figure 12) or videos accumulated through the preservation process, in the order of the location information contained in the route information. Furthermore, when multiple videos are acquired, the video composition unit 134 combines the acquired multiple videos in the order of the location information contained in the route information, and acquires a combined video that is a video in which the multiple videos are combined in terms of time. Next, the video transmission unit 141 transmits the combined video to the user terminal 3. Furthermore, the rights holder processing unit 135 performs preservation processing on the video.

[0324] Next, the user receiving unit 35 of the user terminal 3 receives the combined moving image. The user output unit 36 outputs the moving image.

[0325] As described above, according to this specific example, past videos of the route can be provided to the user based on the route identification information.

[0326] As described above, according to this embodiment, the information processing device 1 serves as a platform for appropriately providing videos of each point on the route.

[0327] Furthermore, according to this embodiment, the information processing device 1 serves as a platform for appropriately providing videos of multiple points on a route.

[0328] Furthermore, according to this embodiment, it is possible to provide a platform that places a low load on mobile terminals that provide video at each point along a route.

[0329] Furthermore, according to this embodiment, it is possible to reduce the load on the platform for appropriately providing video at each point along the route.

[0330] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.

[0331] Furthermore, according to this embodiment, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.

[0332] Furthermore, according to this embodiment, it is possible to provide appropriate compensation to the rights holder of the video captured by the mobile terminal.

[0333] Furthermore, according to this embodiment, the video can be preserved.

[0334] Furthermore, according to this embodiment, the rights holder of the video can be the appropriate rights holder.

[0335] The processing in this embodiment may be implemented by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments in this specification.

[0336] (Embodiment 2) <Outline of Second Embodiment>

[0337] In the first embodiment, the information processing device 1 determines the mobile terminal 2 to which a video that matches the user's inquiry can be transmitted. In the present embodiment, the mobile terminal determines whether or not to transmit a video in response to the user's inquiry. <Outline of Information System A>

[0338] The conceptual diagram of the information system B in this embodiment is the same as FIG. 1 except for the reference numerals.

[0339] Fig. 16 is a block diagram of an information system B according to this embodiment. Fig. 17 is a block diagram of an information processing device 4.

[0340] The information system B includes an information processing device 4, one or more mobile terminals 5, and one or more user terminals 3.

[0341] The information processing device 4 is a server that provides the video transmitted from one or more mobile terminals 5 to the user terminal 3. The information processing device 4 is, for example, a so-called server, such as a cloud server or an ASP server, but the type is not important. The information processing device 4 may also be a device that constitutes a blockchain.

[0342] The mobile terminal 5 is a terminal installed on a moving object and is a terminal that captures video. The mobile terminal 5 is, for example, a smartphone, a tablet terminal, a camera with a communication function, camera-equipped glasses, or a smart watch with a camera.

[0343] The information processing device 4 and one or more mobile terminals 5, and the information processing device 4 and one or more user terminals 3 are generally capable of communicating via a network such as the Internet.

[0344] The information processing device 4 includes a storage unit 41, a receiving unit 42, a processing unit 43, and a transmitting unit 44. The storage unit 41 includes a terminal management unit 411. The receiving unit 42 includes an inquiry receiving unit 122. The processing unit 43 includes a video acquisition unit 433, a video composition unit 134, and a right-to-transmit processing unit 135. The transmitting unit 44 includes an inquiry sending unit 441 and a video transmission sending unit 141.

[0345] The mobile terminal 5 includes a moving storage unit 21, a moving receiving unit 52, a moving processing unit 53, a moving transmitting unit 54, and a moving output unit 25. The moving processing unit 53 includes a position acquiring unit 231, a photographing unit 232, an attribute value acquiring unit 233, a composition unit 234, and a moving determination unit 531. The moving transmitting unit 54 includes a moving video transmitting unit 542. <Details of Components of Information Processing Device 4>

[0346] Various types of information are stored in the storage unit 41. The various types of information include, for example, terminal information (to be described later), videos, and video attribute values associated with the videos.

[0347] The terminal management unit 411 stores one or more pieces of terminal information. The terminal information is associated with the mobile terminal 5. The terminal information is information relating to the mobile terminal 5. The terminal information here usually includes a terminal identifier, which is an identifier of the mobile terminal 5, and terminal communication information.

[0348] The receiving unit 42 receives various types of information and instructions from the mobile terminal 5 or the user terminal 3. The various types of information and instructions are, for example, inquiries, moving images, and additional moving images.

[0349] The processing unit 43 performs various types of processing. The various types of processing include processing performed by the video acquisition unit 433, the video composition unit 134, and the rights holder processing unit 135, for example.

[0350] The video acquisition unit 433 acquires videos taken by one or more mobile terminals 5 that satisfy the route conditions.

[0351] The video acquisition unit 433 normally receives video from the mobile terminal 5 in response to a transmitted query. For example, the video acquisition unit 433 receives video captured by each of a plurality of mobile terminals 5. The mobile terminal 5 that transmits the video is the mobile terminal 5 that corresponds to the location information that matches the query.

[0352] The video acquisition unit 433 acquires, for example, a first video corresponding to location information that identifies a first partial route of the route identified by the route identification information, and acquires a second video corresponding to location information that identifies a second partial route other than the first partial route of the route identified by the route identification information.

[0353] The transmitter 44 transmits various types of information or instructions to the mobile terminal 5 or the user terminal 3. The various types of information or instructions are, for example, an inquiry, a video, or a stop instruction.

[0354] The inquiry sending unit 441 sends the inquiry received by the inquiry receiving unit 122 to one or more mobile terminals 5. The mobile terminals 5 are terminals managed by the terminal management unit 411. <Details of Components of Mobile Terminal 5>

[0355] The mobile receiver 52 receives an inquiry including route identification information.

[0356] The movement processing unit 53 performs various types of processing. The various types of processing are, for example, processing performed by the position acquisition unit 231, the photographing unit 232, the attribute value acquisition unit 233, the composition unit 234, and the movement determination unit 531.

[0357] The movement determination unit 531 determines whether or not the location information acquired by the location acquisition unit 231 satisfies a route condition, which is a condition that the location information corresponds to location information that identifies at least a part of the route identified by the route identification information.

[0358] If the timing flag included in the query is "real time", the movement determination unit 531 determines whether or not the latest location information acquired by the location acquisition unit 231 satisfies the route condition that the latest location information is information indicating the location of a point on the route identified by the route identification information.

[0359] If the timing flag included in the query is "past", the movement determination unit 531 determines whether or not at least a part of the route specified by one or more pieces of location information stored in the movement storage unit 21 satisfies the route condition that it is part of the route specified by the route specification information.

[0360] The mobile transmission unit 54 transmits various types of information to the information processing device 4. The various types of information are, for example, a set of attribute values, a moving image, and an additional moving image.

[0361] When the movement determination unit 531 determines that the query is met, the movement video transmission unit 542 transmits the video. Note that the video here may be an additional video. Meeting the query means satisfying the route condition.

[0362] If the timing flag included in the inquiry is “real time”, the moving moving image transmitting unit 542 transmits the moving image being captured to the information processing device 4.

[0363] If the timing flag included in the inquiry is "past", the movement video sending unit 542 sends a video paired with one or more pieces of location information that specify part or all of the route specified by the received route specifying information to the information processing device 4. Note that such a video is a video stored in the movement storage unit 21.

[0364] The storage unit 41 and the terminal management unit 411 are preferably non-volatile recording media, but can also be realized by volatile recording media.

[0365] There is no restriction on the process by which information is stored in the storage unit 41 etc. For example, information may be stored in the storage unit 41 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 41 etc., or information input via an input device may be stored in the storage unit 41 etc.

[0366] The receiving unit 42 and the mobile receiving unit 52 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.

[0367] The processing unit 43, movement processing unit 53, and movement determination unit 531 can usually be realized by a processor, memory, etc. The processing procedures of the processing unit 43, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.

[0368] The video acquisition unit 433 is usually realized by a wireless or wired communication means, but may also be realized by a means for receiving broadcasts.

[0369] The transmitting unit 44, the inquiry transmitting unit 441, the mobile transmitting unit 54, and the mobile video transmitting unit 542 are usually realized by wireless or wired communication means, but may also be realized by broadcasting means. <Operation>

[0370] Next, an example of the operation of the information system B will be described. First, an example of the operation of the information processing device 4 will be described using the flowchart in Fig. 18. In the flowchart in Fig. 18, the description of the same steps as in the flowchart in Fig. 4 will be omitted.

[0371] (S1801) The processing unit 43 assigns 1 to a counter i.

[0372] (S1802) Processing unit 43 determines whether or not the i-th mobile terminal 5 exists among the mobile terminals 5 managed by terminal management unit 411. If the i-th mobile terminal 5 exists, the process proceeds to S1803, and if not, the process proceeds to S1805.

[0373] (S1803) Processing unit 43 acquires terminal communication information of the i-th mobile terminal 5 from terminal management unit 411. Inquiry sending unit 441 sends the received inquiry to the i-th mobile terminal 5 corresponding to the acquired terminal communication information.

[0374] (S1804) The processing unit 43 increments the counter i by 1. The process returns to S1802.

[0375] (S1805) The receiving unit 42 determines whether or not location information, etc. has been received from one or more mobile terminals 5. If location information, etc. has been received, the process proceeds to S1806, and if not, the process returns to S1805.

[0376] Here, the receiving unit 42 waits, for example, until a predetermined period of time has elapsed since the inquiry was sent. The location information, etc., may be, for example, location information and a thumbnail image, or location information and a video. The location information, etc., may have one or more video attribute values. There may also be cases where the receiving unit 42 is unable to receive the location information, etc.

[0377] (S1806) The transmitter 44 transmits the location information and the like of each of the one or more mobile terminals 5 received in S1805 to the user terminal 3 that sent the inquiry. Return to S403.

[0378] In the flowchart of FIG. 18, the process ends when the power is turned off or an interrupt occurs to end the process.

[0379] Next, an example of the operation of the mobile terminal 5 will be described with reference to the flowchart of Fig. 19. In the flowchart of Fig. 19, the description of the same steps as in the flowchart of Fig. 10 will be omitted.

[0380] (S1901) The mobile receiving unit 52 determines whether or not an inquiry has been received from the information processing device 4. If an inquiry has been received, the process proceeds to S1902, and if not, the process proceeds to S1905.

[0381] (S1902) The movement determination unit 531 acquires the route identification information contained in the query. The movement determination unit 531 acquires the latest location information. The movement determination unit 531 determines whether the latest location information satisfies the route conditions for the route identified by the route identification information. If the route conditions are satisfied, the process proceeds to S1903, and if not, the process proceeds to S1002.

[0382] The route condition here is that the latest position information is information indicating a point on the route specified by the route specification information.

[0383] (S1903) Movement processing unit 53 composes information to be transmitted. The information to be transmitted is, for example, the latest location information, one or more video attribute values, a thumbnail image, and a terminal identifier. The information to be transmitted is, for example, the latest location information, one or more video attribute values, a video, and a terminal identifier.

[0384] (S1904) The mobile transmitting unit 54 transmits the information configured in S1903 to the information processing device 4. The process proceeds to S1010.

[0385] (S1905) The mobile receiving unit 52 determines whether or not a transmission instruction has been received from the information processing device 4. If a transmission instruction has been received, the process proceeds to S1906, and if not, the process proceeds to S1908.

[0386] (S1906) The movement processing unit 53 acquires a moving image. The movement processing unit 53 normally acquires a moving image stored in the movement storage unit 21. Here, it is preferable that the movement processing unit 53 acquires, from the moving images stored in the movement storage unit 21, a moving image corresponding to position information that specifies a route that overlaps with a route indicated by the route specification information included in the transmission instruction.

[0387] (S1907) The moving video transmission unit 542 transmits the video acquired in S1906 to the information processing device 4.

[0388] (S1908) The movement processing unit 53 determines whether or not to end the process. If the process is to be ended, the process returns to S1901, and if not, the process returns to S1902. The process is ended, for example, when an instruction to end a process such as video storage is received.

[0389] In the flowchart of FIG. 19, the process ends when the power is turned off or an interrupt occurs to end the process.

[0390] As described above, according to this embodiment, the information processing device 4 serves as a platform for appropriately providing video of each point on the route.

[0391] Furthermore, according to this embodiment, the information processing device 4 serves as a platform for appropriately providing videos of multiple points on the route.

[0392] Furthermore, according to this embodiment, a platform with a low load when providing video at each point along a route can be provided.

[0393] Furthermore, according to this embodiment, it is possible to reduce the load on the platform for appropriately providing video at each point along the route.

[0394] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.

[0395] Furthermore, according to this embodiment, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.

[0396] Furthermore, according to this embodiment, it is possible to provide appropriate compensation to the rights holder of the video captured by the mobile terminal.

[0397] Furthermore, according to this embodiment, the video can be preserved.

[0398] Furthermore, according to this embodiment, the rights holder of the video can be the appropriate rights holder.

[0399] 20 shows the appearance of a computer that executes the programs described herein to realize each device, such as the information processing device 1, of the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 20 is an overview of this computer system 300, and FIG. 21 is a block diagram of the system 300.

[0400] In FIG. 20, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0401] 21, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.

[0402] A program that causes computer system 300 to execute the functions of information processing device 1 and the like of the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and then transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may also be loaded directly from CD-ROM 3101 or the network.

[0403] The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-described embodiment. The program only needs to include instructions that call appropriate functions (modules) in a controlled manner and achieve desired results. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.

[0404] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).

[0405] The computer that executes the program may be a single computer or a plurality of computers, that is, it may perform centralized processing or distributed processing.

[0406] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be physically realized by one medium.

[0407] Furthermore, in each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.

[0408] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]

[0409] As described above, the information processing device 1 according to the present invention has the effect of being able to appropriately acquire video at each point on a route, and is useful as a server that transmits video, etc.

Claims

1. an inquiry receiving unit that receives an inquiry including route identification information that identifies a route from a user terminal; an inquiry sending unit that sends the inquiry to each of a plurality of mobile terminals; an acquisition unit that, in response to the transmission of the inquiry, acquires, from one or more of the multiple mobile terminals that have been determined to satisfy a route condition that the mobile terminal corresponds to location information that identifies at least a portion of the route identified by the route identification information, a first image that corresponds to location information that identifies a first partial route among the location information that identifies at least a portion of the route identified by the route identification information, and acquires a second image that corresponds to location information that identifies a second partial route beyond the first partial route among the route identified by the route identification information; an information processing device comprising: a transmission unit that transmits the first image and the second image to the user terminal;

2. the first image and the second image acquired by the acquisition unit are associated with right holder identifiers that identify right holders of the first image and the second image, respectively; The information processing device according to claim 1 , further comprising a right holder processing unit that performs right holder processing related to right holders identified by right holder identifiers associated with the first image and the second image, respectively.

3. An information processing method used in an information processing device including an inquiry receiving unit, an inquiry transmitting unit, an acquiring unit, and a transmitting unit, an inquiry receiving step in which the inquiry receiving unit receives an inquiry including route identification information that identifies a route from a user terminal; a query transmission step in which the query transmission unit transmits the query to each of a plurality of mobile terminals; an acquisition step in which, in response to the transmission of the inquiry, the acquisition unit acquires, from one or more of the multiple mobile terminals determined to satisfy a route condition that the mobile terminals correspond to location information that identifies at least a portion of the route identified by the route identification information, a first image corresponding to location information that identifies a first partial route among the location information that identifies at least a portion of the route identified by the route identification information, and acquires a second image corresponding to location information that identifies a second partial route beyond the first partial route among the route identified by the route identification information; a transmitting step in which the transmitting unit transmits the first image and the second image to the user terminal; An information processing method including:

Images