Information processing device, mobile terminal, user terminal, and information processing method

Abstract

[Problem] Conventionally, it has been impossible to properly acquire video of points along a route. An information processing device 1 comprises: an inquiry receiving unit 122 for receiving an inquiry including route-specifying information specifying a route from a user terminal 3; a video acquisition unit 133 for acquiring video captured by each of one or more mobile terminals satisfying a route condition that is the condition of corresponding to location information specifying an at least partial route of the route specified by the route-specifying information; and a video transmission unit 141 for transmitting the video to the user terminal 3. The video acquisition unit 133 acquires first video corresponding to location information specifying a first partial route of the route specified by the route-specifying information, and acquires second video corresponding to location information specifying a second partial route, of the route specified by the route-specifying information, that is ahead of the first partial route. The video transmission unit 141 transmits the first video and the second video. The foregoing makes it possible to properly acquire video of points along the route.

Description

[Technical field]

[0001] The present invention relates to an information processing device or the like that can serve as a platform for providing video along a route. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been a technique for providing a user with image data captured by an on-board camera at a position and environment desired by the user (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-83034 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, it is not possible to properly acquire videos captured by a mobile terminal at points along a route. [Means for solving the problem]

[0005] The information processing device of the first invention is an information processing device that includes an inquiry receiving unit that receives an inquiry including route identification information that identifies a route from a user terminal, a video acquisition unit that acquires a first video corresponding to location information that identifies a first partial route corresponding to location information that identifies at least a part of the route identified by the route identification information, and acquires a second video corresponding to location information that identifies a second partial route beyond the first partial route of the route identified by the route identification information, and a video transmission unit that transmits the first video and the second video to the user terminal.

[0006] This configuration provides a platform for multiple mobile terminals to appropriately provide videos captured at points along a route.

[0007] In addition, compared to the first invention, the information processing device of the second invention further includes a terminal management unit in which terminal information including location information identifying the location of each mobile terminal is stored in correspondence with each of one or more mobile terminals, a location receiving unit that receives location information from each of the one or more mobile terminals, and a terminal determination unit that uses the location information received by the location receiving unit to determine one or more mobile terminals that were present on at least a portion of the route identified by the route identification information, and the video acquisition unit is an information processing device that acquires videos taken by each of the one or more mobile terminals determined by the terminal determination unit.

[0008] This configuration makes it possible to provide a platform that places a low load on mobile terminals for providing video of points along a route.

[0009] Furthermore, the information processing device of the third invention is an information processing device according to the first invention, which includes an inquiry sending unit that sends an inquiry to each of a plurality of mobile terminals, and the video acquisition unit is an information processing device that receives video from one or more mobile terminals that are determined to satisfy a route condition, which is a condition that the route identification information corresponds to location information that identifies at least a part of a route identified by the route identification information, in response to the sending of the inquiry.

[0010] This configuration can reduce the load on the platform to appropriately provide videos captured by mobile terminals at points along the route.

[0011] In addition, the information processing device of the fourth invention is an information processing device in which, with respect to any of the first to fourth inventions, the video acquired by the video acquisition unit is associated with a right holder identifier that identifies the right holder of the video, and further includes a right holder processing unit that performs right holder processing, which is processing related to the right holder identified by the right holder identifier associated with the video.

[0012] With this configuration, appropriate processing regarding the rights holder of the video can be carried out.

[0013] In addition, the information processing device of the fifth invention is an information processing device in which, compared to the fourth invention, the rights holder processing unit has a third security means for storing the video in association with a rights holder identifier that identifies the user of the user terminal.

[0014] With this configuration, the rights holder of the video can become the rights holder who needs the video.

[0015] In addition, the mobile terminal of the sixth invention is a mobile terminal comprising a location acquisition unit that acquires location information identifying the location of the mobile terminal, a photographing unit that photographs video, a mobile receiving unit that receives an inquiry including route identification information, a mobile determination unit that determines whether the location information acquired by the location acquisition unit satisfies a route condition that corresponds to location information that identifies at least a portion of a route identified by the route identification information, and a mobile video transmission unit that transmits the video when the mobile determination unit determines that the route condition is met.

[0016] With this configuration, it is possible to realize a mobile terminal that appropriately provides video of points along a route.

[0017] In addition, the user terminal of the seventh invention includes a user output unit that outputs a map showing a route, a user transmitting unit that transmits an inquiry including route identification information that identifies the route, a user receiving unit that receives a video in response to the transmission of the inquiry, a user receiving unit that accepts a point instruction that is an instruction for a point on the route on the map, and a user processing unit that acquires a video corresponding to location information indicating the point for the point instruction, and the user output unit is a user terminal that outputs the video acquired by the user processing unit.

[0018] With this configuration, a user terminal that properly acquires video of points on a route can be realized. Effect of the Invention

[0019] According to the information processing device of the present invention, video of each point on the route can be appropriately acquired. [Brief description of the drawings]

[0020] [Figure 1] Conceptual diagram of information system A in embodiment 1. [Diagram 2] Block diagram of Information System A [Diagram 3] Block diagram of the information processing device 1 [Figure 4] A flowchart illustrating an example of the operation of the information processing device 1. [Diagram 5] A flowchart illustrating an example of the terminal determination process [Figure 6] A flowchart illustrating an example of the past video acquisition process. [Figure 7] A flowchart illustrating an example of the maintenance process. [Figure 8] A flowchart illustrating an example of the fourth maintenance process. [Figure 9] A flowchart illustrating an example of the compensation process. [Figure 10] A flowchart for explaining an example of the operation of the mobile terminal 2 [Figure 11] A flowchart for explaining an example of the operation of the user terminal 3. [Figure 12] A diagram showing the terminal management table [Figure 13] A diagram showing an example of the output [Figure 14] A diagram showing an example of the output [Figure 15] A diagram showing an example of the output [Figure 16] Block diagram of information system B in embodiment 2 [Figure 17] Block diagram of the information processing device 4 [Figure 18] A flowchart for explaining an example of the operation of the information processing device 4. [Figure 19] A flowchart for explaining an example of the operation of the mobile terminal 5 [Figure 20] Overview of the computer system according to the above embodiment. [Figure 21] Block diagram of the computer system DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Hereinafter, an embodiment of an information processing device and the like will be described with reference to the drawings. Note that, in the embodiments, components with the same reference numerals perform similar operations, and therefore repeated description may be omitted.

[0022] (Embodiment 1) <Outline of First Embodiment>

[0023] In this embodiment, an information processing device that serves as a platform for acquiring and providing one or more videos using route identification information that identifies a route will be described.

[0024] In addition, in this embodiment, an information processing device that performs right holder processing, which is processing related to the right holder of the output video, will be described. The right holder processing is, for example, a remuneration process described later and various security processes described later.

[0025] In the present embodiment, a mobile terminal that transmits acquired location information to an information processing device and transmits a captured video to the information processing device in response to a transmission instruction received from the information processing device will be described.

[0026] Furthermore, in this embodiment, a user terminal that receives an instruction for a specific point on a route and outputs a video of that point will be described.

[0027] In this specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>

[0028] 1 is a conceptual diagram of an information system A according to the present embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.

[0029] The information processing device 1 is a server that provides a user terminal 3 with video transmitted from one or more mobile terminals 2. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type is not important. The information processing device 1 may also be a device that constitutes a blockchain.

[0030] In this specification, the time interval between the capture of each of the multiple still images included in the moving image does not matter. The moving image is, for example, a 60 frame / second moving image or a 30 frame / second moving image, but it may also be a collection of multiple still images captured with an interval of a predetermined time (for example, one minute) or more, or a collection of multiple still images captured when a predetermined condition is satisfied. The still images may also be called fields or frames.

[0031] The mobile terminal 2 is a terminal that can move. The mobile terminal 2 is a terminal that is installed on a moving object and shoots video. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, glasses with a camera, or a smart watch with a camera. Furthermore, installation usually means being fixed, but it may also be considered to include being in contact with or held. The mobile object is an object that moves, for example, a device that moves underground, or a living thing. The living thing is usually a person, but may also be a dog, a cat, etc.

[0032] The user terminal 3 is a terminal used by a user. A user is someone who watches videos or needs videos. The user terminal 3 may have the functions of the mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may be, for example, a navigation terminal, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and the type is not important.

[0033] The information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3 are generally capable of communicating with each other via a network such as the Internet.

[0034] Fig. 2 is a block diagram of an information system A according to the present embodiment, and Fig. 3 is a block diagram of an information processing device 1.

[0035] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a terminal management unit 111. The receiving unit 12 includes a location receiving unit 121 and an inquiry receiving unit 122. The processing unit 13 includes a location accumulation unit 131, a terminal determination unit 132, a video acquisition unit 133, a video composition unit 134, and a right holder processing unit 135. The right holder processing unit 135 includes a first security means 1351, a second security means 1352, a third security means 1353, a fourth security means 1354, and a remuneration means 1355. The transmitting unit 14 includes a video transmitting unit 141.

[0036] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, a moving transmitting unit 24, and a moving output unit 25. The moving processing unit 23 includes a position acquisition unit 231, a shooting unit 232, an attribute value acquisition unit 233, and a configuration unit 234. The moving transmitting unit 24 includes a position transmission unit 241 and a moving video transmission unit 242. The moving output unit 25 includes a video output unit 251.

[0037] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit , a user reception unit 35, and a user output unit . <Details of components of information processing device 1>

[0038] Various types of information are stored in the storage unit 11. The various types of information are, for example, terminal information (to be described later), a moving image, and one or more moving image attribute values ​​associated with the moving image.

[0039] The video attribute value is an attribute value of the video. The video attribute value is, for example, environmental information. The environmental information is information about the environment in which the video was taken. The environmental information is, for example, location information, time information, weather information, temperature information, and season information, which will be described later. The time information is information that specifies the time when the video was taken. The time when the video was taken may be a time around the time when the video was taken, and accuracy is not required. The time information is, for example, the time, the year / month / date / time, the year / month / date / time / minute, the year / month / date / time / minute / second, the year / month / date, and the month / day. In other words, the granularity of the time indicated by the time information does not matter. The weather information is information that specifies the weather at the location (or region) where the video was taken. The weather information is, for example, "sunny", "rain", "snow", and "cloudy". The temperature information is information that specifies the temperature at the location where the video was taken. The temperature information is, for example, "25 degrees" and "above 30 degrees". The season information is information that specifies the season at the location where the video was taken. The season information is, for example, "spring", "summer", "early summer", and "winter".

[0040] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information related to the mobile terminal 2. The terminal information here typically includes a terminal identifier that is an identifier of the mobile terminal 2, location information, and terminal communication information. The mobile terminal 2 here is typically a terminal that can transmit video. The terminal information is associated with the mobile terminal 2.

[0041] The terminal identifier is information for identifying the mobile terminal 2. The terminal identifier may be a right holder identifier for identifying the right holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.

[0042] A rights holder is someone who has some right regarding the video shot by the mobile terminal 2. A rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that shot the video, or a person with the right to dispose of the video. A rights holder is, for example, the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it may be anyone who has the rights to the video shot by the mobile terminal 2.

[0043] The right holder identifier may be a terminal identifier. The right holder identifier is, for example, a right holder's ID, a right holder's name, a right holder's email address, or a right holder's phone number. The right holder's ID is, for example, a user identifier.

[0044] Location information is information that identifies a location. Location information is, for example, (latitude, longitude) or (movement, longitude, altitude).

[0045] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of a communication application installed in the mobile terminal 2.

[0046] The receiving unit 12 receives various types of information and instructions from the mobile terminal 2 or the user terminal 3. The various types of information and instructions are, for example, location information, inquiries, videos, and additional videos, which will be described later.

[0047] The receiver 12 may receive video from one or more mobile terminals 2 in pairs with the location information. In such a case, it is preferable for the receiver 12 to continuously receive the video. Continuous reception means, for example, receiving periodically or receiving all the time. The intervals between periods may vary slightly.

[0048] The location receiving unit 121 receives location information from one or more mobile terminals 2. It is preferable that the location receiving unit 121 continuously receives the latest location information from one or more mobile terminals 2. The location receiving unit 121 may receive, from the mobile terminal 2, one or more sets of location information corresponding to videos stored in the mobile terminal 2. The location receiving unit 121 normally receives location information in association with a terminal identifier.

[0049] The inquiry receiving unit 122 receives an inquiry from the user terminal 3. The inquiry can be said to be a request for video captured at one or more points on a route. The inquiry includes route identification information. The inquiry includes, for example, a timing flag.

[0050] The route specification information is information that specifies a route. The route specification information may be route information including multiple location information, may be information on a starting point and a destination, or may be a collection of three or more place names. The route specification information may be any information that can specify a route, and its structure and content are not important.

[0051] The timing flag is information that specifies the type of video to be acquired. The timing flag can be "real time", which instructs the transmission of real-time video being shot, or "past", which instructs the transmission of video that was shot in the past and stored.

[0052] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by a location accumulation unit 131, a terminal determination unit 132, a video acquisition unit 133, a video composition unit 134, and a right holder processing unit 135.

[0053] The processing unit 13 may store the moving images continuously received by the receiving unit 12 in association with the position information and the terminal identifier.

[0054] The processing unit 13 determines whether the latest location information of the mobile terminal 2 transmitting the video, which is the location information received by the receiving unit 12, has deviated from the route indicated by the route identification information.

[0055] The location accumulation unit 131 accumulates the location information received by the location receiving unit 121 from the mobile terminal 2 in the terminal management unit 111 in association with the mobile terminal 2. The location accumulation unit 131 accumulates the location information in the terminal management unit 111, for example, in a pair with a terminal identifier. It is preferable that the location accumulation unit 131 add the location information to the terminal management unit 111 in association with the mobile terminal 2.

[0056] The terminal determination unit 132 determines one or more mobile terminals 2 that satisfy the route conditions in response to the received inquiry.

[0057] The route condition is a condition that corresponds to location information that identifies at least a part of the route identified by the route identification information. The route condition is that the mobile terminal 2 captures a video at any point on the route identified by the route identification information, that the mobile terminal 2 is present at any point on the route identified by the route identification information, or that the mobile terminal 2 holds a video captured at one or more points on the route identified by the route identification information.

[0058] The terminal determination unit 132 determines, for example, one or more mobile terminals 2 corresponding to the location information that identifies at least a part of the route identified by the route identification information included in the received inquiry.

[0059] When the terminal determination unit 132 determines multiple mobile terminals 2 corresponding to location information that identifies at least a portion of the route identified by the route identification information contained in the received inquiry, the terminal determination unit 132 may select only one or more mobile terminals 2 that satisfy the selection conditions.

[0060] The selection condition is, for example, that the mobile terminal 2 corresponds to a plurality of pieces of location information in which the ratio of supporting the route specified by the route specification information is equal to or greater than a threshold value. The selection condition is, for example, that the ratio of supporting the route specified by the route specification information is the largest.

[0061] When the terminal determination unit 132 determines a plurality of mobile terminals 2 corresponding to position information that identifies at least a part of the route identified by the route identification information included in the received inquiry, the terminal determination unit 132 may use sorting information as a key to sort the plurality of mobile terminals 2. The sorting information is, for example, a ratio of the route identified by the plurality of position information associated with the mobile terminal 2 to the route identified by the route identification information.

[0062] The video acquisition unit 133 acquires videos captured by one or more mobile terminals 2 that satisfy the route conditions.

[0063] The video acquisition unit 133 acquires, for example, a first video corresponding to position information that identifies a first partial route of the route identified by the route identification information, and acquires a second video corresponding to position information that identifies a second partial route other than the first partial route of the route identified by the route identification information. Note that the first partial route and the second partial route are parts of the route identified by the route identification information. It is preferable that the first partial route and the second partial route are continuous routes. It is preferable that the first partial route and the second partial route are routes that do not overlap. In the route identified by the route identification information, for example, the second partial route is a route ahead of the first partial route.

[0064] The video acquisition unit 133 acquires, for example, videos captured by one or more mobile terminals 2 determined by the terminal determination unit 132.

[0065] For example, the video acquiring unit 133 transmits a transmission instruction to one or more mobile terminals 2 determined by the terminal determining unit 132. Then, the video acquiring unit 133 receives video from the one or more mobile terminals 2. Such video is usually video that is transmitted immediately after being captured by the mobile terminal 2. Such video is appropriately referred to as real-time video.

[0066] For example, the video acquiring unit 133 transmits a transmission instruction having the route identification information to one or more mobile terminals 2 determined by the terminal determining unit 132. Then, the video acquiring unit 133 receives, from each mobile terminal 2, a video that is, for example, a video captured by each of the one or more mobile terminals 2 along the route specified by the route identification information and that has been stored in each mobile terminal 2. Such a video is a video that has been captured and stored by the mobile terminal 2, and is appropriately referred to as a past video.

[0067] The video acquisition unit 133 acquires, for example, a video stored by the right holder processing unit 135 described later, which is a video shot at one or more points on the route specified by the route identification information. Such a video is also referred to as a past video as appropriate. For example, the video acquisition unit 133 checks position information paired with the past video stored by the right holder processing unit 135, and acquires a video corresponding to the position information of one or more points on the route specified by the route identification information. The video acquisition unit 133 acquires the video, for example, by using access information described later.

[0068] The video composition unit 134, for example, combines the multiple videos acquired by the video acquisition unit 133 in time to compose one video. It is preferable that each of the multiple videos is a video taken at a different point on the route specified by the route identification information. Note that one video combined in time is one video that connects multiple original videos. When the multiple videos that are the source of one video combined in time are taken, it is preferable that they are continuous in time, but they may be separated in time. For example, the time when one video that is the source of one video was taken may be, for example, 8:20, and the day when another video that is the source of one video was taken may be, for example, 8:25. It is preferable that the video composition unit 134 combines the multiple videos in the order of the points on the route specified by the route identification information to compose one video. One combined video is appropriately called a combined video.

[0069] Furthermore, the moving image composition unit 134, for example, spatially fuses the multiple moving images acquired by the moving image acquisition unit 133 to compose one moving image. A spatially fused moving image is a moving image that is constructed by constructing a frame using some or all of the frames that constitute each of the multiple original moving images for each of the multiple frames that constitute each of the multiple original moving images, and connecting the constructed frames in time. At least one of the frames that constitute the single moving image is a frame that has some or all of the frames of each of the multiple original moving images. A spatially fused moving image is appropriately called a fused moving image.

[0070] The moving image composing unit 134 may perform processing up to passing one moving image acquired by the moving image acquiring unit 133 to the moving image transmitting unit 141. Such processing may also be considered as processing for composing one moving image. The processing up to passing to the moving image transmitting unit 141 is usually processing for sequentially arranging the moving images in a buffer for transmitting the moving images.

[0071] The video composition unit 134, for example, combines the multiple videos acquired by the video acquisition unit 133 in the order of time information corresponding to the videos to compose one video. The video composition unit 134, for example, acquires a part of each of the multiple videos acquired by the video acquisition unit 133, combines the parts of the videos in order to compose one video. Combining multiple videos in time usually means combining parts of the videos taken by each of the multiple mobile terminals 2 in the order of the time they were taken. Combining parts of the videos in order may also mean passing parts of the videos to the video transmission unit 141 in order. Combining in time order corresponding to the videos means combining the videos in the order of time indicated by the time information corresponding to the videos, or combining the videos in the order in which the videos were received. Combining multiple videos in time to compose one video only needs to result in a single video that the user can see.

[0072] The moving image composing unit 134 composes one moving image, for example, by spatially fusing a portion of each of the multiple moving images having different position information corresponding to each of the multiple moving images acquired by the moving image acquiring unit 133. The moving image composing unit 134 composes one frame using, for example, some or all of the frames constituting each of the multiple moving images acquired by the moving image acquiring unit 133, and connects the frames in time to compose one moving image.

[0073] The process of spatially fusing frames included in each of a plurality of moving images is, for example, the following processes (a) and (b). (a) Image processing-based methods

[0074] The moving image composing unit 134 performs, for example, a process of adjusting the direction and scale of each of the multiple frames that are the subject of the spatial connection process. Next, the moving image composing unit 134 detects, for example, the same area in each of the multiple frames. Next, the moving image composing unit 134 performs, for example, a process of overlapping multiple frames having the same area to compose one wide-area frame. Note that it is possible to detect the same area in each of the multiple frames using publicly known technology. (b) Machine learning-based methods

[0075] The video composition unit 134, for example, provides a plurality of frames and a learning model to a module that performs machine learning prediction processing, executes the module, and acquires one wide-area frame.

[0076] The learning model is obtained by providing multiple teacher data sets, which have multiple frames as explanatory variables and a wide-area frame composed of the multiple frames as the objective variable, to a module that performs machine learning learning processing, executing the module, and so on.

[0077] The learning model may be called a learner, a classifier, a classification model, etc. The machine learning algorithm is preferably deep learning, but may be random forest, etc. For machine learning, various machine learning functions such as the TensorFlow library and the random forest module of the R language, and various existing libraries may be used.

[0078] The right holder processing unit 135 performs right holder processing. The right holder processing is processing related to a right holder identified by a right holder identifier corresponding to a video. The right holder processing unit 135 performs right holder processing, which is processing in response to the video transmission unit 141 transmitting a video, for example, and is processing related to a right holder identified by a right holder identifier corresponding to the video. The right holder processing is, for example, a first security processing described later, a second security processing described later, a third security processing described later, a fourth security processing described later, and a compensation processing described later.

[0079] The right holder identifier associated with a video is, for example, a right holder identifier associated with one or more videos that are the source of the video, or an identifier of a user who requested the video. The user who requested the video is the user of the user terminal 3 that sent the inquiry.

[0080] The first maintenance means 1351 performs a first maintenance process of storing a moving image composed by the moving image composition unit 134 in association with an attribute value set corresponding to one or more original moving images. The first maintenance means 1351 may also perform a first maintenance process of storing a moving image received from the mobile terminal 2 in association with an attribute value set corresponding to the moving image. The attribute value set is one or more moving image attribute values.

[0081] The second security means 1352 performs a second security process of storing one moving image composed by the moving image composition unit 134 in association with a right holder identifier corresponding to one or more original moving images that are the basis of the one moving image.

[0082] In addition, the first maintenance means 1351 or the second maintenance means 1352 may store a video composed by the video composition unit 134 in association with a set of attribute values ​​corresponding to one or more videos that were the basis of the video, and with a rights holder identifier corresponding to one or more videos that were the basis of the video.

[0083] The third security means 1353 stores one video composed by the video composition unit 134 in association with a right holder identifier that identifies the user of the user terminal 3. The user of the user terminal 3 here is a person who watches one video. The user terminal 3 here is, for example, a terminal that has sent an inquiry.

[0084] Also, the destination where a video is stored is, for example, the storage unit 11, but it may also be another device, such as another device that constitutes a blockchain.

[0085] The fourth security means 1354 performs a fourth security process to store security information. The security information includes access information for accessing one stored video. The order of storing a video and performing the fourth security process on the security information corresponding to that video does not matter.

[0086] The fourth maintenance means 1354 performs a fourth maintenance process, for example, of storing maintenance information including access information for accessing one stored video composed by the video composition unit 134 in the blockchain.

[0087] In addition, it is preferable that the fourth maintenance means 1354 accumulates the maintenance information in a blockchain. That is, it is preferable that the fourth maintenance means 1354 accumulates the maintenance information in a distributed ledger of the blockchain. It is preferable that the fourth maintenance means 1354 registers the maintenance information as an NFT (non-fungible token). It is preferable that the fourth maintenance means 1354 registers the maintenance information in a distributed file system in an IPFS (Inter Planetary File System) network.

[0088] The preservation information is information for ensuring the originality of a video. It can be said that the preservation information is heading information for a video. The preservation information is, for example, access information and a set of attribute values. It is preferable that the preservation information has, for example, one or more right holder identifiers. When the preservation information has multiple right holder identifiers, the right holder of the video may be shared, and the multiple right holder identifiers may be right holder history information. The right holder history information is a set of right holder identifiers and is information indicating the history of the right holder. The fourth preservation process can ensure the originality of the preservation information of the registered video. By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. The access information is information for accessing a video. The access information is information that identifies the storage destination of the video. The access information is, for example, a URL or a URI.

[0089] It is preferable that the security information includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.

[0090] The remuneration means 1355 performs remuneration processing for each right holder identified by a right holder identifier associated with one or more moving images that are the basis of one moving image composed by the moving image composition unit 134 .

[0091] The reward process is a process of giving a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more right holder identifiers corresponding to a video. The reward process is, for example, a process of making a payment to a right holder identified by one or more right holder identifiers corresponding to a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a right holder identified by one or more right holder identifiers corresponding to a video. The reward process may be of any kind as long as it gives a merit to a right holder identified by one or more right holder identifiers corresponding to a video. The reward may be, for example, money, points, goods, content, or the like, and the content may be of any kind.

[0092] It is preferable that the reward means 1355 performs reward processing, which is a process of acquiring one or more video attribute values ​​corresponding to one or more videos that were the basis of a video transmitted by the video transmission unit 141, determining rewards for each of multiple rights holders using the one or more video attribute values, and awarding the rewards.

[0093] Here, the one or more moving image attribute values ​​are, for example, the amount of data of the moving image, the duration of the moving image, the number of frames of the moving image, and the resolution of the moving image.

[0094] It is preferable that the reward means 1355 performs a reward process, which is a process of acquiring a reward amount corresponding to a service identifier that identifies a service provided to a target video, and giving a reward corresponding to the reward amount. The service identifier is, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.

[0095] The reward means 1355 performs reward processing, which is a process of acquiring a reward amount using, for example, one or more pieces of information among one or more video attribute values ​​and one or more service identifiers, and giving a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of the multiple service identifiers is stored in the storage unit 11. The arithmetic expression is an expression for calculating the reward amount using one or more video attribute values ​​as parameters. The correspondence table is a table having multiple pieces of correspondence information for managing reward amounts corresponding to one or more video attribute values.

[0096] The remuneration means 1355 normally performs a process of charging a user who has enjoyed a service related to the target video with a remuneration. The process of charging a remuneration is, for example, a process of charging the amount of remuneration acquired. The process of charging a remuneration is, for example, a process of charging the amount of remuneration acquired and the amount of profit obtained by the management of the information processing device 1. The process of charging a remuneration is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc.

[0097] The transmission unit 14 transmits various types of information or instructions to the mobile terminal 2 or the user terminal 3. The various types of information or instructions are, for example, a moving image, a transmission instruction, and a stop instruction. Note that the stop instruction is an instruction to stop the transmission of the moving image.

[0098] When it is determined that the latest location information of the mobile terminal 2 transmitting the video has deviated from the route indicated by the route identification information, the transmission unit 14 transmits a stop instruction to the mobile terminal 2.

[0099] The moving image transmitting unit 141 transmits the moving image composed by the moving image composing unit 134 to the user terminal 3. The moving image composed by the moving image composing unit 134 may be the moving image acquired by the moving image acquiring unit 133 itself.

[0100] The video transmitting unit 141 transmits, for example, the first video and the second video acquired by the video acquiring unit 133 to the user terminal 3. It is preferable that the video transmitting unit 141 transmits the videos in the order of positions on the route identified by the route identification information. <Details of components of mobile terminal 2>

[0101] Various types of information are stored in the moving storage unit 21. The various types of information are, for example, a video, an attribute value set, a rights holder identifier, and a camera attribute value. The camera attribute value is an attribute value of a camera. The camera attribute value is, for example, an angle of view, direction information, and resolution.

[0102] For example, one or more moving image attribute values ​​constituting an attribute value set correspond to one or more still images constituting a moving image. The one or more moving image attribute values ​​may correspond to all still images, may correspond to some of the still images, or may correspond to multiple still images.

[0103] The mobile receiving unit 22 receives various information. The various information is, for example, a transmission instruction and a stop instruction. The mobile instruction receiving unit 221 receives a transmission instruction from the information processing device 1.

[0104] The movement processing unit 23 performs various types of processing. The various types of processing are, for example, processing performed by a position acquisition unit 231, a shooting unit 232, an attribute value acquisition unit 233, and a configuration unit 234.

[0105] The position acquisition unit 231 acquires position information. The position acquisition unit 231 usually acquires position information that specifies the position of the mobile terminal 2. The position acquisition unit 231 acquires the position information by, for example, a GPS receiver. However, the means and algorithm by which the position acquisition unit 231 acquires the position information are not important.

[0106] The photographing unit 232 photographs a moving image. For example, the photographing unit 232 photographs a moving image while the mobile terminal 2 is moving. It is preferable that the photographed moving image is associated with location information acquired by the location acquisition unit 231. It is preferable that the photographed moving image is associated with one or more moving image attribute values ​​acquired by the attribute value acquisition unit 233 described later.

[0107] It is preferable that the imaging unit 231 stores the captured video in the moving storage unit 21. When storing video in the moving storage unit 21 with a limited storage capacity, it is preferable that the imaging unit 231 overwrites new video in an area in which old video is stored. In other words, it is preferable that the structure of the moving storage unit 21 is a ring buffer structure.

[0108] The attribute value acquisition unit 233 acquires one or more camera attribute values ​​including direction information indicating the direction in which the image is captured by the image capture unit 232. It is preferable that the attribute value acquisition unit 233 acquires one or more video attribute values ​​including the camera attribute value.

[0109] The attribute value acquisition unit 233 acquires, for example, one or more moving image attribute values. One or more moving image attribute values ​​may be called an attribute value set. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting. The attribute value acquisition unit 233 acquires time information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting, and acquires season information corresponding to the time information. The attribute value acquisition unit 233 acquires weather information, for example, during shooting. Note that even if the shooting location is indoors, the weather information may be information about the weather in a similar area to the indoor location. The movement processing unit 23 acquires weather information corresponding to the position information, for example, from a server (not shown). The movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied. The attribute value acquisition unit 23 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to the position information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed in the moving object. The movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied. Note that the acquisition condition is, for example, when the analysis result of the video satisfies a predetermined condition.

[0110] The attribute value acquisition unit 233 acquires, for example, one or more tags for the moving image captured by the imaging unit 231, and associates the tags with the moving image. Note that a tag can also be considered as a moving image attribute value.

[0111] The attribute value acquisition unit 233, for example, analyzes a moving image captured by the image capture unit 231 and acquires one or more tags for the moving image.

[0112] The attribute value acquisition unit 233 acquires one or more tags, for example, by using one or more moving object attribute values ​​acquired during shooting by the shooting unit 231. The moving object attribute value is, for example, CAN data.

[0113] The attribute value acquisition unit 233, for example, determines one or more still images that match the video tag condition, and acquires a tag that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.

[0114] For example, if the video tag condition is "the number of cars whose front-to-back intervals are within a threshold is equal to or greater than a threshold and the moving speed of the cars is equal to or less than a threshold" and the tag paired with the video tag condition is "traffic jam", the attribute value acquisition unit 233 analyzes frames of the video, recognizes multiple cars, and acquires the intervals between the multiple cars. The attribute value acquisition unit 233 also acquires the number of cars whose intervals are within a threshold. The attribute value acquisition unit 233 also acquires the moving distance and frame rate of one car in multiple frames, and acquires the speed of the car. Then, the attribute value acquisition unit 233 uses the number of cars whose intervals are within a threshold and the speed of the car to determine whether or not the video tag condition is met. Then, if the video tag condition is met, the attribute value acquisition unit 233 acquires the tag "traffic jam" paired with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.

[0115] The attribute value acquisition unit 233 may, for example, determine one or more moving object attribute values ​​that match an attribute value tag condition, and acquire a tag that is paired with the attribute value tag condition. The attribute value acquisition unit 233 may also associate the tag with a video that is paired with the one or more moving object attribute values.

[0116] For example, if the attribute value tag condition is "driving time at a speed less than 30 km is 10 minutes or more & the ratio of the speed less than 30% during the driving time is 80% or more" and the tag paired with the attribute value tag condition is "traffic jam", the attribute value acquisition unit 233 detects CAN data that matches the attribute value tag condition using the speed history of the CAN data associated with each field of the video, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is the CAN data acquired at the same timing as the field was shot.

[0117] The composition unit 234 associates the acquired position information with the moving image and acquires the additional moving image. The composition unit 234 acquires, for example, an additional moving image in which one or more camera attribute values ​​acquired by the attribute value acquisition unit 233 are also associated with the moving image. The composition unit 234 acquires, for example, an additional moving image in which one or more moving image attribute values ​​acquired by the attribute value acquisition unit 233 are also associated with the moving image. The additional moving image is a moving image to which one or more moving image attribute values ​​have been added. Such one or more moving image attribute values ​​usually include position information.

[0118] The mobile transmission unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, position information, moving images, and additional moving images. The mobile transmission unit 24 may continuously transmit moving images acquired by the photographing unit 232 to the information processing device 1. In such a case, the moving images are usually associated with position information.

[0119] It is preferable that the mobile transmitter 24 stops transmitting the video when a stop instruction is received.

[0120] The position transmission unit 241 transmits the position information acquired by the position acquisition unit 231 to the information processing device 1.

[0121] It is preferable that the location transmission unit 241 continuously transmits the location information to the information processing device 1. "Continuously" may include "always" or "periodically." "Periodic" means that the transmission interval may vary to some extent. There is no restriction on the frequency or interval at which the location transmission unit 241 transmits the location information.

[0122] The moving video transmitting unit 242 transmits the video captured by the imaging unit 232 in response to, for example, a transmission instruction being received by the movement instruction receiving unit 221. It is preferable that the moving video transmitting unit 242 transmits an additional video.

[0123] For example, in response to the movement instruction receiving unit 221 receiving a transmission instruction, the movement processing unit 23 acquires from the movement storage unit 21 past videos paired with one or more pieces of location information corresponding to the route specified by the route specifying information included in the transmission instruction, and the movement video transmitting unit 242 transmits the past videos. It is preferable that the movement video transmitting unit 242 transmits additional videos.

[0124] The movement output unit 25 outputs various types of information, such as a moving image, an additional moving image, and a set of attribute values.

[0125] Output is a concept that includes displaying on a display, projecting using a projector, printing on a printer, outputting sound, transmitting to an external device, storing on a recording medium, and passing on the processing results to other processing devices or other programs.

[0126] The video output unit 251 outputs a video. It is preferable that the video output unit 251 outputs an additional video. The output here may be accumulation in the moving storage unit 21. <Details of components of user terminal 3>

[0127] Various types of information are stored in the user storage unit 31. The various types of information include, for example, a user identifier, a video, an inquiry, and map information.

[0128] The user reception unit 32 receives various instructions and information. The various instructions and information are, for example, an inquiry, a location instruction, a purchase instruction, and route specification information. Note that the inquiry may include a purchase instruction. Also, the route specification information may be a destination.

[0129] Reception is a concept that includes the reception of information input from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.

[0130] The point specification is a specification of a point on the route on the output map, and is a specification of outputting a video of the point.

[0131] A purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information identifying the video. The purchase instruction has, for example, a video identifier. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, a purchase amount. The purchase conditions include, for example, information identifying a rights period.

[0132] The means for inputting various instructions and information may be any means, such as a touch panel, a keyboard, a mouse, or a menu screen.

[0133] The user processing unit 33 performs various processes. For example, the various processes are processes for creating a data structure for transmitting various instructions and information received by the user receiving unit 32. For example, the various processes are processes for creating a structure for transmitting information received by the user receiving unit 35.

[0134] The user processing unit 33 acquires a video corresponding to the position information indicating the location corresponding to the location instruction received by the user receiving unit 32. The video is a part or all of the videos received by the user receiving unit 35.

[0135] For example, when a destination is accepted, the user processing unit 33 acquires route specification information using the current position and the destination. Note that such processing is a well-known processing in a navigation terminal.

[0136] The user transmission unit 34 transmits various instructions and information to the information processing device 1. The various instructions and information are, for example, inquiries and purchase instructions.

[0137] The user transmission unit 34 transmits, for example, an inquiry including route identification information that identifies a route. There is no restriction on the timing or trigger for the user transmission unit 34 to transmit the inquiry. For example, when a route is set, the user transmission unit 34 transmits an inquiry including route identification information that identifies the route.

[0138] The user receiving unit 35 receives the video in response to the transmission of the inquiry. The user receiving unit 35 usually receives the video from the information processing device 1. For example, in response to the transmission of the inquiry, the user receiving unit 35 receives position information of a mobile terminal 2 that exists at a point on the route specified by the route identification information. For example, in response to the transmission of the inquiry, the user receiving unit 35 receives thumbnail images constituting the video captured by a mobile terminal 2 that exists at a point on the route specified by the route identification information.

[0139] The user output unit 36 ​​outputs a map using the map information in the user storage unit 31. The user output unit 36 ​​outputs a map that clearly shows the route indicated by the route identification information acquired by the user processing unit 33.

[0140] The user output unit 36 ​​outputs a map indicating points along the route where videos can be acquired. The points where videos can be acquired are points indicated by the location information of one or more mobile terminals 2 received by the user receiving unit 35. The user output unit 36 ​​outputs, for example, a thumbnail image received by the user receiving unit 35. It is preferable that the user output unit 36 ​​outputs the thumbnail image in association with the point indicated by the location information associated with the thumbnail image.

[0141] The user output unit 36 ​​outputs the video received by the user receiving unit 35 .

[0142] The storage unit 11, the terminal management unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.

[0143] There is no restriction on the process by which information is stored in the storage unit 11, etc. For example, information may be stored in the storage unit 11, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 11, etc., or information inputted via an input device may be stored in the storage unit 11, etc.

[0144] The receiving unit 12, the location receiving unit 121, the inquiry receiving unit 122, the mobile receiving unit 22, and the user receiving unit 35 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.

[0145] The processing unit 13, the position accumulation unit 131, the terminal determination unit 132, the video acquisition unit 133, the video composition unit 134, the right holder processing unit 135, the first security means 1351, the second security means 1352, the third security means 1353, the fourth security means 1354, the reward means 1355, the movement processing unit 23, the attribute value acquisition unit 233, the composition unit 234, and the user processing unit 33 can usually be realized by a processor, a memory, or the like. The processing procedure of the processing unit 13, etc. is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). The processor is a CPU, an MPU, a GPU, etc., and the type does not matter.

[0146] The transmitting unit 14, video transmitting unit 141, mobile transmitting unit 24, position transmitting unit 241, mobile video transmitting unit 242, and user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.

[0147] The position acquisition unit 231 is realized by, for example, a GPS receiver.

[0148] The image capturing unit 232 includes a camera capable of capturing moving images. Note that any type of camera may be used.

[0149] The movement output unit 25, the video output unit 251, and the user output unit 36 ​​may or may not include output devices such as a display, a speaker, etc. The movement output unit 25 may be realized by driver software for an output device, or a combination of driver software for an output device and an output device, etc.

[0150] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen. <Operation>

[0151] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described with reference to the flowchart of Fig. 4. Note that "S" in each flowchart used in the following description indicates a step.

[0152] (S401) The location receiving unit 121 judges whether or not location information has been received from the mobile terminal 2. If location information has been received, the process proceeds to S402, and if location information has not been received, the process proceeds to S403. The received location information is associated with a terminal identifier. Here, the receiving unit 12 may also receive video from the mobile terminal 2 in a pair with one or more pieces of location information. The receiving unit 12 may also receive location information and one or more video attribute values.

[0153] (S402) Position accumulation unit 131 associates the position information received in S401 with the terminal identifier and adds it to terminal management unit 111. Return to S401. Note that processing unit 13 may accumulate videos in pairs with one or more pieces of position information.

[0154] (S403) The inquiry receiving unit 122 judges whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S404, and if an inquiry has not been received, the process returns to S401. Note that an inquiry is usually associated with the user identifier of the user who sent the inquiry.

[0155] (S404) The terminal determination unit 132 acquires route information included in the inquiry received in S403. Alternatively, the terminal determination unit 132 acquires route information using route specification information included in the inquiry. Note that the route information is a collection of multiple pieces of location information.

[0156] (S405) The terminal determination unit 132 judges whether the inquiry received in S403 is an inquiry indicating acquisition of real-time video (appropriately referred to as "real-time") or an inquiry indicating acquisition of video that may include video stored in the past (appropriately referred to as "past") If it is real-time acquisition, the process proceeds to S406, and if it is past acquisition, the process proceeds to S413.

[0157] The terminal determination unit 132 determines whether the inquiry is "real time" or "past" based on the value of a timing flag included in the inquiry, for example.

[0158] (S406) The terminal determination unit 132 determines one or more mobile terminals 2 capable of transmitting real-time video. An example of such a terminal determination process will be described with reference to the flowchart in Fig. 5. Note that a mobile terminal 2 capable of transmitting real-time video is a mobile terminal 2 capturing video at any point on a route specified by the route information.

[0159] (S407) The moving image obtaining unit 133 assigns 1 to a counter i.

[0160] (S408) The video acquisition unit 133 determines whether or not the i-th mobile terminal 2 exists among the mobile terminals 2 determined in S406. If the i-th mobile terminal 2 exists, the process proceeds to S409, and if not, the process returns to S401.

[0161] (S409) The video acquiring unit 133 acquires terminal communication information of the i-th mobile terminal 2 from the terminal management unit 111. The video acquiring unit 133 transmits a video transmission instruction to the i-th mobile terminal 2 using the terminal communication information.

[0162] (S410) The receiving unit 12 judges whether or not a video has been received from the i-th mobile terminal 2. If a video has been received, the process proceeds to S411, and if a video has not been received, the process returns to S410. Note that it is preferable to wait here until the video is received from the mobile terminal 2 that transmitted the transmission instruction.

[0163] Here, the receiving unit 12 may receive only the location information from the i-th mobile terminal 2 instead of the video, or may receive the location information and a thumbnail image.

[0164] (S411) The processing unit 13 composes information including the location information of the i-th mobile terminal 2, to be transmitted to the user terminal 3. The transmission unit 14 transmits the information to the user terminal 3.

[0165] This information is, for example, the position information of the i-th mobile terminal 2 and a still image (for example, a thumbnail image) included in the video from the mobile terminal 2. This information is, for example, the position information of the i-th mobile terminal 2 and the video.

[0166] (S412) The moving image obtaining unit 133 increments the counter i by 1. The process returns to S408.

[0167] (S413) Video acquisition unit 133 performs a process of acquiring past videos. An example of such past video acquisition process will be described with reference to the flowchart in Fig. 6. Note that the past videos are videos stored by information processing device 1 or videos stored by mobile terminal 2 in mobile storage unit 21 of mobile terminal 2.

[0168] (S414) The video transmission unit 141 transmits the video acquired in S413 to the user terminal 3. Return to S401.

[0169] (S415) The receiving unit 12 judges whether or not a video or the like has been received from the mobile terminal 2. If a video or the like has been received, the process proceeds to S416, and if a video or the like has not been received, the process proceeds to S421. The video or the like may be, for example, a video, a terminal identifier, or a set of attribute values.

[0170] (S416) The processing unit 13 temporarily stores the video etc. received in S415 in a buffer (not shown). Note that the destination for storing the video etc. may be, for example, the storage unit 11, and is not critical.

[0171] (S417) The processing unit 13 judges whether or not the video received from the mobile terminal 2 identified by the terminal identifier included in the video etc. received in S415 is being transmitted to the user terminal 3. If it is being transmitted, the process proceeds to S418, and if it is not being transmitted, the process returns to S401.

[0172] (S418) The processing unit 13 judges whether or not the path condition is satisfied. If the path condition is satisfied, the process proceeds to S419, and if the path condition is not satisfied, the process proceeds to S420.

[0173] The route condition here is that the latest location information paired with the terminal identifier included in the video or the like received in S415 is location information of a point on the route indicated by the route information corresponding to the inquiry. If the route condition is not satisfied, it is preferable that the transmission unit 14 transmits a stop instruction to the mobile terminal 2.

[0174] (S419) The video transmission unit 141 transmits the video received in S415 to the user terminal 3.

[0175] (S420) Right holder processing unit 135 performs protection processing. An example of the protection processing will be described with reference to the flowchart in FIG.

[0176] (S421) The receiving unit 12 judges whether or not a location instruction has been received from the user terminal 3. If a location instruction has been received, the process proceeds to S422, and if a location instruction has not been received, the process proceeds to S425.

[0177] (S422) The video acquisition unit 133 acquires location information corresponding to the location instruction. The video acquisition unit 133 acquires a video of the location indicated by the location information.

[0178] The video acquisition unit 133 acquires, for example, a terminal identifier corresponding to the acquired location information, and acquires the video paired with the terminal identifier from a buffer (not shown).

[0179] The video acquisition unit 133, for example, acquires a terminal identifier corresponding to the acquired location information, and transmits a transmission instruction to the mobile terminal 2 identified by the terminal identifier. Then, the video acquisition unit 133 receives the video from the mobile terminal 2.

[0180] (S423) The video transmission unit 141 transmits the video acquired in S422 to the user terminal 3 that has transmitted the location instruction.

[0181] (S424) The processing unit 13 judges whether or not to end the transmission of the video to the user terminal 3. If the transmission is to be ended, the process proceeds to S420, and if the transmission is not to be ended, the process returns to S422. Note that the transmission is to be ended, for example, when an instruction to end the transmission is received from the user terminal 3.

[0182] (S425) The receiving unit 12 determines whether or not a purchase instruction has been received from the user terminal 3. If a purchase instruction has been received, the process proceeds to step S426, and if not, the process returns to step S401.

[0183] (S426) The video acquiring unit 133 acquires the video corresponding to the purchase instruction. Note that the video acquiring unit 133 acquires the video corresponding to the purchase instruction from the videos accumulated by the right holder processing unit 135, for example.

[0184] (S427) The fourth security means 1354 acquires a user identifier corresponding to the user terminal 3 that transmitted the purchase instruction. This user identifier becomes the right holder identifier for the purchased video.

[0185] (S428) The fourth security means 1354 performs a fourth security process using the user identifier acquired in S427. An example of the fourth security process will be described with reference to the flowchart of FIG.

[0186] (S429) The compensation means 1355 performs compensation processing for the original rights holder of the purchased video. Return to S401. An example of the compensation processing will be described with reference to the flowchart of FIG.

[0187] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt is issued to end the process.

[0188] Next, an example of the terminal determination process in S406 will be described with reference to the flowchart in FIG.

[0189] (S501) The terminal determination unit 132 assigns 1 to a counter i.

[0190] (S502) The terminal determination unit 132 judges whether or not the i-th location information is present in the route information acquired in S404. If the i-th location information is present, the process proceeds to S503, and if not, the process returns to the upper processing.

[0191] (S503) The terminal determination unit 132 assigns 1 to a counter j.

[0192] (S504) Terminal determination unit 132 judges whether or not j-th terminal information exists in terminal management unit 111. If j-th terminal information exists, the process proceeds to S505, and if not, the process proceeds to S509.

[0193] (S505) The terminal determination unit 132 acquires the latest location information included in the j-th terminal information.

[0194] (S506) The terminal determination unit 132 judges whether or not the i-th location information in the route information satisfies an approximation condition with the latest location information of the mobile terminal 2. If the approximation condition is satisfied, the process proceeds to S507, and if the approximation condition is not satisfied, the process proceeds to S508.

[0195] The approximation condition is that the two pieces of location information are close to each other. For example, the approximation condition is that the distance between the two points indicated by the two pieces of location information is within a threshold or is smaller than a threshold.

[0196] (S507) The terminal determination unit 132 calculates the distance between the two points using the two pieces of location information. The terminal determination unit 132 temporarily stores the distance in a pair with the terminal identifier of the mobile terminal 2.

[0197] (S508) The terminal determination unit 132 increments the counter j by 1. The process returns to S504.

[0198] (S509) The terminal determination unit 132 judges whether or not a mobile terminal 2 that satisfies the approximation condition is present. If a mobile terminal 2 is present, the process proceeds to S508, and if not, the process proceeds to S511.

[0199] (S510) The terminal determination unit 132 acquires the terminal identifier of the mobile terminal 2 with the shortest distance.

[0200] (S511) The terminal determination unit 132 increments the counter i by α, where α is a natural number equal to or greater than 1. The process returns to S502.

[0201] It is preferable that if the terminal identifier of mobile terminal 2 can be acquired in S510, α is a multiple large numerical value, and if the terminal identifier of mobile terminal 2 cannot be acquired, α is a numerical value smaller than that in the case where the terminal identifier is acquired, such as 1.

[0202] Next, an example of the past video acquisition process in S413 will be described with reference to the flowchart in FIG.

[0203] (S601) The moving image obtaining unit 133 assigns 1 to a counter i.

[0204] (S602) The video acquisition unit 133 determines whether or not the i-th location information is present in the route information acquired in S404. If the i-th location information is present, the process proceeds to S603; if not, the process returns to the upper level process.

[0205] (S603) The moving image obtaining unit 133 assigns 1 to a counter j.

[0206] (S604) Video acquisition unit 133 refers to terminal management unit 111 and determines whether or not there is a j-th mobile terminal 2 (j-th terminal information) to which video can be transmitted. If there is a j-th mobile terminal 2, the process proceeds to S605; if there is not, the process proceeds to S610.

[0207] (S605) The video acquisition unit 133 acquires a location information group paired with the terminal identifier of the j-th mobile terminal 2 from the terminal management unit 111. The location information group is one or more pieces of location information. Also, it is assumed that the video corresponding to the location information group has been shot by the mobile terminal 2 and stored in the video storage unit 21.

[0208] (S606) The video acquisition unit 133 judges whether or not the i-th position information satisfies the route condition for the group of position information acquired in S605. If the route condition is satisfied, the process proceeds to S607, and if the route condition is not satisfied, the process proceeds to S609. Note that the route condition here is that the i-th position information is information indicating a point on a route specified by the group of position information.

[0209] (S607) The video acquisition unit 133 acquires a group of location information, which is one or more pieces of location information from the group of location information acquired in S605, which is a group of location information from the route information acquired in S404, and which is a collection of one or more pieces of location information from the i-th location information onward in the route information. Such a group of location information is information that identifies a route on which the j-th mobile terminal 2 has video.

[0210] (S608) The video acquisition unit 133 calculates the distance of the route specified by the group of positional information acquired in S607.

[0211] (S609) The moving image obtaining unit 133 increments the counter j by 1. The process returns to S604.

[0212] (S610) The moving image obtaining unit 133 assigns 1 to a counter k.

[0213] (S611) The video acquisition unit 133 judges whether or not the k-th previous video exists among the previous videos stored in S420. If the k-th previous video exists,

[0214] (S612) The video obtaining unit 133 obtains a group of position information corresponding to past videos.

[0215] (S613) The video acquisition unit 133 judges whether the i-th position information satisfies the route condition for the group of position information acquired in S125. If the route condition is satisfied, the process proceeds to S614, and if the route condition is not satisfied, the process proceeds to S616. Note that the route condition here is that the i-th position information is information indicating a point on the route specified by the group of position information acquired in S612.

[0216] (S614) The video acquisition unit 133 acquires a position information group that is one or more pieces of position information from the position information group acquired in S612, is a position information group from the route information acquired in S404, and is a set of one or more pieces of position information from the i-th position information onward in the route information. This position information group is a set of position information that identifies a route that overlaps with the route indicated by the route information, among routes corresponding to the past video.

[0217] (S615) The video acquisition unit 133 calculates the distance of the route specified by the group of positional information acquired in S614.

[0218] (S616) The moving image obtaining unit 133 increments the counter k by 1. The process returns to S613.

[0219] (S617) The video acquisition unit 133 determines whether the path condition has been satisfied at least once in either S606 or S614. If the path condition is satisfied, the process proceeds to S618, and if the path condition is not satisfied, the process proceeds to S619.

[0220] (S618) The video acquisition unit 133 acquires the terminal identifier of the mobile terminal 2 with the longest distance calculated in S608 or S615, or an identifier of a past video. When the video acquisition unit 133 acquires a terminal identifier, it transmits an instruction to transmit a video including a group of position information corresponding to the distance to the mobile terminal 2 identified by the terminal identifier, and receives a video on the route indicated by the group of position information from the mobile terminal 2. When the video acquisition unit 133 acquires an identifier of a past video, it acquires the video etc. identified by the identifier from the storage area indicated by the access information of the video.

[0221] (S619) The moving image obtaining unit 133 increments the value of the counter i. The process returns to S602.

[0222] If the path condition is not satisfied, the video acquisition unit 133 preferably increments the value of the counter i by 1. If the path condition is satisfied, the video acquisition unit 133 preferably increments the value of the counter i by 2 or more.

[0223] Next, an example of the security process of S420 will be described with reference to the flowchart of FIG.

[0224] (S701) Rights holder processing unit 135 stores the transmitted moving image in association with a set of attribute values ​​corresponding to one or more original moving images from which the transmitted moving image is based.

[0225] It is preferable that the right holder processing unit 135 stores the video in a pair with a right holder identifier that identifies one or more right holders. The right holder identifier here is, for example, one or more right holder identifiers of the video that is the source of the stored video. The right holder identifier here is, for example, a single right holder identifier that identifies the user who made the inquiry.

[0226] Furthermore, the right holder processing unit 135 accumulates the video in, for example, the storage unit 11 or a device other than the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.

[0227] (S702) The fourth maintenance means 1354 performs the fourth maintenance process. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.

[0228] (S703) The right holder processing unit 135 assigns 1 to a counter i.

[0229] (S704) Right holder processing unit 135 judges whether or not the i-th moving image that was the source of the stored moving image exists. If the i-th moving image exists, the process proceeds to S705, and if not, the process returns to the upper process.

[0230] (S705) Remuneration means 1355 performs a remuneration process. An example of the remuneration process will be described with reference to the flowchart in Fig. 9. The remuneration process here is a process of paying remuneration to the right holder of the i-th moving image that is the basis of the accumulated moving image.

[0231] (S706) Rights holder processing unit 135 judges whether or not to change the rights holder of the i-th moving image that is the source of the stored moving image. If the rights holder is to be changed, the process proceeds to S707. If the rights holder is not to be changed, the process proceeds to S708.

[0232] In addition, whether or not to change the rights holder may be based on a flag corresponding to the i-th video, or may be decided in advance, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder."

[0233] (S707) The right holder processing unit 135 acquires the user identifier of the user terminal 3. This user identifier becomes a new right holder identifier.

[0234] (S708) The first maintenance unit 1351 stores the i-th moving image that is the source of the stored moving images.

[0235] (S709) The fourth maintenance means 1354 performs a fourth maintenance process on the i-th moving image that is the source of the stored moving image. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.

[0236] (S710) The right holder processing unit 135 increments the counter i by 1. The process returns to S704.

[0237] In the flowchart of Figure 7, when a combined video is constructed, a process (S708) of storing the multiple videos that are the basis of the combined video and a fourth preservation process (S709) are performed, but such processes do not have to be performed.

[0238] Next, an example of the fourth security process of S702 and S709 will be described with reference to the flowchart of FIG.

[0239] (S801) The fourth security unit 1354 acquires access information for identifying a storage destination of a moving image. The moving image is, for example, a fused moving image or a combined moving image.

[0240] (S802) The fourth maintenance means 1354 acquires an attribute value set corresponding to the stored moving image. If the stored moving image is a moving image composed of multiple original moving images, the attribute value set corresponding to the moving image is the attribute value set of each of the multiple original moving images.

[0241] (S803) The fourth security means 1354 constructs security information having the access information acquired in S801, the attribute value set acquired in S802, and the rights holder identifier of the video. Note that, if a new rights holder identifier has been acquired, the fourth security means 1354 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. (S804) The fourth maintenance means 1354 accumulates the maintenance information configured in S803, and then returns to the upper level processing.

[0242] In addition, in S804, if the preservation information of the video corresponding to the preservation information to be stored is stored, the preservation information configured in S803 is overwritten with the preservation information. In this way, for example, the transition of the right holder of the video can be managed. In addition, the fourth preservation means 1354 stores the preservation information in, for example, a block chain.

[0243] Next, an example of the reward process in S705 will be described with reference to the flowchart in FIG.

[0244] (S901) Reward means 1355 acquires one or more right holder identifiers of a target video. Reward means 1355 may acquire right holder identifiers of previous right holders of the target video.

[0245] (S902) The reward means 1355 acquires a set of attribute values ​​of the target video.

[0246] (S903) The reward means 1355 acquires a service identifier that identifies a service provided to the target video. The service identifier is, for example, “view” or “purchase.”

[0247] (S904) The reward means 1355 acquires a reward amount using one or more pieces of information among the attribute value set acquired in S902 and the service identifier acquired in S903.

[0248] If multiple right holder identifiers are obtained, the remuneration means 1355 obtains a remuneration amount for each right holder identifier. If the history information of a right holder including multiple right holder identifiers is obtained, the remuneration means 1355 may obtain a remuneration amount for each right holder identifier.

[0249] In addition, it is preferable that the remuneration means 1355, for example, acquires a moving image attribute value corresponding to each of the multiple moving images that are the source of the moving image transmitted by the moving image transmission unit 141, and determines the amount of remuneration for each of the multiple right holders using the moving image attribute value. It is preferable that the remuneration means 1355, for example, determines a larger amount of remuneration as the data amount, the time of the moving image, or the number of frames of the original moving image adopted in the moving image transmitted by the moving image transmission unit 141 increases. It is preferable that the remuneration means 1355, for example, determines a larger amount of remuneration as the resolution of the original moving image adopted in the moving image transmitted by the moving image transmission unit 141 increases.

[0250] (S905) The reward means 1355 performs a process of giving a reward of the reward amount acquired in S904 to the right holder identified by the right holder identifier acquired in S901.

[0251] (S906) Reward means 1355 performs a process of charging the user who has enjoyed the service related to the target video with a reward. The process returns to the upper level process. Note that the target video is usually a video transmitted to user terminal 3.

[0252] In the flowchart of FIG. 9, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.

[0253] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.

[0254] (S1001) The mobile terminal 2 determines whether or not a start instruction has been received. If a start instruction has been received, the process proceeds to S1002, and if not, the process proceeds to S1011. The start instruction may be, for example, an instruction to start a video transmission application or to power on the mobile terminal 2.

[0255] (S1002) Position acquisition unit 231 acquires position information.

[0256] (S1003) Attribute value acquisition unit 233 acquires one or more moving image attribute values ​​excluding position information.

[0257] (S1004) Configuration unit 234 acquires a terminal identifier from movement storage unit 21.

[0258] (S1005) Composition unit 234 composes information to be transmitted, which is information having position information, one or more video attribute values, and a terminal identifier. Position transmission unit 241 transmits the information composed in S1005 to information processing device 1.

[0259] (S1006) The imaging unit 232 captures and acquires a video.

[0260] (S1007) Composition unit 234 composes an additional moving image having a moving image, location information, one or more moving image attribute values, and a terminal identifier. Composition unit 234 accumulates the additional moving image in transfer storage unit 21.

[0261] (S1008) The moving video transmission unit 242 judges whether or not to transmit the video to the information processing device 1. If the video is to be transmitted, the process proceeds to S1009, and if not, the process proceeds to S1010. Note that, when transmitting a video, for example, the transmission flag may be "ON". Also, the initial value of the transmission flag is "OFF".

[0262] (S1009) The moving moving image transmission unit 242 transmits the additional image accumulated in S1007 to the information processing device 1. Note that there is no limit to the amount of moving images transmitted at one time.

[0263] (S1010) The movement processing unit 23 judges whether or not to end the transmission of the position information, etc. If the transmission is to be ended, the process returns to S1001, and if the transmission is not to be ended, the process returns to S1002. The transmission of the position information, etc. is ended, for example, when an end instruction is received from the user.

[0264] (S1011) The movement instruction receiving unit 221 determines whether or not a video transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S1002, and if not, the process returns to S1001.

[0265] (S1012) The movement processing unit 23 judges whether the transmission instruction received in S1011 is an instruction to transmit real-time video or an instruction to transmit past video. If it is an instruction to transmit real-time video, the process proceeds to S1013, and if it is an instruction to transmit past video, the process proceeds to S1014.

[0266] The movement processing unit 23 may determine whether the transmission instruction is an instruction to transmit real-time video or an instruction to transmit past video based on a timing flag included in the transmission instruction. The movement processing unit 23 may determine that the transmission instruction is an instruction to transmit real-time video when the transmission instruction does not have a position information group, and may determine that the transmission instruction is an instruction to transmit past video when the transmission instruction has a position information group.

[0267] (S1013) The movement processing unit 23 sets the transmission flag to “ON.” The process returns to S1002.

[0268] (S1014) The movement processing unit 23 acquires a group of location information included in the transmission instruction.

[0269] (S1015) The movement processing unit 23 acquires moving images, etc., corresponding to the plurality of pieces of position information corresponding to the group of position information acquired in S1014, from the movement storage unit 21. The moving images, etc., are preferably so-called additional moving images, but may be only moving images.

[0270] (S1016) The moving moving image transmission unit 242 transmits the additional moving image acquired in S1015 to the information processing device 1.

[0271] (S1017) Mobile receiving unit 22 determines whether or not a stop instruction has been received from information processing device 1. If a stop instruction has been received, the process proceeds to S1018, and if not, the process returns to S1001.

[0272] (S1018) The movement processing unit 23 sets the transmission flag to “OFF.” The process returns to S1002.

[0273] In the flowchart of FIG. 10, the process ends when the power is turned off or an interrupt is issued to end the process.

[0274] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.

[0275] (S1101) The user reception unit 32 judges whether or not route identification information has been received. If the route identification information has been received, the process proceeds to S1102, and if not, the process proceeds to S1117.

[0276] (S1102) The user processing unit 33 acquires route identification information. The route identification information accepted in S1101 is the destination, and the acquired route identification information may be a collection of multiple location information items resulting from a route search using the current location and the destination. In other words, the route identification information accepted in S1101 and the route identification information acquired here do not have to be the same information.

[0277] (S1103) The user processing unit 33 acquires map information from the user storage unit 31. Next, the user processing unit 33 creates map information on the map information that indicates the route specified by the route specification information. The user output unit 36 ​​uses the map information to output a map on which the route is specified.

[0278] (S1104) The user processing unit 33 composes an inquiry having the route identification information acquired in S1102. The user transmission unit 34 transmits the inquiry to the information processing device 1.

[0279] Here, the user processing unit 33 may perform the processes from S1104 to S1116 only when the inquiry flag in the user storage unit 31 is "ON". In other words, when the inquiry flag is "OFF", the video is not output to the user terminal 3. And, the inquiry flag is changeable.

[0280] (S1105) In response to the transmission of the inquiry, the user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1106, and if not, the process proceeds to S1113.

[0281] (S1106) User processing unit 33 judges whether or not a moving image is included in the information received in S1105. If a moving image is included, the process proceeds to S1107, and if a moving image is not included, the process proceeds to S1109.

[0282] (S1107) User output unit 36 ​​outputs one or more videos from the information received in S1105. It is preferable that user output unit 36 ​​clearly displays on a map the location indicated by the position information corresponding to the video.

[0283] (S1108) User processing unit 33 judges whether or not to end the output of information. If the output is to be ended, the process returns to S1101, and if not, the process returns to S1105.

[0284] (S1109) User processing unit 33 acquires a group of location information from the information received in S1105.

[0285] (S1110) User processing unit 33 creates a map that clearly shows the points indicated by each piece of location information included in the group of location information acquired in S1109. User output unit 36 ​​outputs the map.

[0286] (S1111) The user processing unit 33 judges whether or not a thumbnail image is present in the information received in S1105. If a thumbnail image is present, the process proceeds to S1112, and if not, the process returns to S1105. Note that a thumbnail image is one image in a video.

[0287] (S1112) User output unit 36 ​​outputs one or more thumbnail images from the information received in S1105. It is preferable that user output unit 36 ​​outputs the thumbnail image in a manner that clearly indicates the location indicated by the location information paired with the thumbnail image.

[0288] (S1113) The user processing unit 33 judges whether or not a timeout has occurred. If a timeout has occurred, the process returns to S1101, and if not, the process proceeds to S1114. A timeout occurs when a time equal to or greater than a threshold has elapsed since the transmission of the inquiry.

[0289] (S1114) The user reception unit 32 judges whether or not a location instruction has been received. If a location instruction has been received, the process proceeds to S1115, and if not, the process returns to S1105.

[0290] (S1115) The user processing unit 33 etc. acquires a video paired with the position information corresponding to the point instruction.

[0291] The user transmitting unit 34 transmits a transmission instruction to the mobile terminal 2 corresponding to the position information corresponding to the location instruction, for example. Then, the user receiving unit 35 receives the video from the mobile terminal 2. Then, the user processing unit 33 acquires the video.

[0292] (S1116) User output unit 36 ​​outputs the video acquired in S1115.

[0293] (S1117) The user reception unit 32 judges whether or not a purchase instruction has been received from the user. If a purchase instruction has been received, the process proceeds to S1118, and if not, the process returns to S1101. The purchase instruction includes, for example, an inquiry.

[0294] (S1118) The user processing unit 33 composes a purchase instruction to be transmitted. Next, the user transmitting unit 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.

[0295] (S1119) The user receiving unit 35 judges whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1120, and if information has not been received, the process returns to S1119. The information is, for example, a moving image, information indicating that the transfer of the rights holder has been completed, and a set of attribute values ​​of the moving image.

[0296] (S1120) User processing unit 33 uses the received information to compose information to be output. User output unit 36 ​​outputs the information. Return to S1101.

[0297] In the flowchart of FIG. 11, the process ends when the power is turned off or an interrupt occurs to end the process.

[0298] A specific example of the operation of the information system A in this embodiment will be described below. Two specific examples will be described below. Specific example 1 is a case where real-time video based on route identification information is output by the user terminal 3. Specific example 2 is a case where past video based on route identification information is output by the user terminal 3.

[0299] (Example 1) Assume now that a terminal management table having the structure shown in Fig. 12 is stored in the terminal management unit 111 of the information processing device 1. The terminal management table is a table that manages one or more pieces of terminal information. The terminal management table manages one or more records that have an "ID," "terminal identifier," "terminal communication information," and an "attribute value set." The "attribute value set" here includes "time" and "location information."

[0300] Then, after the mobile terminal 2, which is a drive recorder mounted on a car, receives a start instruction from user A, the position acquisition unit 231 acquires position information (x, y). Furthermore, the attribute value acquisition unit 233 acquires one or more video attribute values ​​such as time. Then, the configuration unit 234 configures information to be transmitted, which is information having the position information, one or more video attribute values, and a terminal identifier. Next, the position transmission unit 241 transmits the configured information to the information processing device 1. Furthermore, the shooting unit 232 shoots and acquires the video. Next, the configuration unit 234 configures an additional video having a video, position information, one or more video attribute values, and a terminal identifier. The configuration unit 234 accumulates the additional video in the moving storage unit 21. The mobile terminal 2 repeats the above processes.

[0301] In addition, many other mobile terminals 2 also perform the same process as the above mobile terminal 2. The many other mobile terminals 2 may be a drive recorder mounted on an automobile, a camera-equipped eyeglass-type terminal worn by a person, or a smartphone mounted on a bicycle.

[0302] Then, the location receiving unit 121 of the information processing device 1 receives location information and the like from each mobile terminal 2. Then, the location accumulating unit 131 associates the received location information and the like with the terminal identifier and adds it to the terminal management table. As a result, the terminal management table shown in FIG. 12 is constructed.

[0303] In the above situation, it is assumed that user A inputs a destination into user terminal 3, which is a navigation terminal installed in a car.

[0304] Next, the user receiving unit 32 of the user terminal 3 receives route identification information, which is the destination. Next, the user processing unit 33 acquires the current position by the GPS receiver. Next, the user processing unit 33 performs a route search using the current position and the destination, and acquires route information that identifies the route from the current position to the destination and has multiple position information. Then, as shown in FIG. 13, a map on which the route is drawn is output to the user terminal 3.

[0305] Next, the user processing unit 33 of the user terminal 3 acquires the inquiry flag stored in the user storage unit 31. Next, the user processing unit 33 detects that the "inquiry flag = ON" in the user storage unit 31, and composes an inquiry having the acquired route information and a timing flag that is "real time". Next, the user transmission unit 34 transmits the inquiry to the information processing device 1.

[0306] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry from the user terminal 3. Next, the terminal determination unit 132 acquires route information contained in the received inquiry. In addition, the terminal determination unit 132 determines that the received inquiry includes the timing flag "real time".

[0307] Next, the terminal determination unit 132 refers to the terminal management table (FIG. 12) and determines one or more mobile terminals 2 to which real-time video on the route indicated by the route information included in the query can be transmitted. That is, the terminal determination unit 132 determines, from the location information paired with the latest time of each mobile terminal 2 in the terminal management table, one or more pieces of location information that satisfy an approximation condition for any of the location information indicating a position on the route indicated by the location information group contained in the received query, and obtains the terminal identifier and terminal communication information paired with each piece of location information from the terminal management table (FIG. 12).

[0308] Next, the video acquiring unit 133 uses one or more pieces of terminal communication information to transmit a video transmission instruction to one or more mobile terminals 2. Note that the video acquiring unit 133 transmits a transmission instruction including a timing flag "real time".

[0309] Next, the movement instruction receiving unit 221 of each of the one or more mobile terminals 2 receives the transmission instruction. Next, the movement processing unit 23 of each mobile terminal 2 determines that the received transmission instruction is a transmission instruction for real-time video based on the timing flag "real-time" included in the received transmission instruction.

[0310] Next, the position acquisition unit 231 of each mobile terminal 2 acquires position information. Also, the attribute value acquisition unit 233 of each mobile terminal 2 acquires one or more video attribute values. The composition unit 234 acquires a terminal identifier from the moving storage unit 21. The composition unit 234 composes information having the position information, one or more video attribute values, and a terminal identifier. The shooting unit 232 shoots and acquires a video. Next, the composition unit 234 composes an additional video having a video, position information, one or more video attribute values, and a terminal identifier. The composition unit 234 accumulates the additional video in the moving storage unit 21. Next, the moving video transmission unit 242 transmits information having the position information, one or more video attribute values, and a terminal identifier, and a thumbnail image, which is a still image in the video, to the information processing device 1. Note that here, the moving video transmission unit 242 of each mobile terminal 2 may transmit the additional image to the information processing device 1. It is also preferable that the location transmission unit 241 of each mobile terminal 2 repeatedly transmits to the information processing device 1 location information, one or more video attribute values, and information including a terminal identifier.

[0311] Next, the receiving unit 12 of the information processing device 1 receives information including location information, one or more video attribute values, a terminal identifier, and a thumbnail image from each mobile terminal 2. Next, the processing unit 13 composes information including the location information and thumbnail image of each mobile terminal 2, to be transmitted to the user terminal 3. The transmitting unit 14 transmits the information to the user terminal 3.

[0312] Next, the user receiving unit 35 of the user terminal 3 receives information including the position information and thumbnail images of each mobile terminal 2 from the information processing device 1. The user processing unit 33 creates a map that clearly indicates the points indicated by each piece of position information. Next, the user output unit 36 ​​outputs the map. The user output unit 36 ​​also outputs one or more thumbnail images in association with the positions indicated by the position information. An example of such output is shown in FIG. 14.

[0313] Next, suppose that the user designates one location (here, a car icon) 1401 or one thumbnail image 1402 on the output screen in Fig. 14. Then, the user reception unit 32 of the user terminal 3 accepts the location designation. Next, the user transmission unit 34 transmits a transmission instruction having a timing flag "real time" to the mobile terminal 2 identified by the terminal identifier corresponding to the location designation.

[0314] Next, the mobile receiving unit 22 of the mobile terminal 2 receives the transmission instruction. Next, the mobile processing unit 23 checks whether the timing flag is "real time". Then, the shooting unit 232 acquires the video currently being shot. Next, the moving video sending unit 242 transmits the video to the information processing device 1.

[0315] Next, the receiving unit 12 of the information processing device 1 receives the moving image. Next, the moving image transmitting unit 141 transmits the moving image to the user terminal 3.

[0316] Next, the user receiving unit 35 of the user terminal 3 receives the moving image. Next, the user output unit 36 ​​outputs the moving image. An example of such output is shown in FIG. 15. The output moving image is 1501.

[0317] Moreover, the right holder processing unit 135 of the information processing device 1 performs the protection process described using the flowchart of FIG.

[0318] As described above, according to this specific example, real-time video of the route can be provided to the user based on the route identification information.

[0319] (Example 2) It is assumed that the terminal management table shown in FIG.

[0320] Then, it is assumed that user B walks while holding user terminal 3, which is a smartphone. As a result, it is assumed that route information specifying the route walked by user B is stored in user storage unit 31 of user terminal 3. It is assumed that route information is a collection of multiple pieces of position information.

[0321] Next, assume that user B inputs an inquiry including the location information group to the user terminal 3. Next, the user reception unit 32 of the user terminal 3 receives the inquiry. The user processing unit 33 acquires the user identifier from the user storage unit 31, and composes an inquiry including the user identifier, the route information, and a timing flag "past". Next, the user transmission unit 34 transmits the inquiry to the information processing device 1.

[0322] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry. Next, the terminal determining unit 132 acquires the route information included in the received inquiry.

[0323] Next, the video acquisition unit 133 performs a process of acquiring past videos based on the timing flag "past" by the process described using the flowchart in Fig. 6. That is, the video acquisition unit 133 acquires one or more videos that satisfy the route condition from the videos stored in the mobile terminal 2 managed in the terminal management table (Fig. 12) or the videos accumulated by the preservation process, in the order of the location information contained in the route information. Also, when multiple videos are acquired, the video composition unit 134 combines the acquired multiple videos in the order of the location information contained in the route information, and acquires a combined video that is a video in which the multiple videos are combined in terms of time. Next, the video transmission unit 141 transmits the combined video to the user terminal 3. Also, the right holder processing unit 135 performs preservation processing on the video.

[0324] Next, the user receiving unit 35 of the user terminal 3 receives the combined moving image. The user output unit 36 ​​outputs the moving image.

[0325] As described above, according to this specific example, past videos of the route can be provided to the user based on the route identification information.

[0326] As described above, according to this embodiment, the information processing device 1 serves as a platform for appropriately providing video of each point on the route.

[0327] Moreover, according to this embodiment, the information processing device 1 serves as a platform for appropriately providing videos of a plurality of points on a route.

[0328] Moreover, according to this embodiment, a platform can be provided that places a low load on mobile terminals that provide video at each point along a route.

[0329] Furthermore, according to this embodiment, the load on the platform for appropriately providing video at each point on the route can be reduced.

[0330] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.

[0331] Furthermore, according to this embodiment, a reward can be given to the rights holder of the video captured by the mobile terminal.

[0332] Furthermore, according to this embodiment, it is possible to provide appropriate compensation to the rights holder of the video captured by the mobile terminal.

[0333] Furthermore, according to this embodiment, the video can be preserved.

[0334] Furthermore, according to this embodiment, the rights holder of the video can be determined to be an appropriate rights holder.

[0335] The processing in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments in this specification.

[0336] (Embodiment 2) <Outline of the second embodiment>

[0337] In the first embodiment, the information processing device 1 determines the mobile terminal 2 to which a video matching the user's inquiry can be transmitted. In the present embodiment, the mobile terminal determines whether or not to transmit a video in response to a user's inquiry. <Outline of Information System A>

[0338] The conceptual diagram of an information system B in this embodiment is the same as FIG. 1 except for the reference numerals.

[0339] Fig. 16 is a block diagram of an information system B in this embodiment. Fig. 17 is a block diagram of an information processing device 4.

[0340] The information system B includes an information processing device 4 , one or more mobile terminals 5 , and one or more user terminals 3 .

[0341] The information processing device 4 is a server that provides the video transmitted from one or more mobile terminals 5 to the user terminal 3. The information processing device 4 is, for example, a so-called server, such as a cloud server or an ASP server, but the type does not matter. The information processing device 4 may be a device that constitutes a blockchain.

[0342] The mobile terminal 5 is a terminal installed in a moving object and is a terminal that captures video. The mobile terminal 5 is, for example, a smartphone, a tablet terminal, a camera with a communication function, glasses with a camera, or a smart watch with a camera.

[0343] The information processing device 4 and one or more mobile terminals 5, and the information processing device 4 and one or more user terminals 3 are generally capable of communicating with each other via a network such as the Internet.

[0344] The information processing device 4 includes a storage unit 41, a receiving unit 42, a processing unit 43, and a transmitting unit 44. The storage unit 41 includes a terminal management unit 411. The receiving unit 42 includes an inquiry receiving unit 122. The processing unit 43 includes a moving image acquisition unit 433, a moving image composition unit 134, and a right transmission holder processing unit 135. The transmitting unit 44 includes an inquiry transmitting unit 441, and a moving image transmission unit 141.

[0345] The mobile terminal 5 includes a moving storage unit 21, a moving receiving unit 52, a moving processing unit 53, a moving transmitting unit 54, and a moving output unit 25. The moving processing unit 53 includes a position acquiring unit 231, a shooting unit 232, an attribute value acquiring unit 233, a composition unit 234, and a moving determination unit 531. The moving transmitting unit 54 includes a moving video transmitting unit 542. <Details of components of information processing device 4>

[0346] Various types of information are stored in the storage unit 41. The various types of information are, for example, terminal information (to be described later), videos, and video attribute values ​​associated with the videos.

[0347] The terminal management unit 411 stores one or more pieces of terminal information. The terminal information is associated with the mobile terminal 5. The terminal information is information relating to the mobile terminal 5. The terminal information here usually includes a terminal identifier that is an identifier of the mobile terminal 5, and terminal communication information.

[0348] The receiving unit 42 receives various types of information and instructions from the mobile terminal 5 or the user terminal 3. The various types of information and instructions are, for example, inquiries, videos, and additional videos.

[0349] The processing unit 43 performs various types of processing. The various types of processing are, for example, processing performed by the moving image acquisition unit 433, the moving image composition unit 134, and the right holder processing unit 135.

[0350] The video acquisition unit 433 acquires videos captured by one or more mobile terminals 5 that satisfy the route conditions.

[0351] The video acquisition unit 433 normally receives videos from the mobile terminal 5 in response to a transmitted inquiry. For example, the video acquisition unit 433 receives videos captured by each of a plurality of mobile terminals 5. The mobile terminal 5 that transmits the videos is the mobile terminal 5 that corresponds to the location information that matches the inquiry.

[0352] The video acquisition unit 433 acquires, for example, a first video corresponding to location information that identifies a first partial route of the route identified by the route identification information, and acquires a second video corresponding to location information that identifies a second partial route other than the first partial route of the route identified by the route identification information.

[0353] The transmission unit 44 transmits various types of information or instructions to the mobile terminal 5 or the user terminal 3. The various types of information or instructions are, for example, an inquiry, a video, or a stop instruction.

[0354] The inquiry sending unit 441 sends the inquiry received by the inquiry receiving unit 122 to one or more mobile terminals 5. The mobile terminals 5 are terminals managed by the terminal management unit 411. <Details of components of mobile terminal 5>

[0355] The mobile receiver 52 receives an inquiry that includes route identification information.

[0356] The movement processing unit 53 performs various types of processing. The various types of processing are, for example, processing performed by the position acquisition unit 231, the shooting unit 232, the attribute value acquisition unit 233, the composition unit 234, and the movement determination unit 531.

[0357] The movement determination unit 531 determines whether or not the position information acquired by the position acquisition unit 231 satisfies a route condition, which is a condition that the position information corresponds to position information that identifies at least a part of a route identified by the route identification information.

[0358] If the timing flag included in the query is “real-time”, the movement determination unit 531 determines whether or not the latest location information acquired by the location acquisition unit 231 satisfies the route condition that the latest location information is information indicating the location of a point on a route identified by the route identification information.

[0359] If the timing flag included in the query is “past”, the movement determination unit 531 determines whether or not at least a portion of the route identified by one or more pieces of location information stored in the movement storage unit 21 satisfies the route condition that the route is part of the route identified by the route identification information.

[0360] The mobile transmission unit 54 transmits various types of information to the information processing device 4. The various types of information are, for example, an attribute value set, a moving image, and an additional moving image.

[0361] When the movement determination unit 531 determines that the query is met, the movement video transmission unit 542 transmits the video. Note that the video here may be an additional video. Meeting the query means satisfying the route condition.

[0362] When the timing flag included in the inquiry is “real time”, the moving moving image transmission unit 542 transmits the moving image being shot to the information processing device 4.

[0363] When the timing flag included in the inquiry is “past”, the movement video sending unit 542 sends a video paired with one or more pieces of location information that specify a part or all of the route specified by the received route specifying information to the information processing device 4. Note that such a video is a video stored in the movement storage unit 21.

[0364] The storage unit 41 and the terminal management unit 411 are preferably non-volatile recording media, but may also be realized as volatile recording media.

[0365] There is no restriction on the process by which information is stored in the storage unit 41, etc. For example, information may be stored in the storage unit 41, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 41, etc., or information inputted via an input device may be stored in the storage unit 41, etc.

[0366] The receiving unit 42 and the mobile receiving unit 52 are usually realized by wireless or wired communication means, but may be realized by means for receiving broadcasts.

[0367] The processing unit 43, the movement processing unit 53, and the movement determination unit 531 can usually be realized by a processor, a memory, etc. The processing procedure of the processing unit 43, etc. is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type is not important.

[0368] The video acquisition unit 433 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

[0369] The transmitting unit 44, the inquiry transmitting unit 441, the mobile transmitting unit 54, and the mobile video transmitting unit 542 are usually realized by wireless or wired communication means, but may be realized by broadcasting means. <Operation>

[0370] Next, an example of the operation of the information system B will be described. First, an example of the operation of the information processing device 4 will be described with reference to the flowchart of Fig. 18. In the flowchart of Fig. 18, the description of the same steps as in the flowchart of Fig. 4 will be omitted.

[0371] (S1801) The processing unit 43 assigns 1 to a counter i.

[0372] (S1802) Processing unit 43 determines whether or not the i-th mobile terminal 5 exists among the mobile terminals 5 managed by terminal management unit 411. If the i-th mobile terminal 5 exists, the process proceeds to S1803, and if not, the process proceeds to S1805.

[0373] (S1803) The processing unit 43 acquires terminal communication information of the i-th mobile terminal 5 from the terminal management unit 411. The inquiry sending unit 441 sends the received inquiry to the i-th mobile terminal 5 corresponding to the acquired terminal communication information.

[0374] (S1804) The processing unit 43 increments the counter i by 1. The process returns to S1802.

[0375] (S1805) Reception unit 42 determines whether or not location information, etc. has been received from one or more mobile terminals 5. If location information, etc. has been received, the process proceeds to S1806, and if not, the process returns to S1805.

[0376] Here, the receiving unit 42 waits, for example, until a predetermined period of time has elapsed since the inquiry was sent. The location information and the like are, for example, location information and a thumbnail image, or location information and a video. The location information and the like may have one or more video attribute values. Here, the receiving unit 42 may not be able to receive the location information and the like.

[0377] (S1806) The transmission unit 44 transmits the location information and the like of each of the one or more mobile terminals 5 received in S1805 to the user terminal 3 that sent the inquiry. Then, the process returns to S403.

[0378] In the flowchart of FIG. 18, the process ends when the power is turned off or an interrupt occurs to end the process.

[0379] Next, an example of the operation of the mobile terminal 5 will be described with reference to the flowchart of Fig. 19. In the flowchart of Fig. 19, the description of the same steps as in the flowchart of Fig. 10 will be omitted.

[0380] (S1901) The mobile receiving unit 52 determines whether or not an inquiry has been received from the information processing device 4. If an inquiry has been received, the process proceeds to S1902, and if not, the process proceeds to S1905.

[0381] (S1902) The movement determination unit 531 acquires the route identification information contained in the inquiry. The movement determination unit 531 acquires the latest location information. The movement determination unit 531 judges whether the latest location information satisfies the route condition for the route identified by the route identification information. If the route condition is satisfied, the process proceeds to S1903, and if not, the process proceeds to S1002.

[0382] The route condition here is that the latest position information is information indicating a point on the route specified by the route specification information.

[0383] (S1903) Movement processing unit 53 configures information to be transmitted. The information to be transmitted is, for example, the latest location information, one or more video attribute values, a thumbnail image, and a terminal identifier. The information to be transmitted is, for example, the latest location information, one or more video attribute values, a video, and a terminal identifier.

[0384] (S1904) The mobile transmitting unit 54 transmits the information constructed in S1903 to the information processing device 4. The process proceeds to S1010.

[0385] (S1905) The mobile receiving unit 52 determines whether or not a transmission instruction has been received from the information processing device 4. If a transmission instruction has been received, the process proceeds to S1906, and if not, the process proceeds to S1908.

[0386] (S1906) The movement processing unit 53 acquires a moving image. The movement processing unit 53 normally acquires a moving image stored in the movement storage unit 21. Here, it is preferable that the movement processing unit 53 acquires, from the moving images stored in the movement storage unit 21, a moving image corresponding to position information that identifies a route that overlaps with a route indicated by the route identification information included in the transmission instruction.

[0387] (S1907) The moving video transmission unit 542 transmits the video acquired in S1906 to the information processing device 4.

[0388] (S1908) The movement processing unit 53 judges whether or not to end the process. If the process is to be ended, the process returns to S1901. If the process is not to be ended, the process returns to S1902. The process is ended, for example, when an instruction to end a process such as the accumulation of a moving image is received.

[0389] In the flowchart of FIG. 19, the process ends when the power is turned off or an interrupt occurs to end the process.

[0390] As described above, according to this embodiment, the information processing device 4 serves as a platform for appropriately providing video of each point on the route.

[0391] Moreover, according to this embodiment, the information processing device 4 serves as a platform for appropriately providing videos of a plurality of points on a route.

[0392] Furthermore, according to this embodiment, a platform can be provided that imposes a small load when providing video at each point along a route.

[0393] Furthermore, according to this embodiment, the load on the platform for appropriately providing video at each point on the route can be reduced.

[0394] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.

[0395] Furthermore, according to this embodiment, a reward can be given to the rights holder of the video captured by the mobile terminal.

[0396] Furthermore, according to this embodiment, it is possible to provide appropriate compensation to the rights holder of the video captured by the mobile terminal.

[0397] Furthermore, according to this embodiment, the video can be preserved.

[0398] Furthermore, according to this embodiment, the rights holder of the video can be determined to be an appropriate rights holder.

[0399] Fig. 20 shows the appearance of a computer that executes the programs described in this specification to realize each device such as the information processing device 1 of the various embodiments described above. The above-mentioned embodiments can be realized by computer hardware and a computer program executed thereon. Fig. 20 is an overview of this computer system 300, and Fig. 21 is a block diagram of the system 300.

[0400] In FIG. 20, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0401] 21, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.

[0402] A program for causing computer system 300 to execute the functions of information processing device 1 and the like of the above-mentioned embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and further transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 at the time of execution. The program may be loaded directly from CD-ROM 3101 or the network.

[0403] The program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-mentioned embodiment. The program only needs to include an instruction portion that calls appropriate functions (modules) in a controlled manner to obtain a desired result. How the computer system 300 operates is well known, and a detailed description will be omitted.

[0404] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmitting step (processing that is performed only by hardware).

[0405] The program may be executed by a single computer or a plurality of computers. That is, the program may be executed by a centralized processing or a distributed processing.

[0406] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be realized physically by one medium.

[0407] In each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.

[0408] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]

[0409] As described above, the information processing device 1 according to the present invention has an effect of being able to appropriately acquire video at each point on a route, and is useful as a server that transmits video, etc.

Claims

1. An inquiry receiving unit that receives an inquiry including route identification information that identifies a route from a user terminal; an acquisition unit that acquires a first image corresponding to position information that identifies a first partial route among position information that corresponds to position information that identifies at least a part of the route identified by the route identification information, and acquires a second image corresponding to position information that identifies a second partial route beyond the first partial route among the route identified by the route identification information; a transmission unit that transmits the first image and the second image to the user terminal; a terminal management unit in which terminal information including location information for identifying a location of each of one or more mobile terminals is stored in association with each of the one or more mobile terminals; a location receiving unit that receives the location information from one or more of the mobile terminals; a terminal determination unit that determines, using the location information received by the location receiving unit, one or more of the mobile terminals that existed on at least a portion of the route identified by the route identification information; Equipped with The acquisition unit is Acquire images taken by each of the one or more mobile terminals determined by the terminal determination unit. Information processing device.

2. The image acquired by the acquisition unit is associated with a rights holder identifier that identifies a rights holder of the image, 2. The information processing apparatus according to claim 1, further comprising a right holder processing unit for performing right holder processing related to a right holder identified by a right holder identifier associated with the image.

3. The right holder processing unit:

3. An information processing apparatus according to claim 2, further comprising a third security means for storing said image in association with a right holder identifier for identifying a user of said user terminal.

4. a location acquisition unit that acquires location information for identifying a location of a mobile terminal; An image capturing unit that captures an image; a mobile receiver for receiving an inquiry including route identification information; a movement determination unit that determines whether or not the location information acquired by the location acquisition unit satisfies a route condition that corresponds to location information that identifies at least a part of a route identified by the route identification information; a mobile transmission unit that transmits the image when the movement determination unit determines that the route condition is met.

5. An information processing method for use in an information processing device including an inquiry receiving unit, a terminal management unit in which terminal information including location information that is associated with one or more mobile terminals and identifies a location of each of the mobile terminals is stored, a location receiving unit, a terminal determination unit, an acquisition unit, and a transmission unit, an inquiry receiving step in which the inquiry receiving unit receives an inquiry including route identification information for identifying a route from a user terminal; a location receiving step in which the location receiving unit receives location information from one or more of the mobile terminals; a terminal determination step in which the terminal determination unit determines, by using the received location information, one or more mobile terminals that existed on at least a part of the route specified by the route specification information; an acquisition step in which the acquisition unit acquires a first image, which is an image taken by each of the one or more mobile terminals determined by the terminal determination unit, corresponding to position information that identifies a first partial route of the route identified by the route identification information, and acquires a second image, which corresponds to position information that identifies a second partial route beyond the first partial route of the route identified by the route identification information; a transmitting step of the transmitting unit transmitting the first image and the second image to the user terminal; An information processing method comprising:

6. An information processing method implemented by a location acquisition unit, an imaging unit, a mobile receiving unit, a mobile determination unit, and a transmission unit, comprising: a location acquisition step in which the location acquisition unit acquires location information that identifies a location of the mobile terminal; A photographing step in which the photographing unit photographs an image; a mobile receiving step in which the mobile receiving unit receives an inquiry including route identification information; a movement determination step in which the movement determination unit determines whether or not the position information acquired in the position acquisition step satisfies a route condition that corresponds to position information that identifies at least a part of a route identified by the route identification information; and a transmitting step of transmitting the image by the transmitting unit when it is determined in the movement determining step that the route condition is met.

Images