Information processing apparatus, mobile terminal, information processing method, and program

Abstract

To construct a single, useful video from videos shot by two or more mobile terminals.SOLUTION: An information processing device 1 to enable construction and provision of a single, useful video from videos shot by two or more mobile terminals comprises: a video acquisition unit 133 to acquire videos shot by and transmitted from two or more mobile terminals, where each video is associated with an attribute value set including one or more pieces of environment information, which includes location information for identifying a shooting location or time information for identifying a shooting time; a video construction unit 134 that constructs a single video by temporally combining two or more videos acquired by the video acquisition unit 133 and each associated with a different piece of time information, or spatially fusing parts of two or more videos acquired by the video acquisition unit 133 and each associated with a different piece of location information; and a video transmission unit 141 that transmits the single video constructed by the video construction unit 134.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and the like that perform processing on videos captured by two or more mobile terminals.

Background Art

[0002] Conventionally, there has been an image display system that enables a user to view a visual scene outside the user's own field of view (a scene visible from a moving object other than the user). In such an image display system, a plurality of moving objects can capture and transmit a plurality of videos, and the plurality of videos can be output on a single screen (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

[0140] , FIG. 24, etc.)

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, it is only possible to simply view the videos captured by a plurality of moving objects on a single screen, and it is not possible to utilize the videos captured by two or more mobile terminals to compose and provide a useful single video.

Means for Solving the Problems

[0005] The information processing apparatus of the first invention is a video captured by two or more mobile terminals, and is a video associated with an attribute value set including one or more pieces of environmental information including position information for specifying a shooting position or time information for specifying a shooting time. The information processing apparatus includes a video acquisition unit that acquires videos transmitted from two or more mobile terminals, and a video composition unit that temporally combines two or more videos whose associated time information is different among the two or more videos acquired by the video acquisition unit, or spatially fuses a part of two or more videos whose associated position information is different among the two or more videos acquired by the video acquisition unit to constitute one video, and a video transmission unit that transmits the one video constituted by the video composition unit.

[0006] With such a configuration, it is possible to use videos captured by two or more mobile terminals to constitute and provide one useful video.

[0007] Further, the information processing apparatus of the second invention, with respect to the first invention, the video acquisition unit sequentially acquires two or more videos whose position information associated with the two or more videos satisfies a first position condition, and the video composition unit combines the two or more videos acquired by the video acquisition unit in the order of the time corresponding to the videos to constitute one video.

[0008] With such a configuration, it is possible to use videos captured by two or more mobile terminals to constitute and provide one useful video temporally combined.

[0009] Further, the information processing apparatus of the third invention, with respect to the second invention, further includes an inquiry reception unit that receives an inquiry including position information from a user terminal, and the video acquisition unit acquires two or more videos corresponding to position information that satisfies a first position condition using the position information received by the inquiry reception unit.

[0010] With such a configuration, it is possible to use videos captured by two or more mobile terminals to constitute and provide one useful video temporally combined.

[0011] Furthermore, the information processing apparatus of the fourth invention further includes an inquiry receiving unit that sequentially receives two or more pieces of position information transmitted from a target terminal. The video acquisition unit is an information processing apparatus that sequentially acquires two or more videos corresponding to the position information that satisfies the first position condition by sequentially using the two or more pieces of position information received by the inquiry receiving unit.

[0012] With such a configuration, it is possible to construct and provide a useful single video that is temporally combined using two or more videos corresponding to two or more pieces of position information transmitted from the target terminal. By doing so, for example, it is possible to monitor a target person who holds a moving target terminal.

[0013] Furthermore, the information processing apparatus of the fifth invention further includes an inquiry receiving unit that receives an inquiry including position information for specifying a destination set in the navigation terminal. The video acquisition unit is an information processing apparatus that sequentially acquires two or more videos corresponding to the position information that satisfies the first position condition using the position information received by the inquiry receiving unit.

[0014] With such a configuration, it is possible to construct and provide a useful single video that is temporally combined using two or more videos corresponding to the destination set in the navigation terminal.

[0015] Furthermore, the information processing apparatus of the sixth invention further includes an inquiry receiving unit that receives an inquiry including route information including two or more pieces of position information. The video acquisition unit is an information processing apparatus that acquires two or more videos corresponding to the position information that satisfies two or more first position conditions using the two or more pieces of position information included in the route information.

[0016] With such a configuration, it is possible to construct and provide a useful single video that is combined in the order of the route using the videos corresponding to the two or more pieces of position information included in the route information.

[0017] Further, the information processing apparatus of the seventh invention, with respect to the sixth invention, the route information has time information corresponding to each of two or more pieces of position information, and the video acquisition unit is an information processing apparatus that acquires two or more videos corresponding to the position information that satisfies a first position condition using the two or more pieces of position information and the time information included in the route information.

[0018] With such a configuration, it is possible to construct and provide a useful single video combined in the order of the route and the order of time using the videos corresponding to each of the two or more pieces of position information included in the route information.

[0019] Further, the information processing apparatus of the eighth invention, with respect to the first invention, the video acquisition unit acquires two or more videos in which the position information associated with each of the two or more videos satisfies a second position condition and the time information associated with each of the two or more videos satisfies a time condition, and the video composition unit uses part or all of the frames constituting each of the two or more videos acquired by the video acquisition unit to constitute a single frame, and connects the frames temporally to constitute a single video.

[0020] With such a configuration, it is possible to spatially fuse the videos captured by two or more mobile terminals to constitute and provide a useful single video.

[0021] Further, the information processing apparatus of the ninth invention, with respect to the eighth invention, the video is a video of a parking lot, and the video composition unit spatially connects the top frames synthesized from the frames of the videos captured by two or more mobile terminals installed in two or more moving bodies to constitute a single frame, and constitutes a single video having the single frame.

[0022] With such a configuration, it is possible to grasp the parking situation in the parking lot.

[0023] Further, the information processing apparatus of the tenth invention, with respect to any one of the first to ninth inventions, the video is associated with a rights holder identifier that identifies the rights holder of the video, and further includes a rights holder processing unit that performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier associated with the single video configured by the video composition unit.

[0024] With such a configuration, appropriate processing regarding the rights holder of the video can be performed.

[0025] Further, in the information processing apparatus of the eleventh invention, with respect to the tenth invention, the rights holder identifier associated with one video is the rights holder identifier associated with each of two or more videos that are the source of the one video, and the rights holder processing unit includes reward means for performing a reward process, which is a process of giving a reward to each rights holder identified by the rights holder identifier associated with each of two or more videos that are the source of the one video.

[0026] With such a configuration, a reward can be given to the rights holder of the video captured by the mobile terminal.

[0027] Further, in the information processing apparatus of the twelfth invention, with respect to the eleventh invention, the reward means acquires video attribute values corresponding to each of two or more videos that are the source of the video transmitted by the video transmission unit, determines the rewards for each of the two or more rights holders using the video attribute values, and is an information processing apparatus that performs a reward process, which is a process of giving a reward.

[0028] With such a configuration, an appropriate reward can be given to the rights holder of the video captured by the mobile terminal.

[0029] Further, in the information processing apparatus of the thirteenth invention, with respect to the tenth invention, the rights holder processing unit includes first preservation means for performing a first preservation process of associating and storing one video configured by the video configuration unit with a set of attribute values associated with each of two or more videos that are the source of the one video.

[0030] With such a configuration, one video composed of two or more images can be preserved.

[0031] Further, in the information processing apparatus of the fourteenth invention, with respect to the tenth invention, the rights holder processing unit includes second preservation means for performing a second preservation process of associating and storing one video configured by the video configuration unit with the rights holder identifier corresponding to each of two or more videos that are the source of the one video.

[0032] With such a configuration, the rights holder of a single video composed of two or more images can be made into an appropriate rights holder.

[0033] In addition, the information processing apparatus of the fifteenth invention further includes an inquiry receiving unit that receives, from a user terminal, an inquiry regarding environmental information related to the environment in which the mobile terminal captured a video with respect to the tenth invention. The video acquisition unit acquires two or more videos corresponding to the inquiry received by the inquiry receiving unit, and the rights holder processing unit stores a single video configured by the video configuration unit in association with a rights holder identifier that identifies the user of the user terminal, and is an information processing apparatus including a third preservation means.

[0034] With such a configuration, the rights holder of a single video composed of two or more images can be made into the rights holder who needs the video.

[0035] In addition, the information processing apparatus of the sixteenth invention, with respect to any one of the thirteenth to fifteenth inventions, is an information processing apparatus including a fourth preservation means that performs a fourth preservation process in which the rights holder processing unit stores preservation information including access information for accessing a single video in a blockchain.

[0036] With such a configuration, the management information of a video that requires preservation can be preserved.

Advantages of the Invention

[0037] According to the information processing apparatus of the present invention, it is possible to use videos captured by two or more mobile terminals, configure and provide a useful single video.

Brief Description of the Drawings

[0038]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Embodiments for Carrying Out the Invention

[0039] Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. In the embodiments, components denoted by the same reference numerals perform the same operations, and thus the description may be omitted again.

[0040] (Embodiment 1) In the present embodiment, an information processing apparatus that constitutes a single temporally combined video or a single spatially fused video using two or more videos acquired by imaging devices in two or more moving bodies will be described. Note that inquiries for selecting two or more videos are, for example, inquiries using position information specified by a user terminal, inquiries using two or more position information received from a monitored target terminal, inquiries using a destination set in a navigation terminal, and inquiries using route information.

[0041] Also, in the present embodiment, an information processing apparatus that performs rights holder processing, which is processing related to the rights holder of a single output video, will be described. The rights holder processing is, for example, the reward processing described later and various preservation processes described later.

[0042] Also, in the present embodiment, an information processing apparatus that automatically receives and stores videos that meet the preservation conditions from a mobile terminal will be described.

[0043] Also, in the present embodiment, an information processing apparatus that handles videos to which one or more tags obtained by analyzing the videos or the like are attached will be described. Note that the process of attaching tags is performed, for example, by the information processing apparatus or the mobile terminal, but it may also be performed by other devices.

[0044] Also, in the present embodiment, an information processing apparatus that performs processing for a user of a mobile terminal or a user who needs a video when a desired video exists but cannot be transmitted by the user will be described. Note that when a video cannot be transmitted, for example, it is a case where the power of the mobile terminal is OFF.

[0045] Also, in the present embodiment, an information processing apparatus that receives and utilizes movement information regarding the start of movement from a mobile terminal will be described.

[0046] Also, in the present embodiment, a mobile terminal that transmits movement information to an information processing apparatus will be described.

[0047] Also, in the present embodiment, a mobile terminal that transmits the latest set of attribute values for a captured video to an information processing apparatus at the end of movement will be described.

[0048] Furthermore, in the present embodiment, a mobile terminal that acquires one or more tags by analyzing a video or the like and associates them with the video will be described.

[0049] Note that in the present embodiment, information X being associated with information Y means that information Y can be acquired from information X, or information X can be acquired from information Y, and the method of association is not limited. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, information Y may be included in information X, and so on.

[0050] FIG. 1 is a conceptual diagram of an information system A in the present embodiment. The information system A includes an information processing apparatus 1, one or two or more mobile terminals 2, one or two or more user terminals 3, one or two or more target terminals 4, and one or two or more navigation terminals 5.

[0051] The information processing device 1 is a server that provides a user terminal 3 with a single video using videos transmitted by two or more mobile terminals 2. The information processing device 1 is, for example, a so-called server, such as a cloud server, an ASP server, etc., and its type is not limited. The information processing device 1 may also be a device that constitutes a blockchain.

[0052] Here, the video is an image captured by the mobile terminal 2. A video is usually a collection of two or more still images, but it may also be considered as a single still image. Also, the interval between the shooting times of the two or more still images included in the video is not limited. The video is, for example, a video at 60 frames per second or a video at 30 frames per second, but it may also be a collection of two or more still images captured with a time gap of a predetermined time (e.g., 1 minute) or more, or a collection of two or more still images captured when a predetermined condition is satisfied.

[0053] The mobile terminal 2 is a terminal installed on a moving body and is a terminal that captures videos. The mobile terminal 2 is, for example, a drive recorder, a smartphone, a tablet terminal, or a camera with a communication function. Also, installation usually means being fixed, but it may also be considered to include being in contact with or holding to a certain extent. Also, the mobile terminal 2 may have driving means such as an engine or moving means such as wheels.

[0054] A moving body is an object that moves. The moving body is, for example, a ground moving device, a sea moving device, an underwater moving device, an air moving device, a space moving device, or a living being.

[0055] Ground moving devices are, for example, automobiles, bicycles, rickshaws, or vehicles that move by human power such as play vehicles, trains, railway vehicles such as steam locomotives, rides in amusement parks, business vehicles in factories and other facilities, etc. There may also be ground moving devices that are not moving bodies for people to ride on, such as various robots for business or play, and playthings such as so-called radio-controlled toys. Note that automobiles are, for example, passenger cars, trucks, buses, taxis, or motorcycles.

[0056] The marine mobile devices are, for example, various ships, water bikes, surfboards, rowboats, inner tubes, rafts, etc.

[0057] The underwater mobile devices are, for example, submarines, underwater robots, diving equipment such as aqualungs, etc.

[0058] The aerial mobile devices are, for example, various airplanes, helicopters, gliders, parachutes, balloons, kites, etc.

[0059] The space mobile devices are, for example, rockets, space probes, artificial satellites, etc.

[0060] Living organisms are, for example, humans and mobile entities other than humans. Mobile entities other than humans are, for example, birds, mammals, reptiles, amphibians, fish, insects, and other various organisms.

[0061] The user terminal 3 is a terminal used by the user. The user is a person who watches videos or a person who needs videos. The user terminal 3 may have the functions of the mobile terminal 2. That is, the user terminal 3 may be the terminal of the user who provides videos. The user terminal 3 may also be the navigation terminal 5 described later.

[0062] The target terminal 4 is a terminal that transmits location information. The target terminal 4 is, for example, a terminal installed in a monitoring target. The monitoring target is, for example, a living organism or an object. The living organism is, for example, a human. The human is, for example, a child or an elderly person. The object to be monitored is, for example, an object that is not intended to be stolen, such as a car.

[0063] The mobile terminal 2, the user terminal 3, and the target terminal 4 are, for example, smartphones, tablet terminals, so-called personal computers, navigation terminals, etc., and their types are not limited.

[0064] The navigation terminal 5 is a so-called navigation terminal. The navigation terminal 5 is a terminal installed in a ground mobile device or held by a person.

[0065] The information processing apparatus 1 and each of the one or more mobile terminals 2 can normally communicate with each other via a network such as the Internet. Also, the information processing apparatus 1 and each of the one or more user terminals 3 can normally communicate with each other via a network such as the Internet. Also, the information processing apparatus 1 and each of the one or more target terminals 4 can normally communicate with each other via a network such as the Internet. Further, the information processing apparatus 1 and each of the one or more navigation terminals 5 can normally communicate with each other via a network such as the Internet.

[0066] FIG. 2 is a block diagram of the information system A in the present embodiment. FIG. 3 is a block diagram of the information processing apparatus 1.

[0067] The information processing apparatus 1 includes a storage unit 11, a reception unit 12, a processing unit 13, and a transmission unit 14. The storage unit 11 includes an aggregation storage unit 111. The reception unit 12 includes a movement information reception unit 121, an inquiry reception unit 122, and an aggregation reception unit 123. The processing unit 13 includes a movement information accumulation unit 131, an aggregation accumulation unit 132, a video acquisition unit 133, a video composition unit 134, and a rights holder processing unit 135. The rights holder processing unit 135 includes a first security means 1351, a second security means 1352, a third security means 1353, a fourth security means 1354, and a reward means 1355. The transmission unit 14 includes a video transmission unit 141, a status transmission unit 142, and a needs transmission unit 143.

[0068] The mobile terminal 2 includes a mobile storage unit 21, a mobile reception unit 22, a mobile processing unit 23, and a mobile transmission unit 24. The mobile processing unit 23 includes a photographing unit 231, a tag acquisition unit 232, and a movement information acquisition unit 233. The mobile transmission unit 24 includes a movement information transmission unit 241, a mobile video transmission unit 242, and an aggregation transmission unit 243.

[0069] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit 34, a user reception unit 35, and a user output unit 36.

[0070] Various types of information are stored in the storage unit 11 that constitutes the information processing apparatus 1. The various types of information are, for example, terminal information to be described later, an attribute value set to be described later, movement information to be described later, videos, and management information.

[0071] The management information is information used to monitor the person under surveillance. The management information has a user identifier for transmitting a video to the user terminal 3 of the person monitoring the target person and a target person identifier for identifying the target terminal 4 of the target person.

[0072] One or more pieces of terminal information are stored in the aggregate storage unit 111. The terminal information is information regarding the mobile terminal 2. The terminal information includes information on the videos currently held by the mobile terminal 2. The terminal information includes a terminal identifier and an attribute value set. The terminal information may be associated with a video. Also, the terminal identifier may be included in the attribute value set.

[0073] The terminal identifier is information for identifying the mobile terminal 2. The terminal identifier may be a rights holder identifier for identifying the rights holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the name of the mobile terminal 2, or the MAC address of the mobile terminal 2.

[0074] The rights holder is a person who has some rights regarding the video. The rights holder is, for example, the owner of the video, the copyright holder of the video, or the owner of the mobile terminal 2 that captured the video. The rights holder is the initial rights holder of the video. The rights holder is usually the holder of the mobile terminal 2, but any person who has the rights to the video captured by the mobile terminal 2 is acceptable.

[0075] The rights holder identifier is an identifier of the rights holder of the video. The rights holder identifier may be a terminal identifier. The rights holder identifier is, for example, the ID of the rights holder, the name of the rights holder, the email address of the rights holder, or the phone number of the rights holder.

[0076] The set of video attribute values is a set of one or more video attribute values. A video attribute value is an attribute value of a video. The video attribute value is, for example, environmental information. The video attribute value is, for example, a tag. The video attribute value may be, for example, a moving object attribute value described later.

[0077] Environmental information is information about the environment in which the video was taken. Environmental information is, for example, location information, time information, weather information, temperature information, and season information. Location information is information that identifies the shooting location. The shooting location is the location of the camera that shoots. Location information is, for example, (latitude, longitude), (latitude, longitude, altitude). However, the location information may be a region identifier that identifies a region on a map, an address, a road identifier that identifies a road, a lane identifier that identifies a lane of a road, etc. Time information is information that identifies the time when the video was taken. The time when the video was taken may be the time around the time when the video was taken, and accuracy is not necessarily required. Time information is, for example, time, date and time, date and time and minute, date and time and minute and second, date and year, month and day. That is, the granularity of the time indicated by the time information does not matter. Weather information is information that identifies the weather at the time when the video was taken at the location where the video was taken. Weather information is, for example, "sunny", "rainy", "snowy", "cloudy". Temperature information is information that identifies the outside air temperature at the time when the video was taken at the location where the video was taken. Temperature information is, for example, "25 degrees", "30 degrees or more". Season information is information that identifies the season at the time when the video was taken at the location where the video was taken. Season information is, for example, "spring", "summer", "early summer", "winter".

[0078] A tag is information that identifies the characteristics of a video. A tag is, for example, information that is the result of analyzing a video. A tag is, for example, information that is the result of analyzing one or more moving object attribute values. A tag is, for example, information that is the result of analyzing two or more moving object attribute values in time series.

[0079] The mobile body attribute value is an attribute value related to the mobile body. The mobile body attribute value is, for example, information related to movement that can be acquired while the mobile body is moving. The mobile body attribute value is, for example, CAN (Controller Area Network) data, information indicating the use of an airbag. The CAN data is, for example, speed, engine speed, and brake state. Tags are, for example, "accident", "traffic jam", "dangerous driving", "speed over", and the name of the object shown in the video (e.g., "person", "bear", name of a famous person).

[0080] The receiving unit 12 receives various information and instructions from the mobile terminal 2, user terminal 3, target terminal 4, or navigation terminal 5. The various information and instructions are, for example, movement information, position information, inquiries, attribute value sets, and videos.

[0081] It is preferable that the video received by the receiving unit 12 is associated with a rights identifier for identifying the rights holder of the video. The video received by the receiving unit 12 is, for example, associated with one or more video attribute values.

[0082] The video received by the receiving unit 12 is, for example, a video taken at a parking lot. However, the acquisition location of the video received by the receiving unit 12 is not limited.

[0083] The movement information receiving unit 121 receives movement information from the mobile terminal 2 at the start of the movement of the mobile terminal 2. The start time is preferably immediately after the start, but it may also be after a predetermined time (e.g., 1 minute) has elapsed since the start of the movement.

[0084] The movement information is information for specifying that the mobile terminal 2 is moving. The information for specifying movement may also be information for specifying that the movement has started. The movement here may be movement that will start in the future or movement that is in progress. The movement information is, for example, a movement start flag and a terminal identifier. The movement start flag is information indicating that the movement has started. The terminal identifier is an identifier of the mobile terminal 2 that starts the movement. Note that the terminal identifier may be the same as the rights identifier.

[0085] The inquiry receiving unit 122 receives an inquiry regarding environmental information from the user terminal 3. The inquiry regarding environmental information is an inquiry that includes environmental information as a condition. The inquiry is a request for a video captured by the mobile terminal 2. The inquiry is, for example, SQL, but its format, data structure, etc. are not limited.

[0086] The inquiry receiving unit 122 receives, for example, an inquiry including location information from the user terminal 3.

[0087] The inquiry receiving unit 122 sequentially receives, for example, each of two or more pieces of location information transmitted from the target terminal 4. The inquiry receiving unit 122 may receive each of the two or more pieces of location information from the target terminal 4, or may receive it from the user terminal 3 or the like that has received it from the target terminal 4.

[0088] The inquiry receiving unit 122 receives, for example, an inquiry including location information for specifying a destination set in the navigation terminal 5. The inquiry receiving unit 122 may receive the location information from the navigation terminal 5, for example, or may receive it from the user terminal 3 that has received it from the navigation terminal 5, or may receive it from the user terminal 3 or the like that has transmitted it to the navigation terminal 5 for destination setting.

[0089] The inquiry receiving unit 122 receives, for example, an inquiry including route information including two or more pieces of location information. The inquiry receiving unit 122 receives, for example, an inquiry including route information from the user terminal 3 or the navigation terminal 5.

[0090] The inquiry receiving unit 122 receives from the user terminal 3 an inquiry regarding environmental information about the environment in which the mobile terminal 2 captured a video.

[0091] Note that the route information included in the inquiry is, for example, information for specifying the route traveled by the user who views the video, or route information set in the navigation terminal 5 or the user terminal 3 having a navigation function. It is preferable that the route information has time information corresponding to each of the two or more pieces of location information. The time information is, for example, information for specifying the time when the user was at the location specified by the location information. Note that the distance interval between each of the two or more pieces of location information included in the route information is not limited.

[0092] The set reception unit 123 receives an attribute value set from the mobile terminal 2. It is preferable that the set reception unit 123 receives the attribute value set from the mobile terminal 2 at the end of the movement of the mobile terminal 2. Here, the attribute value set is information for specifying a video stored in the mobile terminal 2.

[0093] The processing unit 13 performs various processes. The various processes are, for example, processes performed by the movement information storage unit 131, the set storage unit 132, the video acquisition unit 133, the video composition unit 134, and the rights holder processing unit 135.

[0094] The movement information storage unit 131 stores the movement information received by the movement information reception unit 121 in association with the mobile terminal 2. Associating with the mobile terminal 2 is, for example, associating with a rights holder identifier or a terminal identifier.

[0095] The set storage unit 132 stores the attribute value set received by the set reception unit 123 in the set storage unit 111. The set storage unit 132 usually stores the attribute value set in association with the mobile terminal 2 that has transmitted the attribute value set. Associating with the mobile terminal 2 is, for example, associating with a rights holder identifier or a terminal identifier.

[0096] The video acquisition unit 133 acquires videos taken by two or more mobile terminals 2. Such videos are associated with the attribute value set. The attribute value set includes one or more pieces of environment information. It is preferable that the one or more pieces of environment information include position information for specifying the shooting position or time information for specifying the shooting time. Also, it is preferable that a rights holder identifier is associated with the video.

[0097] The video acquisition unit 133 sequentially acquires two or more videos for which the position information associated with each of the two or more videos satisfies the first position condition.

[0098] The video acquisition unit 133 acquires, for example, two or more videos corresponding to the inquiry received by the inquiry reception unit 122.

[0099] The video acquisition unit 133 acquires two or more videos corresponding to the position information that satisfies the first position condition using, for example, the position information received by the inquiry reception unit 122.

[0100] The video acquisition unit 133 sequentially acquires two or more videos corresponding to the position information that satisfies the first position condition by sequentially using each of the two or more pieces of position information received by the inquiry reception unit 122.

[0101] The video acquisition unit 133 sequentially acquires two or more videos corresponding to the position information that satisfies the first position condition using, for example, the position information received by the inquiry reception unit 122.

[0102] The video acquisition unit 133 acquires two or more videos corresponding to the position information that satisfies each of the two or more first position conditions using each of the two or more pieces of position information included in the route information.

[0103] The video acquisition unit 133 acquires two or more videos corresponding to the position information that satisfies the first position condition using each of the two or more pieces of position information and the time information included in the route information.

[0104] The video acquisition unit 133 acquires two or more videos such that the position information associated with each of the two or more videos satisfies the second position condition and the time information associated with each of the two or more videos satisfies the time condition.

[0105] The first position condition is a condition related to the position information. The first position condition is that the position information to be targeted is position information in an approximate relationship with the position specified by the position information to be targeted. The approximate relationship means being close, for example, the distance is within a threshold, the distance is less than the threshold, the movement time is within a threshold, or the movement time is less than the threshold. Note that the position information to be targeted is, for example, the position information included in the inquiry or the received position information.

[0106] The first position condition may include conditions other than the position information. The first position condition may be a condition related to the position information and the time information. The first position condition is, for example, that it is associated with the position information and the time information that satisfy the approximation condition for a set of target position information and time information. The position information and the time information that satisfy the approximation condition for a set of target position information and time information are, for example, position information indicating a position where the distance is within a threshold, the distance is less than the threshold, the travel time is within a threshold, or the travel time is less than the threshold with respect to the position specified by the target position information, and the time information where the time difference is within a threshold or less than the threshold with respect to the time specified by the target time information. The first position condition may be a condition related to the position information and the traveling direction of the moving body. The first position condition may be a condition related to the position information and the orientation (direction) of the camera.

[0107] The second position condition is position information that has an approximate relationship with the reference position or the reference area of the comparison target. The approximate relationship here is that the distance from the reference position is within a threshold, the distance from the reference position is less than the threshold, or it is a position within the reference area.

[0108] The video acquisition unit 133 acquires, for example, videos captured by two or more mobile terminals 2, videos associated with the set of attribute values and the rights holder identifier, and videos transmitted from the mobile terminal 2. It is preferable for the video acquisition unit 133 to acquire videos that satisfy the storage condition.

[0109] Note that the storage condition is a condition for storing videos. The storage condition is, for example, to match the condition specified by the inquiry. The storage condition is, for example, to match the preservation condition described later.

[0110] Note that the device in which the acquired video is stored may be the mobile terminal 2, the information processing device 1, or other devices not shown in the figure. Note that other devices are, for example, devices constituting a blockchain.

[0111] When the inquiry receiving unit 122 receives an inquiry, for example, the video acquisition unit 133 acquires one or more videos corresponding to the inquiry from the mobile terminal 2. The video acquisition unit 133 acquires, for example, one or more videos that are paired with a set of attribute values that satisfy the conditions regarding the environmental information included in the inquiry from the mobile terminal 2.

[0112] For example, the video acquisition unit 133 transmits an inquiry to one or more mobile terminals 2 and receives one or more videos corresponding to the inquiry from one or two or more mobile terminals 2. Such processing is referred to as unregistered video search processing. Unregistered video search processing is processing for acquiring a video that matches the conditions from videos that are unregistered and stored in the mobile terminal 2. Unregistered video search processing is, for example, processing for acquiring a video that matches the inquiry from videos that are unregistered and stored in the mobile terminal 2.

[0113] For example, the video acquisition unit 133 acquires a video corresponding to the inquiry from among the videos captured by one or more mobile terminals 2 corresponding to the movement information. The video acquisition unit 133 transmits an inquiry to each of one or more mobile terminals 2 corresponding to the movement information and receives a video that matches the inquiry from the mobile terminal 2. Note that the mobile terminal 2 corresponding to the movement information is a mobile terminal 2 that is in motion and can transmit videos.

[0114] When the inquiry receiving unit 122 receives an inquiry, for example, the video acquisition unit 133 determines one or more sets of attribute values that match the inquiry and acquires videos corresponding to each of the one or more sets of attribute values from the storage unit 11.

[0115] For example, the video acquisition unit 133 refers to the aggregated storage unit 111, determines one or two or more videos corresponding to the inquiry, and acquires the one or more videos from the mobile terminal 2.

[0116] With reference to the aggregate storage unit 111, the process of determining a video corresponding to an inquiry is to determine an attribute value set that matches the inquiry among one or more attribute value sets held by the aggregate storage unit 111. Such a process is referred to as a registered video search process. The registered video search process is a process of searching for a video that meets the conditions from the registered videos. The registered video search process is, for example, a process of searching for a video that matches the inquiry from the registered videos. Note that the registered videos are the videos for which the first preservation process or the second preservation process described later has been performed.

[0117] The video acquisition unit 133, for example, refers to the aggregate storage unit 111, determines a video corresponding to an inquiry, determines whether the video can be transmitted from the mobile terminal 2, and only when it can be transmitted, acquires the video from the mobile terminal 2.

[0118] The video acquisition unit 133, for example, attempts to communicate with the mobile terminal 2 and, if it can receive information from the mobile terminal 2, determines that the video can be transmitted from the mobile terminal 2. The video acquisition unit 133, for example, determines whether the movement information corresponding to the mobile terminal 2 is stored in the storage unit 11, and if it is stored, determines that the video can be transmitted from the mobile terminal 2. Note that the state in which the video can be transmitted is, for example, a state in which the power of the mobile terminal 2 or the mobile body corresponding to the mobile terminal 2 is ON (for example, a state in which the engine of a vehicle as the mobile body is ON). Also, the method by which the video acquisition unit 133 determines whether the video can be transmitted is not limited.

[0119] The video acquisition unit 133, for example, acquires from the mobile terminal 2 a video associated with an attribute value set that satisfies the preservation condition. Through such a process, the video can be automatically acquired.

[0120] The preservation condition is a condition for accumulating videos. The preservation condition is a condition regarding the attribute value set.

[0121] The preservation condition is preferably a condition related to one or more tags. The preservation condition is, for example, that the set of attribute values includes a tag indicating "accident", that the set of attribute values includes a tag indicating "traffic jam", and that the set of attribute values includes a tag indicating a specific location. The tag indicating a specific location is, for example, the name of a specific parking lot, the name of a specific place, the name of a specific scenic spot, or the name of a specific landscape.

[0122] The preservation condition is a video corresponding to a set of attribute values that satisfies a predetermined condition with respect to the set of attribute values corresponding to one or more videos stored in a predetermined device or area (for example, the storage unit 11). The predetermined condition is, for example, that the attribute values included in the set of attribute values do not exist in the set of attribute values corresponding to one or more videos stored in the predetermined device or area.

[0123] The video acquisition unit 133 may, for example, acquire a processed image obtained by processing a video captured by the mobile terminal 2. Such a processed image is, for example, an around view image. The around view image is an image displayed on an around view monitor. The around view image is an image that appears to be taken from directly above the area including the moving object.

[0124] The video composition unit 134 composes one video using two or more videos acquired by the video acquisition unit 133. Composing one video may also be to sequentially pass a part of the video that appears to the user as one video to the video transmission unit 141.

[0125] The video composition unit 134, for example, temporally combines two or more videos with different time information associated with each of the two or more videos acquired by the video acquisition unit 133 to compose one video. Temporally combining two or more videos to compose one video may also be to sequentially pass the two or more videos to the video transmission unit 141. That is, temporally combining two or more videos to compose one video only requires that the user sees it as one video as a result.

[0126] The video composition unit 134 combines, for example, each of two or more videos acquired by the video acquisition unit 133 in the order of the time corresponding to the videos to constitute one video. The video composition unit 134 acquires, for example, a part of each of two or more videos acquired by the video acquisition unit 133, and combines the parts of the respective videos in order to constitute one video. Temporally combining two or more videos usually means combining parts of videos captured by two or more mobile terminals 2 in order. Combining parts of a video in order may also mean passing the parts of the video to the video transmission unit 141 in order. Also, Combining in the order of the time corresponding to the videos means combining the videos in the order of the time indicated by the time information corresponding to the videos, or combining the videos in the order in which they are received.

[0127] The video composition unit 134 spatially fuses, for example, parts of two or more videos with different position information associated with each of two or more videos acquired by the video acquisition unit 133 to constitute one video. The video composition unit 134 constitutes one frame, for example, using some or all of the frames constituting each of two or more videos acquired by the video acquisition unit 133, and connects the frames temporally to constitute one video.

[0128] The video composition unit 134 processes, for example, each of two or more videos acquired by the video acquisition unit 133 to constitute one video. The video composition unit 134 spatially connects, for example, the top frames obtained by synthesizing the frames of the videos captured by two or more mobile terminals 2 installed in two or more moving bodies to constitute one frame, and constitutes one video having one frame.

[0129] The video composition unit 134 synthesizes, for example, two or more around-view images to constitute a wide-area around-view image.

[0130] The rights holder processing unit 135 performs rights holder processing. The rights holder processing is processing related to the rights holder identified by the rights holder identifier associated with a single video configured by the video configuration unit 134. The rights holder processing unit 135 performs, for example, processing corresponding to the transmission of a video by the video transmission unit 141, and performs rights holder processing that is processing related to the rights holder identified by the rights holder identifier associated with the video. The rights holder processing is, for example, the first preservation processing described later, the second preservation processing described later, the third preservation processing described later, the fourth preservation processing described later, and the reward processing described later. Note that the video transmitted by the video transmission unit 141 is an image configured by the video configuration unit 134.

[0131] Note that the rights holder identifier associated with a single video is, for example, the rights holder identifier associated with each of two or more videos that are the source of the configured single video, or the identifier of the user who requested the single video.

[0132] The rights holder processing unit 135, for example, accumulates the video acquired by the video acquisition unit 133 in association with the rights holder identifier. It is preferable that the rights holder processing unit 135 accumulates only the videos acquired by the video acquisition unit 133 on the condition that the accumulation conditions are satisfied. Also, it is preferable that the rights holder processing unit 135 does not accumulate videos that do not satisfy the accumulation conditions.

[0133] The rights holder processing unit 135, for example, acquires status information regarding the state when the video acquisition unit 133 determines that the mobile terminal 2 that holds the video corresponding to the inquiry is in a state where it cannot transmit the video.

[0134] The status information is information regarding the state of being unable to transmit the video. The status information is, for example, information indicating the state of the mobile terminal 2 that holds the video. The status information is, for example, "The video exists, but it is not currently in a state where it can be sent to you." "The video exists on the mobile terminal of ○○, but it is not currently in a state where it can be sent to you." The status information is, for example, information indicating that the power of the mobile terminal 2 is OFF, or information indicating that the power of the mobile terminal 2 is ON.

[0135] When the video acquisition unit 133 determines that the mobile terminal 2 holding the video corresponding to the inquiry, for example, is in a state where it cannot transmit the video, the rights holder processing unit 135 acquires needs information.

[0136] The needs information is information indicating that there is a need for the video. The needs information is, for example, "The video of your XXX is requested by other users." "The video of your XXX is requested by other users at ○○ yen."

[0137] The first preservation means 1351 performs a first preservation process of associating and storing one video configured by the video composition unit 134 with a set of attribute values corresponding to each of two or more videos that are the source of the one video. The first preservation means 1351 may perform a first preservation process of associating and storing the video received from the mobile terminal 2 with the set of attribute values associated with the video.

[0138] The second preservation means 1352 performs a second preservation process of associating and storing one video configured by the video composition unit 134 with the rights holder identifiers corresponding to each of two or more videos that are the source of the one video.

[0139] Note that the first preservation means 1351 or the second preservation means 1352 may associate and store one video configured by the video composition unit 134 with the set of attribute values corresponding to each of two or more videos that are the source of the one video, and the rights holder identifiers corresponding to each of two or more videos that are the source of the one video.

[0140] The third preservation means 1353 associates and stores one video configured by the video composition unit 134 with the rights holder identifier that identifies the user of the user terminal 3. Here, the user of the user terminal 3 is the person who views one video. Here, the user terminal 3 is, for example, the terminal that transmitted the inquiry.

[0141] Also, the destination for storing one video is, for example, the storage unit 11, but it may also be other devices, other devices constituting a blockchain, etc.

[0142] The fourth security means 1354 performs a fourth security process of storing security information including access information for accessing one stored video. The order of storing the video and the fourth security process for the security information corresponding to the video does not matter.

[0143] The fourth security means 1354 performs a fourth security process of storing, in a blockchain, security information including access information for accessing one stored video configured by the video configuration unit 134.

[0144] Note that it is preferable for the fourth security means 1354 to store security information in a blockchain. That is, it is preferable for the fourth security means 1354 to store security information in the distributed ledger of the blockchain. It is preferable for the fourth security means 1354 to register the security information as an NFT (non-fungible token). It is preferable for the fourth security means 1354 to register the security information in a distributed file system in the IPFS (Inter Planetary File System) network.

[0145] The security information is information for ensuring the originality of the video. It can be said that the security information is the title information of the video. The security information is, for example, access information and one or more video attribute values. It is preferable for the security information to have, for example, one or two or more rights holder identifiers. When the security information has two or more rights holder identifiers, the rights holders of the video may be shared, or the two or more rights holder identifiers may be rights holder history information. The rights holder history information is a set of rights holder identifiers and is information indicating the history of the rights holders. By the fourth security process, the originality of the security information of the registered video can be guaranteed. By guaranteeing the originality of the security information, the originality of the video corresponding to the security information is also guaranteed. Note that the access information is information for accessing the video. The access information is information for specifying the storage destination of the video. The access information is, for example, a URL or a URI.

[0146] It is preferable that the security information includes information indicating whether a video can be provided to a third party (which may be referred to as a flag). The flag is, for example, information indicating that a third party can view it, information indicating that it is for sale, or information indicating that neither viewing nor selling is permitted.

[0147] The reward means 1355 performs a reward process for each rights holder identified by a rights holder identifier associated with each of two or more videos that are the source of a single video configured by the video configuration unit 134.

[0148] The reward process is a process of giving a reward. The reward process is, for example, a process of increasing points managed in pairs with one or two or more rights holder identifiers associated with the video. The reward process is, for example, a process of making a payment to the rights holder identified by one or two or more rights holder identifiers associated with the video. The reward process is, for example, a process of transmitting the video or other content to the user terminal 3 of the rights holder identified by one or two or more rights holder identifiers associated with the video. The reward process only needs to give a merit to the rights holder identified by one or two or more rights holder identifiers associated with the video, and the content thereof is not limited. Also, the reward is, for example, money, points, goods, content, etc., and the content thereof is not limited.

[0149] It is preferable that the reward means 1355 acquires one or two or more video attribute values corresponding to each of two or more videos that are the source of a single video transmitted by the video transmission unit 141, determines the reward for each of the two or more rights holders using the one or more video attribute values, and performs the reward process which is a process of giving a reward.

[0150] The one or more video attribute values here are, for example, the data volume of the video, the time of the video, the number of frames of the video, and the resolution of the video.

[0151] The reward means 1355 preferably performs a reward process of obtaining a reward amount corresponding to a service identifier that identifies the service performed on the target video and giving a reward corresponding to the reward amount. Note that the service identifier is, for example, "viewing" or "purchase". In such a case, for example, in the storage unit 11, the reward amount corresponding to the service identifier or information for determining the reward amount corresponding to the service identifier is stored.

[0152] The reward means 1355 performs a reward process, which is a process of obtaining a reward amount using, for example, one or more pieces of information among one or more video attribute values and service identifiers and giving a reward corresponding to the reward amount. In such a case, for example, in the storage unit 11, an arithmetic expression or a correspondence table corresponding to two or more service identifiers is stored. The arithmetic expression is an expression for calculating a reward amount using one or more video attribute values as parameters. The correspondence table is a table having two or more pieces of correspondence information for managing the reward amounts corresponding to one or more video attribute values. The reward means 1355 usually performs a process of burdening the user who has enjoyed the service related to the target video with a reward.

[0153] The process of burdening with a reward is, for example, a process of burdening the amount of the obtained reward. The process of burdening with a reward is, for example, a process of burdening the amount of the obtained reward and the amount of profit obtained by the operation side of the information processing apparatus 1. The process of burdening with a reward is, for example, a process of reducing points corresponding to the user who has enjoyed the service, a payment process using the credit card number of the user, etc.

[0154] The transmission unit 14 transmits various types of information or instructions to the mobile terminal 2, the user terminal 3, or the navigation terminal 5. The various types of information or instructions are, for example, videos, inquiries, status information, and needs information.

[0155] The video transmission unit 141 transmits a single video configured by the video composition unit 134. The video transmission unit 141 transmits the single video to the user terminal 3. It is preferable for the video transmission unit 141 to transmit the video in response to receiving an inquiry. The video transmission unit 141 transmits the video to, for example, the user terminal 3 or the navigation terminal 5. Transmitting a single video may also be that the video transmission unit 141 sequentially transmits a part of the single video passed thereto.

[0156] The video transmission unit 141 transmits the video acquired by the video acquisition unit 133 to the user terminal 3, for example.

[0157] When it is in a state where the video cannot be transmitted, the status transmission unit 142 transmits status information regarding the status to the user terminal 3. The status transmission unit 142 transmits the status information acquired by the rights holder processing unit 135 to the user terminal 3, for example.

[0158] Whether it is in a state where the video cannot be transmitted is determined by, for example, the video acquisition unit 133.

[0159] When it is determined that it is in a state where the video cannot be transmitted, the needs transmission unit 143 transmits needs information indicating that there are needs for the video to the user corresponding to the video. The needs transmission unit 143 transmits the needs information acquired by the rights holder processing unit 135 to the user corresponding to the video, for example. Transmitting to the user corresponding to the video is, for example, sending the needs information by email to the destination of the email address paired with the rights holder identifier corresponding to the video. Transmitting to the user corresponding to the video is, for example, sending the needs information as a short message to the destination of the phone number paired with the rights holder identifier corresponding to the video. Transmitting to the user corresponding to the video is, for example, transmitting the needs information to the mobile terminal 2 paired with the rights holder identifier corresponding to the video. Note that the user corresponding to the video is usually the rights holder of the video.

[0160] Various types of information are stored in the mobile storage unit 21 that constitutes the mobile terminal 2. The various types of information are, for example, videos, sets of attribute values, rights holder identifiers, mobile information indicating the start of movement, pairs of attribute value tag conditions and tags, pairs of video tag conditions and tags, one or more security conditions, and one or more pieces of acquisition information. Usually, one or more pairs of attribute value tag conditions and tags are stored in the mobile storage unit 21. Usually, one or more pairs of video tag conditions and tags are stored in the mobile storage unit 21.

[0161] One or more still images (which may also be referred to as fields or frames) that make up a video are associated with, for example, one or more video attribute values that make up a set of attribute values. The one or more video attribute values may be associated with all of the still images, some of the still images, or two or more of the still images.

[0162] The attribute value tag condition is a condition for acquiring a tag based on one or more mobile body attribute values. The attribute value tag condition is a condition regarding one or more mobile body attribute values. The attribute value tag condition is, for example, "the emergency brake has been depressed", "the degree of deceleration of the speed (acceleration) within a unit time is below a threshold value (the emergency brake has been depressed)", "the airbag has been activated", "the time at a speed below the first speed has elapsed for more than the second time (traffic jam)", "the position information corresponds to a specific name". The tag paired with the attribute value tag condition is, for example, "abnormal driving", "accident", "traffic jam", "specific place name".

[0163] Video tag conditions are conditions related to videos. Video tag conditions are conditions based on the analysis results of videos. Video tag conditions are, for example, "having a still image in which two or more automobiles are in contact (being an accident)", "having a frame in which the distance between two or more automobiles is zero (the automobiles being in contact)", "the period during which there are automobiles of a first threshold value or more within a predetermined distance being a second threshold value or more (being congested)", "the cumulative amount per unit time of the change in the distance between the center of gravity point of the preceding vehicle and the lane being a threshold value or more (the preceding vehicle being driving in a zigzag manner)". Tags paired with video tag conditions are, for example, "accident", "congestion", "abnormal driving".

[0164] Preservation conditions are conditions for preserving videos. Preservation conditions are conditions related to the set of attribute values. Such preservation conditions are, for example, "the airbag has been activated (an accident has occurred)", "a specific tag has been attached to the video (the specific tag is, for example, "accident", "dangerous driving")". Preservation conditions are, for example, associated with the acquired information. The acquired information is information for specifying the video to be acquired. The acquired information is information for specifying the video to be acquired when the preservation conditions are satisfied. Such preservation conditions are, for example, "(1) the number of vehicles in the screen is a first threshold value or more & (2) the driving speed of the vehicle is a second threshold value or less & the duration of (1) and (2) is a third threshold value or more (congestion is continuing)".

[0165] The mobile reception unit 22 receives various types of information. The various types of information are, for example, inquiries, needs information, videos taken by other mobile terminals 2.

[0166] The mobile processing unit 23 performs various types of processing. The various types of processing are, for example, the processing performed by the imaging unit 231, the tag acquisition unit 232, and the mobile information acquisition unit 233. The mobile processing unit 23 converts the information received by the mobile reception unit 22 into a data structure for output.

[0167] The mobile processing unit 23 detects, for example, the start of movement. Detection of the start of movement is, for example, detection of the power-on of the mobile terminal 2 or detection of the engine-on of the moving body.

[0168] The movement processing unit 23 detects the end of movement, for example. The detection of the end of movement is, for example, the detection of the power-off of the mobile terminal 2 or the detection of the engine-off of the moving body.

[0169] The movement processing unit 23 determines, for example, a set of attribute values that match the inquiry received by the movement reception unit 22, and acquires from the movement storage unit 21 a video paired with the set of attribute values.

[0170] The movement processing unit 23 acquires, for example, a video from the start to the end of movement. The movement processing unit 23 acquires, for example, a video from the start to the end of movement in association with the set of attribute values acquired during the movement.

[0171] The movement processing unit 23 acquires, for example, a set of attribute values during shooting. The movement processing unit 23 accumulates the acquired set of attribute values in the movement storage unit 21. Also, the movement processing unit 23 associates, for example, the acquired set of attribute values with the video. Associating with the video usually means associating with the frames constituting the video. It is preferable that the set of attribute values and the frames are temporally synchronized.

[0172] Note that the set of attribute values is, for example, one or more pieces of environmental information. The environmental information is, for example, position information, time information, weather information, temperature information, and season information.

[0173] The movement processing unit 23 acquires, for example, position information during shooting. The movement processing unit 23 having the function of a GPS receiver acquires, for example, position information. The movement processing unit 23 acquires, for example, position information constantly, at predetermined intervals, or when the acquisition conditions are satisfied. The acquisition conditions are the conditions for acquiring information. The acquisition conditions are, for example, when it is detected that an accident has occurred, when traffic congestion is detected, or when there is a change in weather information.

[0174] The movement processing unit 23 acquires, for example, time information from a clock (not shown) during shooting. The movement processing unit 23 acquires, for example, time information constantly, at predetermined intervals, or when the acquisition conditions are satisfied.

[0175] The movement processing unit 23, for example, acquires time information from a clock (not shown) during shooting, and acquires season information corresponding to the time information.

[0176] The movement processing unit 23, for example, acquires weather information during shooting. The movement processing unit 23, for example, acquires weather information corresponding to the position information from a server (not shown). The movement processing unit 23, for example, always acquires weather information at predetermined intervals or when the acquisition conditions are satisfied.

[0177] The movement processing unit 23, for example, acquires temperature information during shooting. The movement processing unit 23, for example, acquires temperature information corresponding to the position information from a server (not shown). The movement processing unit 23, for example, acquires temperature information from a temperature sensor installed in the moving body. The movement processing unit 23, for example, always acquires temperature information at predetermined intervals or when the acquisition conditions are satisfied.

[0178] The movement processing unit 23, for example, determines whether the acquired set of attribute values matches the preservation conditions. The movement processing unit 23, for example, determines whether the acquired time-series set of attribute values matches the preservation conditions. The movement processing unit 23, for example, acquires the video corresponding to the set of attribute values when the preservation conditions are met. The movement processing unit 23, for example, acquires the video corresponding to the preservation conditions when the preservation conditions are met. The movement processing unit 23, for example, acquires the acquisition information paired with the preservation conditions when the preservation conditions are met, and acquires the video according to the acquisition information.

[0179] The movement processing unit 23 preferably includes a microphone, acquires sound information, and accumulates the sound information in association with the video acquired by the shooting unit 231. Note that such a function is, for example, the function of a drive recorder.

[0180] The shooting unit 231 shoots a video. The shooting unit 231, for example, starts shooting after detecting the start of movement. Also, the shooting unit 231 preferably continues shooting until detecting the end of movement.

[0181] The photographing unit 231 preferably stores the photographed video in the mobile storage unit 21. When the photographing unit 231 stores a video in the mobile storage unit 21 with a limited storage capacity, it is preferable to overwrite the old video with the new video in the area where the old video is stored. That is, the structure of the mobile storage unit 21 is preferably a ring buffer structure.

[0182] The tag acquisition unit 232 acquires one or more tags for the video photographed by the photographing unit 231 and associates them with the video.

[0183] The tag acquisition unit 232 analyzes, for example, the video photographed by the photographing unit 231 and acquires one or more tags for the video.

[0184] The tag acquisition unit 232 acquires one or more tags, for example, using one or more moving body attribute values acquired during the photographing by the photographing unit 231. The moving body attribute value is, for example, CAN data.

[0185] The tag acquisition unit 232 determines, for example, one or more still images that match the video tag condition, and acquires the tag paired with the video tag condition. Further, the tag acquisition unit 232 may associate the tag with the one or more still images. Note that the still image is a frame constituting the video.

[0186] For example, when the video tag condition is "the number of automobiles within a threshold distance before and after is equal to or greater than the threshold, and the moving speed of the automobiles is equal to or less than the threshold", and the tag corresponding to the video tag condition is "traffic jam", the tag acquisition unit 232 analyzes the frames included in the video, recognizes two or more automobiles, and acquires the distances between the two or more automobiles. Also, the tag acquisition unit 232 acquires the number of automobiles with a distance within the threshold between them. Further, the tag acquisition unit 232 acquires the moving distance of one automobile in two or more frames and the frame rate, and acquires the speed of the automobile. Then, the tag acquisition unit 232 determines whether the video tag condition is met using the number of automobiles with a distance within the threshold and the speed of the automobiles. When the video tag condition is met, the tag acquisition unit 232 acquires the tag "traffic jam" corresponding to the video tag condition. Also, the tag acquisition unit 232 may associate the tag "traffic jam" with the analyzed frames of the video analyzed for the tag.

[0187] The tag acquisition unit 232 determines, for example, one or more moving body attribute values that meet the attribute value tag condition, and acquires the tag corresponding to the attribute value tag condition. Also, the tag acquisition unit 232 may associate the tag with the video corresponding to the one or more moving body attribute values.

[0188] For example, when the attribute value tag condition is "the running time with a speed less than 30 km is equal to or greater than 10 minutes, and the ratio of the speed less than 30% during the running time is equal to or greater than 80%", and the tag corresponding to the attribute value tag condition is "traffic jam", the tag acquisition unit 232 uses the speed history of the CAN data associated with each field included in the video to detect the CAN data that meets the attribute value tag condition, acquires the tag "traffic jam" corresponding to the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field included in the video is CAN acquired at the same timing as the timing when the field was photographed.

[0189] The movement information acquisition unit 233 detects the movement of the mobile terminal 2 and acquires movement information, for example, at the start of the movement. The movement information acquisition unit 233 acquires, for example, the movement information that is the identifier of the rights holder in the movement storage unit 21. The movement information acquisition unit 233 acquires, for example, the movement information in the movement storage unit 21. Note that the movement information is, for example, an identifier of the rights holder and information indicating "the start of movement".

[0190] The movement transmission unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, movement information, video, and a set of attribute values.

[0191] The movement information transmission unit 241 usually transmits, at the start of the movement, movement information that identifies that the mobile terminal 2 is moving to the information processing device 1. The movement information transmission unit 241 transmits the movement information acquired by the movement information acquisition unit 233 to the information processing device 1.

[0192] The movement video transmission unit 242 transmits the video captured by the imaging unit 231 to the information processing device 1. The timing at which the movement video transmission unit 242 transmits the video is not limited. The movement video transmission unit 242, for example, acquires a video that pairs with a set of attribute values that match an inquiry received by the movement processing unit 23 and then transmits the video to the information processing device 1. The movement video transmission unit 242, for example, when detecting the end of the movement, transmits the video accumulated after the detection of the start of the movement to the information processing device 1. The movement video transmission unit 242, for example, when it is determined that the security conditions are met, transmits the video corresponding to the determination to the information processing device 1.

[0193] Note that it is preferable that the movement transmission unit 24 does not transmit the audio information acquired by the movement processing unit 23 even if it transmits the video captured by the imaging unit 231 to the information processing device 1. The audio information may be, for example, the voice information of the driver or passengers in the moving body, and transmitting such audio information to the information processing device 1 and providing it to the user terminal 3 or the like may threaten the privacy of the driver or passengers and is not appropriate.

[0194] The set transmission unit 243 transmits the set of attribute values in the mobile storage unit 21 to the information processing apparatus 1. The set transmission unit 243 transmits the set of attribute values in the mobile storage unit 21 to the information processing apparatus 1, for example, at the end of the movement of the mobile terminal 2. Note that the set transmission unit 243 may immediately transmit the set of attribute values to the information processing apparatus 1 as long as it acquires the set of attribute values. That is, the timing at which the set transmission unit 243 transmits the set of attribute values is not limited.

[0195] Various types of information are stored in the user storage unit 31 that constitutes the user terminal 3. The various types of information are, for example, user identifiers and videos.

[0196] The user reception unit 32 receives various instructions and information. The various instructions and information are, for example, inquiries and purchase instructions.

[0197] Note that the purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction usually includes information for specifying a video. The purchase instruction has, for example, a video identifier. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, the purchase amount. The purchase conditions include, for example, information for specifying the right period.

[0198] The input means for various instructions and information may be anything, such as a touch panel, a keyboard, a mouse, or a menu screen.

[0199] The user processing unit 33 performs various processes. The various processes are, for example, processes for creating a data structure for transmitting various instructions and information received by the user reception unit 32. The various processes are, for example, processes for creating a structure for transmitting information received by the user reception unit 35.

[0200] The user transmission unit 34 transmits various instructions and information to the information processing apparatus 1. The various instructions and information are, for example, inquiries, purchase instructions, position information received from the target terminal 4, and route information received from the navigation terminal 5.

[0201] The user receiving unit 35 receives various types of information and instructions. The various types of information and instructions are, for example, inquiries, videos, and status information.

[0202] The user output unit 36 outputs various types of information. The various types of information are, for example, videos and status information.

[0203] Here, output includes concepts such as display on a display, projection using a projector, printing by a printer, sound output, transmission to an external device, storage in a recording medium, and delivery of processing results to other processing devices or other programs.

[0204] The target terminal 4 acquires and transmits position information that identifies the position of the target terminal 4. The target terminal 4 transmits the position information to, for example, the information processing device 1 or the user terminal 3. It is preferable for the target terminal 4 to transmit the position information in pair with a target person identifier. The target person identifier is information that identifies the surveillance target. The target person identifier is, for example, an ID, name, telephone number, email address, or MAC address of the target terminal 4. The target terminal 4 acquires the position information by, for example, a GPS receiver, but the method of acquiring the position information is not limited.

[0205] The navigation terminal 5 has the functions of a known navigation terminal. The navigation terminal 5 receives an input of a destination, acquires the current position, and acquires route information from the current position to the destination. The navigation terminal 5 transmits, for example, the received destination. The navigation terminal 5 transmits, for example, the acquired route information. The destination or the destination of the route information is transmitted to, for example, the information processing device 1 or the user terminal 3. The navigation terminal 5 may receive the destination from the user terminal 3 and acquire the route information from the current position to the destination.

[0206] The storage unit 11, the collective storage unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but can also be realized with volatile recording media.

[0207] The process of storing information in the storage unit 11 or the like is not limited. For example, information may be stored in the storage unit 11 or the like via a recording medium, or information transmitted via a communication line or the like may be stored in the storage unit 11 or the like, or information input via an input device may be stored in the storage unit 11 or the like.

[0208] The receiving unit 12, the movement information receiving unit 121, the inquiry receiving unit 122, the aggregation receiving unit 123, the movement receiving unit 22, and the user receiving unit 35 are usually realized by wireless or wired communication means, but may also be realized by means of receiving broadcasts.

[0209] The processing unit 13, the movement information storage unit 131, the aggregation storage unit 132, the video acquisition unit 133, the video composition unit 134, the rights holder processing unit 135, the first security means 1351, the second security means 1352, the third security means 1353, the fourth security means 1354, the reward means 1355, the movement processing unit 23, the tag acquisition unit 232, the movement information acquisition unit 233, and the user processing unit 33 can usually be realized from a processor, a memory, etc.

[0210] The processing procedures of the processing unit 13 etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may also be realized by hardware (a dedicated circuit). Note that the processor is a CPU, an MPU, a GPU, etc., and its type is not limited.

[0211] Note that the video acquisition unit 133 and the rights holder processing unit 135 may also be realized by wireless or wired communication means.

[0212] The transmission unit 14, the video transmission unit 141, the status transmission unit 142, the needs transmission unit 143, the movement transmission unit 24, the movement information transmission unit 241, the movement video transmission unit 242, the aggregation transmission unit 243, and the user transmission unit 34 are usually realized by wireless or wired communication means, but may also be realized by broadcast means.

[0213] The imaging unit 231 is implemented by a camera. Note that the camera may be, for example, a CCD camera, a CMOS camera, a 3D camera, LiDAR, or an omnidirectional camera, regardless of its type.

[0214] The user reception unit 32 can be implemented by a device driver of an input means such as a touch panel or a keyboard, or control software of a menu screen, etc.

[0215] The user output unit 36 may or may not be considered to include output devices such as a display and a speaker. The user output unit 36 can be implemented by driver software of the output device or driver software of the output device and the output device, etc.

[0216] Next, an operation example of the information system A will be described. First, an operation example of the information processing apparatus 1 will be described using the flowchart of FIG. 4.

[0217] (Step S401) The movement information reception unit 121 determines whether it has received movement information associated with the rights holder identifier from the mobile terminal 2. If it has received the movement information, it proceeds to step S402, and if it has not received it, it proceeds to step S403.

[0218] (Step S402) The movement information reception unit 121 stores the movement information received in step S401 in the storage unit 11 in association with the rights holder identifier. It returns to step S401. Note that when the movement information is the rights holder identifier, the movement information reception unit 121 stores the rights holder identifier.

[0219] (Step S403) The set reception unit 123 determines whether it has received an attribute value set associated with the rights holder identifier from the mobile terminal 2. If it has received the attribute value set, it proceeds to step S404, and if it has not received it, it proceeds to step S406.

[0220] (Step S404) The set storage unit 132 stores the attribute value set received in step S403 in the set storage unit 111 in association with the rights holder identifier.

[0221] (Step S405) The processing unit 13 deletes the movement information associated with the rights holder identifier from the storage unit 11. Return to step S401. Note that deleting the movement information is equivalent to "rewriting the movement information to information indicating that the video cannot be transmitted."

[0222] (Step S406) The receiving unit 12 determines whether it has received a video or the like associated with the rights holder identifier from the mobile terminal 2. If it has received a video or the like, it proceeds to step S407; if not, it proceeds to step S410.

[0223] (Step S407) The processing unit 13 performs a process of obtaining a set of attribute values corresponding to the video received in step S406. An example of such a process of obtaining a set of attribute values will be described using the flowchart of FIG. 5. Also, the process of obtaining a set of attribute values here may be a process of obtaining a set of attribute values associated with the received video.

[0224] (Step S408) The first preservation means 1351 accumulates the video received in step S406 in association with the set of attribute values obtained in step S407. Note that the first preservation means 1351 accumulates the video in the storage unit 11, for example, but it may also be accumulated in another device such as a device constituting a blockchain. Also, the process of the first preservation means 1351 accumulating the video is the first preservation process.

[0225] (Step S409) The fourth preservation means 1354 performs a fourth preservation process. Return to step S401. An example of the fourth preservation process will be described using the flowchart of FIG. 8.

[0226] (Step S410) The inquiry receiving unit 122 determines whether it has received an inquiry. If it has received an inquiry, it proceeds to step S411; if not, it proceeds to step S414. Note that the inquiry receiving unit 122 usually receives an inquiry from the user terminal 3 or the navigation terminal 5. Note that the navigation terminal 5 that transmits the inquiry may also be the user terminal 3.

[0227] (Step S411) The video acquisition unit 133 determines whether the received query is a real-time video search. If it is a real-time video search, it proceeds to step S412; if it is not a real-time video search, it proceeds to step S415. Such determination is possible by examining the received query. Real-time video search refers to the process in which the mobile terminal 2 searches for videos currently held and videos being shot.

[0228] (Step S412) The video acquisition unit 133 determines whether the received query requires spatial fusion of two or more videos. If spatial fusion is required, it proceeds to step S413; if spatial fusion is not required, it proceeds to step S414. Such determination is possible by examining the received query.

[0229] (Step S413) The video acquisition unit 133, the video composition unit 134, etc. perform video fusion processing. It proceeds to step S418. Video fusion processing refers to the process of spatially fusing two or more videos to obtain and transmit an image having one or more frames. An example of video fusion processing will be described using the flowchart of FIG. 9.

[0230] (Step S414) The video acquisition unit 133, the video composition unit 134, etc. perform video concatenation processing. It proceeds to step S418. Video concatenation processing refers to the process of transmitting one video in which two or more videos are temporally concatenated. An example of video concatenation processing will be described using the flowchart of FIG. 11.

[0231] (Step S415) The video acquisition unit 133, etc. perform registered video search processing. An example of registered video search processing will be described using the flowchart of FIG. 12. Note that here, the video acquisition unit 133 may not be able to acquire a video.

[0232] (Step S416) The video acquisition unit 133 determines whether it was able to acquire a video in step S415. If it was able to acquire the video, it proceeds to step S417, and if it was unable to acquire the video, it proceeds to step S418.

[0233] (Step S417) The video acquisition unit 133 performs an unregistered video search process. An example of the unregistered video search process will be described using the flowcharts of FIGS. 13 and 14. Note that here, the video acquisition unit 133 may also be unable to acquire a video.

[0234] (Step S418) The rights holder processing unit 135 performs a preservation process. It returns to step S401. An example of the preservation process will be described using the flowchart of FIG. 15.

[0235] (Step S419) The reception unit 12 determines whether it has received a purchase instruction from the user terminal 3. If it has received the purchase instruction, it proceeds to step S420, and if it has not received it, it returns to step S401.

[0236] (Step S420) The video acquisition unit 133 acquires the video corresponding to the purchase instruction. Note that the video acquisition unit 133, for example, receives the video corresponding to the purchase instruction from the mobile terminal 2. Also, the video acquisition unit 133, for example, acquires the video corresponding to the purchase instruction from the registered videos. The video acquisition unit 133 may, for example, also acquire the video corresponding to the purchase instruction from the unregistered videos.

[0237] (Step S421) The fourth preservation means 1354 acquires the user identifier corresponding to the user terminal 3 that sent the purchase instruction. Note that this user identifier becomes the rights holder identifier for the purchased video.

[0238] (Step S422) The fourth preservation means 1354 performs a fourth preservation process using the user identifier acquired in step S416. An example of the fourth preservation process will be described using the flowchart of FIG. 8.

[0239] (Step S423) The reward means 1355 performs a reward process for the original rights holder of the purchased video. Return to step S401. An example of the reward process will be described using the flowchart of FIG. 16.

[0240] Note that in the flowchart of FIG. 4, the process ends due to a power-off or a process end interrupt.

[0241] Also, in the flowchart of FIG. 4, it is preferable that the receiving unit 12 receives and temporarily stores the position information for identifying the current position of the mobile terminal 2 from each of two or more mobile terminals 2 in pairs with the identifier of the mobile terminal 2 (for example, the rights holder identifier). The frequency or time interval at which the receiving unit 12 receives and temporarily stores the position information is not limited. The receiving unit 12, for example, continuously receives and temporarily stores the position information. The receiving unit 12, for example, periodically receives and temporarily stores the position information.

[0242] Also, in the flowchart of FIG. 4, the receiving unit 12 may receive the position information continuously, for example, from the user terminal 3, the target terminal 4, or the navigation terminal 5. In such a case, the information processing apparatus 1 may receive the video acquired by the mobile terminal 2 using the received position information and transmit it to the user terminal 3 or the navigation terminal 5. Note that the frequency or time interval for continuously receiving the position information is not limited.

[0243] Next, an example of the attribute value set acquisition process in step S407 will be described using the flowchart of FIG. 5.

[0244] (Step S501) The movement processing unit 23 or the set storage unit 132 (hereinafter referred to as the movement processing unit 23, etc.) acquires one or more pieces of environmental information, etc. associated with the target video. Note that the target video is the video for which the video attribute value is to be acquired, and is, for example, the received video, the captured video, or the video being captured. Also, the environmental information, etc. may be only environmental information, or may be environmental information and one or more moving body attribute values.

[0245] (Step S502) The movement processing unit 23 etc. acquires the rights holder identifier associated with the received video.

[0246] (Step S503) The movement processing unit 23 etc. determines whether to perform annotation processing on the video. If annotation processing is to be performed, it proceeds to step S504; if not, it proceeds to step S511. It is assumed that whether to perform annotation processing is determined in advance. Also, it is preferable to perform annotation on the video either by the information processing apparatus 1 or the mobile terminal 2.

[0247] (Step S504) The movement processing unit 23 etc. substitutes 1 into the counter i.

[0248] (Step S505) The movement processing unit 23 etc. determines whether the unit of the i-th annotation exists in the video. If the unit of the i-th annotation exists, it proceeds to step S506; if not, it proceeds to step S511. Note that the unit of annotation is the object for acquiring the annotation, and for example, it is 1 frame, a group of a certain number of frames, or a video of a certain time (for example, 5 seconds, 10 seconds).

[0249] (Step S506) The movement processing unit 23 etc. determines whether to use the moving body attribute value during annotation. If the moving body attribute value is to be used, it proceeds to step S507; if not, it proceeds to step S508. It is assumed that whether to use the moving body attribute value during annotation is determined in advance.

[0250] (Step S507) The movement processing unit 23 etc. performs moving body attribute value tag acquisition processing. An example of the moving body attribute value tag acquisition processing will be described using the flowchart of FIG. 6.

[0251] (Step S508) The movement processing unit 23 etc. determines whether or not to use a moving image when annotating. If a moving image is to be used, the process proceeds to step S509, and if not, the process proceeds to step S510. It is assumed that whether or not a moving image is to be used when annotating is determined in advance.

[0252] (Step S509) The movement processing unit 23 etc. performs a moving image tag acquisition process. An example of the moving image tag acquisition process will be described with reference to the flowchart of FIG.

[0253] (Step S510) The movement processing unit 23 and the like increment the counter i by 1. The process returns to step S505.

[0254] (Step S511) The movement processing unit 23 etc. constructs an attribute value set having one or more pieces of environment information, one or more tags, and a rights holder identifier, and returns to the upper level processing.

[0255] In the flowchart of FIG. 5, the moving image may be divided into two or more inspection units, and the processes from step S501 to step S511 may be performed for each inspection unit.

[0256] Next, an example of the moving object attribute value tag acquisition process in step S507 will be described with reference to the flowchart in FIG.

[0257] (Step S601) The movement processing unit 23 and the like assign 1 to a counter i.

[0258] (Step S602) The movement processing unit 23 etc. determines whether or not the i-th attribute value tag condition exists. If the i-th attribute value tag condition exists, the process proceeds to step S603, and if not, the process returns to the upper process.

[0259] (Step S603) The movement processing unit 23 etc. acquires the i-th attribute value tag condition.

[0260] (Step S604) The movement processing unit 23 etc. acquire one or more moving body attribute values to be used for determination of the i-th attribute value tag condition.

[0261] (Step S605) The movement processing unit 23 etc. determine whether or not one or more moving body attribute values acquired in Step S604 satisfy the i-th attribute value tag condition. If the attribute value tag condition is satisfied, proceed to Step S606; if not, proceed to Step S607.

[0262] (Step S606) The movement processing unit 23 etc. acquire the tag paired with the i-th attribute value tag condition, and associate the tag with the corresponding video. Associating a tag with a video usually means associating the tag with the field constituting the video.

[0263] (Step S607) The movement processing unit 23 etc. increment the counter i by 1. Return to Step S602.

[0264] Next, an example of the video tag acquisition process in Step S509 will be described using the flowchart in FIG. 7.

[0265] (Step S701) The movement processing unit 23 etc. assign 1 to the counter i.

[0266] (Step S702) The movement processing unit 23 etc. determine whether or not the i-th video tag condition exists. If the i-th video tag condition exists, proceed to Step S703; if not, return to the upper-level process.

[0267] (Step S703) The movement processing unit 23 etc. acquire the i-th video tag condition.

[0268] (Step S704) The movement processing unit 23 etc. acquire one or more video attribute values to be used for determination of the i-th video tag condition.

[0269] (Step S705) The movement processing unit 23 etc. determines whether or not one or more moving body attribute values acquired in Step S704 satisfy the i-th attribute value tag condition. If the attribute value tag condition is satisfied, it proceeds to Step S706, and if not, it proceeds to Step S707.

[0270] (Step S706) The movement processing unit 23 etc. acquires the tag paired with the i-th attribute value tag condition, and associates the tag with the corresponding video. Associating a tag with a video usually

[0271] (Step S707) The movement processing unit 23 etc. increments the counter i by 1. It returns to Step S702.

[0272] Next, an example of the fourth preservation process in Step S409 will be described using the flowchart of FIG. 8.

[0273] (Step S801) The fourth preservation means 1354 acquires access information for specifying the storage destination of the video. Note that such a video is, for example, a fused video or a combined video.

[0274] (Step S802) The fourth preservation means 1354 acquires the set of attribute values corresponding to the stored video. If the stored video is composed of videos from two or more sources, the set of attribute values corresponding to the video is the set of attribute values of each of the two or more source videos.

[0275] (Step S803) The fourth preservation means 1354 constructs preservation information having the access information acquired in Step S801, the set of attribute values acquired in Step S802, and the identifier of the rights holder of the video. Note that if a new rights holder identifier has been acquired, the fourth preservation means 1354 constructs, for example, preservation information including the new rights holder identifier and the original rights holder identifier. (Step S804) The fourth preservation means 1354 stores the preservation information constructed in Step S803. It returns to the upper-level process.

[0276] In step S804, if the preservation information of the video corresponding to the preservation information to be accumulated is already accumulated, overwrite the preservation information with the preservation information configured in step S803. By doing so, for example, the transition of the video rights holder can be managed. Further, the fourth preservation means 1354 accumulates the preservation information in, for example, a blockchain.

[0277] Next, an example of the video fusion process in step S413 will be described using the flowchart of FIG. 9.

[0278] (Step S901) The video acquisition unit 133 acquires reference position information. The reference position information is, for example, the position information included in the received inquiry. The reference position information is, for example, the position information of the user terminal 3 or the target terminal 4. The reference position information is, for example, one of the position information in the route information included in the inquiry. The one position information is the first position information in the route information. The position information is, for example, (latitude, longitude), but may also be a place name (for example, the name of a parking lot), a geographical name, etc.

[0279] (Step S902) The video acquisition unit 133 substitutes 1 for the counter i.

[0280] (Step S903) The video acquisition unit 133 determines whether the i-th mobile terminal 2 capable of transmitting a video exists. If the i-th mobile terminal 2 exists, it proceeds to step S904, and if it does not exist, it proceeds to step S908. Note that the mobile terminal 2 capable of transmitting a video is usually the mobile terminal 2 in motion.

[0281] The mobile terminal 2 in motion is the mobile terminal 2 corresponding to the movement information stored in the storage unit 11. That is, the video acquisition unit 133 refers to, for example, the storage unit 11 and determines whether the i-th movement information exists.

[0282] (Step S904) The video acquisition unit 133 acquires the latest position information transmitted by the i-th mobile terminal 2.

[0283] (Step S905) The video acquisition unit 133 determines whether the position information acquired in step S904 satisfies the second position condition with respect to the reference position information. If it satisfies the second position condition, it proceeds to step S906; if it does not satisfy the second position condition, it proceeds to step S907.

[0284] (Step S906) The video acquisition unit 133 acquires an image from the i-th mobile terminal 2, and temporarily stores the image in a buffer (not shown) in a pair with the rights holder identifier and position information of the i-th mobile terminal 2.

[0285] Note that the video acquisition unit 133, for example, sends an inquiry including a type identifier (e.g., "video", "still image", "around view image") specifying the type of image to be requested to the i-th mobile terminal 2, and receives the image corresponding to the inquiry from the i-th mobile terminal 2.

[0286] (Step S907) The video acquisition unit 133 increments the counter i by 1. It returns to step S903.

[0287] (Step S908) The video composition unit 134 calculates the difference (distance) between each image temporarily stored in a buffer (not shown) and the reference position information. The video composition unit 134 sorts the images in ascending order using the difference as a key.

[0288] (Step S909) The video composition unit 134 acquires a reference image. The reference image is an image corresponding to the reference position information. The reference image is, for example, an image transmitted from the user terminal 3 existing at the position of the reference position information. Note that such an image is an image of the type identified by a type identifier specifying the type of image to be requested.

[0289] (Step S910) The video composition unit 134 substitutes 1 for the counter j.

[0290] (Step S911) The video composition unit 134 determines whether the j-th other image exists. If the j-th other image exists, it proceeds to step S912; if not, it proceeds to step S914. Note that the other images are the images sorted in step S908.

[0291] (Step S912) The video composition unit 134 performs image fusion processing. An example of the image fusion processing will be described using the flowchart of FIG. 10.

[0292] (Step S913) The video composition unit 134 increments the counter j by 1 and returns to step S911.

[0293] (Step S914) The video composition unit 134 constructs an image that indicates the position shown by the reference position information on the fusion image finally constructed in step S912, and temporarily stores it in a buffer (not shown). Note that such an image is a fusion image.

[0294] (Step S915) The video transmission unit 141 transmits the fusion image constructed in step S914. Note that the video transmission unit 141 may transmit the fusion image finally constructed in step S912. The transmission destination of the fusion image is usually the user terminal 3 that sent the inquiry.

[0295] (Step S916) The video transmission unit 141 determines whether to end the transmission of the fusion image. If it is to end the transmission of the fusion image, it proceeds to step S917; if not, it returns to step S901.

[0296] Note that when the video transmission unit 141 receives an end instruction from the user terminal 3 that sent the inquiry, it determines to end the transmission of the fusion image.

[0297] (Step S917) The video composition unit 134 temporally combines the transmitted one or more fusion images to construct a fusion video, and temporarily stores it in a buffer (not shown). It returns to the upper-level processing.

[0298] Next, an example of the image fusion process in step S912 will be described using the flowchart of FIG. 10.

[0299] (Step S1001) The video composition unit 134 acquires a base image. Note that the first base image is the reference image acquired in step S909. Also, the base image is the base image updated in step S1005 in the previous loop from step S911 to step S913.

[0300] (Step S1002) The video composition unit 134 acquires region information for specifying the region covered by the base image acquired in step S1001. Note that the region information is, for example, a set of position information of vertices constituting a polygon, or a set of two position information on diagonals constituting a rectangle.

[0301] (Step S1003) The video composition unit 134 acquires the j-th other image in step S911.

[0302] (Step S1004) The video composition unit 134 acquires region information for specifying the region covered by the other image acquired in step S1003.

[0303] (Step S1005) The video composition unit 134 uses the region information of the base image and the region information of the other image to determine the region where the other image is to be placed with respect to the base image, places the other image in the region, and acquires the updated base image. Return to the upper-level process.

[0304] Next, an example of the video combining process in step S414 will be described using the flowchart of FIG. 11.

[0305] (Step S1101) The video acquisition unit 133 acquires target position information. Note that the target position information is usually the position information included in the query. The target position information is, for example, information for specifying a position close to the position indicated by the position information corresponding to the video to be acquired.

[0306] (Step S1102) The video acquisition unit 133 assigns 1 to the counter i.

[0307] (Step S1103) The video acquisition unit 133 determines whether the i-th mobile terminal 2 capable of transmitting a video exists. If the i-th mobile terminal 2 exists, it proceeds to step S1104; if not, it proceeds to step S1114. Note that the mobile terminal 2 capable of transmitting a video is usually the mobile terminal 2 in motion. The mobile terminal 2 in motion is the mobile terminal 2 corresponding to the movement information stored in the storage unit 11.

[0308] The mobile terminal 2 in motion is the mobile terminal 2 corresponding to the movement information stored in the storage unit 11. That is, the video acquisition unit 133 refers to the storage unit 11, for example, to determine whether the i-th movement information exists.

[0309] (Step S1104) The video acquisition unit 133 acquires the latest position information transmitted by the i-th mobile terminal 2.

[0310] (Step S1105) The video acquisition unit 133 determines whether the position information of the i-th mobile terminal 2 satisfies the first position condition with respect to the target position information. If it satisfies the first position condition, it proceeds to step S1106; if not, it proceeds to step S1110.

[0311] (Step S1106) The video acquisition unit 133 acquires a video from the i-th mobile terminal 2 and temporarily stores the video in a buffer (not shown) in a pair with the rights holder identifier and position information of the i-th mobile terminal 2.

[0312] Note that the video acquisition unit 133 may transmit, for example, an inquiry including a type identifier (e.g., "video", "still image") for specifying the type of image to be requested to the i-th mobile terminal 2, and receive an image corresponding to the inquiry from the i-th mobile terminal 2.

[0313] (Step S1107) The video transmission unit 141 transmits the video acquired in step S1106. The video transmission unit 141 usually transmits the video to the user terminal 3 that has sent the inquiry.

[0314] (Step S1108) The video acquisition unit 133 acquires the target position information. Note that, for example, when the target terminal 4 that transmits the position information is moving, the target position information acquired here is different from the position information acquired in step S1101. However, when the target terminal 4 does not move, when an inquiry with fixed position information has been received, etc., the target position information acquired here is the same as the position information acquired in step S1101.

[0315] (Step S1109) The video acquisition unit 133 acquires the updated position information of the i-th mobile terminal 2. Return to step S1105.

[0316] (Step S1110) The video composition unit 134 determines whether there is a video that is the video acquired by the i-th mobile terminal 2 and has been transmitted. If there is a transmitted video, go to step S1111; if there is no transmitted video, go to step S1113.

[0317] (Step S1111) The video composition unit 134 composes a combined video including the transmitted video, which is the video acquired by the i-th mobile terminal 2, and temporarily stores the combined video in a buffer (not shown) in pair with the identifier of the rights holder of the i-th mobile terminal 2.

[0318] Note that in the process of the first step S1111, the combined video is the video acquired by the i-th mobile terminal 2 and is the transmitted video. The combined video in the process of step S1111 after the second time of the loop process is the video that is the next in time of the combined video acquired so far and combines the video acquired by the i-th mobile terminal 2 and the transmitted video.

[0319] (Step S1112) The video acquisition unit 133 substitutes 1 for the counter i. Return to step S110

[0320] (Step S1113) The video acquisition unit 133 increments the counter i by 1. Return to step S1103.

[0321] (Step S1114) The video acquisition unit 133 determines whether to end the video combining process. If it is to end, go to step S1115; if not, go to step S1116.

[0322] For example, when the next location information included in the received inquiry does not exist, or when an end instruction is received, the video acquisition unit 133 determines to end the video combining process.

[0323] (Step S1115) The video acquisition unit 133 next acquires the target location information. The video acquisition unit 133 acquires, for example, the next target location information included in the path information of the inquiry. Return to step S1103.

[0324] (Step S1116) The video composition unit 134 concatenates the one or more combined videos configured in step S111 in the order in which they are acquired to form a combined video to be accumulated. Next, the video composition unit 134 temporarily stores the combined video in a buffer (not shown) in pairs with the two or more respective rights holder identifiers and location information of the videos that are the source of the combined video. Return to the upper-level process.

[0325] Next, an example of the registered video search process in step S415 will be described with reference to the flowchart of FIG. 12.

[0326] (Step S1201) The video acquisition unit 133 assigns 1 to the counter i.

[0327] (Step S1202) The video acquisition unit 133 determines whether the i-th target location information exists in the received inquiry. If the i-th location information exists, go to step S1203; if not, go to step S1217.

[0328] The target location information is the location information used for video search. The target location information is, for example, one piece of location information in the received inquiry, or each of two or more pieces of location information included in the route information in the received inquiry.

[0329] (Step S1203) The video acquisition unit 133 acquires the i-th target location information in the received inquiry.

[0330] (Step S1204) The video acquisition unit 133 acquires all the preservation information. The video acquisition unit 133 acquires, for example, the preservation information existing on the blockchain.

[0331] (Step S1205) The video acquisition unit 133 substitutes 1 for the counter j.

[0332] (Step S1206) The video acquisition unit 133 determines whether the j-th preservation information exists in the preservation information acquired in Step S1204. If the j-th preservation information exists, it proceeds to Step S1207; if it does not exist, it proceeds to Step S1216.

[0333] (Step S1207) The video acquisition unit 133 inspects the j-th preservation information and determines whether the video corresponding to the j-th preservation information can be provided to a third party. If it can be provided, it proceeds to Step S1208; if it cannot be provided, it proceeds to Step S1215. Note that being able to be provided means, for example, being viewable, being sellable, or being both viewable and sellable.

[0334] (Step S1208) The video acquisition unit 133 substitutes 1 for the counter k.

[0335] (Step S1209) The video acquisition unit 133 determines whether the k-th search unit exists in the j-th preservation information or the video corresponding to the j-th preservation information. If the k-th search unit exists, it proceeds to Step S1210; if it does not exist, it proceeds to Step S1215.

[0336] Note that a search unit is a video of an amount for determining whether or not an inquiry is satisfied. The video of the search unit is, for example, a video from the start of shooting to the end of shooting, a video of a certain period of time, a video until a predetermined event occurs (for example, a video during which the speed as a moving body attribute value changes from 0 to the next 0, a video from a stationary position (for example, a parking lot at home) until returning to the stationary position), a video of a predetermined period before and after being attached with a predetermined tag (for example, "accident", "traffic jam"). However, the search unit is not limited.

[0337] (Step S1210) The video acquisition unit 133 acquires a set of video attribute values of the k-th search unit from the j-th security information.

[0338] (Step S1211) The video acquisition unit 133 determines whether or not the set of video attribute values of the k-th search unit satisfies the first position condition for the i-th target position information. If the first position condition is satisfied, it proceeds to step S1212, and if not, it proceeds to step S1214.

[0339] (Step S1212) The video acquisition unit 133 acquires a video or the like corresponding to the j-th security information and temporarily stores it in a buffer (not shown). The video or the like is, for example, a set of a video and video attribute values, or a video.

[0340] (Step S1213) The video acquisition unit 133 increments the counter i by 1. It returns to step S1202.

[0341] (Step S1214) The video acquisition unit 133 increments the counter k by 1. It returns to step S1209.

[0342] (Step S1215) The video acquisition unit 133 increments the counter j by 1. It returns to step S1206.

[0343] (Step S1216) The video acquisition unit 133 increments the counter i by 1. It returns to step S1202.

[0344] (Step S1217) The video composition unit 134 determines whether two or more videos or the like have been acquired in step S1212. If two or more videos or the like have been acquired, it proceeds to step S1218. If only one video or the like has been acquired, it proceeds to step S1219.

[0345] (Step S1218) The video composition unit 134 combines two or more videos stored in a buffer (not shown) in the order in which they were stored to form a combined video, and stores the combined video in a buffer (not shown). Note that it is preferable for the video composition unit 134 to also store the rights holder identifier and video attribute value of the video that is the source of the combined video in association with the combined video in the buffer (not shown).

[0346] (Step S1219) The video transmission unit 141 transmits the combined video or the acquired video. Return to the upper-level process. Return to the upper-level process.

[0347] Note that in the flowchart of FIG. 12, each time a video is acquired in step S1212, the video transmission unit 141 may transmit the video. In such a case, the process of step S1219 is unnecessary.

[0348] Also, in the flowchart of FIG. 12, the video transmission unit 141 usually transmits the combined video or the video to the user terminal 3 that sent the inquiry.

[0349] Next, an example of the unregistered video search process in step S417 will be described using the flowchart of FIG. 13. The first example of the unregistered video search process is the case of using the set of attribute values in the collective storage unit 111.

[0350] (Step S1301) The video acquisition unit 133 assigns 1 to the counter i.

[0351] (Step S1302) The video acquisition unit 133 determines whether the i-th target position information exists in the received inquiry. If the i-th position information exists, it proceeds to step S1303; if it does not exist, it proceeds to step S1320.

[0352] (Step S1303) The video acquisition unit 133 acquires the i-th target position information in the received inquiry.

[0353] (Step S1304) The video acquisition unit 133 assigns 1 to the counter j.

[0354] (Step S1305) The video acquisition unit 133 determines whether the j-th set of attribute values exists in the aggregation storage unit 111. If the j-th set of attribute values exists, it proceeds to step S1303; if it does not exist, it proceeds to step S1319.

[0355] (Step S1306) The video acquisition unit 133 assigns 1 to the counter k.

[0356] (Step S1307) The video acquisition unit 133 determines whether the k-th search unit corresponding to the j-th set of attribute values exists. If the k-th search unit exists, it proceeds to step S1308; if it does not exist, it proceeds to step S1313.

[0357] (Step S1308) The video acquisition unit 133 acquires the set of video attribute values of the k-th search unit in the j-th set of attribute values from the aggregation storage unit 111.

[0358] (Step S1309) The video acquisition unit 133 determines whether the set of video attribute values acquired in step S1308 satisfies the inquiry. If it satisfies the inquiry, it proceeds to step S1310; if it does not satisfy the inquiry, it proceeds to step S1314.

[0359] (Step S1310) The video acquisition unit 133 acquires the rights holder identifier corresponding to the video.

[0360] (Step S1311) The video acquisition unit 133 determines whether there is movement information corresponding to the rights holder identifier acquired in step S1310. If there is movement information (for example, when the power of the mobile terminal 2 is ON), it proceeds to step S1312; if not (for example, when the power of the mobile terminal 2 is OFF), it proceeds to step S1315.

[0361] (Step S1312) The video acquisition unit 133 acquires the video corresponding to the k-th search unit from the mobile terminal 2 corresponding to the rights holder identifier acquired in step S1310, and temporarily stores it in a buffer (not shown). For example, the video acquisition unit 133 transmits a request for the video corresponding to the k-th search unit to the mobile terminal 2, and receives the video corresponding to the request from the mobile terminal 2.

[0362] (Step S1313) The video acquisition unit 133 increments the counter j by 1. It returns to step S1305.

[0363] (Step S1314) The video acquisition unit 133 increments the counter k by 1. It returns to step S1307.

[0364] (Step S1315) The video acquisition unit 133 acquires status information, etc. The status information, etc. includes, for example, status information indicating that the power of the mobile terminal 2 is OFF.

[0365] (Step S1316) The status transmission unit 142 transmits the status information, etc. acquired in step S1315 to the user who sent the inquiry.

[0366] (Step S1317) The video acquisition unit 133 acquires needs information.

[0367] (Step S1318) The needs transmission unit 143 transmits the needs information acquired in step S1317 to the rights holder of the video. It returns to step S1313.

[0368] (Step S1319) The video acquisition unit 133 increments the counter i by 1. Return to step S1302.

[0369] (Step S1320) The video composition unit 134 determines whether two or more videos were acquired in step S1312. If two or more videos were acquired, proceed to step S1321; if only one video was acquired, proceed to step S1322.

[0370] (Step S1321) The video composition unit 134 combines two or more videos stored in a buffer (not shown) in the order they were stored in step S1312 to form a single combined video, and stores the combined video in a buffer (not shown).

[0371] (Step S1322) The video transmission unit 141 transmits the combined video or the video. Return to the upper-level process. Note that the video transmission unit 141 typically transmits the combined video or the video to the user terminal 3 that sent the query.

[0372] Next, a second example of the unregistered video search process in step S417 will be described using the flowchart of FIG. 14. The second example of the unregistered video search process is the case of querying the mobile terminal 2.

[0373] (Step S1401) The video acquisition unit 133 assigns 1 to the counter i.

[0374] (Step S1402) The video acquisition unit 133 determines whether the i-th target position information exists in the received query. If the i-th position information exists, proceed to step S1403; if it does not exist, proceed to step S1412.

[0375] (Step S1403) The video acquisition unit 133 acquires the i-th target position information in the received query.

[0376] (Step S1404) The video acquisition unit 133 assigns 1 to the counter j.

[0377] (Step S1405) The video acquisition unit 133 determines whether the j-th movement information exists in the storage unit 11. If the j-th movement information exists, it proceeds to step S1403; if it does not exist, it returns to the upper-level process.

[0378] (Step S1406) The video acquisition unit 133 sends an inquiry to the mobile terminal 2 corresponding to the j-th movement information.

[0379] (Step S1407) The video acquisition unit 133 determines whether it has received information from the mobile terminal 2 corresponding to the j-th movement information. If it has received the information, it proceeds to step S1408; if it has not received the information, it returns to step S1407.

[0380] (Step S1408) The video acquisition unit 133 determines whether the information received in step S1407 contains a video. If it contains a video, it proceeds to step S1409; if it does not contain a video, it proceeds to step S1410.

[0381] (Step S1410) The video acquisition unit 133 temporarily stores the video and the like received in step S1407 in a buffer (not shown).

[0382] (Step S1411) The video acquisition unit 133 increments the counter j by 1 and returns to step S1405.

[0383] (Step S1412) The video composition unit 134 determines whether two or more videos have been accumulated in step S1409. If two or more videos have been accumulated, it proceeds to step S1413; if only one video has been acquired, it proceeds to step S1414.

[0384] (Step S1413) In step S1409, the video composition unit 134 combines two or more videos accumulated in a buffer (not shown) in the order of accumulation to form a single combined video, and stores the combined video in a buffer (not shown).

[0385] (Step S1414) The video transmission unit 141 transmits the combined video or the video. Return to the upper-level process. Note that the video transmission unit 141 usually transmits the combined video or the video to the user terminal 3 that has sent the inquiry.

[0386] Next, an example of the preservation process in step S418 will be described using the flowchart of FIG. 15.

[0387] (Step S1501) The rights holder processing unit 135 stores the transmitted video in association with the set of attribute values associated with each of the one or more videos that are the source of the transmitted video.

[0388] Note that it is preferable for the rights holder processing unit 135 to store the video in pairs with a rights holder identifier that identifies one or more rights holders of the video. The rights holder identifier here is, for example, one or more rights holder identifiers of the video that is the source of the stored video. The rights holder identifier here is, for example, one rights holder identifier that identifies the user who made the inquiry.

[0389] Also, the rights holder processing unit 135 stores the video in, for example, a device other than the storage unit 11 or the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.

[0390] (Step S1502) The fourth preservation means 1354 performs a fourth preservation process. An example of the fourth preservation process was described using the flowchart of FIG. 8.

[0391] (Step S1503) The rights holder processing unit 135 substitutes 1 for the counter i.

[0392] (Step S1504) The rights holder processing unit 135 determines whether the i-th video that is the source of the stored video exists. If the i-th video exists, proceed to step S1505; if it does not exist, return to the upper-level process.

[0393] (Step S1505) The reward means 1355 performs reward processing. An example of the reward processing will be described using the flowchart of FIG. 16. The reward processing here is a compensation process for the rights holder of the i-th video that is the source of the accumulated videos.

[0394] (Step S1506) The rights holder processing unit 135 determines whether to change the rights holder of the i-th video that is the source of the accumulated videos. If changing the rights holder, it proceeds to step S1507; if not changing the rights holder, it proceeds to step S1508.

[0395] Note that whether to change the rights holder may be based on a flag associated with the i-th video, may be predetermined, or the rights holder may be changed when the inquiry includes "information indicating a rights holder change request".

[0396] (Step S1507) The rights holder processing unit 135 acquires the user identifier of the user terminal 3. Note that such a user identifier becomes a new rights holder identifier.

[0397] (Step S1508) The rights holder processing unit 135 determines whether the i-th video that is the source of the accumulated videos has been registered. If it has been registered, it proceeds to step S1511; if it has not been registered, it proceeds to step S1509.

[0398] (Step S1509) The first protection means 1351 stores the i-th video that is the source of the accumulated videos.

[0399] (Step S1510) The fourth protection means 1354 performs fourth protection processing on the i-th video that is the source of the accumulated videos. An example of the fourth protection processing was described using the flowchart of FIG. 8.

[0400] (Step S1511) The rights holder processing unit 135 increments the counter i by 1. It returns to step S1504.

[0401] In the flowchart of FIG. 15, when a combined video is formed, the process of storing two or more videos that are the source of the combined video (step S1509) and the fourth preservation process (step S1510) are performed, but such processes may not be performed.

[0402] Next, an example of the reward process such as step S423 will be described with reference to the flowchart of FIG. 16.

[0403] (Step S1601) The reward means 1355 acquires one or more rights holder identifiers of the target video. The reward means 1355 may acquire the rights holder identifiers of the previous rights holders of the target video.

[0404] (Step S1602) The reward means 1355 acquires the set of attribute values of the target video.

[0405] (Step S1603) The reward means 1355 acquires a service identifier that identifies the service performed on the target video. The service identifier is, for example, "viewing" or "purchase".

[0406] (Step S1604) The reward means 1355 acquires the reward amount using one or more pieces of information from the set of attribute values acquired in step S1602 and the service identifier acquired in step S1603.

[0407] When two or more rights holder identifiers are acquired, the reward means 1355 acquires the reward amount for each rights holder identifier. When historical information of a rights holder including two or more rights holder identifiers is acquired, the reward means 1355 may acquire the reward amount for each rights holder identifier.

[0408] Further, it is preferable that the reward means 1355 obtains video attribute values corresponding to each of two or more videos that are the source of the video transmitted by the video transmission unit 141, and determines the amount of reward for each of the two or more rights holders using the video attribute values. For example, it is preferable that the reward means 1355 determines a larger reward amount as the data amount, time, or number of frames of the original video adopted in the video transmitted by the video transmission unit 141 is larger. For example, it is preferable that the reward means 1355 determines a larger reward amount as the resolution of the original video adopted in the video transmitted by the video transmission unit 141 is higher.

[0409] (Step S1605) The reward means 1355 performs a process of giving a reward corresponding to the amount of reward obtained in step S1604 to the rights holder identified by the rights holder identifier obtained in step S1601.

[0410] (Step S1606) The reward means 1355 performs a process of making the user who has enjoyed the service related to the target video bear the reward. Return to the upper-level process. Note that the target video is usually the video transmitted to the user terminal 3.

[0411] In the flowchart of FIG. 16, the operation side of the information processing apparatus 1 may obtain and accumulate the profit obtained.

[0412] Next, an operation example of the mobile terminal 2 will be described with reference to the flowchart of FIG. 17.

[0413] (Step S1701) The movement processing unit 23 determines whether or not a movement start has been detected. If a movement start is detected, it proceeds to step S1702, and if not detected, it proceeds to step S1717. Note that the movement start is caused by, for example, turning on the engine of the moving body on which the mobile terminal 2 is installed or turning on the power of the mobile terminal 2.

[0414] (Step S1702) The movement information acquisition unit 233 acquires movement information. The movement information transmission unit 241 transmits the movement information to the information processing apparatus 1. Note that the movement information is stored, for example, in the movement storage unit 21.

[0415] (Step S1703) The imaging unit 231 starts imaging.

[0416] (Step S1704) The imaging unit 231 acquires a moving image.

[0417] (Step S1705) The movement processing unit 23 acquires one or more moving image attribute values and associates the one or more moving image attribute values with the moving image acquired in Step S1704.

[0418] The movement processing unit 23 acquires, for example, position information, time information, weather information, temperature information, and season information. Further, the movement processing unit 23 acquires, for example, one or more moving body attribute values (for example, CAN data).

[0419] (Step S1706) The tag acquisition unit 232 determines whether to acquire a moving body attribute value tag. If it is determined to acquire the moving body attribute value tag, the process proceeds to Step S1707; if not, the process proceeds to Step S1709. Note that whether to acquire the moving body attribute value tag is determined in advance.

[0420] (Step S1707) The tag acquisition unit 232 performs a moving body attribute value tag acquisition process. An example of the moving body attribute value tag acquisition process was described using the flowchart of FIG. 6. Note that it may be possible that tags cannot be acquired here.

[0421] (Step S1708) When the tag acquisition unit 232 has acquired one or more tags in Step S1707, the tag acquisition unit 232 associates the one or more tags with the moving image acquired in Step S1704.

[0422] Here, it is preferable that the tag acquisition unit 232 associates one or more tags with the moving image and stores them in the moving storage unit 21. As a result, the user of the mobile terminal 2 can search for a moving image using, for example, the tag as a key.

[0423] (Step S1709) The tag acquisition unit 232 determines whether to acquire a moving image tag. If it is determined to acquire the moving image tag, the process proceeds to step S1710; if not, the process proceeds to step S1712. Note that whether to acquire the moving image tag is determined in advance.

[0424] (Step S1710) The tag acquisition unit 232 performs a moving image tag acquisition process. An example of the moving image tag acquisition process was described using the flowchart of FIG. 7. Note that there may be cases where the tag cannot be acquired.

[0425] (Step S1711) When one or more tags are acquired in step S1710, the tag acquisition unit 232 associates the one or more tags with the moving image acquired in step S1704.

[0426] Here, it is preferable that the tag acquisition unit 232 associates one or more tags with the moving image and stores them in the moving storage unit 21. As a result, the user of the mobile terminal 2 can search for a moving image using, for example, the tag as a key.

[0427] (Step S1712) The movement processing unit 23 determines whether the movement has ended. If it is determined that the movement has ended, the process proceeds to step S1713; if not, the process returns to step S1704.

[0428] For example, when the engine is turned off, the power of the mobile terminal 2 is turned off, or the arrival at the destination is detected, the movement processing unit 23 detects the end of the movement.

[0429] (Step S1713) The movement processing unit 23 acquires the rights holder identifier from the movement storage unit 21.

[0430] (Step S1714) The movement processing unit 23 constructs a set of attribute values having one or more moving body attribute values acquired in step S1705, one or more tags acquired in step S1707, and one or more tags acquired in step S1710.

[0431] (Step S1715) The set transmission unit 243 transmits the set of attribute values configured in step S1714 to the information processing apparatus 1 in association with the rights holder identifier.

[0432] (Step S1716) The moving video transmission unit 242 and the like perform video transmission processing. Return to step S1701. An example of the video transmission processing will be described with reference to the flowchart of FIG. 18. The video transmission processing is processing for automatically transmitting a video that meets the security conditions.

[0433] (Step S1717) The movement reception unit 22 determines whether a query has been received from the information processing apparatus 1. If a query has been received, proceed to step S1718; if not, return to step S1701.

[0434] (Step S1718) The movement processing unit 23 performs terminal image acquisition processing corresponding to the query received in step S1717. An example of the terminal image acquisition processing will be described with reference to the flowchart of FIG. 19. The terminal image acquisition processing is processing for acquiring a video that matches the query from among the videos stored in the movement storage unit 21.

[0435] (Step S1719) The movement processing unit 23 determines whether an image has been acquired in step S1718. If an image has been acquired, proceed to step S1720; if not, proceed to step S1721.

[0436] (Step S1720) The moving video transmission unit 242 transmits an image and the like to the information processing apparatus 1. Return to step S1701. Note that the image and the like are, for example, an image, a set of attribute values, and a rights holder identifier. Also, the image is, for example, a video, a still image, or an around view.

[0437] (Step S1721) Moving moving image transmitting section 242 transmits error information. The error information is information indicating that a moving image could not be acquired.

[0438] In the flowchart of Figure 17, it is preferable to transmit a set of video attribute values, which are all or part of one or more video attributes acquired in step S1705, tags acquired in step S1707, and tags acquired in step S1710, to the information processing device 1 each time a video is acquired, at predetermined intervals, or when a predetermined condition is met (for example, the tag ``accident'' or ``traffic jam'' is acquired).

[0439] 17, the video transmission process (processing of S1416) is performed after the end of movement is detected, but the video transmission process may be performed continuously. Continuously performing the video transmission process means, for example, performing the video transmission process (S1416) immediately after step S1711. This allows videos that meet the preservation conditions to be preserved even if the storage area for videos in storage unit 11 is small.

[0440] In the flowchart of FIG. 17, the process ends when the power is turned off or an interrupt occurs to end the process.

[0441] Next, an example of the video transmission process in step S1716 will be described with reference to the flowchart in FIG.

[0442] (Step S1801) The movement processing unit 23 acquires a set of attribute values from the movement storage unit 21.

[0443] (Step S1802) The movement processing unit 23 assigns 1 to the counter i.

[0444] (Step S1803) Movement processing unit 23 determines whether or not the i-th retrieval unit exists. If the i-th retrieval unit exists, the process proceeds to step S1804, and if not, the process returns to the upper process.

[0445] (Step S1804) The movement processing unit 23 acquires a set of video attribute values of the i-th search unit.

[0446] (Step S1805) The movement processing unit 23 assigns 1 to the counter j.

[0447] (Step S1806) The movement processing unit 23 determines whether the j-th preservation condition exists. If the j-th preservation condition exists, it proceeds to Step S1807; if not, it proceeds to Step S1810.

[0448] (Step S1807) The movement processing unit 23 determines whether the set of video attribute values acquired in Step S1804 satisfies the j-th preservation condition. If it satisfies the j-th preservation condition, it proceeds to Step S1808; if not, it proceeds to Step S1811.

[0449] (Step S1808) The movement processing unit 23 acquires the video or the like of the i-th search unit. Note that the video or the like of the i-th search unit is, for example, the video of the i-th search unit and the set of attribute values corresponding to the video.

[0450] (Step S1809) The moving video transmission unit 242 transmits the video or the like acquired in Step S1808 to the information processing apparatus 1.

[0451] (Step S1810) The movement processing unit 23 increments the counter i by 1. It returns to Step S1803.

[0452] (Step S1811) The movement processing unit 23 increments the counter j by 1. It returns to Step S1806.

[0453] Next, an example of the terminal image acquisition process in Step S1718 will be described using the flowchart of FIG. 19.

[0454] (Step S1901) The movement processing unit 23 determines whether to acquire a video using the received query. If acquiring a video, it proceeds to step S1902; if acquiring a still image or the like, it proceeds to step S1908.

[0455] Note that the movement processing unit 23 inspects, for example, the type identifier (e.g., "video", "still image", "surround view image") included in the received query and determines whether to acquire a video.

[0456] (Step S1902) The movement processing unit 23 assigns 1 to the counter i.

[0457] (Step S1903) The movement processing unit 23 determines whether the i-th search unit exists. If the i-th search unit exists, it proceeds to step S1904; if not, it returns to the upper-level process

[0458] (Step S1904) The movement processing unit 23 acquires the set of video attribute values of the i-th search unit.

[0459] (Step S1905) The movement processing unit 23 determines whether the set of video attribute values of the i-th search unit matches the query. If it matches the query, it proceeds to step S1906; if not, it proceeds to step S1907.

[0460] (Step S1906) The movement processing unit 23 acquires the video or the like of the i-th search unit. Note that the video or the like is, for example, a video and a set of video attribute values.

[0461] (Step S1907) The movement processing unit 23 increments the counter i by 1. It returns to step S1903.

[0462] (Step S1908) The movement processing unit 23 acquires the latest composite image or the latest still image. It returns to the upper-level process.

[0463] The composite image is an image synthesized using still images captured by two or more cameras installed in the moving body. The composite image is, for example, an around view image. The still image is an image captured by one camera installed in the moving body. Also, since the technology for constructing the around view image is a known technology, a detailed description thereof will be omitted.

[0464] Next, an operation example of the user terminal 3 will be described with reference to the flowchart of FIG. 20.

[0465] (Step S2001) The user reception unit 32 determines whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to step S2002, and if not, the process proceeds to step S2007.

[0466] Note that the reception of an inquiry is, for example, the reception of user input, the reception of position information from the target terminal 4, and the reception of destination or route information from the navigation terminal 5.

[0467] (Step S2002) The user processing unit 33 constructs an inquiry to be transmitted. Next, the user transmission unit 34 transmits the inquiry to the information processing apparatus 1 in association with the user identifier.

[0468] (Step S2003) The user reception unit 35 determines whether or not information has been received from the information processing apparatus 1. If information has been received, the process proceeds to step S2004, and if not, the process returns to step S2003.

[0469] (Step S2004) The user processing unit 33 determines whether or not the information received in step S2003 includes a moving image. If it includes a moving image, the process proceeds to step S2005, and if not, the process proceeds to step S2006.

[0470] (Step S2005) The user output unit 36 outputs the received moving image. The process returns to step S2001.

[0471] (Step S2006) The user output unit 36 outputs the received other information. Return to step S2001.

[0472] (Step S2007) The user processing unit 33 determines whether it is the timing of an inquiry. If it is the timing of an inquiry, go to step S2008; if it is not the timing of an inquiry, go to step S2009.

[0473] Note that the timing of an inquiry is, for example, when a destination is set in the user terminal 3 which is a navigation terminal, or when the user terminal 3 installed in the vehicle detects traffic congestion.

[0474] (Step S2008) The user processing unit 33 performs an inquiry generation process. Go to step S2002. An example of the inquiry generation process will be described using the flowchart of FIG. 18.

[0475] (Step S2009) The user reception unit 32 determines whether it has received a purchase instruction from the user. If it has received a purchase instruction, go to step S2010; if it has not received a purchase instruction, return to step S2001. Note that the purchase instruction includes, for example, an inquiry.

[0476] (Step S2010) The user processing unit 33 constructs the purchase instruction to be transmitted. Next, the user transmission unit 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.

[0477] (Step S2011) The user reception unit 35 determines whether it has received information from the information processing device 1. If it has received information, go to step S2012; if it has not received information, return to step S2011. Note that the information is, for example, a video, information indicating that the transfer of the rights holder has been completed, and a set of attribute values of the video.

[0478] (Step S2012) The user processing unit 33 constructs the information to be output using the received information. The user output unit 36 outputs the information. Return to step S2001.

[0479] In the flowchart of FIG. 17, the process ends due to a power-off or an interrupt at the end of processing.

[0480] Next, an example of the inquiry generation process in step S2008 will be described using the flowchart of FIG. 21.

[0481] (Step S2101) The user processing unit 33 acquires the destination.

[0482] (Step S2102) The user processing unit 33 acquires the current location.

[0483] (Step S2103) The user processing unit 33 performs route search using the destination and the current location, and acquires route information.

[0484] (Step S2104) The user processing unit 33 acquires information on one or more points that are on the route specified by the route information acquired in step S2103 and satisfy the extraction conditions.

[0485] (Step S2105) The user processing unit 33 constructs an inquiry using the one or more pieces of point information acquired in step S2104. Return to the upper-level process. Note that the user processing unit 33 constructs, for example, an inquiry: "Search for videos that are within 1 hour from now, have either the tag 'traffic jam' or 'accident' added, and form a pair with an attribute value set including any of the one or more pieces of point information."

[0486] Note that instead of the process of the flowchart of FIG. 18, the user processing unit 33 may acquire the current location and construct an inquiry including the current location. Such an inquiry is a transmission request for videos corresponding to predetermined tags (for example, 'accident', 'traffic jam') in the area around the current location (for example, within a threshold distance).

[0487] Next, the operation of the target terminal 4 will be described. The target terminal 4 acquires position information. Next, the target terminal 4 transmits the position information to the information processing apparatus 1 or the user terminal 3 registered in the target terminal 4. Note that the target terminal 4 acquires and transmits the position information when receiving an instruction from the holder of the target terminal 4 (for example, a child to be watched over). Note that the target terminal 4 has, for example, a GPS receiver, and acquires position information by the GPS receiver, but any method of acquiring position information may be used. Also, the user terminal 3 registered in the target terminal 4 is, for example, a guardian of the holder of the target terminal 4.

[0488] Next, the operation of the navigation terminal 5 will be described. The navigation terminal 5 receives a destination from the user. Next, the navigation terminal 5 performs the inquiry generation process described with reference to FIG. 21. Next, the navigation terminal 5 performs the processes of S2002 to S2005 and S2006 in FIG. 20.

[0489] Hereinafter, a specific operation example of the information system A in the present embodiment will be described.

[0490] Currently, a terminal management table having the structure shown in FIG. 22 is stored in the collective storage unit 111 of the information processing apparatus 1. The terminal management table is a table for managing one or more pieces of terminal information. The terminal management table is a table for managing the mobile terminal 2 that transmits videos. Note that a mobile terminal 2 not managed by the terminal management table may transmit a video to the information processing apparatus 1.

[0491] The terminal management table manages one or more records having "ID", "terminal identifier", "video information", "movement information", "registration flag", and "provision flag". "Video information" is information regarding the captured video, and here, it has "frame identifier", "environment information", and "tag". "Environment information" here has "position information", "time information", "weather information", and "temperature information". "Environment information" is information about the environment around the mobile terminal 2 when the video is acquired. "Tag" here has "accident", "traffic jam", and "dangerous driving". That is, here, for example, one or more tags of "accident", "traffic jam", and "dangerous driving" may be assigned to the video.

[0492] "ID" is information for identifying a record. The "terminal identifier" is an identifier of the mobile terminal 2, which is the same as the rights holder identifier that identifies the rights holder of the video at the time of video transmission here. The "frame identifier" is the ID of the frame constituting the video. A frame may also be referred to as a field or a still image. The "location information" is (latitude, longitude) here. The "time information" is year, month, day, hour, minute, and second here. The "weather information" is, for example, "sunny", "rainy", "cloudy", or "snowy". The "temperature information" is the outside air temperature (°C) of the moving object. The value "1" of "accident" indicates that a tag indicating that an accident has occurred is attached to the corresponding frame. The value "1" of "traffic jam" indicates that a tag indicating that a traffic jam has occurred is attached to the corresponding frame. The value "1" of "dangerous driving" indicates that a tag indicating that the vehicle in front is driving dangerously is attached to the corresponding frame. "Movement information = 1" indicates that the mobile terminal 2 is currently in a state where it can transmit a video. "Movement information = 0" indicates that the mobile terminal 2 is currently in a state where it cannot transmit a video due to power off or the like. "Registration flag = 1" indicates that the video has already been registered and can be acquired from the registration destination (for example, the storage unit 11 or another device). The "1" of the "provision flag" indicates that viewing of the video is permitted. The "2" of the "provision flag" indicates that sale (transfer of rights) of the video is permitted.

[0493] Also, a registered video management table having the structure shown in FIG. 23 is stored on the blockchain. The registered video management table is a table for managing registered videos. The registered video management table is a table for managing preservation information. The registered videos are, for example, videos provided to the user in response to an inquiry from the user and videos that meet the preservation conditions. The registered video management table has "ID", "video identifier", "access information", "rights holder identifier", "rights registration date", "video information", and "provision flag". It is assumed that the registered videos are stored in the information processing apparatus 1, another device, or the blockchain. Also, each record of the registered video management table is the preservation information here.

[0494] In such a situation, five specific examples will be described. Specific examples 1 to 4 involve the use of real-time videos. Specific example 5 involves the use of videos taken in the past.

[0495] In specific example 1, in order to monitor a target person (for example, a child, a wandering elderly person), a combined video obtained by combining videos captured by mobile terminals 2 installed on two or more mobile bodies is transmitted to a user terminal 3 of a user (for example, a guardian) related to the target person.

[0496] In specific example 2, in response to an inquiry using route information corresponding to a destination set in the user terminal 3 or the navigation terminal 5, a combined video obtained by combining videos captured by a plurality of mobile terminals 2 is output to the user terminal 3.

[0497] In specific example 3, a user terminal 3 or a navigation terminal 5 that has detected a traffic jam acquires a video that can identify the reason for the traffic jam and outputs it to the user terminal 3 or the navigation terminal 5.

[0498] In specific example 4, in a parking lot, in order for a user to find an empty space, an image that can show the situation of the parking lot is output.

[0499] In specific example 5, a combined video obtained by combining registered videos is output to the user terminal 3 by using route information for identifying a route (for example, a traveled route) that the user has moved along in the past.

[0500] (Specific example 1) Suppose that the storage unit 11 of the information processing apparatus 1 stores management information having a user identifier (for example, the IP address of the user terminal 3) for transmitting a video to the user terminal 3 of a certain guardian P and a target person identifier "T001" for identifying a target terminal 4 of a certain child A of the guardian P.

[0501] Next, it is assumed that child A turned on the power of the target terminal 4 to return home from school. Next, the target terminal 4 periodically acquires position information and sends an inquiry (for example, "operation transmission instruction target identifier = T001, position information (x t1 , y t1 )") including the position information and the target person identifier "T001" to the information processing device 1. It is assumed that the target terminal 4 stores the target person identifier "T001" and the communication destination information (for example, IP address) of the information processing device 1 for sending information to the information processing device 1.

[0502] Also, the receiving unit 12 of the information processing device 1 periodically receives position information for specifying the position of the mobile terminal 2 in pairs with the terminal identifier from two or more mobile terminals 2 and accumulates it in the terminal management table (Figure 22) in pairs with the terminal identifier.

[0503] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry "operation transmission instruction target identifier = T001, position information (x t1 , y t1 )" from the target terminal 4 and temporarily stores the position information (x t1 , y t1 ) and the target person identifier "T001" in a buffer (not shown). It is assumed that the position information is received periodically and the latest position information is stored in a buffer (not shown).

[0504] Next, the video acquisition unit 133 determines the first mobile terminal 2 (here, a drive recorder mounted on an automobile) corresponding to the position information that satisfies the first position condition with respect to the position indicated by the latest position information of the target terminal 4 by the operation described in the flowchart of FIG. 11. Then, the video acquisition unit 133 receives a video from the first mobile terminal 2. Such a video shows child A. This is because the position information of the target terminal 4 of child A and the position information of the mobile terminal 2 indicate positions that are close enough to satisfy the first position condition. Also, the video is usually associated with the position information and the first rights holder identifier of the first mobile terminal 2. Also, it is preferable that the received video is a video transmitted immediately after being captured by the mobile terminal 2.

[0505] Next, the video transmission unit 141 transmits the video received by the video acquisition unit 133 to the user terminal 3 of the guardian P identified by the user identifier paired with the subject identifier "T001".

[0506] Then, the video acquisition unit 133 temporarily stores the video received from the first mobile terminal 2 in a buffer (not shown), pairing the first rights holder identifier of the first mobile terminal 2 with the location information.

[0507] Note that while the location information of the target terminal 4 of child A and the location information of the first mobile terminal 2 satisfy the first location condition, the video acquisition unit 133 receives at least the video received from the first mobile terminal 2, and the video transmission unit 141 transmits the video to the user terminal 3 of the guardian P.

[0508] Next, it is assumed that the video acquisition unit 133 determines that the location information of the target terminal 4 of child A and the location information of the first mobile terminal 2 no longer satisfy the first location condition. This is because the first mobile terminal 2 has moved and is no longer at a position where it can photograph child A who is walking home.

[0509] Next, with reference to FIG. 22, the video acquisition unit 133 determines again the location information of the second mobile terminal 2 whose latest location information satisfies the first location condition for the latest location information of the target terminal 4. Note that FIG. 22 stores the latest location information transmitted from each mobile terminal 2 in pairs with each terminal identifier. Then, the video acquisition unit 133 acquires a video from the second mobile terminal 2. Next, the video acquisition unit 133 temporarily stores the video in a buffer (not shown), pairing the second rights holder identifier of the second mobile terminal 2 with the location information.

[0510] Next, the video transmission unit 141 transmits the video from the second mobile terminal 2 received by the video acquisition unit 133 to the user terminal 3 of the guardian P.

[0511] And then, assume that after a lapse of time (e.g., 10 seconds), the video acquisition unit 133 determines that the position information of the target terminal 4 of child A and the position information of the second mobile terminal 2 no longer satisfy the first position condition.

[0512] Next, the video acquisition unit 133 attempts to determine, with reference to FIG. 22, the position information of the third mobile terminal 2 whose latest position information satisfies the first position condition for the latest position information of the target terminal 4 again. However, assume that there is no position information of the third mobile terminal 2 that satisfies the first position condition. In such a case, the video transmission unit 141 may transmit information indicating that the video in which child A appears cannot be transmitted to the user terminal 3 of the guardian P, or may stop transmitting the video and information to the user terminal 3.

[0513] Through the above video transmission, the user terminal 3 sequentially receives and outputs the video acquired by the first mobile terminal 2 and the video acquired by the second mobile terminal 2. As a result, the guardian P can see how child A returns home.

[0514] And then, due to the passage of time, a third mobile terminal 2 approaching child A comes to exist. Assume that the video acquisition unit 133 can determine, with reference to FIG. 22, the position information of the third mobile terminal 2 whose latest position information satisfies the first position condition for the latest position information of the target terminal 4. Next, the video acquisition unit 133 acquires a video from the third mobile terminal 2. Next, the video acquisition unit 133 temporarily stores the video in a buffer (not shown) in a pair with the third identifier of the third mobile terminal 2 and the position information.

[0515] Next, the video transmission unit 141 transmits the video from the third mobile terminal 2 received by the video acquisition unit 133 to the user terminal 3 of the guardian P identified by the user identifier paired with the target identifier "T001".

[0516] Next, the user terminal 3 receives and outputs the video acquired by the third mobile terminal 2. By doing so, although the guardian P could not see the state of the child A's return home for a while, the output of such a video enables the guardian P to see the state of the child A's return home again.

[0517] The above processing continues until the power of the target terminal 4 of the child A is turned off (until the child A returns home), and the guardian B can monitor the state of the child A's return home from school.

[0518] In addition, the reward means 1355 performs the above-described reward processing on the right holders identified by the right holder identifiers of the first mobile terminal 2, the second mobile terminal 2, and the third mobile terminal 2 that provided the video to the guardian B.

[0519] In addition, the video composition unit 134 combines the videos transmitted from two or more mobile terminals 2 in the order in which they are transmitted to form a combined video.

[0520] In addition, the right holder processing unit 135 stores the combined video in pairs with the right holder identifier that is the identifier of the guardian P.

[0521] In addition, the right holder processing unit 135 stores the combined video in association with the set of attribute values corresponding to each of the one or more videos that are the source of the combined video.

[0522] Next, the fourth security means 1354 acquires access information for specifying the storage destination of the combined video. In addition, the fourth security means 1354 acquires the set of attribute values corresponding to the stored combined video. Next, the fourth security means 1354 constructs security information having the acquired access information, the acquired set of attribute values, and the right holder identifier of the video. Next, the fourth security means 1354 stores the constructed security information.

[0523] As described above, according to this specific example, it is possible to monitor the person holding the target terminal 4 using the combined video. In addition, it is possible to give a reward to the right holder who provided the video that is the source of the combined video for monitoring. In addition, the combined video can be appropriately managed.

[0524] Specific Example 2 Assume that the user has input a destination to the user terminal 3 having a navigation function. Next, the user reception unit 32 of the user terminal 3 receives the destination. Also, the user processing unit 33 acquires the current position. Next, the user processing unit 33 acquires route information from the current position to the destination. Here, it is assumed that the route information has two or more pieces of position information.

[0525] Next, in response to the acquisition of the route information by the user processing unit 33, the user transmission unit 34 of the user terminal 3 automatically transmits an inquiry including the route information to the information processing apparatus 1.

[0526] Next, the inquiry reception unit 122 of the information processing apparatus 1 receives the inquiry. Next, the video acquisition unit 133 and the video composition unit 134 perform video combination processing as follows.

[0527] That is, first, the video acquisition unit 133 acquires the position information of the first intersection (first position information) in the route specified by the route information among the two or more pieces of position information included in the route information. That is, it is preferable that the video acquisition unit 133 acquires a video using only a part of the position information included in the received route information. It is preferable that the video acquisition unit 133 acquires a video using only a part of the position information that satisfies a specific condition among the position information included in the received route information. The specific condition is, for example, that the position information indicates the position of an intersection and that the distance from the previously used position information is equal to or greater than a threshold value.

[0528] Next, the video acquisition unit 133 determines the position information of the first mobile terminal 2 that satisfies the first position condition with respect to the acquired position information. Then, the video acquisition unit 133 acquires a video from the determined first mobile terminal 2 and temporarily stores the video in a buffer (not shown) in a pair with the first identifier of the rights holder of the first mobile terminal 2 and the first position information. Next, the video transmission unit 141 transmits the acquired video to the user terminal 3.

[0529] Next, the video acquisition unit 133 acquires second position information of the next intersection closer to the destination than the position indicated by the first position information of the intersection acquired previously.

[0530] Next, the video acquisition unit 133 determines position information of the second mobile terminal 2 that satisfies the first position condition for the second position information. Then, the video acquisition unit 133 acquires a video from the determined second mobile terminal 2, and temporarily stores the video in a buffer (not shown) in a pair with the second identifier of the rights holder of the second mobile terminal 2 and the second position information. Next, the video transmission unit 141 transmits the acquired video to the user terminal 3.

[0531] Next, the video acquisition unit 133 acquires third position information of the next intersection closer to the destination than the position indicated by the second position information.

[0532] Next, the video acquisition unit 133 determines position information of the third mobile terminal 2 that satisfies the first position condition for the third position information. Then, the video acquisition unit 133 acquires a video from the determined third mobile terminal 2, and temporarily stores the video in a buffer (not shown) in a pair with the third identifier of the rights holder of the third mobile terminal 2 and the third position information. Next, the video transmission unit 141 transmits the acquired video to the user terminal 3.

[0533] The information processing apparatus 1 repeats the above processing until transmitting a video corresponding to the nth position information for specifying the destination.

[0534] Then, the user reception unit 35 of the user terminal 3 sequentially receives the first video, the second video, the third video, ··· the nth video. The user output unit 36 sequentially outputs the first video, the second video, the third video, ··· the nth video.

[0535] Also, the reward means 1355 of the information processing apparatus 1 performs a reward process of giving a reward for providing the video to the first rights holder, the second rights holder, ···, and the nth rights holder identified by the first identifier of the rights holder.

[0536] In addition, the video composition unit 134 combines the videos transmitted from each of two or more mobile terminals 2 in the order in which they are transmitted to constitute a combined video.

[0537] Also, the rights holder processing unit 135 stores the combined video in association with the rights holder identifier, which is the identifier of the user of the user terminal 3. That is, here, the rights holder of the combined video is the user.

[0538] Also, the rights holder processing unit 135 stores the combined video in association with the set of attribute values associated with each of the one or more videos that are the source of the combined video.

[0539] Next, the fourth security means 1354 acquires access information for specifying the storage destination of the combined video. Also, the fourth security means 1354 acquires the set of attribute values corresponding to the stored combined video. Next, the fourth security means 1354 constitutes security information having the acquired access information, the acquired set of attribute values, and the rights holder identifier of the video. Next, the fourth security means 1354 stores the constituted security information.

[0540] As described above, according to this specific example, by using a combined video in which videos transmitted from two or more mobile terminals 2 are at least apparently combined temporally, it is possible to confirm the state of the route to the destination in the order from the closest to the current position. As a result, it is possible to support traveling using a moving body such as an automobile.

[0541] In addition, it is possible to give a reward to the rights holder who provided the video that is the source of the combined video. Also, the combined video can be appropriately stored and managed.

[0542] (Specific Example 3) Assume that the navigation terminal 5 detects traffic congestion on the route to the destination. Note that the function of detecting traffic congestion is possible with known technology. Next, assume that the navigation terminal 5 acquires route information having position information of one or more roads with traffic congestion, and transmits an inquiry including the route information and a user identifier stored in the navigation terminal 5 to the information processing device 1. Note that the user identifier is an identifier of the user terminal 3 that receives a video transmitted from the mobile terminal 2 located at the position of the congested road, and is, for example, an IP address. Also, assume that the route information is information identifying one or two or more roads with traffic congestion. Such a user terminal 3 is, for example, the terminal of a passenger in the passenger seat.

[0543] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry including the route information and the user identifier. Next, the video acquisition unit 133 and the video composition unit 134 perform video combination processing as follows.

[0544] First, the video acquisition unit 133 acquires the position information closest to the current position among the position information included in the route information. Next, the video acquisition unit 133 acquires the last position information that is position information following the said position information and is within a threshold value of the position with respect to the adjacent position information. The video acquisition unit 133 sets such position information as the position information to be used for video acquisition.

[0545] Next, the video acquisition unit 133 determines the first mobile terminal 2 of the position information that satisfies the first position condition with respect to the target position information. Next, the video acquisition unit 133 acquires a video from the mobile terminal 2, and temporarily stores the video in a buffer (not shown) in a pair with the first rights holder identifier and the position information of the first mobile terminal 2.

[0546] Then, the video acquisition unit 133 receives videos from the first mobile terminal 2 until the latest position information of the first mobile terminal 2 no longer satisfies the first position condition, and temporarily stores them in a buffer (not shown).

[0547] Also, the video transmission unit 141 sequentially transmits the acquired videos to the user terminal 3.

[0548] Next, assume that the mobile terminal 2 has passed through the traffic jam, and the video acquisition unit 133 determines that the latest position information of the first mobile terminal 2 no longer satisfies the first position condition.

[0549] Next, the video acquisition unit 133 determines a second mobile terminal 2 with position information that satisfies the first position condition for the target position information. Next, the video acquisition unit 133 acquires a video from the second mobile terminal 2 and temporarily stores the video in a buffer (not shown) in a pair with the second identifier of the rights holder and the position information of the second mobile terminal 2.

[0550] Then, the video acquisition unit 133 receives videos from the second mobile terminal 2 and temporarily stores them in a buffer (not shown) until the latest position information of the second mobile terminal 2 no longer satisfies the first position condition.

[0551] Also, the video transmission unit 141 sequentially transmits the acquired videos to the user terminal 3.

[0552] Then, the user terminal 3 receives and outputs the videos from the information processing device 1.

[0553] By repeating the above processing, the user of the user terminal 3 can continuously know the traffic jam situation.

[0554] Also, when the route information includes information specifying traffic jam roads at two or more locations, the information processing device 1 performs the same processing using the route information specifying the locations after the second location. As a result, the user terminal 3 can also receive and output videos for grasping the traffic jam situation at the locations after the second location. Note that when there are two or more traffic jam locations, it is preferable that the user terminal 3 automatically or at the instruction of the user switches to that location, receives, and outputs the video.

[0555] In addition, in this specific example, although the description is omitted, reward processing, various security processes, etc. may be performed.

[0556] As described above, according to this specific example, it is possible to grasp the traffic jam situation on the route to the destination using the videos transmitted from two or more mobile terminals 2.

[0557] (Specific Example 4) Assume that an inquiry including the position information of the user terminal 3 installed in an automobile that has entered a large parking lot, which is an inquiry for grasping the situation of the parking lot, is transmitted to the information processing apparatus 1. Note that such an inquiry includes "type identifier = around view image", the position information (reference position information) of the user terminal 3, and the around view image acquired by the user terminal 3.

[0558] Next, the inquiry reception unit 122 of the information processing apparatus 1 receives the inquiry. Next, the video acquisition unit 133 determines from the received inquiry that spatial fusion of two or more videos is necessary. Next, the video acquisition unit 133 and the video composition unit 134 perform video fusion processing as follows.

[0559] That is, the video acquisition unit 133 acquires the reference position information included in the received inquiry. Next, the video acquisition unit 133 determines one or two or more mobile terminals 2 corresponding to the position information that satisfies the second position condition with respect to the reference position information. Next, the video acquisition unit 133 transmits an instruction to transmit the current around view image to one or two or more mobile terminals 2. Here, the second position condition is that the position indicated by the position information exists in the area of the parking lot including the reference position information. Assume that each of the one or more mobile terminals 2 continuously acquires around view images.

[0560] Then, the video acquisition unit 133 receives the around view images associated with the position information of the mobile terminal 2 from each of the one or more mobile terminals 2.

[0561] Next, the video composition unit 134 calculates the difference (distance) between the received around view images and the difference between the corresponding position information and the reference position information. Next, the video composition unit 134 sorts the around view images in ascending order using the difference as a key.

[0562] Next, the video composition unit 134 acquires a reference image. Note that the reference image is the surround view image included in the inquiry.

[0563] Next, the video composition unit 134 performs the process described using the flowchart of FIG. 10, and arranges each surround view image received from the other mobile terminal 2 at an appropriate position with respect to the reference image in the sorted order using the position information, thereby constructing a fused image. Further, the video composition unit 134 constructs an image that indicates the position (the position of the user terminal 3 that has transmitted the inquiry) indicated by the reference position information in the finally constructed fused image. Note that such an image is also a fused image.

[0564] Next, the video transmission unit 141 transmits the constructed fused image to the user terminal 3.

[0565] Next, the user terminal 3 receives and outputs the fused image.

[0566] As described above, according to this specific example, it is possible to assist in finding an empty space in the parking lot by fusing images transmitted from one or more other mobile terminals 2.

[0567] Note that in this specific example, the information processing apparatus 1 has fused surround view images. However, the information processing apparatus 1 may fuse two or more normal camera images or two or more images acquired by an omnidirectional camera using the position information corresponding to each image to construct a fused image, and transmit the fused image to the user terminal 3.

[0568] (Specific Example 5) Assume that user B drove on the driving course on a rainy day. And assume that route information for specifying the route on which user B drove by automobile is stored in the user terminal 3.

[0569] Next, assume that after returning home, User B inputs a query including the route information stored in User Terminal 3 and the environmental information "weather information = sunny" into User Terminal 3. Then, User Terminal 3 receives the query and transmits the query to Information Processing Device 1. Note that such a query is a video of the drive course traveled by the user and is a query for obtaining a video on a sunny day.

[0570] Next, the query reception unit 122 of Information Processing Device 1 receives the query. Next, the video acquisition unit 133 determines that the received query is not a real-time video search. Next, the video acquisition unit 133 and the like perform registered video search processing as follows.

[0571] That is, the video acquisition unit 133 acquires the first position information included in the route information in the received query.

[0572] Next, the video acquisition unit 133 acquires all the preservation information from the registered video management table (Fig. 23). That is, the video acquisition unit 133 acquires the preservation information existing on, for example, the blockchain.

[0573] Next, the video acquisition unit 133 determines the preservation information that includes "1" in the provision flag, has position information that satisfies the first position condition with respect to the acquired position information, and includes "weather information = sunny" among the acquired preservation information. Here, assume that the video acquisition unit 133 determines the preservation information with "ID = 1" in Fig. 23.

[0574] Next, the video acquisition unit 133 acquires the access information "Address 01" that corresponds to the determined security information. Next, the video acquisition unit 133 uses the access information "Address 01" to acquire a video. Next, the video acquisition unit 133 cuts out a video from the video corresponding to the access information "Address 01" up to the point where the second and subsequent position information in the path information of the received query satisfies the first position condition (the same or close) with the position information of the security information. That is, the video acquisition unit 133 cuts out and acquires a video from the video corresponding to the access information "Address 01" until it deviates from the path of the drive course traveled by the user.

[0575] Next, the video acquisition unit 133 acquires the position information when the video corresponding to the access information "Address 01" deviates from the drive course and the second position information in the path information of the received query.

[0576] Then, the video acquisition unit 133 determines security information that includes "1" in the provided flag, has position information that satisfies the first position condition with respect to the acquired second position information, and includes "weather information = sunny" among the acquired security information.

[0577] Next, the video acquisition unit 133 acquires access information (for example, "Address X") that corresponds to the determined security information. Next, assume that the video acquisition unit 133 acquires a second video using the access information "Address X". Next, the video acquisition unit 133 cuts out a video from the second video corresponding to the access information "Address X" up to the point where the position information prior to the second position information in the path information of the received query satisfies the position information of the security information. That is, the video acquisition unit 133 cuts out and acquires a video from the video corresponding to the access information "Address X" until it deviates from the path of the drive course traveled by the user.

[0578] The video acquisition unit 133 performs the above processing until it uses the last position information in the path information of the received query.

[0579] Next, the video composition unit 134 combines two or more videos acquired by the video acquisition unit 133 in the order of acquisition (the order of the routes) to compose a combined video.

[0580] Next, the video transmission unit 141 transmits the combined video to the user terminal 3 of user B.

[0581] Next, the user terminal 3 receives and outputs the combined video.

[0582] Also, the reward means 1355 of the information processing apparatus 1 acquires the rights holder identifiers (for example, "U001", etc.) of each of the two or more original videos used in the combined video, and performs a reward process of giving rewards to the rights holders identified by the two or more rights holder identifiers.

[0583] Also, the rights holder processing unit 135 performs various preservation processes described above on the composed combined video.

[0584] As described above, according to this specific example, a combined video obtained by combining two or more videos shot on the route in the past using the route information of the route where the user has moved can be composed and output.

[0585] As described above, according to this embodiment, it is possible to use the videos shot by two or more mobile terminals 2 to compose and provide a useful single video.

[0586] Also, according to this embodiment, it is possible to use the videos shot by two or more mobile terminals 2 to compose and provide a useful single video that is temporally combined.

[0587] Also, according to this embodiment, it is possible to use two or more videos corresponding to two or more pieces of position information transmitted from the target terminal 4 to compose and provide a useful single video that is temporally combined. By doing so, for example, it is possible to monitor the target person holding the moving target terminal 4.

[0588] Also, according to this embodiment, it is possible to use two or more videos corresponding to the destination set in the navigation terminal 5 to compose and provide a useful single video that is temporally combined.

[0589] Also, according to the present embodiment, it is possible to construct and provide a useful single video combined in the order of the route by using videos corresponding to each of two or more pieces of position information included in the route information.

[0590] Also, according to the present embodiment, it is possible to construct and provide a useful single video combined in the order of the route and in the order of time by using videos corresponding to each of two or more pieces of position information included in the route information.

[0591] Also, according to the present embodiment, it is possible to spatially fuse videos captured by two or more mobile terminals to construct and provide a useful single video.

[0592] Also, according to the present embodiment, it is possible to grasp the situation of the available space in the parking lot.

[0593] Also, according to the present embodiment, appropriate processing regarding the rights holders of the videos can be performed. For example, a reward can be given to the rights holder of the video captured by the mobile terminal 2.

[0594] Also, according to the present embodiment, the rights holder of a single video composed of two or more images can be made into an appropriate rights holder. For example, the rights holder of a single video composed of two or more images can be made into a person who needs the video.

[0595] Also, according to the present embodiment, the management information of the videos that need to be preserved can be preserved.

[0596] Furthermore, according to the present embodiment, the mobile terminal 2 acquires and stores video and audio information, but does not transmit the video and transmits the audio information, thereby contributing to the provision of the video and protecting the privacy of the rights holders of the moving body.

[0597] Note that the processing in this embodiment may be implemented by software. And this software may be distributed by software download or the like. Also, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification. The software that realizes the information processing apparatus 1 in this embodiment is a program as follows. That is, this program causes a computer to be a video that is a video captured by two or more mobile terminals and includes an attribute value set including one or more pieces of environmental information including position information for specifying a shooting position or time information for specifying a shooting time, and a video acquisition unit that acquires the videos transmitted from the two or more mobile terminals, and temporally combines two or more videos in which the time information associated with the two or more videos acquired by the video acquisition unit is different, or spatially fuses a part of two or more videos in which the position information associated with the two or more videos acquired by the video acquisition unit is different to constitute a single video, and is a program for causing the video transmission unit that transmits the single video configured by the video configuration unit to function.

[0598] Also, FIG. 24 shows the appearance of a computer that executes the program described in this specification and realizes the information processing apparatus 1 and the like of the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 24 is an overview diagram of this computer system 300, and FIG. 25 is a block diagram of the system 300. Note that the mobile terminal 2 usually includes a camera. Also, the mobile terminal 2 may include a microphone.

[0599] In FIG. 24, the computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0600] In FIG. 25, in addition to the CD-ROM drive 3012, the computer 301 includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 and the like, a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions of application programs and providing a temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Here, although not shown, the computer 301 may further include a network card for providing connection to a LAN.

[0601] A program for causing the computer system 300 to execute functions of the information processing apparatus 1 and the like in the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored in the hard disk 3017. The program is loaded into the RAM 3016 during execution. The program may be loaded directly from the CD-ROM 3101 or the network.

[0602] The program does not necessarily include an operating system (OS) or a third-party program for causing the computer 301 to execute functions of the information processing apparatus and the like in the above-described embodiment. The program only needs to include a portion of instructions that call appropriate functions (modules) in a controlled manner so as to obtain a desired result. How the computer system 300 operates is well known, and a detailed description thereof is omitted.

[0603] Note that in the above program, in steps such as the step of transmitting information and the step of receiving information, processing performed by hardware, for example, processing performed by a modem or an interface card in the transmission step (processing that can only be performed by hardware) is not included.

[0604] Also, the computer that executes the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

[0605] Also, in each of the above embodiments, it goes without saying that two or more communication means existing in one device may be physically realized by one medium.

[0606] Also, in each of the above embodiments, each process may be realized by being centrally processed by a single device, or may be realized by being distributedly processed by a plurality of devices.

[0607] Needless to say, the present invention is not limited to the above embodiments, and various modifications are possible and are also included within the scope of the present invention.

Industrial Applicability

[0608] As described above, the information processing apparatus 1 according to the present invention has an effect that it can utilize the videos captured by two or more mobile terminals 2 to constitute and provide a useful single video, and is useful as a server or the like.

Claims

1. a receiving unit that receives route information including two or more pieces of location information included in an inquiry from a user terminal; an acquisition unit that acquires two or more images associated with location information that satisfies a first location condition, which is a condition regarding the location information included in the route information and the traveling direction of the mobile terminal or the orientation of a camera mounted on the mobile terminal, from the mobile terminal; the image is an image associated with an attribute value set including one or more pieces of environmental information including location information specifying a shooting position, or an attribute value set including two or more pieces of environmental information including location information specifying a shooting position and time information specifying a shooting time; a configuration unit that temporally combines two or more images with different time information associated with each of the two or more images acquired by the acquisition unit, or spatially fuses a part of two or more images with different location information associated with each of the two or more images acquired by the acquisition unit to form one image; a transmission unit that transmits the one image configured by the configuration unit to the user terminal; An information processing apparatus comprising the above.

2. an acquisition unit that acquires images taken by two or more mobile terminals, which are images associated with an attribute value set including one or more pieces of environmental information including location information specifying a shooting position or time information specifying a shooting time, and acquires images transmitted from two or more mobile terminals; a configuration unit that temporally combines two or more images with different time information associated with each of the two or more images acquired by the acquisition unit, or spatially fuses a part of two or more images with different location information associated with each of the two or more images acquired by the acquisition unit to form one of the images; a transmission unit that transmits the one image configured by the configuration unit, and comprising: the acquisition unit: acquires two or more images that satisfy a second location condition that the location information associated with each of the two or more images is a position within a threshold distance from a reference position, a position with a distance from the reference position less than the threshold, or a position within a reference area, and the time information associated with each of the two or more images satisfies a time condition; the configuration unit: configures one frame using part or all of the frames constituting each of the two or more images acquired by the acquisition unit, and connects the frames temporally to form one of the images; An information processing apparatus.

3. the configuration unit: The information processing apparatus according to claim 2, wherein the top frames obtained by synthesizing the frames of the images captured by the two or more mobile terminals installed on each of the two or more moving bodies are spatially connected to form one frame, and one image having the one frame is formed.

4. The image is associated with a rights holder identifier that identifies the rights holder of the image, The information processing apparatus according to claim 1 or claim 2, further comprising a rights holder processing unit that performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier associated with the one image configured by the configuration unit.

5. The rights holder identifier associated with one image is the rights holder identifier associated with each of the two or more images that are the source of the one image, The rights holder processing unit, The information processing apparatus according to claim 4, comprising reward means for performing reward processing, which is processing for giving a reward to each of the rights holders identified by the rights holder identifiers associated with each of the two or more images that are the source of the one image.

6. The reward means, The information processing apparatus according to claim 5, wherein the reward means acquires attribute values corresponding to each of the two or more images that are the source of the image transmitted by the transmission unit, determines rewards for each of the two or more rights holders using the attribute values, and performs processing for giving the rewards.

7. An information processing method used for an information processing apparatus including a receiving unit, an acquiring unit, a configuring unit, and a transmitting unit, a step in which the receiving unit receives route information including two or more pieces of position information included in an inquiry from a user terminal; a step in which the acquiring unit acquires two or more images corresponding to the position information that satisfies a first position condition, which is a condition related to the two or more pieces of position information included in the route information and the traveling direction of the mobile terminal or the orientation of a camera mounted on the mobile terminal, from the mobile terminal; the acquired image is an image associated with an attribute value set including one or more pieces of environment information including position information specifying a shooting position or time information specifying a shooting time; a step in which the configuring unit temporally combines two or more images having different time information associated with each of the two or more images acquired by the acquiring unit, or spatially fuses a part of two or more images having different position information associated with each of the two or more images acquired by the acquiring unit to form one image; a step in which the transmitting unit transmits the one image configured by the configuring unit to the user terminal; An information processing method including the above.

8. An information processing method used in an information processing apparatus including an acquisition unit, a configuration unit, and a transmission unit, comprising: a step in which the acquisition unit acquires images transmitted from two or more mobile terminals, the images being images corresponding to an attribute value set including one or more pieces of environmental information including position information for specifying a shooting position or time information for specifying a shooting time, which are images captured by the two or more mobile terminals; a step in which the configuration unit temporally combines two or more of the images whose time information associated with the two or more images acquired by the acquisition unit is different, or spatially fuses a part of two or more of the images whose position information associated with the two or more images acquired by the acquisition unit is different, to form one of the images; a step in which the transmission unit transmits the one image configured by the configuration unit; the step of the acquisition unit is a step of acquiring two or more of the images that satisfy a second position condition that the position information associated with the two or more images is a position within a threshold distance from a reference position, a position with a distance from the reference position less than the threshold, or a position within a reference area, and the time information associated with the two or more images satisfies a time condition; the step of the configuration unit is a step of configuring one frame using part or all of the frames constituting the two or more images acquired by the acquisition unit, and connecting the frames temporally to form one of the images; An information processing method.

Images