Information processing device, mobile terminal, information processing method, and program
Patent Information
- Application Number
- JP2024206794
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2025-02-14
- Estimated Expiration
- 2042-08-25
AI Technical Summary
【0037】 本発明による情報処理装置によれば、2以上の各移動端末が撮影した動画を利用し、有用な一の動画を構成し、提供できる。
Smart Images

Figure 2025023054000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device or the like that processes moving images captured by two or more mobile terminals. [Background technology]
[0002] Conventionally, there have been image display systems that enable a user to view scenes other than the user's own field of view (scenes seen from moving objects other than the user's own field of view). In such image display systems, multiple moving images captured and transmitted by multiple moving objects can be output on a single screen (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2008-154192 A (paragraph
[0140] , Figure 24, etc.) Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the conventional technology, it was only possible to view videos taken by multiple moving objects on a single screen, and it was not possible to use videos taken by two or more mobile terminals to create and provide a single useful video. [Means for solving the problem]
[0005] The information processing device of the first invention is an information processing device comprising: a video acquisition unit that acquires videos captured by two or more mobile terminals, the videos corresponding to a set of attribute values including one or more environmental information including location information identifying the shooting location or time information identifying the time of shooting, and the videos transmitted from two or more mobile terminals; a video composition unit that temporally combines two or more videos acquired by the video acquisition unit, the two or more videos having different time information associated with each of the two or more videos acquired by the video acquisition unit, or spatially fuses portions of two or more videos having different location information associated with each of the two or more videos acquired by the video acquisition unit, to compose one video; and a video transmission unit that transmits the one video composed by the video composition unit.
[0006] With this configuration, videos captured by two or more mobile terminals can be used to compose and provide a single useful video.
[0007] In addition, the information processing device of the second invention is an information processing device in which, compared to the first invention, a video acquisition unit sequentially acquires two or more videos, the location information corresponding to each of the two or more videos satisfying a first location condition, and a video composition unit combines each of the two or more videos acquired by the video acquisition unit in a time order corresponding to the videos, to compose a single video.
[0008] With this configuration, videos captured by two or more mobile terminals can be used to construct and provide a single useful video that is linked in time.
[0009] In addition, the information processing device of the third invention, compared to the second invention, further includes a query receiving unit that receives a query including location information from a user terminal, and the video acquisition unit is an information processing device that acquires two or more videos corresponding to location information that satisfies a first location condition using the location information received by the query receiving unit.
[0010] With this configuration, videos captured by two or more mobile terminals can be used to construct and provide a single useful video that is linked in time.
[0011] In addition, compared to the second invention, the information processing device of the fourth invention further includes a query receiving unit that sequentially receives two or more pieces of location information transmitted from the target terminal, and the video acquisition unit sequentially uses the two or more pieces of location information received by the query receiving unit to sequentially acquire two or more videos corresponding to the location information that satisfies the first location condition.
[0012] With this configuration, it is possible to construct and provide a useful video that is time-wise combined using two or more videos corresponding to two or more pieces of location information transmitted from the target terminal, which makes it possible to monitor a target person who is holding a moving target terminal, for example.
[0013] In addition, compared to the second invention, the information processing device of the fifth invention is an information processing device that further includes a query receiving unit that receives a query including location information that identifies a destination set in the navigation terminal, and the video acquisition unit is an information processing device that sequentially acquires two or more videos corresponding to location information that satisfies a first location condition using the location information received by the query receiving unit.
[0014] With this configuration, two or more videos corresponding to a destination set in the navigation terminal can be used to create and provide a single useful video that is linked in time.
[0015] In addition, the information processing device of the sixth invention is an information processing device that, compared to the first invention, further includes an inquiry receiving unit that receives an inquiry including route information including two or more location information, and the video acquisition unit is an information processing device that acquires two or more videos corresponding to location information that satisfies two or more first location conditions using each of the two or more location information contained in the route information.
[0016] With this configuration, it is possible to compose and provide a single useful video that is linked in the order of the route using videos corresponding to two or more pieces of location information included in the route information.
[0017] In addition, the information processing device of the seventh invention is an information processing device in which, compared to the sixth invention, the route information has time information corresponding to each of two or more pieces of position information, and the video acquisition unit acquires two or more videos corresponding to position information that satisfies a first position condition using each of the two or more pieces of position information and the time information contained in the route information.
[0018] With this configuration, it is possible to compose and provide a useful single video that is combined in the order of the route and the time using videos corresponding to two or more pieces of location information included in the route information.
[0019] Furthermore, the information processing device of the eighth invention is an information processing device in which, compared to the first invention, the video acquisition unit acquires two or more videos, in which position information corresponding to each of the two or more videos satisfies a second position condition and time information corresponding to each of the two or more videos satisfies a time condition, and the video composition unit composes one frame using some or all of the frames constituting each of the two or more videos acquired by the video acquisition unit, and connects the frames in time to compose one video.
[0020] With this configuration, videos captured by two or more mobile terminals can be spatially merged to create and provide a single useful video.
[0021] Furthermore, in the information processing device of the ninth invention, compared to the eighth invention, the video is a video taken of a parking lot, and the video composition unit is an information processing device that spatially connects a directly above frame that is a composite of frames of videos taken by two or more mobile terminals installed on two or more mobile bodies, to compose one frame, and composes one video having one frame.
[0022] With this configuration, the parking situation in the parking lot can be grasped.
[0023] In addition, the information processing device of the tenth invention is an information processing device according to any one of the first to ninth inventions, further comprising a rights holder processing unit which corresponds to a rights holder identifier that identifies the rights holder of the video, and performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier that corresponds to a video composed by the video composition unit.
[0024] With this configuration, appropriate processing regarding the rights holder of the video can be carried out.
[0025] In addition, the information processing device of the eleventh invention is an information processing device in which, compared to the tenth invention, the rights holder identifier corresponding to one video is a rights holder identifier corresponding to each of two or more videos that were the basis of the one video, and the rights holder processing unit is an information processing device equipped with a reward means that performs reward processing, which is a process of giving rewards to each rights holder identified by the rights holder identifier corresponding to each of the two or more videos that were the basis of the one video.
[0026] With this configuration, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.
[0027] In addition, the information processing device of the twelfth invention is an information processing device in which, compared to the eleventh invention, the reward means acquires video attribute values corresponding to each of two or more videos that are the basis of the video transmitted by the video transmission unit, determines rewards for each of two or more rights holders using the video attribute values, and grants the rewards.
[0028] With this configuration, appropriate compensation can be given to the rights holder of the video captured by the mobile terminal.
[0029] In addition, the information processing device of the thirteenth invention is an information processing device in which, compared to the tenth invention, the rights holder processing unit is equipped with a first security means that performs a first security processing in which a video composed by a video composition unit is associated with a set of attribute values corresponding to each of two or more videos that were the basis of the video and stored.
[0030] With this configuration, a video made up of two or more images can be preserved.
[0031] In addition, the information processing device of the fourteenth invention is an information processing device in which, compared to the tenth invention, the rights holder processing unit is equipped with a second security means that performs a second security processing in which a video composed by the video composition unit is stored in association with a rights holder identifier corresponding to each of two or more videos that were the basis of the video.
[0032] With this configuration, the rights holder of a video made up of two or more images can be determined to be an appropriate rights holder.
[0033] In addition, the information processing device of the fifteenth invention is an information processing device further comprising, compared to the tenth invention, a query receiving unit that receives from a user terminal a query regarding environmental information relating to the environment in which the mobile terminal shot the video, the video acquisition unit acquires two or more videos corresponding to the query received by the query receiving unit, and the rights holder processing unit comprises a third security means that stores a video composed by the video composition unit in association with a rights holder identifier that identifies the user of the user terminal.
[0034] With this configuration, the rights holder of a video made up of two or more images can become a rights holder who needs that video.
[0035] In addition, the information processing device of the sixteenth invention is an information processing device according to any one of the thirteenth to fifteenth inventions, in which the rights holder processing unit is provided with a fourth preservation means that performs a fourth preservation process of storing preservation information including access information for accessing a video in a blockchain.
[0036] With this configuration, it is possible to preserve management information for moving images that need to be preserved. Effect of the Invention
[0037] According to the information processing device of the present invention, videos captured by two or more mobile terminals can be used to compose and provide a single useful video. [Brief description of the drawings]
[0038] [Figure 1] Conceptual diagram of information system A in embodiment 1. [Diagram 2] Block diagram of Information System A [Diagram 3] Block diagram of the information processing device 1 [Figure 4] A flowchart illustrating an example of the operation of the information processing device 1. [Diagram 5] A flowchart for explaining an example of a process for acquiring a set of attribute values [Figure 6] A flowchart for explaining an example of the moving object attribute value tag acquisition process. [Figure 7] A flowchart illustrating an example of the video tag acquisition process. [Figure 8] A flowchart illustrating an example of the fourth maintenance process. [Figure 9] A flowchart illustrating an example of the moving image fusion process. [Figure 10] A flowchart illustrating an example of the image fusion process. [Figure 11] A flowchart illustrating an example of the video combining process. [Figure 12] A flowchart illustrating an example of the registered video search process. [Figure 13] A flowchart for explaining a first example of the unregistered video search process. [Figure 14] A flowchart illustrating a second example of the unregistered video search process. [Figure 15] A flowchart illustrating an example of the maintenance process. [Figure 16] A flowchart illustrating an example of the compensation process. [Figure 17] A flowchart for explaining an example of the operation of the mobile terminal 2 [Figure 18] A flowchart illustrating an example of the video transmission process. [Figure 19] A flowchart illustrating an example of the terminal image acquisition process [Figure 20] A flowchart for explaining an example of the operation of the user terminal 3. [Figure 21] A flowchart for explaining an example of a homogeneous inquiry generation process [Figure 22] A diagram showing the terminal management table [Figure 23] A diagram showing the registered video management table [Figure 24] Overview of the computer system [Diagram 25] Block diagram of the computer system DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0039] Hereinafter, an embodiment of an information processing device and the like will be described with reference to the drawings. Note that, in the embodiments, components with the same reference numerals perform similar operations, and therefore repeated description may be omitted.
[0040] (Embodiment 1) In this embodiment, an information processing device that uses two or more videos captured by a photographing device in each of two or more moving objects to construct one video that is combined in time or one video that is fused in space will be described. Note that the inquiry for selecting two or more videos is, for example, an inquiry using location information specified by a user terminal, an inquiry using two or more location information received from a target terminal to be watched, an inquiry using a destination set in a navigation terminal, or an inquiry using route information.
[0041] In addition, in this embodiment, an information processing device that performs right holder processing, which is processing related to the right holder of one output video, will be described. The right holder processing is, for example, a remuneration process described later and various types of security processing described later.
[0042] In this embodiment, an information processing device that automatically receives and stores videos that meet the preservation conditions from a mobile terminal will be described.
[0043] In addition, in this embodiment, an information processing device that handles videos to which one or more tags obtained by analyzing the videos, etc. are added will be described. Note that the process of adding tags is performed, for example, by the information processing device or a mobile terminal, but may be performed by other devices.
[0044] In addition, in this embodiment, an information processing device that performs processing for a user of a mobile terminal or a user who needs a video when a video desired by the user exists but cannot be transmitted will be described. Note that a case where a video cannot be transmitted is, for example, when the power of the mobile terminal is OFF.
[0045] In this embodiment, an information processing device that receives and utilizes movement information related to the start of movement from a mobile terminal will be described.
[0046] In this embodiment, a mobile terminal that transmits movement information to an information processing device will be described.
[0047] In this embodiment, a mobile terminal that transmits the latest set of attribute values for the captured video to the information processing device when the mobile terminal finishes moving will be described.
[0048] Furthermore, in this embodiment, a mobile terminal will be described that obtains one or more tags by analyzing a video and associates the tags with the video.
[0049] In this embodiment, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc.
[0050] 1 is a conceptual diagram of an information system A in this embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, one or more user terminals 3, one or more target terminals 4, and one or more navigation terminals 5.
[0051] The information processing device 1 is a server that provides one video to a user terminal 3 using videos transmitted from two or more mobile terminals 2. The information processing device 1 is, for example, a so-called server, such as a cloud server or an ASP server, but the type does not matter. The information processing device 1 may also be a device that constitutes a blockchain.
[0052] The video here refers to images captured by the mobile terminal 2. A video is usually a collection of two or more still images, but it may be a single still image. The time interval between captures of the two or more still images contained in the video does not matter. The video may be, for example, a 60 frame / second video or a 30 frame / second video, but it may also be a collection of two or more still images captured with an interval of a predetermined time (for example, one minute) or more, or a collection of two or more still images captured when a predetermined condition is met.
[0053] The mobile terminal 2 is a terminal installed on a moving object and is a terminal that shoots video. The mobile terminal 2 is, for example, a drive recorder, a smartphone, a tablet terminal, or a camera with a communication function. Installation usually means being fixed, but it may also be considered to include being in contact with or held by something. The mobile terminal 2 may also have a driving means such as an engine or a moving means such as wheels.
[0054] A mobile body is an object that moves, such as a terrestrial mobile device, a marine mobile device, an undersea mobile device, an aerial mobile device, a space mobile device, or a living being.
[0055] Examples of ground vehicles include automobiles, bicycles, rickshaws, toys, and other vehicles that are moved by human power, trains, steam locomotives, and other railroad vehicles, rides in amusement parks, and commercial vehicles in factories and other facilities. Ground vehicles may also be non-human vehicles, such as various robots for commercial or playground use, radio-controlled toys, and other such toys. Examples of motor vehicles include passenger cars, trucks, buses, taxis, and motorcycles.
[0056] Examples of marine vehicles include various types of ships, jet skis, surfboards, rowing boats, swim rings, rafts, and the like.
[0057] The underwater mobile device is, for example, a submarine, a diving robot, or diving equipment such as an aqualung.
[0058] Examples of the aerial vehicle include various airplanes, helicopters, gliders, parachutes, balloons, kites, and the like.
[0059] Space vehicles include, for example, rockets, space probes, and artificial satellites.
[0060] Examples of living things include humans and non-human moving objects. Examples of non-human moving objects include birds, mammals, reptiles, amphibians, fish, insects, and other living things.
[0061] The user terminal 3 is a terminal used by a user. A user is someone who watches videos or needs videos. The user terminal 3 may have the functions of the mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may also be a navigation terminal 5 described later.
[0062] The target terminal 4 is a terminal that transmits location information. The target terminal 4 is, for example, a terminal provided in a monitoring target. The monitoring target is, for example, a living thing or an object. The living thing is, for example, a person. The person is, for example, a child or an elderly person. The object to be monitored is, for example, an object that should not be stolen, for example, an automobile.
[0063] The mobile terminal 2, the user terminal 3, and the target terminal 4 may be, for example, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and the types thereof are not important.
[0064] The navigation terminal 5 is a so-called navigation terminal. The navigation terminal 5 is a terminal that is installed in a ground moving device or held by a person.
[0065] The information processing device 1 and one or more mobile terminals 2 are usually capable of communicating with each other via a network such as the Internet. Furthermore, the information processing device 1 and one or more user terminals 3 are usually capable of communicating with each other via a network such as the Internet. Furthermore, the information processing device 1 and one or more target terminals 4 are usually capable of communicating with each other via a network such as the Internet. Furthermore, the information processing device 1 and one or more navigation terminals 5 are usually capable of communicating with each other via a network such as the Internet.
[0066] Fig. 2 is a block diagram of an information system A according to the present embodiment, and Fig. 3 is a block diagram of an information processing device 1.
[0067] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmission unit 14. The storage unit 11 includes a set storage unit 111. The receiving unit 12 includes a movement information receiving unit 121, an inquiry receiving unit 122, and a set receiving unit 123. The processing unit 13 includes a movement information accumulation unit 131, a set accumulation unit 132, a video acquisition unit 133, a video composition unit 134, and a right holder processing unit 135. The right holder processing unit 135 includes a first maintenance means 1351, a second maintenance means 1352, a third maintenance means 1353, a fourth maintenance means 1354, and a reward means 1355. The transmission unit 14 includes a video transmission unit 141, a status transmission unit 142, and a needs transmission unit 143.
[0068] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, and a moving transmitting unit 24. The moving processing unit 23 includes a photographing unit 231, a tag acquiring unit 232, and a moving information acquiring unit 233. The moving transmitting unit 24 includes a moving information transmitting unit 241, a moving video transmitting unit 242, and a collective transmitting unit 243.
[0069] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit , a user reception unit 35, and a user output unit .
[0070] Various types of information are stored in the storage unit 11 constituting the information processing device 1. The various types of information are, for example, terminal information (to be described later), an attribute value set (to be described later), movement information (to be described later), moving images, and management information (to be described later).
[0071] The management information is information used to monitor the person being watched. The management information includes a user identifier for transmitting video to the user terminal 3 of the person watching the person, and a target person identifier for identifying the target terminal 4 of the person being watched.
[0072] The set storage unit 111 stores one or more pieces of terminal information. The terminal information is information about the mobile terminal 2. The terminal information includes information about videos currently held by the mobile terminal 2. The terminal information includes a terminal identifier and an attribute value set. The terminal information may be associated with the video. Furthermore, the terminal identifier may be included in the attribute value set.
[0073] The terminal identifier is information for identifying the mobile terminal 2. The terminal identifier may be a right holder identifier for identifying a right holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the name of the mobile terminal 2, or the MAC address of the mobile terminal 2.
[0074] A rights holder is someone who has some right related to a video. A rights holder is, for example, the owner of the video, the copyright holder of the video, or the owner of the mobile terminal 2 that shot the video. A rights holder is the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it may be anyone who has the rights to the video shot by the mobile terminal 2.
[0075] The right holder identifier is an identifier of the right holder of the video. The right holder identifier may be a terminal identifier. The right holder identifier is, for example, the right holder's ID, the right holder's name, the right holder's email address, or the right holder's phone number.
[0076] An attribute value set is a set of one or more moving image attribute values. A moving image attribute value is an attribute value of a moving image. A moving image attribute value is, for example, environmental information. A moving image attribute value is, for example, a tag. A moving image attribute value may be, for example, a moving object attribute value described later.
[0077] The environmental information is information about the environment in which the video was taken. The environmental information is, for example, location information, time information, weather information, temperature information, and season information. The location information is information that specifies the location of the video. The shooting location is the location of the camera that takes the video. The location information is, for example, (latitude, longitude) or (latitude, longitude, altitude). However, the location information may be an area identifier that specifies an area on a map, an address, a road identifier that specifies a road, a lane identifier that specifies a lane on a road, and the like. The time information is information that specifies the time when the video was taken. The time when the video was taken may be a time around the time when the video was taken, and accuracy is not required. The time information is, for example, the time, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / date, and month / day. In other words, the granularity of the time indicated by the time information does not matter. The weather information is information that specifies the weather at the location where the video was taken when it was taken. The weather information is, for example, "sunny", "rain", "snow", and "cloudy". Temperature information is information that specifies the outside temperature at the location where the video was shot when it was shot. For example, the temperature information is "25 degrees" or "above 30 degrees." Season information is information that specifies the season at the location where the video was shot when it was shot. For example, the season information is "spring," "summer," "early summer," or "winter."
[0078] A tag is information that identifies the characteristics of a video. A tag is, for example, information resulting from analyzing a video. A tag is, for example, information resulting from analyzing one or more moving object attribute values. A tag is, for example, information resulting from analyzing two or more moving object attribute values in a time series.
[0079] A moving object attribute value is an attribute value related to a moving object. A moving object attribute value is, for example, information related to movement that a moving object can acquire while moving. A moving object attribute value is, for example, CAN (Controller Area Network) data, information indicating the use of an airbag. CAN data is, for example, speed, engine RPM, and brake status. A tag is, for example, "accident," "traffic jam," "dangerous driving," "speeding," and the name of an object shown in the video (for example, "person," "bear," or the name of a famous person).
[0080] The receiving unit 12 receives various information and instructions from the mobile terminal 2, the user terminal 3, the target terminal 4, or the navigation terminal 5. The various information and instructions are, for example, movement information, position information, an inquiry, an attribute value set, and a video.
[0081] It is preferable that a right holder identifier that identifies the right holder of the moving image is associated with the moving image received by the receiving unit 12. For example, one or more moving image attribute values are associated with the moving image received by the receiving unit 12.
[0082] The video received by the receiving unit 12 is, for example, a video captured in a parking lot. However, the location from which the video is received by the receiving unit 12 is not important.
[0083] The movement information receiving unit 121 receives movement information from the mobile terminal 2 when the mobile terminal 2 starts moving. The start time is preferably immediately after the start, but may be after a predetermined time (for example, one minute) has elapsed since the start of the movement.
[0084] The movement information is information that specifies that the mobile terminal 2 is moving. The information that specifies that the mobile terminal 2 is moving may be information that specifies that the mobile terminal 2 has started moving. The movement here may mean that the mobile terminal 2 is about to start moving, or that the mobile terminal 2 is currently moving. The movement information is, for example, a movement start flag and a terminal identifier. The movement start flag is information that indicates that the mobile terminal 2 is about to start moving. The terminal identifier is an identifier of the mobile terminal 2 that is about to start moving. The terminal identifier may be the same as the right holder identifier.
[0085] The inquiry receiving unit 122 receives an inquiry about environmental information from the user terminal 3. An inquiry about environmental information is an inquiry that includes environmental information as a condition. The inquiry is a request for a video captured by the mobile terminal 2. The inquiry is, for example, SQL, but the format, data structure, etc., of the inquiry are not important.
[0086] The inquiry receiving unit 122 receives, for example, an inquiry including location information from the user terminal 3.
[0087] The inquiry receiving unit 122 sequentially receives, for example, two or more pieces of location information transmitted from the target terminal 4. The inquiry receiving unit 122 may receive the two or more pieces of location information from the target terminal 4, or may receive the information from the user terminal 3 or the like received from the target terminal 4.
[0088] The inquiry receiving unit 122 receives, for example, an inquiry including location information that specifies a destination set in the navigation terminal 5. The inquiry receiving unit 122 may receive the location information from the navigation terminal 5, or may receive the location information from a user terminal 3 that has received the location information from the navigation terminal 5, or may receive the location information from a user terminal 3 that has transmitted the location information to the navigation terminal 5 for setting the destination.
[0089] The inquiry receiving unit 122 receives an inquiry including route information including two or more pieces of location information, for example. The inquiry receiving unit 122 receives an inquiry including route information from the user terminal 3 or the navigation terminal 5, for example.
[0090] The inquiry receiving unit 122 receives an inquiry from the user terminal 3 regarding environmental information on the environment in which the mobile terminal 2 captured a video.
[0091] The route information contained in the inquiry is, for example, information specifying the route traveled by the user watching the video, or route information set in the navigation terminal 5 or the user terminal 3 having a navigation function. It is preferable that the route information has time information corresponding to each of two or more pieces of position information. The time information is, for example, information specifying the time when the user was at the position specified by the position information. The distance between each of the two or more pieces of position information contained in the route information does not matter.
[0092] The set receiving unit 123 receives the attribute value set from the mobile terminal 2. It is preferable that the set receiving unit 123 receives the attribute value set from the mobile terminal 2 at the end of the movement of the mobile terminal 2. The attribute value set here is information that identifies a video stored in the mobile terminal 2.
[0093] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by a movement information storage unit 131, a collection storage unit 132, a moving image acquisition unit 133, a moving image composition unit 134, and a right holder processing unit 135.
[0094] The movement information storage unit 131 stores the movement information received by the movement information receiving unit 121 in association with the mobile terminal 2. Association with the mobile terminal 2 means association with, for example, a right holder identifier or a terminal identifier.
[0095] The set accumulation unit 132 accumulates the attribute value set received by the set receiving unit 123 in the set storage unit 111. The set accumulation unit 132 normally accumulates the attribute value set in association with the mobile terminal 2 that has transmitted the attribute value set. Association with the mobile terminal 2 means, for example, association with a right holder identifier or a terminal identifier.
[0096] The video acquisition unit 133 acquires videos captured by two or more mobile terminals 2. The videos are associated with an attribute value set. The attribute value set includes one or more pieces of environmental information. It is preferable that the one or more pieces of environmental information include location information that identifies the shooting location or time information that identifies the shooting time. It is also preferable that the videos are associated with a rights holder identifier.
[0097] The moving image acquisition unit 133 sequentially acquires two or more moving images, the position information associated with each of which satisfies the first position condition.
[0098] The video acquisition unit 133 acquires, for example, two or more videos corresponding to the inquiry received by the inquiry receiving unit 122 .
[0099] The video acquisition unit 133 acquires, for example, two or more videos corresponding to the location information that satisfies the first location condition using the location information received by the inquiry receiving unit 122.
[0100] For example, the video acquisition unit 133 sequentially uses each of the two or more pieces of location information received by the inquiry receiving unit 122 to sequentially acquire two or more videos corresponding to the location information that satisfies the first location condition.
[0101] The video acquisition unit 133 sequentially acquires, for example, two or more videos corresponding to the location information that satisfies the first location condition using the location information received by the inquiry receiving unit 122.
[0102] The video acquisition unit 133 acquires, for example, two or more videos corresponding to the position information that satisfies two or more first position conditions using each of the two or more pieces of position information included in the route information.
[0103] The video acquisition unit 133 acquires, for example, two or more videos corresponding to the position information that satisfies a first position condition using each of two or more pieces of position information and time information included in the route information.
[0104] The video acquisition unit 133 acquires, for example, two or more videos in which the position information associated with each of the two or more videos satisfies a second position condition and the time information associated with each of the two or more videos satisfies a time condition.
[0105] The first location condition is a condition related to location information. The first location condition is that the location information is in an approximate relationship with respect to a location specified by the target location information. The approximate relationship is closeness, for example, a distance within a threshold, a distance less than a threshold, a travel time within a threshold, or a travel time less than a threshold. The target location information is, for example, location information included in an inquiry or received location information.
[0106] The first position condition may include a condition other than the position information. The first position condition may be a condition related to the position information and the time information. For example, the first position condition is that the position information and the time information satisfy an approximation condition for a pair of the target position information and the time information. The position information and the time information satisfying the approximation condition for the pair of the target position information and the time information are, for example, position information indicating a position whose distance is within a threshold, whose distance is less than a threshold, whose travel time is within a threshold, or whose travel time is less than a threshold, with respect to a position specified by the target position information, and time information whose time difference is within a threshold or less than a threshold with respect to a time specified by the target time information. The first position condition may be a condition related to the position information and the traveling direction of the moving object. The first position condition may be a condition related to the position information and the orientation (direction) of the camera.
[0107] The second position condition is position information that is in an approximate relationship with a reference position or reference area to be compared. The approximate relationship here means that the distance from the reference position is within a threshold, the distance from the reference position is less than a threshold, or the position is within the reference area.
[0108] The video acquisition unit 133 acquires, for example, a video captured by each of two or more mobile terminals 2, a video associated with an attribute value set and a right holder identifier, and a video transmitted from the mobile terminal 2. It is preferable that the video acquisition unit 133 acquires a video that satisfies a storage condition.
[0109] The storage condition is a condition for storing a video. For example, the storage condition is to match a condition specified by an inquiry. For example, the storage condition is to match a conservation condition, which will be described later.
[0110] The device in which the video to be acquired is stored may be the mobile terminal 2, the information processing device 1, or another device (not shown). The other device may be, for example, a device that constitutes a blockchain.
[0111] For example, when the inquiry receiving unit 122 receives an inquiry, the video acquiring unit 133 acquires one or more videos corresponding to the inquiry from the mobile terminal 2. For example, the video acquiring unit 133 acquires from the mobile terminal 2 one or more videos that are paired with an attribute value set that satisfies a condition related to environmental information included in the inquiry.
[0112] The video acquisition unit 133, for example, transmits a query to one or more mobile terminals 2, and receives one or more videos corresponding to the query from one or more mobile terminals 2. Such processing is called unregistered video search processing. The unregistered video search processing is processing for acquiring a video that matches a condition from unregistered videos stored in the mobile terminal 2. The unregistered video search processing is processing for acquiring a video that matches a query from unregistered videos stored in the mobile terminal 2, for example.
[0113] For example, the video acquisition unit 133 acquires a video corresponding to the inquiry from among videos taken by one or more mobile terminals 2 corresponding to the movement information. The video acquisition unit 133 transmits an inquiry to each of the one or more mobile terminals 2 corresponding to the movement information, and receives a video that matches the inquiry from the mobile terminal 2. Note that the mobile terminal 2 corresponding to the movement information is a mobile terminal 2 that is moving and is capable of transmitting a video.
[0114] For example, when the inquiry receiving unit 122 receives an inquiry, the video acquisition unit 133 determines one or more attribute value sets that match the inquiry, and acquires videos corresponding to each of the one or more attribute value sets from the storage unit 11.
[0115] The moving image acquiring unit 133, for example, refers to the set storage unit 111, determines one or more moving images corresponding to the inquiry, and acquires the one or more moving images from the mobile terminal 2.
[0116] The process of determining a video corresponding to a query by referring to the set storage unit 111 is to determine an attribute value set that matches the query from one or more attribute value sets held by the set storage unit 111. Such a process is called a registered video search process. The registered video search process is a process of searching registered videos for videos that match a condition. The registered video search process is, for example, a process of searching registered videos for videos that match the query. Note that a registered video is a video for which a first preservation process or a second preservation process, which will be described later, has been performed.
[0117] The video acquisition unit 133, for example, refers to the set storage unit 111, determines the video corresponding to the inquiry, determines whether the video is in a state where it can be transmitted from the mobile terminal 2, and acquires the video from the mobile terminal 2 only if it is in a state where it can be transmitted.
[0118] For example, the video acquisition unit 133 attempts to communicate with the mobile terminal 2, and if it can receive information from the mobile terminal 2, it determines that the mobile terminal 2 is in a state where it can transmit video. For example, the video acquisition unit 133 determines whether or not mobile information corresponding to the mobile terminal 2 is stored in the storage unit 11, and if it is stored, it determines that the mobile terminal 2 is in a state where it can transmit video. Note that a state where a video can be transmitted is, for example, a state where the power of the mobile terminal 2 or a mobile object corresponding to the mobile terminal 2 is ON (for example, a state where the engine of a car, which is a mobile object, is ON). In addition, the method by which the video acquisition unit 133 determines whether or not a video can be transmitted is not important.
[0119] The video acquisition unit 133 acquires, for example, a video associated with an attribute value set that satisfies the conservation condition from the mobile terminal 2. Through this process, the video can be acquired automatically.
[0120] The preservation conditions are conditions for storing moving images and relate to a set of attribute values.
[0121] The conservation condition is preferably a condition related to one or more tags. For example, the conservation condition is that the attribute value set includes a tag indicating "accident", that the attribute value set includes a tag indicating "traffic jam", or that the attribute value set includes a tag indicating a specific location. The tag indicating a specific location is, for example, the name of a specific parking lot, a specific place name, the name of a specific scenic spot, or the name of a specific landscape.
[0122] The preservation condition is that the moving image corresponds to an attribute value set that satisfies a predetermined condition for an attribute value set corresponding to one or more moving images stored in a predetermined device or area (e.g., storage unit 11). The predetermined condition is, for example, that an attribute value possessed by the attribute value set does not exist in the attribute value set corresponding to one or more moving images stored in the predetermined device or area.
[0123] The video acquisition unit 133 may acquire a processed image acquired by processing a video captured by the mobile terminal 2, for example. Such a processed image is, for example, an around-view image. The around-view image is an image displayed on an around-view monitor. The around-view image is an image that appears as if an area including a moving object was captured from directly above.
[0124] The moving image composing unit 134 composes one moving image using two or more moving images acquired by the moving image acquiring unit 133. Composing one moving image may mean sequentially passing parts of the moving images that appear as one moving image to the user to the moving image transmitting unit 141.
[0125] The moving image composing unit 134, for example, temporally combines two or more moving images having different time information corresponding to each of the two or more moving images acquired by the moving image acquiring unit 133 to compose one moving image. Combining two or more moving images temporally to compose one moving image may mean passing the two or more moving images in order to the moving image transmitting unit 141. In other words, combining two or more moving images temporally to compose one moving image is sufficient as long as the user sees the two or more moving images as one moving image.
[0126] For example, moving image composing unit 134 combines two or more moving images acquired by moving image acquiring unit 133 in the time order corresponding to the moving images to compose one moving image. For example, moving image composing unit 134 acquires parts of two or more moving images acquired by moving image acquiring unit 133 and combines the parts of the moving images in order to compose one moving image. Combining two or more moving images in time usually means combining parts of the moving images captured by two or more mobile terminals 2 in order. Combining parts of the moving images in order may also mean passing the parts of the moving images in order to moving image transmitting unit 141. Also, Combining the videos in the order of time corresponding to the videos means combining the videos in the order of time indicated by the time information corresponding to the videos, or combining the videos in the order in which they were received.
[0127] The moving image composing unit 134 composes one moving image, for example, by spatially fusing a portion of each of two or more moving images having different position information corresponding to each of the two or more moving images acquired by the moving image acquiring unit 133. The moving image composing unit 134 composes one frame using, for example, a portion or all of the frames constituting each of the two or more moving images acquired by the moving image acquiring unit 133, and connects the frames in time to compose one moving image.
[0128] The moving image composing unit 134 composes one moving image, for example, by processing each of the two or more moving images acquired by the moving image acquiring unit 133. For example, the moving image composing unit 134 spatially connects a directly above frame obtained by combining frames of moving images captured by each of two or more mobile terminals 2 installed on each of two or more moving bodies, composes one frame, and composes one moving image having one frame.
[0129] The moving image composition unit 134, for example, combines two or more around-view images to compose a wide-area around-view image.
[0130] The right holder processing unit 135 performs right holder processing. The right holder processing is processing related to a right holder identified by a right holder identifier corresponding to one video composed by the video composition unit 134. The right holder processing unit 135 performs right holder processing, which is processing in response to the video transmission unit 141 transmitting a video, for example, and is processing related to a right holder identified by a right holder identifier corresponding to the video. The right holder processing is, for example, a first security processing, which will be described later, a second security processing, which will be described later, a third security processing, which will be described later, a fourth security processing, which will be described later, and a compensation processing, which will be described later. Note that the video transmitted by the video transmission unit 141 is an image composed by the video composition unit 134.
[0131] The right holder identifier associated with one moving image is, for example, a right holder identifier associated with each of two or more moving images that are the basis of the constructed moving image, or an identifier of a user who requested the one moving image.
[0132] The right holder processing unit 135, for example, stores the video acquired by the video acquisition unit 133 in association with a right holder identifier. It is preferable that the right holder processing unit 135 stores only the video acquired by the video acquisition unit 133 as satisfying the storage condition. It is also preferable that the right holder processing unit 135 does not store the video that does not satisfy the storage condition.
[0133] For example, when the video acquisition unit 133 determines that the mobile terminal 2 holding the video corresponding to the inquiry is in a state where it cannot transmit the video, the rights holder processing unit 135 acquires status information relating to that state.
[0134] The status information is information about a state in which a video cannot be sent. The status information is, for example, information indicating the state of the mobile terminal 2 that holds the video. For example, the status information is "The video exists, but it is not currently in a state where it can be sent to you," or "The video exists on Mr. XX's mobile terminal, but it is not currently in a state where it can be sent to you." The status information is, for example, information indicating that the power of the mobile terminal 2 is OFF, or information indicating that the power of the mobile terminal 2 is ON.
[0135] For example, when the video acquisition unit 133 determines that the mobile terminal 2 holding the video corresponding to the inquiry is in a state in which the video cannot be transmitted, the right holder processing unit 135 acquires the needs information.
[0136] The need information is information indicating that there is a need for a video. For example, the need information is "Your XXX video is being requested by other users" or "Your XXX video is being requested by other users for XX yen."
[0137] The first maintenance means 1351 performs a first maintenance process of storing one moving image composed by the moving image composition unit 134 in association with an attribute value set corresponding to each of two or more moving images that are the basis of the one moving image. The first maintenance means 1351 may also perform a first maintenance process of storing a moving image received from the mobile terminal 2 in association with an attribute value set corresponding to the moving image.
[0138] The second security means 1352 performs a second security process of storing one moving image composed by the moving image composition unit 134 in association with the right holder identifiers corresponding to the two or more original moving images that formed the one moving image.
[0139] In addition, the first maintenance means 1351 or the second maintenance means 1352 may store a video composed by the video composition unit 134 in association with a set of attribute values corresponding to each of two or more videos that were the basis for the video, and with a rights holder identifier corresponding to each of the two or more videos that were the basis for the video.
[0140] The third security means 1353 stores one video composed by the video composition unit 134 in association with a right holder identifier that identifies the user of the user terminal 3. The user of the user terminal 3 here is a person who watches one video. The user terminal 3 here is, for example, a terminal that has sent an inquiry.
[0141] Also, the destination where a video is stored is, for example, the storage unit 11, but it may also be another device, such as another device that constitutes a blockchain.
[0142] The fourth security means 1354 performs a fourth security process to store security information including access information for accessing one of the stored moving images. The order of storing the moving image and the fourth security process for the security information corresponding to the moving image does not matter.
[0143] The fourth security means 1354 performs a fourth security process of storing security information, which is composed by the video composition unit 134 and includes access information for accessing one stored video, in the block chain.
[0144] In addition, it is preferable that the fourth maintenance means 1354 accumulates the maintenance information in a blockchain. That is, it is preferable that the fourth maintenance means 1354 accumulates the maintenance information in a distributed ledger of the blockchain. It is preferable that the fourth maintenance means 1354 registers the maintenance information as an NFT (non-fungible token). It is preferable that the fourth maintenance means 1354 registers the maintenance information in a distributed file system in an IPFS (Inter Planetary File System) network.
[0145] The preservation information is information for ensuring the originality of a video. It can be said that the preservation information is heading information for a video. The preservation information is, for example, access information and one or more video attribute values. It is preferable that the preservation information has, for example, one or more right holder identifiers. When the preservation information has two or more right holder identifiers, the right holder of the video may be shared, and the two or more right holder identifiers may be right holder history information. The right holder history information is a collection of right holder identifiers and is information indicating the history of the right holder. The fourth preservation process can guarantee the originality of the preservation information of the registered video. By guaranteeing the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. The access information is information for accessing a video. The access information is information that specifies the storage destination of the video. The access information is, for example, a URL or a URI.
[0146] It is preferable that the security information includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.
[0147] The remuneration means 1355 performs remuneration processing for each right holder identified by a right holder identifier corresponding to each of two or more moving images that are the basis of one moving image composed by the moving image composition unit 134.
[0148] The reward process is a process of giving a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more right holder identifiers corresponding to a video. The reward process is, for example, a process of making a payment to a right holder identified by one or more right holder identifiers corresponding to a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a right holder identified by one or more right holder identifiers corresponding to a video. The reward process may be any type of merit as long as it gives a merit to a right holder identified by one or more right holder identifiers corresponding to a video. The reward may be, for example, money, points, goods, content, or the like, and the type of merit is not important.
[0149] It is preferable that the reward means 1355 performs reward processing, which is a process of acquiring one or more video attribute values corresponding to two or more videos that were the basis for the single video transmitted by the video transmission unit 141, determining rewards for each of two or more rights holders using the one or more video attribute values, and awarding the rewards.
[0150] Here, the one or more moving image attribute values are, for example, the amount of data of the moving image, the duration of the moving image, the number of frames of the moving image, and the resolution of the moving image.
[0151] It is preferable that the reward means 1355 performs a reward process, which is a process of acquiring a reward amount corresponding to a service identifier that identifies a service provided to a target video, and giving a reward corresponding to the reward amount. The service identifier is, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.
[0152] The reward means 1355 performs reward processing, which is processing for obtaining a reward amount using, for example, one or more pieces of information among one or more video attribute values and one or more service identifiers, and giving a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of two or more service identifiers is stored in the storage unit 11. The arithmetic expression is an expression for calculating the reward amount using one or more video attribute values as parameters. The correspondence table is a table having two or more pieces of correspondence information for managing the reward amount corresponding to one or more video attribute values. The remuneration means 1355 normally performs a process of charging a remuneration to a user who has enjoyed a service related to the target video.
[0153] The process of charging the reward is, for example, a process of charging the amount of reward acquired. The process of charging the reward is, for example, a process of charging the amount of reward acquired and the amount of profit obtained by the management of the information processing device 1. The process of charging the reward is, for example, a process of deducting points corresponding to the user who enjoyed the service, a settlement process using the credit card number of the user, etc.
[0154] The transmission unit 14 transmits various types of information or instructions to the mobile terminal 2, the user terminal 3, or the navigation terminal 5. The various types of information or instructions are, for example, video, inquiries, status information, and needs information.
[0155] The video sending unit 141 transmits one video composed by the video composition unit 134. The video sending unit 141 transmits the one video to the user terminal 3. It is preferable that the video sending unit 141 transmits a video in response to receiving an inquiry. The video sending unit 141 transmits a video to, for example, the user terminal 3 or the navigation terminal 5. Transmitting one video may mean that the video sending unit 141 sequentially transmits parts of the one video that have been handed over to it.
[0156] The video sending unit 141 sends, for example, the video acquired by the video acquiring unit 133 to the user terminal 3.
[0157] When a video cannot be transmitted, the status transmission unit 142 transmits status information relating to the status to the user terminal 3. The status transmission unit 142 transmits, for example, status information acquired by the right holder processing unit 135 to the user terminal 3.
[0158] Whether or not the video cannot be transmitted is determined by, for example, the video acquisition unit 133.
[0159] When it is determined that the video cannot be transmitted, the needs transmission unit 143 transmits needs information indicating that there is a need for the video to the user corresponding to the video. For example, the needs transmission unit 143 transmits the needs information acquired by the right holder processing unit 135 to the user corresponding to the video. Transmitting to the user corresponding to the video means, for example, sending the needs information by email to the email address that is paired with the right holder identifier that corresponds to the video. Transmitting to the user corresponding to the video means, for example, sending the needs information by short message to the telephone number that is paired with the right holder identifier that corresponds to the video. Transmitting to the user corresponding to the video means, for example, sending the needs information to the mobile terminal 2 that is paired with the right holder identifier that corresponds to the video. Note that the user corresponding to the video is usually the right holder of the video.
[0160] Various types of information are stored in the movement storage unit 21 constituting the mobile terminal 2. The various types of information are, for example, moving images, attribute value sets, right holder identifiers, movement information indicating the start of movement, pairs of attribute value tag conditions and tags, pairs of moving image tag conditions and tags, one or more conservation conditions, and one or more pieces of acquisition information. The movement storage unit 21 typically stores one or more pairs of attribute value tag conditions and tags. The movement storage unit 21 typically stores one or more pairs of moving image tag conditions and tags.
[0161] For example, one or more moving image attribute values constituting an attribute value set correspond to one or more still images (which may also be called fields or frames) that make up a moving image. The one or more moving image attribute values may correspond to all still images, may correspond to some of the still images, or may correspond to two or more still images.
[0162] An attribute value tag condition is a condition for acquiring a tag based on one or more mobile object attribute values. An attribute value tag condition is a condition related to one or more mobile object attribute values. Examples of attribute value tag conditions are "the brake is applied suddenly," "the degree of deceleration of the speed within a unit time (acceleration) is below a threshold value (the brake is applied suddenly)," "the airbag is deployed," "the time at or below a first speed has elapsed for a second hour or more (there is a traffic jam)," and "the location information corresponds to a specific name." Examples of tags paired with an attribute value tag condition are "abnormal driving," "accident," "traffic jam," and "specific location name."
[0163] A video tag condition is a condition related to a video. A video tag condition is a condition based on the analysis result of a video. Examples of video tag conditions are "having a still image of two or more cars touching each other (it is an accident)", "having a frame in which the distance between two or more cars is zero (cars are touching each other)", "having a period in which a first threshold or more of cars are present within a specified distance is a second threshold or more (it is a traffic jam)", and "the cumulative amount of change in the distance between the center of gravity of the car in front and the lane per unit time is a threshold or more (the car in front is swerving)". Examples of tags that are paired with a video tag condition are "accident", "traffic jam", and "abnormal driving".
[0164] The preservation condition is a condition for preserving a video. The preservation condition is a condition related to a set of attribute values. For example, such a preservation condition is "an airbag has been deployed (an accident has occurred)" or "a specific tag has been added to the video (the specific tag is, for example, "accident" or "dangerous driving")." The preservation condition corresponds to, for example, acquired information. The acquired information is information that identifies the video to be acquired. The acquired information is information that identifies the video to be acquired when the preservation condition is satisfied. For example, such a preservation condition is "(1) the number of cars on the screen is equal to or greater than a first threshold value & (2) the traveling speed of the cars is equal to or less than a second threshold value & the duration of (1) and (2) is equal to or greater than a third threshold value (traffic jam continues)."
[0165] The mobile receiving unit 22 receives various types of information, such as inquiries, needs information, and videos captured by other mobile terminals 2.
[0166] The movement processing unit 23 performs various processes. The various processes are, for example, processes performed by the photographing unit 231, the tag acquiring unit 232, and the movement information acquiring unit 233. The movement processing unit 23 converts the information received by the movement receiving unit 22 into a data structure to be output.
[0167] The movement processing unit 23 detects, for example, the start of movement. The detection of the start of movement is, for example, detection of the power supply being turned on of the mobile terminal 2 or detection of the engine being turned on of the moving object.
[0168] The movement processing unit 23 detects, for example, the end of movement. The detection of the end of movement is, for example, detection of the power supply of the mobile terminal 2 being turned off, or detection of the engine of the moving object being turned off.
[0169] The movement processing unit 23 determines, for example, an attribute value set that matches the inquiry received by the movement receiving unit 22, and acquires from the movement storage unit 21 a video that is paired with the attribute value set.
[0170] The movement processing unit 23 acquires, for example, a video from the start of movement to the end of movement. The movement processing unit 23 acquires, for example, a video from the start of movement to the end of movement in association with a set of attribute values acquired during the movement.
[0171] The movement processing unit 23, for example, acquires an attribute value set during shooting. The movement processing unit 23 accumulates the acquired attribute value set in the movement storage unit 21. The movement processing unit 23 also associates the acquired attribute value set with a moving image, for example. Associating with a moving image usually means associating with a frame that constitutes the moving image. It is preferable that the attribute value set and the frame are synchronized in time.
[0172] The attribute value set is, for example, one or more pieces of environmental information, such as location information, time information, weather information, temperature information, and season information.
[0173] The movement processing unit 23 acquires location information, for example, during shooting. The movement processing unit 23 having a function of a GPS receiver acquires location information, for example. The movement processing unit 23 acquires location information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied. The acquisition condition is a condition for acquiring information. The acquisition condition is, for example, when an accident is detected, when a traffic jam is detected, or when there is a change in weather information.
[0174] The movement processing unit 23 acquires time information from a clock (not shown) during shooting, for example. The movement processing unit 23 acquires time information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
[0175] For example, during shooting, the movement processing unit 23 acquires time information from a clock (not shown) and acquires season information corresponding to the time information.
[0176] The movement processing unit 23 acquires weather information, for example, during shooting. The movement processing unit 23 acquires weather information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
[0177] The movement processing unit 23 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed on a moving object. The movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
[0178] The movement processing unit 23, for example, judges whether the acquired attribute value set matches the preservation condition. The movement processing unit 23, for example, judges whether the acquired time-series attribute value set matches the preservation condition. For example, when the preservation condition is met, the movement processing unit 23 acquires a video corresponding to the attribute value set. For example, when the preservation condition is met, the movement processing unit 23 acquires a video corresponding to the preservation condition. For example, when the preservation condition is met, the movement processing unit 23 acquires acquisition information paired with the preservation condition, and acquires a video according to the acquisition information.
[0179] It is preferable that the movement processing unit 23 includes, for example, a microphone, acquires sound information, and stores the sound information in association with the video acquired by the imaging unit 231. Such a function is, for example, a function of a drive recorder.
[0180] The photographing unit 231 photographs a moving image. The photographing unit 231 starts photographing after detecting the start of movement, for example. It is preferable that the photographing unit 231 continues photographing until detecting the end of movement, for example.
[0181] It is preferable that the imaging unit 231 stores the captured video in the moving storage unit 21. When storing video in the moving storage unit 21 with a limited storage capacity, it is preferable that the imaging unit 231 overwrites new video in an area in which old video is stored. In other words, it is preferable that the structure of the moving storage unit 21 is a ring buffer structure.
[0182] The tag acquiring unit 232 acquires one or more tags for the video captured by the imaging unit 231 and associates them with the video.
[0183] The tag acquisition unit 232, for example, analyzes a moving image captured by the image capture unit 231 and acquires one or more tags for the moving image.
[0184] The tag acquiring unit 232 acquires one or more tags, for example, by using one or more moving object attribute values acquired during shooting by the shooting unit 231. The moving object attribute values are, for example, CAN data.
[0185] For example, the tag acquiring unit 232 determines one or more still images that match the video tag condition, and acquires a tag that is paired with the video tag condition. The tag acquiring unit 232 may also associate the tag with the one or more still images. Note that the still images are frames that constitute the video.
[0186] For example, if the video tag condition is "the number of cars whose front-to-back intervals are within a threshold is equal to or greater than a threshold and the moving speed of the cars is equal to or less than a threshold" and the tag paired with the video tag condition is "traffic jam", the tag acquisition unit 232 analyzes frames of the video, recognizes two or more cars, and acquires the intervals between the two or more cars. The tag acquisition unit 232 also acquires the number of cars whose intervals are within a threshold. The tag acquisition unit 232 also acquires the moving distance and frame rate of one car in two or more frames, and acquires the speed of the car. Then, the tag acquisition unit 232 uses the number of cars whose intervals are within a threshold and the speed of the car to determine whether or not the video tag condition is met. Then, if the video tag condition is met, the tag acquisition unit 232 acquires the tag "traffic jam" paired with the video tag condition. The tag acquisition unit 232 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.
[0187] For example, the tag acquiring unit 232 determines one or more moving object attribute values that match the attribute value tag condition, and acquires a tag that is paired with the attribute value tag condition. The tag acquiring unit 232 may also associate the tag with a video that is paired with the one or more moving object attribute values.
[0188] For example, if the attribute value tag condition is "driving time at a speed less than 30 km for 10 minutes or more & the ratio of the speed less than 30% during the driving time is 80% or more" and the tag paired with the attribute value tag condition is "traffic jam", the tag acquisition unit 232 detects CAN data that matches the attribute value tag condition using the speed history of the CAN data associated with each field of the video, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is the CAN data acquired at the same timing as the field was shot.
[0189] The movement information acquisition unit 233 detects movement of the mobile terminal 2, and acquires movement information, for example, at the start of the movement. The movement information acquisition unit 233 acquires movement information, which is, for example, a right holder identifier of the movement storage unit 21. The movement information acquisition unit 233 acquires, for example, the movement information of the movement storage unit 21. The movement information is, for example, a right holder identifier and information indicating that movement has started.
[0190] The movement transmitting unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, movement information, a video, and a set of attribute values.
[0191] The movement information transmission unit 241 normally transmits, at the start of movement, movement information specifying that the mobile terminal 2 is moving, to the information processing device 1. The movement information transmission unit 241 transmits the movement information acquired by the movement information acquisition unit 233 to the information processing device 1.
[0192] The movement video sending unit 242 sends the video captured by the imaging unit 231 to the information processing device 1. The timing at which the movement video sending unit 242 sends the video does not matter. For example, after the movement processing unit 23 acquires a video paired with an attribute value set that matches the query received, the movement video sending unit 242 sends the video to the information processing device 1. For example, when the movement processing unit 23 detects the end of the movement, the movement video sending unit 242 sends the video accumulated after the detection of the start of the movement to the information processing device 1. For example, when it is determined that the conservation conditions are met, the movement video sending unit 242 sends the video corresponding to the determination to the information processing device 1.
[0193] It is preferable that the mobile transmission unit 24 does not transmit the sound information acquired by the mobile processing unit 23 even if it transmits the video captured by the imaging unit 231 to the information processing device 1. The sound information may be, for example, voice information of the driver or passengers in the moving object, and transmitting such sound information to the information processing device 1 and providing it to the user terminal 3 or the like may threaten the privacy of the driver or passengers, which is not appropriate.
[0194] The set sending unit 243 sends the attribute value set in the movement storage unit 21 to the information processing device 1. For example, the set sending unit 243 sends the attribute value set in the movement storage unit 21 to the information processing device 1 when the movement of the mobile terminal 2 ends. Note that upon acquiring the attribute value set, the set sending unit 243 may immediately send the attribute value set to the information processing device 1. That is, the timing at which the set sending unit 243 sends the attribute value set does not matter.
[0195] Various types of information are stored in the user storage unit 31 constituting the user terminal 3. The various types of information are, for example, a user identifier and a video.
[0196] The user reception unit 32 receives various instructions and information, such as inquiries and purchase instructions.
[0197] It should be noted that a purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information that identifies a video. The purchase instruction has, for example, a video identifier. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, a purchase price. The purchase conditions include, for example, information that identifies a rights period.
[0198] The means for inputting various instructions and information may be any means, such as a touch panel, a keyboard, a mouse, or a menu screen.
[0199] The user processing unit 33 performs various processes. For example, the various processes are processes for creating a data structure for transmitting various instructions and information received by the user receiving unit 32. For example, the various processes are processes for creating a structure for transmitting information received by the user receiving unit 35.
[0200] The user transmission unit 34 transmits various instructions and information to the information processing device 1. The various instructions and information are, for example, an inquiry, a purchase instruction, location information received from the target terminal 4, and route information received from the navigation terminal 5.
[0201] The user receiving unit 35 receives various types of information and instructions, such as inquiries, videos, and status information.
[0202] The user output unit 36 outputs various types of information, such as video and status information.
[0203] Here, output is a concept that includes display on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and handing over the processing results to other processing devices or other programs, etc.
[0204] The target terminal 4 acquires and transmits location information that identifies the location of the target terminal 4. The target terminal 4 transmits the location information to, for example, the information processing device 1 or the user terminal 3. It is preferable that the target terminal 4 transmits the location information in pair with a target identifier. The target identifier is information that identifies the monitoring target. The target identifier is, for example, an ID, name, telephone number, email address, or MAC address of the target terminal 4. The target terminal 4 acquires the location information by, for example, a GPS receiver, but the method of acquiring the location information is not important.
[0205] The navigation terminal 5 has the functions of a known navigation terminal. The navigation terminal 5 accepts input of a destination, acquires a current position, and acquires route information from the current position to the destination. The navigation terminal 5, for example, transmits the accepted destination. The navigation terminal 5 transmits, for example, the acquired route information. The destination or route information is transmitted to, for example, the information processing device 1 or the user terminal 3. The navigation terminal 5 may receive a destination from the user terminal 3, and acquire route information from the current position to the destination.
[0206] The storage unit 11, the collection storage unit 111, the moving storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0207] There is no restriction on the process by which information is stored in the storage unit 11, etc. For example, information may be stored in the storage unit 11, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 11, etc., or information inputted via an input device may be stored in the storage unit 11, etc.
[0208] The receiving unit 12, the mobile information receiving unit 121, the inquiry receiving unit 122, the collective receiving unit 123, the mobile receiving unit 22, and the user receiving unit 35 are typically realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.
[0209] The processing unit 13, movement information storage unit 131, collection storage unit 132, video acquisition unit 133, video composition unit 134, rights holder processing unit 135, first maintenance means 1351, second maintenance means 1352, third maintenance means 1353, fourth maintenance means 1354, reward means 1355, movement processing unit 23, tag acquisition unit 232, movement information acquisition unit 233, and user processing unit 33 can typically be realized from a processor, memory, etc.
[0210] The processing procedures of the processing unit 13 and the like are usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, or the like, and the type is not important.
[0211] The video acquisition unit 133 and the right holder processing unit 135 may be realized by a wireless or wired communication means.
[0212] The transmitting unit 14, the video transmitting unit 141, the status transmitting unit 142, the needs transmitting unit 143, the mobile transmitting unit 24, the mobile information transmitting unit 241, the mobile video transmitting unit 242, the collective transmitting unit 243, and the user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.
[0213] The photographing unit 231 is realized by a camera. The camera may be, for example, a CCD camera, a CMOS camera, a 3D camera, a LiDAR, or an omnidirectional camera, but the type is not limited thereto.
[0214] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen.
[0215] The user output unit 36 may or may not include an output device such as a display, a speaker, etc. The user output unit 36 may be realized by driver software for an output device, or a combination of driver software for an output device and the output device, etc.
[0216] Next, a description will be given of an example of the operation of the information system A. First, a description will be given of an example of the operation of the information processing device 1 with reference to the flowchart of FIG.
[0217] (Step S401) The movement information receiving unit 121 judges whether or not movement information associated with a right holder identifier has been received from the mobile terminal 2. If movement information has been received, the process proceeds to step S402, and if not, the process proceeds to step S403.
[0218] (Step S402) The movement information receiving unit 121 associates the movement information received in step S401 with the right holder identifier and accumulates it in the storage unit 11. Return to step S401. Note that if the movement information is a right holder identifier, the movement information receiving unit 121 accumulates the right holder identifier.
[0219] (Step S403) The set receiving unit 123 judges whether or not an attribute value set associated with the right holder identifier has been received from the mobile terminal 2. If an attribute value set has been received, the process proceeds to step S404, and if not, the process proceeds to step S406.
[0220] (Step S404) The set accumulation unit 132 accumulates the set of attribute values received in step S403 in the set storage unit 111 in association with the right holder identifier.
[0221] (Step S405) The processing unit 13 deletes the movement information corresponding to the right holder identifier from the storage unit 11. Return to step S401. Note that deleting the movement information is equivalent to "rewriting the movement information to information indicating that the video is not in a state where it can be transmitted."
[0222] (Step S406) The receiving unit 12 judges whether or not a video or the like associated with the right holder identifier has been received from the mobile terminal 2. If a video or the like has been received, the process proceeds to step S407, and if not, the process proceeds to step S410.
[0223] (Step S407) The processing unit 13 performs a process of acquiring an attribute value set corresponding to the moving image received in step S406. An example of such an attribute value set acquisition process will be described with reference to the flowchart of Fig. 5. The attribute value set acquisition process here may be a process of acquiring an attribute value set associated with the received moving image.
[0224] (Step S408) The first maintenance means 1351 stores the video received in step S406 in association with the attribute value set acquired in step S407. Note that the first maintenance means 1351 stores the video in the storage unit 11, for example, but may store the video in another device such as a device constituting a blockchain. Also, the process in which the first maintenance means 1351 stores the video is the first maintenance process.
[0225] (Step S409) The fourth maintenance means 1354 performs a fourth maintenance process. Return to step S401. An example of the fourth maintenance process will be described with reference to the flowchart in FIG.
[0226] (Step S410) The inquiry receiving unit 122 judges whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to step S411, and if not, the process proceeds to step S414. The inquiry receiving unit 122 normally receives an inquiry from the user terminal 3 or the navigation terminal 5. The navigation terminal 5 that transmits the inquiry may be the user terminal 3.
[0227] (Step S411) The video acquisition unit 133 judges whether the received query is a real-time video search. If it is a real-time video search, the process proceeds to step S412, and if it is not a real-time video search, the process proceeds to step S415. This judgment can be made by inspecting the received query. A real-time video search is a process in which the mobile terminal 2 searches for videos that it is currently holding and videos that are being shot.
[0228] (Step S412) The video acquisition unit 133 judges whether the received query requires spatial fusion of two or more videos. If spatial fusion is required, the process proceeds to step S413. If spatial fusion is not required, the process proceeds to step S414. Note that such a judgment can be made by inspecting the received query.
[0229] (Step S413) The moving image acquisition unit 133, the moving image composition unit 134, etc. perform moving image fusion processing. Go to step S418. The moving image fusion processing is a process of spatially fusing two or more moving images to acquire and transmit an image having one or more frames. An example of the moving image fusion processing will be described with reference to the flowchart of FIG. 9.
[0230] (Step S414) The moving image acquisition unit 133, the moving image composition unit 134, etc. perform moving image combination processing. Go to step S418. The moving image combination processing is processing for transmitting one moving image in which two or more moving images are interrelatedly combined. An example of the moving image combination processing will be described with reference to the flowchart of FIG. 11.
[0231] (Step S415) The moving image acquiring unit 133 and the like perform a registered moving image search process. An example of the registered moving image search process will be described with reference to the flowchart in Fig. 12. Note that there may be a case where the moving image acquiring unit 133 cannot acquire a moving image.
[0232] (Step S416) The moving image acquiring unit 133 judges whether or not the moving image was acquired in step S415. If the moving image was acquired, the process proceeds to step S417, and if the moving image was not acquired, the process proceeds to step S418.
[0233] (Step S417) The moving image acquiring unit 133 performs an unregistered moving image search process. An example of the unregistered moving image search process will be described with reference to the flowcharts of Fig. 13 and Fig. 14. Note that there may be a case where the moving image acquiring unit 133 cannot acquire a moving image.
[0234] (Step S418) The right holder processing unit 135 performs a security process. Return to step S401. An example of the security process will be described with reference to the flowchart in FIG.
[0235] (Step S419) The receiving unit 12 judges whether or not a purchase instruction has been received from the user terminal 3. If a purchase instruction has been received, the process proceeds to step S420, and if not, the process returns to step S401.
[0236] (Step S420) The video acquisition unit 133 acquires a video corresponding to the purchase instruction. For example, the video acquisition unit 133 receives the video corresponding to the purchase instruction from the mobile terminal 2. For example, the video acquisition unit 133 acquires the video corresponding to the purchase instruction from registered videos. For example, the video acquisition unit 133 may acquire the video corresponding to the purchase instruction from unregistered videos.
[0237] (Step S421) The fourth security means 1354 acquires a user identifier corresponding to the user terminal 3 that has transmitted the purchase instruction. This user identifier becomes the right holder identifier for the purchased video.
[0238] (Step S422) The fourth security means 1354 performs a fourth security process using the user identifier acquired in step S416. An example of the fourth security process will be described with reference to the flowchart of FIG.
[0239] (Step S423) The compensation means 1355 performs compensation processing for the original rights holder of the purchased video. Return to step S401. An example of the compensation processing will be described with reference to the flowchart of FIG.
[0240] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt is issued to end the process.
[0241] Also, in the flowchart of Figure 4, it is preferable that the receiver 12 receives and temporarily stores location information that identifies the current location of the mobile terminal 2, paired with an identifier (e.g., a rights holder identifier) of the mobile terminal 2, from each of two or more mobile terminals 2. The frequency or time interval at which the receiver 12 receives and temporarily stores the location information is not important. The receiver 12, for example, continuously receives and temporarily stores the location information. The receiver 12, for example, periodically receives and temporarily stores the location information.
[0242] 4, the receiving unit 12 may receive, for example, continuously, location information from the user terminal 3, the target terminal 4, or the navigation terminal 5. In this case, the information processing device 1 may receive, for example, a video acquired by the mobile terminal 2 using the received location information, and transmit the video to the user terminal 3 or the navigation terminal 5. Note that the frequency or time interval at which the location information is continuously received does not matter.
[0243] Next, an example of the attribute value set acquisition process in step S407 will be described with reference to the flowchart in FIG.
[0244] (Step S501) The movement processing unit 23 or the collection storage unit 132 (hereinafter referred to as the movement processing unit 23, etc.) acquires one or more pieces of environmental information etc. associated with a target moving image. The target moving image is a moving image for which a moving image attribute value is to be acquired, such as a received moving image, a shot moving image, or a moving image being shot. The environmental information etc. may be only environmental information, or may be environmental information and one or more moving object attribute values.
[0245] (Step S502) The movement processing unit 23 or the like acquires a rights holder identifier associated with the received moving image.
[0246] (Step S503) The movement processing unit 23 etc. judge whether or not to perform annotation processing on the moving image. If annotation processing is to be performed, the process proceeds to step S504, and if not, the process proceeds to step S511. It is assumed that whether or not annotation processing is to be performed is determined in advance. Also, it is preferable to perform annotation on the moving image on either the information processing device 1 or the mobile terminal 2.
[0247] (Step S504) The movement processing unit 23 and the like assign 1 to the counter i.
[0248] (Step S505) The movement processing unit 23 etc. judge whether or not the i-th annotation unit exists in the video. If the i-th annotation unit exists, the process proceeds to step S506, and if not, the process proceeds to step S511. Note that the annotation unit is the subject from which annotation is acquired, and is, for example, one frame, a certain number of frames, or a video of a certain time (for example, 5 seconds, 10 seconds).
[0249] (Step S506) The movement processing unit 23 etc. judges whether or not to use the moving object attribute value at the time of annotation. If the moving object attribute value is to be used, the process proceeds to step S507, and if not, the process proceeds to step S508. It is assumed that whether or not to use the moving object attribute value at the time of annotation is determined in advance.
[0250] (Step S507) The movement processing unit 23 etc. performs a moving object attribute value tag acquisition process. An example of the moving object attribute value tag acquisition process will be described with reference to the flowchart of FIG.
[0251] (Step S508) The movement processing unit 23 etc. judge whether or not to use a moving image when making an annotation. If a moving image is to be used, the process proceeds to step S509, and if not, the process proceeds to step S510. It is assumed that it is previously determined whether or not a moving image is to be used when making an annotation.
[0252] (Step S509) The movement processing unit 23 etc. perform a moving image tag acquisition process. An example of the moving image tag acquisition process will be described with reference to the flowchart of FIG.
[0253] (Step S510) The movement processing unit 23 and the like increment the counter i by 1. The process returns to step S505.
[0254] (Step S511) The movement processing unit 23 etc. configures an attribute value set having one or more pieces of environment information, one or more tags, and a rights holder identifier, and returns to the upper level process.
[0255] In the flowchart of FIG. 5, the moving image may be divided into two or more inspection units, and the processes from step S501 to step S511 may be performed for each inspection unit.
[0256] Next, an example of the moving object attribute value tag acquisition process in step S507 will be described with reference to the flowchart in FIG.
[0257] (Step S601) The movement processing unit 23 and the like assign 1 to a counter i.
[0258] (Step S602) The movement processing unit 23 etc. judge whether or not the i-th attribute value tag condition exists. If the i-th attribute value tag condition exists, the process proceeds to step S603, and if not, the process returns to the upper process.
[0259] (Step S603) The movement processing unit 23 etc. acquire the i-th attribute value tag condition.
[0260] (Step S604) The movement processing unit 23 etc. acquire one or more moving object attribute values to be used for determining the i-th attribute value tag condition.
[0261] (Step S605) The movement processing unit 23 etc. judges whether or not one or more moving object attribute values acquired in step S604 satisfy the i-th attribute value tag condition. If they satisfy the attribute value tag condition, the process proceeds to step S606, and if they do not, the process proceeds to step S607.
[0262] (Step S606) The movement processing unit 23 etc. acquires a tag that is paired with the i-th attribute value tag condition, and associates the tag with the corresponding moving image. Associating a tag with a moving image usually means associating the tag with a field that constitutes the moving image.
[0263] (Step S607) The movement processing unit 23 and the like increment the counter i by 1. The process returns to step S602.
[0264] Next, an example of the video tag acquisition process in step S509 will be described with reference to the flowchart in FIG.
[0265] (Step S701) The movement processing unit 23 and the like assign 1 to a counter i.
[0266] (Step S702) The movement processing unit 23 etc. judge whether or not the i-th video tag condition exists. If the i-th video tag condition exists, the process proceeds to step S703, and if not, the process returns to the upper process.
[0267] (Step S703) The movement processing unit 23 etc. acquire the i-th moving image tag condition.
[0268] (Step S704) The movement processing unit 23 etc. acquire one or more moving image attribute values used for determining the i-th moving image tag condition.
[0269] (Step S705) The movement processing unit 23 etc. judges whether or not one or more moving object attribute values acquired in step S704 satisfy the i-th attribute value tag condition. If they satisfy the attribute value tag condition, the process proceeds to step S706, and if they do not, the process proceeds to step S707.
[0270] (Step S706) The movement processing unit 23 or the like acquires a tag that is paired with the i-th attribute value tag condition, and associates the tag with the corresponding video. Associating a tag with a video is usually performed by:
[0271] (Step S707) The movement processing unit 23 and the like increment the counter i by 1. The process returns to step S702.
[0272] Next, an example of the fourth maintenance process in step S409 will be described with reference to the flowchart in FIG.
[0273] (Step S801) The fourth security means 1354 acquires access information for identifying a storage destination of a moving image. Note that the moving image is, for example, a fused moving image or a combined moving image.
[0274] (Step S802) The fourth maintenance means 1354 acquires an attribute value set corresponding to the stored moving image. If the stored moving image is composed of two or more original moving images, the attribute value set corresponding to the moving image is the attribute value set of each of the two or more original moving images.
[0275] (Step S803) The fourth security means 1354 constructs security information having the access information acquired in step S801, the attribute value set acquired in step S802, and the right holder identifier of the video. Note that, if a new right holder identifier has been acquired, the fourth security means 1354 constructs security information including, for example, the new right holder identifier and the original right holder identifier. (Step S804) The fourth maintenance means 1354 accumulates the maintenance information configured in step S803, and returns to the upper level processing.
[0276] In step S804, if preservation information of a video corresponding to the preservation information to be stored is stored, the preservation information configured in step S803 is overwritten with the preservation information. This makes it possible to manage, for example, the transition of the rights holder of the video. Furthermore, the fourth preservation means 1354 stores the preservation information in, for example, a block chain.
[0277] Next, an example of the moving image fusion process in step S413 will be described with reference to the flowchart in FIG.
[0278] (Step S901) The video acquisition unit 133 acquires reference location information. The reference location information is, for example, location information included in the received inquiry. The reference location information is, for example, location information of the user terminal 3 or the target terminal 4. The reference location information is, for example, one piece of location information in the route information included in the inquiry. The one piece of location information is the first piece of location information in the route information. The location information is, for example, (latitude, longitude), but may also be a location name (for example, the name of a parking lot), a place name, etc.
[0279] (Step S902) The moving image obtaining unit 133 assigns 1 to a counter i.
[0280] (Step S903) The video acquisition unit 133 judges whether or not there is an i-th mobile terminal 2 to which the video can be transmitted. If there is an i-th mobile terminal 2, the process proceeds to step S904, and if there is no i-th mobile terminal 2, the process proceeds to step S908. Note that a mobile terminal 2 to which the video can be transmitted is usually a mobile terminal 2 that is moving.
[0281] The mobile terminal 2 in motion is the mobile terminal 2 corresponding to the motion information stored in the storage unit 11. That is, the video acquisition unit 133, for example, refers to the storage unit 11 and determines whether or not the i-th motion information exists.
[0282] (Step S904) The video acquiring unit 133 acquires the latest location information transmitted by the i-th mobile terminal 2.
[0283] (Step S905) The video acquisition unit 133 judges whether the location information acquired in step S904 satisfies a second location condition with respect to the reference location information. If the second location condition is satisfied, the process proceeds to step S906, and if the second location condition is not satisfied, the process proceeds to step S907.
[0284] (Step S906) The video acquiring unit 133 acquires an image from the i-th mobile terminal 2, pairs the image with the right holder identifier and location information of the i-th mobile terminal 2, and temporarily stores the image in a buffer (not shown).
[0285] In addition, the video acquisition unit 133 sends, for example, an inquiry to the i-th mobile terminal 2, including a type identifier that specifies the type of image requested (for example, "video", "still image", or "around view image"), and receives an image corresponding to the inquiry from the i-th mobile terminal 2.
[0286] (Step S907) The moving image obtaining unit 133 increments the counter i by 1. The process returns to step S903.
[0287] (Step S908) The moving image composing unit 134 calculates the difference (distance) between each image temporarily stored in a buffer (not shown) and the reference position information. The moving image composing unit 134 sorts the images in ascending order using the difference as a key.
[0288] (Step S909) The moving image composing unit 134 acquires a reference image. The reference image is an image corresponding to the reference position information. The reference image is, for example, an image transmitted from a user terminal 3 that is present at the position of the reference position information. Note that this image is an image of a type identified by a type identifier that specifies the type of image requested.
[0289] (Step S910) The moving image composing unit 134 assigns 1 to a counter j.
[0290] (Step S911) The moving image composing unit 134 judges whether or not the jth other image exists. If the jth other image exists, the process proceeds to step S912, and if not, the process proceeds to step S914. The other images are the images sorted in step S908.
[0291] (Step S912) The moving image composition unit 134 performs image fusion processing. An example of the image fusion processing will be described with reference to the flowchart of FIG.
[0292] (Step S913) The moving image composing unit 134 increments the counter j by 1. The process returns to step S911.
[0293] (Step S914) The moving image constructing unit 134 constructs an image indicating the position indicated by the reference position information in the fusion image finally constructed in step S912, and temporarily stores the image in a buffer (not shown). Note that this image is a fusion image.
[0294] (Step S915) The video transmission unit 141 transmits the fusion image constructed in step S914. Note that the video transmission unit 141 may transmit the fusion image finally constructed in step S912. The destination of the fusion image is usually the user terminal 3 that transmitted the inquiry.
[0295] (Step S916) The moving image transmitting unit 141 judges whether or not to end the transmission of the fusion image. If the transmission of the fusion image is to be ended, the process proceeds to step S917, and if not, the process returns to step S901.
[0296] When an end instruction is received from the user terminal 3 that has transmitted the inquiry, the video transmitting unit 141 determines to end the transmission of the fusion image.
[0297] (Step S917) The moving image constructing unit 134 temporally combines the one or more fusion images transmitted, constructs a fusion moving image, and temporarily stores the fusion moving image in a buffer (not shown).The process returns to the upper level process.
[0298] Next, an example of the image fusion process in step S912 will be described with reference to the flowchart in FIG.
[0299] (Step S1001) The moving image composition unit 134 acquires a base image. The initial base image is the reference image acquired in step S909. The base image is also the base image updated in step S1005 in the previous loop from step S911 to step S913.
[0300] (Step S1002) The video composing unit 134 acquires area information that identifies the area covered by the base image acquired in step S1001. Note that the area information is, for example, a set of position information of vertices that configure a polygon, or a set of position information of two diagonal corners that configure a rectangle.
[0301] (Step S1003) The moving image composing unit 134 acquires the j-th other image in step S911.
[0302] (Step S1004) The moving image composing unit 134 obtains area information that specifies the area covered by the other images obtained in step S1003.
[0303] (Step S1005) The video composition unit 134 uses the area information of the base image and the area information of the other image to determine an area in which the other image is to be placed with respect to the base image, places the other image in the determined area, and obtains an updated base image. The process returns to the upper level process.
[0304] Next, an example of the moving image combining process in step S414 will be described with reference to the flowchart in FIG.
[0305] (Step S1101) The video acquisition unit 133 acquires location information of a target. The location information of the target is usually location information included in a query. The location information of the target is, for example, information that identifies a location close to a location indicated by location information corresponding to the video to be acquired.
[0306] (Step S1102) The moving image obtaining unit 133 assigns 1 to a counter i.
[0307] (Step S1103) The video acquisition unit 133 judges whether or not there is an i-th mobile terminal 2 to which a video can be transmitted. If there is an i-th mobile terminal 2, the process proceeds to step S1104. If there is no i-th mobile terminal 2, the process proceeds to step S1114. Note that a mobile terminal 2 to which a video can be transmitted is usually a mobile terminal 2 that is moving. A mobile terminal 2 that is moving is a mobile terminal 2 that corresponds to the movement information stored in the storage unit 11.
[0308] The mobile terminal 2 in motion is the mobile terminal 2 corresponding to the motion information stored in the storage unit 11. That is, the video acquisition unit 133, for example, refers to the storage unit 11 and determines whether or not the i-th motion information exists.
[0309] (Step S1104) The video acquiring unit 133 acquires the latest location information transmitted by the i-th mobile terminal 2.
[0310] (Step S1105) The video acquisition unit 133 judges whether or not the location information of the i-th mobile terminal 2 satisfies the first location condition for the target location information. If the first location condition is satisfied, the process proceeds to step S1106, and if the first location condition is not satisfied, the process proceeds to step S1110.
[0311] (Step S1106) The video acquiring unit 133 acquires the video from the i-th mobile terminal 2, pairs the video with the right holder identifier and location information of the i-th mobile terminal 2, and temporarily accumulates the video in a buffer (not shown).
[0312] In addition, the video acquisition unit 133 may, for example, send an inquiry to the i-th mobile terminal 2, including a type identifier that identifies the type of image requested (e.g., "video" or "still image"), and receive an image corresponding to the inquiry from the i-th mobile terminal 2.
[0313] (Step S1107) The video transmitting unit 141 transmits the video acquired in step S1106. The video transmitting unit 141 normally transmits the video to the user terminal 3 that has transmitted the inquiry.
[0314] (Step S1108) The video acquisition unit 133 acquires the target location information. For example, if the target terminal 4 that transmits the location information is moving, the target location information acquired here differs from the location information acquired in step S1101. However, if the target terminal 4 is not moving, if an inquiry having one fixed location information is received, etc., the target location information acquired here is the same as the location information acquired in step S1101.
[0315] (Step S1109) The video obtaining unit 133 obtains the updated location information of the i-th mobile terminal 2. The process returns to step S1105.
[0316] (Step S1110) Moving image composing unit 134 judges whether or not there is a transmitted moving image, which is a moving image acquired by i-th mobile terminal 2. If there is a transmitted moving image, the process proceeds to step S1111, and if there is no transmitted moving image, the process proceeds to step S1113.
[0317] (Step S1111) The video composition unit 134 composes a combined video that is the video acquired by the i-th mobile terminal 2 and includes the transmitted video, and temporarily stores the combined video in a buffer not shown, paired with the rights holder identifier of the i-th mobile terminal 2.
[0318] In the first processing step S1111, the combined moving image is the moving image acquired and transmitted by the i-th mobile terminal 2. In the processing step S1111 from the second iteration of the loop processing onwards, the combined moving image is the moving image acquired and transmitted by the i-th mobile terminal 2 that is next in time to the combined moving images acquired in the processing up to that point.
[0319] (Step S1112) The moving image obtaining unit 133 assigns 1 to the counter i. Then, the process returns to step S1103.
[0320] (Step S1113) The moving image obtaining unit 133 increments the counter i by 1. The process returns to step S1103.
[0321] (Step S1114) The moving image acquisition unit 133 judges whether or not to end the moving image combination process. If it is to be ended, the process proceeds to step S1115, and if it is not to be ended, the process proceeds to step S1116.
[0322] For example, if there is no next location information included in the received inquiry, or if an end instruction is received, the video acquisition section 133 determines to end the video combination process.
[0323] (Step S1115) The video acquisition unit 133 acquires the next target position information. For example, the video acquisition unit 133 acquires the next target position information included in the route information that the inquiry has. Return to step S1103.
[0324] (Step S1116) Moving image composing unit 134 links one or more combined moving images composed in step S1111 in the order in which they were acquired to compose a combined moving image to be stored. Next, moving image composing unit 134 pairs the combined moving image with two or more right holder identifiers and location information of the original moving images of the combined moving image, and temporarily stores the combined moving image in a buffer (not shown). The process returns to the upper level process.
[0325] Next, an example of the registered moving image search process in step S415 will be described with reference to the flowchart in FIG.
[0326] (Step S1201) The moving image obtaining unit 133 assigns 1 to a counter i.
[0327] (Step S1202) The video acquisition unit 133 judges whether or not the i-th target location information is present in the received query. If the i-th location information is present, the process proceeds to step S1203, and if not, the process proceeds to step S1217.
[0328] The target location information is location information used for searching for videos. The target location information is, for example, one piece of location information in the received inquiry, or two or more pieces of location information included in the route information in the received inquiry.
[0329] (Step S1203) The video acquisition unit 133 acquires the i-th target location information in the received inquiry.
[0330] (Step S1204) The video acquisition unit 133 acquires all the preservation information. For example, the video acquisition unit 133 acquires the preservation information present on the blockchain.
[0331] (Step S1205) The moving image obtaining unit 133 assigns 1 to a counter j.
[0332] (Step S1206) The video acquisition unit 133 judges whether or not the j-th preservation information is present in the preservation information acquired in step S1204. If the j-th preservation information is present, the process proceeds to step S1207, and if not, the process proceeds to step S1216.
[0333] (Step S1207) The video acquisition unit 133 checks the j-th security information and judges whether the video corresponding to the j-th security information can be provided to a third party. If it can be provided, the process proceeds to step S1208, and if it cannot be provided, the process proceeds to step S1215. Note that being available means, for example, that it can be viewed, that it can be sold, or that it can be viewed and sold.
[0334] (Step S1208) The moving image obtaining unit 133 assigns 1 to a counter k.
[0335] (Step S1209) The video acquisition unit 133 judges whether or not the kth search unit exists in the jth preservation information or the video corresponding to the jth preservation information. If the kth search unit exists, the process proceeds to step S1210, and if not, the process proceeds to step S1215.
[0336] A search unit is a quantity of video that determines whether or not a query is satisfied. Videos in search units are, for example, video from the start to the end of shooting, video for a certain period of time, video until a predetermined event occurs (for example, video from a speed that is a moving object attribute value of 0 to the next speed 0, video from leaving a residence position (for example, a parking lot at home) to returning to the residence position), and video of a predetermined period before and after a predetermined tag (for example, "accident" or "traffic jam") is attached. However, the search unit is not important.
[0337] (Step S1210) The moving image acquiring unit 133 acquires a set of moving image attribute values of the kth search unit from the jth maintenance information.
[0338] (Step S1211) Video acquisition unit 133 judges whether or not a set of video attribute values of k-th search unit for i-th target location information satisfies a first location condition. If the first location condition is satisfied, the process proceeds to step S1212, and if not, the process proceeds to step S1214.
[0339] (Step S1212) The video acquisition unit 133 acquires a video etc. corresponding to the j-th security information, and temporarily stores it in a buffer (not shown). The video etc. is, for example, a set of video and video attribute values, or a video.
[0340] (Step S1213) The moving image obtaining unit 133 increments the counter i by 1. The process returns to step S1202.
[0341] (Step S1214) The moving image obtaining unit 133 increments the counter k by 1. The process returns to step S1209.
[0342] (Step S1215) The moving image obtaining unit 133 increments the counter j by 1. The process returns to step S1206.
[0343] (Step S1216) The moving image obtaining unit 133 increments the counter i by 1. The process returns to step S1202.
[0344] (Step S1217) The moving image composing unit 134 judges whether or not two or more moving images, etc. have been acquired in step S1212. If two or more moving images, etc. have been acquired, the process proceeds to step S1218, and if only one moving image, etc. has been acquired, the process proceeds to step S1219.
[0345] (Step S1218) The moving image composing unit 134 combines two or more moving images stored in a buffer (not shown) in the order in which they were stored, composes a combined moving image, and stores the combined moving image in a buffer (not shown). Note that it is preferable that the moving image composing unit 134 also associates the rights holder identifier and moving image attribute value of the original moving image to the combined moving image and stores them in a buffer (not shown).
[0346] (Step S1219) The moving image transmitting unit 141 transmits the combined moving image or the acquired moving image. Return to the upper-level processing. Return to the upper-level processing.
[0347] 12, each time a moving image is acquired in step S1212, the moving image transmission unit 141 may transmit the moving image. In this case, the process of step S1219 is not necessary.
[0348] In the flowchart of FIG. 12, the moving image sending unit 141 normally sends a combined moving image or a moving image to the user terminal 3 that has sent the inquiry.
[0349] Next, an example of the unregistered moving image search process in step S417 will be described with reference to the flowchart in Fig. 13. A first example of the unregistered moving image search process is a case where the attribute value set in the set storage unit 111 is used.
[0350] (Step S1301) The moving image obtaining unit 133 assigns 1 to a counter i.
[0351] (Step S1302) The video acquisition unit 133 judges whether or not the i-th target location information is present in the received query. If the i-th location information is present, the process proceeds to step S1303, and if not, the process proceeds to step S1320.
[0352] (Step S1303) The video acquisition unit 133 acquires the i-th target location information from the received inquiry.
[0353] (Step S1304) The moving image obtaining unit 133 assigns 1 to a counter j.
[0354] (Step S1305) Moving image obtaining unit 133 judges whether or not the j-th attribute value set exists in set storage unit 111. If the j-th attribute value set exists, the process proceeds to step S1303, and if not, the process proceeds to step S1319.
[0355] (Step S1306) The moving image obtaining unit 133 assigns 1 to a counter k.
[0356] (Step S1307) Video acquirer 133 determines whether or not the kth retrieval unit corresponding to the jth attribute value set exists. If the kth retrieval unit exists, the process proceeds to step S1308, and if not, the process proceeds to step S1313.
[0357] (Step S1308) Moving image acquiring section 133 acquires from set storage section 111 a set of moving image attribute values of the k-th search unit in the j-th attribute value set.
[0358] (Step S1309) Moving image acquiring unit 133 judges whether or not the set of moving image attribute values acquired in step S1308 satisfies the query. If it does, the process proceeds to step S1310, and if it does not, the process proceeds to step S1314.
[0359] (Step S1310) The moving image obtaining unit 133 obtains a rights holder identifier corresponding to the moving image.
[0360] (Step S1311) The video acquisition unit 133 determines whether or not there is movement information corresponding to the right holder identifier acquired in step S1310. If there is movement information (for example, when the power of the mobile terminal 2 is ON), the process proceeds to step S1312, and if there is no movement information (for example, when the power of the mobile terminal 2 is OFF), the process proceeds to step S1315.
[0361] (Step S1312) Video acquisition unit 133 acquires a video corresponding to the k-th search unit from mobile terminal 2 corresponding to the right holder identifier acquired in step S1310, and temporarily stores the video in a buffer (not shown). Note that video acquisition unit 133 transmits a request for a video corresponding to the k-th search unit to mobile terminal 2, for example, and receives a video corresponding to the request from mobile terminal 2.
[0362] (Step S1313) The moving image obtaining unit 133 increments the counter j by 1. The process returns to step S1305.
[0363] (Step S1314) The moving image obtaining unit 133 increments the counter k by 1. The process returns to step S1307.
[0364] (Step S1315) The video obtaining unit 133 obtains state information etc. Note that the state information etc. includes, for example, state information indicating that the power supply of the mobile terminal 2 is OFF.
[0365] (Step S1316) Status transmission unit 142 transmits the status information etc. acquired in step S1315 to the user who transmitted the inquiry.
[0366] (Step S1317) The video acquiring unit 133 acquires needs information.
[0367] (Step S1318) The needs transmitting unit 143 transmits the needs information acquired in step S1317 to the rights holder of the video. Return to step S1313.
[0368] (Step S1319) The moving image obtaining unit 133 increments the counter i by 1. The process returns to step S1302.
[0369] (Step S1320) Moving image composing unit 134 judges whether or not two or more moving images have been acquired in step S1312. If two or more moving images have been acquired, the process proceeds to step S1321, and if only one moving image has been acquired, the process proceeds to step S1322.
[0370] (Step S1321) The moving image composing unit 134 combines, in the order in which they were stored in step S1312, two or more moving images stored in a buffer (not shown), to compose one combined moving image, and stores the combined moving image in a buffer (not shown).
[0371] (Step S1322) The video sending unit 141 sends the combined video or a video. Then, the process returns to the upper level process. Note that the video sending unit 141 normally sends the combined video or a video to the user terminal 3 that has sent the inquiry.
[0372] Next, a second example of the unregistered moving image search process in step S417 will be described with reference to the flowchart of Fig. 14. The second example of the unregistered moving image search process is a case where an inquiry is made to the mobile terminal 2.
[0373] (Step S1401) The moving image obtaining unit 133 assigns 1 to a counter i.
[0374] (Step S1402) The video acquisition unit 133 judges whether or not the i-th target location information is present in the received query. If the i-th location information is present, the process proceeds to step S1403, and if not, the process proceeds to step S1412.
[0375] (Step S1403) The video acquiring unit 133 acquires the i-th target position information in the received inquiry.
[0376] (Step S1404) The moving image obtaining unit 133 assigns 1 to a counter j.
[0377] (Step S1405) The video acquisition unit 133 judges whether or not the j-th movement information exists in the storage unit 11. If the j-th movement information exists, the process proceeds to step S1403, and if not, the process returns to the upper level process.
[0378] (Step S1406) The video acquiring unit 133 transmits an inquiry to the mobile terminal 2 corresponding to the j-th movement information.
[0379] (Step S1407) The video acquisition unit 133 judges whether or not information corresponding to the j-th movement information has been received from the mobile terminal 2. If information has been received, the process proceeds to step S1408, and if not, the process returns to step S1407.
[0380] (Step S1408) The moving image obtaining unit 133 judges whether or not a moving image is included in the information received in step S1407. If a moving image is included, the process proceeds to step S1409, and if not, the process proceeds to step S1410.
[0381] (Step S1410) The moving image obtaining unit 133 temporarily stores the moving image etc. received in step S1407 in a buffer (not shown).
[0382] (Step S1411) The moving image obtaining unit 133 increments the counter j by 1. The process returns to step S1405.
[0383] (Step S1412) Moving image composing unit 134 judges whether or not two or more moving images have been stored in step S1409. If two or more moving images have been stored, the process proceeds to step S1413, and if only one moving image has been acquired, the process proceeds to step S1414.
[0384] (Step S1413) The moving image composer 134 combines the two or more moving images stored in the buffer (not shown) in step S1409 in the order in which they were stored, composes one combined moving image, and stores it in a buffer (not shown).
[0385] (Step S1414) The video sending unit 141 sends the combined video or a video. Then, the process returns to the upper level process. Note that the video sending unit 141 normally sends the combined video or a video to the user terminal 3 that has sent the inquiry.
[0386] Next, an example of the security process in step S418 will be described with reference to the flowchart in FIG.
[0387] (Step S1501) The right holder processing unit 135 stores the transmitted moving image in association with the attribute value set corresponding to each of one or more original moving images from which the transmitted moving image is based.
[0388] It is preferable that the right holder processing unit 135 stores a video paired with a right holder identifier that identifies one or more right holders of the video. The right holder identifier here is, for example, one or more right holder identifiers of the video that is the source of the stored video. The right holder identifier here is, for example, a single right holder identifier that identifies the user who made the inquiry.
[0389] Furthermore, the right holder processing unit 135 accumulates the video in, for example, the storage unit 11 or a device other than the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.
[0390] (Step S1502) The fourth maintenance means 1354 performs the fourth maintenance process. An example of the fourth maintenance process has been described with reference to the flowchart of FIG.
[0391] (Step S1503) The right holder processing unit 135 assigns 1 to the counter i.
[0392] (Step S1504) Rights holder processing unit 135 judges whether or not the i-th moving image that was the source of the stored moving image exists. If the i-th moving image exists, the process proceeds to step S1505, and if not, the process returns to the upper process.
[0393] (Step S1505) Reward means 1355 performs reward processing. An example of the reward processing will be described with reference to the flowchart in Fig. 16. The reward processing here is a processing for paying reward to the right holder of the i-th moving image that is the basis of the accumulated moving image.
[0394] (Step S1506) Rights holder processing unit 135 judges whether or not to change the rights holder of the i-th moving image that is the source of the stored moving image. If the rights holder is to be changed, the process proceeds to step S1507. If the rights holder is not to be changed, the process proceeds to step S1508.
[0395] In addition, whether or not to change the rights holder may be based on a flag corresponding to the i-th video, or may be decided in advance, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder."
[0396] (Step S1507) The right holder processing unit 135 acquires the user identifier of the user terminal 3. This user identifier becomes a new right holder identifier.
[0397] (Step S1508) The right holder processing unit 135 judges whether the i-th moving image that is the source of the stored moving image has been registered or not. If it has been registered, the process proceeds to step S1511, and if it has not been registered, the process proceeds to step S1509.
[0398] (Step S1509) The first maintenance means 1351 stores the i-th moving image that is the source of the stored moving images.
[0399] (Step S1510) The fourth maintenance means 1354 performs a fourth maintenance process on the i-th moving image that is the source of the stored moving image. An example of the fourth maintenance process has been described with reference to the flowchart of FIG.
[0400] (Step S1511) The right holder processing unit 135 increments the counter i by 1. The process returns to step S1504.
[0401] In the flowchart of Figure 15, when a combined video is constructed, a process of storing two or more videos that are the basis of the combined video (step S1509) and a fourth conservation process (step S1510) are performed, but such processes do not have to be performed.
[0402] Next, an example of the reward process in step S423 etc. will be described with reference to the flowchart in FIG.
[0403] (Step S1601) The reward means 1355 acquires one or more right holder identifiers of a target moving image. The reward means 1355 may acquire the right holder identifier of a previous right holder of the target moving image.
[0404] (Step S1602) The reward means 1355 acquires a set of attribute values of the target video.
[0405] (Step S1603) The reward unit 1355 acquires a service identifier that identifies a service provided to the target video. The service identifier is, for example, "view" or "purchase."
[0406] (Step S1604) The reward means 1355 acquires a reward amount using one or more pieces of information among the attribute value set acquired in step S1602 and the service identifier acquired in step S1603.
[0407] If two or more right holder identifiers are obtained, the remuneration means 1355 obtains a remuneration amount for each right holder identifier. If the history information of a right holder including two or more right holder identifiers is obtained, the remuneration means 1355 may obtain a remuneration amount for each right holder identifier.
[0408] In addition, it is preferable that the remuneration means 1355, for example, acquires a moving image attribute value corresponding to each of two or more moving images that are the basis of the moving image transmitted by the moving image transmission unit 141, and determines a remuneration amount for each of two or more right holders using the moving image attribute value. It is preferable that the remuneration means 1355, for example, determines a larger remuneration amount as the data amount, the time of the moving image, or the number of frames of the original moving image adopted in the moving image transmitted by the moving image transmission unit 141 increases. It is preferable that the remuneration means 1355, for example, determines a larger remuneration amount as the resolution of the original moving image adopted in the moving image transmitted by the moving image transmission unit 141 increases.
[0409] (Step S1605) The reward means 1355 performs a process of giving a reward of the reward amount acquired in step S1604 to the right holder identified by the right holder identifier acquired in step S1601.
[0410] (Step S1606) The remuneration means 1355 performs a process of charging the user who has enjoyed the service related to the target video with a remuneration. The process returns to the upper level process. Note that the target video is usually a video transmitted to the user terminal 3.
[0411] In the flowchart of FIG. 16, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.
[0412] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.
[0413] (Step S1701) The movement processing unit 23 judges whether or not the start of movement has been detected. If the start of movement has been detected, the process proceeds to step S1702, and if not, the process proceeds to step S1717. Note that the start of movement is, for example, when the engine of the moving object on which the mobile terminal 2 is installed is turned on, or when the power of the mobile terminal 2 is turned on.
[0414] (Step S1702) The movement information acquisition unit 233 acquires movement information. The movement information transmission unit 241 transmits the movement information to the information processing device 1. Note that the movement information is stored in the movement storage unit 21, for example.
[0415] (Step S1703) The photographing unit 231 starts photographing.
[0416] (Step S1704) The image capturing unit 231 acquires a moving image.
[0417] (Step S1705) The movement processing unit 23 acquires one or more moving image attribute values, and associates the one or more moving image attribute values with the moving image acquired in step S1704.
[0418] The movement processing unit 23 acquires, for example, location information, time information, weather information, temperature information, and season information. In addition, the movement processing unit 23 acquires, for example, one or more moving object attribute values (for example, CAN data).
[0419] (Step S1706) The tag acquiring unit 232 judges whether or not to acquire a moving object attribute value tag. If a moving object attribute value tag is to be acquired, the process proceeds to step S1707, and if not, the process proceeds to step S1709. Note that whether or not to acquire a moving object attribute value tag is determined in advance.
[0420] (Step S1707) The tag acquiring unit 232 performs a moving object attribute value tag acquiring process. An example of the moving object attribute value tag acquiring process has been described with reference to the flowchart in Fig. 6. Note that there may be cases where a tag cannot be acquired here.
[0421] (Step S1708) If one or more tags are acquired in step S1707, the tag acquiring unit 232 associates the one or more tags with the moving image acquired in step S1704.
[0422] It is preferable that the tag acquiring unit 232 associates one or more tags with the video and stores them in the mobile storage unit 21. This allows the user of the mobile terminal 2 to search for videos, for example, using the tags as a key.
[0423] (Step S1709) Tag acquiring unit 232 judges whether or not to acquire a moving image tag. If a moving image tag is to be acquired, the process proceeds to step S1710, and if not, the process proceeds to step S1712. Note that whether or not to acquire a moving image tag is determined in advance.
[0424] (Step S1710) The tag obtaining unit 232 performs a video tag obtaining process. An example of the video tag obtaining process has been described with reference to the flowchart in Fig. 7. Note that there may be cases where a tag cannot be obtained here.
[0425] (Step S1711) If one or more tags are acquired in step S1710, the tag acquiring unit 232 associates the one or more tags with the moving image acquired in step S1704.
[0426] It is preferable that the tag acquiring unit 232 associates one or more tags with the video and stores them in the mobile storage unit 21. This allows the user of the mobile terminal 2 to search for videos, for example, using the tags as a key.
[0427] (Step S1712) The movement processing unit 23 judges whether or not the end of the movement is detected. If the end of the movement is detected, the process proceeds to step S1713, and if not, the process returns to step S1704.
[0428] For example, the movement processing unit 23 detects the end of movement by detecting that the engine is turned off, that the power supply of the mobile terminal 2 is turned off, or that the mobile terminal 2 has arrived at the destination.
[0429] (Step S1713) The movement processing unit 23 acquires the right holder identifier from the movement storage unit 21.
[0430] (Step S1714) The movement processing unit 23 configures an attribute value set having one or more moving object attribute values acquired in step S1705, one or more tags acquired in step S1707, and one or more tags acquired in step S1710.
[0431] (Step S1715) The set sending unit 243 sends the attribute value set constructed in step S1714 to the information processing device 1 in association with the right holder identifier.
[0432] (Step S1716) The moving video transmission unit 242 and the like perform a video transmission process. Return to step S1701. An example of the video transmission process will be described with reference to the flowchart in Fig. 18. The video transmission process is a process for automatically transmitting a video that matches a preservation condition.
[0433] (Step S1717) The mobile receiving unit 22 judges whether or not an inquiry has been received from the information processing device 1. If an inquiry has been received, the process proceeds to step S1718, and if not, the process returns to step S1701.
[0434] (Step S1718) The movement processing unit 23 performs a terminal image acquisition process corresponding to the inquiry received in step S1717. An example of the terminal image acquisition process will be described with reference to the flowchart in Fig. 19. The terminal image acquisition process is a process of acquiring a video that matches the inquiry from among the videos stored in the movement storage unit 21.
[0435] (Step S1719) The movement processing unit 23 judges whether or not an image was acquired in step S1718. If an image was acquired, the process proceeds to step S1720, and if not, the process proceeds to step S1721.
[0436] (Step S1720) The moving video transmission unit 242 transmits images and the like to the information processing device 1. Return to step S1701. Note that the images and the like are, for example, an image, an attribute value set, and a rights holder identifier. Also, the images are, for example, a video, a still image, or an around-view image.
[0437] (Step S1721) The moving video transmission unit 242 transmits error information. The error information is information indicating that a video could not be acquired.
[0438] In the flowchart of FIG. 17, it is preferable to transmit a set of video attribute values, which are all or a part of one or more video attributes acquired in step S1705, the tags acquired in step S1707, and the tags acquired in step S1710, to the information processing device 1 each time a video is acquired, at predetermined intervals, or when a predetermined condition is met (for example, the tag "accident" or "traffic jam" has been acquired).
[0439] 17, after the end of movement is detected, the video transmission process (processing of S1416) is performed, but the video transmission process may be performed continuously. Continuously performing the video transmission process means, for example, performing the video transmission process (S1416) immediately after step S1711. In this way, even if the storage area for videos in storage unit 11 is small, videos that meet the preservation conditions can be preserved.
[0440] In the flowchart of FIG. 17, the process ends when the power is turned off or an interrupt occurs to end the process.
[0441] Next, an example of the moving image transmission process in step S1716 will be described with reference to the flowchart in FIG.
[0442] (Step S 1801 ) The movement processing unit 23 acquires a set of attribute values from the movement storage unit 21 .
[0443] (Step S1802) The movement processing unit 23 assigns 1 to the counter i.
[0444] (Step S1803) Movement processing unit 23 judges whether or not the i-th retrieval unit exists. If the i-th retrieval unit exists, the process proceeds to step S1804, and if not, the process returns to the upper process.
[0445] (Step S1804) The movement processing unit 23 acquires a set of video attribute values of the i-th search unit.
[0446] (Step S1805) The movement processing unit 23 assigns 1 to the counter j.
[0447] (Step S1806) The movement processing unit 23 judges whether or not the j-th maintenance condition exists. If the j-th maintenance condition exists, the process proceeds to step S1807, and if not, the process proceeds to step S1810.
[0448] (Step S1807) The movement processing unit 23 judges whether or not the set of video attribute values acquired in step S1804 satisfies the j-th conservation condition. If the j-th conservation condition is satisfied, the process proceeds to step S1808, and if not, the process proceeds to step S1811.
[0449] (Step S1808) The movement processing unit 23 acquires the video etc. of the i-th search unit. Note that the video etc. of the i-th search unit is, for example, the video of the i-th search unit and a set of attribute values corresponding to the video.
[0450] (Step S1809) The moving video transmission unit 242 transmits the video etc. acquired in step S1808 to the information processing device 1.
[0451] (Step S1810) The movement processing unit 23 increments the counter i by 1. The process returns to step S1803.
[0452] (Step S1811) The movement processing unit 23 increments the counter j by 1. The process returns to step S1806.
[0453] Next, an example of the terminal image acquisition process in step S1718 will be described with reference to the flowchart in FIG.
[0454] (Step S1901) The movement processing unit 23 uses the received inquiry to determine whether or not to acquire a moving image. If a moving image is to be acquired, the process proceeds to step S1902, and if a still image or the like is to be acquired, the process proceeds to step S1908.
[0455] Note that the movement processing unit 23 checks, for example, a type identifier (for example, "video", "still image", or "around-view image") included in the received inquiry, and determines whether or not to acquire a video.
[0456] (Step S1902) The movement processing unit 23 assigns 1 to the counter i.
[0457] (Step S1903) Movement processing unit 23 judges whether or not the i-th retrieval unit exists. If the i-th retrieval unit exists, the process proceeds to step S1904, and if not, the process returns to the upper process.
[0458] (Step S1904) The movement processing unit 23 acquires a set of video attribute values of the i-th search unit.
[0459] (Step S1905) Movement processing unit 23 judges whether or not the set of video attribute values of the i-th search unit matches the query. If it matches the query, the process proceeds to step S1906, and if it does not match, the process proceeds to step S1907.
[0460] (Step S1906) The movement processing unit 23 acquires a moving image etc. in the i-th search unit. Note that the moving image etc. is, for example, a set of moving images and moving image attribute values.
[0461] (Step S1907) The movement processing unit 23 increments the counter i by 1. The process returns to step S1903.
[0462] (Step S1908) The movement processing unit 23 acquires the latest composite image or the latest still image, and then returns to the upper processing.
[0463] The composite image is an image synthesized using still images captured by two or more cameras installed on a moving object. The composite image is, for example, an around-view image. The still image is an image captured by one camera installed on the moving object. The technology for constructing the around-view image is a known technology, and therefore a detailed description thereof will be omitted.
[0464] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.
[0465] (Step S2001) The user reception unit 32 judges whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to step S2002, and if not, the process proceeds to step S2007.
[0466] Note that the reception of an inquiry is, for example, the reception of an input from a user, the reception of position information from the target terminal 4, or the reception of destination or route information from the navigation terminal 5.
[0467] (Step S2002) The user processing unit 33 composes a query to be transmitted. Next, the user transmission unit 34 transmits the query to the information processing device 1 in association with the user identifier.
[0468] (Step S2003) The user receiving unit 35 judges whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to step S2004, and if information has not been received, the process returns to step S2003.
[0469] (Step S2004) User processing unit 33 judges whether or not the information received in step S2003 includes a moving image. If a moving image is included, the process proceeds to step S2005, and if a moving image is not included, the process proceeds to step S2006.
[0470] (Step S2005) The user output unit 36 outputs the received video. Then, the process returns to step S2001.
[0471] (Step S2006) The user output unit 36 outputs the other information that has been received. Then, the process returns to step S2001.
[0472] (Step S2007) The user processing unit 33 judges whether it is time to make an inquiry. If it is time to make an inquiry, the process proceeds to step S2008, and if it is not time to make an inquiry, the process proceeds to step S2009.
[0473] The timing of the inquiry is, for example, when a destination is set in the user terminal 3 which is a navigation terminal, or when the user terminal 3 installed in the automobile detects congestion.
[0474] (Step S2008) The user processing unit 33 performs an inquiry generation process. Go to step S2002. An example of the inquiry generation process will be described with reference to the flowchart of FIG.
[0475] (Step S2009) The user reception unit 32 judges whether or not a purchase instruction has been received from the user. If a purchase instruction has been received, the process proceeds to step S2010, and if not, the process returns to step S2001. The purchase instruction includes, for example, an inquiry.
[0476] (Step S2010) The user processing unit 33 composes a purchase instruction to be transmitted. Next, the user transmitting unit 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.
[0477] (Step S2011) The user receiving unit 35 judges whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to step S2012, and if information has not been received, the process returns to step S2011. The information is, for example, a moving image, information indicating that the transfer of the rights holder has been completed, and a set of attribute values of the moving image.
[0478] (Step S2012) User processing unit 33 uses the received information to compose information to be output. User output unit 36 outputs the information. Return to step S2001.
[0479] In the flowchart of FIG. 17, the process ends when the power is turned off or an interrupt occurs to end the process.
[0480] Next, an example of the inquiry generation process in step S2008 will be described with reference to the flowchart in FIG.
[0481] (Step S2101) The user processing unit 33 acquires a destination.
[0482] (Step S2102) The user processing unit 33 acquires the current location.
[0483] (Step S2103) User processing unit 33 searches for a route using the destination and the current location, and acquires route information.
[0484] (Step S2104) The user processing unit 33 acquires information on one or more points on the route specified by the route information acquired in step S2103 and which satisfy the extraction condition.
[0485] (Step S2105) The user processing unit 33 constructs a query using one or more pieces of location information acquired in step S2104. The process returns to the upper level process. For example, the user processing unit 33 constructs a query such as "Search for videos that are within the next hour, have a tag of either "traffic jam" or "accident" added, and are paired with an attribute value set that includes any one of one or more pieces of location information."
[0486] Instead of the process of the flowchart in Fig. 18, the user processing unit 33 may obtain the current location and configure an inquiry including the current location. The inquiry is a request to transmit a video corresponding to a predetermined tag (e.g., "accident" or "traffic jam") in a surrounding area including the current location (e.g., a distance within a threshold).
[0487] Next, the operation of the target terminal 4 will be described. The target terminal 4 acquires location information. Next, the target terminal 4 transmits the location information to the information processing device 1 or the user terminal 3 registered in the target terminal 4. The target terminal 4 acquires and transmits the location information upon receiving an instruction from the holder of the target terminal 4 (for example, a child to be watched over). The target terminal 4 has, for example, a GPS receiver and acquires the location information by the GPS receiver, but the method of acquiring the location information is not important. The user terminal 3 registered in the target terminal 4 is, for example, the guardian of the holder of the target terminal 4.
[0488] Next, the operation of the navigation terminal 5 will be described. The navigation terminal 5 accepts a destination from a user. Next, the navigation terminal 5 performs the inquiry generation process described in Fig. 21. Next, the navigation terminal 5 performs the processes from S2002 to S2005 and S2006 in Fig. 20.
[0489] A specific example of the operation of the information system A in this embodiment will be described below.
[0490] Currently, a terminal management table having the structure shown in Fig. 22 is stored in the set storage unit 111 of the information processing device 1. The terminal management table is a table for managing information on one or more terminals. The terminal management table is a table for managing mobile terminals 2 that transmit moving images. Note that a mobile terminal 2 that is not managed in the terminal management table may transmit moving images to the information processing device 1.
[0491] The terminal management table manages one or more records having an "ID," "terminal identifier," "video information," "movement information," "registration flag," and "provision flag." "Video information" is information about a captured video, and here includes a "frame identifier," "environmental information," and "tag." "Environmental information" here includes "location information," "time information," "weather information," and "temperature information." "Environmental information" is information about the environment around the mobile terminal 2 when the video was acquired, etc. "Tags" here include "accident," "traffic jam," and "dangerous driving." In other words, here, a video may be given one or more tags, for example, "accident," "traffic jam," and "dangerous driving."
[0492] "ID" is information for identifying a record. "Terminal identifier" is an identifier of the mobile terminal 2, and in this case, is the same as the right holder identifier for identifying the right holder of the video at the time of transmission of the video. "Frame identifier" is the ID of a frame constituting the video. A frame may be called a field or a still image. "Location information" is (latitude, longitude) here. "Time information" is year, month, day, hour, minute, and second here. "Weather information" is, for example, "sunny," "rain," "cloudy," or "snow." "Temperature information" is the temperature (℃) outside the moving object. "Accident" value "1" indicates that a tag indicating that an accident has occurred is attached to the corresponding frame. "Traffic jam" value "1" indicates that a tag indicating that a traffic jam has occurred is attached to the corresponding frame. "Dangerous driving" value "1" indicates that a tag indicating that a car or the like traveling in front is driving dangerously is attached to the corresponding frame. "Movement information=1" indicates that a video is currently in a state where it can be transmitted from the mobile terminal 2. "Movement information = 0" indicates that the mobile terminal 2 is currently in a state where video cannot be sent due to the power being turned off, etc. "Registration flag = 1" indicates that the video has already been registered and can be obtained from the registration destination (e.g., storage unit 11 or another device). "Provision flag" of "1" indicates that viewing of the video is permitted. "Provision flag" of "2" indicates that sale of the video (transfer of rights holder) is permitted.
[0493] In addition, a registered video management table having the structure shown in FIG. 23 is stored on the blockchain. The registered video management table is a table that manages registered videos. The registered video management table is a table that manages preservation information. Registered videos are, for example, videos provided to a user in response to an inquiry from the user, and videos that satisfy preservation conditions. The registered video management table has an "ID," "video identifier," "access information," "rights holder identifier," "rights registration date," "video information," and "provision flag." It is assumed that registered videos are stored in the information processing device 1, another device, or the blockchain. It is also assumed that each record in the registered video management table is preservation information here.
[0494] In this context, five specific examples will be described. Specific examples 1 to 4 are examples of using real-time video. Specific example 5 is an example of using video captured in the past.
[0495] Specific example 1 is a case in which, in order to monitor a target person (e.g., a child or a wandering elderly person), a combined video is created by combining videos taken by mobile terminals 2 installed on two or more mobile objects, and the combined video is transmitted to a user terminal 3 of a user related to the target person (e.g., a guardian).
[0496] Specific example 2 is a case in which a combined video that combines videos taken by multiple mobile terminals 2 is output to a user terminal 3 in response to an inquiry using route information corresponding to a destination set in the user terminal 3 or the navigation terminal 5.
[0497] A specific example 3 is a case where the user terminal 3 or the navigation terminal 5 detects a traffic jam and obtains a video that enables the user to understand the reason for the traffic jam and outputs the video to the user terminal 3 or the navigation terminal 5.
[0498] A fourth specific example is a case where an image is output that allows a user to grasp the situation of a parking lot so that the user can find an empty space in the parking lot.
[0499] A fifth specific example is a case where a combined moving image obtained by combining registered moving images is output to the user terminal 3 using route information that identifies a route the user has traveled in the past (for example, a route traveled).
[0500] (Example 1) The storage unit 11 of the information processing device 1 stores management information having a user identifier (e.g., the IP address of the user terminal 3) for sending a video to a user terminal 3 of a guardian P, and a target identifier "T001" for identifying a target terminal 4 of a child A of the guardian P.
[0501] Next, assume that child A turns on the target terminal 4 to return home from school. Next, the target terminal 4 periodically acquires location information and sends a query including the location information and the target identifier "T001" (for example, "Action transmission instruction Target identifier=T001, location information (x t1 ,y t1 )") to the information processing device 1. It is assumed that the target terminal 4 stores a target user identifier "T001" and communication destination information (e.g., IP address) of the information processing device 1 for transmitting information to the information processing device 1.
[0502] In addition, the receiving unit 12 of the information processing device 1 periodically receives location information that identifies the location of the mobile terminal 2, paired with the terminal identifier, from each of two or more mobile terminals 2, and stores the location information in a terminal management table (Figure 22), paired with the terminal identifier.
[0503] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry “action transmission instruction, target person identifier=T001, location information (x t1 ,y t1 )" from the target terminal 4 and stores the location information (x t1 ,y t1 ) and the target person identifier “T001.” The location information is received periodically, and the latest location information is stored in a buffer (not shown).
[0504] Next, it is assumed that the video acquisition unit 133 has determined the first mobile terminal 2 (here, a drive recorder mounted on an automobile) corresponding to the location information that satisfies the first location condition with respect to the location indicated by the latest location information of the target terminal 4, by the operation described in the flowchart of FIG. 11. Then, the video acquisition unit 133 receives a video from the first mobile terminal 2. Note that the video shows child A. This is because the location information of the target terminal 4 of child A and the location information of the mobile terminal 2 are information indicating positions that are close enough to satisfy the first location condition. Furthermore, the video is usually associated with the location information and the first right holder identifier of the first mobile terminal 2. Furthermore, it is preferable that the received video is a video that the mobile terminal 2 transmitted immediately after shooting.
[0505] Next, the video sending unit 141 sends the video received by the video acquiring unit 133 to the user terminal 3 of the guardian P who is identified by the user identifier paired with the target person identifier "T001".
[0506] Then, the video acquisition unit 133 temporarily stores the video received from the first mobile terminal 2 in a buffer (not shown) in a pair with the first rights holder identifier and the location information of the first mobile terminal 2.
[0507] In addition, the video acquisition unit 133 receives at least the video received from the first mobile terminal 2 while the location information of the child A's target terminal 4 and the location information of the first mobile terminal 2 satisfy the first location condition, and the video transmission unit 141 transmits the video to the parent P's user terminal 3.
[0508] Next, it is assumed that the video acquisition unit 133 determines that the location information of the target terminal 4 of child A and the location information of the first mobile terminal 2 no longer satisfy the first location condition. This is because the first mobile terminal 2 has moved and is no longer in a position to capture an image of child A who is walking home.
[0509] Next, the video acquisition unit 133 again determines, with reference to FIG. 22, the location information of the second mobile terminal 2 whose latest location information satisfies the first location condition, with respect to the latest location information of the target terminal 4. Note that in FIG. 22, the latest location information transmitted from each mobile terminal 2 is stored in pair with each terminal identifier. Then, the video acquisition unit 133 acquires the video from the second mobile terminal 2. Next, the video acquisition unit 133 temporarily accumulates the video in a buffer (not shown), pairing it with the second rights holder identifier and location information of the second mobile terminal 2.
[0510] Next, the video sending unit 141 sends the video received by the video acquiring unit 133 from the second mobile terminal 2 to the user terminal 3 of the guardian P.
[0511] Then, after a period of time (eg, 10 seconds), the video acquiring unit 133 determines that the location information of the target terminal 4 of child A and the location information of the second mobile terminal 2 no longer satisfy the first location condition.
[0512] Next, the video acquisition unit 133 again refers to Fig. 22 to determine the location information of the third mobile terminal 2 whose latest location information satisfies the first location condition with respect to the latest location information of the target terminal 4, but assumes that there is no location information of the third mobile terminal 2 that satisfies the first location condition. In such a case, the video transmission unit 141 may transmit information to the user terminal 3 of the guardian P that the video including the child A cannot be transmitted, or may stop transmission of the video or information to the user terminal 3.
[0513] Through the above video transmission, the user terminal 3 sequentially receives and outputs the video acquired by the first mobile terminal 2 and the video acquired by the second mobile terminal 2. This allows the guardian P to see how the child A returns home.
[0514] Then, as time passes, a third mobile terminal 2 approaches child A, and the video acquisition unit 133 refers to Fig. 22 and determines the location information of the third mobile terminal 2 whose latest location information satisfies the first location condition with respect to the latest location information of the target terminal 4. Next, the video acquisition unit 133 acquires a video from the third mobile terminal 2. Next, the video acquisition unit 133 pairs the video with the third rights holder identifier and location information of the third mobile terminal 2, and temporarily stores the video in a buffer (not shown).
[0515] Next, the video sending unit 141 sends the video received by the video acquiring unit 133 from the third mobile terminal 2 to the user terminal 3 of the guardian P identified by the user identifier paired with the target person identifier "T001".
[0516] Next, the user terminal 3 receives and outputs the video acquired by the third mobile terminal 2. As a result, the guardian P was unable to see how Child A returned home for a short time, but now that the video is output, he or she can see how Child A returned home again.
[0517] The above process continues until the target terminal 4 of child A is powered off (until child A returns home), and parent B can monitor child A's return home from school.
[0518] In addition, the remuneration means 1355 performs the above-mentioned remuneration process for the right holders identified by the right holder identifiers of the first mobile terminal 2, the second mobile terminal 2, and the third mobile terminal 2 who have provided the video to the guardian B.
[0519] Furthermore, moving image composer 134 combines the moving images transmitted from two or more mobile terminals 2 in the order in which they were transmitted, to compose a combined moving image.
[0520] Moreover, the right holder processing unit 135 stores the combined moving image in a pair with a right holder identifier, which is the identifier of the guardian P.
[0521] Moreover, the rights holder processing unit 135 stores the combined moving image in association with a set of attribute values corresponding to one or more original moving images from which the combined moving image is created.
[0522] Next, the fourth security means 1354 acquires access information that specifies the storage destination of the combined moving image. The fourth security means 1354 also acquires a set of attribute values corresponding to the stored combined moving image. Next, the fourth security means 1354 constructs security information having the acquired access information, the acquired set of attribute values, and the rights holder identifier of the moving image. Next, the fourth security means 1354 stores the constructed security information.
[0523] As described above, according to this specific example, the combined video can be used to monitor the subject who has the target terminal 4. In addition, a reward can be given to the right holder who provided the video that is the source of the combined video for monitoring. In addition, the combined video can be appropriately managed.
[0524] (Example 2) It is assumed that a user inputs a destination to a user terminal 3 having a navigation function. Next, the user receiving unit 32 of the user terminal 3 receives the destination. In addition, the user processing unit 33 acquires a current position. Next, the user processing unit 33 acquires route information from the current position to the destination. It is assumed here that the route information has two or more pieces of position information.
[0525] Next, in response to the acquisition of the route information by the user processing unit 33, the user transmitting unit 34 of the user terminal 3 automatically transmits an inquiry including the route information to the information processing device 1.
[0526] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry. Next, the moving image acquiring unit 133 and the moving image composing unit 134 perform moving image combining processing as follows.
[0527] That is, first, the video acquisition unit 133 acquires, from among two or more pieces of position information contained in the route information, position information (first position information) of the first intersection in the route specified by the route information. That is, it is preferable that the video acquisition unit 133 acquires a video using only a portion of the position information contained in the received route information. It is preferable that the video acquisition unit 133 acquires a video using only a portion of the position information contained in the received route information that satisfies a specific condition. Note that the specific condition is, for example, that the position information is information indicating the position of an intersection, and that the distance from the previously used position information is equal to or greater than a threshold.
[0528] Next, the video acquisition unit 133 determines the location information of the first mobile terminal 2 that satisfies the first location condition for the acquired location information. Then, the video acquisition unit 133 acquires the video from the determined first mobile terminal 2, pairs the video with the first rights holder identifier and the first location information of the first mobile terminal 2, and temporarily stores the video in a buffer (not shown). Next, the video transmission unit 141 transmits the acquired video to the user terminal 3.
[0529] Next, the video acquisition unit 133 acquires second position information of the next intersection that is closer to the destination than the position indicated by the previously acquired first position information of the intersection.
[0530] Next, the video acquisition unit 133 determines the location information of the second mobile terminal 2 that satisfies the first location condition for the second location information. Then, the video acquisition unit 133 acquires the video from the determined second mobile terminal 2, pairs the video with the second rights holder identifier and the second location information of the second mobile terminal 2, and temporarily stores the video in a buffer (not shown). Next, the video transmission unit 141 transmits the acquired video to the user terminal 3.
[0531] Next, the video acquisition unit 133 acquires third position information of the next intersection that is closer to the destination than the position indicated by the second position information.
[0532] Next, the video acquisition unit 133 determines the location information of a third mobile terminal 2 that satisfies the first location condition for the third location information. Then, the video acquisition unit 133 acquires the video from the determined third mobile terminal 2, pairs the video with the third rights holder identifier and the third location information of the third mobile terminal 2, and temporarily stores the video in a buffer (not shown). Next, the video transmission unit 141 transmits the acquired video to the user terminal 3.
[0533] The information processing device 1 repeats the above process until transmitting a video corresponding to the n-th location information that identifies the destination.
[0534] Then, the user receiving unit 35 of the user terminal 3 sequentially receives the first moving image, the second moving image, the third moving image, ..., the nth moving image. The user output unit 36 sequentially outputs the first moving image, the second moving image, the third moving image, ..., the nth moving image.
[0535] Furthermore, the reward means 1355 of the information processing device 1 performs reward processing to reward the first right holder, the second right holder, . . . , and the n-th right holder identified by the first right holder identifier for providing the video.
[0536] Furthermore, moving image composer 134 combines the moving images transmitted from two or more mobile terminals 2 in the order in which they were transmitted, to compose a combined moving image.
[0537] Moreover, the rights holder processing unit 135 stores the combined moving image in a pair with a rights holder identifier that is an identifier of the user of the user terminal 3. That is, in this case, the rights holder of the combined moving image is the user.
[0538] Moreover, the rights holder processing unit 135 stores the combined moving image in association with a set of attribute values corresponding to one or more original moving images from which the combined moving image is created.
[0539] Next, the fourth security means 1354 acquires access information that specifies the storage destination of the combined moving image. The fourth security means 1354 also acquires a set of attribute values corresponding to the stored combined moving image. Next, the fourth security means 1354 constructs security information having the acquired access information, the acquired set of attribute values, and the rights holder identifier of the moving image. Next, the fourth security means 1354 stores the constructed security information.
[0540] As described above, according to this specific example, videos transmitted from two or more mobile terminals 2 are, at least in appearance, temporally combined to form a combined video, which can be used to check the route to the destination in order of proximity from the current position, thereby providing support for traveling using a mobile object such as an automobile.
[0541] In addition, a reward can be given to the rights holder who provided the original video of the combined video, and the combined video can be appropriately stored and managed.
[0542] (Example 3) It is assumed that the navigation terminal 5 detects a traffic jam on a route to a destination, for example. The function of detecting a traffic jam can be realized by a known technology. Next, it is assumed that the navigation terminal 5 acquires route information having one or more pieces of location information that specify a road with a traffic jam, and transmits an inquiry including the route information and a user identifier stored in the navigation terminal 5 to the information processing device 1. It is assumed that the user identifier is an identifier of a user terminal 3 that receives a video transmitted from a mobile terminal 2 located at a position of the road with a traffic jam, and is, for example, an IP address. It is also assumed that the route information is information that specifies one or more roads with a traffic jam. The user terminal 3 is, for example, a terminal of a passenger in the front passenger seat.
[0543] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry including the route information and the user identifier. Next, the moving image acquiring unit 133 and the moving image composing unit 134 perform moving image combining processing as follows.
[0544] First, the video acquisition unit 133 acquires the location information closest to the current location from among the location information included in the route information. Next, the video acquisition unit 133 acquires the last location information of the location information that follows the location information and is located within a threshold value relative to the adjacent location information. The video acquisition unit 133 sets the location information as the target location information to be used for video acquisition.
[0545] Next, the video acquisition unit 133 determines a first mobile terminal 2 whose location information satisfies a first location condition for the target location information. Next, the video acquisition unit 133 acquires a video from the mobile terminal 2, pairs the video with the first right holder identifier and location information of the first mobile terminal 2, and temporarily stores the video in a buffer (not shown).
[0546] Then, the video acquisition unit 133 receives video from the first mobile terminal 2 and temporarily stores the video in a buffer (not shown) until the latest location information of the first mobile terminal 2 no longer satisfies the first location condition.
[0547] Furthermore, the video transmission unit 141 transmits the acquired videos to the user terminal 3 in sequence.
[0548] Next, it is assumed that the mobile terminal 2 leaves the congestion, and the video acquisition unit 133 determines that the latest location information of the first mobile terminal 2 no longer satisfies the first location condition.
[0549] Next, the video acquisition unit 133 determines a second mobile terminal 2 whose location information satisfies the first location condition for the target location information. Next, the video acquisition unit 133 acquires a video from the second mobile terminal 2, pairs the video with the second right holder identifier and location information of the second mobile terminal 2, and temporarily stores the video in a buffer (not shown).
[0550] Then, the video acquisition unit 133 receives video from the second mobile terminal 2 and temporarily stores the video in a buffer (not shown) until the latest location information of the second mobile terminal 2 no longer satisfies the first location condition.
[0551] Furthermore, the video transmission unit 141 transmits the acquired videos to the user terminal 3 in sequence.
[0552] Then, the user terminal 3 receives the video from the information processing device 1 and outputs it.
[0553] By repeating the above process, the user of the user terminal 3 can continuously know the state of traffic congestion.
[0554] Furthermore, when the route information includes information specifying two or more congested roads, the information processing device 1 performs the same process using the route information specifying the second and subsequent locations. As a result, the user terminal 3 can also receive and output video for grasping the state of congestion at the second and subsequent locations. Note that, when there are two or more congested locations, it is preferable that the user terminal 3 automatically or in response to a user's instruction switches between the locations to receive and output the video.
[0555] In this specific example, although explanation is omitted, reward processing, various security processing, etc. may also be performed.
[0556] As described above, according to this specific example, the video transmitted from two or more mobile terminals 2 can be used to grasp the state of traffic congestion on the route to the destination.
[0557] (Example 4) It is assumed that a user terminal 3 installed in a car in a large parking lot transmits an inquiry including position information of the user terminal 3 to ascertain the situation of the parking lot to the information processing device 1. It is assumed that the inquiry includes "type identifier=around view image", position information of the user terminal 3 (reference position information), and the around view image acquired by the user terminal 3.
[0558] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry. Next, the moving image acquiring unit 133 determines from the received inquiry that spatial fusion of two or more moving images is necessary. Next, the moving image acquiring unit 133 and the moving image composing unit 134 perform moving image fusion processing as follows.
[0559] That is, the video acquisition unit 133 acquires the reference location information contained in the received inquiry. Next, the video acquisition unit 133 determines one or more mobile terminals 2 corresponding to location information that satisfies a second location condition with respect to the reference location information. Next, the video acquisition unit 133 transmits an instruction to transmit a current around-view image to the one or more mobile terminals 2. Note that the second location condition here is that the location indicated by the location information is present in an area of the parking lot that includes the reference location information. Note that it is assumed that each of the one or more mobile terminals 2 continuously acquires around-view images.
[0560] Then, the video acquisition unit 133 receives, from each of the one or more mobile terminals 2, an around-view image associated with the position information of the mobile terminal 2.
[0561] Next, the moving image composing unit 134 calculates the difference (distance) between the position information paired with each received around-view image and the reference position information. Next, the moving image composing unit 134 sorts the around-view images in ascending order using the difference as a key.
[0562] Next, the moving image composition unit 134 acquires a reference image. Note that the reference image is an around-view image included in the query.
[0563] Next, the video composition unit 134 performs the process described using the flowchart in Fig. 10, and arranges each around-view image received from another mobile terminal 2 in an appropriate position relative to the reference image in the sorted order using the position information to compose a fusion image. Furthermore, the video composition unit 134 composes an image that clearly indicates the position indicated by the reference position information (the position of the user terminal 3 that sent the query) in the finally composed fusion image. Note that such an image is also a fusion image.
[0564] Next, the moving image transmission unit 141 transmits the constructed fusion image to the user terminal 3.
[0565] Next, the user terminal 3 receives and outputs the fusion image.
[0566] As described above, according to this example, images transmitted from one or more other mobile terminals 2 can be fused to assist in finding an empty space in a parking lot.
[0567] In this specific example, the information processing device 1 fuses around-view images. However, the information processing device 1 may fuse two or more normal camera images or two or more images captured by an omnidirectional camera using position information corresponding to each image to construct a fused image, and transmit the fused image to the user terminal 3.
[0568] (Example 5) It is assumed that user B drives a driving course on a rainy day, and route information that specifies the route that user B drove by car is stored in the user terminal 3.
[0569] Next, assume that after returning home, user B inputs an inquiry including the route information stored in the user terminal 3 and the environmental information "weather information = sunny" to the user terminal 3. Then, the user terminal 3 accepts the inquiry and transmits the inquiry to the information processing device 1. Note that this inquiry is an inquiry for acquiring a video of the driving course traveled by the user on a sunny day.
[0570] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry. Next, the video acquiring unit 133 determines that the received inquiry is not a real-time video search. Next, the video acquiring unit 133 and the like perform a registered video search process as follows.
[0571] That is, the video acquisition unit 133 acquires the first location information contained in the route information in the received inquiry.
[0572] Next, the video acquisition unit 133 acquires all the preservation information from the registered video management table (FIG. 23). That is, the video acquisition unit 133 acquires, for example, the preservation information present on the block chain.
[0573] Next, the video acquisition unit 133 determines, from among the acquired conservation information, conservation information that includes "1" in the provision flag, has location information that satisfies the first location condition for the acquired location information, and includes "weather information = sunny." Here, it is assumed that the video acquisition unit 133 has determined the conservation information of "ID = 1" in FIG. 23, for example.
[0574] Next, the video acquisition unit 133 acquires the access information "Address 01" that pairs with the determined security information. Next, the video acquisition unit 133 acquires a video using the access information "Address 01". Next, the video acquisition unit 133 cuts out a video from the video corresponding to the access information "Address 01" up to the point where the second or subsequent location information in the route information of the received inquiry satisfies (is the same as or is close to) the first location condition as the location information of the security information. In other words, the video acquisition unit 133 cuts out and acquires a video from the video corresponding to the access information "Address 01" up to the point where the user deviates from the route of the driving course traveled by the user.
[0575] Next, the video acquisition unit 133 acquires second location information, which is location information when the video corresponding to the access information "address 01" deviates from the driving course and is included in the route information included in the received inquiry.
[0576] Then, the video acquisition unit 133 determines, from the acquired conservation information, conservation information that includes a provision flag of "1", has location information that satisfies the first location condition with respect to the acquired second location information, and includes "weather information = sunny".
[0577] Next, the video acquisition unit 133 acquires access information (for example, "Address X") that pairs with the determined security information. Next, it is assumed that the video acquisition unit 133 acquires a second video using the access information "Address X". Next, the video acquisition unit 133 cuts out from the second video corresponding to the access information "Address X" a video up to the point where the location information beyond the second location information contained in the route information contained in the received inquiry satisfies the location information of the security information. In other words, the video acquisition unit 133 cuts out and acquires from the video corresponding to the access information "Address X" a video up to the point where the user deviates from the route of the driving course traveled by the user.
[0578] The video acquisition unit 133 performs the above process until it uses the last location information contained in the route information in the received inquiry.
[0579] Next, the moving image constructing section 134 constructs a combined moving image by combining two or more moving images acquired by the moving image acquiring section 133 in the order in which they were acquired (in the order of the route).
[0580] Next, the moving image transmission unit 141 transmits the combined moving image to the user terminal 3 of the user B.
[0581] Next, the user terminal 3 receives and outputs the combined moving image.
[0582] In addition, the reward means 1355 of the information processing device 1 acquires the rights holder identifiers (e.g., "U001") of each of the two or more original videos used in the combined video, and performs reward processing to give rewards to the rights holders identified by each of the two or more rights holder identifiers.
[0583] Moreover, the rights holder processing unit 135 performs the various types of protection processing described above on the constructed combined moving image.
[0584] As described above, according to this specific example, a combined moving image can be constructed by combining two or more moving images captured in the past along a route traveled by a user using route information of the route, and can be output.
[0585] As described above, according to this embodiment, videos captured by two or more mobile terminals 2 can be used to construct and provide a single useful video.
[0586] Furthermore, according to this embodiment, videos captured by two or more mobile terminals 2 can be used to construct and provide a single useful video that is linked in time.
[0587] Furthermore, according to this embodiment, it is possible to configure and provide one useful video that is temporally linked using two or more videos corresponding to two or more pieces of location information transmitted from the target terminal 4. This makes it possible to watch over a target person who is holding a moving target terminal 4, for example.
[0588] Furthermore, according to this embodiment, two or more videos corresponding to a destination set in the navigation terminal 5 can be used to construct and provide one useful video that is linked in time.
[0589] Furthermore, according to this embodiment, a useful single video can be constructed and provided by using videos corresponding to two or more pieces of location information included in the route information and linked in the order of the route.
[0590] Furthermore, according to this embodiment, a useful video can be constructed and provided by combining videos corresponding to two or more pieces of location information included in the route information in the order of the route and the time.
[0591] Furthermore, according to this embodiment, moving images captured by two or more mobile terminals can be spatially merged to form a single useful moving image, which can then be provided.
[0592] Furthermore, according to this embodiment, the status of available spaces in a parking lot can be grasped.
[0593] Furthermore, according to this embodiment, appropriate processing can be performed regarding the rights holder of the video. For example, a reward can be given to the rights holder of the video captured by the mobile terminal 2.
[0594] Furthermore, according to the present embodiment, the right holder of a video made up of two or more images can be an appropriate right holder. For example, the right holder of a video made up of two or more images can be a person who needs the video.
[0595] Furthermore, according to this embodiment, it is possible to preserve management information for moving images that need to be preserved.
[0596] Furthermore, according to this embodiment, the mobile terminal 2 acquires and stores video and audio information, but transmits the video but not the audio information, thereby contributing to the provision of video and protecting the privacy of the rights holder of the mobile object.
[0597] The processing in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software for realizing the information processing device 1 in this embodiment is a program as follows. That is, this program causes a computer to function as a video acquisition unit that acquires videos that are videos taken by two or more mobile terminals and correspond to an attribute value set including one or more environmental information including location information that specifies the shooting position or time information that specifies the shooting time, and transmitted from the two or more mobile terminals, a video composition unit that temporally combines two or more videos that have different time information associated with each of the two or more videos acquired by the video acquisition unit, or spatially combines parts of two or more videos that have different location information associated with each of the two or more videos acquired by the video acquisition unit to compose one video, and a video transmission unit that transmits the one video composed by the video composition unit.
[0598] Also, Fig. 24 shows the appearance of a computer that executes the program described in this specification to realize the information processing device 1 and the like of the various embodiments described above. The above-mentioned embodiments can be realized by computer hardware and a computer program executed thereon. Fig. 24 is an overview of this computer system 300, and Fig. 25 is a block diagram of the system 300. Note that the mobile terminal 2 is usually equipped with a camera. Also, the mobile terminal 2 may be equipped with a microphone.
[0599] In FIG. 24, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.
[0600] 25, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.
[0601] A program for causing computer system 300 to execute the functions of information processing device 1 and the like of the above-mentioned embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and further transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 at the time of execution. The program may be loaded directly from CD-ROM 3101 or the network.
[0602] The program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the information processing device of the above-mentioned embodiment. The program only needs to include an instruction portion that calls appropriate functions (modules) in a controlled manner to obtain a desired result. How the computer system 300 operates is well known, and a detailed description will be omitted.
[0603] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmitting step (processing that is performed only by hardware).
[0604] The program may be executed by a single computer or a plurality of computers. That is, the program may be executed by a centralized processing or a distributed processing.
[0605] Furthermore, in each of the above embodiments, it goes without saying that two or more communication means present in one device may be physically realized by one medium.
[0606] In each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.
[0607] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]
[0608] As described above, the information processing device 1 according to the present invention has an effect of being able to use moving images captured by two or more mobile terminals 2 to construct and provide one useful moving image, and is useful as a server or the like.
Claims
1. a video acquisition unit that acquires videos captured by each of two or more mobile terminals, the videos corresponding to an attribute value set including one or more pieces of environmental information including location information that identifies the location where the videos were captured or time information that identifies the time when the videos were captured, and that acquires the videos transmitted from each of the two or more mobile terminals; a video composition unit that temporally combines two or more of the videos acquired by the video acquisition unit, the two or more videos having different time information associated with each of the two or more videos, or spatially fuses parts of two or more of the videos acquired by the video acquisition unit, the two or more videos having different position information associated with each of the two or more videos, to compose one of the videos; An information processing device comprising: a moving image transmitting unit that transmits one of the moving images constructed by the moving image constructing unit.
2. The video acquisition unit is Sequentially acquiring two or more of the videos, each of which has position information corresponding to the two or more videos and which satisfies a first position condition; The video composition unit includes: The information processing apparatus according to claim 1 , wherein the two or more moving images acquired by the moving image acquisition unit are combined in a time sequence corresponding to the moving images to form one moving image.
3. Further comprising an inquiry receiving unit that receives an inquiry including the location information from a user terminal, The video acquisition unit is The information processing apparatus according to claim 2 , further comprising: acquiring two or more videos corresponding to the location information that satisfies the first location condition using the location information received by the inquiry receiving unit.
4. The method further includes the step of: receiving, in sequence, each of the two or more pieces of location information transmitted from each of the mobile terminals; The video acquisition unit is The information processing device according to claim 2 , wherein the two or more pieces of location information received by the inquiry receiving unit are sequentially used to sequentially obtain the two or more videos corresponding to the location information that satisfies the first location condition.
5. a query receiving unit that receives a query including the location information that identifies a destination set in the navigation terminal, The video acquisition unit is The information processing apparatus according to claim 2 , further comprising: sequentially acquiring two or more of the videos corresponding to the location information that satisfies the first location condition using the location information received by the inquiry receiving unit.
6. Further comprising an inquiry receiving unit that receives an inquiry including route information including two or more pieces of location information; The video acquisition unit is The information processing apparatus according to claim 1 , wherein the two or more videos corresponding to the position information that satisfies the two or more first position conditions using the two or more pieces of position information included in the route information are acquired.
7. the route information has time information corresponding to each of two or more pieces of location information; The video acquisition unit is The information processing apparatus according to claim 6 , further comprising: acquiring two or more videos corresponding to the position information that satisfies the first position condition using the two or more pieces of position information contained in the route information and the time information.
8. The video acquisition unit is Acquire two or more videos in which the position information corresponding to each of the two or more videos satisfies a second position condition and the time information corresponding to each of the two or more videos satisfies a time condition; The video composition unit includes: The information processing device according to claim 1 , wherein one frame is constructed using some or all of the frames constituting each of the two or more moving images acquired by the moving image acquisition unit, and the frames are connected in time to construct one moving image.
9. The video is a video of a parking lot, The video composition unit includes: An information processing device as described in claim 8, which spatially connects a directly above frame obtained by combining the frames of the video captured by two or more mobile terminals installed on two or more moving bodies to form one frame, and constructs one video having one frame.
10. The video is associated with a rights holder identifier that identifies a rights holder of the video; 10. The information processing device according to claim 1, further comprising a right holder processing unit that performs right holder processing related to the right holder identified by a right holder identifier associated with the one moving image constructed by the moving image construction unit.
11. The right holder identifier corresponding to one of the moving images is the right holder identifier corresponding to each of the two or more moving images that are the source of the one of the moving images, The right holder processing unit:
11. The information processing device according to claim 10, further comprising a reward means for performing a reward process which is a process of giving a reward to each of the rights holders identified by the rights holder identifiers corresponding to each of the two or more videos that are the basis of one of the videos.
12. The reward means comprises: An information processing device as described in claim 11, which acquires video attribute values corresponding to two or more of the videos that were the basis for the video transmitted by the video transmission unit, uses the video attribute values to determine rewards for each of the two or more rights holders, and performs processing to award the rewards.
13. The right holder processing unit: An information processing device as described in claim 10, further comprising a first maintenance means for performing a first maintenance process in which a video acquired by the video acquisition unit is stored in association with a set of attribute values corresponding to each of two or more videos that were the source of the video.
14. The right holder processing unit: An information processing device as described in claim 10, further comprising a second security means for performing a second security process in which a video acquired by the video acquisition unit is stored in association with a rights holder identifier corresponding to each of two or more videos that were the source of the video.
15. The mobile terminal further includes an inquiry receiving unit configured to receive an inquiry regarding environmental information regarding an environment in which the mobile terminal captured the video from the user terminal, The video acquisition unit is The inquiry receiving unit acquires two or more videos corresponding to the inquiry received, The right holder processing unit:
11. The information processing apparatus according to claim 10, further comprising a third security means for storing the one of the videos acquired by the video acquisition section in association with the right holder identifier that identifies a user of the user terminal.
16. The right holder processing unit: The information processing device according to claim 13 , further comprising a fourth security means for performing a fourth security process that accumulates security information including access information for accessing the one video in a blockchain.
17. An information processing method implemented by a moving image acquisition unit, a moving image composition unit, and a moving image transmission unit, comprising: a video acquisition step in which the video acquisition unit acquires the video, which is a video captured by each of two or more mobile terminals and corresponds to an attribute value set including one or more pieces of environmental information including location information that identifies a location where the video was captured or time information that identifies a time when the video was captured, and which is transmitted from each of the two or more mobile terminals; a video composition step in which the video composition unit temporally combines two or more of the videos that have different time information associated with each of the two or more videos acquired by the video acquisition unit, or spatially fuses parts of two or more of the videos that have different position information associated with each of the two or more videos acquired by the video acquisition unit to compose one of the videos; a moving image transmitting step in which the moving image transmitting unit transmits one of the moving images composed by the moving image composition unit.
18. Computer, a video acquisition unit that acquires a video transmitted from each of two or more mobile terminals, the video being captured by each of the two or more mobile terminals, the video being associated with an attribute value set including one or more pieces of environmental information including location information that identifies a location where the video was captured or time information that identifies a time when the video was captured; a video composition unit that temporally combines two or more of the videos acquired by the video acquisition unit, the two or more videos having different time information associated with each of the two or more videos, or spatially fuses parts of two or more of the videos acquired by the video acquisition unit, the two or more videos having different position information associated with each of the two or more videos, to compose one of the videos; A program for causing the video composition unit to function as a video transmission unit that transmits one of the videos composed by the video composition unit.
Citation Information
Patent Citations
Information processing system and method, program and recording medium, vehicle, and image processing apparatus
JP2003153253A
Image database construction system
JP2012129961A
Sensor control device, sensor control method and sensor control program
JP2016038703A
Moving image distribution system
JP2016134859A
Information processing apparatus
JP2021010081A