Information processing device and information processing method
The information processing device addresses the challenge of capturing continuous video of moving objects in areas without fixed cameras by using mobile terminals to acquire and transmit video based on received position information, ensuring a comprehensive and uninterrupted visual feed.
Patent Information
- Application Number
- JP2024559766
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-11-22
- Publication Date
- 2025-04-23
- Estimated Expiration
- 2042-11-22
AI Technical Summary
Existing systems cannot capture continuous video of a moving object in areas without fixed cameras.
An information processing device that receives position information from a moving target terminal, acquires video from mobile terminals capturing the corresponding areas, and transmits this video. Additionally, it switches to another mobile terminal's video if the initial one is out of range.
Enables continuous video capture of moving objects even in areas without fixed cameras, providing a comprehensive and uninterrupted visual feed.
Smart Images

Figure 0007667921000001 
Figure 0007667921000002 
Figure 0007667921000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device or the like that processes video of a moving object captured by a mobile terminal. [Background technology]
[0002] Conventionally, there has been a position search imaging system that can capture images of people or objects that can move freely within a predetermined area and search for their positions (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2003-67895 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, conventional technology only uses video captured by fixed cameras, and therefore cannot obtain video of a moving subject in a continuous manner in areas where there are no fixed cameras. [Means for solving the problem]
[0005] The information processing device of the first invention is an information processing device that includes a location receiving unit that sequentially receives multiple pieces of location information at different times of a moving target terminal, a video acquisition unit that acquires a video from the mobile terminal that has captured an area corresponding to each of the multiple pieces of location information received by the location receiving unit, and a video transmission unit that transmits a video based on the video acquired by the video acquisition unit.
[0006] With this configuration, a useful video can be provided using video from a mobile terminal that captures the subject being watched over.
[0007] In addition, compared to the first invention, the information processing device of the second invention is an information processing device in which, when it is determined that the location information received by the location receiving unit is not within the range of video shooting from the mobile terminal, the video acquisition unit acquires video from another mobile terminal that shoots the area corresponding to the location information, and the video transmission unit transmits a single video combining the multiple videos acquired by the video acquisition unit.
[0008] With this configuration, it is possible to provide a single useful video by using videos from multiple mobile terminals that capture the subject being watched over.
[0009] In addition, the information processing device of the third invention, compared to the first or second invention, further includes a video composing unit that clearly indicates the position of the target terminal within a frame of the video acquired by the video acquisition unit and composes one video, and the video transmission unit is an information processing device that transmits the one video composed by the video composing unit.
[0010] With this configuration, the target of monitoring can be clearly indicated in the video.
[0011] In addition, the information processing device of the fourth invention is an information processing device relative to any one of the first to third inventions, further comprising a rights holder processing unit which corresponds a video to a rights holder identifier that identifies the rights holder of the video, and performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier corresponding to a video transmitted by the video transmission unit.
[0012] With this configuration, appropriate processing regarding the rights holder of the video can be carried out.
[0013] In addition, the information processing device of the fifth invention is an information processing device in which, compared to the fourth invention, the rights holder identifier corresponding to a single video is a rights holder identifier corresponding to the video that was the source of the single video, and the rights holder processing unit is an information processing device equipped with a reward means that performs reward processing, which is a process of giving a reward to the rights holder identified by the rights holder identifier corresponding to the video that was the source of the single video.
[0014] With this configuration, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.
[0015] In addition, the information processing device of the sixth invention is an information processing device in which, compared to the fifth invention, the reward means acquires a video attribute value corresponding to a video that is the basis of a video, determines a reward for the rights holder using the video attribute value, and performs reward processing, which is a process of awarding the reward.
[0016] With this configuration, appropriate compensation can be given to the rights holder of the video captured by the mobile terminal.
[0017] In addition, the information processing device of the seventh invention is an information processing device in which, compared to the fourth invention, the rights holder processing unit is equipped with a first security means that performs a first security processing in which a video is stored in association with a set of attribute values corresponding to the video that was the source of the video.
[0018] With this configuration, one video can be preserved.
[0019] In addition, the information processing device of the eighth invention is an information processing device in which, compared to the fourth invention, the rights holder processing unit is equipped with a second security means that performs a second security processing to store a video in association with a rights holder identifier corresponding to the video that was the source of the video.
[0020] With this configuration, the rights holder of a video can be determined to be the appropriate rights holder.
[0021] In addition, the information processing device of the ninth invention is an information processing device comprising, compared to the fourth invention, a third security means in which a video sending unit sends a single video to a user terminal that is paired with the target terminal, and a rights holder processing unit stores the single video in association with a rights holder identifier that identifies the user of the user terminal.
[0022] With this configuration, a rights holder of one video can become a rights holder who needs that video.
[0023] In addition, the information processing device of the tenth invention is an information processing device in which, with respect to any one of the seventh to ninth inventions, the rights holder processing unit is equipped with a fourth preservation means that performs a fourth preservation process of storing preservation information including access information for accessing a video in a blockchain.
[0024] With this configuration, it is possible to preserve information including access information for videos that need to be preserved. Effect of the Invention
[0025] According to the information processing device of the present invention, a moving image can be obtained by continuously shooting a moving target. [Brief description of the drawings]
[0026] [Figure 1] Conceptual diagram of information system A in embodiment 1. [Diagram 2] Block diagram of Information System A [Diagram 3] Block diagram of the information processing device 1 [Figure 4] A flowchart illustrating an example of the operation of the information processing device 1. [Diagram 5] 11 is a flowchart illustrating a first example of the video acquisition process. [Figure 6] A flowchart for explaining an example of a process for acquiring a set of attribute values [Figure 7] A flowchart for explaining an example of the moving object attribute value tag acquisition process. [Figure 8] A flowchart illustrating an example of the video tag acquisition process. [Figure 9] A flowchart illustrating an example of the determination process [Figure 10] A flowchart illustrating an example of the maintenance process. [Figure 11] A flowchart illustrating an example of the fourth maintenance process. [Figure 12] A flowchart illustrating an example of the compensation process. [Figure 13]Flowchart for explaining a second example of simultaneous video acquisition processing [Figure 14] A flowchart for explaining an example of the operation of the mobile terminal 2 [Figure 15] A flowchart for explaining an example of a terminal attribute value set acquisition process [Figure 16] A flowchart for explaining an example of a process for acquiring video from the same terminal [Figure 17] A diagram showing the terminal management table [Figure 18] A diagram showing the registered video management table [Figure 19] Overview of the computer system [Figure 20] Block diagram of the computer system DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0027] Hereinafter, an embodiment of an information processing device and the like will be described with reference to the drawings. Note that, in the embodiments, components with the same reference numerals perform similar operations, and therefore repeated description may be omitted.
[0028] (Embodiment 1) <Outline of First Embodiment>
[0029] In this embodiment, we describe an information system that includes an information processing device that acquires videos captured by one or more mobile terminals using location information of a target terminal, which is the terminal that is the subject of the capture, and composes and transmits a single video from the acquired videos.
[0030] In addition, in this embodiment, we will describe an information system that has an information processing device that, when it determines that one mobile terminal is no longer able to photograph the target due to the movement of the target or the movement of the mobile terminal, switches to and acquires a video photographed by another mobile terminal, uses that video to compose a video, and transmits it.
[0031] In addition, in this embodiment, an information system including an information processing device that configures and transmits one video that clearly indicates the position of a target terminal among the videos to be transmitted will be described.
[0032] In addition, in this embodiment, an information processing device that performs right holder processing, which is processing related to the right holder of one output video, will be described. The right holder processing is, for example, a remuneration process described later and various types of security processing described later.
[0033] In addition, in this embodiment, an information processing device that handles videos to which one or more tags obtained by analyzing the videos, etc. are added will be described. Note that the process of adding tags is performed by, for example, an information processing device or a mobile terminal, but may be performed by another device.
[0034] In this embodiment, an information processing device will be described that receives and utilizes movement information related to the start of movement and end information indicating the end of movement from a mobile terminal.
[0035] In this embodiment, a mobile terminal that transmits movement information to an information processing device will be described.
[0036] Furthermore, in this embodiment, a mobile terminal will be described that obtains one or more tags by analyzing a video and associates the tags with the video.
[0037] In this embodiment, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>
[0038] 1 is a conceptual diagram of an information system A according to the present embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, one or more user terminals 3, and one or more target terminals 4.
[0039] The information processing device 1 is a server that provides a video to a user terminal 3 using videos transmitted by one or more mobile terminals 2. The information processing device 1 is, for example, a cloud server or an ASP server, but the type does not matter. The information processing device 1 may also be a device that constitutes a blockchain. The information processing device 1 mainly performs processing related to videos, so it may also be called a video processing device.
[0040] Here, the original video constituting one video is an image captured by the mobile terminal 2, but may also include images captured by a fixed camera (hereinafter, referred to as a fixed camera, as appropriate). The interval between capture times of the still images contained in the video does not matter. The video may be, for example, a video of 60 frames / second or a video of 30 frames / second, but may also be a collection of still images captured with an interval of a predetermined time (for example, one minute) or more, or may be a collection of still images captured when a predetermined condition is satisfied.
[0041] The mobile terminal 2 is a terminal installed on a moving object and is a terminal that shoots videos. The mobile terminal 2 is, for example, a drive recorder, a smartphone, a tablet terminal, or a camera with a communication function. Installation usually means being fixed, but it may also be considered to include being in contact with or held. The mobile terminal 2 may be, for example, a terminal held by a person. The mobile terminal 2 may also have a driving means such as an engine or a moving means such as wheels. The mobile terminal 2 is a terminal that is not fixed to a building or the ground. The mobile object is a moving object, for example, a terrestrial moving device, a water moving device, an underwater moving device, an aerial moving device, a space moving device, or a living thing. The terrestrial moving device is, for example, a vehicle or a robot. The water moving device is, for example, a ship. The underwater moving device is, for example, a submarine. The aerial moving device is, for example, an aircraft or a drone. The space moving device is, for example, a rocket or an artificial satellite.
[0042] The user terminal 3 is a terminal used by a user. The user is a person who watches a video, a person who needs a video, a person who watches an object, etc. The user terminal 3 may have the functions of the mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides a video.
[0043] The target terminal 4 is a terminal that transmits location information. The target terminal 4 is, for example, a terminal provided in a target. The target is a monitoring target or a photographing target. The target is, for example, a living thing or an object. The living thing is, for example, a person or an animal such as a pet. The person is, for example, a child or an elderly person. The object of the target is, for example, an object that is not desired to be stolen, such as a car, a motorcycle, or a bicycle. However, the monitoring target is not limited.
[0044] The information processing device 1 and one or more mobile terminals 2 can usually communicate with each other via a network such as the Internet. Also, the information processing device 1 and one or more user terminals 3 can usually communicate with each other via a network such as the Internet. Also, the information processing device 1 and one or more target terminals 4 can usually communicate with each other via a network such as the Internet. Note that the user terminal 3 and the target terminal 4 can communicate with each other via a network such as the Internet.
[0045] Fig. 2 is a block diagram of an information system A according to the present embodiment, and Fig. 3 is a block diagram of an information processing device 1. <Example of each device configuration>
[0046] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a terminal management unit 111. The receiving unit 12 includes a movement information receiving unit 121, and a location receiving unit 122. The processing unit 13 includes a movement information accumulation unit 131, a video acquisition unit 132, a video composition unit 133, and a right holder processing unit 134. The right holder processing unit 134 includes a first security means 1341, a second security means 1342, a third security means 1343, a fourth security means 1344, and a remuneration means 1345. The transmitting unit 14 includes a video transmitting unit 141.
[0047] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, and a moving transmitting unit 24. The moving processing unit 23 includes a shooting unit 231, a tag acquiring unit 232, and a moving information acquiring unit 233. The moving transmitting unit 24 includes a moving information transmitting unit 241, and a moving video transmitting unit 242.
[0048] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit , a user reception unit 35, and a user output unit . <Details of components of information processing device 1>
[0049] Various types of information are stored in the storage unit 11 constituting the information processing device 1. The various types of information are, for example, terminal information (to be described later), an attribute value set (to be described later), movement information (to be described later), termination information (to be described later), a video, a correspondence table, one or more pieces of fixed terminal information, a set of an attribute value tag condition and a tag (to be described later), and a set of a video tag condition and a tag (to be described later).
[0050] The correspondence table is a table that manages the correspondence between the target terminal 4 and the user terminal 3. It can also be said that the correspondence table is a table that manages the subjects of photography and users. The correspondence table has multiple pieces of correspondence information having, for example, the identifiers of the target terminal 4 and the identifiers of the user terminal 3.
[0051] The fixed terminal information is information about a fixed terminal (not shown). The fixed terminal has a fixed camera and a communication function. The fixed terminal information includes a fixed terminal identifier and a fixed attribute value set. The fixed terminal information may be associated with a video. The fixed terminal identifier may be included in the fixed attribute value set. The fixed terminal identifier is information for identifying a fixed terminal. The fixed terminal identifier may be a right holder identifier for identifying a right holder who is a user of the fixed terminal. The fixed terminal identifier is, for example, the ID of the fixed terminal, the name of the fixed terminal, the IP address of the fixed terminal, and the MAC address of the fixed terminal. The fixed attribute value set is a set of one or more fixed video attribute values. The fixed video attribute value is an attribute value of a fixed video. The fixed video attribute value is, for example, environmental information and a tag. The fixed video attribute value is a dynamic attribute value that can change dynamically, or a static attribute value that does not change dynamically. The static attribute value of the fixed terminal is, for example, location information and camera information. The dynamic attribute value of the fixed terminal is, for example, time information, weather information, temperature information, and season information.
[0052] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information related to the mobile terminal 2. The terminal information includes, for example, a terminal identifier and an attribute value set. The terminal information may be associated with a video captured by the mobile terminal 2. The terminal identifier may also be included in the attribute value set.
[0053] The terminal identifier is information for identifying the mobile terminal 2. The terminal identifier may be a right holder identifier for identifying the right holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.
[0054] A rights holder is someone who has some right related to a video. A rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that shot the video, or the person with the right to dispose of the video. A rights holder is the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it can be anyone who has the rights to the video shot by the mobile terminal 2.
[0055] The right holder identifier is an identifier of the right holder of the video. The right holder identifier may be a terminal identifier. The right holder identifier is, for example, a right holder ID, a right holder name, a right holder email address, or a right holder phone number. The right holder ID is, for example, a user identifier.
[0056] An attribute value set is a set of one or more moving image attribute values. A moving image attribute value is an attribute value of a moving image. A moving image attribute value is, for example, environmental information. A moving image attribute value is, for example, a tag. A moving image attribute value is usually a dynamic attribute value that can change dynamically, but may also be a static attribute value that does not change dynamically.
[0057] The environmental information is information about the environment in which the video was shot. The environmental information is, for example, location information, direction information, camera information, time information, weather information, temperature information, and season information. The location information is information that specifies the shooting location. The shooting location is the location of the camera that shoots. The location information is, for example, (latitude, longitude) or (latitude, longitude, altitude). However, the location information may be an area identifier that specifies an area on a map, an address, a road identifier that specifies a road, a lane identifier that specifies a lane on a road, and the like. The direction information is information that specifies the direction of shooting. The direction information is, for example, an angle from true north. The camera information is information about the camera. The camera information is, for example, an angle of view and a resolution. The time information is information that specifies the time when the video was shot. The time when the video was shot may be a time around the time when the video was shot, and accuracy is not required. The time information is, for example, time, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / day, and month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that specifies the weather at the location where the video was shot when it was shot. Examples of weather information are "sunny," "rain," "snow," and "cloudy." Temperature information is information that specifies the outside temperature at the location where the video was shot when it was shot. Examples of temperature information are "25 degrees" and "above 30 degrees." Season information is information that specifies the season at the location where the video was shot when it was shot. Examples of season information are "spring," "summer," "early summer," and "winter."
[0058] A tag is information that identifies the characteristics of a video. A tag is, for example, information resulting from analyzing a video. A tag is, for example, information resulting from analyzing one or more moving object attribute values. A tag is, for example, information resulting from analyzing multiple moving object attribute values in time series.
[0059] A moving object attribute value is an attribute value related to a moving object. A moving object attribute value is, for example, information related to movement that a moving object can acquire while moving. A moving object attribute value is, for example, CAN (Controller Area Network) data, information indicating the use of an airbag. CAN data is, for example, speed, engine RPM, and brake status. A tag is, for example, "accident," "traffic jam," "dangerous driving," "speeding," and the name of an object shown in the video (for example, "person," "bear," or the name of a famous person).
[0060] The video attribute values of position information, direction information, time information, weather information, temperature information, and season information are dynamic attribute values, while the camera information is a static attribute value.
[0061] The receiving unit 12 receives various types of information and instructions from the mobile terminal 2, the user terminal 3, or the target terminal 4. The various types of information and instructions are, for example, movement information, end information, location information, an inquiry, an attribute value set, a video, a purchase instruction, and a viewing instruction.
[0062] It should be noted that a purchase instruction is an instruction to purchase a video. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information that identifies a video. The purchase instruction has, for example, a video identifier. The purchase instruction includes, for example, an inquiry. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, a purchase price. The purchase conditions include, for example, information that identifies a rights period.
[0063] The viewing instruction is an instruction to view a video. The viewing instruction corresponds to a user identifier. The viewing instruction corresponds to a video identifier that identifies a video.
[0064] The receiving unit 12 receives the video from the mobile terminal 2. The receiving unit 12 receives the video from the mobile terminal 2 for which permission from the user has been accepted, for example, in accordance with a usage mode flag stored in the mobile terminal 2.
[0065] The usage mode flag is information that specifies the stance of the rights holder of a video when a third party uses the video. The usage mode flag is, for example, information indicating that "there is a desire for permanent use" or information indicating that "temporary use is acceptable." Note that permanent use is not temporary use. The usage mode flag is, for example, information indicating that "permission from the rights holder is required for a third party to use the video" or information indicating that "permission from the rights holder is not required for a third party to use the video."
[0066] For example, when the usage mode flag stored in the mobile terminal 2 indicates that there is a desire for non-provisional use, the receiving unit 12 receives video from the mobile terminal 2 only if the mobile terminal 2 accepts permission from the user.
[0067] It is preferable that a right holder identifier that identifies the right holder of the moving image is associated with the moving image received by the receiving unit 12. For example, one or more moving image attribute values are associated with the moving image received by the receiving unit 12.
[0068] The receiving unit 12 may receive video captured by a fixed camera (not shown) from a fixed terminal (not shown). The fixed terminal acquires and transmits the video captured by the fixed camera.
[0069] The movement information receiving unit 121 receives movement information from the mobile terminal 2 when the mobile terminal 2 starts moving. The start time is preferably immediately after the start, but may be after a predetermined time (for example, one minute) has elapsed since the start of the movement. The movement information receiving unit 121 usually receives movement information associated with the terminal identifier of the mobile terminal 2.
[0070] The movement information is information specifying that the mobile terminal 2 is moving. The information specifying that the mobile terminal 2 is moving may be information specifying that the mobile terminal 2 has started moving. The movement here may mean that the mobile terminal 2 is about to start moving, or that the mobile terminal 2 is currently moving. The movement information is, for example, a movement start flag and a terminal identifier. The movement start flag is information indicating that the mobile terminal 2 is about to start moving. The movement start means, for example, that the engine has been turned on and that the mobile terminal 2 has started shooting. The terminal identifier is an identifier of the mobile terminal 2 that is starting to move. The terminal identifier may be the same as the right holder identifier.
[0071] The movement information receiving unit 121 receives end information from the mobile terminal 2 when the movement of the mobile terminal 2 ends. The end is preferably immediately before the end, but may be after the end of the movement, etc. The movement information receiving unit 121 usually receives end information associated with the terminal identifier of the mobile terminal 2.
[0072] The end information is information that specifies that the mobile terminal 2 will stop moving. The end information is information that indicates that video cannot be transmitted. The end information is, for example, a movement end flag or a terminal identifier. The movement end flag is information that indicates that movement will end. Ending movement means, for example, that the engine has been turned off or that the power supply of the mobile terminal 2 has been turned off. The terminal identifier is the identifier of the mobile terminal 2 that will end movement.
[0073] The location receiving unit 122 receives location information of the target terminal 4. The location receiving unit 122 usually receives location information of the target terminal 4 while moving. For example, the location receiving unit 122 sequentially receives multiple pieces of location information of the target terminal 4 at different times. The location information of the target terminal 4 is information that specifies the location of the target terminal 4. The location information is, for example, (latitude, longitude) or (latitude, longitude, altitude), but may also be an ID that specifies the location.
[0074] The location receiving unit 122 may receive the location information from the target terminal 4, or may receive the location information from the user terminal 3 that has received the location information from the target terminal 4, etc.
[0075] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by a movement information accumulation unit 131, a video acquisition unit 132, a video composition unit 133, and a right holder processing unit 134. The processing unit 13 may perform the same processing as a tag acquisition unit 232 described later.
[0076] When a purchase instruction is received, the processing unit 13 acquires a user identifier corresponding to the user terminal 3 that sent the purchase instruction, and stores the user identifier in a pair with the video identifier included in the purchase instruction. The user identifier is the identifier of the new right holder of the video. This process may be performed by the fourth security means 1344.
[0077] When the processing unit 13 receives a viewing instruction, the processing unit 13 acquires the moving image identified by the moving image identifier included in the viewing instruction, and transmits the moving image to the user terminal 3 that transmitted the viewing instruction.
[0078] The movement information accumulation unit 131 accumulates the movement information received by the movement information receiving unit 121 in association with the mobile terminal 2. Associating with the mobile terminal 2 means, for example, associating with a right holder identifier. The right holder identifier may be a terminal identifier. The movement information accumulation unit 131 accumulates the movement information in the terminal management unit 111, for example. In response to, for example, the movement information receiving unit 121 receiving the end information, the movement information accumulation unit 131 deletes the movement information that is paired with the right holder identifier that corresponds to the end information. In response to, for example, the movement information receiving unit 121 receiving the end information, the movement information accumulation unit 131 accumulates the end information in association with the mobile terminal 2.
[0079] The video acquisition unit 132 acquires videos captured by one or more mobile terminals 2. The videos acquired by the video acquisition unit 132 are usually associated with an attribute value set. The attribute value set includes one or more pieces of environmental information. It is preferable that the one or more pieces of environmental information include location information that identifies the shooting location. It is preferable that the one or more pieces of environmental information include time information that identifies the shooting time. In addition, it is preferable that the videos are associated with a right holder identifier of the mobile terminal 2.
[0080] The video acquisition unit 132 normally acquires videos from a mobile terminal 2 that has captured an image of an area corresponding to the location information received by the location receiving unit 122. The mobile terminal 2 that has captured an area may be a mobile terminal 2 that would have captured an image of the area, and is broadly understood as such. In other words, a mobile terminal 2 may exist in a position where it would be possible to capture an image, but the video transmitted from the mobile terminal 2 may not include an object corresponding to the location information received by the location receiving unit 122. The video acquisition unit 132 normally acquires videos from one or more mobile terminals 2 that have captured an image of an area corresponding to each of the multiple pieces of location information received by the location receiving unit 122.
[0081] The video acquisition unit 132, for example, sequentially acquires a plurality of videos that match the location condition from different mobile terminals 2, respectively.
[0082] The location condition is that an area including the location information of the target terminal 4 is photographed, or that the area is likely to be photographed. The location condition is, for example, that the distance between the location information of the target terminal 4 and the location information of the mobile terminal 2 is within a threshold or less than a threshold. The location condition is, for example, that the position indicated by the location information of the target terminal 4 is included in the photographing range specified using the location information of the mobile terminal 2 and the angle of view and direction information of the camera of the mobile terminal 2. The location condition is, for example, that the position indicated by the location information of the target terminal 4 is included in the photographing range specified using the location information of the mobile terminal 2 and the angle of view and direction information of the camera of the mobile terminal 2, and that the distance between the location information of the mobile terminal 2 and the location information of the target terminal 4 is within a threshold or less than a threshold.
[0083] The shooting range is the range indicated by the range specifying information. The range specifying information is information specifying a region acquired using one piece of location information of the mobile terminal 2 transmitted from the mobile terminal 2, or the one piece of location information and the angle of view and direction information of the camera of the mobile terminal 2. Such information specifying the region is usually a collection of multiple pieces of location information. Camera information including the angle of view and direction information of the camera of the mobile terminal 2 is stored in the terminal management unit 111 in association with a terminal identifier. The process of acquiring range specifying information specifying the range shot by the camera using the position information, angle of view, and direction information of the camera is a known process.
[0084] For example, when it is determined that the location information received by the location receiving unit 122 is not within the shooting range of the video transmitted from the mobile terminal 2, the video acquiring unit 132 acquires a video from another mobile terminal 2 that captures the area corresponding to the location information. Note that, although it is preferable that the video acquiring unit 132 performs such a determination, the mobile terminal 2 may perform it.
[0085] The video acquisition unit 132 acquires the video from the mobile terminal 2, for example, by one of the following three methods. (1) Inquiry method
[0086] The inquiry method is a method in which the location receiving unit 122 inquires of one or more mobile terminals 2 as to whether or not the location information of the target terminal 4 received satisfies a location condition.
[0087] The video acquisition unit 132 constructs a query having the location information of the target terminal 4 received by the location receiving unit 122, transmits the query to one or more mobile terminals 2, and receives video from one or more mobile terminals 2 determined to satisfy the location condition for the location information. It is preferable that the mobile terminal 2 to which the video acquisition unit 132 transmits the query is the mobile terminal 2 corresponding to the movement information. The mobile terminal 2 corresponding to the movement information is a terminal capable of transmitting video. The mobile terminal 2 corresponding to the movement information is usually a terminal that is moving. (2) Determination method
[0088] The determination method is a method in which the video acquisition unit 132 determines one or more mobile terminals 2 that satisfy a location condition for the location information of the target terminal 4.
[0089] In this case, the position information or range identification information of one or more mobile terminals 2 is stored in the terminal management unit 111. Moreover, the position information or range identification information of the terminal management unit 111 is preferably constantly or periodically updated and is the latest position information or latest range identification information of the mobile terminal 2. Moreover, it is preferable that the position information of the terminal management unit 111 corresponds to the angle of view and direction information of the camera.
[0090] The video acquisition unit 132 refers to the terminal management unit 111 and determines one or more mobile terminals 2 that satisfy a location condition for the location information of the target terminal 4 received by the location receiving unit 122. Next, the video acquisition unit 132 transmits a request to transmit video to the one or more mobile terminals 2, and receives video from each of the one or more mobile terminals 2. It is preferable that the transmission request includes the location information of the target terminal 4.
[0091] When the video acquisition unit 132 receives videos from multiple mobile terminals 2, it is preferable to select one video by using one or more video attribute values included in the attribute value set of the mobile terminal 2. The video acquisition unit 132 selects, for example, a video of the mobile terminal 2 corresponding to the location information closest to the target location information. (3) Search method
[0092] The search method is a method of searching for videos that capture an area corresponding to the location information received by the location receiving unit 122 from among the videos received from one or more mobile terminals 2 .
[0093] In such a case, the mobile terminal 2 spontaneously transmits the moving image to the information processing device 1 in association with the attribute value set. The attribute value set includes, for example, location information, or location information, angle of view, and direction information, or range specification information. The receiving unit 12 receives the moving image and the attribute value set from the mobile terminal 2. Next, the processing unit 13 stores the moving image and the attribute value set in the storage unit 11 in association with the right holder identifier.
[0094] Then, the moving image acquiring unit 132 acquires from the storage unit 11 a moving image corresponding to a moving image attribute value that satisfies a location condition for the location information of the target terminal 4 received by the location receiving unit 122 .
[0095] The moving image composing section 133 composes one moving image to be transmitted, using the moving image acquired by the moving image acquiring section 132. Note that composing one moving image may simply mean acquiring one moving image.
[0096] The moving image composing unit 133 composes one moving image, for example, using a plurality of moving images acquired by the moving image acquiring unit 132. The moving image composing unit 133 composes one moving image, for example, by connecting the plurality of moving images acquired sequentially by the moving image acquiring unit 132 in chronological order.
[0097] The video composing unit 133 composes one video by indicating the position of the target terminal 4 in a frame of the video acquired by the video acquiring unit 132. Indicating the position means, for example, adding a figure such as a circle or a rectangle, an arrow, or the like to the position indicated by the position information of the target in the frame.
[0098] The following describes further specific examples of the processing by the moving image composing unit 133. The moving image composing unit 133 performs (1) temporal combination of moving images, or (2) spatial combination of moving images, or both (1) and (2). (1) Temporal video merging
[0099] The moving image constructing unit 133 constructs one moving image by, for example, combining a plurality of moving images in terms of time.
[0100] The moving image composing unit 133, for example, combines in time a plurality of moving images having different time information corresponding to each of the plurality of moving images acquired by the moving image acquiring unit 132 to compose one moving image. Combining a plurality of moving images in time to compose one moving image may mean passing the plurality of moving images in order to the moving image transmitting unit 141. In other words, combining a plurality of moving images in time to compose one moving image is sufficient as long as the user sees the moving images as one moving image.
[0101] For example, the moving image composing unit 133 combines the multiple moving images acquired by the moving image acquiring unit 132 in the order in which the moving images were received to compose one moving image. For example, the moving image composing unit 133 acquires a part of each of the multiple moving images acquired by the moving image acquiring unit 132, and combines the parts of the moving images in order to compose one moving image. Combining multiple moving images in time usually means combining parts of the moving images captured by the mobile terminal 2 in order. Combining parts of the moving images in order may also mean passing parts of the moving images to the moving image transmitting unit 141 in order. Combining in the order of time corresponding to the moving images means combining the moving images in the order of time indicated by the time information corresponding to the moving images, or combining the moving images in the order in which the moving images were received. (2) Spatial video integration
[0102] The moving image composing unit 133 composes one moving image, for example, by spatially fusing a part of each of the multiple moving images acquired by the moving image acquiring unit 132. The moving image composing unit 133 composes one frame using a part or all of the frames constituting each of the multiple moving images acquired by the moving image acquiring unit 132, and connects the multiple frames in time to compose one moving image.
[0103] For example, moving image constructor 133 constructs one moving image having a plurality of frames by spatially fusing at least some of the frames of one moving image with at least some of the frames of another moving image.
[0104] The process of spatially fusing frames included in each of a plurality of moving images is, for example, the following processes (a) and (b). (a) Image processing-based methods
[0105] The moving image composing unit 133 performs, for example, a process of matching the direction and scale of each of the multiple frames that are the subject of the spatial connection process. Next, the moving image composing unit 133 detects, for example, the same area in each of the multiple frames. Next, the moving image composing unit 133 performs, for example, a process of overlapping multiple frames having the same area to compose one wide-area frame. Note that it is possible to detect the same area in each of the multiple frames using publicly known technology. (b) Machine learning-based methods
[0106] The video composition unit 133, for example, provides a plurality of frames and a learning model to a module that performs machine learning prediction processing, executes the module, and acquires one wide-area frame.
[0107] The learning model is obtained by providing multiple teacher data sets, which have multiple frames as explanatory variables and a wide-area frame composed of the multiple frames as the objective variable, to a module that performs machine learning learning processing, executing the module, and so on.
[0108] The learning model may be called a learner, a classifier, a classification model, etc. The machine learning algorithm is preferably deep learning, but may be random forest, etc. For machine learning, various machine learning functions such as the TensorFlow library and the random forest module of the R language, and various existing libraries may be used.
[0109] The right holder processing unit 134 performs right holder processing. The right holder processing is processing related to the rights of one video. The right holder processing is, for example, processing related to a right holder identified by a right holder identifier corresponding to one video composed by the video composition unit 133. The right holder processing is, for example, a first security processing described later, a second security processing described later, a third security processing described later, a fourth security processing described later, and a remuneration processing described later.
[0110] Right holder processing unit 134 performs right holder processing, which is processing in response to video transmission unit 141 transmitting a video, for example, and is processing related to a right holder identified by a right holder identifier associated with the video.
[0111] In addition, the right holder identifier corresponding to one video is, for example, a right holder identifier corresponding to each of the multiple videos that are the basis of the constructed one video, or a user identifier for the user terminal 3 to which the one video is transmitted.
[0112] The right holder processing unit 134, for example, stores the moving image acquired by the moving image acquisition unit 132 in association with the right holder identifier. The right holder identifier usually includes the right holder identifier of the right holder of the original moving image or the right holder identifier of the right holder of one moving image.
[0113] The first maintenance means 1341 performs a first maintenance process of storing one moving image composed by the moving image composition unit 133 in association with an attribute value set corresponding to each of the multiple moving images that are the source of the moving image. The first maintenance means 1341 may also perform a first maintenance process of storing a moving image transmitted from the mobile terminal 2 in association with an attribute value set corresponding to the moving image.
[0114] The second security means 1342 performs a second security process of storing one moving image composed by the moving image composition unit 133 in association with the right holder identifiers corresponding to the multiple original moving images from which the moving image was created.
[0115] In addition, the first maintenance means 1341 or the second maintenance means 1342 may store a video composed by the video composition unit 133 in association with a set of attribute values corresponding to each of the multiple videos that were the basis for the video, and with a rights holder identifier corresponding to each of the multiple videos that were the basis for the video.
[0116] The third security means 1343 stores one video composed by the video composition unit 133 in association with a right holder identifier that identifies the user of the user terminal 3. The user of the user terminal 3 here is the person who watches one video. The user terminal 3 here is the user terminal 3 corresponding to the target terminal 4 of the target appearing in the one video. The user terminal 3 here is, for example, a terminal of a parent of a child to be watched over, or a terminal of a caregiver of an elderly person to be watched over.
[0117] In addition, the destination where one video is stored is, for example, the storage unit 11, but it may be another device, another device that constitutes a blockchain, etc. In addition, the stored video is usually associated with a video identifier that identifies the video.
[0118] The fourth security means 1344 performs a fourth security process to store security information including access information for accessing one of the stored moving images. The order of storing the moving image and the fourth security process for the security information corresponding to the moving image does not matter.
[0119] The fourth maintenance means 1344 performs a fourth maintenance process, for example, of storing maintenance information including access information for accessing one stored video composed by the video composition unit 133 in the blockchain.
[0120] In addition, it is preferable that the fourth maintenance means 1344 accumulates the maintenance information in a blockchain. That is, it is preferable that the fourth maintenance means 1344 accumulates the maintenance information in a distributed ledger of the blockchain. It is preferable that the fourth maintenance means 1344 registers the maintenance information as an NFT (non-fungible token). It is preferable that the fourth maintenance means 1344 registers the maintenance information in a distributed file system in an IPFS (Inter Planetary File System) network.
[0121] The preservation information is information for ensuring the originality of a video. It can be said that the preservation information is heading information for a video. The preservation information is, for example, access information and a set of attribute values. It is preferable that the preservation information has, for example, one or more right holder identifiers. When the preservation information has multiple right holder identifiers, the right holder of the video may be shared, and the multiple right holder identifiers may be right holder history information. The right holder history information is a set of right holder identifiers and is information indicating the history of the right holder. The fourth preservation process can ensure the originality of the preservation information of the registered video. By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. The access information is information for accessing a video. The access information is information that identifies the storage destination of the video. The access information is, for example, a URL or a URI.
[0122] It is preferable that the security information includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.
[0123] The remuneration means 1345 performs, for example, remuneration processing for each right holder identified by a right holder identifier corresponding to each of a plurality of moving images that are the basis of one moving image composed by the moving image composition unit 133 .
[0124] The reward process is a process for giving a reward. The reward process is, for example, a process for increasing points managed in pairs with one or more right holder identifiers corresponding to a video. The reward process is, for example, a process for making a payment to a right holder identified by one or more right holder identifiers corresponding to a video. The reward process is, for example, a process for transmitting a video or other content to a user terminal 3 of a right holder identified by one or more right holder identifiers corresponding to a video. The reward process may be of any kind as long as it gives a merit to a right holder identified by one or more right holder identifiers corresponding to a video. The reward may be, for example, money, points, goods, content, or the like, and the content may be of any kind.
[0125] It is preferable that the reward means 1345 acquires a set of attribute values corresponding to each of the multiple videos that were the basis for the single video transmitted by the video transmission unit 141, and performs reward processing, which is a process of determining rewards for each of the multiple rights holders using the set of attribute values and awarding the rewards.
[0126] The attribute value set here is, for example, the amount of video data, the duration of the video, the number of frames of the video, and the resolution of the video.
[0127] It is preferable that the reward means 1345 performs a reward process, which is a process of acquiring a reward amount corresponding to a service identifier that identifies a service provided to a target video, and giving a reward corresponding to the reward amount. The service identifier is, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.
[0128] The reward means 1345 performs reward processing, which is processing for acquiring a reward amount using, for example, one or more pieces of information from the attribute value set and the service identifier, and giving a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a reward correspondence table corresponding to each of the multiple service identifiers is stored in the storage unit 11. The arithmetic expression is an expression for calculating the reward amount using one or more video attribute values included in the attribute value set as a parameter. The reward correspondence table is a table having multiple pieces of reward correspondence information for managing reward amounts corresponding to one or more video attribute values.
[0129] The remuneration means 1345 normally performs a process of charging a remuneration to a user who has enjoyed a service related to the target video.
[0130] The process of charging the reward is, for example, a process of charging the amount of reward acquired. The process of charging the reward is, for example, a process of charging the amount of reward acquired and the amount of profit obtained by the management of the information processing device 1. The process of charging the reward is, for example, a process of deducting points corresponding to the user who enjoyed the service, a settlement process using the credit card number of the user, etc.
[0131] The transmission unit 14 transmits various types of information or instructions to the mobile terminal 2 or the user terminal 3. The various types of information or instructions are, for example, video, inquiries, and transmission requests.
[0132] The video sending unit 141 transmits one video based on the video acquired by the video acquiring unit 132. The one video based on the video acquired by the video acquiring unit 132 is one video obtained by combining multiple videos acquired by the video acquiring unit 132, or one video acquired by the video acquiring unit 132. The video sending unit 141 transmits, for example, one video obtained by combining multiple videos acquired by the video acquiring unit 132. The video sending unit 141 transmits, for example, one video composed by the video composition unit 133.
[0133] The video transmission unit 141 transmits one video to, for example, a user terminal 3 paired with the target terminal 4. The video transmission unit 141, for example, refers to the correspondence table in the storage unit 11, determines the user terminal 3 corresponding to the target terminal 4, and transmits one video to the user terminal 3. <Details of components of mobile terminal 2>
[0134] Various types of information are stored in the mobile storage unit 21 constituting the mobile terminal 2. The various types of information are, for example, video, attribute value set, right holder identifier, movement information, end information, a pair of attribute value tag condition and tag, a pair of video tag condition and tag, and a usage mode flag. The mobile storage unit 21 typically stores one or more pairs of attribute value tag condition and tag. The mobile storage unit 21 typically stores one or more pairs of video tag condition and tag. It is preferable that the attribute value set has position information, the angle of view of the camera which is the shooting unit 231, and camera direction information.
[0135] For example, one or more moving image attribute values constituting an attribute value set correspond to one or more still images (which may also be called fields or frames) that make up a moving image. The one or more moving image attribute values may correspond to all still images, one still image, or multiple still images.
[0136] An attribute value tag condition is a condition for acquiring a tag based on one or more mobile object attribute values. An attribute value tag condition is a condition related to one or more mobile object attribute values. Examples of the attribute value tag condition are "one or more pieces of location information indicating a specific location or area," "the brake has been applied suddenly," "the degree of speed deceleration (acceleration) within a unit time is equal to or less than a threshold (the brake has been applied suddenly)," "the airbag has been activated," "the time at or below a first speed has elapsed for a second hour or more (there is a traffic jam)," and "the location information corresponds to a specific name." Examples of tags paired with an attribute value tag condition are "a name indicating a specific location or area (for example, a place name, a region name, a scenic spot name)," "abnormal driving," "accident," "traffic jam," and "specific place name."
[0137] A video tag condition is a condition related to a video. A video tag condition is a condition based on the analysis results of a video. Examples of video tag conditions are "having a still image of a car colliding with a person (meaning an accident)" and "there being no sidewalk on the road (meaning a dangerous road)." Tags that pair with a video tag condition are, for example, "accident" and "danger."
[0138] The mobile receiving unit 22 receives various types of information, such as inquiries and transmission requests.
[0139] The movement processing unit 23 performs various processes. The various processes are, for example, processes performed by the photographing unit 231, the tag acquiring unit 232, and the movement information acquiring unit 233. The movement processing unit 23 creates a data structure for outputting the information received by the movement receiving unit 22.
[0140] The movement processing unit 23 detects, for example, the start of movement. The detection of the start of movement is, for example, detection of the power supply being turned on of the mobile terminal 2 or detection of the engine being turned on of the moving object.
[0141] The movement processing unit 23 detects, for example, the end of movement. The detection of the end of movement is, for example, detection of the power supply of the mobile terminal 2 being turned off, or detection of the engine of the moving object being turned off.
[0142] The movement processing unit 23, for example, determines an attribute value set that matches the query received by the mobile receiving unit 22, and acquires a video paired with the attribute value set. The movement processing unit 23, for example, acquires a video being shot. The movement processing unit 23 acquires a video from the movement storage unit 21, for example. The attribute value set that matches the query usually has position information that satisfies a position condition for the position information held by the query. The attribute value set that matches the query usually has position information, an angle of view, and direction information that specify a shooting range that includes the position indicated by the position information held by the query. Here, if an attribute value set that matches the query received by the mobile receiving unit 22 cannot be determined, the movement processing unit 23 does not acquire a video.
[0143] For example, when the mobile receiving unit 22 receives a request to transmit a video, the movement processing unit 23 acquires the video captured by the imaging unit 231. For example, when the mobile receiving unit 22 receives a request to transmit a video including location information, the movement processing unit 23 acquires a video corresponding to the location information from the movement storage unit 21. Such location information is the location information of the target terminal 4. In addition, the video corresponding to the location information is a video including a frame that is paired with the location information that satisfies a location condition for the location information.
[0144] The movement processing unit 23, for example, acquires an attribute value set during shooting. The movement processing unit 23 accumulates the acquired attribute value set in the movement storage unit 21. The movement processing unit 23 also associates the acquired attribute value set with a moving image, for example. Associating with a moving image usually means associating with a frame that constitutes the moving image. It is preferable that the attribute value set and the frame are synchronized in time.
[0145] The attribute value set is, for example, one or more pieces of environmental information, such as location information, time information, weather information, temperature information, and season information.
[0146] The movement processing unit 23 usually acquires location information during shooting. For example, the movement processing unit 23 having a GPS receiver function acquires the location information. The movement processing unit 23 acquires the location information, for example, constantly at predetermined intervals.
[0147] The movement processing unit 23 acquires time information from a clock (not shown) during shooting, for example. The movement processing unit 23 acquires time information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
[0148] For example, during shooting, the movement processing unit 23 acquires time information from a clock (not shown) and acquires season information corresponding to the time information.
[0149] The movement processing unit 23 acquires weather information, for example, during shooting. The movement processing unit 23 acquires weather information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
[0150] The movement processing unit 23 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed on a moving object. The movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
[0151] It is preferable that the movement processing unit 23 includes, for example, a microphone, acquires sound information, and stores the sound information in association with the video acquired by the imaging unit 231. Such a function is, for example, a function of a drive recorder.
[0152] The movement processing unit 23, for example, acquires the usage mode flag of the movement storage unit 21, and judges whether the usage mode flag is information indicating whether to inquire of the user whether to transmit the moving video before transmitting the moving video. For example, when the usage mode flag is a value indicating "non-provisional request for actual use", the movement processing unit 23 outputs inquiry information which is information for inquiring of the user whether to transmit the moving video. Note that the inquiry information is, for example, screen information (for example, a panel) for inquiring whether to transmit the moving video, or audio information for inquiring whether to transmit the moving video.
[0153] The photographing unit 231 photographs a moving image. The photographing unit 231 starts photographing after detecting the start of movement, for example. It is preferable that the photographing unit 231 continues photographing until detecting the end of movement, for example.
[0154] It is preferable that the imaging unit 231 stores the captured video in the moving storage unit 21. When storing video in the moving storage unit 21 with a limited storage capacity, it is preferable that the imaging unit 231 overwrites new video in an area in which old video is stored. In other words, it is preferable that the structure of the moving storage unit 21 is a ring buffer structure.
[0155] The tag acquiring unit 232 acquires one or more tags for the video captured by the imaging unit 231 and associates them with the video.
[0156] The tag acquisition unit 232, for example, analyzes a moving image captured by the image capture unit 231 and acquires one or more tags for the moving image.
[0157] The tag acquiring unit 232 acquires one or more tags, for example, by using one or more moving object attribute values acquired during shooting by the shooting unit 231. The moving object attribute values are, for example, CAN data.
[0158] For example, the tag acquiring unit 232 determines one or more still images that match the video tag condition, and acquires a tag that is paired with the video tag condition. The tag acquiring unit 232 may also associate the tag with the one or more still images. Note that the still images are frames that constitute the video.
[0159] For example, if a video tag condition is "the distance between a person and a car is 0" and the tag paired with the video tag condition is "accident", the tag acquisition unit 232 analyzes frames of the video, recognizes the person and the car in the frame, acquires the distance between the person and the car, determines whether the distance is 0 or not, and acquires the tag "accident" if it is 0. Furthermore, the tag acquisition unit 232 may associate the tag "accident" with the analyzed frame.
[0160] For example, the tag acquiring unit 232 determines one or more moving object attribute values that match the attribute value tag condition, and acquires a tag that is paired with the attribute value tag condition. The tag acquiring unit 232 may also associate the tag with a video that is paired with the one or more moving object attribute values.
[0161] For example, if the attribute value tag condition is "driving time at a speed less than 30 km for 10 minutes or more & the ratio of the speed less than 30% during the driving time is 80% or more" and the tag paired with the attribute value tag condition is "traffic jam", the tag acquisition unit 232 detects CAN data that matches the attribute value tag condition using the speed history of the CAN data associated with each field of the video, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is the CAN data acquired at the same timing as the field was shot.
[0162] The movement information acquisition unit 233 detects the movement of the mobile terminal 2, and acquires movement information, for example, at the start of the movement. The movement information acquisition unit 233 acquires movement information, which is, for example, a right holder identifier of the movement storage unit 21. The movement information acquisition unit 233 acquires, for example, the movement information of the movement storage unit 21. Note that the movement information is, for example, a right holder identifier, and information indicating that movement has started. Detection of the movement of the mobile terminal 2 is, for example, detection of the engine being ON, or detection of the power supply being ON of the mobile terminal 2.
[0163] The movement information acquisition unit 233 detects, for example, the end of movement of the mobile terminal 2, and acquires end information indicating that the movement has ended.
[0164] The movement transmitting unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, movement information, end information, a video, and an attribute value set.
[0165] The movement information transmission unit 241 normally transmits the movement information acquired by the movement information acquisition unit 233 at the start of movement to the information processing device 1. When the movement ends, the movement information transmission unit 241 transmits end information to the information processing device 1.
[0166] The moving video transmitting unit 242 transmits the video captured by the imaging unit 231 to the information processing device 1. The timing at which the moving video transmitting unit 242 transmits the video does not matter. For example, after the movement processing unit 23 acquires a video paired with an attribute value set that matches the query received, the moving video transmitting unit 242 transmits the video to the information processing device 1. For example, in response to receiving a transmission request, the moving video transmitting unit 242 transmits the video being captured or the video corresponding to the transmission request to the information processing device 1. For example, when the imaging unit 231 captures a video, the moving video transmitting unit 242 constantly transmits the video to the information processing device 1.
[0167] It is preferable that the mobile transmission unit 24 does not transmit the sound information acquired by the mobile processing unit 23 even if it transmits the video captured by the imaging unit 231 to the information processing device 1. The sound information may be, for example, voice information of the driver or passengers in the moving object, and transmitting such sound information to the information processing device 1 and providing it to the user terminal 3 or the like may threaten the privacy of the driver or passengers, which is not appropriate.
[0168] When the movement processing unit 23 inquires of the user of the mobile terminal 2 whether or not to transmit a video based on the usage mode flag, the movement video transmission unit 242 transmits a video only when information indicating that a video will be transmitted is received in response to the inquiry. The information indicating that a video will be transmitted or that a video will not be transmitted is received by a movement reception unit (not shown) possessed by the mobile terminal 2. It is preferable that the movement processing unit 23 inquires of the user of the mobile terminal 2 whether or not to transmit a video based on the usage mode flag at the start of movement. It is also preferable that the movement processing unit 23 resets the answer to the inquiry at the end of movement. <Details of components of user terminal 3>
[0169] Various types of information are stored in the user storage unit 31 constituting the user terminal 3. The various types of information are, for example, a user identifier and a video.
[0170] The user reception unit 32 receives various instructions and information, such as a purchase instruction and a viewing instruction.
[0171] The means for inputting various instructions and information may be any means, such as a touch panel, a keyboard, a mouse, or a menu screen.
[0172] The user processing unit 33 performs various processes. For example, the various processes are processes for creating a data structure for transmitting various instructions and information received by the user receiving unit 32. For example, the various processes are processes for creating a structure for transmitting information received by the user receiving unit 35.
[0173] The user transmission unit 34 transmits various instructions and information to the information processing device 1. The various instructions and information are, for example, a purchase instruction, a viewing instruction, and location information received from the target terminal 4.
[0174] The user receiving unit 35 receives various information and instructions. The various information and instructions are, for example, position information and videos of the target terminal 4. The user receiving unit 35 receives, for example, a video corresponding to the transmitted viewing instruction from the information processing device 1.
[0175] The user output unit 36 outputs various types of information, such as video.
[0176] Here, output is a concept that includes display on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and handing over the processing results to other processing devices or other programs, etc. <Operation description of target device 4>
[0177] The target terminal 4 acquires and transmits location information that identifies the location of the target terminal 4. The target terminal 4 transmits the location information to, for example, the information processing device 1 or the user terminal 3. It is preferable that the target terminal 4 transmits the location information in pair with a target identifier. The target identifier is information that identifies the target. The target identifier is, for example, an ID, a name, a telephone number, an email address, or a MAC address of the target terminal 4. The target terminal 4 acquires the location information by, for example, a GPS receiver, but the method of acquiring the location information is not important.
[0178] The storage unit 11, the terminal management unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0179] There is no restriction on the process by which information is stored in the storage unit 11, etc. For example, information may be stored in the storage unit 11, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 11, etc., or information inputted via an input device may be stored in the storage unit 11, etc.
[0180] The receiving unit 12, the movement information receiving unit 121, the position receiving unit 122, the movement receiving unit 22, and the user receiving unit 35 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.
[0181] The processing unit 13, the movement information accumulation unit 131, the video acquisition unit 132, the video composition unit 133, the right holder processing unit 134, the first security means 1341, the second security means 1342, the third security means 1343, the fourth security means 1344, the reward means 1345, the movement processing unit 23, the tag acquisition unit 232, the movement information acquisition unit 233, and the user processing unit 33 can usually be realized by a processor, a memory, or the like. The processing procedure of the processing unit 13, etc. is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). The processor is a CPU, an MPU, a GPU, etc., and the type does not matter.
[0182] The transmitting unit 14, the video transmitting unit 141, the mobile transmitting unit 24, the mobile information transmitting unit 241, the mobile video transmitting unit 242, and the user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.
[0183] The photographing unit 231 is realized by a camera. The camera may be, for example, a CCD camera, a CMOS camera, a 3D camera, a LiDAR, or an omnidirectional camera, but the type is not limited thereto.
[0184] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen.
[0185] The user output unit 36 may or may not include an output device such as a display, a speaker, etc. The user output unit 36 may be realized by driver software for an output device, or a combination of driver software for an output device and the output device, etc. <Operation>
[0186] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described with reference to the flowchart of Fig. 4. Note that "S" in each flowchart used in the following description indicates a step.
[0187] (S401) The movement information receiving unit 121 determines whether or not movement information associated with a right holder identifier has been received from the mobile terminal 2. If movement information has been received, the process proceeds to S402, and if not, the process proceeds to S403.
[0188] (S402) The movement information accumulation unit 131 accumulates the movement information received in S401 in the terminal management unit 111 in association with the right holder identifier. Return to S401. Note that if the movement information is a right holder identifier, the movement information receiving unit 121 accumulates the right holder identifier.
[0189] (S403) The mobile information receiving unit 121 determines whether or not end information associated with the right holder identifier has been received from the mobile terminal 2. If end information has been received, the process proceeds to S404, and if not, the process proceeds to S405.
[0190] (S404) Processing unit 13 deletes the mobile information paired with the right holder identifier corresponding to the end information from terminal management unit 111. Return to S401. Note that at this point, it is sufficient that the storage unit 11 is managed to indicate that the mobile terminal 2 corresponding to the right holder identifier is in a state in which it cannot transmit video upon receipt of the end information.
[0191] (S405) Position receiving unit 122 judges whether or not it has received the position information of target terminal 4. If it has received the position information, it proceeds to S406, and if it has not received the position information, it returns to S401.
[0192] (S406) The moving image acquisition unit 132 etc. acquires one moving image to be transmitted. An example of such moving image acquisition processing will be described with reference to the flowcharts of FIGS.
[0193] (S407) The processing unit 13 acquires an attribute value set corresponding to the moving image acquired in S406. An example of such an attribute value set acquisition process will be described with reference to the flowchart in Fig. 6. The attribute value set acquisition process here may be a process of acquiring an attribute value set associated with a moving image that is the source of one moving image.
[0194] (S408) The video transmitting unit 141 transmits the video acquired in S406 to the user terminal 3. Note that the video transmitting unit 141 refers to the correspondence table in the storage unit 11, and transmits the video to the user terminal 3 identified by the user identifier paired with the identifier of the target terminal 4 paired with the location information.
[0195] (S409) The video acquisition unit 132 determines whether or not new location information of the target terminal 4 has been received. If new location information has been received, the process proceeds to S410, and if new location information has not been received, the process proceeds to S413. Note that the new location information is location information transmitted from the moving mobile terminal 2, and is different from the location information used when the previous video was acquired.
[0196] Typically, while one or more targets are moving, updated location information is continuously transmitted from target terminal 4. Furthermore, receiver 12 continuously receives location information in association with the target identifier, and stores the location information in storage 11 in a pair with the target identifier. Continuous reception can refer to periodic reception or constant reception, with no restrictions on the interval, frequency, etc. Furthermore, the interval at which location information is received does not need to be constant.
[0197] (S410) The video acquisition unit 132 determines whether the position information acquired in S409 is within the video capture range of the mobile terminal 2. An example of such a determination process will be described with reference to the flowchart of FIG.
[0198] (S411) In S410, if the video acquisition unit 132 determines that it is within the shooting range, the process proceeds to S412, and if it determines that it is not within the shooting range, the process returns to S406. Note that, if the location information acquired in S409 is within the shooting range of the video from the mobile terminal 2, the video from the mobile terminal 2 can be continuously used to acquire a video in which the target for the target terminal 4 is shown.
[0199] (S412) The receiving unit 12 continues to receive the moving image from the mobile terminal 2. The process returns to S403.
[0200] (S413) The video acquisition unit 132 judges whether or not to end acquisition of a video of a target for the target terminal 4. If it is to be ended, the process proceeds to S414, and if it is not to be ended, the process returns to S409. Note that acquisition of a video is ended, for example, when the receiving unit 12 receives an end instruction from the target terminal 4 or the user terminal 3. However, any trigger may be used to end acquisition of a video. The end instruction is transmitted from the target terminal 4 to the information processing device 1, for example, when the target terminal 4 is powered off.
[0201] (S414) The right holder processing unit 134 performs a security process. Return to S401. An example of the security process will be described with reference to the flowchart in FIG.
[0202] In the flowchart of Fig. 4, the receiving unit 12 continuously receives attribute value sets including position information of one or more mobile terminals 2. Then, the processing unit 13 temporarily stores the attribute value sets of the mobile terminals 2 in the storage unit 11 in pairs with the terminal identifiers of the mobile terminals 2. The attribute value set is, for example, information that specifies the shooting range of the mobile terminal 2. The attribute value set is, for example, position information, angle of view, and direction information. However, the attribute value set may be, for example, only position information. When the attribute value set is only position information, it is preferable that the shooting unit 231 of the mobile terminal 2 is an omnidirectional camera.
[0203] 4, it is preferable to obtain continuously captured videos of multiple moving targets and transmit them to the user terminal 3. In other words, it is preferable to perform the processes from S405 to S414 in parallel for each of the multiple targets.
[0204] Furthermore, in the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt for ending the process occurs.
[0205] Next, a first example of the moving image acquisition process in S406 will be described with reference to the flowchart in FIG.
[0206] (S501) The moving image obtaining unit 132 assigns 1 to a counter i.
[0207] (S502) The video acquisition unit 132 determines whether or not the i-th mobile terminal 2 capturing video is present. If the i-th mobile terminal 2 is present, the process proceeds to S503; if not, the process proceeds to S505.
[0208] In addition, the determination of whether or not there is an i-th mobile terminal 2 that is shooting a video is made by, for example, determining whether or not there is an i-th terminal identifier that pairs with the movement information indicating that “movement has begun.”
[0209] (S503) Video acquiring unit 132 acquires location information paired with the terminal identifier of i-th mobile terminal 2. Video acquiring unit 132 also acquires location information of target terminal 4. Next, video acquiring unit 132 calculates the distance between the location information of mobile terminal 2 and the location information of target terminal 4, associates the distance with the terminal identifier, and temporarily accumulates the distance in a buffer (not shown).
[0210] (S504) The moving image obtaining unit 132 increments the counter i by 1. The process returns to S502.
[0211] (S505) The video acquisition unit 132 sorts the attribute value sets paired with the terminal identifiers using the distances calculated in S503 as a key, and temporarily stores the sorted results in a buffer (not shown). Note that the attribute value set here is the position information, angle of view, and direction information of the mobile terminal 2.
[0212] (S506) The moving image obtaining unit 132 assigns 1 to a counter j.
[0213] (S507) The video obtainer 132 determines whether or not there is a j-th mobile terminal 2. If there is a j-th mobile terminal 2, the process proceeds to S508; if there is not, the process returns to S401 in FIG.
[0214] The j-th mobile terminal 2 is a terminal corresponding to the j-th attribute value set sorted in S505. That is, here, the video acquisition unit 132 determines whether or not the j-th attribute value set exists among the attribute value sets sorted in S505.
[0215] In addition, the video acquisition unit 132 is a terminal corresponding to the jth attribute value set sorted in S505, and it is preferable to determine whether the jth mobile terminal 2 is present among the terminals whose distance from the target position is within a threshold value.
[0216] (S508) The moving image obtaining unit 132 obtains the j-th attribute value set from a buffer (not shown).
[0217] (S509) The video acquisition unit 132 acquires shooting range information from the j-th attribute value set. Next, the video acquisition unit 132 determines whether or not the range indicated by the j-th shooting range information includes the position indicated by the position information of the target terminal 4. If it includes the position of the target terminal 4, proceed to S511; if it does not, proceed to S510.
[0218] (S510) The moving image obtaining unit 132 increments the counter j by 1. The process returns to S507.
[0219] (S511) The video acquisition unit 132 composes a transmission request to be transmitted to the j-th mobile terminal 2. Next, the video acquisition unit 132 transmits the transmission request to the j-th mobile terminal 2.
[0220] (S512) The video acquiring unit 132 determines whether or not a video has been received from the j-th mobile terminal 2. If a video has been received, the process proceeds to S513, and if a video has not been received, the process returns to S512.
[0221] (S513) The video acquisition unit 132 acquires the video received from the j-th mobile terminal 2. The process returns to the upper level process.
[0222] 5, the video acquisition unit 132 may perform the determination in S509 for multiple mobile terminals 2, determine that multiple mobile terminals 2 are within the shooting range, transmit a transmission request to the multiple mobile terminals 2, and acquire videos from each of the multiple mobile terminals 2. Using the multiple videos, the video composition unit 133 may spatially combine the videos to compose one video. Also, the video acquisition unit 132 may select one video from the multiple received videos using an attribute value set paired with each video.
[0223] Next, an example of the attribute value set acquisition process in S407 will be described with reference to the flowchart in FIG.
[0224] (S601) The processing unit 13 acquires one or more pieces of environmental information etc. associated with the video acquired by the video acquisition unit 132. Note that the environmental information etc. may be only environmental information, or may be environmental information and one or more moving object attribute values.
[0225] (S 602 ) The processing unit 13 acquires a right holder identifier associated with the moving image transmitted from the mobile terminal 2 .
[0226] (S603) The processing unit 13 judges whether or not to perform annotation processing on the video. If annotation processing is to be performed, the process proceeds to S604, and if not, the process proceeds to S611. It is assumed that whether or not annotation processing is to be performed is determined in advance. In addition, it is preferable to perform annotation on the video on either the information processing device 1 or the terminal.
[0227] (S604) The processing unit 13 assigns 1 to a counter i.
[0228] (S605) The processing unit 13 judges whether or not the i-th annotation unit exists in the video. If the i-th annotation unit exists, the process proceeds to S606, and if not, the process proceeds to S611. Note that the annotation unit is the target for which annotation is to be acquired, and is, for example, one frame, a certain number of frames, or a video of a certain time (for example, 5 seconds, 10 seconds).
[0229] (S606) The processing unit 13 judges whether or not to use the moving object attribute value at the time of annotation. If the moving object attribute value is to be used, the process proceeds to S607, and if not, the process proceeds to S608. It is assumed that whether or not to use the moving object attribute value at the time of annotation is determined in advance. Also, the moving object attribute value is usually information transmitted in a pair with the video.
[0230] (S607) The processing unit 13 performs a moving object attribute value tag acquisition process. An example of the moving object attribute value tag acquisition process will be described with reference to the flowchart of FIG.
[0231] (S608) The processing unit 13 judges whether or not to use a moving image when performing annotation. If a moving image is to be used, the process proceeds to S609, and if not, the process proceeds to S610. It is assumed that it is previously determined whether or not a moving image is to be used when performing annotation.
[0232] (S609) The processing unit 13 performs a video tag acquisition process. An example of the video tag acquisition process will be described with reference to the flowchart of FIG.
[0233] (S610) The processing unit 13 increments the counter i by 1. The process returns to S605.
[0234] (S611) The processing unit 13 constructs an attribute value set having one or more pieces of environmental information, one or more tags, and a rights holder identifier, and then returns to the upper processing.
[0235] In the flowchart of FIG. 6, the moving image may be divided into a plurality of inspection units, and the processes from S601 to S611 may be performed for each inspection unit.
[0236] Next, an example of the moving object attribute value tag acquisition process in S607 will be described with reference to the flowchart in FIG.
[0237] (S701) The processing unit 13 assigns 1 to a counter i.
[0238] (S702) The processing unit 13 judges whether or not the i-th attribute value tag condition exists. If the i-th attribute value tag condition exists, the process proceeds to S703, and if not, the process returns to the upper process.
[0239] (S703) The processing unit 13 acquires the i-th attribute value tag condition.
[0240] (S704) The processing unit 13 acquires one or more moving object attribute values to be used for determining whether the i-th attribute value tag condition is satisfied.
[0241] (S705) The processing unit 13 judges whether or not one or more moving object attribute values acquired in S704 satisfy the i-th attribute value tag condition. If the attribute value tag condition is satisfied, the process proceeds to S706, and if not, the process proceeds to S707.
[0242] (S706) The processing unit 13 acquires a tag that is paired with the i-th attribute value tag condition, and associates the tag with the corresponding moving image. Associating a tag with a moving image usually means associating the tag with a field that constitutes the moving image.
[0243] (S707) The processing unit 13 increments the counter i by 1. The process returns to S702.
[0244] Next, an example of the video tag acquisition process in S609 will be described with reference to the flowchart in FIG.
[0245] (S801) The processing unit 13 assigns 1 to a counter i.
[0246] (S802) The processing unit 13 judges whether or not the i-th movie tag condition exists. If the i-th movie tag condition exists, the process proceeds to S803, and if not, the process returns to the upper process.
[0247] (S803) The processing unit 13 acquires the i-th moving image tag condition.
[0248] (S804) The processing unit 13 acquires one or more moving image attribute values to be used for determining whether the i-th moving image tag condition is satisfied.
[0249] (S805) The processing unit 13 judges whether or not the one or more video attribute values acquired in S804 satisfy the i-th attribute value tag condition. If the attribute value tag condition is satisfied, the process proceeds to S806, and if not, the process proceeds to S807.
[0250] (S806) The processing unit 13 acquires a tag that is paired with the i-th attribute value tag condition, and associates the tag with the corresponding video. Associating a tag with a video usually means associating the tag with one or more frames that are paired with one or more video attribute values used to determine the attribute value tag condition.
[0251] (S807) The processing unit 13 increments the counter i by 1. The process returns to S802.
[0252] Next, an example of the determination process of S410 will be described with reference to the flowchart of FIG.
[0253] (S901) The video acquisition unit 132 acquires location information of the target terminal 4.
[0254] (S902) Video acquisition unit 132 acquires the latest set of attribute values of a target mobile terminal 2. The set of attribute values is, for example, position information, angle of view, and direction information of the mobile terminal 2.
[0255] (S903) The video acquisition unit 132 acquires shooting range information from the latest attribute value set of the mobile terminal 2. The video acquisition unit 132 determines whether or not the position indicated by the position information of the target terminal 4 is included in the range indicated by the shooting range information. If it is included in the range indicated by the shooting range information, proceed to S904; if it is not included, proceed to S905.
[0256] (S904) The video obtaining unit 132 assigns “within the shooting range” to the variable “determination result”, and then returns to the upper level process.
[0257] (S905) The moving image obtaining unit 132 assigns “not within the shooting range” to the variable “determination result”, and then returns to the upper process.
[0258] Next, an example of the security process in S414 will be described with reference to the flowchart in FIG.
[0259] (S1001) Rights holder processing unit 134 stores the transmitted moving image in association with a set of attribute values corresponding to one or more original moving images from which the transmitted moving image is based.
[0260] It is preferable that the right holder processing unit 134 stores a video paired with a right holder identifier that identifies one or more right holders of the video. The right holder identifier here is, for example, one or more right holder identifiers of the video that is the source of the stored video. The right holder identifier here is, for example, a single right holder identifier that identifies the user who made the inquiry.
[0261] Furthermore, the right holder processing unit 134 accumulates the video in, for example, the storage unit 11 or a device other than the information processing device 1. The device other than the information processing device 1 may be a device that constitutes a blockchain.
[0262] (S1002) The fourth maintenance means 1344 performs a fourth maintenance process. An example of the fourth maintenance process will be described with reference to the flowchart in FIG.
[0263] (S1003) The right holder processing unit 134 assigns 1 to a counter i.
[0264] (S1004) Right holder processing unit 134 determines whether or not the i-th moving image that was the source of the stored moving image exists. If the i-th moving image exists, the process proceeds to S1005, and if not, the process returns to the upper process.
[0265] (S1005) Reward means 1345 performs reward processing. An example of the reward processing will be described with reference to the flowchart in Fig. 12. The reward processing here is a processing for paying reward to the right holder of the i-th moving image that is the basis of the accumulated moving image.
[0266] (S1006) Rights holder processing unit 134 determines whether or not to change the rights holder of the i-th moving image that is the source of the stored moving image. If the rights holder is to be changed, the process proceeds to S1007. If the rights holder is not to be changed, the process proceeds to S1008.
[0267] In addition, whether or not to change the rights holder may be based on a flag corresponding to the i-th video, or may be decided in advance, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder."
[0268] (S1007) The right holder processing unit 134 acquires the user identifier of the user terminal 3. This user identifier becomes a new right holder identifier.
[0269] (S1008) The rights holder processing unit 134 determines whether or not to store the i-th video that was the source of the stored video. If it is to be stored, the process proceeds to S1009, and if it is not to be stored, the process proceeds to S1011. Note that whether or not to store the original video is determined in advance, for example. Also, whether or not to store the original video is determined by the rights holder processing unit 134, for example, based on the attribute value set. The rights holder processing unit 134 determines, for example, that a video that is paired with an attribute value set that includes a specific tag (for example, "accident") is to be stored.
[0270] (S1009) The first maintenance unit 1341 stores the i-th moving image that is the source of the stored moving images.
[0271] (S1010) The fourth maintenance means 1344 performs a fourth maintenance process on the i-th moving image that is the source of the stored moving image. An example of the fourth maintenance process has been described with reference to the flowchart in FIG.
[0272] (S1011) The right holder processing unit 134 increments the counter i by 1. The process returns to S1004.
[0273] In the flowchart of Figure 10, when a combined video is constructed, a process (S1009) of storing the multiple videos that are the basis of the combined video and a fourth preservation process (S1010) are performed, but such processes do not have to be performed.
[0274] Next, an example of the fourth maintenance process of S1010 will be described with reference to the flowchart of FIG.
[0275] (S1101) The fourth security means 1344 acquires access information that identifies a storage destination of a video.
[0276] (S1102) The fourth maintenance means 1344 acquires an attribute value set corresponding to the accumulated moving image. If the accumulated moving image is a moving image composed of multiple original moving images, the attribute value set corresponding to the moving image is the attribute value set of each of the multiple original moving images.
[0277] (S1103) The fourth security means 1344 configures security information having the access information acquired in S1101, the attribute value set acquired in S1102, and the right holder identifier of the video. Note that, if a new right holder identifier has been acquired, the fourth security means 1344 configures security information including, for example, the new right holder identifier and the original right holder identifier. (S1104) The fourth maintenance means 1344 accumulates the maintenance information configured in S1103. Then, the process returns to the upper level process. The fourth maintenance means 1344 accumulates the maintenance information in, for example, a block chain.
[0278] Next, an example of the reward process in S1005 etc. will be described with reference to the flowchart in FIG.
[0279] (S1201) Reward means 1345 acquires one or more right holder identifiers of a target video. Reward means 1345 may acquire right holder identifiers of previous right holders of the target video.
[0280] (S1202) The reward means 1345 acquires a set of attribute values of the target video.
[0281] (S1203) The reward means 1345 acquires a service identifier that identifies a service provided to the target video. The service identifier is, for example, "use," "view," or "purchase." Note that "use" refers to use in composing one video.
[0282] (S1204) The reward means 1345 acquires a reward amount using one or more pieces of information among the attribute value set acquired in S1202 and the service identifier acquired in S1203.
[0283] If multiple right holder identifiers are obtained, the remuneration means 1345 obtains a remuneration amount for each right holder identifier. If the right holder history information including multiple right holder identifiers is obtained, the remuneration means 1345 may obtain a remuneration amount for each right holder identifier.
[0284] In addition, it is preferable that the remuneration means 1345, for example, acquires a moving image attribute value corresponding to each of the multiple moving images that are the source of the moving image transmitted by the moving image transmission unit 141, and determines the amount of remuneration for each of the multiple right holders using the moving image attribute value. It is preferable that the remuneration means 1345, for example, determines a larger amount of remuneration as the data amount, the time of the moving image, or the number of frames of the original moving image adopted in the moving image transmitted by the moving image transmission unit 141 increases. It is preferable that the remuneration means 1345, for example, determines a larger amount of remuneration as the resolution of the original moving image adopted in the moving image transmitted by the moving image transmission unit 141 increases.
[0285] (S1205) The reward means 1345 performs a process of giving a reward of the reward amount acquired in S1204 to the right holder identified by the right holder identifier acquired in S1201.
[0286] (S1206) Reward means 1345 performs a process of charging the user who has enjoyed the service related to the target video with a reward. The process returns to the upper level process. Note that the target video is usually a video transmitted to user terminal 3.
[0287] In the flowchart of FIG. 12, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.
[0288] Next, a second example of the moving image acquisition process of S406 will be described with reference to the flowchart of Fig. 13. In the flowchart of Fig. 13, the description of the same steps as in the flowchart of Fig. 5 will be omitted.
[0289] (S1301) The video acquisition unit 132 acquires the latest location information of a received target. The video acquisition unit 132 composes a query including the location information.
[0290] (S1302) The moving image obtaining unit 132 assigns 1 to a counter j.
[0291] (S1303) The video acquisition unit 132 determines whether or not there is a j-th mobile terminal 2 corresponding to the movement information indicating that the j-th mobile terminal 2 has started moving. If there is a j-th mobile terminal 2, the process proceeds to S1304, and if there is not, the process returns to S401.
[0292] (S1304) The video obtainer 132 transmits a query to the j-th mobile terminal 2.
[0293] (S1305) The video obtainer 132 determines whether or not information has been received from the j-th mobile terminal 2. If information has been received, the process proceeds to S1306, and if information has not been received, the process returns to S1305.
[0294] (S1306) The video acquisition unit 132 judges whether or not a video is included in the information received in S1305. If a video is included, the process proceeds to S1307, and if a video is not included, the process proceeds to S1308. Note that if a video is not included, for example, information (such as an error message) is received indicating that the position indicated by the position information of the target terminal 4 has not been photographed.
[0295] (S1307) The moving image obtaining unit 132 obtains the moving image received in S1305, and then returns to the upper level process.
[0296] (S1308) The moving image obtaining unit 132 increments the counter j by 1. The process returns to S1303.
[0297] 13, moving images may be received from a plurality of mobile terminals 2. In such a case, it is preferable that moving image acquisition unit 132 selects one moving image by using one or more moving image attribute values included in the attribute value set of mobile terminal 2. In addition, in such a case, moving image composition unit 133 may spatially fuse parts of the plurality of moving images acquired by moving image acquisition unit 132 to compose one moving image.
[0298] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.
[0299] (S1401) The movement processing unit 23 judges whether or not the start of movement has been detected. If the start of movement has been detected, the process proceeds to S1402, and if not, the process proceeds to S1417. The start of movement is, for example, when the engine of the moving object on which the mobile terminal 2 is installed is turned on, or when the power of the mobile terminal 2 is turned on.
[0300] (S1402) The movement information acquisition unit 233 acquires movement information. The movement information acquisition unit 233 acquires a terminal identifier from the movement storage unit 21. The movement information transmission unit 241 transmits the movement information to the information processing device 1 in a pair with the terminal identifier. Note that the movement information is stored in the movement storage unit 21, for example.
[0301] (S1403) The photographing unit 231 starts photographing.
[0302] (S1404) The imaging unit 231 acquires a moving image and stores it in the moving storage unit 21.
[0303] (S1405) The movement processing unit 23 acquires a set of attribute values of the mobile terminal 2. An example of such a process of acquiring a set of terminal attribute values will be described with reference to the flowchart of FIG.
[0304] (S1406) The movement processing unit 23 judges whether or not the end of the movement has been detected. If the end of the movement has been detected, the process proceeds to S1407, and if not, the process returns to S1404.
[0305] For example, the movement processing unit 23 detects the end of movement by detecting that the engine is turned off, that the power supply of the mobile terminal 2 is turned off, or that the mobile terminal 2 has arrived at the destination.
[0306] (S1407) The movement information acquisition unit 233 acquires end information. The movement information acquisition unit 233 acquires a terminal identifier from the movement storage unit 21. The movement information acquisition unit 233 transmits the end information to the information processing device 1 in association with the terminal identifier.
[0307] (S1408) The mobile receiving unit 22 determines whether or not an inquiry has been received from the information processing device 1. If an inquiry has been received, the process proceeds to S1409, and if not, the process proceeds to S1414.
[0308] (S1409) The movement processing unit 23 performs a terminal video acquisition process corresponding to the inquiry received in S1408. An example of the terminal video acquisition process will be described with reference to the flowchart in Fig. 16. The terminal video acquisition process is a process for acquiring a video that matches the inquiry.
[0309] (S1410) Movement processing unit 23 determines whether or not a video was acquired in S1409. If a video was acquired, the process proceeds to S1411, and if not, the process proceeds to S1413.
[0310] (S1411) The movement processing unit 23 acquires a set of attribute values of the mobile terminal 2. An example of such terminal attribute value set acquisition processing will be described with reference to the flowchart of FIG.
[0311] (S1412) The moving moving image transmission unit 242 transmits the moving image and the like to the information processing device 1. Return to S1401. Note that the moving image and the like is, for example, a moving image, an attribute value set, and a rights holder identifier.
[0312] (S1413) The moving video transmission unit 242 transmits error information associated with the right holder identifier. The error information is information indicating that the video could not be acquired.
[0313] (S1414) Mobile receiving unit 22 determines whether or not a transmission request has been received from information processing device 1. If a transmission request has been received, the process proceeds to S1415, and if not, the process returns to S1401.
[0314] (S1415) The movement processing unit 23 acquires the moving image being shot by the shooting unit 231. Note that the moving image includes the latest frame, but it is preferable that the moving image also includes frames that were shot in the past and stored in the moving storage unit 21. In addition, the length of the moving image does not matter.
[0315] (S1416) The movement processing unit 23 acquires a set of attribute values of the mobile terminal 2. An example of such a process of acquiring a set of terminal attribute values will be described with reference to the flowchart of FIG.
[0316] (S1417) The moving moving image transmission unit 242 transmits the moving image etc. acquired in S1415 to the information processing device 1. Return to S1401. Note that the moving image etc. is, for example, a moving image, an attribute value set, and a rights holder identifier.
[0317] (S1418) Movement processing unit 23 determines whether or not to end the transmission of the moving image. If the transmission of the moving image is to be ended, the process returns to S1401. If the transmission of the moving image is not to be ended, the process returns to S1415.
[0318] In the flowchart of Figure 14, it is preferable that the mobile processing unit 23 of the mobile terminal 2 continuously acquires location information as time passes, and that the mobile transmission unit 24 continuously transmits the acquired location information to the information processing device 1 in pairs with the right holder identifier.
[0319] In the flowchart of FIG. 14, the mobile terminal 2 may transmit video or the like to the information processing device 1 at all times.
[0320] Furthermore, in the flowchart of FIG. 14, the process ends when the power is turned off or an interrupt for ending the process occurs.
[0321] Next, an example of the terminal attribute value set acquisition process in S1405 and S1416 will be described with reference to the flowchart in FIG.
[0322] (S1501) The movement processing unit 23 acquires one or more moving image attribute values, and associates the one or more moving image attribute values with the acquired moving images.
[0323] The movement processing unit 23 acquires, for example, position information, time information, weather information, temperature information, and season information. In addition, the movement processing unit 23 acquires, for example, one or more moving object attribute values (for example, CAN data).
[0324] (S1502) The tag acquisition unit 232 judges whether or not to acquire a moving object attribute value tag. If a moving object attribute value tag is to be acquired, the process proceeds to S1503, and if not, the process proceeds to S1505. Note that whether or not to acquire a moving object attribute value tag is determined in advance.
[0325] (S1503) The tag acquiring unit 232 performs a moving object attribute value tag acquiring process. An example of the moving object attribute value tag acquiring process is the same as the process in the flowchart of Fig. 7. Note that there may be cases where a tag cannot be acquired here.
[0326] (S1504) If one or more tags are acquired in S1503, the tag acquiring unit 232 associates the one or more tags with the acquired moving image.
[0327] It is preferable that the tag acquiring unit 232 associates one or more tags with the video and stores them in the mobile storage unit 21. This allows the user of the mobile terminal 2 to search for videos, for example, using the tags as a key.
[0328] (S1505) Tag acquiring unit 232 judges whether or not to acquire a moving image tag. If a moving image tag is to be acquired, the process proceeds to S1506, and if not, the process proceeds to S1508. Note that whether or not to acquire a moving image tag is determined in advance.
[0329] (S1506) The tag obtaining unit 232 performs a video tag obtaining process. An example of the video tag obtaining process is the same as the process in the flowchart of Fig. 8. Note that there may be cases where a tag cannot be obtained here.
[0330] (S1507) If one or more tags are acquired in S1506, the tag acquiring unit 232 associates the one or more tags with the acquired moving image.
[0331] It is preferable that the tag acquiring unit 232 associates one or more tags with the video and stores them in the mobile storage unit 21. This allows the user of the mobile terminal 2 to search for videos, for example, using the tags as a key.
[0332] (S1508) The movement processing unit 23 acquires the right holder identifier from the movement storage unit 21, and associates it with the video. Then, the process returns to the upper level process.
[0333] An example of the terminal video acquisition process in S1409 will be described with reference to the flowchart in FIG.
[0334] (S1501) The movement processing unit 23 acquires location information of the target terminal 4.
[0335] (S1502) Movement processing unit 23 acquires a set of attribute values of mobile terminal 2. The set of attribute values is, for example, position information, angle of view, and direction information of mobile terminal 2.
[0336] (S1503) The movement processing unit 23 acquires shooting range information by using the attribute value set acquired in S1502.
[0337] (S1504) The movement processing unit 23 judges whether or not the position indicated by the position information of the target terminal 4 is included in the shooting range indicated by the shooting range information. If it is included in the shooting range, the process proceeds to S1505, and if it is not included, the process proceeds to S1506.
[0338] (S1505) Movement processing unit 23 acquires the video captured by imaging unit 231. The process returns to the upper level process.
[0339] (S1506) The movement processing unit 23 acquires error information. The process returns to the upper level process. The error information is information indicating that a video is not acquired, and information indicating that the position of the target terminal 4 is not included in the shooting range.
[0340] Next, an example of the operation of the user terminal 3 will be described. The user receiving unit 35 of the user terminal 3 receives a video in which a target (for example, a child to be watched over) appears from the information processing device 1. The user output unit 36 outputs the video. This process is usually repeated.
[0341] Next, an example of the operation of the target terminal 4 will be described. The target terminal 4 acquires location information. Next, the target terminal 4 transmits the location information to the information processing device 1 or the user terminal 3 registered in the target terminal 4. The target terminal 4 acquires and transmits the location information, for example, by receiving an instruction from the holder of the target terminal 4 (for example, a child to be watched over). The target terminal 4 has, for example, a GPS receiver and acquires the location information by the GPS receiver, but the method of acquiring the location information is not important. The user terminal 3 registered in the target terminal 4 is, for example, the guardian of the holder of the target terminal 4. The process of the target terminal 4 acquiring and transmitting the location information is usually repeated. <Specific operation example>
[0342] A specific example of the operation of the information system A in this embodiment will be described below.
[0343] 17 is stored in the terminal management unit 111 of the information processing device 1. The terminal management table is a table for managing terminal information of one or more mobile terminals 2. The terminal management table is a table for managing mobile terminals 2 that transmit moving images. Note that a fixed terminal not managed in the terminal management table may transmit moving images to the information processing device 1.
[0344] The terminal management table manages one or more records having an "ID," "terminal identifier," "video attribute value," and "movement information." The "video attribute value" has "environmental information." The "environmental information" has "location information," "direction information," "camera information," "time information," "weather information," and "temperature information." The "camera information" has "angle of view" and "resolution." "Environmental information" is information about the environment around the mobile terminal 2 when the video was captured, etc.
[0345] "ID" is information that identifies the record. "Terminal identifier" is an identifier of mobile terminal 2, and is the same as the rights holder identifier that identifies the rights holder of the video at the time the video is transmitted. "Location information" is (latitude, longitude) here. "Direction information" is the shooting direction of the camera, and in this case, is the angle in a clockwise direction from true north. In other words, if the shooting direction of the camera is due east, the direction information is "90 degrees". "Angle of view" is the angle of view of the camera. "Resolution" is the resolution of the camera. "Time information" is in this case, the year, month, day, hour, minute, and second. "Movement information = 1" indicates that the mobile terminal 2 is currently in a state where it can transmit video. "Movement information = 0" indicates that the mobile terminal 2 is currently in a state where it cannot transmit video due to the power being turned off, etc. "Movement information = 0" may be considered to be end information.
[0346] At the start of the movement, the mobile terminal 2 transmits the movement information "1" to the information processing device 1 in association with the terminal identifier. Then, the information processing device 1 receives the movement information "1" and stores it in the terminal management table in association with the terminal identifier. Also, it is assumed that the mobile terminal 2, which is moving, continuously transmits an attribute value set having position information and direction information to the information processing device 1 in a pair with the terminal identifier. Then, the information processing device 1 receives the attribute value set having the terminal identifier, position information, and direction information, acquires time information from a clock (not shown), and stores the video viewing attribute value having the position information, direction information, and time information in the terminal management table in association with the terminal identifier. Also, the camera information is stored in advance in the terminal management table in association with the terminal identifier. Also, at the end of the movement, the mobile terminal 2 transmits the end information "0" to the information processing device 1 in association with the terminal identifier. Then, the information processing device 1 receives the end information "0", and stores the end information "0" in the terminal management table in association with the terminal identifier as the attribute value of the attribute "movement information". Through the above processing, the terminal management table in FIG. 17 is constructed.
[0347] Furthermore, a registered video management table having the structure shown in FIG. 18 is stored on the blockchain. The registered video management table is a table for managing registered videos. The registered video management table is a table for managing preservation information. Registered videos are, for example, videos provided to users and videos that satisfy preservation conditions. In other words, here, videos sent to the user terminal 3 and videos that satisfy the preservation conditions are automatically stored.
[0348] The registered video management table manages one or more records having an "ID," "video identifier," "access information," "rights holder identifier," "rights registration date," "video information," and "provision flag." "Video information" is information about the captured video, and in this case has a "frame identifier" and a "video attribute value." The "video attribute value" has "environmental information" and "tag." "Environmental information" has "location information," "direction information," "camera information," and "time information." "Camera information" has "angle of view" and "resolution." "Environmental information" is information about the environment around the mobile terminal 2 when the video was captured, etc. "Tags" in this case have "accident," "traffic jam," and "dangerous driving." "Tags" are information associated with a video, for example, by the above-mentioned processing.
[0349] The registered videos are stored in the information processing device 1, other devices, or the blockchain. Each record in the registered video management table is preservation information here. The "provision flag" of "1" indicates that viewing of the video is permitted. The "provision flag" of "2" indicates that sale of the video (transfer of rights holder) is permitted. <Example>
[0350] In this situation, the following specific example will be described. The specific example is a case where, in order to watch over a target person (e.g., a child or a wandering elderly person), moving videos taken by mobile terminals 2 installed in a plurality of moving objects are combined to produce a combined video, which is then transmitted to user terminal 3 of a user (e.g., a guardian) related to the target person.
[0351] The storage unit 11 of the information processing device 1 stores correspondence information having a user identifier (e.g., the IP address of the user terminal 3) for sending a video to a user terminal 3 of a guardian P, and a target identifier "T001" that identifies a target terminal 4 of a child A of the guardian P.
[0352] Next, assume that child A turns on the target terminal 4 to return home from school. Next, the target terminal 4 periodically acquires location information and sends a query including the location information and the target identifier "T001" (for example, "Video transmission request, target identifier=T001, location information (x t1 ,y t1 ) to the information processing device 1. It is assumed that the target terminal 4 stores a target identifier "T001" and communication destination information (e.g., an IP address) of the information processing device 1 for transmitting information to the information processing device 1.
[0353] In addition, the receiving unit 12 of the information processing device 1 periodically receives location information and direction information that identify the location of the mobile terminal 2, paired with the terminal identifier, from each of the multiple mobile terminals 2, and stores the information in a terminal management table (Figure 17), paired with the terminal identifier.
[0354] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry “video transmission request, target identifier=T001, location information (x t1 ,y t1 )" from the target terminal 4 and stores the location information (x t1 ,y t1 ) and the target identifier “T001.” It is assumed that the location information of the target terminal 4 is received periodically, and the latest location information is stored in a buffer (not shown).
[0355] Next, the video acquisition unit 132, by the operation described in the flowchart of FIG. 5, refers to the terminal management table (FIG. 17) and determines the mobile terminal 2 corresponding to the position information, angle of view, and direction information that satisfy the position conditions for the position indicated by the latest position information of the target terminal 4, as follows:
[0356] That is, the video acquisition unit 132 checks the terminal management table (FIG. 17) to see whether the latest location information of the target terminal 4 has location information, direction information, and angle of view that satisfy the location condition (the location indicated by the latest location information of the target terminal 4 has been photographed), and the latest location information, direction information, and angle of view. Then, it is assumed that the video acquisition unit 132 has determined that the terminal management table (FIG. 17) has location information, etc. that satisfies the location condition. Then, it is assumed that the video acquisition unit 132 has determined the first terminal (here, the mobile terminal 2 mounted on the car). Next, the video acquisition unit 132 transmits a transmission request to the first terminal.
[0357] Next, the mobile terminal 2, which is the first terminal that has received the transmission request, transmits the captured video to the information processing device 1 together with the first rights holder identifier and the first set of attribute values.
[0358] Next, the receiving unit 12 of the information processing device 1 receives the first right holder identifier, the first attribute value set, and the video. The video includes child A. It is preferable that the received video is a video that the mobile terminal 2 has transmitted immediately after shooting the video.
[0359] Next, the video sending unit 141 sends the video received by the video acquiring unit 132 to the user terminal 3 of the guardian P who is identified by the user identifier paired with the object identifier "T001".
[0360] Then, the video acquisition unit 132 temporarily stores the video received from the first terminal in a buffer (not shown) in a pair with the first rights holder identifier and the location information of the first terminal.
[0361] Note that while the location information of the target terminal 4 of child A and the location information of the first terminal etc. satisfy the location condition, the video acquisition unit 132 receives at least the video received from the first terminal, and the video transmission unit 141 transmits the video to the user terminal 3 of the guardian P. During this period, one or two pieces of location information of the target terminal 4 and the first terminal are updated.
[0362] Next, it is assumed that the video acquisition unit 132 determines that the latest location information of the target terminal 4 of child A and the latest location information of the first terminal, etc., no longer satisfy the location condition (child A is no longer captured). This is because the mobile terminal 2 has moved and is no longer in a position to capture child A, who is walking home.
[0363] Next, the video acquisition unit 132 again attempts to determine the latest location information of the second terminal that satisfies the location condition for the latest location information of the target terminal 4 by referring to the terminal management table (FIG. 17). Here, the video acquisition unit 132 determines that the area captured based on the location information (FX1, FY1), direction information "Fd1", and angle of view "FD1" in the terminal management table (FIG. 17) satisfies the location condition for the latest location information of the target terminal 4.
[0364] Next, the video acquisition unit 132 transmits a transmission request to the mobile terminal 2 identified by the terminal identifier "U101" and receives the video etc. from the mobile terminal 2. Next, the video acquisition unit 132 temporarily stores the video etc. in a buffer (not shown) in a pair with the second rights holder identifier "U101" of the second mobile terminal 2 and location information.
[0365] Next, the video sending unit 141 sends the video received by the video acquiring unit 132 from the second mobile terminal 2 to the user terminal 3 of the guardian P.
[0366] Then, after the passage of time (for example, 10 seconds), the video acquisition unit 132 determines that the location information of Child A's target terminal 4 and the location information, directional information, and angle of view of the second mobile terminal 2 no longer satisfy the location conditions (Child A is no longer in the image).
[0367] Next, the video acquisition unit 132 again attempts to determine the location information of a third mobile terminal 2 whose latest location information satisfies the location condition for the latest location information of the target terminal 4 by referring to the terminal management table (Figure 17), but it is determined that there is no location information of a third mobile terminal 2 that satisfies the location condition.
[0368] Next, the video sending unit 141 sends information to the user terminal 3 of the guardian P that the video in which the child A appears cannot be sent, or stops sending the video to the user terminal 3.
[0369] Through the above video transmission, the user terminal 3 sequentially receives and outputs the videos acquired by each of the multiple mobile terminals 2. This allows the guardian P to see how the child A returns home.
[0370] Then, as time passes, a third terminal, a mobile terminal 2, comes into view approaching child A, and the video acquisition unit 132 is able to determine the latest location information of the third terminal that satisfies the location condition for the latest location information of the target terminal 4 by referring to the terminal management table (Figure 17).
[0371] Next, the video acquisition unit 132 acquires the video etc. from the third mobile terminal 2. Next, the video acquisition unit 132 temporarily stores the video in a buffer (not shown) in a pair with the third rights holder identifier and the attribute value set of the third mobile terminal 2.
[0372] Next, the video sending unit 141 sends the video received by the video acquiring unit 132 from the third mobile terminal 2 to the user terminal 3 of the guardian P identified by the user identifier paired with the object identifier "T001".
[0373] Next, the user terminal 3 receives and outputs the video acquired by the third mobile terminal 2. As a result, the guardian P was unable to see how Child A returned home for a short time, but now that the video is output, he or she can see how Child A returned home again.
[0374] The above process continues until the target terminal 4 of child A is powered off (until child A returns home), and parent B can monitor child A's return home from school.
[0375] In addition, the remuneration means 1345 performs the above-mentioned remuneration process for the right holders identified by the right holder identifiers of the first mobile terminal 2, the second mobile terminal 2, and the third mobile terminal 2 who have provided the video to the guardian B.
[0376] Furthermore, the moving image constructing unit 133 constructs one moving image by combining the moving images transmitted from each of the multiple mobile terminals 2 in the order in which they were transmitted. This one moving image may be called a combined moving image.
[0377] Moreover, the right holder processing unit 134 stores the combined moving image in a pair with a right holder identifier, which is the identifier of the guardian P.
[0378] Moreover, the right holder processing unit 134 stores the combined moving image in association with a set of attribute values corresponding to one or more original moving images from which the combined moving image is created.
[0379] Next, the fourth maintenance means 1344 acquires access information that specifies the storage destination of the combined video. The fourth maintenance means 1344 also acquires a set of attribute values corresponding to the accumulated combined video. Next, the fourth maintenance means 1344 constructs maintenance information having the acquired access information, the acquired set of attribute values, and the rights holder identifier of the video. Next, the fourth maintenance means 1344 accumulates the constructed maintenance information in the blockchain. An example of such maintenance information is the record "ID=2" in FIG. 18.
[0380] As described above, according to this specific example, the combined video can be used to monitor the subject who has the target terminal 4. In addition, a reward can be given to the right holder who provided the video that is the source of the combined video for monitoring. In addition, the combined video can be appropriately managed.
[0381] In addition to the above specific examples, for example, a target terminal may be mounted on a moving vehicle, and a video of the vehicle's movement status may be acquired from another mobile terminal 2 to generate a combined video and provide it to a user. Also, for example, a runner participating in a race may race while holding a user terminal 3, and a video of the runner may be acquired from another mobile terminal 2 to generate a combined video. Examples of races that may be envisioned include marathons, races using motorcycles, bicycles, cars, motorboats, etc.
[0382] As described above, according to this embodiment, a useful video can be provided by using a video captured by a mobile terminal of a moving target.
[0383] Furthermore, according to this embodiment, a single useful video can be provided by using videos from a plurality of mobile terminals that capture a moving target.
[0384] Furthermore, according to this embodiment, a moving object can be clearly shown in a video.
[0385] Furthermore, according to this embodiment, appropriate processing relating to the rights holder of the video can be carried out.
[0386] Furthermore, according to this embodiment, a reward can be given to the rights holder of the video captured by the mobile terminal.
[0387] Furthermore, according to this embodiment, it is possible to provide appropriate compensation to the rights holder of the video captured by the mobile terminal.
[0388] Furthermore, according to this embodiment, one video can be preserved.
[0389] Furthermore, according to this embodiment, the rights holder of a video can be determined to be an appropriate rights holder.
[0390] Furthermore, according to this embodiment, a rights holder of one video can become a rights holder who needs that video.
[0391] The processing in this embodiment may be realized by software. This software may be distributed by software download or the like. This software may be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software for realizing the information processing device 1 in this embodiment is a program as follows. That is, this program is a program for making a computer function as a location receiving unit that sequentially receives a plurality of pieces of location information at different times of a target terminal in motion, a video acquiring unit that acquires a video from a mobile terminal that has captured an area corresponding to each of the plurality of pieces of location information received by the location receiving unit, and a video transmitting unit that transmits a video based on the video acquired by the video acquiring unit.
[0392] Fig. 19 shows the appearance of a computer that executes the program described in this specification to realize the information processing device 1 and the like of the various embodiments described above. The above-mentioned embodiments can be realized by computer hardware and a computer program executed thereon. Fig. 19 is an overview of this computer system 300, and Fig. 20 is a block diagram of the system 300.
[0393] In FIG. 19, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.
[0394] 20, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.
[0395] A program for causing computer system 300 to execute the functions of information processing device 1 and the like of the above-mentioned embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and further transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 at the time of execution. The program may be loaded directly from CD-ROM 3101 or the network.
[0396] The program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the information processing device of the above-mentioned embodiment. The program only needs to include an instruction portion that calls appropriate functions (modules) in a controlled manner to obtain a desired result. How the computer system 300 operates is well known, and a detailed description will be omitted.
[0397] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmitting step (processing that is performed only by hardware).
[0398] The program may be executed by a single computer or a plurality of computers. That is, the program may be executed by a centralized processing or a distributed processing.
[0399] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be realized physically by one medium.
[0400] In each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.
[0401] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]
[0402] As described above, the information processing device 1 according to the present invention has an effect of being able to obtain moving images by continuously shooting a moving subject, and is useful as a moving image processing server or the like.
Claims
1. A storage unit that stores a target terminal identifier that identifies a target terminal and a user terminal identifier that identifies a user terminal in association with each other; a receiving unit that sequentially receives target terminal location information indicating a plurality of locations of the target terminal at different times while the target terminal is moving, together with the target terminal identifier; an acquisition unit that acquires, from a mobile terminal that has captured an image of an area corresponding to each of the target terminal position information received by the receiving unit, a plurality of area images that are images captured within the area; the area image is an image in which an attribute value set including two or more pieces of environmental information including location information for identifying a shooting location and time information for identifying a shooting time is associated with a right holder identifier for identifying a right holder of the area image, A configuration unit that temporally combines the acquired multiple area images based on the target terminal location information, or spatially fuses parts of the multiple area images to form a single provided image; a transmission unit that transmits the provided image to the user terminal identified by the user terminal identifier that is stored in the storage unit in association with the target terminal identifier; a right holder processing unit that performs a second security process of storing the right holder identifiers corresponding to the plurality of area images that constitute the provided image in association with the provided image; An information processing device comprising:
2. The right holder processing unit further comprises: The information processing apparatus according to claim 1 , further comprising a third security process for storing the right holder identifier, which identifies the user terminal to which the provided image is to be transmitted, in association with the provided image.
3. An information processing method for use in an information processing device having a storage unit, a receiving unit, an acquiring unit, a configuration unit, a transmitting unit, and a rights holder processing unit, The storage unit stores a target terminal identifier that identifies a target terminal and a user terminal identifier that identifies a user terminal in association with each other; The receiving unit sequentially receives target terminal location information indicating a plurality of locations of the target terminal at different times while the target terminal is moving, together with the target terminal identifier; The acquisition unit acquires, from a mobile terminal that has captured an image of an area corresponding to each of the target terminal position information received by the receiving unit, a plurality of area images that are images captured within the area; the area image is an image in which an attribute value set including two or more pieces of environmental information including location information for identifying a shooting location and time information for identifying a shooting time is associated with a right holder identifier for identifying a right holder of the area image, The composition unit temporally combines the acquired multiple area images based on the target terminal location information, or spatially fuses a portion of the multiple area images to compose one provided image; a step of transmitting the provided image to the user terminal indicated by the user terminal identifier stored in the storage unit in association with the target terminal identifier; The information processing method includes a step of performing a second security process in which the rights holder processing unit stores the rights holder identifiers corresponding to each of the multiple area images that constitute the provided image in association with the provided image.
Citation Information
Patent Citations
Water-base ink composition
JP1989048872A
Monitoring method, monitor, record medium recording monitor program, and monitor information providing method
JP2002042273A
Method and system for monitoring moving body
JP2003044956A
Position search / image pickup system
JP2003067895A
Image collection system, image pickup device and image storage device
JP2013156784A