Mobile terminal, information processing device, and information processing method

Abstract

[Problem] Conventionally, it has been unable to efficiently select and use a still image that satisfies a condition from a video imaged by a mobile terminal. [Solution] The present invention comprises: a position acquisition unit 231 that acquires position information; an imaging unit 232 that acquires, while moving, a video which includes a still image and which is associated with the position information; a determination unit 233 that determines whether or not the still image included in the video acquired by the imaging unit 232 satisfies a selection condition; and an image transmission unit 241 that transmits the still image determined to satisfy the selection condition by the determination unit 233, in association with the position information acquired by the position acquisition unit 231. The determination unit 233 acquires one or more attribute values corresponding to the still image, and determines whether or not the one or ore attribute values satisfy an inspection condition. A mobile terminal 2, which determines whether or not the still image determined to satisfy the inspection condition satisfies the selection condition, efficiently selects and uses the still image that satisfies the conditions from the video imaged by the mobile terminal.

Description

Mobile terminal, information processing device, and information processing method

[0001] The present invention relates to a mobile terminal or the like that processes video captured while moving.

[0002] Previously, there was a technology that used a map game application that showed the locations of manholes, asking participants to record and collect photos of manholes and information such as their state of deterioration, and awarding points based on the number of photos taken (see, for example, non-patent document 1).

[0003] Patent document 1 discloses an information processing device that mounts an imaging device on a mobile body moving on a road, captures an image of an area including the surface of the road, analyzes the captured image, determines defects in the road in the image, and identifies and outputs images that include defects.

[0004] JP 2016-150719 A

[0005] "Turning citizens into allies with a game app: A new manhole management service is interesting," [online], [searched November 18, 2022], Internet [URL: https: / / newswitch.jp / p / 28392]

[0006] In conventional technology, defects in roads and the like were judged for all still images included in the captured video, making it impossible to make efficient judgments.

[0007] However, there are various issues when identifying similar defects and collecting only images containing defects from drive recorders installed in ordinary vehicles. For example, there is the issue of copyright management for the collected images. Those who provide the images would like to receive some kind of compensation for providing them. Also, those who use the images have the problem of not being able to use them freely if the images still have the rights of others remaining.

[0008] Therefore, an object of the present invention is to provide a video utilization system that allows both image providers and users to provide and use images without any problems.

[0009] The mobile terminal of the first invention is a mobile terminal that includes a location acquisition unit that acquires location information, a shooting unit that acquires video including still images while moving and that corresponds to the location information, a judgment unit that determines whether the still images included in the video acquired by the shooting unit satisfy the selection conditions, and an image transmission unit that transmits the still images that the judgment unit determines satisfy the selection conditions in association with the location information acquired by the location acquisition unit.

[0010] With this configuration, still images that meet certain conditions can be selected from videos captured by the mobile terminal and used.

[0011] In addition, the mobile terminal of the second invention is a mobile terminal in which, compared to the first invention, the judgment unit acquires one or more attribute values ​​corresponding to a still image, judges whether or not the one or more attribute values ​​match the inspection conditions, and is equipped with judgment means for judging whether or not a still image judged to match the inspection conditions satisfies the selection conditions.

[0012] With this configuration, it is determined whether or not a still image that matches the inspection condition satisfies the selection condition, so that necessary still images can be acquired efficiently.

[0013] Furthermore, the mobile terminal of the third invention is a mobile terminal in which, compared to the first or second invention, the judgment unit determines whether a still image satisfies each of a plurality of selection conditions and further includes a tag acquisition unit that acquires a tag corresponding to the selection condition that the judgment unit determines to be satisfied, and the image transmission unit transmits the still image in association with the tag and location information.

[0014] With this configuration, still images that meet a plurality of conditions can be selected from the video captured by the mobile terminal and used.

[0015] Furthermore, the mobile terminal of the fourth invention is a mobile terminal in which, compared to any one of the first to third inventions, the judgment unit also acquires analysis results for still images included in the video, and further includes a tag acquisition unit that acquires tags using the analysis results for still images that the judgment unit determines satisfy the selection conditions, and the image transmission unit transmits the still images in association with the tags and location information.

[0016] With this configuration, it is possible to assign appropriate tags to still images that meet the conditions.

[0017] Furthermore, the mobile terminal of the fifth invention is a mobile terminal according to any one of the first to fourth inventions, in which the camera constituting the photographing unit is installed in a position to photograph the moving surface of the mobile terminal or the vicinity of the moving surface, and the photographing unit photographs the moving surface or the vicinity while moving and acquires video.

[0018] With this configuration, still images that meet certain conditions can be selected and used from videos captured on the surface of the mobile terminal or in the vicinity of the surface of the mobile terminal.

[0019] Furthermore, the mobile terminal of the sixth invention is a mobile terminal in which the selection conditions for any one of the first to fifth inventions are that there is a crack in the road in the still image, that there is damage to the bridge in the still image, that there is damage to the manhole in the road in the still image, or that there is a fallen object on the road in the still image.

[0020] With this configuration, it is possible to select and use a still image that can confirm defects on the surface on which the mobile terminal is moving or in the vicinity of the surface on which the mobile terminal is moving, such as cracks in the road, damage to a bridge, or damage to a manhole.

[0021] In addition, the information processing device of the seventh invention is an information processing device having a receiving unit that receives a still image associated with location information from any one of the first to sixth mobile terminals, and a storage unit that stores the still image received by the receiving unit in pairs with the location information.

[0022] With this configuration, still images that match the conditions and are selected from videos captured by the mobile terminal can be received and stored.

[0023] In addition, the information processing device of the eighth invention is an information processing device that includes a receiving unit that receives a video that is taken by a mobile terminal while it is moving and that has a plurality of still images corresponding to location information, a judgment unit that judges whether the still images included in the video received by the receiving unit satisfy the selection conditions, and a storage unit that stores the still images that the judgment unit judges to satisfy the selection conditions in association with the location information corresponding to the still images.

[0024] With this configuration, still images that meet certain conditions can be selected from videos captured by the mobile terminal and stored.

[0025] Furthermore, the information processing device of the ninth invention is an information processing device in which, compared to the seventh or eighth invention, a tag is associated with the still image, notification destination information that identifies the notification destination of the still image is associated with the tag, and the information processing device further includes a transmitting unit that transmits the still image to the notification destination identified by the notification destination information that is associated with the tag that corresponds to the still image.

[0026] With this configuration, still images can be automatically sent to those who need them.

[0027] In addition, the information processing device of the tenth invention is an information processing device in which, compared to any one of the seventh to ninth inventions, the still image or video received by the receiving unit is associated with a rights holder identifier that identifies the rights holder of the still image or video, and further includes a rights holder processing unit that performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier.

[0028] With this configuration, appropriate processing relating to the rights holder of the still image can be performed.

[0029] In addition, the information processing device of the eleventh invention is an information processing device in which, compared to the tenth invention, the rights holder identifier is a rights holder identifier corresponding to the video that is the source of the still image, and the rights holder processing unit is an information processing device equipped with a reward means that performs reward processing, which is a process of giving a reward to the rights holder identified by the rights holder identifier.

[0030] With this configuration, it is possible to give a reward to the rights holder of the video captured by the mobile terminal.

[0031] In addition, the information processing device of the twelfth invention is an information processing device in which, compared to the tenth invention, the rights holder processing unit is equipped with a first security means that performs a first security processing to store still images in association with a set of attribute values ​​corresponding to the still images.

[0032] With this configuration, it is possible to preserve still images that satisfy the selection conditions.

[0033] In addition, the information processing device of the thirteenth invention is an information processing device in which, compared to the ninth invention, the rights holder processing unit is equipped with a second security means that performs a second security processing in which the still image is stored in association with a rights holder identifier corresponding to the still image.

[0034] With this configuration, the right holder of the still image that satisfies the selection conditions can be determined to be the appropriate right holder.

[0035] In addition, the information processing device of the fourteenth invention is an information processing device that, compared to the ninth invention, further includes a transmitting unit that transmits the still image to a user terminal, and the rights holder processing unit includes a third security means that stores the still image in association with a rights holder identifier corresponding to the user terminal.

[0036] With this configuration, the right holder of a still image that satisfies the selection conditions can be the right holder who needs the still image.

[0037] In addition, the information processing device of the fifteenth invention is an information processing device in which, compared to any one of the twelfth to fourteenth inventions, the rights holder processing unit is equipped with a fourth security means that performs a fourth security process that accumulates security information including access information for accessing still images in a blockchain.

[0038] With this configuration, it is possible to store the security information of still images that require security.

[0039] According to the present invention, still images that meet certain conditions can be efficiently selected and used from videos captured by a mobile terminal.

[0040] FIG. 1 is a block diagram of the information system A according to the first embodiment; FIG. 2 is a flowchart illustrating an example of the operation of the information processing device 1; FIG. 3 is a flowchart illustrating an example of the maintenance processing; FIG. 4 is a flowchart illustrating an example of the fourth maintenance processing; FIG. 5 is a flowchart illustrating an example of the reward processing; FIG. 6 is a flowchart illustrating an example of the operation of the mobile terminal 2;

[0041] Hereinafter, embodiments of a mobile terminal and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.

[0042] (First embodiment) <Outline of first embodiment>

[0043] In this embodiment, a mobile terminal will be described that transmits a still image that constitutes a video captured by the mobile terminal and that satisfies a selection condition, along with location information, etc. The mobile terminal determines whether a still image that satisfies a detection condition satisfies the selection condition, for example. The selection condition may be, for example, a road with cracks, a damaged bridge, a damaged manhole, or an object that has fallen onto the road. The still image may also be referred to as a field or frame.

[0044] In this embodiment, a mobile terminal will be described that determines whether a plurality of selection conditions are satisfied, and if the selection conditions are satisfied, transmits a still image with a tag corresponding to the selection condition.

[0045] In this embodiment, a mobile terminal that acquires a tag corresponding to a still image and transmits the still image with the tag attached will be described.

[0046] Furthermore, in this embodiment, an information processing device that performs right holder processing, which is processing related to the right holder of a still image, will be described. The right holder processing includes, for example, a compensation processing to be described later and various security processing to be described later.

[0047] In the specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>

[0048] 1 is a conceptual diagram of an information system A according to this embodiment. The information system A includes an information processing device 1 and one or more mobile terminals 2.

[0049] The information processing device 1 is a server that accumulates still images and the like transmitted by one or more mobile terminals 2. The information processing device 1 is, for example, a cloud server or an ASP server, but the type does not matter. The information processing device 1 may also be a device that constitutes a blockchain. The information processing device 1 mainly performs image-related processing, so it may also be called an image processing device.

[0050] The mobile terminal 2 is a terminal installed on a moving body and is a terminal that captures video. Examples of the mobile terminal 2 include a drive recorder, a smartphone, a tablet terminal, a camera with communication functions, and a glasses-type camera. Installed typically means fixed, but it may also be considered to include being in contact with or held. The mobile terminal 2 may be, for example, a terminal held by a person. The mobile terminal 2 may also have a driving means such as an engine or a means of transportation such as wheels. The mobile terminal 2 is a terminal that is not fixed to a building, the ground, or the like. The mobile body is a moving object, such as a terrestrial mobile device, a surface mobile device, an underwater mobile device, an aerial mobile device, a space mobile device, or a living organism. Examples of terrestrial mobile devices include vehicles and robots. Examples of aerial mobile devices include ships. Examples of aerial mobile devices include submarines. Examples of aerial mobile devices include aircraft and drones. Examples of space mobile devices include rockets and artificial satellites.

[0051] The information processing device 1 and one or more mobile terminals 2 are generally capable of communicating with each other via a network such as the Internet.

[0052] 2 is a block diagram of an information system A according to the present embodiment. The information processing device 1 constituting the information system A includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a terminal management unit 111 and a remuneration management unit 112. The processing unit 13 includes an accumulation unit 131 and a right holder processing unit 132. The right holder processing unit 132 includes a first security means 1321, a second security means 1322, a third security means 1323, a fourth security means 1324, and a remuneration means 1325.

[0053] The mobile terminal 2 includes a mobile storage unit 21, a mobile receiving unit 22, a mobile processing unit 23, and a mobile transmitting unit 24. The mobile storage unit 21 includes a condition management unit 211. The mobile processing unit 23 includes a position acquisition unit 231, a photographing unit 232, a determination unit 233, and a tag acquisition unit 234. The mobile transmitting unit 24 includes an image transmission unit 241. <Details of components of information processing device 1>

[0054] Various types of information are stored in the storage unit 11. The various types of information include, for example, terminal information, still images and location information, one or more pieces of notification destination information, and one or more sets of tags and notification destination information, which will be described later.

[0055] The notification destination information is information that specifies the destination to which the still image is to be sent. The notification destination information is, for example, an email address, a telephone number, a user identifier of a communication application, or an IP address of the destination terminal.

[0056] A tag is information that identifies the characteristics of a still image. For example, a tag is information resulting from analyzing a still image. For example, a tag is information that indicates the classification of a still image. For example, a tag is information that indicates characteristic elements contained in a still image. For example, tags are "manhole damage," "road crack," "bridge damage," and "fallen object." Tags are also called metadata.

[0057] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information related to the mobile terminal 2. The terminal information includes, for example, a terminal identifier and an attribute value set. The terminal information may be associated with a video captured by the mobile terminal 2. The terminal identifier may also be included in the attribute value set.

[0058] The terminal identifier is information that identifies the mobile terminal 2. The terminal identifier may be a rights holder identifier that identifies the rights holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.

[0059] A rights holder is a person who has some right to a video taken by the mobile terminal 2 or a still image transmitted by the mobile terminal 2. A rights holder is, for example, the owner of the still image, the copyright holder of the still image, the owner of the mobile terminal 2 that took the still image, or a person with the right to dispose of the still image. A rights holder is, for example, the initial rights holder of the still image. The rights holder is usually the owner of the mobile terminal 2, but it may be any person who has the right to a video taken by the mobile terminal 2 or a still image transmitted by the mobile terminal 2.

[0060] The rights holder identifier is an identifier of the rights holder of the selected still image. The rights holder identifier may be a terminal identifier. The rights holder identifier is, for example, the rights holder's ID, name, email address, or telephone number. The rights holder ID is, for example, a user identifier.

[0061] An attribute value set is a set of one or more attribute values. The attribute values ​​are attribute values ​​of still images. The attribute values ​​may also be attribute values ​​of moving images that include still images. The attribute values ​​may be, for example, environmental information, tags, or scores.

[0062] Environmental information is information about the environment in which a video was shot. Examples of environmental information include location information, road type identifier, point information, direction information, camera information, time information, weather information, temperature information, and season information. Location information is information that identifies the shooting location. The shooting location is the location of the camera that shot the video. Examples of location information include (latitude, longitude) and (latitude, longitude, altitude). However, location information may also be an area identifier that identifies an area on a map, an address, a road identifier that identifies a road, or a lane identifier that identifies a lane on a road. Location information is usually associated with a still image. Road type identifiers are information that identify the type of road on which a mobile object traveled. Examples of road type identifiers are "expressway," "national highway," and "prefectural road." Location information is information that identifies a point. Examples of location information include place names, bridge names, and road names. Direction information is information that identifies the direction of shooting. Examples of direction information include the angle from true north. Camera information is information about the camera. Examples of camera information include the angle of view and resolution. Time information is information that specifies the time when a video was shot. The time when a video was shot may be a time around the time the video was shot, and accuracy is not required. Time information is, for example, the time, year / month / date and time, year / month / date and time minute, year / month / date and time minute / second, year / month / date, and month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that specifies the weather at the location where the video was shot at the time it was shot. Examples of weather information include "sunny," "rain," "snow," and "cloudy." Temperature information is information that specifies the outside temperature at the location where the video was shot at the time it was shot. Examples of temperature information include "25 degrees" and "above 30 degrees." Season information is information that specifies the season at the location where the video was shot at the time it was shot. Examples of season information include "spring," "summer," "early summer," and "winter."

[0063] The score is information indicating, for example, the certainty of the judgment or the degree of the situation. Examples of the score include a score when it is determined that a manhole is damaged, a score when it is determined that there is a crack in the road, a score when it is determined that a bridge is damaged, a score when it is determined that there is a fallen object on the road, the degree of damage to the manhole, the degree or size of the crack in the road, and the degree of damage to the bridge.

[0064] The reward management unit 112 manages one or more pieces of reward information. It is preferable that the reward information is associated with a tag. That is, for example, it is preferable that the reward corresponding to providing a still image of road damage is different from the reward corresponding to providing a still image of manhole damage. It is preferable that the reward information is associated with a score. That is, it is preferable that the higher the score, the higher the reward. Reward information is information for determining the reward. Reward information is, for example, a monetary amount, points, or an arithmetic formula for determining the reward amount.

[0065] The receiving unit 12 receives various information and instructions from the mobile terminal 2 or a terminal not shown. The various information and instructions are, for example, a still image, location information, an attribute value set, an output instruction, a purchase instruction, inspection conditions described below, and selection conditions described below. The terminal not shown is, for example, a user terminal or an operator terminal. A user terminal is a terminal to which a still image is transmitted, a terminal of a user who requests a still image, or a terminal of a user who uses a still image. A operator terminal is a terminal of the operator of the information processing device 1.

[0066] The receiving unit 12 receives still images associated with the location information from the mobile terminal 2. The receiving unit 12 receives one or more still images from the mobile terminal 2. These still images are still images that satisfy the selection conditions. The receiving unit 12 may also receive videos that include still images that satisfy the selection conditions. Even when receiving videos, the still images included in the videos are received, so this may be considered as receiving still images. The still images received by the receiving unit 12 may include still images that do not satisfy the selection conditions.

[0067] The receiving unit 12 receives, for example, an output instruction or a purchase instruction from a user terminal.

[0068] An output instruction is an instruction to output a still image or the like. An output instruction is an instruction to cause a user terminal to output a still image or the like. An output instruction is associated with, for example, location information. A still image or the like is, for example, a still image and a set of attribute values.

[0069] A purchase instruction is an instruction to purchase a still image. The purchase instruction is associated with a user identifier. The purchase instruction typically includes information that identifies the still image. The purchase instruction has, for example, a still image identifier. The purchase instruction includes, for example, purchase conditions. The purchase conditions are, for example, a purchase price. The purchase conditions include, for example, information that identifies a rights period.

[0070] The receiving unit 12 receives the inspection conditions from, for example, a user terminal or an operator terminal (not shown) of the operator of the information processing device 1. The receiving unit 12 receives the selection conditions from, for example, the user terminal or the operator terminal.

[0071] The processing unit 13 performs various processes, such as processes performed by the storage unit 131 and the rights holder processing unit 132.

[0072] The storage unit 131 stores the still image received by the receiving unit 12 in pairs with the received position information.

[0073] The rights holder processing unit 132 performs rights holder processing. The rights holder processing is processing related to a rights holder identified by a rights holder identifier. The rights holder identifier is, for example, a rights holder identifier associated with a video that is the source of a still image that satisfies the selection conditions. The rights holder identifier is, for example, a rights holder identifier received in pairs with a still image. The rights holder identifier is, for example, information that identifies a person who uses a still image that satisfies the selection conditions. The person who uses the still image is, for example, a user who downloaded the still image from a user terminal, or a user identified by a user identifier for the user terminal to which the still image was transmitted. Note that the user may also be an organization that uses the still image. The organization is, for example, a company, a local government, or a national institution.

[0074] The right holder process is a process related to the rights of a single still image. The right holder process is, for example, a first security process, a second security process, a third security process, a fourth security process, and a compensation process, which will be described later.

[0075] The first security means 1321 performs a first security process of storing still images that satisfy the selection conditions in association with a set of attribute values ​​associated with the still images. Note that the still images that satisfy the selection conditions are still images received by the receiving unit 12 or still images selected by the information processing device 3, which will be described later. The set of attribute values ​​associated with the still images may also be a set of attribute values ​​associated with the video that is the source of the still images.

[0076] The second security unit 1322 performs a second security process of storing still images that satisfy the selection conditions in association with a rights holder identifier corresponding to the still image. The rights holder identifier corresponding to the still image may be the rights holder identifier corresponding to the video that is the source of the still image.

[0077] The third security means 1323 stores the still images that satisfy the selection conditions in association with the right holder identifier corresponding to the user terminal.

[0078] The fourth security means 1324 performs a fourth security process of storing security information including access information for accessing the still images.

[0079] It is preferable that the fourth security means 1324 stores the security information in a blockchain. That is, it is preferable that the fourth security means 1324 stores the security information in a distributed ledger of the blockchain. It is preferable that the fourth security means 1324 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1324 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.

[0080] The security information is information for ensuring the originality of a still image. The security information can be said to be header information for the still image. The security information is, for example, access information and a set of attribute values. It is preferable that the security information has, for example, one or more rights holder identifiers. When the security information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information. The rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder. The fourth security process can guarantee the originality of the security information of the registered still image. By guaranteeing the originality of the security information, the originality of the video corresponding to the security information is also guaranteed. The access information is information for accessing the video. The access information is information that identifies the storage location of the video. The access information is, for example, a URL or a URI.

[0081] The rewarding means 1325 performs a rewarding process, which is a process of giving a reward to a right holder identified by a right holder identifier. The rewarding means 1325 usually performs a rewarding process to a right holder who has the right to the mobile terminal 2 that transmitted the still image.

[0082] The reward means 1325 performs a reward process, which is a process of, for example, acquiring reward information corresponding to a tag paired with a still image that satisfies a selection condition from the reward management unit 112 and giving a reward corresponding to the reward information.

[0083] The reward means 1325 performs a reward process, which is a process of, for example, acquiring reward information corresponding to a score paired with a still image that satisfies a selection condition from the reward management unit 112 and giving a reward corresponding to the reward information.

[0084] The reward means 1325 performs a reward process, which is, for example, a process of acquiring reward information corresponding to a tag and a score paired with a still image that satisfies a selection condition from the reward management unit 112 and giving a reward corresponding to the reward information.

[0085] The reward process is a process for providing a reward. The reward process is, for example, a process for increasing points managed in association with one or more rights holder identifiers associated with a still image. The reward process is, for example, a process for depositing money to a rights holder identified by one or more rights holder identifiers associated with a still image. The reward process is, for example, a process for transmitting a still image or other content to a user terminal of a rights holder identified by one or more rights holder identifiers associated with a still image. The reward process may be any type of benefit, as long as it provides a benefit to a rights holder identified by one or more rights holder identifiers associated with a still image. The reward may be, for example, money, points, goods, content, or the like, and the type of benefit is not important.

[0086] It is preferable that the reward means 1325 acquires a set of attribute values ​​corresponding to the still image transmitted by the transmission unit 14, and performs reward processing, which is a process of determining rewards for one or more rights holders using the set of attribute values ​​and awarding the rewards.

[0087] The remuneration means 1325 preferably acquires a remuneration amount corresponding to a service identifier that identifies a service provided for a still image, and performs a remuneration process that provides a remuneration corresponding to the remuneration amount. The service identifier may be, for example, "output" or "purchase." In this case, the remuneration information corresponding to the service identifier is stored in the storage unit 11, for example.

[0088] The reward means 1325 performs reward processing, which is a process for obtaining a reward amount using, for example, one or more pieces of information from the attribute value set and the service identifier, and awarding a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a reward correspondence table corresponding to each of the multiple service identifiers is stored in the storage unit 11. The arithmetic expression is a formula for calculating the reward amount using one or more video attribute values ​​included in the attribute value set as parameters. The reward correspondence table is a table having multiple pieces of reward correspondence information for managing reward amounts corresponding to one or more video attribute values.

[0089] The remuneration means 1325 normally performs processing to charge a remuneration to a user who has enjoyed a service related to a still image.

[0090] The process of charging the reward is, for example, a process of charging the amount of the acquired reward and the amount of profit obtained by the management side of the information processing device 1. The process of charging the reward is, for example, a process of deducting points corresponding to the user who enjoyed the service, a settlement process using the credit card number of the user, etc.

[0091] The transmission unit 14 transmits the still image to the user terminal. For example, in response to receiving an output instruction from the user terminal, the transmission unit 14 transmits the still image corresponding to the output instruction to the user terminal.

[0092] The transmitter 14 transmits the still image to the notification destination specified by the notification destination information associated with the tag associated with the still image. In this case, the transmitter 14 automatically transmits the still image. Furthermore, when a still image is received, the transmitter 14 preferably acquires the tag associated with the still image, acquires the notification destination information corresponding to the tag from the storage unit 11, and transmits the still image to the notification destination specified by the notification destination information. When a still image is received, the transmitter 14 preferably immediately transmits the still image. <Details of Components of Mobile Terminal 2>

[0093] Various types of information are stored in the mobile storage unit 21 constituting the mobile terminal 2. The various types of information include, for example, videos, still images that satisfy selection conditions, attribute value sets, right holder identifiers, one or more inspection conditions, one or more sets of selection conditions and tags, and map information.

[0094] For example, one or more attribute values ​​constituting an attribute value set correspond to one or more still images constituting a moving image. The one or more attribute values ​​may correspond to all the still images, one still image, or multiple still images.

[0095] The condition management unit 211 stores one or more selection conditions. The condition management unit 211 may store one or more inspection conditions. It is preferable that the selection conditions are associated with tags. Examples of tags are "crack in road," "damage to bridge," "damage to manhole," "fallen object," and "identifier of fallen object." Examples of "identifier of fallen object" are "tire," "wood," and "unknown."

[0096] The inspection conditions are conditions for determining still images for determining whether they satisfy the selection conditions. By using the inspection conditions, the number of times the selection conditions are judged can be reduced, thereby reducing overall processing costs. The inspection conditions are conditions based on one or more attribute values ​​corresponding to the still images. The one or more attribute values ​​here are, for example, environmental information and attribute values ​​of the road on which the mobile object is traveling. The environmental information here is, for example, location information, time information, weather information, temperature information, and seasonal information. The attribute values ​​of the road are, for example, a road type identifier (e.g., expressway) and location information. The location information is, for example, information specifying the location of a manhole or information specifying the location of a bridge.

[0097] The selection conditions are conditions for selecting still images from a video. The selection conditions are conditions related to the content of the still images. For example, the selection conditions are that there is a crack in the road in the still image, that there is damage to the bridge in the still image, that there is damage to the manhole in the road in the still image, and that there is a fallen object on the road in the still image.

[0098] The selection conditions include, for example, a learning model for determining whether the selection conditions are met. The selection conditions include, for example, an image for determining whether the selection conditions are met. The selection conditions preferably include, for example, an image for determining whether the selection conditions are met and a similarity threshold. The similarity threshold is a threshold for the similarity between the still image and the image included in the selection conditions. The selection conditions include, for example, that the similarity is within a threshold or greater than a threshold.

[0099] A learning model is information constructed by a machine learning learning process and is information used in a machine learning prediction process. The learning model is, for example, information acquired by executing a machine learning learning module using one or more positive example teacher data and one or more negative example teacher data. The learning model may also be called a learner, classification model, classifier, etc. The machine learning algorithm may be deep learning, random forest, decision tree, SVM, etc. Furthermore, for machine learning, various machine learning functions such as the TensorFlow library, the random forest module of the R language, and TinySVM, as well as various existing libraries, can be used.

[0100] The training data of positive examples includes still images that meet the selection conditions. The training data of negative examples includes still images that do not meet the selection conditions. Examples of still images that meet the selection conditions include a still image containing a cracked road, a still image containing a damaged bridge, a still image containing a damaged manhole, and a still image containing a road with fallen objects.

[0101] The images used to determine whether they meet the selection conditions are, for example, still images including a cracked road, a damaged bridge, a damaged manhole, or a road with fallen objects.

[0102] The mobile receiving unit 22 receives various types of information, such as one or more inspection conditions, and one or more sets of selection conditions and tags.

[0103] The movement processing unit 23 performs various types of processing. The various types of processing are, for example, processing performed by the position acquisition unit 231, the photographing unit 232, the determination unit 233, and the tag acquisition unit 234. The movement processing unit 23, for example, stores information received by the movement receiving unit 22 in the movement storage unit 21. The movement processing unit 23, for example, creates a data structure for outputting the information received by the movement receiving unit 22.

[0104] The movement processing unit 23 may, for example, perform all the functions that a navigation terminal can perform.

[0105] The movement processing unit 23 acquires an attribute value set during shooting, for example. The movement processing unit 23 stores the acquired attribute value set in the movement storage unit 21. Furthermore, the movement processing unit 23 associates the acquired attribute value set with a moving image, for example. Associating with a moving image usually means associating with still images that make up the moving image. It is preferable that the attribute value set and the still images are synchronized in terms of time.

[0106] The attribute value set may be, for example, one or more pieces of environmental information, such as location information, time information, weather information, temperature information, and season information.

[0107] The movement processing unit 23 acquires time information from a clock (not shown), for example, during shooting. The movement processing unit 23 acquires time information, for example, constantly, at predetermined intervals, or when a selection condition is satisfied.

[0108] For example, during shooting, the movement processing unit 23 acquires time information from a clock (not shown) and acquires season information corresponding to the time information.

[0109] The movement processing unit 23 acquires weather information, for example, during shooting. The movement processing unit 23 acquires weather information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when acquisition conditions are met.

[0110] The movement processing unit 23 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed on a moving object. The movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when a selection condition is met.

[0111] It is preferable that the movement processing unit 23 is provided with, for example, a microphone, acquires sound information, and stores the sound information in association with the video acquired by the imaging unit 232. Such a function is, for example, a function of a drive recorder.

[0112] The position acquisition unit 231 acquires position information. The position acquisition unit 231 usually acquires position information during shooting. The position acquisition unit 231 acquires position information, for example, using a GPS receiver that is held by the position acquisition unit 231. The position acquisition unit 231 acquires position information, for example, constantly, at predetermined intervals.

[0113] The image capturing unit 232 captures video including still images while moving and associated with the location information. It is preferable that the image capturing unit 232 captures the moving surface or the vicinity while moving and captures the video. Note that the vicinity refers to the range captured by the camera. The vicinity is, for example, a range within a threshold from the position indicated by the location information.

[0114] The determination unit 233 determines whether or not a still image included in the moving image acquired by the image capturing unit 232 satisfies a selection condition.

[0115] The determination unit 233 preferably determines whether or not some still images in a moving image satisfy the selection condition, for example, or whether or not only one still image among N still images (N is a natural number equal to or greater than 2) in the moving image satisfies the selection condition.

[0116] It is preferable that the determination unit 233 obtains one or more attribute values ​​corresponding to still images included in the video acquired by the imaging unit 232, determines whether or not the one or more attribute values ​​match the inspection conditions, and determines whether or not the still images determined to match the inspection conditions satisfy the selection conditions. Here, it is preferable that the determination unit 233 extracts still images included in the video acquired by the imaging unit 232, for example, and determines whether or not the still images match the inspection conditions.

[0117] The attribute values ​​here are, for example, location information, an identifier of a specific object in the still image, a road type identifier of the road on which the mobile object traveled, and location information that identifies the location on which the mobile object traveled. The location information is, for example, information indicating the location of a manhole. In such a case, the inspection condition is, for example, that the distance between the location information indicating the location of the manhole and the location information corresponding to the still image, which is the location information acquired by the location acquisition unit 231, is within a threshold or is smaller than the threshold.

[0118] The determination unit 233, for example, determines whether a still image included in the video acquired by the image capturing unit 232 matches the inspection conditions. Next, the determination unit 233 may determine whether each of a plurality of consecutive still images, including the still image determined to match the inspection conditions, satisfies a selection condition. In such a case, when the determination unit 233 detects a plurality of still images that satisfy the selection condition, the determination unit 233 may select a specific still image from the plurality of still images, or may acquire the plurality of consecutive still images. Note that the specific still image may be, for example, a still image in a specific order (e.g., the middle) from the plurality of consecutive still images, or a still image in which an object (e.g., damage, a fallen object) is most prominently displayed.

[0119] In addition, each of the consecutive still images including the still image determined to match the inspection conditions may be a still image after the still image determined to match the inspection conditions, or a still image before the still image determined to match the inspection conditions.

[0120] The determination unit 233, for example, provides a machine learning prediction module with still images included in the video acquired by the imaging unit 232 and a learning model included in the selection conditions, executes the prediction module, and obtains a determination result indicating whether the selection conditions are met. It is preferable that the determination unit 233 also obtains a score here. The score is information output by the prediction module. The score can be said to be, for example, the likelihood of the determination result. The determination result is, for example, "1" indicating that the selection conditions are met, or "0" indicating that the selection conditions are not met. It is preferable that the still images included in the video acquired by the imaging unit 232 are still images that meet the inspection conditions.

[0121] It is preferable that the determination unit 233 also acquires an analysis result for a still image included in the video. The analysis result is, for example, an identifier of an object on a road in the still image. The object identifier is, for example, an identifier of a fallen object. The identifier of a fallen object is, for example, the name of the fallen object or the ID of the fallen object.

[0122] The determination unit 233 preferably determines whether a specific object is included in a still image included in the video, and determines whether the still image determined to include the specific object satisfies the selection condition. The specific object may be, for example, a manhole or a fallen object. The fallen object may be, for example, a tire, a piece of wood, or a plastic bottle, but is not limited thereto. Furthermore, the inclusion of the specific object may be considered to be a match with the inspection condition.

[0123] When the condition management unit 211 stores a plurality of selection conditions, the determination unit 233 determines whether or not the still image satisfies each of the plurality of selection conditions.

[0124] The tag acquisition unit 234 acquires tags corresponding to the selection conditions that are determined to be satisfied by the determination unit 233. The tag acquisition unit 234 acquires the tags from the condition management unit 211. Note that tags may also be considered as attribute values.

[0125] The tag acquisition unit 234 acquires a tag using, for example, the analysis result for the still image that the determination unit 233 has determined to satisfy the selection condition. The tag acquisition unit 234 acquires, for example, an object identifier that is the analysis result.

[0126] The mobile transmission unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, still images, videos, and attribute value sets. That is, the mobile transmission unit 24 may transmit to the information processing device 1 a video including a still image that the determination unit 233 determines satisfies the selection condition.

[0127] The image transmitting unit 241 transmits the still image that the determining unit 233 has determined to satisfy the selection conditions in association with the location information acquired by the location acquiring unit 231. It is preferable that the image transmitting unit 241 transmits the still image that the determining unit 233 has determined to satisfy the selection conditions in association with the location information and the right holder identifier.

[0128] The image transmitting unit 241 may also transmit attribute values ​​other than the position information in association with the still image. The attribute values ​​other than the position information may be, for example, a tag, location information, a road type identifier, or time information, but are not limited thereto.

[0129] The image transmitting unit 241 may transmit a video including a still image that the determining unit 233 has determined to satisfy the selection condition to the information processing device 1. Such a video is a still image that is consecutive to the still image that satisfies the selection condition, and preferably includes one or more still images before the still image that satisfies the selection condition and / or one or more still images after the still image that satisfies the selection condition. Note that the image transmitting unit 241 normally transmits still images, etc. to the information processing device 1. <Operation>

[0130] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described using the flowchart in Fig. 3. Note that "S" in each flowchart used in the following description indicates a step.

[0131] (S301) The receiving unit 12 determines whether or not inspection conditions, etc. have been received from a terminal (not shown). If inspection conditions, etc. have been received, the process proceeds to S302, and if inspection conditions, etc. have not been received, the process proceeds to S303. The inspection conditions, etc. are, for example, inspection conditions and tags.

[0132] (S302) The transmission unit 14 transmits the inspection conditions, etc. received in S301 to one or more mobile terminals 2 managed by the terminal management unit 111. Return to S301. Note that the processing unit 13 may store the inspection conditions, etc. in the storage unit 11.

[0133] (S303) The receiving unit 12 determines whether or not selection conditions, etc. have been received from a terminal (not shown). If selection conditions, etc. have been received, the process proceeds to S304; if selection conditions, etc. have not been received, the process proceeds to S305. The selection conditions, etc., are, for example, selection conditions and tags. The selection conditions may include usage information used for selection. The usage information is, for example, a learning model and an image.

[0134] (S304) The transmission unit 14 transmits the selection conditions, etc. received in S303 to one or more mobile terminals 2 managed by the terminal management unit 111. Return to S301. Note that the processing unit 13 may store the selection conditions, etc. in the storage unit 11.

[0135] (S305) The receiving unit 12 determines whether or not a still image or the like has been received from the mobile terminal 2. If a still image or the like has been received, the process proceeds to S306, and if a still image or the like has not been received, the process proceeds to S309. Note that a still image or the like is, for example, a still image, a tag, an attribute value set, and a rights holder identifier.

[0136] (S306) The processing unit 13 determines whether the still image etc. received in S305 satisfies the notification condition. If the notification condition is satisfied, the process proceeds to S307, and if the notification condition is not satisfied, the process proceeds to S301.

[0137] (S307) The processing unit 13 acquires notification destination information corresponding to the still image etc. received in S305. The transmission unit 14 transmits the still image etc. received in S305 to the destination indicated by the notification destination information.

[0138] (S308) The rights holder processing unit 132 performs a security process. Return to S301. An example of the security process will be described with reference to the flowchart in FIG.

[0139] (S309) The receiving unit 12 determines whether or not an output instruction has been received from the user terminal. If an output instruction has been received, the process proceeds to S311, and if an output instruction has not been received, the process proceeds to S312.

[0140] (S310) The processing unit 13 acquires access information for a still image or the like corresponding to the output instruction, and then acquires the still image or the like from the access destination indicated by the access information.

[0141] (S311) The transmission unit 14 transmits the still image etc. acquired in S310 to the user terminal that has transmitted the output instruction.

[0142] (S312) The receiving unit 12 determines whether or not a purchase instruction has been received from the user terminal. If a purchase instruction has been received, the process proceeds to S313, and if no purchase instruction has been received, the process returns to S301. Note that the purchase instruction is associated with the user identifier of the user who is the purchaser.

[0143] (S313) The processing unit 13 acquires access information for the still image etc. corresponding to the purchase instruction, and then acquires the still image etc. from the access destination indicated by the access information.

[0144] (S314) The processing unit 13 acquires a user identifier corresponding to the purchase instruction. The user identifier is the identifier of the user who will purchase the still image.

[0145] (S315) The fourth maintenance means 1324 performs the fourth maintenance process. The process returns to S301. An example of the fourth maintenance process will be described with reference to the flowchart in FIG.

[0146] In the flowchart of FIG. 3, the process ends when the power is turned off or an interrupt occurs to end the process.

[0147] Next, an example of the security process in S308 will be described with reference to the flowchart in FIG.

[0148] (S401) The first security unit 1321 acquires a rights holder identifier. This rights holder identifier is usually a rights holder identifier paired with the received still image. However, the rights holder identifier is a rights holder identifier paired with a tag paired with the received still image, and may be a rights holder identifier stored in the storage unit 11. This rights holder identifier is an identifier of a user who needs the still image.

[0149] (S402) The first security unit 1321 stores the received still images etc. in association with the rights holder identifier acquired in S401.

[0150] (S403) The fourth maintenance means 1324 performs a fourth maintenance process. An example of the fourth maintenance process will be described with reference to the flowchart in FIG.

[0151] (S404) The reward unit 1325 performs reward processing. Return to S301. An example of the reward processing will be described with reference to the flowchart in FIG.

[0152] Next, an example of the fourth maintenance process of S315 and S403 will be described with reference to the flowchart of FIG.

[0153] (S501) The fourth security unit 1324 acquires access information that identifies the storage destination of still images and the like.

[0154] (S502) The fourth maintenance unit 1324 acquires a set of attribute values ​​corresponding to the stored still images and the like.

[0155] (S503) The fourth security means 1324 constructs security information including the access information acquired in S501, the attribute value set acquired in S502, and the rights holder identifier of the still image, etc. If a new rights holder identifier has been acquired, the fourth security means 1324 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. The new rights holder identifier is usually the identifier of the user who needs the still image. (S504) The fourth security means 1324 stores the security information constructed in S503. The process returns to the upper level processing. The fourth security means 1324 stores the security information in a blockchain, for example.

[0156] Next, an example of the reward process in S404 will be described with reference to the flowchart in FIG.

[0157] (S601) The compensation unit 1325 acquires one or more right holder identifiers of the target still image, etc. The compensation unit 1325 may acquire the right holder identifiers of the previous right holders of the target still image, etc.

[0158] (S602) The reward unit 1325 acquires a set of attribute values ​​of the target still image or the like.

[0159] (S603) The remuneration unit 1325 acquires a service identifier that identifies the service provided for the target still image, etc. The service identifier is, for example, "output" or "purchase."

[0160] (S604) The reward unit 1325 acquires a reward amount using one or more pieces of information from the attribute value set acquired in S602 and the service identifier acquired in S603.

[0161] If multiple right holder identifiers are acquired, the remuneration unit 1325 acquires a remuneration amount for each right holder identifier. If history information of right holders including multiple right holder identifiers is acquired, the remuneration unit 1325 may acquire a remuneration amount for each right holder identifier.

[0162] (S605) The reward unit 1325 performs processing to give a reward of the amount of reward acquired in S604 to the right holder identified by the right holder identifier acquired in S601.

[0163] (S606) The remuneration means 1325 performs processing to charge a remuneration to the user who has enjoyed the service related to the target still image, etc., and returns to the upper processing. Note that the target still image, etc., is usually a moving image transmitted to the user terminal.

[0164] In the flowchart of FIG. 6, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.

[0165] In the flowchart of FIG. 6, the reward means 1325 may acquire reward information corresponding to a tag paired with a target still image from the reward management unit 112, and use the reward information to acquire the reward amount.

[0166] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.

[0167] (S701) The mobile receiving unit 22 determines whether or not inspection conditions, etc. have been received from the information processing device 1. If inspection conditions, etc. have been received, the process proceeds to S702, and if inspection conditions, etc. have not been received, the process proceeds to S703. Note that the inspection conditions, etc. are, for example, inspection conditions and tags.

[0168] (S702) The movement processing unit 23 stores the inspection conditions and the like received in S701 in the condition management unit 211. The process returns to S701.

[0169] (S703) The mobile receiving unit 22 determines whether or not selection conditions, etc. have been received from the information processing device 1. If selection conditions, etc. have been received, the process proceeds to S704, and if selection conditions, etc. have not been received, the process proceeds to S705. The selection conditions, etc. are, for example, selection conditions and tags. The selection conditions, etc. are, for example, selection conditions, usage information, and tags.

[0170] (S704) The movement processing unit 23 stores the selection conditions and the like received in S703 in the condition management unit 211. The process returns to S701.

[0171] (S705) The movement processing unit 23 determines whether or not the start of movement has been detected. If the start of movement has been detected, the process proceeds to S706, and if not, the process returns to S701. The start of movement is, for example, when the engine of the moving object on which the mobile terminal 2 is installed is turned on or when the power of the mobile terminal 2 is turned on.

[0172] (S706) The photographing unit 231 starts photographing.

[0173] (S707) The photographing unit 231 acquires the video and stores it in the moving storage unit 21.

[0174] (S708) The movement processing unit 23 acquires a set of attribute values ​​of the mobile terminal 2. That is, the location acquisition unit 231 acquires current location information. The movement processing unit 23 also acquires other attribute values. The other attribute values ​​include, for example, time information, weather information, temperature information, and season information.

[0175] (S709) The movement processing unit 23 assigns 1 to the counter i.

[0176] (S710) The movement processing unit 23 determines whether the i-th still image is present in the moving image acquired in S707. If the i-th still image is present, the process proceeds to S711; if not, the process proceeds to S716.

[0177] (S711) The determination unit 233 performs a determination process on the ith still image. An example of the determination process will be described with reference to the flowchart in FIG.

[0178] (S712) If the result of the determination in S711 is information that "matches the selection conditions", the process proceeds to S713, and if the information is information that "does not match the selection conditions", the process proceeds to S715.

[0179] (S713) The tag retrieval unit 234 retrieves from the moving storage unit 21 tags that are paired with one or more matching selection conditions.

[0180] (S714) The movement processing unit 23 composes information including still images and one or more tags. Note that here, the movement processing unit 23 may compose information having a plurality of still images, including a still image that matches the selection conditions. It is preferable that all of the plurality of still images match the selection conditions, but it is also possible to include a still image that does not match the selection conditions. It is preferable that the plurality of still images are still images that are consecutive in time.

[0181] (S715) The movement processing unit 23 increments the counter i by 1. The process returns to S710.

[0182] It is preferable that the movement processing unit 23 increments the counter i by N (N is a natural number equal to or greater than 2). In other words, it is preferable to perform the determination process of FIG. 8 on the thinned-out still images.

[0183] (S716) The movement processing unit 23 determines whether or not the information has been configured in S714. If the information has been configured, the process proceeds to S717, and if not, the process proceeds to S720.

[0184] (S717) The movement processing unit 23 acquires the rights holder identifier from the movement storage unit 21.

[0185] (S718) The movement processing unit 23 composes information to be transmitted using the rights holder identifier and the information composed in S714.

[0186] (S719) The image transmission unit 241 transmits the information constructed in S718 to the information processing device 1.

[0187] (S720) The movement processing unit 23 determines whether or not the end of movement has been detected. If the end of movement has been detected, the process returns to S701. If the end of movement has not been detected, the process returns to S709. Note that the movement processing unit 23 detects the end of movement by, for example, detecting that the engine has been turned off, the power of the mobile terminal 2 has been turned off, or the arrival at the destination.

[0188] Next, an example of the determination process in S711 will be described with reference to the flowchart in FIG.

[0189] (S801) The determination unit 233 assigns 1 to a counter i.

[0190] (S802) The determination unit 233 determines whether or not the i-th tag exists. If the i-th tag exists, the process proceeds to S803, and if not, the process returns to the upper process.

[0191] (S803) The determination unit 233 determines whether or not an inspection condition corresponding to the i-th tag exists. If an inspection condition exists, the process proceeds to S804, and if not, the process proceeds to S807.

[0192] (S804) The determination unit 233 acquires the inspection condition corresponding to the i-th tag.

[0193] (S805) The determination unit 233 obtains, from the attribute value set, one or more attribute values ​​to be used for determining the inspection condition obtained in S804.

[0194] (S806) The determination unit 233 determines whether or not the one or more attribute values ​​acquired in S805 match the inspection conditions acquired in S804. If the inspection conditions are met, the process proceeds to S807, and if the inspection conditions are not met, the process proceeds to S810.

[0195] (S807) The determination unit 233 acquires the selection conditions and the like corresponding to the i-th tag. The selection conditions and the like are, for example, the selection conditions and the usage information.

[0196] (S808) The determination unit 233 determines whether the still image to be determined matches the selection conditions acquired in S807. If the selection conditions are met, the process proceeds to S809, and if the selection conditions are not met, the process proceeds to S810.

[0197] The still image to be judged may be only the still image that meets the inspection conditions, or may be a plurality of still images surrounding the still image that meets the inspection conditions. The plurality of surrounding still images are usually a plurality of still images that are consecutive in time within a predetermined period, but may also be still images arbitrarily extracted within the predetermined period. The predetermined period is, for example, 10 seconds or 5 seconds.

[0198] (S809) The determination unit 233 assigns the value "match" to the variable "i-th determination result" corresponding to the i-th tag. Note that the initial value of the "i-th determination result" is "mismatch."

[0199] (S810) The determination unit 233 increments the counter i by 1. Return to S802. <Specific Operation Example>

[0200] A specific example of the operation of the information system A in this embodiment will be described below.

[0201] It is assumed that terminal information including a terminal identifier and communication destination information is stored in the terminal management unit 111 of the information processing device 1 for each of one or more mobile terminals 2. It is also assumed that the information processing device 1 transmits inspection conditions, selection conditions, etc. to the mobile terminal 2, and that the mobile terminal 2 receives and stores the inspection conditions, selection conditions, etc.

[0202] The reward management unit 112 stores a reward management table having the structure shown in FIG. 9. The reward management table is a table that manages one or more pieces of reward management information. The reward management information has an "ID," "tag," "reward conditions," "reward information," and "notification destination information." The "ID" is information that identifies a record. The "reward conditions" are the conditions under which a reward is generated. The "reward information" here is an amount or points. The "notification destination information" is information that indicates the notification destination of the user to whom a still image or the like corresponding to the tag is sent. The "notification destination information" is, for example, an email address, a telephone number, a fax number, a notification app ID, or the IP address of the user terminal used by the user. The notification destination is, for example, a person in a local government organization that develops measures against cracks in roads, damage to bridges, and damage to manholes, or a person in the Japan Highway Public Corporation that removes fallen debris from expressways.

[0203] Here, reward information is managed for each tag. In other words, the reward for a selected still image varies depending on the selection conditions. Multiple different reward information may be acquired for a single tag according to the reward conditions (see the record with "ID = 3" in Figure 9). The reward condition "first location" means that the location information associated with the selected still image is the first location information among one or more location information associated with already received still images. The non-first location information may be only location information that matches one or more location information associated with already received still images, or may include location information where the difference between the two location information is within or less than a threshold. The score included in the reward condition is a score acquired by a machine learning prediction module.

[0204] The condition management unit 211 of the mobile terminal 2 stores the inspection condition management table shown in FIG. 10 . The inspection condition management table stores one or more records each having an "ID," "tag," and "inspection condition." The "ID" is information that identifies the record. It is preferable that the "inspection condition" be managed for each tag. The inspection condition for "ID=1" is a condition for inspecting road cracks. The inspection condition "Road type identifier !=" "Expressway"" indicates that the condition applies to roads other than expressways. "!=" means "not equal." The inspection condition for "ID=2" is a condition for inspecting bridge damage. The inspection condition "Location information=".*bridge"" indicates that the name of the location being traveled ends with "bridge" (i.e., the vehicle is traveling over a bridge). The inspection condition for "ID=3" is a condition for inspecting manhole damage. The inspection condition is a collection of location information indicating the location of each manhole. The inspection condition for "ID=4" is a condition for inspecting fallen objects on the road. The check condition "road type identifier = 'expressway'" indicates that it applies only to expressways.

[0205] The condition management unit 211 also stores a selection condition management table shown in FIG. 11 . The selection condition management table stores one or more records each having an "ID," "tag," "usage information," and "selection condition." The "usage information" is information used to determine whether or not a selection condition is met. The "usage information" is, for example, a learning model or an image. The image is a source image from which the similarity with a still image included in a captured video is obtained. The "selection condition" is, for example, a condition based on a prediction result, a condition based on a prediction result and a score, or a condition based on the similarity between two images. The prediction result is the execution result (objective variable) of a machine learning prediction module. The score is a value obtained as a result of executing the prediction module.

[0206] In FIG. 11 , learning model 1 is information acquired by providing a machine learning learning module with multiple positive example images of road sections with cracks and multiple negative example images of road sections without cracks, and then executing the learning module. Learning model 2 is information acquired by providing a machine learning learning module with multiple positive example images of damaged bridge sections and multiple negative example images of undamaged bridge sections, and then executing the learning module. Learning model 3 is information acquired by providing a machine learning learning module with multiple positive example images of damaged manholes and multiple negative example images of undamaged manholes, and then executing the learning module. Learning model 4 is information acquired by providing a machine learning learning module with multiple positive example images of road sections with fallen objects on a highway and multiple negative example images of highway sections without fallen objects, and then executing the learning module. It is preferable that each positive example image be an image of various fallen objects that have occurred on the highway. Furthermore, image 1, image 2, ..., image N are images of various tires that had fallen on a highway. The selection condition "similarity >= 0.8" indicates that the similarity to any of images 1 to N is 0.8 or greater. <Specific Example>

[0207] In this situation, the following specific example will be described. In this specific example, when a vehicle is traveling on a national highway, an expressway, or the like, a mobile terminal 2 mounted on the vehicle detects a crack in the road, a damaged bridge, a damaged manhole, or a fallen object, and transmits a still image of the detection, a right holder identifier, and a set of attribute values ​​to the information processing device 1.

[0208] While the automobile is traveling, the photographing unit 232 of the mobile terminal 2 photographs video. Then, while traveling, the position acquisition unit 231 constantly acquires position information. Also, while traveling, the movement processing unit 23 acquires an attribute value set. Here, the attribute value set includes a road type identifier and point information. Note that the attribute value set may also include other attribute values, such as time information. Note that the technology for acquiring a road type identifier and point information while traveling using the automobile's navigation function is a publicly known technology.

[0209] Then, the determination unit 233 refers to the inspection condition management table ( FIG. 10 ) according to the flowchart of FIG. 8 and determines whether each still image included in the captured video satisfies the inspection conditions of any of the records. If the inspection conditions of any of the records are satisfied, the determination unit 233 refers to the selection condition management table ( FIG. 11 ) according to the flowchart of FIG. 8 and acquires the usage information and selection conditions that are paired with the tag corresponding to the satisfied inspection condition. Next, the determination unit 233 determines whether the selection conditions are satisfied using the still image that satisfies the inspection conditions and the acquired usage information and selection conditions.

[0210] 7, the tag acquisition unit 234 acquires a tag paired with the matched selection condition. Next, the movement processing unit 23 constructs information including the still image that satisfies the selection condition, the attribute value set, the tag, and the rights holder identifier (here, "U001") of the movement storage unit 21. Next, the image transmission unit 241 transmits the constructed information to the information processing device 1. Note that the attribute value set includes, for example, a tag, a road type identifier, point information, location information, etc.

[0211] The above process is repeated in the mobile terminal 2 until the car engine is stopped.

[0212] The information processing device 1 then operates as follows, in accordance with the processing of the flowchart in Fig. 3. That is, the receiving unit 12 of the information processing device 1 receives a still image or the like from the mobile terminal 2. The still image or the like includes a rights holder identifier, a still image, and an attribute value set including a tag. Here, it is assumed that the received tag is, for example, "falling object, tire."

[0213] Next, the processing unit 13 determines whether the still image, etc. received in S305 satisfies the notification condition. Here, the notification condition is defined as the existence of notification destination information corresponding to the received tag (not NULL "-"). The processing unit 13 then obtains notification destination information "notification destination S4" paired with the tag "falling object, tire" from the remuneration management table (Figure 9). Next, the transmission unit 14 transmits the received still image, etc. to the notification destination indicated by the notification destination information. Here, the notification destination indicated by "notification destination S4" is defined as a terminal (not shown) of a person in charge of the Japan Highway Public Corporation who maintains the safety of expressways. Next, the terminal of the person in charge receives and outputs the still image, etc. Then, the person in charge views the still image, etc., heads to the location indicated by the location information paired with the still image, and performs the task of removing the fallen object from the expressway.

[0214] Next, the right holder processing unit 132 of the information processing device 1 performs the following security processing in accordance with the operation of the flowchart in FIG.

[0215] First, the first security unit 1321 acquires the right holder identifier "U001" that has transmitted the still image. Next, the first security unit 1321 stores the received still image etc. in the storage unit 11 in association with the right holder identifier "U001."

[0216] Next, the fourth security means 1324 performs the fourth security process as follows, following the operation of the flowchart in FIG. 5 . That is, first, the fourth security means 1324 acquires access information (here, a URL) that identifies the storage destination of the still images, etc. The fourth security means 1324 also acquires a set of attribute values ​​corresponding to the stored still images, etc. The fourth security means 1324 also constructs security information including the URL, the set of attribute values, and the rights holder identifier "U001" of the still images, etc. The fourth security means 1324 also acquires a rights holder identifier "X001" corresponding to the Japan Highway Public Corporation that requires the still images, etc. It is assumed that the rights holder identifier "X001" is managed in the storage unit 11, for example, paired with the tag "falling object." Next, the fourth security means 1324 constructs security information including the rights holder identifier "X001" and the original rights holder identifier "U001," for example. Next, the fourth security means 1324 stores the constructed security information in the blockchain. The security information does not have to include the original rights holder identifier "U001".

[0217] Next, the remuneration means 1325 performs remuneration processing as follows, in accordance with the operation of the flowchart in FIG. 6 . First, the remuneration means 1325 acquires the rights holder identifier "U001" of the target still image, etc. Next, the remuneration means 1325 acquires an attribute value set that is a set of attribute values ​​of the target still image, etc., and that includes the tag "falling object, tire." Next, the remuneration means 1325 references the remuneration management table ( FIG. 9 ) and acquires remuneration information "100 yen" corresponding to the tag "falling object, tire." Next, the remuneration means 1325 performs processing to provide the remuneration information "100 yen" to the rights holder identified by the rights holder identifier "U001." Furthermore, the remuneration means 1325 performs processing to have the organization of notification destination S4 (the organization corresponding to rights holder identifier "X001") that has enjoyed the service related to the target still image, etc., pay the remuneration "100 yen."

[0218] As described above, according to this embodiment, it is possible to select and use still images that match the selection conditions from the video captured by the mobile terminal 2. Also, according to this embodiment, it is possible to select and use still images that match two or more selection conditions from the video captured by the mobile terminal 2.

[0219] Furthermore, according to this embodiment, still images that match the inspection conditions are used as the selection condition for determining the selection conditions, so that necessary still images can be acquired efficiently.

[0220] Furthermore, according to this embodiment, it is possible to assign appropriate tags to still images that meet the conditions.

[0221] Furthermore, according to this embodiment, a still image that meets the conditions can be selected and used from a video captured on the surface on which the mobile terminal 2 is moving or in the vicinity of the surface on which the mobile terminal 2 is moving.

[0222] Furthermore, according to this embodiment, it is possible to select and use a still image that can confirm defects on the surface of movement of the mobile terminal 2 or in the vicinity of the surface of movement, such as cracks in the road, damage to a bridge, damage to a manhole, or fallen objects.

[0223] Furthermore, according to this embodiment, still images that match the selection conditions can be received from the moving images captured by the mobile terminal 2 and stored.

[0224] Furthermore, according to this embodiment, a still image can be automatically transmitted to a person who needs the still image. In particular, according to this embodiment, a still image can be automatically transmitted to a person who needs the still image immediately in response to reception of the still image.

[0225] Furthermore, according to this embodiment, a reward is paid to the party providing the image, and a right is granted to the party using the image, so that both parties can provide and use the image without any hindrance.

[0226] The various processes in the various devices described in this specification may be implemented by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments described in this specification. The software that implements the information processing device 1 in this embodiment is the following program. In other words, this program causes a computer to function as a receiving unit that receives still images associated with location information from a mobile terminal 2, and as a storage unit that stores the still images received by the receiving unit in pairs with the location information.

[0227] Furthermore, software that realizes the mobile terminal 2 in this embodiment is the following program. That is, this program causes a computer to function as a location acquisition unit that acquires location information, a shooting unit that acquires, while moving, a video that includes still images and that is associated with the location information, a determination unit that determines whether or not a still image included in the video acquired by the shooting unit satisfies a selection condition, and an image transmission unit that transmits the still image that the determination unit determines satisfies the selection condition, in association with the location information acquired by the location acquisition unit.

[0228] (Embodiment 2) This embodiment differs from Embodiment 1 in that the information processing device receives a video from a mobile terminal and performs a determination process to select a still image that satisfies a selection condition from the video. <Outline of Information System B>

[0229] The conceptual diagram of the information system B in this embodiment is the same as Fig. 1 except for the reference numerals. Fig. 12 is a block diagram of the information system B in this embodiment.

[0230] The information system B includes an information processing device 3 and one or more mobile terminals 4. The information processing device 3 is, for example, a cloud server or an ASP server, but the type is not important. The information processing device 3 may also be a device that constitutes a blockchain. The information processing device 3 mainly performs image processing, so it may also be called an image processing device. The mobile terminal 4 is, for example, a drive recorder, a smartphone, a tablet terminal, a camera with communication functions, or a glasses-type camera.

[0231] The information processing device 3 includes a storage unit 31, a receiving unit 32, a processing unit 33, and a transmission unit 14. The storage unit 31 includes a terminal management unit 111, a remuneration management unit 112, and a condition management unit 211. The processing unit 33 includes a determination unit 233, a tag acquisition unit 234, an accumulation unit 131, and a rights holder processing unit 132.

[0232] The mobile terminal 4 includes a movement storage unit 41, a movement receiving unit 42, a movement processing unit 43, a movement transmitting unit 44, and a movement output unit 45. The movement processing unit 43 includes a position acquisition unit 231 and an imaging unit 232. <Details of components of the information processing device 3>

[0233] Various types of information are stored in the storage unit 31 that constitutes the information processing device 3. The various types of information are, for example, sets of attribute values ​​such as terminal information, reward information, detection conditions, selection conditions, moving images, still images, and location information.

[0234] The receiving unit 32 receives a video that includes multiple still images and is captured by the mobile terminal 4 while it is moving. Typically, a still image is associated with a set of attribute values ​​that includes location information. However, a video may include still images that are not associated with location information, etc.

[0235] The processing unit 33 performs various processes, such as processes performed by the determination unit 233, tag acquisition unit 234, storage unit 131, and rights holder processing unit 132.

[0236] The determination unit 233 performs a determination process. The determination unit 233 determines whether or not a still image included in the moving image received by the receiving unit 32 satisfies the selection condition. The process of determining whether or not the selection condition is satisfied has been described in the first embodiment.

[0237] The storage unit 131 stores the still images that the determination unit 233 determines satisfy the selection conditions in association with an attribute value set including location information associated with the still images. Details of the storage unit 131 have been described in the first embodiment. <Details of the components of the mobile terminal 4>

[0238] Various types of information are stored in the mobile storage unit 41 of the mobile terminal 4. The various types of information include, for example, video, attribute value sets, right holder identifiers, and map information.

[0239] The mobile receiving unit 42 receives various types of information. The mobile receiving unit 42 receives information from the information processing device 3. The various types of information are, for example, remuneration information.

[0240] The movement processing unit 43 performs various processes. The various processes are, for example, processes performed by the position acquisition unit 231 and the photographing unit 232. The movement processing unit 43 acquires an attribute value set. This process is the same as the process performed by the movement processing unit 23, and has been described above.

[0241] The movement processing unit 43 performs, for example, the processing of a navigation terminal, such as obtaining a road type identifier and obtaining point information corresponding to the current position.

[0242] The mobile transmission unit 44 transmits various types of information to the information processing device 1. The various types of information include, for example, a moving image, a set of attribute values, and a rights holder identifier.

[0243] The movement output unit 45 outputs various types of information, such as map information and video.

[0244] Here, output is a concept that includes displaying on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and delivery of processing results to other processing devices or other programs.

[0245] The storage unit 31 and the moving storage unit 41 are preferably non-volatile recording media, but may also be realized as volatile recording media.

[0246] There is no restriction on the process by which information is stored in the storage unit 31 etc. For example, information may be stored in the storage unit 31 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 31 etc., or information input via an input device may be stored in the storage unit 31 etc.

[0247] The receiving unit 32 and the mobile receiving unit 42 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.

[0248] The processing unit 33 and the movement processing unit 43 can usually be realized by a processor, memory, etc. The processing procedures of the processing unit 33, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.

[0249] The mobile transmitting unit 44 is usually realized by wireless or wired communication means, but may also be realized by broadcasting means.

[0250] The movement output unit 45 may or may not include an output device such as a display or speaker. The movement output unit 45 may be realized by driver software for an output device, or by a combination of driver software for an output device and the output device. <Operation>

[0251] Next, an example of the operation of the information system B will be described. First, an example of the operation of the information processing device 3 will be described using the flowchart of Fig. 13. In the flowchart of Fig. 13, the description of the same steps as in the flowchart of Fig. 3 will be omitted.

[0252] (S1301) The receiving unit 32 determines whether or not a video or the like has been received from the mobile terminal 4. If a video or the like has been received, the process proceeds to S1302, and if a video or the like has not been received, the process proceeds to S309. The video or the like is, for example, a video, a set of attribute values, and a rights holder identifier.

[0253] (S1302) The processing unit 33 acquires a set of attribute values ​​associated with the moving image.

[0254] (S1303) The processing unit 33 assigns 1 to the counter i.

[0255] (S1304) The processing unit 23 determines whether the i-th still image is present in the video received in S1301. If the i-th still image is present, the process proceeds to S1305; if not, the process proceeds to S1310.

[0256] (S1305) The determination unit 233 performs a determination process on the ith still image. An example of the determination process has been described with reference to the flowchart in FIG.

[0257] (S1306) If the result of the determination in S1305 is that the selection condition is met, the process proceeds to S1307, and if the result of the determination is that the selection condition is not met, the process proceeds to S1309.

[0258] (S1307) The tag retrieval unit 234 retrieves from the storage unit 31 tags paired with each of the one or more matching selection conditions.

[0259] (S1308) The processing unit 33 composes information including still images and one or more tags. Note that here, the processing unit 33 may compose information having a plurality of still images including a still image that matches the selection conditions. It is preferable that all of the plurality of still images match the selection conditions, but it is also possible to include a still image that does not match the selection conditions. It is preferable that the plurality of still images are still images that are consecutive in time.

[0260] (S1309) The processing unit 33 increments the counter i by 1. The process returns to S1304.

[0261] Here, it is preferable that the processing unit 33 increments the counter i by N (N is a natural number equal to or greater than 2). In other words, it is preferable to perform the determination process on the thinned-out still images.

[0262] (S1310) The processing unit 33 determines whether or not the information has been configured in S1308. If the information has been configured, the process proceeds to S1311, and if not, the process returns to S1301.

[0263] (S1311) The processing unit 33 composes still images etc. to be stored. The still images etc. are, for example, one or more still images, a set of attribute values ​​including tags, and a rights holder identifier.

[0264] (S1312) The processing unit 33 determines whether the stored still image, etc. matches the notification condition. If the notification condition is met, the process proceeds to S1313, and if not, the process proceeds to S1314.

[0265] (S1313) The processing unit 13 acquires notification destination information corresponding to the still image, etc. The transmission unit 14 transmits the still image, etc. to the destination indicated by the notification destination information.

[0266] (S1314) The rights holder processing unit 132 performs the security processing. Return to S1301. Note that an example of the security processing has been described using the flowchart in FIG.

[0267] In the flowchart of FIG. 13, the process ends when the power is turned off or an interrupt occurs to end the process.

[0268] Next, an example of the operation of the mobile terminal 4 will be described with reference to the flowchart of Fig. 14. In the flowchart of Fig. 14, the description of the same steps as in the flowchart of Fig. 7 will be omitted.

[0269] (S1401) The movement processing unit 43 composes information to be transmitted. This information includes moving images, etc. The moving images, etc. are, for example, moving images, attribute value sets, and rights holder identifiers.

[0270] (S1402) The mobile transmitting unit 44 transmits the information constructed in S1401 to the information processing device 3. The process proceeds to S720.

[0271] In the flowchart of FIG. 14, the process ends when the power is turned off or an interrupt occurs to end the process.

[0272] As described above, according to this embodiment, it is possible to select and use still images that match the selection conditions from the video captured by the mobile terminal 4. Also, according to this embodiment, it is possible to select and use still images that match two or more selection conditions from the video captured by the mobile terminal 4.

[0273] Furthermore, according to this embodiment, still images that match the inspection conditions are used as the selection condition for determining the selection conditions, so that necessary still images can be acquired efficiently.

[0274] Furthermore, according to this embodiment, it is possible to assign appropriate tags to still images that meet the conditions.

[0275] Furthermore, according to this embodiment, a still image that meets the conditions can be selected and used from a video captured on the surface on which the mobile terminal 4 is moving or in the vicinity of the surface on which the mobile terminal 4 is moving.

[0276] Furthermore, according to this embodiment, it is possible to select and use still images that can confirm defects on the surface of movement of the mobile terminal 4 or in the vicinity of the surface of movement, such as cracks in the road, damage to a bridge, damage to a manhole, or fallen objects.

[0277] Furthermore, according to this embodiment, still images that match the selection conditions can be received from the moving images captured by the mobile terminal 4 and stored.

[0278] Furthermore, according to this embodiment, a still image can be automatically transmitted to a person who needs the still image. In particular, according to this embodiment, a still image can be automatically transmitted to a person who needs the still image immediately in response to reception of the still image.

[0279] 15 shows the appearance of a computer that executes the programs described herein to realize the information processing device 1, mobile terminal 2, information processing device 3, and mobile terminal 4 of the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 15 is an overview of this computer system 300, and FIG. 16 is a block diagram of system 300.

[0280] In FIG. 15, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0281] 16, the computer 301 includes, in addition to a CD-ROM drive 3012, an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 etc., a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions for application programs and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Although not shown here, the computer 301 may further include a network card for providing connection to a LAN.

[0282] A program that causes computer system 300 to execute the functions of information processing device 1 and the like of the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and then transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may also be loaded directly from CD-ROM 3101 or the network.

[0283] The program does not necessarily have to include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-described embodiment. The program only needs to include instructions that call appropriate functions (modules) in a controlled manner and achieve the desired results. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.

[0284] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).

[0285] The computer that executes the program may be a single computer or a plurality of computers, that is, it may perform centralized processing or distributed processing.

[0286] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be physically realized by one medium.

[0287] Furthermore, in each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.

[0288] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention.

[0289] As described above, the mobile terminal of the present invention has the effect of being able to select and use still images that meet certain conditions from videos captured by the mobile terminal, and is useful as a drive recorder installed in an automobile, etc.

Claims

1. a receiving unit that receives a video captured by a mobile terminal while moving, the video having location information indicating a capture location and a plurality of still images each having a tag associated therewith; a determination unit that determines whether the still image included in the moving image received by the receiving unit satisfies a selection condition; a storage unit that stores the still image determined by the determination unit to satisfy the selection condition in association with the position information corresponding to the still image; a storage unit that stores the tag in association with notification destination information that identifies a notification destination, the tag being information that indicates a feature element included in the still image; a transmission unit that transmits the still image associated with the tag to the notification destination based on the notification destination information; An information processing device comprising:

2. The method further includes a rights holder processing unit that associates the still images stored by the storage unit with rights holder identifiers that identify rights holders of the still images, and stores security information including access information for accessing the still images in a blockchain.

2. The information processing device according to claim 1.

3. An information processing method for use in an information processing device having a receiving unit, a determining unit, an accumulating unit, a storing unit, and a transmitting unit, receiving, by the receiving unit, a video that is a video taken by the mobile terminal while moving, the video having location information indicating a shooting location and a plurality of still images each having a tag associated therewith; a step of determining whether or not the still image included in the moving image received by the receiving unit satisfies a selection condition; a step of storing the still image, which the determination unit has determined to satisfy the selection condition, in association with the position information corresponding to the still image, by the storage unit; the storage unit storing the tag, which is information indicating a feature element included in the still image, and notification destination information specifying a notification destination in association with each other; and transmitting, by the transmitting unit, the still image associated with the tag to the notification destination based on the notification destination information.