Information processing device, user terminal, and information processing method
Patent Information
- Application Number
- JP2024574191
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-02-02
- Filing Date
- 2023-02-02
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2043-02-02
AI Technical Summary
Conventional systems cannot effectively compare videos from multiple locations such as supermarkets, department stores, and expressways, limiting the ability to obtain and analyze video content from various sites simultaneously.
An information processing device that includes an inquiry receiving unit, video acquisition unit, screen configuration unit, and screen transmission unit, allowing it to acquire, configure, and transmit videos from multiple locations specified by a user, using mobile terminals equipped with cameras and position information to provide real-time video comparison.
Enables the provision of videos from multiple locations, facilitating comparison and analysis, and allows for ranking and secure transmission of video content, ensuring the right holder's identity and providing remuneration for video contributors.
Abstract
Description
Information processing device, user terminal, and information processing method
[0001] The present invention relates to an information processing device or the like that provides images of a plurality of locations to be compared.
[0002] Conventionally, there has been a system that includes a terminal on which a viewer watches a video, an advertising video distribution server that distributes advertising video content including advertising products to the terminal, and an advertising product database that stores image information of the advertising products; when a viewer specifies an advertising product in a video by performing a predetermined instruction operation on the terminal receiving the advertising video content, the system compares the image information of the advertising product in the video with image information of advertising products registered in the advertising product database, and identifies information about the specified advertising product, making it possible to access the information provider of the specified advertising product from the terminal (see Patent Document 1).
[0003] Japanese Patent Application Laid-Open No. 2005-286882
[0004] However, in the prior art, it was not possible to obtain video of multiple locations to be compared. The multiple locations to be compared may be, for example, supermarkets (e.g., supermarkets A and B), department stores (e.g., department stores X, Y, and Z), or expressways (e.g., the Meishin Expressway and the Keiji Bypass), but the types of locations are not important.
[0005] The information processing device of the first invention is an information processing device that includes an inquiry receiving unit that receives an inquiry from a user terminal including specific information that identifies multiple locations to be compared, a video acquisition unit that acquires videos transmitted from mobile terminals located in each of the multiple locations identified by the specific information, a screen composition unit that uses the multiple videos to construct a single screen, and a screen transmission unit that transmits the single screen to the user terminal.
[0006] With this configuration, videos of multiple locations can be obtained for comparison.
[0007] In addition, the information processing device of the second invention is an information processing device in which, compared to the first invention, the video acquisition unit refers to a group management unit in which one or more group information including location identifiers that identify each of a plurality of locations to be compared is stored, acquires a plurality of location identifiers corresponding to the specific information included in the query, and acquires videos received from mobile terminals located in each of the plurality of locations identified by the plurality of location identifiers.
[0008] With this configuration, videos of multiple locations to be compared can be easily obtained.
[0009] Furthermore, the information processing device of the third invention is an information processing device in which, compared to the first or second invention, the video acquisition unit transmits a video transmission instruction to a mobile terminal located at each of multiple locations identified by the specific information, and receives the video from the mobile terminal in response to the transmission of the transmission instruction.
[0010] With this configuration, videos of multiple locations can be obtained for comparison.
[0011] Furthermore, the information processing device of the fourth invention is an information processing device that, compared to the third invention, further includes a location receiving unit that receives location information from each of a plurality of mobile terminals, and the video acquisition unit includes a terminal determination means that uses the location information received by the location receiving unit to determine a mobile terminal that is present at each of a plurality of locations identified by the specific information, an instruction sending means that sends a transmission instruction to each of the plurality of mobile terminals determined by the terminal determination means, and a video receiving means that receives video from each of the plurality of mobile terminals.
[0012] With this configuration, videos of multiple locations can be obtained for comparison.
[0013] In addition, the information processing device of the fifth invention is an information processing device in which, compared to the third invention, the video acquisition unit includes an instruction sending means for sending an inquiry based on specific information to a plurality of mobile terminals, and a video receiving means for receiving video from each of a plurality of mobile terminals that has been determined to correspond to the specific information in response to the sending of the inquiry.
[0014] With this configuration, videos of multiple locations can be obtained for comparison.
[0015] In addition, the information processing device of the sixth invention, compared to the first or second invention, further includes a video receiving unit that receives videos corresponding to location information from a plurality of mobile terminals, and a video storage unit that stores each of the plurality of videos in association with the location information, and the video acquisition unit is an information processing device that acquires videos corresponding to location information corresponding to each of the plurality of locations identified by the specific information from the plurality of videos stored in the video storage unit.
[0016] With this configuration, videos of multiple locations can be obtained for comparison.
[0017] In addition, the information processing device of the seventh invention is an information processing device in which, compared to any one of the first to sixth inventions, the screen composition unit is equipped with a ranking means for acquiring attribute values of each of a plurality of videos and ranking the plurality of videos using the attribute values, and a composition means for composing a screen according to the ranking of each of the plurality of videos.
[0018] With this configuration, ranked videos can be obtained. Furthermore, the information processing device of the seventh invention is an information processing device according to any one of the first to sixth inventions, further comprising a third security means for storing multiple videos or a single screen including multiple videos in association with a rights holder identifier that identifies the user of the user terminal. With this configuration, the rights holder of a video can be a user who needs the video.
[0019] In addition, the user terminal of the ninth invention is a user terminal that includes a location acquisition unit that acquires a location identifier that identifies the location of the user terminal, a query acquisition unit that acquires a query that includes specific information using the location identifier, a user transmission unit that transmits the query to an information processing device, a user receiving unit that receives from the information processing device a single screen that is composed of videos of multiple locations including the location identified by the location identifier, and a user output unit that outputs the single screen.
[0020] With this configuration, videos of multiple locations to be compared can be easily obtained.
[0021] Furthermore, the user terminal of the tenth invention is a user terminal that includes an inquiry acquisition unit that acquires an inquiry including specific information including a user identifier, a user transmission unit that transmits the inquiry to an information processing device, a user receiving unit that receives from the information processing device a single screen that is composed of videos of multiple locations identified by multiple location identifiers that correspond to the user identifier, and a user output unit that outputs the single screen.
[0022] With this configuration, videos of multiple locations to be compared can be easily obtained.
[0023] According to the information processing device of the present invention, videos of a plurality of locations to be compared can be provided.
[0024] FIG. 1 is a conceptual diagram of an information system A in a first embodiment; FIG. 2 is a block diagram of the information system A; FIG. 3 is a block diagram of the information processing device 1; FIG. 4 is a flowchart illustrating a first operation example of the information processing device 1; FIG. 5 is a flowchart illustrating an example of a terminal determination process; FIG. 6 is a flowchart illustrating an example of a comparison target position acquisition process; FIG. 7 is a flowchart illustrating an example of a screen configuration process; FIG. 8 is a flowchart illustrating an example of a fourth maintenance process;
[0025] Hereinafter, embodiments of an information processing device and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.
[0026] (First embodiment) <Outline of first embodiment>
[0027] In this embodiment, an information processing device is described that receives an inquiry specifying a plurality of locations to be compared, and transmits a screen including video of one or more of the plurality of locations to a user terminal based on the inquiry. Note that video is referred to as video as appropriate. It is preferable that the video is real-time video. Real-time video is video that is being captured, but there may be a delay between capturing and displaying. It is also preferable that the screen includes video of all of the plurality of locations.
[0028] In addition, in this embodiment, we will describe an information processing device that determines a mobile terminal to photograph each of multiple locations to be compared, receives videos from each of the multiple mobile terminals, and transmits a screen containing one or more videos of the multiple videos to a user terminal.
[0029] In addition, in this embodiment, we will describe an information system that includes a mobile terminal that receives an inquiry, determines whether or not the inquiry matches, and if a video of a location that matches the inquiry is being taken, transmits the taken video, and an information processing device that sends inquiries to multiple mobile terminals, receives video from mobile terminals that it determines match the inquiry, and transmits a screen including the video to a user terminal.
[0030] Furthermore, in this embodiment, an information processing device that ranks videos or objects within videos based on the analysis results of the videos will be described.
[0031] In the specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>
[0032] 1 is a conceptual diagram of an information system A according to this embodiment. The information system A comprises an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.
[0033] The information processing device 1 is a device that provides video received from the mobile terminal 2 to the user terminal 3. The information processing device 1 is usually a server that provides video to the user terminal 3. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type does not matter. The information processing device 1 may also be a device that constitutes a blockchain.
[0034] In this specification, the interval between each of the multiple still images included in a moving image does not matter. A moving image is, for example, a moving image at 60 frames per second or 30 frames per second, but it may also be a collection of multiple still images taken at intervals of a predetermined time (for example, one minute) or more, or a collection of multiple still images taken when predetermined conditions are met. Still images may also be called fields or frames.
[0035] The mobile terminal 2 is a terminal that can move. The mobile terminal 2 is a device that shoots video and transmits the video to the information processing device 1. The mobile terminal 2 is a terminal that is installed on a moving body and shoots video. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, camera-equipped glasses, a camera-equipped smartwatch, or a drive recorder. The type of the mobile terminal 2 is not important. Furthermore, "installed" usually means "fixed," but it may also be considered to include "in contact with" or "held." The mobile body is a moving object, such as a car, a motorcycle, a bicycle, or a living thing. The living thing is usually a person, but may be another living thing.
[0036] The user terminal 3 is a terminal used by a user. The user terminal 3 is, for example, a device that receives an inquiry specifying multiple locations to be compared and outputs real-time video of the multiple locations based on the inquiry. The user is someone who watches videos or needs videos. The user terminal 3 may have the functions of a mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may be, for example, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and its type does not matter.
[0037] The information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3 are generally capable of communicating via a network such as the Internet.
[0038] 2 is a block diagram of an information system A according to the present embodiment, and FIG. 3 is a block diagram of an information processing device 1. As shown in FIG.
[0039] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a group management unit 111 and a terminal management unit 112. The receiving unit 12 includes a location receiving unit 121 and an inquiry receiving unit 122. The processing unit 13 includes a video acquisition unit 131, a screen composition unit 132, and a rights holder processing unit 133. The video acquisition unit 131 includes a terminal determination means 1311, an instruction sending means 1312, and a video receiving means 1313. The screen composition unit 132 includes a ranking means 1321 and a composition means 1322. The rights holder processing unit 133 includes a first security means 1331, a second security means 1332, a third security means 1333, a fourth security means 1334, and a reward means 1335. The transmitting unit 14 includes a screen transmission unit 141.
[0040] The mobile terminal 2 includes a movement storage unit 21, a movement receiving unit 22, a movement processing unit 23, a movement transmitting unit 24, and a movement output unit 25. The movement processing unit 23 includes a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234.
[0041] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit 34, a user reception unit 35, and a user output unit 36. The user processing unit 33 includes a location acquisition unit 331 and an inquiry acquisition unit 332. <Details of components of the information processing device 1>
[0042] Various types of information are stored in the storage unit 11. The various types of information include, for example, group information (to be described later), terminal information (to be described later), videos, one or more attribute values associated with the videos, and map information.
[0043] The attribute value is, for example, the attribute value of the video. The attribute value of the video is, for example, environmental information. Environmental information is information about the environment in which the video was shot. Environmental information is, for example, location information, time information, weather information, temperature information, seasonal information, and a location identifier, which will be described later. Time information is information that identifies the time when the video was shot. The time when the video was shot may be a time around the time the video was shot, and accuracy is not required. Time information is, for example, the time, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / date, and month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that identifies the weather at the location (or region) where the video was shot. Weather information is, for example, "sunny," "rain," "snow," or "cloudy." Temperature information is information that identifies the temperature at the location where the video was shot. Temperature information is, for example, "25 degrees" or "above 30 degrees." Seasonal information is information that identifies the season at the location where the video was shot. The season information is, for example, “spring,” “summer,” “early summer,” or “winter.” The road attribute value is the attribute value of the road on which the mobile terminal 2 has traveled.
[0044] Map information is used to obtain, for example, a location identifier corresponding to location information. The map information is, for example, in KIWI format, but the data structure is not critical. Location information is information that identifies a location. Location information is usually (latitude, longitude) or (latitude, longitude, altitude), but it may also be a location identifier, which will be described later.
[0045] A location identifier is information that identifies a location. The location identifier is, for example, the name of the location or the ID of the location. However, the location identifier may also be (latitude, longitude) or (latitude, longitude, altitude).
[0046] The group management unit 111 stores one or more pieces of group information. Group information is information that identifies multiple locations to be compared. The group information includes, for example, a location identifier for each of the multiple locations to be compared. The group information includes, for example, location information for each of the multiple locations to be compared.
[0047] The group information may be associated with a user identifier. That is, a group of multiple locations to be compared that each user desires may be managed. The group information associated with a user identifier is, for example, information registered by a user identified by the user identifier.
[0048] The terminal management unit 112 stores one or more pieces of terminal information. The terminal information is information relating to the mobile terminal 2. The terminal information here typically includes a terminal identifier, which is an identifier for the mobile terminal 2, and terminal communication information. The terminal information has, for example, the latest location information for the mobile terminal 2. The mobile terminal 2 here is typically a terminal capable of transmitting video. The terminal information is associated with the mobile terminal 2. The terminal information in the terminal management unit 112 is accumulated, for example, by transmission of terminal communication information and the like from the mobile terminal 2 when the mobile terminal 2 is in a state where it can transmit video.
[0049] The terminal identifier is information that identifies the mobile terminal 2. The terminal identifier may be a rights holder identifier that identifies the rights holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.
[0050] A rights holder is a person who has some right to a video shot by the mobile terminal 2. A rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that shot the video, or the person with the right to dispose of the video. A rights holder is, for example, the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it may be any person who has the rights to the video shot by the mobile terminal 2.
[0051] The right holder identifier may be a terminal identifier. The right holder identifier is, for example, the right holder's ID, name, email address, or telephone number. The right holder's ID is, for example, a user identifier.
[0052] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of the communication application installed in the mobile terminal 2.
[0053] The receiving unit 12 receives various types of information and instructions. The various types of information and instructions are, for example, location information, an inquiry (described later), a video, and a video associated with one or more attribute values. Note that a video associated with one or more attribute values is appropriately referred to as an additional video. Note that the term "video" is a concept that includes the additional video.
[0054] The location receiving unit 121 receives location information from each of the multiple mobile terminals 2. Note that each of the multiple mobile terminals 2 here is a terminal capable of transmitting video. A terminal capable of transmitting video is, for example, a terminal currently shooting video, but it may also be a terminal that starts shooting video in response to receiving an instruction from the information processing device 1. The location receiving unit 121 normally receives location information from each of the multiple mobile terminals 2 continuously. Receiving continuously means receiving the information two or more times, for example, receiving the information constantly, receiving the information periodically, or receiving the information irregularly 22 or more times.
[0055] The inquiry receiving unit 122 receives inquiries from one or more user terminals 3. An inquiry can be said to be a request for transmission of screens based on videos of multiple locations to be compared. The inquiry includes specific information.
[0056] The specific information is information for identifying multiple locations to be compared. The specific information is, for example, a location identifier (e.g., a location name) that identifies each of the multiple locations, location information (e.g., (latitude, longitude)) that identifies each of the multiple locations, one location identifier, the location identifier of the location where the user terminal 3 is located, one location information, location information indicating the location where the user terminal 3 is located, or a user identifier.
[0057] The processing unit 13 performs various types of processing, such as processing performed by a video acquisition unit 131, a screen composition unit 132, or a rights holder processing unit 133.
[0058] The video acquisition unit 131 acquires videos transmitted from the mobile terminals 2 present at the locations specified by the identification information. The video acquisition unit 131 acquires videos in one of the following methods (1) and (2), for example: (1) When the video acquisition unit 131 determines the mobile terminal 2 to which the video is to be transmitted
[0059] The video acquisition unit 131 transmits a video transmission instruction to the mobile terminal 2 located at each of the multiple locations specified by the specific information, and receives the video from the mobile terminal 2 in response to the transmission of the transmission instruction. In this case, the video acquisition unit 131 includes the following terminal determination means 1311, instruction transmission means 1312, and video reception means 1313.
[0060] The terminal determination means 1311 uses the location information of the mobile terminal 2 received by the location receiving unit 121 to determine the mobile terminal 2 present at each of the multiple locations specified by the identification information.
[0061] The instruction sending means 1312 sends a transmission instruction to each of the plurality of mobile terminals 2 determined by the terminal determining means 1311. The transmission instruction is an instruction to transmit a moving image.
[0062] The video receiving means 1313 receives video from each of the plurality of mobile terminals 2 to which a transmission instruction has been transmitted. (2) When the mobile terminal 2 determines whether to transmit video
[0063] The video acquisition unit 131 includes, for example, an instruction sending unit 1312 and a video receiving unit 1313 described below.
[0064] The instruction sending means 1312 sends an inquiry based on the specific information to the multiple mobile terminals 2. The multiple mobile terminals 2 here are multiple mobile terminals 2 that can send video. The multiple mobile terminals 2 here are typically all mobile terminals 2 that can send video. The multiple mobile terminals 2 here are, for example, multiple mobile terminals 2 that are managed by the terminal management unit 112 as being in a state where they can send video.
[0065] The query based on the identifying information is transmitted to the mobile terminal 2 and may be the same information as the received query or may be different information. The query based on the identifying information may include the received identifying information, may include multiple pieces of location information corresponding to the received identifying information, or may include multiple location identifiers corresponding to the received identifying information.
[0066] In response to the transmission of the inquiry, the video receiving means 1313 receives video from each of the plurality of mobile terminals 2 determined to correspond to the specific information.
[0067] The screen configuration unit 132 configures a screen based on multiple videos acquired by the video acquisition unit 131. It is preferable for a single screen to include multiple videos. It is also preferable for a single screen to include all videos acquired by the video acquisition unit 131. However, a single screen may include thumbnail images based on frames constituting each of the multiple videos, or may include a portion (e.g., one) of the multiple videos and thumbnail images based on frames constituting one or more other videos. It is preferable for a portion (window) of a single screen to include one or more videos. Furthermore, configuring a screen means acquiring screen information that is the basis for displaying the screen. The screen information is described in, for example, HTML, XML, or the like, but the format is not important.
[0068] The ranking means 1321 acquires one or more attribute values of each of the multiple videos and ranks the multiple videos using the attribute values. The attribute values are, for example, the analysis results of the video and the distance from the user terminal 3. The analysis results of the video are, for example, the price of a specific product in the video and the degree of road congestion based on the number of cars. The distance from the user terminal 3 is the distance acquired using the location information corresponding to the video and the location information transmitted from the user terminal 3.
[0069] The ranking means 1321 performs object recognition processing on one frame of a video taken inside each of multiple supermarkets, for example, to determine the object in the frame, and obtains the price, which is a number near the object, through character recognition processing. Next, the ranking means 1321 assigns a rank (for example, any natural number greater than or equal to 1) to the videos in order of lowest price of the same object, for example.
[0070] The ranking means 1321, for example, performs object recognition processing on one frame in each video of a plurality of different expressways, obtains the number of cars or the distance between cars in that frame, and obtains the road congestion level (level) using the number of cars or the distance. Note that the ranking means 1321 obtains the level by, for example, referring to a correspondence table containing a plurality of pieces of correspondence information having ranges of the number of cars and levels, or a correspondence table containing a plurality of pieces of correspondence information having ranges of distance between cars and levels. Next, the ranking means 1321, for example, assigns a level to each video.
[0071] The ranking means 1321 calculates the distance for each of the plurality of mobile terminals 2, for example, using the location information associated with the video transmitted from the mobile terminal 2 and the location information transmitted from the user terminal 3. Next, the ranking means 1321 assigns a rank to each of the videos transmitted from the mobile terminal 2 in order of the shortest distance, for example.
[0072] The configuration unit 1322 configures one screen based on each of the multiple videos. It is preferable that the configuration unit 1322 configures one screen according to the ranking of each of the multiple videos. Note that the one screen according to the ranking is, for example, a screen including multiple videos sorted in order of rank, or a screen indicating the rank of each video. Note that, as described above, it is preferable that the one screen include all of the multiple videos, but it may also include thumbnail images using still images that configure each video, or it may include only some of the videos.
[0073] The right holder processing unit 133 performs right holder processing. The right holder processing is processing related to a right holder identified by a right holder identifier associated with a video. Note that the video here is, for example, a video acquired by the video acquisition unit 131. The video here is, for example, a video received by the receiving unit 12.
[0074] The rights holder processing unit 133 performs rights holder processing, which is processing in response to the transmission of a screen by the screen transmission unit 141, and is processing related to a rights holder identified by a rights holder identifier associated with each of multiple videos corresponding to the screen. The rights holder processing is, for example, a first security processing, a second security processing, a third security processing, a fourth security processing, and a compensation processing, which will be described later.
[0075] The right holder identifier associated with the video is, for example, the right holder identifier corresponding to the mobile terminal 2 that transmitted the video, or the identifier of the user of the user terminal 3 to which the video was transmitted. The user of the user terminal 3 is the user who transmitted the inquiry.
[0076] The first security means 1331 performs a first security process of storing the video received by the receiving unit 12 in association with an attribute value set corresponding to the video. The attribute value set includes one or more attribute values. The first security means 1331 stores the video in a blockchain, for example.
[0077] The second security means 1332 performs a second security process of storing the video received by the receiving unit 12 in association with the rights holder identifier corresponding to the video. The second security means 1332 stores the video in a blockchain, for example.
[0078] The third security means 1333 stores a right holder identifier that identifies the user of the user terminal 3, in association with the video. The third security means 1333 stores the right holder identifier, for example, in the storage unit 11 or a blockchain. The third security means 1333 may store a right holder identifier that identifies the user of the user terminal 3 for multiple videos received by the receiving unit 12. The third security means 1333 may store temporally consecutive screens (video of the screens) transmitted by the screen transmission unit 141, paired with the right holder identifier.
[0079] The video is stored in, for example, the storage unit 11, but may also be stored in other devices, such as other devices that make up the blockchain.
[0080] The fourth security means 1334 performs a fourth security process to store security information. The security information includes access information for accessing the stored video. The order of storing the video and performing the fourth security process on the security information corresponding to the video does not matter.
[0081] The fourth security means 1334 performs, for example, a fourth security process of accumulating security information including access information for accessing the multiple videos acquired by the video acquisition unit 131. The fourth security means 1334 performs, for example, a fourth security process of accumulating security information including access information for accessing the video on the screen transmitted by the screen transmission unit 141 to the user terminal 3.
[0082] It is preferable that the fourth security means 1334 stores the security information in a blockchain. That is, it is preferable that the fourth security means 1334 stores the security information in a distributed ledger of the blockchain. It is preferable that the fourth security means 1334 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1334 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.
[0083] The security information is information for ensuring the originality of a video. The security information can be said to be header information for the video. The security information is, for example, access information and a set of attribute values. It is preferable that the security information has, for example, one or more rights holder identifiers. When the security information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information. The rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder. The fourth security process can ensure the originality of the security information of the registered video (which may be a video on a screen). By ensuring the originality of the security information, the originality of the video corresponding to the security information is also ensured. The access information is information for accessing the video. The access information is information that identifies the storage location of the video. The access information is, for example, a URL or a URI.
[0084] The remuneration means 1335 performs remuneration processing for each right holder identified by a right holder identifier associated with the video acquired by the video acquisition unit 131. Note that such a right holder identifier is, for example, the owner of the mobile terminal 2.
[0085] The reward process is a process of providing a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more rights holder identifiers associated with a video. The reward process is, for example, a process of depositing money to a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is not limited to the type of merit provided to the rights holder identified by one or more rights holder identifiers associated with the video. The reward may be, for example, money, points, goods, content, or the like, and the type of merit is not limited.
[0086] It is preferable that the compensation means 1335 acquires one or more attribute values of the video corresponding to the screen transmitted by the screen transmission unit 141, and performs compensation processing, which is a process of determining a compensation to the rights holder of the video using the one or more attribute values and providing the compensation.
[0087] Here, the one or more attribute values are, for example, the amount of video data, the duration of the video, the number of frames of the video, and the resolution of the video.
[0088] The reward means 1335 preferably acquires a reward amount corresponding to a service identifier that identifies a service provided for a target video, and performs a reward process that awards a reward corresponding to the reward amount. The service identifier may be, for example, "view" or "purchase." In this case, the storage unit 11 stores, for example, the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.
[0089] The reward means 1335 performs reward processing, which is a process of obtaining a reward amount using, for example, one or more pieces of information from one or more attribute values and one or more service identifiers, and providing a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of multiple service identifiers is stored in the storage unit 11. The arithmetic expression is a formula for calculating the reward amount using one or more attribute values as parameters. The correspondence table is a table having multiple pieces of correspondence information for managing reward amounts corresponding to one or more attribute values.
[0090] The reward means 1335 typically performs a process of charging a user who has enjoyed a service related to the target video with a reward. The process of charging a user with a reward is, for example, a process of charging the user with the amount of reward obtained. The process of charging a user with a reward is, for example, a process of charging the user with the amount of reward obtained and the amount of profit obtained by the operator of the information processing device 1. The process of charging a user with a reward is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc. The user who has enjoyed the service is typically the user of the user terminal 3.
[0091] The transmitting unit 14 transmits various types of information or instructions, such as a screen.
[0092] The screen transmission unit 141 transmits one of the screens acquired by the screen composition unit 132 to the user terminal 3 that has sent the inquiry. The screen transmission unit 141 usually transmits to the user terminal 3 a screen including videos taken at multiple locations to be compared. <Details of the components of the mobile terminal 2>
[0093] Various types of information are stored in the moving storage unit 21. The various types of information include, for example, video, attribute value sets, rights holder identifiers, camera attribute values, and map information. The camera attribute values are attribute values of the camera. The camera attribute values include, for example, the angle of view, direction information, and resolution.
[0094] For example, one or more attribute values constituting an attribute value set correspond to one or more still images constituting a moving image. The one or more attribute values may correspond to all of the still images, some of the still images, or multiple still images.
[0095] The mobile receiving unit 22 receives various information and instructions, such as transmission instructions and inquiries.
[0096] The movement processing unit 23 performs various processes, such as processes performed by a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234.
[0097] The movement processing unit 23 determines whether the location information acquired by the location acquisition unit 231 matches the query received by the mobile receiving unit 22. The movement processing unit 23 determines whether any one or more location identifiers or any one or more location information included in the query satisfies a location condition with respect to the location information acquired by the location acquisition unit 231. The location condition means that the two locations are the same or nearby locations. Examples of the location condition include the location indicated by the location information acquired by the location acquisition unit 231 being the same as the location identified by the location identifier or location information included in the query, or the distance between the point indicated by the location information acquired by the location acquisition unit 231 and the point identified by the location identifier or location information included in the query being within a threshold or less than a threshold.
[0098] The location acquisition unit 231 acquires location information. The location acquisition unit 231 typically acquires location information that identifies the current location of the mobile terminal 2. The location acquisition unit 231 acquires the location information using, for example, a GPS receiver. However, the means or algorithm by which the location acquisition unit 231 acquires the location information is not critical.
[0099] The photographing unit 232 photographs a video. For example, the photographing unit 232 photographs a video while the mobile terminal 2 is moving. It is preferable that the photographed video be associated with location information acquired by the location acquisition unit 231. It is also preferable that the photographed video be associated with one or more attribute values acquired by the attribute value acquisition unit 233, which will be described later.
[0100] It is preferable that the imaging unit 232 stores the captured video in the mobile storage unit 21. When the imaging unit 232 stores video in the mobile storage unit 21, which has a limited storage capacity, it is preferable that the imaging unit 232 overwrites new video in the area where old video is stored. In other words, it is preferable that the structure of the mobile storage unit 21 is a ring buffer structure.
[0101] The photographing unit 232 may start photographing a video in response to, for example, receiving a transmission instruction. The photographing unit 232 may start photographing a video when, for example, it is determined that a location condition is met in response to a received inquiry. The photographing unit 232 starts photographing a video in response to, for example, receiving a photographing instruction input from a user.
[0102] The attribute value acquisition unit 233 acquires one or more camera attribute values including direction information indicating the direction in which the image is captured by the image capture unit 232. It is preferable that the attribute value acquisition unit 233 acquires one or more attribute values including the camera attribute value.
[0103] The attribute value acquisition unit 233 acquires, for example, one or more attribute values. The one or more attribute values may be referred to as an attribute value set. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting. The attribute value acquisition unit 233 acquires time information, for example, constantly, at predetermined intervals, or when acquisition conditions are met. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting, and acquires seasonal information corresponding to the time information. The attribute value acquisition unit 233 acquires weather information corresponding to location information, for example, from a server (not shown). The attribute value acquisition unit 233 acquires weather information, for example, constantly, at predetermined intervals, or when acquisition conditions are met. The attribute value acquisition unit 233 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed in the moving object. The movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied, such as when the analysis result of the video satisfies a predetermined condition.
[0104] The attribute value acquisition unit 233, for example, acquires from map information a location identifier corresponding to the location information acquired by the location acquisition unit 231, and associates the location identifier with the video. The attribute value acquisition unit 233, for example, acquires from map information a location identifier that is a location identifier corresponding to the location information acquired by the location acquisition unit 231 and that satisfies a specific condition, and associates the location identifier with the video. The specific condition is, for example, that the location identifier is a specific type of location identifier (for example, a station name or a building name).
[0105] Note that the association with the moving image may be association with frames that make up the moving image, or association with the entire moving image.
[0106] The attribute value acquisition unit 233 acquires, for example, one or more tags for the video captured by the image capture unit 232 and associates the tags with the video. Note that a tag can also be considered an attribute value.
[0107] The attribute value acquisition unit 233, for example, analyzes the video captured by the image capture unit 232 and acquires one or more tags for the video.
[0108] The attribute value acquisition unit 233 acquires one or more tags using, for example, one or more moving object attribute values acquired during image capture by the image capture unit 232. The moving object attribute values are, for example, CAN data.
[0109] The attribute value acquisition unit 233 may, for example, determine one or more still images that match the video tag condition and acquire a tag that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.
[0110] For example, if the video tag condition is "the number of cars with a distance between them within a threshold is equal to or greater than a threshold and the car's moving speed is equal to or less than a threshold," and the tag paired with the video tag condition is "traffic jam," the attribute value acquisition unit 233 analyzes frames of the video, recognizes multiple cars, and acquires the distances between each of the multiple cars. The attribute value acquisition unit 233 also acquires the number of cars with a distance between them within a threshold. The attribute value acquisition unit 233 also acquires the moving distance and frame rate of a single car in multiple frames, and acquires the car's speed. The attribute value acquisition unit 233 then determines whether the video tag condition is met using the number of cars with a distance between them within a threshold and the car's speed. If the video tag condition is met, the attribute value acquisition unit 233 acquires the tag "traffic jam" paired with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.
[0111] The attribute value acquisition unit 233 may, for example, determine one or more moving object attribute values that match the attribute value tag condition, and acquire a tag that pairs with the attribute value tag condition. The attribute value acquisition unit 233 may also associate the tag with a video that pairs with the one or more moving object attribute values.
[0112] For example, if the attribute value tag condition is "driving time at a speed of less than 30 km for 10 minutes or more and the proportion of times during that driving time when the speed is less than 30% is 80% or more," and the tag paired with the attribute value tag condition is "traffic jam," the attribute value acquisition unit 233 uses the speed history contained in the CAN data associated with each field of the video to detect CAN data that matches the attribute value tag condition, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is CAN data acquired at the same time that the field was captured.
[0113] The composition unit 234 associates the acquired location information with the video and acquires an additional video. The composition unit 234 acquires, for example, an additional video in which one or more camera attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. The composition unit 234 acquires, for example, an additional video in which one or more attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. The additional video usually includes location information.
[0114] The mobile transmission unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, moving images and additional moving images. The mobile transmission unit 24 may continuously transmit moving images acquired by the shooting unit 232 to the information processing device 1. In such cases, the moving images are usually associated with location information and time information.
[0115] For example, in response to receiving a transmission instruction, the mobile transmission unit 24 transmits the video captured by the shooting unit 232 to the information processing device 1 .
[0116] For example, when it is determined that the location condition is met for the received inquiry, the mobile transmitting unit 24 transmits the video captured by the photographing unit 232 to the information processing device 1 .
[0117] The movement output unit 25 outputs various types of information, such as a moving image, an additional moving image, and a set of attribute values.
[0118] The concept of output includes displaying on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and delivery of processing results to other processing devices or other programs. <Details of Components of the User Terminal 3>
[0119] Various types of information are stored in the user storage unit 31. The various types of information include, for example, a user identifier, a video, an inquiry, and map information.
[0120] The user receiving unit 32 receives various instructions and information. The various instructions and information are, for example, inquiries. The inquiries received by the user receiving unit 32 include, for example, specific information.
[0121] Reception is a concept that includes the reception of information entered from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.
[0122] The user receiving unit 32 receives, for example, an inquiry from a user. Such an inquiry is an instruction to acquire videos of multiple locations to be compared. The inquiry received from the user may be simply a button press or a menu item selection, or may include input of one or more location identifiers, or may include input of one or more pieces of location information.
[0123] For example, when the location information acquired by the user processing unit 33 is specific location information (for example, a point before a branch point of an expressway such as the Tomei Expressway and the Shin-Tomei Expressway), the user accepting unit 32 acquires an inquiry including the location information. Acquisition of such an inquiry may also be considered as acceptance of an inquiry.
[0124] The user processing unit 33 performs various types of processing. The various types of processing are, for example, processing performed by the location acquisition unit 331 and the inquiry acquisition unit 332. The various types of processing are, for example, processing to create a data structure for transmitting various instructions and information received by the user reception unit 32. The various types of processing are, for example, processing to create a structure for transmitting information received by the user reception unit 35.
[0125] The location acquisition unit 331 acquires a location identifier that identifies the location of the user terminal 3. The location identifier is, for example, a location name and location information. The location acquisition unit 331 acquires the location information using, for example, a GPS receiver, and acquires the location identifier corresponding to the location information from map information. The map information may be stored in the user storage unit 31 or in an external device.
[0126] The inquiry acquisition unit 332 acquires, for example, an inquiry accepted by the user acceptance unit 32 .
[0127] The inquiry acquisition unit 332 acquires, for example, an inquiry including specific information using the location identifier acquired by the location acquisition unit 331. The inquiry acquisition unit 332 may acquire an inquiry accepted by the user acceptance unit 32.
[0128] The inquiry acquisition unit 332 acquires, for example, one location identifier input by the user, and acquires an inquiry having the one location identifier.
[0129] The inquiry acquisition unit 332 acquires, for example, a user identifier from the user storage unit 31 and acquires an inquiry having the user identifier.
[0130] The user transmission unit 34 transmits the inquiry acquired by the inquiry acquisition unit 332 to the information processing device 1 .
[0131] The user receiving unit 35 receives from the information processing device 1 a screen configured using videos of a plurality of locations including the location identified by the location identifier.
[0132] The user output unit 36 outputs one screen received by the user receiving unit 35. It is preferable that one screen contains videos of a plurality of comparison locations.
[0133] The storage unit 11, group management unit 111, terminal management unit 112, mobile storage unit 21, and user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0134] There is no restriction on the process by which information is stored in the storage unit 11 etc. For example, information may be stored in the storage unit 11 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 11 etc., or information input via an input device may be stored in the storage unit 11 etc.
[0135] The receiving unit 12, the location receiving unit 121, the inquiry receiving unit 122, the video receiving means 1313, the mobile receiving unit 22, and the user receiving unit 35 are typically realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.
[0136] The processing unit 13, video acquisition unit 131, screen composition unit 132, rights holder processing unit 133, terminal determination means 1311, ranking means 1321, composition means 1322, first security means 1331, second security means 1332, third security means 1333, fourth security means 1334, reward means 1335, movement processing unit 23, attribute value acquisition unit 233, composition unit 234, user processing unit 33, and inquiry acquisition unit 332 can typically be realized by a processor, memory, etc. The processing procedures of the processing unit 13, etc. are typically realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.
[0137] The instruction transmitting means 1312, the transmitting unit 14, the screen transmitting unit 141, the mobile transmitting unit 24, and the user transmitting unit 34 are usually realized by wireless or wired communication means, but may also be realized by broadcasting means.
[0138] The position acquisition unit 231 is realized by, for example, a GPS receiver.
[0139] The location acquisition unit 331 is realized by, for example, a communication module that receives a location identifier, or a GPS receiver.
[0140] The photographing unit 232 is realized by a camera.
[0141] The movement output unit 25 and the user output unit 36 may or may not include output devices such as a display, a speaker, etc. The movement output unit 25 may be realized by driver software for an output device, or by a combination of driver software for an output device and the output device, etc.
[0142] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen.
[0143] Next, an operation example of the information system A will be described. First, a first operation example of the information processing device 1 will be described using the flowchart in Fig. 4. The first operation example is a case where the information processing device 1 determines a mobile terminal 2 to which a video is to be transmitted.
[0144] (S401) The location receiving unit 121 determines whether or not location information, etc. has been received from the mobile terminal 2. If location information, etc. has been received, the process proceeds to S402, and if location information, etc. has not been received, the process proceeds to S403. The location information, etc. is, for example, the location information and a terminal identifier.
[0145] (S402) The processing unit 13 associates the location information received in S401 with the terminal identifier and stores the information in the terminal management unit 112. The process returns to S401.
[0146] (S403) The inquiry receiving unit 122 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S404, and if an inquiry has not been received, the process returns to S401. The received inquiry is associated with a user identifier.
[0147] (S404) Terminal determination unit 1311 determines a plurality of mobile terminals 2 to which to transmit the video corresponding to the received inquiry. An example of such terminal determination processing will be described with reference to the flowchart of FIG.
[0148] (S405) The instruction sending means 1312 acquires the terminal communication information of each of the plurality of mobile terminals 2 determined in S404 from the terminal management unit 112. Next, the instruction sending means 1312 sends a transmission instruction to the mobile terminal 2 that is the communication destination indicated by the plurality of terminal communication information. (S406) The video receiving means 1313 determines whether or not a video has been received from any one or more mobile terminals 2 to which a transmission instruction has been sent. If a video has been received, the process proceeds to S407, and if a video has not been received, the process returns to S406. The video receiving means 1313 receives the video in pair with the terminal identifier of the mobile terminal 2. The video receiving means 1313 may receive a video that is paired with one or more attribute values.
[0149] (S407) The video acquisition unit 131 pairs the video received in S406 with the terminal identifier and temporarily stores the paired video in a buffer (not shown). The video acquisition unit 131 may also pair the video received in S406 with one or more attribute values and temporarily store the paired video in a buffer (not shown).
[0150] (S408) The screen composition unit 132 composes a screen using the moving image temporarily stored in a buffer (not shown). An example of such screen composition processing will be described with reference to the flowchart in FIG.
[0151] (S409) The screen transmission unit 141 transmits the screen constructed in S408 to the user terminal 3 that sent the inquiry.
[0152] (S410) The processing unit 13 determines whether or not to end the transmission of the screen. If it is to end, the process proceeds to S411. If it is not to end, the process returns to S406. Note that the transmission of the screen is ended, for example, when an instruction to end the transmission is received from the user terminal 3.
[0153] (S411) The third security unit 1333 acquires the user identifier of the user terminal 3.
[0154] (S412) The third security means 1333 stores the video images of the screens continuously transmitted in S409 or the multiple video images that constitute the screens, paired with the user identifier acquired in S411. As a result, the rights holder of the video images of the screens continuously transmitted in S409 or the multiple video images that constitute the screens becomes the user identified by the user identifier. In other words, the user identifier is a rights holder identifier.
[0155] (S413) The fourth maintenance means 1334 performs a fourth maintenance process. An example of the fourth maintenance process will be described with reference to the flowchart in FIG.
[0156] (S414) The reward unit 1335 performs reward processing. Return to S401. An example of the reward processing will be described with reference to the flowchart in FIG. 9.
[0157] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt occurs to end the process.
[0158] Next, an example of the terminal determination process in S404 will be described with reference to the flowchart in FIG.
[0159] (S501) The terminal determining unit 1311 acquires the specific information included in the received inquiry.
[0160] (S502) Terminal determination unit 1311 uses the identification information to acquire location information for each of a plurality of comparison targets. An example of such comparison target location acquisition processing will be described with reference to the flowchart in FIG.
[0161] (S503) The terminal determination unit 1311 assigns 1 to a counter i.
[0162] (S504) The terminal determination unit 1311 determines whether the i-th location information to be compared obtained in S502 exists. If the i-th location information exists, the process proceeds to S505; if not, the process returns to the upper process.
[0163] (S505) The terminal determining unit 1311 assigns 1 to a counter j.
[0164] (S506) Terminal determination means 1311 determines whether or not location information of the jth mobile terminal 2 exists in terminal management unit 112. If the jth location information exists, proceed to S506; if not, proceed to S510.
[0165] (S507) The terminal determination means 1311 determines whether the location information of the ith comparison target and the location information of the jth mobile terminal 2 satisfy the location condition. If the location condition is satisfied, the process proceeds to S508; if not, the process proceeds to S510.
[0166] (S508) Terminal determination unit 1311 acquires the terminal identifier and location information of j-th mobile terminal 2 from terminal management unit 112, and stores them in a buffer (not shown).
[0167] (S509) The terminal determination unit 1311 increments the counter j by 1. The process returns to S506.
[0168] (S510) The terminal determination means 1311 determines one terminal identifier from the terminal identifiers accumulated in a buffer (not shown). Note that the terminal determination means 1311 determines, for example, one terminal identifier that pairs with the location information of the position closest to the position indicated by the i-th location information to be compared. The terminal determination means 1311 determines one terminal identifier, for example, randomly. Note that any algorithm may be used to determine one terminal identifier.
[0169] (S511) The terminal determination means 1311 increments the counter i by 1. The process returns to S504.
[0170] Next, an example of the comparison position acquisition process in S502 will be described with reference to the flowchart in FIG.
[0171] (S601) The terminal determination means 1311 determines whether the acquired specific information has multiple pieces of location information. If multiple pieces of location information are included, the process proceeds to S602. If multiple pieces of location information are not included, the process proceeds to S603. Note that if the specific information has multiple pieces of location information, the locations corresponding to the multiple pieces of location information are the locations to be compared.
[0172] (S602) Terminal determination unit 1311 acquires multiple pieces of location information contained in the acquired identification information, and returns to the upper-level processing.
[0173] (S603) The terminal determination unit 1311 determines whether the acquired specific information includes one piece of location information. If it does include one piece of location information, the process proceeds to S604; if it does not include location information, the process proceeds to S607.
[0174] (S604) The terminal determination unit 1311 uses the map information in the storage unit 11 to obtain a location identifier (for example, a place name or a store name) corresponding to the location information included in the obtained identification information.
[0175] (S605) Terminal determining unit 1311 obtains, from the group information in group management unit 111, one or more location identifiers that are paired with the location identifier obtained in S604.
[0176] (S606) The terminal determination means 1311 uses the map information in the storage unit 11 to obtain location information that pairs with each of the one or more location identifiers obtained in S605. The terminal determination means 1311 also obtains location information contained in the obtained specific information. The process returns to the upper level processing. As a result, the terminal determination means 1311 obtains multiple pieces of location information.
[0177] (S607) The terminal determination means 1311 determines whether the acquired specific information has multiple location identifiers. If it has multiple location identifiers, the process proceeds to S608. If it does not have multiple location identifiers, the process proceeds to S609. Note that if the specific information has multiple location identifiers, the locations identified by the multiple location identifiers are the locations to be compared.
[0178] (S608) The terminal determination unit 1311 acquires location information corresponding to each of the location identifiers included in the acquired identification information, using the map information in the storage unit 11. The process returns to the upper-level process.
[0179] (S609) The terminal determination unit 1311 determines whether the acquired specific information has one location identifier. If it has one location identifier, the process proceeds to S610. If it does not have a location identifier, the process proceeds to S612.
[0180] (S610) Terminal determination unit 1311 acquires the location identifier included in the acquired specific information. Terminal determination unit 1311 then acquires one or more other location identifiers that are paired with the acquired location identifier from the group information in group management unit 111.
[0181] (S611) Terminal determination unit 1311 uses the map information in storage unit 11 to obtain location information corresponding to the location identifier included in the obtained specific information and the one or more location identifiers obtained from group management unit 111. The process returns to the upper-level process.
[0182] (S612) The terminal determining unit 1311 acquires the user identifier included in the acquired specific information.
[0183] (S613) The terminal determination means 1311 acquires multiple location identifiers paired with the user identifier from the group management unit 111. The terminal determination means 1311 acquires location information corresponding to the acquired multiple location identifiers using the map information in the storage unit 11. The process returns to the upper-level process.
[0184] Next, an example of the screen configuration process in S408 will be described with reference to the flowchart in FIG.
[0185] (S701) The screen composition unit 132 assigns 1 to a counter i.
[0186] (S702) The screen composition unit 132 determines whether or not the i-th mobile terminal 2 exists among the mobile terminals 2 determined in S404. If the i-th mobile terminal 2 exists, the process proceeds to S703; if not, the process proceeds to S706.
[0187] (S703) The screen composition unit 132 acquires the video transmitted and stored by the i-th mobile terminal 2.
[0188] (S704) The screen composition unit 132 acquires one or more attribute values corresponding to the i-th mobile terminal 2.
[0189] (S705) The screen composition unit 132 increments the counter i by 1. The process returns to S702.
[0190] (S706) The ranking means 1321 obtains the rank of each of the plurality of mobile terminals 2 using one or more attribute values corresponding to the mobile terminal 2.
[0191] (S707) The composition unit 1322 composes a single screen in which the moving images acquired in S703 are arranged according to the ranking, and returns to the upper level processing.
[0192] The one screen is, for example, a screen on which the video transmitted from each mobile terminal 2 is displayed within a frame corresponding to each mobile terminal 2 transmitting the video.
[0193] Next, an example of the fourth maintenance process of S413 will be described with reference to the flowchart of FIG.
[0194] (S801) The fourth security unit 1334 acquires access information that identifies the storage destination of the video.
[0195] (S802) The fourth maintenance unit 1334 acquires a set of attribute values corresponding to the stored moving images.
[0196] (S803) The fourth security means 1334 constructs security information including the access information acquired in S801, the attribute value set acquired in S802, and the rights holder identifier of the video. If a new rights holder identifier has been acquired, the fourth security means 1334 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. (S804) The fourth security means 1334 stores the security information constructed in S803. The process returns to the upper level process.
[0197] In S804, if preservation information for a video corresponding to the preservation information to be stored has been stored, the preservation information configured in S803 is overwritten with the preservation information. This allows, for example, the transition of rights holders of the video to be managed. Furthermore, the fourth preservation unit 1334 stores the preservation information in a blockchain, for example.
[0198] Next, an example of the reward process in S414 will be described with reference to the flowchart in FIG.
[0199] (S901) The reward means 1345 assigns 1 to a counter i.
[0200] (S902) The reward unit 1345 determines whether the i-th video that was the basis for composing the screen exists. If the i-th video exists, the process proceeds to S903, and if not, the process returns to the upper process.
[0201] (S903) The reward means 1345 acquires a rights holder identifier paired with the target video.
[0202] (S904) The reward means 1345 acquires a set of attribute values of the target moving image.
[0203] (S905) The reward means 1345 acquires a reward amount using the attribute value set acquired in S904.
[0204] (S906) The reward unit 1345 performs processing to reward the right holder identified by the right holder identifier acquired in S903, in the amount of reward acquired in S905.
[0205] (S907) The remuneration unit 1345 performs processing to make the user corresponding to the user terminal 3 that received the screen pay a remuneration.
[0206] (S908) The reward means 1345 increments the counter i by 1. The process returns to S902.
[0207] Next, a second operation example of the information processing device 1 will be described using the flowchart of Fig. 10. The second operation example is a case where an inquiry is sent to all mobile terminals 2 managed by the information processing device 1. In the flowchart of Fig. 10, the description of the same steps as in the flowchart of Fig. 4 will be omitted.
[0208] (S1001) The inquiry receiving unit 122 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S1002, and if an inquiry has not been received, the process returns to S1001. Note that the received inquiry is associated with a user identifier.
[0209] (S1002) The transmitting unit 14 assigns 1 to a counter i.
[0210] (S1003) The transmission unit 14 determines whether or not the i-th terminal information exists in the terminal management unit 112. If the i-th terminal information exists, the process proceeds to S1004, and if not, the process proceeds to S1006.
[0211] (S1004) Transmitter 14 acquires terminal communication information included in the i-th terminal information from terminal manager 112. Transmitter 14 transmits an inquiry to the i-th mobile terminal 2 identified by the terminal communication information.
[0212] (S1005) The transmission unit 14 increments the counter i by 1. The process returns to S1003.
[0213] (S1006) Terminal determination unit 1311 acquires location information of each of a plurality of comparison targets using the specific information included in the received inquiry. An example of such comparison target location acquisition processing has been described with reference to the flowchart in FIG.
[0214] (S1007) Video receiving means 1313 determines whether or not video or the like has been received from any mobile terminal 2. If video or the like has been received, the process proceeds to S1008, and if not, the process returns to S1007.
[0215] (S1008) The video acquisition unit 131 acquires location information paired with the video received in S1007.
[0216] (S1009) The video acquisition unit 131 determines whether the location information acquired in S1008 satisfies the location condition of any of the location information acquired in S1006 that does not correspond to video. If the location condition is satisfied, the process proceeds to S1010; if not, the process proceeds to S1016.
[0217] (S1010) The video acquisition unit 131 stores the terminal identifier and the video in a buffer (not shown).
[0218] (S1011) Determine whether all of the location information acquired in S1006 is associated with video. If all of the location information is associated with video, proceed to S408, and if not all of the location information is associated with video, return to S1007.
[0219] In the flowchart of FIG. 10, the process ends when the power is turned off or an interrupt occurs to end the process.
[0220] Next, a first operation example of the mobile terminal 2 will be described using the flowchart in Fig. 11. The first operation example is a case where the information processing device 1 determines the mobile terminal 2 to which to transmit a video. In other words, the flowchart for the mobile terminal 2 in Fig. 11 corresponds to the flowchart for the information processing device 1 in Fig. 4.
[0221] (S1101) The mobile terminal 2 determines whether or not a start instruction has been received. If a start instruction has been received, the process proceeds to S1102, and if a start instruction has not been received, the process proceeds to S1101.
[0222] (S1102) The location acquisition unit 231 acquires the current location information of the mobile terminal 2.
[0223] (S1103) The movement processing unit 23 acquires a terminal identifier from the movement storage unit 21. Next, the movement processing unit 23 composes information including the terminal identifier and the location information acquired in S1102. The movement transmission unit 24 transmits the information to the information processing device 1.
[0224] (S1104) The movement processing unit 23 determines whether or not to end the process. If the process is to be ended, the process returns to S1101. If the process is not to be ended, the process proceeds to S1105. The process is ended, for example, when an end instruction is input by the user.
[0225] (S1105) The mobile receiving unit 22 determines whether or not a transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S1106, and if a transmission instruction has not been received, the process returns to S1102.
[0226] (S1106) The image capturing unit 232 acquires a video.
[0227] (S1107) The attribute value acquisition unit 233 acquires one or more attribute values. The composition unit 234 acquires a terminal identifier from the moving storage unit 21. The composition unit 234 associates one or more attribute values and a terminal identifier with the moving image to compose information to be transmitted. Note that each frame constituting the moving image is associated with, for example, time information acquired by the attribute value acquisition unit 233, position information acquired by the position acquisition unit 231, etc.
[0228] (S1108) The mobile transmission unit 24 transmits the video etc. constructed in S1107 to the information processing device 1. Return to S1104. Note that the length and amount of data of the video transmitted by the mobile transmission unit 24 at one time are not important.
[0229] 11, the photographing unit 232 starts photographing in response to receiving a transmission instruction. However, the photographing unit 232 may start photographing in response to receiving a start instruction.
[0230] In the flowchart of FIG. 11, the process ends when the power is turned off or an interrupt occurs to end the process.
[0231] Next, a second operation example of the mobile terminal 2 will be described using the flowchart in Fig. 12. The second operation example is a case where the mobile terminal 2 determines whether or not to transmit a video to the information processing device 1. In other words, the flowchart of the mobile terminal 2 in Fig. 12 corresponds to the flowchart of the information processing device 1 in Fig. 10.
[0232] (S1201) The mobile receiving unit 22 determines whether or not an inquiry has been received from the information processing device 1. If an inquiry has been received, the process proceeds to S1202, and if an inquiry has not been received, the process returns to S1201.
[0233] (S1202) The movement processing unit 23 performs a comparison position acquisition process. The comparison position acquisition process is the same as the process described with reference to the flowchart in FIG.
[0234] (S1203) The location acquisition unit 231 acquires the current location information of the mobile terminal 2.
[0235] (S1204) The movement processing unit 23 assigns 1 to the counter i.
[0236] (S1205) The movement processing unit 23 determines whether or not the i-th location information exists among the plurality of location information to be compared acquired in S1202. If the i-th location information exists, the process proceeds to S1206, and if not, the process returns to S1201.
[0237] (S1206) The movement processing unit 23 determines whether the location information acquired in S1203 and the i-th location information satisfy the location condition. If the location condition is satisfied, the process proceeds to S1207, and if the location condition is not satisfied, the process proceeds to S1211.
[0238] (S1207) The image capturing unit 232 acquires a video.
[0239] (S1208) Attribute value acquisition unit 233 acquires one or more attribute values. Composition unit 234 acquires a terminal identifier from moving storage unit 21. Composition unit 234 associates the one or more attribute values and the terminal identifier with the video, and composes information to be transmitted.
[0240] Each frame constituting the moving image is associated with, for example, time information acquired by the attribute value acquisition unit 233, position information acquired by the position acquisition unit 231, and the like.
[0241] (S1209) The mobile transmission unit 24 transmits the video and the like constructed in S1208 to the information processing device 1.
[0242] (S1210) The movement processing unit 23 determines whether or not to end the transmission of the video, etc. If the transmission of the video, etc. is to be ended, the process returns to S1201, and if the transmission of the video, etc. is not to be ended, the process returns to S1207. Note that the transmission of the video, etc. is ended, for example, when a transmission unnecessary command is received from the information processing device 1 or when an end instruction is received from the user of the mobile terminal 2.
[0243] (S1211) The movement processing unit 23 increments the counter i by 1. The process returns to S1205.
[0244] 12, before acquiring the video in S1207, the information processing device 1 may be inquired of whether or not to transmit the video. In such a case, the mobile transmission unit 24 transmits an inquiry including, for example, location information and other attribute values to the information processing device 1. Then, in response to the inquiry received from the current location information of multiple mobile terminals 2, the information processing device 1 determines, for each comparison location, one mobile terminal 2 to transmit the video to, based on the location information and other attribute values. This determination method may be the same as the operation at S510 in the flowchart of FIG. 5.
[0245] In the flowchart of FIG. 12, the process ends when the power is turned off or an interrupt occurs to end the process.
[0246] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.
[0247] (S1301) The user reception unit 32 determines whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to S1302, and if an inquiry has not been received, the process returns to S1301.
[0248] (S 1302 ) The user processing unit 33 acquires the user identifier from the user storage unit 31 .
[0249] (S1303) The inquiry acquisition unit 332 uses the inquiry received in S1301 to construct an inquiry to be sent. The inquiry to be sent is usually associated with a user identifier. The inquiry to be sent includes, for example, the location information acquired by the user processing unit 33 or the location identifier acquired by the location acquisition unit 331.
[0250] (S1304) The user transmission unit 34 transmits the inquiry constructed in S1303 to the information processing device 1.
[0251] (S1305) The user receiving unit 35 determines whether or not a screen has been received from the information processing device 1. If a screen has been received, the process proceeds to S1306, and if a screen has not been received, the process proceeds to S1307.
[0252] (S1306) User processing unit 33 creates a screen to be output based on the received screen. User output unit 36 outputs this screen.
[0253] (S1307) The user processing unit 33 determines whether or not to end the screen output. If the screen output is to be ended, the process returns to S1301. If the screen output is not to be ended, the process returns to S1305. Note that the screen output is ended, for example, when an end instruction is received from the user.
[0254] In the flowchart of Fig. 13, the process ends when the power is turned off or an interrupt occurs to end the process.
[0255] A specific example of the operation of the information system A in this embodiment will be described below.
[0256] Assume that the group management table shown in FIG. 14 is stored in the group management unit 111 of the information processing device 1. The group management table is a table for managing group information. The group management table is a table for managing information for determining multiple locations to be compared with specific information included in a received inquiry. The group information is the set of location identifiers shown in FIG. 14 , but it may also be considered to include specific information. The group management table manages records having an "ID," "specific information," and "set of location identifiers." The "ID" is information for identifying a record. Here, the "specific information" is, for example, a store name (supermarket name), location information (latitude, longitude), or a user identifier. The "set of location identifiers" is a set of location identifiers that identify each of multiple locations to be compared. Here, the location identifiers are the store name (supermarket name), location information (latitude, longitude), and location name (name of a location on a highway). Note that the store name is an example of a location name.
[0257] It is assumed that the terminal management unit 112 stores the terminal management table shown in Fig. 15. The terminal management table manages records having "ID" and "terminal information." The "terminal information" here includes "terminal identifier," "terminal communication information," and "location information." The "location information" is the latest location information of the mobile terminal 2.
[0258] It is assumed that, when the mobile terminal 2 is in a state where it is able to provide video, it continuously transmits its current location information, associated with its terminal identifier, to the information processing device 1. The location receiving unit 121 of the information processing device 1 receives the location information associated with the terminal identifier from each mobile terminal 2. The processing unit 13 then stores the location information in the terminal management table ( FIG. 15 ), associated with the terminal identifier.
[0259] Map information is stored in the storage unit 11 of the information processing device 1. The map information has store names paired with location information of the stores, and location names paired with location information of the locations.
[0260] In this situation, the following four specific examples will be described. Specific Example 1 is a case where a user inputs a location identifier (here, the name of a single store) that identifies multiple locations to be compared into a smartphone, and obtains videos of multiple locations, including locations identified by other location identifiers that are paired with the location identifier. Specific Example 2 is a case where a user presses a specific button in a specific app on the smartphone to obtain videos of each of the multiple locations to be compared. Specific Example 3 is a case where a user inputs a user identifier on the screen of a specific app on the smartphone and then presses a button to obtain videos of each of the multiple locations to be compared. Specific Example 4 is a case where, when a user passes a specific point while traveling by car, a video is output to a navigation device to show the conditions of multiple roads that branch off after passing the specific point.
[0261] (Specific Example 1) It is assumed that a user launches an app on the user terminal 3. The app is capable of acquiring and outputting videos of multiple comparison locations. Next, the app is launched on the user terminal 3. The user terminal 3 then outputs a screen for inputting specific information. Note that this screen has a field for inputting specific information and a "send" button. The "send" button is a button for sending an inquiry to the information processing device 1.
[0262] Next, the user inputs the specific information "Supermarket A" on the screen and presses the "Send" button.
[0263] Then, the user receiving unit 32 of the user terminal 3 receives the query "<specific information> Supermarket A". Next, the user processing unit 33 obtains the user identifier "U001" from the user storage unit 31. The query obtaining unit 332 uses the received query to construct a query to be sent, "<user identifier> U001 <specific information> Supermarket A". Next, the user sending unit 34 sends the query to the information processing device 1.
[0264] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry “<user identifier> U001 <specific information> Supermarket A” from the user terminal 3 .
[0265] Next, the terminal determination means 1311 acquires the specific information "Supermarket A" contained in the received inquiry. The terminal determination means 1311 acquires the location identifier set "Supermarket B, Supermarket C, Supermarket D" that pairs with the specific information "Supermarket A" from the group management table (FIG. 14). Next, the terminal determination means 1311 acquires the location information of "Supermarket A, Supermarket B, Supermarket C, Supermarket D" by referring to the map information in the storage unit 11. The location information of each of these four supermarkets is calculated as follows: (x 21 , y 21 ) (x 22 , y 22 ) (x 23 , y 23 ) (x 24 , y 24). Next, the terminal determination means 1311 determines the location information of the mobile terminal 2 that satisfies the location condition for the location information of each of the four supermarkets (that is, that is located in that supermarket) from the terminal management table (FIG. 15). Here, it is assumed that the terminal determination means 1311 has acquired the terminal identifier "T001" of the mobile terminal 2 that is located in supermarket A, the terminal identifier "T002" of the mobile terminal 2 that is located in supermarket B, the terminal identifier "T003" of the mobile terminal 2 that is located in supermarket C, and the terminal identifier "T004" of the mobile terminal 2 that is located in supermarket D from the terminal management table (FIG. 15).
[0266] Next, the instruction sending means 1312 acquires the terminal communication information paired with each of the acquired four terminal identifiers from the terminal management table (FIG. 15). Next, the instruction sending means 1312 transmits a transmission instruction to the mobile terminal 2, which is the communication destination indicated by each of the four pieces of terminal communication information.
[0267] Next, the mobile receiving unit 22 of each of the four mobile terminals 2 receives a transmission instruction from the information processing device 1. Next, the photographing unit 232 acquires the video. Furthermore, the attribute value acquisition unit 233 acquires one or more attribute values. Here, it is assumed that the attribute value acquisition unit 233 acquires an attribute value that is the price of a product in the video. Furthermore, the configuration unit 234 acquires a terminal identifier from the mobile storage unit 21. The configuration unit 234 associates one or more attribute values and a terminal identifier with the video to configure information to be transmitted. Next, the mobile transmitting unit 24 transmits the video, etc. to the information processing device 1.
[0268] Next, the video receiving means 1313 of the information processing device 1 receives the video etc. from each of the four mobile terminals 2 to which the transmission instruction was sent. The video etc. has one or more attribute values including the price of the product in the video, and a terminal identifier. Next, the video acquisition unit 131 pairs the received video and attribute values with the terminal identifier for each of the four mobile terminals 2, and temporarily stores them in a buffer (not shown).
[0269] Next, the ranking means 1321 obtains a rank (a natural number from "1" to "4") for each of the four mobile terminals 2 in order of lowest price using the prices corresponding to the mobile terminals 2. Next, the configuration means 1322 constructs a screen in which each of the four obtained videos is arranged from top to bottom according to its ranking. The configuration means 1322 also constructs a screen including a map showing the locations of the four places (supermarkets) to be compared. The configuration means 1322 also constructs a screen having information listing the attribute values (here, prices) of the four places to be compared in order of rank. The configuration means 1322 also constructs a screen including the current time obtained from a clock (not shown).
[0270] Next, the screen transmission unit 141 transmits the screen constructed by the screen construction unit 132 to the user terminal 3 that has transmitted the inquiry.
[0271] Next, the user receiving unit 35 of the user terminal 3 receives the screen from the information processing device 1. Next, the user processing unit 33 creates a screen to be output based on the received screen. The user output unit 36 outputs the screen. An example of such a screen is shown in FIG. 16. In FIG. 16, 1601 to 1604 are windows in which videos taken inside each supermarket are output. The videos are arranged in order of the ranking of each supermarket. 1605 is the ranking result of the attribute value (here, price). 1606 shows the locations of the four supermarkets on a map.
[0272] Through the above process, the user can obtain multiple super videos that he or she wishes to compare, and can also obtain a screen according to the ranking of each of the multiple videos.
[0273] (Specific Example 2) Assume that a user launches an app on the user terminal 3. The app is capable of acquiring and outputting videos of multiple comparison locations. Next, the app is launched on the user terminal 3, and a screen is output. Note that this screen has a "Send" button. Also, this screen does not have any components such as fields for inputting specific information. The "Send" button is a button for sending an inquiry to the information processing device 1.
[0274] Next, the user presses the "Send" button on the screen. Then, the location acquisition unit 331 of the user terminal 3 receives location information (x 21 , y 21 Next, the user receiving unit 32 acquires the position information (x 21 , y 21 Next, the user processing unit 33 acquires the user identifier "U001" from the user storage unit 31. The inquiry acquisition unit 332 uses the received inquiry to generate the inquiry to be sent, "<user identifier>U001 <specific information> (x 21 , y 21 Next, the user transmission unit 34 transmits the inquiry to the information processing device 1.
[0275] Next, the inquiry receiving unit 122 of the information processing device 1 receives an inquiry from the user terminal 3, “<user identifier> U001 <specific information> (x 21 , y 21 ) is received.
[0276] Next, the terminal determination means 1311 determines the specific information (x 21 , y 21 The terminal determination unit 1311 acquires the specific information (x 21 , y 21 ) and the set of location identifiers (x 22 , y 22 ) (x 23 , y 23 ) (x 24 , y 24 ) from the group management table (FIG. 14). Next, the terminal determination means 1311 obtains each of the four pieces of location information (x 21 , y 21 ) (x 22 , y 22 ) (x 23 , y 23 ) (x 24 , y 24 ) is determined from the terminal management table (FIG. 15). 21 , y 21 ) (x 22 , y 22 ) (x 23 , y 23) (x 24 , y 24 ) are the location information of supermarket A, supermarket B, supermarket C, and supermarket D, respectively. Also, it is assumed that terminal determination means 1311 has acquired terminal identifier "T001" of mobile terminal 2 located in supermarket A, terminal identifier "T002" of mobile terminal 2 located in supermarket B, terminal identifier "T003" of mobile terminal 2 located in supermarket C, and terminal identifier "T004" of mobile terminal 2 located in supermarket D from the terminal management table (FIG. 15). Next, instruction sending means 1312 sends a transmission instruction to each of the four mobile terminals 2.
[0277] Next, each of the four mobile terminals 2 transmits video or the like to the information processing device 1 by the same operation as that described in the first specific example.
[0278] Next, the information processing device 1 receives the video or the like by the same operation as that described in the specific example 1, composes a screen based on the video or the like, and transmits the screen to the user terminal 3.
[0279] Next, the user terminal 3 receives and outputs the screen in the same manner as described in Example 1. An example of such output is shown in FIG.
[0280] (Specific Example 3) It is assumed that a user launches an app on the user terminal 3. The app is capable of acquiring and outputting videos of multiple comparison locations. Next, the app is launched on the user terminal 3. The user terminal 3 then outputs a screen for inputting specific information. Note that this screen has a field for inputting specific information and a "send" button. The "send" button is a button for sending an inquiry to the information processing device 1.
[0281] Next, the user inputs specific information "U101" into the screen and selects the "Send" button. Note that the specific information "U101" is a user identifier.
[0282] Then, the user receiving unit 32 of the user terminal 3 receives the inquiry "<specific information> U101". Next, the user transmitting unit 34 transmits the inquiry "<specific information> U101" to the information processing device 1. Note that the inquiry may include "<user identifier> U101".
[0283] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry “<specific information> U101” from the user terminal 3 .
[0284] Next, the terminal determination means 1311 acquires the specific information "U101" contained in the received inquiry. The terminal determination means 1311 acquires the location identifier set "Supermarket A, Supermarket B, Supermarket C, Supermarket D" that pairs with the specific information "U101" from the group management table (FIG. 14). Next, the terminal determination means 1311 acquires the location information of "Supermarket A, Supermarket B, Supermarket C, Supermarket D" by referring to the map information in the storage unit 11. The location information of each of these four supermarkets is (x 21 , y 21 ) (x 22 , y 22 ) (x 23 , y 23 ) (x 24 , y 24 ). Next, the terminal determination means 1311 determines the location information of the mobile terminal 2 (located in the supermarket) that satisfies the location condition for the location information of each of the four supermarkets from the terminal management table (FIG. 15). Here, it is assumed that the terminal determination means 1311 has acquired the terminal identifier "T001" of the mobile terminal 2 located in supermarket A, the terminal identifier "T002" of the mobile terminal 2 located in supermarket B, the terminal identifier "T003" of the mobile terminal 2 located in supermarket C, and the terminal identifier "T004" of the mobile terminal 2 located in supermarket D from the terminal management table (FIG. 15).
[0285] Next, the instruction sending means 1312 acquires the terminal communication information paired with each of the acquired four terminal identifiers from the terminal management table (FIG. 15). Next, the instruction sending means 1312 transmits a transmission instruction to the mobile terminal 2, which is the communication destination indicated by each of the four pieces of terminal communication information.
[0286] Next, each of the four mobile terminals 2 transmits video or the like to the information processing device 1 by the same operation as that described in the first specific example.
[0287] Next, the information processing device 1 receives the video or the like by the same operation as that described in the specific example 1, composes a screen based on the video or the like, and transmits the screen to the user terminal 3.
[0288] Next, the user terminal 3 receives and outputs the screen in the same manner as described in Example 1. An example of such output is shown in FIG.
[0289] (Specific Example 4) In specific example 4, the terminal management table ( FIG. 15 ) manages terminal information including location information transmitted from a mobile terminal 2 mounted on an automobile. The mobile terminal 2 is, for example, a drive recorder or a navigation terminal.
[0290] It is assumed that the user, while driving a car, passes a point just before the junction between the outbound Tomei Expressway and the outbound Shin-Tomei Expressway. Then, the location acquisition unit 331 of the user terminal 3, which is the navigation terminal of the car, acquires the location information (x 31 , y 31 ) has been acquired. Next, the query acquisition unit 332 determines that the location information satisfies a predetermined condition with respect to the location information for constructing a query stored in the user storage unit 31 (for example, matches, or the distance is within a threshold). Next, the query acquisition unit 332 acquires the specific information (x 31 , y 31 ) and the user identifier of the user storage unit 31. Next, the user transmission unit 34 generates a query including the query "<user identifier>U001 <specific information> (x 31 , y 31 )) to the information processing device 1. Note that the user terminal 3 may continuously acquire location information and continuously transmit inquiries including the location information to the information processing device 1.
[0291] Next, the inquiry receiving unit 122 of the information processing device 1 receives an inquiry from the user terminal 3, “<user identifier> U001 <specific information> (x 31 , y 31 ) is received.
[0292] Next, the terminal determination means 1311 determines the specific information (x 31 , y 31 The terminal determination unit 1311 acquires the specific information (x 31 , y 31) from the group management table (FIG. 14). Next, the terminal determination means 1311 refers to the map information in the storage unit 11 and acquires each piece of location information for "X point on the outbound side of the Tomei Expressway, Y point on the outbound side of the Shin-Tomei Expressway." The location information for each point on each of these two expressways is respectively (x h1 , y h1 ) (x h2 , y h2 Next, the terminal determination unit 1311 determines the position information (x h1 , y h1 ) (x h2 , y h2 ) from the terminal management table (FIG. 15). Here, it is assumed that the terminal determination means 1311 acquires the terminal identifier "T001" of the mobile terminal 2 traveling on "Point X on the outbound Tomei Expressway" and the terminal identifier "T002" of the mobile terminal 2 traveling on "Point Y on the outbound Shin-Tomei Expressway" from the terminal management table (FIG. 15).
[0293] Next, the instruction sending means 1312 acquires the terminal communication information paired with each of the two acquired terminal identifiers from the terminal management table (FIG. 15). Next, the instruction sending means 1312 transmits a transmission instruction to the mobile terminal 2, which is the communication destination indicated by each of the two pieces of terminal communication information.
[0294] Next, the mobile receiving unit 22 of each of the two mobile terminals 2 receives a transmission instruction from the information processing device 1. Next, the photographing unit 232 acquires the video. Furthermore, the attribute value acquisition unit 233 acquires one or more attribute values. Here, it is assumed that the attribute value acquisition unit 233 acquires the number of cars in the video and the attribute value indicating the congestion level based on the number of cars. Furthermore, the configuration unit 234 acquires a terminal identifier from the mobile storage unit 21. The configuration unit 234 associates one or more attribute values and a terminal identifier with the video to configure information to be transmitted. Next, the mobile transmitting unit 24 transmits the video, etc. to the information processing device 1.
[0295] Next, the video receiving means 1313 of the information processing device 1 receives the video etc. from each of the two mobile terminals 2 to which the transmission instruction was sent. The video etc. includes the number of cars in the video, the congestion level, and the terminal identifier. Next, the video acquisition unit 131 pairs the received video and attribute value with the terminal identifier for each of the two mobile terminals 2, and temporarily stores them in a buffer (not shown).
[0296] Next, the ranking means 1321 obtains a rank ("1" or "2") for each of the two mobile terminals 2 in ascending order of congestion level using the congestion level corresponding to the mobile terminal 2. Next, the configuration means 1322 configures a screen in which each of the two obtained videos is arranged according to the ranking. The screen also includes information including the names of expressways and the congestion level of each road.
[0297] Next, the screen transmission unit 141 transmits the screen constructed by the screen construction unit 132 to the user terminal 3 that has transmitted the inquiry.
[0298] Next, the user receiving unit 35 of the user terminal 3 receives the screen from the information processing device 1. Next, the user processing unit 33 composes a screen to be output based on the received screen. The user processing unit 33 composes a single screen that combines the information of the received screen and the information of the screen being output. The screen being output is a map during navigation.
[0299] Next, the user output unit 36 outputs the screen. An example of such a screen is shown in Fig. 17. In Fig. 17, 1701 is a map displayed on the navigation terminal, which is the user terminal 3, and an icon 1702 of the user's car is displayed at the position of the road on which the user is traveling. Also, a video 1703 with a rank of "1" is arranged in the center of the screen, and a video 1704 with a rank of "2" is arranged on the left side of the screen. Also, 1705 shows the degree of congestion on each road.
[0300] By outputting the screen of FIG. 17, the user can select an appropriate expressway from among a plurality of expressways before a fork in the road, and continue driving.
[0301] As described above, according to this embodiment, videos of a plurality of locations to be compared can be provided.
[0302] Furthermore, according to this embodiment, ranked videos can be provided.
[0303] The processing in this embodiment may be implemented by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software implementing the information processing device 1 in this embodiment is the following program. That is, this program causes a computer to function as: an inquiry receiving unit that receives, from a user terminal, an inquiry including specific information that identifies multiple locations to be compared; a video acquiring unit that acquires videos transmitted from mobile terminals located in each of the multiple locations identified by the specific information; a screen composing unit that uses the multiple videos to compose a single screen; and a screen transmitting unit that transmits the single screen to the user terminal.
[0304] (Second embodiment) <Outline of second embodiment>
[0305] The present embodiment differs from the first embodiment in that the mobile terminal 2 constantly transmits videos to the information processing device. In the second embodiment, when the information processing device receives a query, it retrieves videos of multiple comparison locations corresponding to the query from the stored videos. <Outline of Information System B>
[0306] The conceptual diagram of the information system B in this embodiment is the same as that of the information system A except for the reference numerals of the devices.
[0307] Fig. 18 is a block diagram of information system B in this embodiment. Details of mobile terminal 2 and user terminal 3 are omitted from Fig. 18. Details of right holder processing unit 133 are also omitted from Fig. 18.
[0308] The information system B includes an information processing device 4 , one or more mobile terminals 2 , and one or more user terminals 3 .
[0309] The information processing device 4 includes a storage unit 41, a receiving unit 42, a processing unit 43, and a transmission unit 14. The storage unit 41 includes a group management unit 111, a terminal management unit 112, and a video storage unit 411. The receiving unit 42 includes an inquiry receiving unit 122 and a video receiving unit 421. The processing unit 43 includes a video accumulation unit 431, a video acquisition unit 432, a screen composition unit 132, and a right holder processing unit 133. <Details of components of the information processing device 4>
[0310] Various types of information are stored in the storage unit 41. The various types of information include, for example, group information, terminal information, videos, one or more attribute values associated with the videos, and map information.
[0311] The video storage unit 411 stores one or more videos. A user identifier is usually associated with each video. For example, one or more attribute values are associated with each video. For example, time information and position information are associated with each frame that constitutes a video.
[0312] The video receiving unit 421 receives videos associated with location information from each of the multiple mobile terminals 2. The location information is typically (latitude, longitude), but may also be a location identifier such as a location name. The video receiving unit 421 continuously acquires videos from each of the multiple mobile terminals 2. Such videos are typically additional videos.
[0313] The processing unit 43 performs various types of processing, such as processing performed by the video storage unit 431, the video acquisition unit 432, the screen composition unit 132, or the rights holder processing unit 133.
[0314] The video accumulation unit 431 accumulates the video received by the video receiving unit 421. The video accumulation unit 431 normally accumulates the video in association with the terminal identifier of the mobile terminal 2. The video accumulation unit 431 normally accumulates the video in the video storage unit 411. Each frame constituting the video accumulated by the video accumulation unit 431 is normally associated with position information.
[0315] The video acquisition unit 432 acquires videos transmitted from the mobile terminals 2 present at the locations specified by the specific information contained in the received inquiry.
[0316] The video acquisition unit 432 acquires a video associated with location information corresponding to each of the multiple locations identified by the identification information from among the multiple videos stored in the video storage unit 431. The video acquisition unit 432 acquires a video associated with location information corresponding to each of the multiple locations identified by the identification information from among the multiple videos in the video storage unit 411, for example. <Explanation of Components of Mobile Terminal 2>
[0317] Here, the mobile receiving unit 22 of the mobile terminal 2 does not receive a transmission instruction. The mobile transmitting unit 24 of the mobile terminal 2 continuously transmits the video to the information processing device 4. Note that continuously transmitting means transmitting two or more times. Continuously transmitting means, for example, transmitting constantly, transmitting periodically, or transmitting two or more times irregularly.
[0318] The storage unit 41 and the video storage unit 411 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0319] There is no restriction on the process by which information is stored in the storage unit 41 etc. For example, information may be stored in the storage unit 41 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 41 etc., or information input via an input device may be stored in the storage unit 41 etc.
[0320] The receiving unit 42 and the video receiving unit 421 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.
[0321] The processing unit 43, video storage unit 431, and video acquisition unit 432 can usually be realized by a processor, memory, etc. The processing procedures of the processing unit 43, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter. <Operation>
[0322] Next, an example of the operation of the information processing device 4 will be described with reference to the flowchart of Fig. 19. In the flowchart of Fig. 19, the description of the same steps as those in the flowchart of Fig. 4 will be omitted.
[0323] (S1901) The video receiving unit 421 determines whether or not video or the like has been received from one or more mobile terminals 2. If video or the like has been received, the process proceeds to S1902, and if video or the like has not been received, the process proceeds to S403.
[0324] (S1902) Video accumulation unit 431 accumulates one or more videos in video storage unit 411 in association with the terminal identifier.
[0325] (S1903) Video acquisition unit 432 determines videos of multiple locations corresponding to the inquiry from among the videos stored in video storage unit 411. An example of such video determination processing will be described with reference to the flowchart in FIG.
[0326] (S1904) The video acquisition unit 432 acquires the videos and the like identified by the multiple video identifiers determined in S1903 from the video storage unit 411. Then, the process proceeds to S408.
[0327] In the flowchart of FIG. 19, the process ends when the power is turned off or an interrupt occurs to end the process.
[0328] Next, an example of the video selection process in S1903 will be described with reference to the flowchart in Fig. 20. In the flowchart in Fig. 20, the description of the same steps as in the flowchart in Fig. 5 will be omitted.
[0329] (S2001) The video acquisition unit 432 determines whether or not the jth video exists in the video storage unit 411. If the jth video exists, the process proceeds to S2002, and if not, the process returns to the upper processing.
[0330] (S2002) The video acquisition unit 432 determines whether the jth location information and the latest location information associated with the jth video in the video storage unit 411 satisfy the location condition. If the location condition is satisfied, the process proceeds to S2003; if the location condition is not satisfied, the process proceeds to S509.
[0331] (S2003) Video acquisition unit 432 acquires a video identifier that identifies the j-th video, and temporarily stores the video identifier in a buffer (not shown) in association with the i-th position information.
[0332] (S2004) The video acquisition unit 432 determines one video identifier from one or more video identifiers associated with the i-th location information. Note that the video acquisition unit 432 determines, for example, one video identifier of location information that minimizes the distance between the position indicated by the location information paired with the video identifier and the position indicated by the i-th location information.
[0333] As described above, according to this embodiment, videos of a plurality of locations to be compared can be provided.
[0334] Furthermore, according to this embodiment, ranked videos can be provided.
[0335] The software that realizes the information processing device 4 in this embodiment is the following program. That is, this program causes a computer to function as an inquiry receiving unit that receives, from a user terminal, an inquiry including specific information that identifies multiple locations to be compared, a video acquiring unit that acquires videos transmitted from mobile terminals located in each of the multiple locations identified by the specific information, a screen composing unit that uses the multiple videos to compose a single screen, and a screen transmitting unit that transmits the single screen to the user terminal.
[0336] 21 shows the appearance of a computer that executes the programs described in this specification to realize the information processing device 1 and the like according to the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 21 is an overview of this computer system 300, and FIG. 22 is a block diagram of the system 300.
[0337] In FIG. 21, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.
[0338] 22, in addition to a CD-ROM drive 3012, the computer 301 includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 etc., a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions for application programs and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Although not shown here, the computer 301 may further include a network card for providing connection to a LAN.
[0339] A program that causes computer system 300 to execute the functions of information processing device 1 and the like of the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and then transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may also be loaded directly from CD-ROM 3101 or the network.
[0340] The program does not necessarily have to include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-described embodiment. The program only needs to include instructions that call appropriate functions (modules) in a controlled manner and achieve the desired results. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.
[0341] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).
[0342] The computer that executes the program may be a single computer or a plurality of computers, that is, it may perform centralized processing or distributed processing.
[0343] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be physically realized by one medium.
[0344] Furthermore, in each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.
[0345] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention.
[0346] As described above, the information processing device 1 according to the present invention has the effect of being able to provide videos of a plurality of locations to be compared, and is useful as a server or the like that provides videos.
Claims
1. An inquiry receiving unit that receives an inquiry including specific information for specifying a plurality of locations to be compared from a user terminal, An image acquisition unit that acquires images transmitted from mobile terminals existing at each of the plurality of locations specified by the specific information, A screen configuration unit that configures one screen using the plurality of images, An information processing apparatus comprising a screen transmission unit that transmits the one screen to the user terminal.
2. The image acquisition unit, refers to a group management unit in which one or more groups of information including location identifiers for identifying each of the plurality of locations to be compared are stored, acquires a plurality of location identifiers corresponding to the specific information included in the inquiry, and acquires the images received from the mobile terminals existing at each of the plurality of locations identified by the plurality of location identifiers. The information processing apparatus according to claim 1.
3. The image acquisition unit, transmits an image transmission instruction to the mobile terminals existing at each of the plurality of locations specified by the specific information, and receives an image from the mobile terminals in response to the transmission of the transmission instruction. The information processing apparatus according to claim 1 or claim 2.
4. Further comprising a position receiving unit that receives position information from each of the plurality of mobile terminals, The image acquisition unit, terminal determination means for determining mobile terminals existing at each of the plurality of locations specified by the specific information using the position information received by the position receiving unit, instruction transmission means for transmitting the transmission instruction to each of the plurality of mobile terminals determined by the terminal determination means, The information processing apparatus according to claim 3, comprising image receiving means for receiving images from each of the plurality of mobile terminals.
5. The image acquisition unit, instruction transmission means for transmitting an inquiry based on the specific information to a plurality of mobile terminals, The information processing apparatus according to claim 1 or claim 2, comprising image receiving means for receiving images from each of the plurality of mobile terminals determined to correspond to the specific information in response to the transmission of the inquiry.
6. An image receiving unit that receives images associated with position information from a plurality of mobile terminals, Further comprising an image storage unit that stores the plurality of images in association with the position information, The image acquisition unit, acquires images associated with position information corresponding to each of the plurality of locations specified by the specific information from among the plurality of images stored by the image storage unit. The information processing apparatus according to claim 1 or claim 2.
7. The screen configuration unit, Ranking means for acquiring the attribute values of each of the plurality of images and ranking the plurality of images using the attribute values; The information processing apparatus according to claim 1, further comprising configuration means for configuring the one screen according to the ranking of each of the plurality of images.
8. The information processing apparatus according to claim 1, further comprising third preservation means for accumulating the plurality of images or the one screen including the plurality of images in association with a rights holder identifier for identifying a user of the user terminal.
9. A location acquisition unit for acquiring a location identifier for specifying the location of a user terminal; An inquiry acquisition unit for acquiring an inquiry including specific information using the location identifier; A user transmission unit for transmitting the inquiry to an information processing apparatus; A user reception unit for receiving from the information processing apparatus a single screen configured using images of a plurality of locations including the location identified by the location identifier; A user terminal comprising a user output unit for outputting the one screen.
10. An inquiry acquisition unit for acquiring an inquiry including specific information including a user identifier; A user transmission unit for transmitting the inquiry to an information processing apparatus; A user reception unit for receiving from the information processing apparatus a single screen configured using images of a plurality of locations identified by a plurality of location identifiers corresponding to the user identifier; A user terminal comprising a user output unit for outputting the one screen.
11. An information processing method realized by an inquiry reception unit, an image acquisition unit, a screen configuration unit, and a screen transmission unit, comprising: An inquiry reception step in which the inquiry reception unit receives from a user terminal an inquiry including specific information for specifying a plurality of locations to be compared; An image acquisition step in which the image acquisition unit acquires images transmitted from mobile terminals existing at each of the plurality of locations specified by the specific information; A screen configuration step in which the screen configuration unit configures a single screen using the plurality of images; An information processing method comprising a screen transmission step in which the screen transmission unit transmits the one screen to the user terminal.