Information processing device, user terminal, and information processing method
The information processing device addresses the lack of video comparison across multiple locations by acquiring, ranking, and securely transmitting videos from mobile terminals to user terminals, while rewarding rights holders, thus improving user experience and video management.
Patent Information
- Application Number
- JP2024574191
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-02-02
- Publication Date
- 2025-09-30
- Estimated Expiration
- 2043-02-02
AI Technical Summary
Existing systems fail to provide video comparison of multiple locations, such as supermarkets, department stores, or expressways, by identifying and accessing information about specified advertising products.
An information processing device that receives inquiries specifying multiple locations, acquires videos from mobile terminals at those locations, composes a single screen, and transmits it to a user terminal, incorporating features like video ranking and security processing to manage and reward rights holders.
Enables easy comparison of videos from multiple locations, ensuring secure video transmission and rewarding rights holders, thereby enhancing user experience and video management.
Smart Images

Figure 0007746610000001 
Figure 0007746610000002 
Figure 0007746610000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device or the like that provides images of a plurality of locations to be compared. [Background technology]
[0002] Conventionally, there has been a system that includes a terminal on which a viewer watches a video, an advertising video distribution server that distributes advertising video content including advertising products to the terminal, and an advertising product database that stores image information of the advertising products; when a viewer specifies an advertising product in a video by performing a predetermined instruction operation on the terminal receiving the advertising video content, the system compares the image information of the advertising product in the video with the image information of the advertising product registered in the advertising product database, and identifies information about the specified advertising product, making it possible to access the information provider of the specified advertising product from the terminal (see Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2005-286882 Summary of the Invention [Problem to be solved by the invention]
[0004] However, in the prior art, it was not possible to obtain video of multiple locations to be compared. The multiple locations to be compared could be, for example, supermarkets (e.g., supermarkets A and B), department stores (e.g., department stores X, Y, and Z), or expressways (e.g., the Meishin Expressway and the Keiji Bypass), but the types of locations are not important. [Means for solving the problem]
[0005] The information processing device of the first invention is an information processing device that includes an inquiry receiving unit that receives an inquiry from a user terminal including specific information that identifies multiple locations to be compared, a video acquisition unit that acquires videos transmitted from mobile terminals located in each of the multiple locations identified by the specific information, a screen composition unit that uses the multiple videos to construct a single screen, and a screen transmission unit that transmits the single screen to the user terminal.
[0006] With this configuration, videos of multiple locations can be obtained for comparison.
[0007] In addition, the information processing device of the second invention is an information processing device in which, compared to the first invention, the video acquisition unit refers to a group management unit in which one or more group information including location identifiers that identify each of a plurality of locations to be compared is stored, acquires a plurality of location identifiers corresponding to the specific information included in the query, and acquires videos received from mobile terminals located in each of the plurality of locations identified by the plurality of location identifiers.
[0008] With this configuration, videos of multiple locations to be compared can be easily obtained.
[0009] Furthermore, the information processing device of the third invention is an information processing device in which, compared to the first or second invention, the video acquisition unit transmits a video transmission instruction to a mobile terminal located at each of multiple locations identified by the specific information, and receives the video from the mobile terminal in response to the transmission of the transmission instruction.
[0010] With this configuration, videos of multiple locations can be obtained for comparison.
[0011] Furthermore, the information processing device of the fourth invention is an information processing device that, compared to the third invention, further includes a location receiving unit that receives location information from each of a plurality of mobile terminals, and the video acquisition unit includes a terminal determination means that uses the location information received by the location receiving unit to determine a mobile terminal that is present at each of a plurality of locations identified by the specific information, an instruction sending means that sends a transmission instruction to each of the plurality of mobile terminals determined by the terminal determination means, and a video receiving means that receives video from each of the plurality of mobile terminals.
[0012] With this configuration, videos of multiple locations can be obtained for comparison.
[0013] In addition, the information processing device of the fifth invention is an information processing device in which, compared to the third invention, the video acquisition unit includes an instruction sending means for sending an inquiry based on specific information to a plurality of mobile terminals, and a video receiving means for receiving video from each of a plurality of mobile terminals that has been determined to correspond to the specific information in response to the sending of the inquiry.
[0014] With this configuration, videos of multiple locations can be obtained for comparison.
[0015] In addition, the information processing device of the sixth invention, compared to the first or second invention, further includes a video receiving unit that receives videos corresponding to location information from a plurality of mobile terminals, and a video storage unit that stores each of the plurality of videos in association with the location information, and the video acquisition unit is an information processing device that acquires videos corresponding to location information corresponding to each of the plurality of locations identified by the specific information from the plurality of videos stored in the video storage unit.
[0016] With this configuration, videos of multiple locations can be obtained for comparison.
[0017] In addition, the information processing device of the seventh invention is an information processing device in which, compared to any one of the first to sixth inventions, the screen composition unit is equipped with a ranking means for acquiring attribute values of each of a plurality of videos and ranking the plurality of videos using the attribute values, and a composition means for composing a screen according to the ranking of each of the plurality of videos.
[0018] With this configuration, ranked videos can be obtained. In addition, the information processing device of the seventh invention is an information processing device that, with respect to any one of the first to sixth inventions, further comprises a third security means for storing multiple videos or a screen containing multiple videos in association with a rights holder identifier that identifies the user of the user terminal. With this configuration, the rights holder of the video can be the user who needs the video.
[0019] In addition, the user terminal of the ninth invention is a user terminal that includes a location acquisition unit that acquires a location identifier that identifies the location of the user terminal, a query acquisition unit that acquires a query that includes specific information using the location identifier, a user transmission unit that transmits the query to an information processing device, a user receiving unit that receives from the information processing device a single screen that is composed of videos of multiple locations including the location identified by the location identifier, and a user output unit that outputs the single screen.
[0020] With this configuration, videos of multiple locations to be compared can be easily obtained.
[0021] Furthermore, the user terminal of the tenth invention is a user terminal that includes an inquiry acquisition unit that acquires an inquiry including specific information including a user identifier, a user transmission unit that transmits the inquiry to an information processing device, a user receiving unit that receives from the information processing device a single screen that is composed of videos of multiple locations identified by multiple location identifiers that correspond to the user identifier, and a user output unit that outputs the single screen.
[0022] With this configuration, videos of multiple locations to be compared can be easily obtained. [Effects of the Invention]
[0023] According to the information processing device of the present invention, videos of a plurality of locations to be compared can be provided. [Brief explanation of the drawings]
[0024] [Figure 1] Conceptual diagram of information system A in embodiment 1 [Figure 2] Block diagram of Information System A [Figure 3] Block diagram of the information processing device 1 [Figure 4] 10 is a flowchart illustrating a first operation example of the information processing device 1. [Figure 5] Flowchart illustrating an example of the terminal determination process [Figure 6] 10 is a flowchart illustrating an example of the comparison position acquisition process. [Figure 7] A flowchart illustrating an example of the screen configuration process. [Figure 8] 10 is a flowchart illustrating an example of the fourth maintenance process. [Figure 9] A flowchart illustrating an example of the reward process [Figure 10] 10 is a flowchart illustrating a second operation example of the information processing device 1. [Figure 11] 10 is a flowchart illustrating a first operation example of the mobile terminal 2. [Figure 12] 10 is a flowchart illustrating a second operation example of the mobile terminal 2. [Figure 13] A flowchart illustrating an example of the operation of the user terminal 3 [Figure 14] A diagram showing the group management table [Figure 15] A diagram showing the terminal management table [Figure 16] Figure showing an example of the output [Figure 17] Figure showing an example of the output [Figure 18] Block diagram of information system B in embodiment 2 [Figure 19] A flowchart illustrating an example of the operation of the information processing device 4 [Figure 20] A flowchart illustrating an example of the video determination process [Figure 21] Overview of the computer system in the above embodiment [Figure 22] Block diagram of the computer system DETAILED DESCRIPTION OF THE INVENTION
[0025] Hereinafter, embodiments of an information processing device and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.
[0026] (Embodiment 1) <Outline of First Embodiment>
[0027] In this embodiment, an information processing device is described that receives an inquiry specifying a plurality of locations to be compared, and transmits a screen including video of one or more of the plurality of locations to a user terminal based on the inquiry. Note that video is referred to as video as appropriate. It is preferable that the video is real-time video. Real-time video is video that is being captured, but there may be a delay between capturing and displaying. It is also preferable that the screen includes video of all of the plurality of locations.
[0028] In addition, in this embodiment, we will describe an information processing device that determines a mobile terminal to photograph each of multiple locations to be compared, receives videos from each of the multiple mobile terminals, and transmits a screen containing one or more videos of the multiple videos to a user terminal.
[0029] In addition, in this embodiment, we will describe an information system that includes a mobile terminal that receives an inquiry, determines whether or not the inquiry matches, and if a video of a location that matches the inquiry is being taken, transmits the taken video, and an information processing device that sends inquiries to multiple mobile terminals, receives video from mobile terminals that it determines match the inquiry, and transmits a screen including the video to a user terminal.
[0030] Furthermore, in this embodiment, an information processing device that ranks videos or objects within videos based on the analysis results of the videos will be described.
[0031] In the specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>
[0032] 1 is a conceptual diagram of an information system A according to this embodiment. The information system A includes an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.
[0033] The information processing device 1 is a device that provides video received from a mobile terminal 2 to a user terminal 3. The information processing device 1 is usually a server that provides video to the user terminal 3. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type is not important. The information processing device 1 may also be a device that constitutes a blockchain.
[0034] In this specification, the interval between each of the multiple still images included in a moving image does not matter. A moving image is, for example, a moving image at 60 frames per second or 30 frames per second, but it may also be a collection of multiple still images taken at intervals of a predetermined time (for example, one minute) or more, or a collection of multiple still images taken when predetermined conditions are met. A still image may also be called a field or a frame.
[0035] The mobile terminal 2 is a terminal that can move. The mobile terminal 2 is a device that captures video and transmits it to the information processing device 1. The mobile terminal 2 is a terminal that is installed on a moving body and that captures video. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with communication functions, camera-equipped glasses, a smartwatch with a camera, or a drive recorder. The type of mobile terminal 2 is not important. Furthermore, "installed" usually means "fixed," but it may also be considered to include "in contact with" or "held." The mobile body is an object that moves, such as a car, a motorcycle, a bicycle, or a living thing. The living thing is usually a person, but may be another living thing.
[0036] The user terminal 3 is a terminal used by a user. The user terminal 3 is, for example, a device that receives an inquiry specifying multiple locations to be compared and outputs real-time video of the multiple locations based on the inquiry. A user is someone who watches videos or needs videos. The user terminal 3 may have the functions of a mobile terminal 2. In other words, the user terminal 3 may be a terminal of a user who provides videos. The user terminal 3 may be, for example, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, or the like, and the type does not matter.
[0037] The information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3 are generally capable of communicating via a network such as the Internet.
[0038] 2 is a block diagram of an information system A according to the present embodiment, and FIG.
[0039] The information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. The storage unit 11 includes a group management unit 111 and a terminal management unit 112. The receiving unit 12 includes a location receiving unit 121 and an inquiry receiving unit 122. The processing unit 13 includes a video acquisition unit 131, a screen composition unit 132, and a rights holder processing unit 133. The video acquisition unit 131 includes a terminal determination means 1311, an instruction sending means 1312, and a video receiving means 1313. The screen composition unit 132 includes a ranking means 1321 and a composition means 1322. The rights holder processing unit 133 includes a first security means 1331, a second security means 1332, a third security means 1333, a fourth security means 1334, and a reward means 1335. The transmitting unit 14 includes a screen transmission unit 141.
[0040] The mobile terminal 2 includes a moving storage unit 21, a moving receiving unit 22, a moving processing unit 23, a moving transmitting unit 24, and a moving output unit 25. The moving processing unit 23 includes a position acquiring unit 231, a photographing unit 232, an attribute value acquiring unit 233, and a configuration unit 234.
[0041] The user terminal 3 includes a user storage unit 31, a user reception unit 32, a user processing unit 33, a user transmission unit 34, a user reception unit 35, and a user output unit 36. The user processing unit 33 includes a location acquisition unit 331 and an inquiry acquisition unit 332. <Details of Components of Information Processing Device 1>
[0042] Various types of information are stored in the storage unit 11. The various types of information are, for example, group information (to be described later), terminal information (to be described later), video, one or more attribute values associated with the video, and map information.
[0043] The attribute value is, for example, the attribute value of the video. The attribute value of the video is, for example, environmental information. Environmental information is information about the environment in which the video was shot. Environmental information is, for example, location information, time information, weather information, temperature information, season information, and a location identifier, which will be described later. Time information is information that identifies the time when the video was shot. The time when the video was shot may be a time around the time the video was shot, and accuracy is not required. Time information is, for example, the time, year / month / date / time, year / month / date / time / minute, year / month / date / time / minute / second, year / month / date, and month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that identifies the weather at the location (or region) where the video was shot. Weather information is, for example, "sunny," "rain," "snow," or "cloudy." Temperature information is information that identifies the temperature at the location where the video was shot. Temperature information is, for example, "25 degrees" or "above 30 degrees." Seasonal information is information that identifies the season at the location where the video was shot. The season information is, for example, “spring,” “summer,” “early summer,” or “winter.” The road attribute value is the attribute value of the road on which the mobile terminal 2 travels.
[0044] Map information is used, for example, to obtain a location identifier corresponding to location information. The map information is, for example, in KIWI format, but the data structure is not important. Location information is information that identifies a location. Location information is usually (latitude, longitude) or (latitude, longitude, altitude), but it can also be a location identifier, which will be described later.
[0045] A location identifier is information that identifies a location. The location identifier is, for example, the name of the location or the ID of the location. However, the location identifier may also be (latitude, longitude) or (latitude, longitude, altitude).
[0046] The group management unit 111 stores one or more pieces of group information. The group information is information that identifies multiple locations to be compared. The group information includes, for example, a location identifier for each of the multiple locations to be compared. The group information includes, for example, position information for each of the multiple locations to be compared.
[0047] The group information may be associated with a user identifier. That is, a group of multiple locations to be compared that each user desires may be managed. The group information associated with a user identifier is, for example, information registered by a user identified by the user identifier.
[0048] The terminal management unit 112 stores one or more pieces of terminal information. The terminal information is information relating to the mobile terminal 2. The terminal information here typically includes a terminal identifier, which is an identifier for the mobile terminal 2, and terminal communication information. The terminal information has, for example, the latest location information for the mobile terminal 2. The mobile terminal 2 here is typically a terminal capable of transmitting video. The terminal information is associated with the mobile terminal 2. The terminal information in the terminal management unit 112 is accumulated by transmitting terminal communication information and the like from the mobile terminal 2, for example, when the mobile terminal 2 is in a state where it can transmit video.
[0049] The terminal identifier is information that identifies the mobile terminal 2. The terminal identifier may be a rights holder identifier that identifies the rights holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.
[0050] A rights holder is someone who has some right to the video captured by the mobile terminal 2. A rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that captured the video, or the person with the right to dispose of the video. A rights holder is, for example, the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it can be anyone who has the rights to the video captured by the mobile terminal 2.
[0051] The rights holder identifier may be a terminal identifier. The rights holder identifier is, for example, the rights holder's ID, name, email address, or telephone number. The rights holder's ID is, for example, a user identifier.
[0052] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of the communication application installed in the mobile terminal 2.
[0053] The receiving unit 12 receives various types of information and instructions. The various types of information and instructions are, for example, location information, inquiries (described later), videos, and videos associated with one or more attribute values. Note that videos associated with one or more attribute values are appropriately referred to as additional videos. Note that the term "video" is a concept that includes additional videos.
[0054] The location receiving unit 121 receives location information from each of the multiple mobile terminals 2. Note that each of the multiple mobile terminals 2 here is a terminal capable of transmitting moving images. A terminal capable of transmitting moving images is, for example, a terminal currently shooting moving images, but it may also be a terminal that starts shooting in response to receiving an instruction from the information processing device 1. The location receiving unit 121 normally receives location information from each of the multiple mobile terminals 2 continuously. Receiving continuously means receiving the information two or more times, for example, receiving the information constantly, receiving the information periodically, or receiving the information irregularly 22 or more times.
[0055] The inquiry receiving unit 122 receives an inquiry from one or more user terminals 3. An inquiry can be said to be a request for transmission of a screen based on videos of multiple locations to be compared. The inquiry includes specific information.
[0056] The identification information is information for identifying multiple locations to be compared. The identification information is, for example, a location identifier (e.g., a location name) that identifies each of the multiple locations, location information (e.g., (latitude, longitude)) that identifies each of the multiple locations, one location identifier, the location identifier of the location where the user terminal 3 is located, one location information, location information indicating the location where the user terminal 3 is located, or a user identifier.
[0057] The processing unit 13 performs various types of processing. The various types of processing are, for example, processing performed by the video acquisition unit 131, the screen composition unit 132, or the rights holder processing unit 133.
[0058] The video acquisition unit 131 acquires the video transmitted from the mobile terminal 2 located at each of the multiple locations identified by the identification information. The method by which the video acquisition unit 131 acquires the video is, for example, either of the following methods (1) and (2). (1) When the video acquisition unit 131 determines the mobile terminal 2 to which the video is to be transmitted
[0059] The video acquisition unit 131 transmits a video transmission instruction to the mobile terminal 2 located at each of the multiple locations specified by the identification information, and receives the video from the mobile terminal 2 in response to the transmission of the transmission instruction. In this case, the video acquisition unit 131 includes the following terminal determination means 1311, instruction transmission means 1312, and video reception means 1313.
[0060] The terminal determination means 1311 uses the location information of the mobile terminal 2 received by the location receiving unit 121 to determine the mobile terminal 2 that is present in each of the multiple locations identified by the identification information.
[0061] The instruction sending means 1312 sends a transmission instruction to each of the plurality of mobile terminals 2 determined by the terminal determining means 1311. The transmission instruction is an instruction to transmit a moving image.
[0062] The video receiving means 1313 receives the video from each of the plurality of mobile terminals 2 to which the transmission instruction has been transmitted. (2) When the mobile terminal 2 determines whether to transmit video
[0063] The video acquisition unit 131 includes, for example, an instruction sending unit 1312 and a video receiving unit 1313 described below.
[0064] The instruction sending means 1312 sends a query based on the identification information to a plurality of mobile terminals 2. The plurality of mobile terminals 2 here are a plurality of mobile terminals 2 that are capable of transmitting moving images. The plurality of mobile terminals 2 here are typically all mobile terminals 2 that are capable of transmitting moving images. The plurality of mobile terminals 2 here are, for example, a plurality of mobile terminals 2 that are managed by the terminal management unit 112 as being in a state where they can transmit moving images.
[0065] The query based on the identifying information is sent to the mobile terminal 2 and may be the same information as the received query or may be different information. The query based on the identifying information may include the received identifying information, may include multiple pieces of location information corresponding to the received identifying information, or may include multiple location identifiers corresponding to the received identifying information.
[0066] In response to the transmission of the inquiry, the video receiving means 1313 receives the video from each of the plurality of mobile terminals 2 that have been determined to correspond to the specific information.
[0067] The screen configuration unit 132 configures a screen based on multiple videos acquired by the video acquisition unit 131. It is preferable that a single screen has multiple videos. It is also preferable that a single screen has all of the videos acquired by the video acquisition unit 131. However, the single screen may be a screen having thumbnail images based on frames constituting each of the multiple videos, or a screen having a portion (for example, one) of the multiple videos and thumbnail images based on frames constituting one or more other videos. It is preferable that a portion of an area (window) within the single screen contains one or more videos. Furthermore, configuring a screen means acquiring screen information that is the basis for displaying the screen. The screen information is written in, for example, HTML, XML, etc., but the format is not important.
[0068] The ranking means 1321 acquires one or more attribute values of each of a plurality of videos and ranks the plurality of videos using the attribute values. The attribute values are, for example, the analysis results of the video, or the distance from the user terminal 3. The analysis results of the video are, for example, the price of a particular product in the video, or the degree of road congestion based on the number of cars. The distance from the user terminal 3 is the distance acquired using the location information corresponding to the video and the location information transmitted from the user terminal 3.
[0069] The ranking means 1321 performs object recognition processing on one frame of a video taken inside each of multiple supermarkets, for example, to determine the object in the frame, and obtains the price, which is a number near the object, through character recognition processing. Next, the ranking means 1321 assigns a rank (for example, any natural number greater than or equal to 1) to the videos in order of lowest price of the same object, for example.
[0070] The ranking means 1321, for example, performs object recognition processing on one frame in each video of a plurality of different expressways, obtains the number of cars or the distance between cars in the frame, and obtains the road congestion level (level) using the number of cars or the distance. Note that the ranking means 1321 obtains the level by, for example, referring to a correspondence table containing a plurality of pieces of correspondence information having ranges of the number of cars and levels, or a correspondence table containing a plurality of pieces of correspondence information having ranges of distance between cars and levels. Next, the ranking means 1321, for example, assigns a level to each video.
[0071] The ranking means 1321 calculates the distance for each of the plurality of mobile terminals 2, for example, using the location information associated with the video transmitted from the mobile terminal 2 and the location information transmitted from the user terminal 3. Next, the ranking means 1321 assigns a rank to each of the videos transmitted from the mobile terminal 2 in order of the shortest distance, for example.
[0072] The configuration means 1322 configures one screen based on each of the multiple videos. It is preferable that the configuration means 1322 configures one screen according to the ranking of each of the multiple videos. Note that one screen according to the ranking is, for example, a screen including multiple videos sorted in order of rank, or a screen indicating the rank of each video. Note that, as described above, it is preferable that one screen include all of the multiple videos, but it may also include thumbnail images using still images that make up each video, or it may include only some of the videos.
[0073] The right holder processing unit 133 performs right holder processing. The right holder processing is processing related to a right holder identified by a right holder identifier associated with a video. The video here is, for example, a video acquired by the video acquisition unit 131. The video here is, for example, a video received by the receiving unit 12.
[0074] The rights holder processing unit 133 performs rights holder processing, which is processing in response to the transmission of a screen by the screen transmission unit 141, and is processing related to a rights holder identified by a rights holder identifier associated with each of multiple videos corresponding to the screen. The rights holder processing is, for example, a first security processing, a second security processing, a third security processing, a fourth security processing, and a compensation processing, which will be described later.
[0075] The right holder identifier associated with the video is, for example, the right holder identifier corresponding to the mobile terminal 2 that transmitted the video, or the identifier of the user of the user terminal 3 to which the video was transmitted. The user of the user terminal 3 is the user who transmitted the inquiry.
[0076] The first security means 1331 performs a first security process of storing the video received by the receiving unit 12 in association with an attribute value set corresponding to the video. The attribute value set includes one or more attribute values. The first security means 1331 stores the video in a blockchain, for example.
[0077] The second security means 1332 performs a second security process of storing the video received by the receiving unit 12 in association with the right holder identifier corresponding to the video. The second security means 1332 stores the video in a blockchain, for example.
[0078] The third security means 1333 stores a right holder identifier that identifies the user of the user terminal 3, in association with the video. The third security means 1333 stores the right holder identifier, for example, in the storage unit 11 or a blockchain. The third security means 1333 may store a right holder identifier that identifies the user of the user terminal 3 for multiple videos received by the receiving unit 12. The third security means 1333 may store temporally consecutive screens (video of the screens) transmitted by the screen transmission unit 141, paired with the right holder identifier.
[0079] The video is stored in, for example, the storage unit 11, but may also be stored in other devices, such as other devices that make up the blockchain.
[0080] The fourth security means 1334 performs a fourth security process to store security information. The security information includes access information for accessing the stored video. The order of storing the video and performing the fourth security process on the security information corresponding to the video does not matter.
[0081] The fourth security means 1334 performs, for example, a fourth security process of accumulating security information including access information for accessing the multiple videos acquired by the video acquisition unit 131. The fourth security means 1334 performs, for example, a fourth security process of accumulating security information including access information for accessing the video of the screen transmitted by the screen transmission unit 141 to the user terminal 3.
[0082] It is preferable that the fourth security means 1334 stores the security information in a blockchain. That is, it is preferable that the fourth security means 1334 stores the security information in a distributed ledger of the blockchain. It is preferable that the fourth security means 1334 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1334 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.
[0083] The preservation information is information for ensuring the originality of a video. It can be said that the preservation information is header information for the video. The preservation information is, for example, access information and a set of attribute values. It is preferable that the preservation information has, for example, one or more rights holder identifiers. When the preservation information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information. The rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder. The fourth preservation process can ensure the originality of the preservation information of the registered video (which may be a video on a screen). By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also ensured. The access information is information for accessing a video. The access information is information that identifies the storage location of the video. The access information is, for example, a URL or a URI.
[0084] The remuneration means 1335 performs remuneration processing for each right holder identified by a right holder identifier associated with the video acquired by the video acquisition unit 131. Note that the right holder identifier is, for example, the owner of the mobile terminal 2.
[0085] The reward process is a process of providing a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more rights holder identifiers associated with a video. The reward process is, for example, a process of depositing money to a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a rights holder identified by one or more rights holder identifiers associated with a video. The reward process only needs to provide a benefit to a rights holder identified by one or more rights holder identifiers associated with a video, and the content of the benefit is not important. The reward may be, for example, money, points, goods, content, etc., and the content is not important.
[0086] It is preferable that the reward means 1335 acquires one or more attribute values of the video corresponding to the screen transmitted by the screen transmission unit 141, and performs reward processing, which is a process of determining a reward to the rights holder of the video using the one or more attribute values and providing the reward.
[0087] Here, the one or more attribute values are, for example, the amount of video data, the duration of the video, the number of frames of the video, and the resolution of the video.
[0088] The reward means 1335 preferably acquires a reward amount corresponding to a service identifier that identifies a service provided for a target video, and performs a reward process that provides a reward corresponding to the reward amount. The service identifier may be, for example, "view" or "purchase." In such a case, for example, the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.
[0089] The reward means 1335 performs reward processing, which is a process of obtaining a reward amount using, for example, one or more pieces of information from one or more attribute values and one or more service identifiers, and providing a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of a plurality of service identifiers is stored in the storage unit 11. The arithmetic expression is a formula for calculating the reward amount using one or more attribute values as parameters. The correspondence table is a table having multiple pieces of correspondence information for managing reward amounts corresponding to one or more attribute values.
[0090] The reward means 1335 typically performs a process of charging a reward to a user who has enjoyed a service related to the target video. The process of charging a reward is, for example, a process of charging the amount of reward obtained. The process of charging a reward is, for example, a process of charging the amount of reward obtained and the amount of profit obtained by the operator of the information processing device 1. The process of charging a reward is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc. The user who has enjoyed the service is typically the user of the user terminal 3.
[0091] The transmitting unit 14 transmits various types of information or instructions, such as a screen.
[0092] The screen transmission unit 141 transmits one of the screens acquired by the screen composition unit 132 to the user terminal 3 that has sent the inquiry. The screen transmission unit 141 usually transmits to the user terminal 3 a screen including videos taken at multiple locations to be compared. <Details of components of mobile terminal 2>
[0093] Various types of information are stored in the moving storage unit 21. The various types of information include, for example, video, attribute value sets, rights holder identifiers, camera attribute values, and map information. The camera attribute values are attribute values of the camera. The camera attribute values include, for example, the angle of view, direction information, and resolution.
[0094] For example, one or more attribute values constituting an attribute value set correspond to one or more still images constituting a moving image. The one or more attribute values may correspond to all of the still images, some of the still images, or multiple still images.
[0095] The mobile receiving unit 22 receives various information and instructions, such as transmission instructions and inquiries.
[0096] The movement processing unit 23 performs various types of processing. The various types of processing are, for example, processing performed by a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234.
[0097] The movement processing unit 23 determines whether the location information acquired by the location acquisition unit 231 matches the query received by the mobile receiving unit 22. The movement processing unit 23 determines whether any one or more location identifiers or any one or more location information included in the query satisfies a location condition with respect to the location information acquired by the location acquisition unit 231. The location condition means that the two locations are the same or nearby locations. The location condition means, for example, that the location indicated by the location information acquired by the location acquisition unit 231 is the same as the location identified by the location identifier or location information included in the query, or that the distance between the point indicated by the location information acquired by the location acquisition unit 231 and the point identified by the location identifier or location information included in the query is within a threshold or is smaller than a threshold.
[0098] The position acquisition unit 231 acquires position information. The position acquisition unit 231 usually acquires position information that specifies the current position of the mobile terminal 2. The position acquisition unit 231 acquires the position information by, for example, a GPS receiver. However, the means or algorithm by which the position acquisition unit 231 acquires the position information is not important.
[0099] The photographing unit 232 photographs a moving image. For example, the photographing unit 232 photographs a moving image while the mobile terminal 2 is moving. It is preferable that the photographed moving image is associated with location information acquired by the location acquisition unit 231. It is preferable that the photographed moving image is associated with one or more attribute values acquired by the attribute value acquisition unit 233, which will be described later.
[0100] It is preferable that the imaging unit 232 stores the captured video in the mobile storage unit 21. When the imaging unit 232 stores video in the mobile storage unit 21, which has a limited storage capacity, it is preferable that the imaging unit 232 overwrites new video in an area where old video is stored. In other words, it is preferable that the structure of the mobile storage unit 21 is a ring buffer structure.
[0101] The photographing unit 232 may start photographing a video in response to, for example, receiving a transmission instruction. The photographing unit 232 may start photographing a video when, for example, it is determined that a location condition is met in response to a received inquiry. The photographing unit 232 starts photographing a video in response to, for example, receiving a photographing instruction input from a user.
[0102] The attribute value acquisition unit 233 acquires one or more camera attribute values including direction information indicating the direction in which the image is captured by the image capture unit 232. It is preferable that the attribute value acquisition unit 233 acquires one or more attribute values including the camera attribute value.
[0103] The attribute value acquisition unit 233 acquires, for example, one or more attribute values. The one or more attribute values may be referred to as an attribute value set. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting. The attribute value acquisition unit 233 acquires time information, for example, constantly, at predetermined intervals, or when acquisition conditions are met. The attribute value acquisition unit 233 acquires time information from a clock (not shown), for example, during shooting, and acquires seasonal information corresponding to the time information. The attribute value acquisition unit 233 acquires weather information corresponding to location information, for example, from a server (not shown). The attribute value acquisition unit 233 acquires weather information, for example, constantly, at predetermined intervals, or when acquisition conditions are met. The attribute value acquisition unit 233 acquires temperature information, for example, during shooting. The movement processing unit 23 acquires temperature information corresponding to location information, for example, from a server (not shown). The movement processing unit 23 acquires temperature information, for example, from a temperature sensor installed in a moving object. The movement processing unit 23 acquires the temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied, such as when the analysis result of the video satisfies a predetermined condition.
[0104] The attribute value acquisition unit 233, for example, acquires a location identifier corresponding to the location information acquired by the location acquisition unit 231 from map information, and associates the location identifier with a video. The attribute value acquisition unit 233, for example, acquires a location identifier that is a location identifier corresponding to the location information acquired by the location acquisition unit 231 and that has a specific condition from map information, and associates the location identifier with a video. The specific condition is, for example, that the location identifier is a specific type of location identifier (for example, a station name or a building name).
[0105] Note that the association with the moving image may be association with frames that make up the moving image, or association with the entire moving image.
[0106] The attribute value acquisition unit 233 acquires, for example, one or more tags for the video captured by the image capture unit 232, and associates the tags with the video. Note that a tag can also be considered an attribute value.
[0107] The attribute value acquisition unit 233, for example, analyzes the video captured by the shooting unit 232 and acquires one or more tags for the video.
[0108] The attribute value acquisition unit 233 acquires one or more tags, for example, using one or more moving object attribute values acquired during shooting by the shooting unit 232. The moving object attribute values are, for example, CAN data.
[0109] The attribute value acquisition unit 233, for example, determines one or more still images that match the video tag condition and acquires a tag that pairs with the video tag condition. The attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.
[0110] For example, if the video tag condition is "the number of cars with a distance between them within a threshold is equal to or greater than a threshold and the car's moving speed is equal to or less than a threshold," and the tag paired with the video tag condition is "traffic jam," the attribute value acquisition unit 233 analyzes frames of the video, recognizes multiple cars, and acquires the distances between each of the multiple cars. The attribute value acquisition unit 233 also acquires the number of cars with a distance between them within a threshold. The attribute value acquisition unit 233 also acquires the moving distance and frame rate of a single car in multiple frames, and acquires the car's speed. The attribute value acquisition unit 233 then determines whether the video tag condition is met using the number of cars with a distance between them within a threshold and the car's speed. If the video tag condition is met, the attribute value acquisition unit 233 acquires the tag "traffic jam" paired with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.
[0111] The attribute value acquisition unit 233 may, for example, determine one or more moving object attribute values that match the attribute value tag condition, and acquire a tag that pairs with the attribute value tag condition. The attribute value acquisition unit 233 may also associate the tag with a video that pairs with the one or more moving object attribute values.
[0112] For example, if the attribute value tag condition is "driving time at a speed of less than 30 km for 10 minutes or more and the proportion of the driving time at a speed less than 30% is 80% or more," and the tag paired with the attribute value tag condition is "traffic jam," the attribute value acquisition unit 233 uses the speed history contained in the CAN data associated with each field of the video to detect CAN data that matches the attribute value tag condition, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is CAN data acquired at the same time that the field was captured.
[0113] The composition unit 234 associates the acquired location information with the video and acquires an additional video. The composition unit 234 acquires, for example, an additional video in which one or more camera attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. The composition unit 234 acquires, for example, an additional video in which one or more attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. The additional video usually includes location information.
[0114] The mobile transmitting unit 24 transmits various types of information to the information processing device 1. The various types of information are, for example, moving images and additional moving images. The mobile transmitting unit 24 may continuously transmit moving images acquired by the photographing unit 232 to the information processing device 1. In such cases, the moving images are usually associated with location information and time information.
[0115] For example, the mobile transmitting unit 24 transmits the video captured by the photographing unit 232 to the information processing device 1 in response to receiving a transmission instruction.
[0116] For example, when it is determined that the location condition is met in response to the received inquiry, the mobile transmitting unit 24 transmits the video captured by the photographing unit 232 to the information processing device 1.
[0117] The movement output unit 25 outputs various types of information, such as a moving image, an additional moving image, and a set of attribute values.
[0118] Output is a concept that includes displaying on a display, projecting using a projector, printing on a printer, outputting sound, transmitting to an external device, storing on a recording medium, and handing over processing results to other processing devices or other programs. <Details of components of user terminal 3>
[0119] Various types of information are stored in the user storage unit 31. The various types of information include, for example, a user identifier, a video, an inquiry, and map information.
[0120] The user receiving unit 32 receives various instructions and information. The various instructions and information are, for example, inquiries. The inquiries received by the user receiving unit 32 include, for example, specific information.
[0121] Reception is a concept that includes the reception of information entered from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as an optical disk, magnetic disk, or semiconductor memory.
[0122] The user receiving unit 32 receives, for example, an inquiry from a user. Such an inquiry is an instruction to acquire videos of multiple locations to be compared. The inquiry received from the user may be simply a button press or a menu item selection, or may include input of one or more location identifiers, or may include input of one or more pieces of location information.
[0123] For example, when the location information acquired by the user processing unit 33 is specific location information (for example, a point before a branch point of an expressway such as the Tomei Expressway and the Shin-Tomei Expressway), the user accepting unit 32 acquires an inquiry including the location information. Acquisition of such an inquiry may also be considered as acceptance of an inquiry.
[0124] The user processing unit 33 performs various types of processing. The various types of processing are, for example, processing performed by the location acquisition unit 331 and the inquiry acquisition unit 332. The various types of processing are, for example, processing to create a data structure for transmitting various instructions and information received by the user reception unit 32. The various types of processing are, for example, processing to create a structure for transmitting information received by the user reception unit 35.
[0125] The location acquisition unit 331 acquires a location identifier that identifies the location of the user terminal 3. The location identifier is, for example, a location name and location information. The location acquisition unit 331 acquires the location information using, for example, a GPS receiver, and acquires the location identifier corresponding to the location information from map information. The map information may be stored in the user storage unit 31 or in an external device.
[0126] The inquiry acquisition unit 332 acquires, for example, an inquiry accepted by the user acceptance unit 32 .
[0127] The inquiry acquisition unit 332 acquires, for example, an inquiry including specific information using the location identifier acquired by the location acquisition unit 331. The inquiry acquisition unit 332 may acquire an inquiry accepted by the user acceptance unit 32.
[0128] The inquiry acquisition unit 332 acquires, for example, one location identifier input by the user, and acquires an inquiry having the one location identifier.
[0129] The inquiry acquisition unit 332 acquires, for example, a user identifier from the user storage unit 31, and acquires an inquiry having the user identifier.
[0130] The user transmission unit 34 transmits the inquiry acquired by the inquiry acquisition unit 332 to the information processing device 1.
[0131] The user receiving unit 35 receives from the information processing device 1 one screen configured using moving images of a plurality of locations including the location identified by the location identifier.
[0132] The user output unit 36 outputs one screen received by the user receiving unit 35. It is preferable that one screen contains videos of a plurality of comparison locations.
[0133] The storage unit 11, group management unit 111, terminal management unit 112, mobile storage unit 21, and user storage unit 31 are preferably non-volatile recording media, but may also be realized as volatile recording media.
[0134] There is no restriction on the process by which information is stored in the storage unit 11 etc. For example, information may be stored in the storage unit 11 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 11 etc., or information input via an input device may be stored in the storage unit 11 etc.
[0135] The receiving unit 12, the location receiving unit 121, the inquiry receiving unit 122, the video receiving means 1313, the mobile receiving unit 22, and the user receiving unit 35 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.
[0136] The processing unit 13, video acquisition unit 131, screen composition unit 132, rights holder processing unit 133, terminal determination means 1311, ranking means 1321, composition means 1322, first maintenance means 1331, second maintenance means 1332, third maintenance means 1333, fourth maintenance means 1334, reward means 1335, movement processing unit 23, attribute value acquisition unit 233, composition unit 234, user processing unit 33, and inquiry acquisition unit 332 can typically be realized by a processor, memory, etc. The processing procedures of the processing unit 13, etc. are typically realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.
[0137] The instruction transmitting means 1312, the transmitting unit 14, the screen transmitting unit 141, the mobile transmitting unit 24, and the user transmitting unit 34 are usually realized by wireless or wired communication means, but may also be realized by broadcasting means.
[0138] The position acquisition unit 231 is realized by, for example, a GPS receiver.
[0139] The location acquisition unit 331 is realized by, for example, a communication module that receives a location identifier, or a GPS receiver.
[0140] The photographing unit 232 is realized by a camera.
[0141] The movement output unit 25 and the user output unit 36 may or may not include output devices such as a display, a speaker, etc. The movement output unit 25 may be realized by driver software for an output device, or by a combination of driver software for an output device and the output device, etc.
[0142] The user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen. <Operation>
[0143] Next, an operation example of the information system A will be described. First, a first operation example of the information processing device 1 will be described using the flowchart in Fig. 4. The first operation example is a case where the information processing device 1 determines a mobile terminal 2 to which a video is to be transmitted.
[0144] (S401) The location receiving unit 121 determines whether or not location information, etc. has been received from the mobile terminal 2. If location information, etc. has been received, the process proceeds to S402, and if location information, etc. has not been received, the process proceeds to S403. The location information, etc. is, for example, the location information and a terminal identifier.
[0145] (S402) The processing unit 13 associates the location information received in S401 with the terminal identifier and stores it in the terminal management unit 112. The process returns to S401.
[0146] (S403) The inquiry receiving unit 122 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S404, and if an inquiry has not been received, the process returns to S401. The received inquiry is associated with a user identifier.
[0147] (S404) The terminal determination means 1311 determines a plurality of mobile terminals 2 to which to transmit the video corresponding to the received inquiry. An example of such terminal determination processing will be described with reference to the flowchart of FIG.
[0148] (S405) The instruction sending means 1312 acquires the terminal communication information of each of the multiple mobile terminals 2 determined in S404 from the terminal management unit 112. Next, the instruction sending means 1312 sends a transmission instruction to the mobile terminal 2 that is the communication destination indicated by the multiple terminal communication information. (S406) The video receiving means 1313 determines whether or not video has been received from any one or more mobile terminals 2 to which a transmission instruction has been sent. If video has been received, the process proceeds to S407, and if video has not been received, the process returns to S406. The video receiving means 1313 receives video in pair with the terminal identifier of the mobile terminal 2. The video receiving means 1313 may receive video in pair with one or more attribute values.
[0149] (S407) The video acquisition unit 131 pairs the video received in S406 with the terminal identifier and temporarily stores it in a buffer (not shown). The video acquisition unit 131 may also pair the video received in S406 with one or more attribute values and temporarily store it in a buffer (not shown).
[0150] (S408) Screen composition unit 132 composes a screen using moving images temporarily stored in a buffer (not shown). An example of such screen composition processing will be described with reference to the flowchart in FIG.
[0151] (S409) The screen transmission unit 141 transmits the screen constructed in S408 to the user terminal 3 that has sent the inquiry.
[0152] (S410) The processing unit 13 determines whether or not to end the transmission of the screen. If it is to be ended, the process proceeds to S411, and if it is not to be ended, the process returns to S406. Note that the transmission of the screen is ended, for example, when an instruction to end the transmission is received from the user terminal 3.
[0153] (S 411 ) The third security unit 1333 acquires the user identifier of the user terminal 3 .
[0154] (S412) The third security means 1333 stores the video of the screen continuously transmitted in S409 or the multiple videos that constitute the screen, paired with the user identifier acquired in S411. As a result, the rights holder of the video of the screen continuously transmitted in S409 or the multiple videos that constitute the screen becomes the user identified by the user identifier. In other words, the user identifier is a rights holder identifier.
[0155] (S413) The fourth maintenance means 1334 performs a fourth maintenance process. An example of the fourth maintenance process will be described with reference to the flowchart in FIG.
[0156] (S414) The reward means 1335 performs reward processing. Return to S401. An example of the reward processing will be described with reference to the flowchart in FIG.
[0157] In the flowchart of FIG. 4, the process ends when the power is turned off or an interrupt occurs to end the process.
[0158] Next, an example of the terminal determination process in S404 will be described with reference to the flowchart in FIG.
[0159] (S501) The terminal determination means 1311 acquires the specific information included in the received inquiry.
[0160] (S502) Terminal determination means 1311 uses the identification information to acquire location information for each of a plurality of comparison targets. An example of such comparison target location acquisition processing will be described with reference to the flowchart in FIG.
[0161] (S503) The terminal determination means 1311 assigns 1 to the counter i.
[0162] (S504) The terminal determination means 1311 determines whether or not the i-th location information to be compared obtained in S502 exists. If the i-th location information exists, the process proceeds to S505, and if not, the process returns to the upper processing.
[0163] (S505) The terminal determination means 1311 assigns 1 to the counter j.
[0164] (S506) Terminal determination means 1311 determines whether or not location information of the jth mobile terminal 2 exists in terminal management unit 112. If the jth location information exists, proceed to S506; if not, proceed to S510.
[0165] (S507) The terminal determination means 1311 determines whether the location information of the ith comparison target and the location information of the jth mobile terminal 2 satisfy the location condition. If the location condition is satisfied, the process proceeds to S508; if not, the process proceeds to S510.
[0166] (S508) Terminal determination means 1311 acquires the terminal identifier and location information of j-th mobile terminal 2 from terminal management unit 112, and stores them in a buffer (not shown).
[0167] (S509) The terminal determination means 1311 increments the counter j by 1. The process returns to S506.
[0168] (S510) The terminal determination means 1311 determines one terminal identifier from the terminal identifiers accumulated in a buffer (not shown). Note that the terminal determination means 1311 determines, for example, one terminal identifier that pairs with the location information of the position closest to the position indicated by the i-th location information to be compared. The terminal determination means 1311 determines one terminal identifier, for example, randomly. Note that any algorithm may be used to determine one terminal identifier.
[0169] (S511) The terminal determination means 1311 increments the counter i by 1. The process returns to S504.
[0170] Next, an example of the comparison position acquisition process in S502 will be described with reference to the flowchart in FIG.
[0171] (S601) The terminal determination means 1311 determines whether the acquired specific information has multiple pieces of location information. If multiple pieces of location information are included, the process proceeds to S602; if multiple pieces of location information are not included, the process proceeds to S603. Note that if the specific information has multiple pieces of location information, the locations corresponding to the multiple pieces of location information are the locations to be compared.
[0172] (S602) The terminal determination means 1311 acquires the plurality of pieces of location information contained in the acquired identification information, and returns to the upper processing.
[0173] (S603) The terminal determination means 1311 determines whether the acquired specific information has one piece of location information. If it has one piece of location information, the process proceeds to S604, and if it does not have location information, the process proceeds to S607.
[0174] (S604) The terminal determination means 1311 uses the map information in the storage unit 11 to acquire a location identifier (for example, a place name or a store name) corresponding to the location information included in the acquired identification information.
[0175] (S605) The terminal determination means 1311 acquires, from the group information in the group management unit 111, one or more location identifiers that are paired with the location identifier acquired in S604.
[0176] (S606) The terminal determination means 1311 uses the map information in the storage unit 11 to obtain location information paired with each of the one or more location identifiers obtained in S605. The terminal determination means 1311 also obtains the location information contained in the obtained identification information. The process returns to the upper level processing. As a result, the terminal determination means 1311 obtains multiple pieces of location information.
[0177] (S607) The terminal determination means 1311 determines whether the acquired specific information has multiple location identifiers. If it has multiple location identifiers, the process proceeds to S608; if it does not have multiple location identifiers, the process proceeds to S609. Note that if the specific information has multiple location identifiers, the locations identified by the multiple location identifiers are the locations to be compared.
[0178] (S608) The terminal determination means 1311 acquires location information corresponding to each of the plurality of location identifiers included in the acquired identification information, using the map information in the storage unit 11. The process returns to the upper level process.
[0179] (S609) The terminal determination means 1311 determines whether the acquired specific information has one location identifier. If it has one location identifier, the process proceeds to S610, and if it does not have a location identifier, the process proceeds to S612.
[0180] (S610) The terminal determination means 1311 acquires the location identifier included in the acquired identification information. The terminal determination means 1311 acquires one or more other location identifiers that are paired with the acquired location identifier from the group information of the group management unit 111.
[0181] (S611) The terminal determination means 1311 uses the map information in the storage unit 11 to acquire location information corresponding to the location identifier included in the acquired specific information and one or more location identifiers acquired from the group management unit 111. The process returns to the upper level process.
[0182] (S612) The terminal determination means 1311 acquires the user identifier included in the acquired identification information.
[0183] (S613) The terminal determination means 1311 acquires multiple location identifiers paired with the user identifier from the group management unit 111. The terminal determination means 1311 acquires location information corresponding to the acquired multiple location identifiers using the map information in the storage unit 11. The process returns to the upper level process.
[0184] Next, an example of the screen configuration process in S408 will be described with reference to the flowchart in FIG.
[0185] (S701) The screen composition unit 132 assigns 1 to a counter i.
[0186] (S702) The screen composition unit 132 determines whether or not the i-th mobile terminal 2 exists among the mobile terminals 2 determined in S404. If the i-th mobile terminal 2 exists, the process proceeds to S703; if not, the process proceeds to S706.
[0187] (S703) The screen composition unit 132 acquires the video transmitted and stored by the i-th mobile terminal 2.
[0188] (S704) The screen composition unit 132 acquires one or more attribute values corresponding to the i-th mobile terminal 2.
[0189] (S705) The screen composition unit 132 increments the counter i by 1. The process returns to S702.
[0190] (S706) The ranking means 1321 obtains the rank of each of the plurality of mobile terminals 2 using one or more attribute values corresponding to the mobile terminal 2.
[0191] (S707) The composition unit 1322 composes a single screen in which the moving images acquired in S703 are arranged according to the ranking, and returns to the upper level processing.
[0192] The one screen is, for example, a screen on which the video transmitted from each mobile terminal 2 is displayed within a frame corresponding to each mobile terminal 2 transmitting the video.
[0193] Next, an example of the fourth maintenance process of S413 will be described with reference to the flowchart of FIG.
[0194] (S801) The fourth security unit 1334 acquires access information that identifies the storage destination of the video.
[0195] (S802) The fourth maintenance means 1334 acquires a set of attribute values corresponding to the stored moving images.
[0196] (S803) The fourth security means 1334 generates security information including the access information acquired in S801, the attribute value set acquired in S802, and the rights holder identifier of the video. Note that if a new rights holder identifier has been acquired, the fourth security means 1334 generates security information including, for example, the new rights holder identifier and the original rights holder identifier. (S804) The fourth maintenance means 1334 stores the maintenance information configured in S803, and returns to the upper level processing.
[0197] In addition, in S804, if preservation information for a video corresponding to the preservation information to be stored has been stored, the preservation information configured in S803 is overwritten with the preservation information. This makes it possible to manage, for example, the transition of rights holders of the video. Furthermore, the fourth preservation means 1334 stores the preservation information in, for example, a blockchain.
[0198] Next, an example of the reward process in S414 will be described with reference to the flowchart in FIG.
[0199] (S901) The reward means 1345 assigns 1 to a counter i.
[0200] (S902) The compensation means 1345 determines whether the i-th video that was the source of the screen exists. If the i-th video exists, the process proceeds to S903, and if not, the process returns to the upper process.
[0201] (S903) The compensation means 1345 acquires a rights holder identifier paired with the target video.
[0202] (S904) The reward means 1345 acquires a set of attribute values of the target video.
[0203] (S905) The reward means 1345 acquires a reward amount using the attribute value set acquired in S904.
[0204] (S906) The reward means 1345 performs processing to give a reward of the amount of reward acquired in S905 to the right holder identified by the right holder identifier acquired in S903.
[0205] (S907) The remuneration means 1345 performs processing to make the user corresponding to the user terminal 3 that received the screen pay a remuneration.
[0206] (S908) The reward means 1345 increments the counter i by 1. The process returns to S902.
[0207] Next, a second operation example of the information processing device 1 will be described using the flowchart in Fig. 10. The second operation example is a case where an inquiry is sent to all mobile terminals 2 managed by the information processing device 1. In the flowchart in Fig. 10, explanations of steps that are the same as those in the flowchart in Fig. 4 will be omitted.
[0208] (S1001) The inquiry receiving unit 122 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S1002, and if an inquiry has not been received, the process returns to S1001. The received inquiry is associated with a user identifier.
[0209] (S1002) The transmission unit 14 assigns 1 to a counter i.
[0210] (S1003) The transmission unit 14 determines whether or not the i-th terminal information exists in the terminal management unit 112. If the i-th terminal information exists, the process proceeds to S1004, and if not, the process proceeds to S1006.
[0211] (S1004) Transmitter 14 acquires terminal communication information included in the i-th terminal information from terminal manager 112. Transmitter 14 transmits an inquiry to the i-th mobile terminal 2 identified by the terminal communication information.
[0212] (S1005) The transmission unit 14 increments the counter i by 1. The process returns to S1003.
[0213] (S1006) Terminal determination means 1311 acquires location information of each of a plurality of comparison targets using the identification information included in the received inquiry. An example of such comparison target location acquisition processing has been described with reference to the flowchart of FIG.
[0214] (S1007) The video receiving means 1313 determines whether or not video or the like has been received from any of the mobile terminals 2. If video or the like has been received, the process proceeds to S1008, and if not, the process returns to S1007.
[0215] (S1008) The video acquisition unit 131 acquires location information paired with the video received in S1007.
[0216] (S1009) The video acquisition unit 131 determines whether the location information acquired in S1008 satisfies the location condition of any of the location information acquired in S1006 that is not compatible with video. If the location condition is satisfied, the process proceeds to S1010; if not, the process proceeds to S1016.
[0217] (S1010) Video acquisition unit 131 stores the terminal identifier and the video in a buffer (not shown).
[0218] (S1011) Determine whether all of the location information acquired in S1006 is associated with video. If all of the location information is associated with video, proceed to S408, and if not all of the location information is associated with video, return to S1007.
[0219] In the flowchart of FIG. 10, the process ends when the power is turned off or an interrupt occurs to end the process.
[0220] Next, a first operation example of the mobile terminal 2 will be described using the flowchart in Fig. 11. The first operation example is a case where the information processing device 1 determines the mobile terminal 2 to which to transmit a video. In other words, the flowchart of the mobile terminal 2 in Fig. 11 corresponds to the flowchart of the information processing device 1 in Fig. 4.
[0221] (S1101) The mobile terminal 2 determines whether or not a start instruction has been received. If a start instruction has been received, the process proceeds to S1102, and if a start instruction has not been received, the process proceeds to S1101.
[0222] (S1102) The location acquisition unit 231 acquires the current location information of the mobile terminal 2.
[0223] (S1103) The movement processing unit 23 acquires a terminal identifier from the movement storage unit 21. Next, the movement processing unit 23 composes information having the terminal identifier and the location information acquired in S1102. The movement transmission unit 24 transmits the information to the information processing device 1.
[0224] (S1104) The movement processing unit 23 determines whether or not to end the process. If the process is to be ended, the process returns to S1101, and if the process is not to be ended, the process proceeds to S1105. The process is ended, for example, when an end instruction is input by the user.
[0225] (S1105) The mobile receiving unit 22 determines whether or not a transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S1106, and if a transmission instruction has not been received, the process returns to S1102.
[0226] (S1106) The image capturing unit 232 captures a video.
[0227] (S1107) The attribute value acquisition unit 233 acquires one or more attribute values. The composition unit 234 acquires a terminal identifier from the moving storage unit 21. The composition unit 234 associates one or more attribute values and a terminal identifier with the moving image to compose information to be transmitted. Note that each frame constituting the moving image is associated with, for example, time information acquired by the attribute value acquisition unit 233, position information acquired by the position acquisition unit 231, etc.
[0228] (S1108) The mobile transmitting unit 24 transmits the moving image etc. constructed in S1107 to the information processing device 1. Return to S1104. Note that the length and amount of data of the moving image transmitted by the mobile transmitting unit 24 at one time is not important.
[0229] 11, the photographing unit 232 starts photographing in response to receiving a transmission instruction. However, the photographing unit 232 may start photographing in response to receiving a start instruction.
[0230] In the flowchart of FIG. 11, the process ends when the power is turned off or an interrupt occurs to end the process.
[0231] Next, a second operation example of the mobile terminal 2 will be described with reference to the flowchart in Fig. 12. The second operation example is a case where the mobile terminal 2 determines whether or not to transmit a video to the information processing device 1. In other words, the flowchart of the mobile terminal 2 in Fig. 12 corresponds to the flowchart of the information processing device 1 in Fig. 10.
[0232] (S1201) The mobile receiving unit 22 determines whether or not an inquiry has been received from the information processing device 1. If an inquiry has been received, the process proceeds to S1202, and if an inquiry has not been received, the process returns to S1201.
[0233] (S1202) The movement processing unit 23 performs a comparison position acquisition process. The comparison position acquisition process is the same as the process described in the flowchart of FIG.
[0234] (S1203) The location acquisition unit 231 acquires the current location information of the mobile terminal 2.
[0235] (S1204) The movement processing unit 23 assigns 1 to the counter i.
[0236] (S1205) The movement processing unit 23 determines whether or not the i-th location information exists among the plurality of location information to be compared acquired in S1202. If the i-th location information exists, the process proceeds to S1206, and if not, the process returns to S1201.
[0237] (S1206) The movement processing unit 23 determines whether the location information acquired in S1203 and the i-th location information satisfy the location condition. If the location condition is satisfied, the process proceeds to S1207, and if the location condition is not satisfied, the process proceeds to S1211.
[0238] (S1207) The image capturing unit 232 captures a video.
[0239] (S1208) Attribute value acquisition unit 233 acquires one or more attribute values. Composition unit 234 acquires a terminal identifier from moving storage unit 21. Composition unit 234 associates one or more attribute values and a terminal identifier with the video, and composes information to be transmitted.
[0240] Each frame constituting the moving image is associated with, for example, time information acquired by the attribute value acquisition unit 233, position information acquired by the position acquisition unit 231, and the like.
[0241] (S1209) The mobile transmitting unit 24 transmits the video and the like constructed in S1208 to the information processing device 1.
[0242] (S1210) The movement processing unit 23 determines whether or not to end the transmission of the video, etc. If the transmission of the video, etc. is to be ended, the process returns to S1201, and if the transmission of the video, etc. is not to be ended, the process returns to S1207. Note that the transmission of the video, etc. is ended, for example, when a transmission unnecessary command is received from the information processing device 1, or when an end instruction is received from the user of the mobile terminal 2.
[0243] (S1211) The movement processing unit 23 increments the counter i by 1. The process returns to S1205.
[0244] 12, before acquiring the video in S1207, the information processing device 1 may be inquired of whether or not to transmit the video. In such a case, the mobile transmission unit 24 transmits an inquiry including, for example, location information and other attribute values to the information processing device 1. Then, in response to the inquiry received from the current location information of multiple mobile terminals 2, the information processing device 1 determines, for each comparison location, one mobile terminal 2 to transmit the video to, based on the location information and other attribute values. This determination method may be the same as the operation at S510 in the flowchart of FIG. 5.
[0245] In the flowchart of FIG. 12, the process ends when the power is turned off or an interrupt occurs to end the process.
[0246] Next, an example of the operation of the user terminal 3 will be described with reference to the flowchart of FIG.
[0247] (S1301) The user reception unit 32 determines whether or not an inquiry has been received. If an inquiry has been received, the process proceeds to S1302, and if an inquiry has not been received, the process returns to S1301.
[0248] (S1302) The user processing unit 33 acquires the user identifier from the user storage unit 31.
[0249] (S1303) The inquiry acquisition unit 332 uses the inquiry received in S1301 to construct an inquiry to be transmitted. The inquiry to be transmitted is usually associated with a user identifier. The inquiry to be transmitted includes, for example, the location information acquired by the user processing unit 33 or the location identifier acquired by the location acquisition unit 331.
[0250] (S1304) The user transmission unit 34 transmits the inquiry constructed in S1303 to the information processing device 1.
[0251] (S1305) The user reception unit 35 determines whether or not a screen has been received from the information processing device 1. If a screen has been received, the process proceeds to S1306, and if a screen has not been received, the process proceeds to S1307.
[0252] (S1306) User processing unit 33 composes a screen to be output based on the received screen. User output unit 36 outputs this screen.
[0253] (S1307) The user processing unit 33 determines whether or not to end the screen output. If the screen output is to be ended, the process returns to S1301, and if the screen output is not to be ended, the process returns to S1305. Note that the screen output is ended, for example, when an end instruction is received from the user.
[0254] In the flowchart of FIG. 13, the process ends when the power is turned off or an interrupt occurs to end the process. <Example>
[0255] A specific example of the operation of the information system A in this embodiment will be described below.
[0256] It is assumed that the group management table of FIG. 14 is stored in the group management unit 111 of the information processing device 1. The group management table is a table for managing group information. The group management table is a table for managing information for determining multiple locations to be compared with specific information included in a received query. The group information is the set of location identifiers in FIG. 14, but it may also be considered to include specific information. The group management table manages records having an "ID," "specific information," and "set of location identifiers." The "ID" is information that identifies a record. The "specific information" here is, for example, a store name (name of a supermarket), location information (latitude, longitude), or a user identifier. The "set of location identifiers" is a set of location identifiers that identify each of multiple locations to be compared. The location identifiers here are the store name (name of a supermarket), location information (latitude, longitude), and location name (name of a location on a highway). Note that the store name is an example of a location name.
[0257] It is assumed that the terminal management unit 112 stores the terminal management table of FIG. 15. The terminal management table manages records having "ID" and "terminal information." Here, the "terminal information" has "terminal identifier," "terminal communication information," and "location information." The "location information" is the latest location information of the mobile terminal 2.
[0258] It is assumed that, in a state where a video can be provided, the mobile terminal 2 continuously transmits current location information associated with a terminal identifier to the information processing device 1. The location receiving unit 121 of the information processing device 1 receives the location information associated with the terminal identifier from each mobile terminal 2. The processing unit 13 then stores the location information in the terminal management table (FIG. 15) in association with the terminal identifier.
[0259] Map information is stored in the storage unit 11 of the information processing device 1. The map information has store names paired with location information of the stores, and location names paired with location information of the locations.
[0260] In this situation, the following four specific examples will be described. Specific Example 1 is a case where a user inputs a location identifier (here, the name of a single store) that identifies multiple locations to be compared into a smartphone, and obtains videos of multiple locations including locations identified by other location identifiers that are paired with the location identifier. Specific Example 2 is a case where a user presses a specific button in a specific app on the smartphone to obtain videos of each of the multiple locations to be compared. Specific Example 3 is a case where a user inputs a user identifier on the screen of a specific app on the smartphone and then presses a button to obtain videos of each of the multiple locations to be compared. Specific Example 4 is a case where, when a user passes a specific point while traveling by car, a video is output to a navigation terminal to show the conditions of multiple roads that branch off after passing the specific point.
[0261] (Example 1) It is assumed that a user launches an app on the user terminal 3. The app is capable of acquiring and outputting videos of multiple comparison locations. Next, the app is launched on the user terminal 3. The user terminal 3 then outputs a screen for inputting specific information. This screen has a field for inputting specific information and a "send" button. The "send" button is a button for sending an inquiry to the information processing device 1.
[0262] Next, the user inputs the specific information "Supermarket A" on the screen and presses the "Send" button.
[0263] Then, the user receiving unit 32 of the user terminal 3 receives the query "<specific information> Super A". Next, the user processing unit 33 acquires the user identifier "U001" from the user storage unit 31. The query acquisition unit 332 uses the received query to construct the query to be sent, "<user identifier> U001 <specific information> Super A". Next, the user sending unit 34 sends the query to the information processing device 1.
[0264] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry “<user identifier>U001 <specific information>Supermarket A” from the user terminal 3.
[0265] Next, the terminal determination means 1311 acquires the specific information "Supermarket A" contained in the received inquiry. The terminal determination means 1311 acquires the location identifier set "Supermarket B, Supermarket C, Supermarket D" that pairs with the specific information "Supermarket A" from the group management table (FIG. 14). Next, the terminal determination means 1311 acquires the location information of "Supermarket A, Supermarket B, Supermarket C, Supermarket D" by referring to the map information in the storage unit 11. The location information of each of these four supermarkets is respectively (x 21 ,y 21 )(x 22 ,y 22 )(x 23 ,y 23 )(x 24 ,y 24) Next, the terminal determination means 1311 determines the location information of the mobile terminal 2 that satisfies the location condition for the location information of each of the four supermarkets (that is, that is located in that supermarket) from the terminal management table (FIG. 15). Here, it is assumed that the terminal determination means 1311 has acquired the terminal identifier "T001" of the mobile terminal 2 that is located in supermarket A, the terminal identifier "T002" of the mobile terminal 2 that is located in supermarket B, the terminal identifier "T003" of the mobile terminal 2 that is located in supermarket C, and the terminal identifier "T004" of the mobile terminal 2 that is located in supermarket D from the terminal management table (FIG. 15).
[0266] Next, the instruction sending means 1312 acquires terminal communication information paired with each of the acquired four terminal identifiers from the terminal management table (FIG. 15). Next, the instruction sending means 1312 transmits a transmission instruction to the mobile terminal 2 that is the communication destination indicated by each of the four pieces of terminal communication information.
[0267] Next, the mobile receiving unit 22 of each of the four mobile terminals 2 receives a transmission instruction from the information processing device 1. Next, the photographing unit 232 acquires the video. Furthermore, the attribute value acquisition unit 233 acquires one or more attribute values. Here, it is assumed that the attribute value acquisition unit 233 acquires an attribute value that is the price of a product in the video. Furthermore, the configuration unit 234 acquires a terminal identifier from the mobile storage unit 21. The configuration unit 234 associates the video with one or more attribute values and a terminal identifier to configure information to be transmitted. Next, the mobile transmitting unit 24 transmits the video, etc. to the information processing device 1.
[0268] Next, the video receiving means 1313 of the information processing device 1 receives the video etc. from each of the four mobile terminals 2 to which the transmission instruction was sent. The video etc. has one or more attribute values including the price of the product in the video, and a terminal identifier. Next, the video acquisition unit 131 pairs the received video and attribute values with the terminal identifier for each of the four mobile terminals 2, and temporarily stores them in a buffer (not shown).
[0269] Next, the ranking means 1321 uses the prices corresponding to the mobile terminals 2 to obtain the ranks (natural numbers from "1" to "4") of each of the four mobile terminals 2 in order of lowest price. Next, the configuration means 1322 composes a screen in which each of the four obtained videos is arranged from top to bottom according to its ranking. The configuration means 1322 also composes a screen including a map showing the locations of the four places (supermarkets) to be compared. The configuration means 1322 also composes a screen having information listing the attribute values (here, prices) of the four places to be compared in order of rank. The configuration means 1322 also composes a screen including the current time obtained from a clock (not shown).
[0270] Next, the screen transmission unit 141 transmits the screen configured by the screen configuration unit 132 to the user terminal 3 that has sent the inquiry.
[0271] Next, the user receiving unit 35 of the user terminal 3 receives the screen from the information processing device 1. Next, the user processing unit 33 composes a screen to be output based on the received screen. The user output unit 36 outputs the screen. An example of such a screen is shown in FIG. 16. In FIG. 16, 1601 to 1604 are windows in which videos taken inside each supermarket are output. The videos are arranged in order of the ranking of each supermarket. 1605 is the ranking result of the attribute value (here, price). 1606 shows the locations of the four supermarkets on a map.
[0272] Through the above process, the user can obtain multiple super videos that he or she wishes to compare, and can also obtain a screen according to the ranking of each of the multiple videos.
[0273] (Example 2) Assume that a user launches an app on the user terminal 3. The app is capable of acquiring and outputting videos of multiple comparison locations. Next, the app is launched on the user terminal 3, and a screen is output. Note that this screen has a "Send" button. Also, this screen does not have any components such as fields for inputting specific information. The "Send" button is a button for sending an inquiry to the information processing device 1.
[0274] Next, the user presses the "Send" button on the screen. Then, the location acquisition unit 331 of the user terminal 3 receives location information (x 21 ,y 21 Next, the user reception unit 32 acquires the position information (x 21 ,y 21 Next, the user processing unit 33 acquires the user identifier "U001" from the user storage unit 31. The inquiry acquisition unit 332 uses the received inquiry to generate the inquiry to be sent, "<user identifier>U001 <specific information>(x 21 ,y 21 Next, the user transmission unit 34 transmits the inquiry to the information processing device 1.
[0275] Next, the inquiry receiving unit 122 of the information processing device 1 receives an inquiry from the user terminal 3, “<user identifier>U001 <specific information>(x 21 ,y 21 )" is received.
[0276] Next, the terminal determination means 1311 determines the specific information (x 21 ,y 21 The terminal determination means 1311 acquires the specific information (x 21 ,y 21 ) and the set of location identifiers (x 22 ,y 22 )(x 23 ,y 23 )(x 24 ,y 24 ) from the group management table (FIG. 14). Next, the terminal determination means 1311 obtains each of the four pieces of location information (x 21,y 21 )(x 22 ,y 22 )(x 23 ,y 23 )(x 24 ,y 24 ) is determined from the terminal management table (Fig. 15). 21 ,y 21 )(x 22 ,y 22 )(x 23 ,y 23 )(x 24 ,y 24 ) are the location information of supermarket A, supermarket B, supermarket C, and supermarket D, respectively. Also, it is assumed that terminal determination means 1311 has acquired terminal identifier "T001" of mobile terminal 2 present in supermarket A, terminal identifier "T002" of mobile terminal 2 present in supermarket B, terminal identifier "T003" of mobile terminal 2 present in supermarket C, and terminal identifier "T004" of mobile terminal 2 present in supermarket D from the terminal management table (Figure 15). Next, instruction sending means 1312 sends a transmission instruction to each of the four mobile terminals 2.
[0277] Next, each of the four mobile terminals 2 transmits video and the like to the information processing device 1 by the same operation as that described in the first specific example.
[0278] Next, the information processing device 1 receives the video or the like, constructs a screen based on the video or the like, and transmits the screen to the user terminal 3 through the same operations as those described in the first specific example.
[0279] Next, the user terminal 3 receives and outputs the screen by the same operation as that described in specific example 1. An example of such output is shown in FIG.
[0280] (Example 3) It is assumed that a user launches an app on the user terminal 3. The app is capable of acquiring and outputting videos of multiple comparison locations. Next, the app is launched on the user terminal 3. The user terminal 3 then outputs a screen for inputting specific information. This screen has a field for inputting specific information and a "send" button. The "send" button is a button for sending an inquiry to the information processing device 1.
[0281] Next, the user inputs the specific information "U101" into the screen and selects the "Send" button. Note that the specific information "U101" is a user identifier.
[0282] Then, the user receiving unit 32 of the user terminal 3 receives the query "<specific information> U101." Next, the user transmitting unit 34 transmits the query "<specific information> U101" to the information processing device 1. Note that the query may also include "<user identifier> U101."
[0283] Next, the inquiry receiving unit 122 of the information processing device 1 receives the inquiry “<specific information> U101” from the user terminal 3.
[0284] Next, the terminal determination means 1311 acquires the specific information "U101" contained in the received inquiry. The terminal determination means 1311 acquires the location identifier set "Supermarket A, Supermarket B, Supermarket C, Supermarket D" that pairs with the specific information "U101" from the group management table (FIG. 14). Next, the terminal determination means 1311 acquires the location information of "Supermarket A, Supermarket B, Supermarket C, Supermarket D" by referring to the map information in the storage unit 11. The location information of each of these four supermarkets is respectively (x 21 ,y 21 )(x 22 ,y 22 )(x 23 ,y 23 )(x 24 ,y 24). Next, terminal determination means 1311 determines the location information of mobile terminal 2 that satisfies the location condition for the location information of each of the four supermarkets (that is, that is located in that supermarket) from the terminal management table (FIG. 15). Here, it is assumed that terminal determination means 1311 has acquired terminal identifier "T001" of mobile terminal 2 that is located in supermarket A, terminal identifier "T002" of mobile terminal 2 that is located in supermarket B, terminal identifier "T003" of mobile terminal 2 that is located in supermarket C, and terminal identifier "T004" of mobile terminal 2 that is located in supermarket D from the terminal management table (FIG. 15).
[0285] Next, the instruction sending means 1312 acquires terminal communication information paired with each of the acquired four terminal identifiers from the terminal management table (FIG. 15). Next, the instruction sending means 1312 transmits a transmission instruction to the mobile terminal 2 that is the communication destination indicated by each of the four pieces of terminal communication information.
[0286] Next, each of the four mobile terminals 2 transmits video and the like to the information processing device 1 by the same operation as that described in the first specific example.
[0287] Next, the information processing device 1 receives the video or the like, constructs a screen based on the video or the like, and transmits the screen to the user terminal 3 through the same operations as those described in the first specific example.
[0288] Next, the user terminal 3 receives and outputs the screen by the same operation as that described in specific example 1. An example of such output is shown in FIG.
[0289] (Example 4) In specific example 4, it is assumed that the terminal management table (FIG. 15) manages terminal information including location information transmitted from a mobile terminal 2 mounted on an automobile. The mobile terminal 2 is, for example, a drive recorder or a navigation terminal.
[0290] It is assumed that the user, while driving a car, passes a point just before the junction between the outbound Tomei Expressway and the outbound Shin-Tomei Expressway. Then, the location acquisition unit 331 of the user terminal 3, which is the navigation terminal of the car, acquires the location information (x31 ,y 31 ) has been acquired. Next, it is assumed that the query acquisition unit 332 determines that the location information satisfies a predetermined condition (for example, matches or the distance is within a threshold) with respect to the location information for constructing a query stored in the user storage unit 31. Next, the query acquisition unit 332 acquires the specific information (x 31 ,y 31 ) and the user identifier of the user storage unit 31. Next, the user sending unit 34 forms a query including the query "<user identifier>U001 <specific information>(x 31 ,y 31 )" to the information processing device 1. Note that the user terminal 3 may continuously acquire location information and continuously transmit inquiries including the location information to the information processing device 1.
[0291] Next, the inquiry receiving unit 122 of the information processing device 1 receives an inquiry from the user terminal 3, “<user identifier>U001 <specific information>(x 31 ,y 31 )" is received.
[0292] Next, the terminal determination means 1311 determines the specific information (x 31 ,y 31 The terminal determination means 1311 acquires the specific information (x 31 ,y 31 ) from the group management table (Fig. 14). Next, the terminal determination means 1311 refers to the map information in the storage unit 11 and acquires each piece of location information of "Tomei Expressway inbound point X, Shin-Tomei Expressway inbound point Y". The location information of each point of each of these two expressways is respectively (x h1 ,y h1 )(x h2 ,y h2 Next, the terminal determination means 1311 determines the position information (x h1 ,y h1 )(x h2 ,y h2) from the terminal management table (FIG. 15). Here, it is assumed that the terminal determination means 1311 acquires the terminal identifier "T001" of the mobile terminal 2 traveling on "Point X on the outbound Tomei Expressway" and the terminal identifier "T002" of the mobile terminal 2 traveling on "Point Y on the outbound Shin-Tomei Expressway" from the terminal management table (FIG. 15).
[0293] Next, the instruction sending means 1312 acquires terminal communication information paired with each of the two acquired terminal identifiers from the terminal management table (FIG. 15). Next, the instruction sending means 1312 transmits a transmission instruction to the mobile terminal 2, which is the communication destination indicated by each of the two pieces of terminal communication information.
[0294] Next, the mobile receiving unit 22 of each of the two mobile terminals 2 receives a transmission instruction from the information processing device 1. Next, the photographing unit 232 acquires the video. Furthermore, the attribute value acquiring unit 233 acquires one or more attribute values. Here, it is assumed that the attribute value acquiring unit 233 acquires the number of cars in the video and the attribute value indicating the congestion level based on the number of cars. Furthermore, the configuration unit 234 acquires a terminal identifier from the mobile storage unit 21. The configuration unit 234 associates the video with one or more attribute values and a terminal identifier to configure information to be transmitted. Next, the mobile transmitting unit 24 transmits the video, etc. to the information processing device 1.
[0295] Next, the video receiving means 1313 of the information processing device 1 receives the video etc. from each of the two mobile terminals 2 to which the transmission instruction was sent. The video etc. includes the number of cars in the video, the congestion level, and a terminal identifier. Next, the video acquisition unit 131 pairs the received video and attribute value with the terminal identifier for each of the two mobile terminals 2, and temporarily stores them in a buffer (not shown).
[0296] Next, the ranking means 1321 obtains a rank ("1" or "2") for each of the two mobile terminals 2 in ascending order of congestion level using the congestion level corresponding to the mobile terminal 2. Next, the configuration means 1322 configures a screen in which each of the two obtained videos is arranged according to the ranking. The screen also includes information including the names of expressways and the congestion level of each road.
[0297] Next, the screen transmission unit 141 transmits the screen configured by the screen configuration unit 132 to the user terminal 3 that has sent the inquiry.
[0298] Next, the user receiving unit 35 of the user terminal 3 receives the screen from the information processing device 1. Next, the user processing unit 33 composes a screen to be output based on the received screen. The user processing unit 33 composes a single screen that combines the information of the received screen and the information of the screen being output. The screen being output is a map during navigation.
[0299] Next, the user output unit 36 outputs the screen. An example of such a screen is shown in Fig. 17. In Fig. 17, 1701 is a map displayed on the navigation terminal, which is the user terminal 3, and an icon 1702 of the user's car is displayed at the position of the road on which the user is traveling. Also, a video 1703 with a rank of "1" is arranged in the center of the screen, and a video 1704 with a rank of "2" is arranged on the left side of the screen. Also, 1705 shows the degree of congestion on each road.
[0300] By outputting the screen of FIG. 17, the user can select an appropriate expressway from among a plurality of expressways before a fork in the road, and continue driving.
[0301] As described above, according to this embodiment, videos of a plurality of locations to be compared can be provided.
[0302] Furthermore, according to this embodiment, ranked videos can be provided.
[0303] The processing in this embodiment may be implemented by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software implementing the information processing device 1 in this embodiment is the following program. That is, this program causes a computer to function as: an inquiry receiving unit that receives, from a user terminal, an inquiry including specific information that identifies multiple locations to be compared; a video acquiring unit that acquires videos transmitted from mobile terminals located in each of the multiple locations identified by the specific information; a screen composing unit that uses the multiple videos to compose a single screen; and a screen transmitting unit that transmits the single screen to the user terminal.
[0304] (Embodiment 2) <Outline of Second Embodiment>
[0305] The present embodiment differs from the first embodiment in that the mobile terminal 2 constantly transmits videos to the information processing device. In the second embodiment, when the information processing device receives a query, it acquires videos of multiple comparison locations corresponding to the query from the stored videos. <Outline of Information System B>
[0306] The conceptual diagram of information system B in this embodiment is the same as that of information system A, except for the reference numerals of the devices.
[0307] Fig. 18 is a block diagram of information system B in this embodiment. Details of mobile terminal 2 and user terminal 3 are omitted from Fig. 18. Details of right holder processing unit 133 are also omitted from Fig. 18.
[0308] The information system B includes an information processing device 4, one or more mobile terminals 2, and one or more user terminals 3.
[0309] The information processing device 4 includes a storage unit 41, a receiving unit 42, a processing unit 43, and a transmission unit 14. The storage unit 41 includes a group management unit 111, a terminal management unit 112, and a video storage unit 411. The receiving unit 42 includes an inquiry receiving unit 122 and a video receiving unit 421. The processing unit 43 includes a video accumulation unit 431, a video acquisition unit 432, a screen composition unit 132, and a right holder processing unit 133. <Details of Components of Information Processing Device 4>
[0310] Various types of information are stored in the storage unit 41. The various types of information include, for example, group information, terminal information, videos, one or more attribute values associated with the videos, and map information.
[0311] The video storage unit 411 stores one or more videos. A user identifier is usually associated with each video. For example, one or more attribute values are associated with each video. For example, time information and position information are associated with each frame that constitutes a video.
[0312] The video receiving unit 421 receives videos associated with location information from each of the multiple mobile terminals 2. The location information is usually (latitude, longitude), but may be a location identifier such as a location name. The video receiving unit 421 continuously acquires videos from each of the multiple mobile terminals 2. The videos are usually additional videos.
[0313] The processing unit 43 performs various types of processing, such as processing performed by the video storage unit 431, the video acquisition unit 432, the screen composition unit 132, or the right holder processing unit 133.
[0314] Video accumulation unit 431 accumulates the video received by video receiving unit 421. Video accumulation unit 431 normally accumulates the video in association with the terminal identifier of mobile terminal 2. Video accumulation unit 431 normally accumulates the video in video storage unit 411. Each frame constituting the video accumulated by video accumulation unit 431 is normally associated with position information.
[0315] The video acquisition unit 432 acquires videos transmitted from the mobile terminals 2 present at the locations specified by the specific information contained in the received inquiry.
[0316] The video acquisition unit 432 acquires a video associated with location information corresponding to each of the multiple locations identified by the identification information from among the multiple videos accumulated in the video accumulation unit 431. The video acquisition unit 432 acquires a video associated with location information corresponding to each of the multiple locations identified by the identification information from among the multiple videos in the video storage unit 411, for example. <Description of Components of Mobile Terminal 2>
[0317] Here, the mobile receiving unit 22 of the mobile terminal 2 does not receive a transmission instruction. The mobile transmitting unit 24 of the mobile terminal 2 continuously transmits the video to the information processing device 4. Note that continuously transmitting means transmitting two or more times. Continuously transmitting means, for example, transmitting all the time, transmitting periodically, or transmitting two or more times irregularly.
[0318] The storage unit 41 and the moving image storage unit 411 are preferably non-volatile recording media, but can also be realized as volatile recording media.
[0319] There is no restriction on the process by which information is stored in the storage unit 41 etc. For example, information may be stored in the storage unit 41 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 41 etc., or information input via an input device may be stored in the storage unit 41 etc.
[0320] The receiving unit 42 and the video receiving unit 421 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.
[0321] The processing unit 43, video storage unit 431, and video acquisition unit 432 can usually be realized by a processor, memory, etc. The processing procedures of the processing unit 43, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter. <Operation>
[0322] Next, an example of the operation of the information processing device 4 will be described with reference to the flowchart of Fig. 19. In the flowchart of Fig. 19, the description of the same steps as those in the flowchart of Fig. 4 will be omitted.
[0323] (S1901) Video receiving unit 421 determines whether or not video or the like has been received from one or more mobile terminals 2. If video or the like has been received, the process proceeds to S1902, and if video or the like has not been received, the process proceeds to S403.
[0324] (S1902) Video accumulation unit 431 accumulates one or more videos in video storage unit 411 in association with the terminal identifier.
[0325] (S1903) Video acquisition unit 432 determines videos of multiple locations corresponding to the inquiry from among the videos stored in video storage unit 411. An example of such video determination processing will be described with reference to the flowchart in FIG.
[0326] (S1904) The moving image acquisition unit 432 acquires the moving images, etc. identified by the multiple moving image identifiers determined in S1903 from the moving image storage unit 411. The process proceeds to S408.
[0327] In the flowchart of FIG. 19, the process ends when the power is turned off or an interrupt occurs to end the process.
[0328] Next, an example of the video selection process in S1903 will be described with reference to the flowchart in Fig. 20. In the flowchart in Fig. 20, the description of the same steps as in the flowchart in Fig. 5 will be omitted.
[0329] (S2001) Moving image acquisition unit 432 determines whether or not the j-th moving image exists in moving image storage unit 411. If the j-th moving image exists, the process proceeds to S2002, and if not, the process returns to the upper processing.
[0330] (S2002) Video acquisition unit 432 determines whether the jth location information and the latest location information associated with the jth video in video storage unit 411 satisfy the location condition. If the location condition is satisfied, the process proceeds to S2003; if the location condition is not satisfied, the process proceeds to S509.
[0331] (S2003) The moving image acquiring unit 432 acquires a moving image identifier for identifying the j-th moving image, and temporarily stores the moving image identifier in a buffer (not shown) in association with the i-th position information.
[0332] (S2004) The video acquisition unit 432 determines one video identifier from one or more video identifiers associated with the i-th location information. Note that the video acquisition unit 432 determines, for example, one video identifier of location information that minimizes the distance between the position indicated by the location information paired with the video identifier and the position indicated by the i-th location information.
[0333] As described above, according to this embodiment, videos of a plurality of locations to be compared can be provided.
[0334] Furthermore, according to this embodiment, ranked videos can be provided.
[0335] The software that realizes the information processing device 4 in this embodiment is the following program. That is, this program causes a computer to function as an inquiry receiving unit that receives, from a user terminal, an inquiry including specific information that identifies multiple locations to be compared, a video acquiring unit that acquires videos transmitted from mobile terminals located in each of the multiple locations identified by the specific information, a screen composing unit that composes a single screen using the multiple videos, and a screen transmitting unit that transmits the single screen to the user terminal.
[0336] 21 shows the appearance of a computer that executes the programs described herein to realize the information processing device 1 and the like according to the various embodiments described above. The above-described embodiments can be realized by computer hardware and a computer program executed thereon. FIG. 21 is an overview of this computer system 300, and FIG. 22 is a block diagram of the system 300.
[0337] In FIG. 21, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.
[0338] 22, computer 301 includes, in addition to CD-ROM drive 3012, MPU 3013, bus 3014 connected to CD-ROM drive 3012 etc., ROM 3015 for storing programs such as a boot-up program, RAM 3016 connected to MPU 3013 for temporarily storing instructions of application programs and providing temporary storage space, and hard disk 3017 for storing application programs, system programs, and data. Although not shown here, computer 301 may further include a network card for providing connection to a LAN.
[0339] A program that causes computer system 300 to execute the functions of information processing device 1 and the like of the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and then transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may also be loaded directly from CD-ROM 3101 or the network.
[0340] The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-described embodiment. The program only needs to include instructions that call appropriate functions (modules) in a controlled manner and achieve desired results. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.
[0341] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).
[0342] The computer that executes the program may be a single computer or a plurality of computers, that is, it may perform centralized processing or distributed processing.
[0343] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be physically realized by one medium.
[0344] Furthermore, in each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.
[0345] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention. [Industrial Applicability]
[0346] As described above, the information processing device 1 according to the present invention has the effect of being able to provide videos of a plurality of locations to be compared, and is useful as a server or the like that provides videos.
Claims
1. an inquiry receiving unit that receives, from a user terminal, an inquiry including identification information that identifies a plurality of locations to be compared; an image acquisition unit that acquires images transmitted from mobile terminals present at each of the plurality of locations identified by the identification information; a screen composition unit that composes one screen using the plurality of images; and a screen transmission unit that transmits the one screen to the user terminal.
2. The image acquisition unit The information processing device of claim 1, further comprising: a group management unit that stores one or more group information pieces including location identifiers that identify each of a plurality of locations to be compared; a plurality of location identifiers corresponding to the specific information included in the query; and an information processing device that acquires the images received from the mobile terminals located in each of the plurality of locations identified by the plurality of location identifiers.
3. The image acquisition unit 3. An information processing device according to claim 1, wherein an instruction to transmit an image is sent to the mobile terminals present at each of the plurality of locations specified by the specific information, and the image is received from the mobile terminals in response to the transmission of the instruction to transmit the image.
4. a location receiving unit that receives location information from each of the plurality of mobile terminals; The image acquisition unit a terminal determination means for determining, using the location information received by the location receiving unit, a mobile terminal present at each of the plurality of locations identified by the identification information; an instruction transmitting means for transmitting the transmission instruction to each of the plurality of mobile terminals determined by the terminal determining means; 4. The information processing apparatus according to claim 3, further comprising image receiving means for receiving images from each of said plurality of mobile terminals.
5. The image acquisition unit an instruction sending means for sending an inquiry based on the specific information to a plurality of mobile terminals; 3. The information processing apparatus according to claim 1, further comprising: an image receiving means for receiving an image from each of said plurality of mobile terminals determined to correspond to said specific information in response to said inquiry being transmitted.
6. an image receiving unit that receives images associated with location information from a plurality of mobile terminals; an image storage unit that stores each of the plurality of images in association with the position information; The image acquisition unit 3. The information processing apparatus according to claim 1, wherein an image associated with position information corresponding to each of the plurality of locations specified by the specific information is acquired from the plurality of images stored in the image storage unit.
7. The screen configuration unit a ranking means for acquiring attribute values of each of the plurality of images and ranking the plurality of images using the attribute values; 2. The information processing apparatus according to claim 1, further comprising: configuration means for configuring said one screen in accordance with the ranking of each of said plurality of images.
8. 2. The information processing apparatus according to claim 1, further comprising a third security means for storing the plurality of images or the one screen including the plurality of images in association with a rights holder identifier that identifies a user of the user terminal.
9. a location acquisition unit that acquires a location identifier that identifies a location of the user terminal; an inquiry acquisition unit that acquires an inquiry including specific information using the location identifier; a user transmission unit that transmits the inquiry to an information processing device; a user receiving unit that receives from the information processing device a screen configured using images of a plurality of places including the place identified by the place identifier; a user output unit that outputs the one screen;
10. an inquiry acquisition unit that acquires an inquiry including specific information including a user identifier; a user transmission unit that transmits the inquiry to an information processing device; a user receiving unit that receives from the information processing device a screen configured using images of a plurality of places identified by a plurality of place identifiers corresponding to the user identifier; a user output unit that outputs the one screen;
11. An information processing method realized by an inquiry receiving unit, an image acquiring unit, a screen composing unit, and a screen transmitting unit, an inquiry receiving step in which the inquiry receiving unit receives an inquiry including identification information that identifies a plurality of locations to be compared from a user terminal; an image acquisition step in which the image acquisition unit acquires images transmitted from mobile terminals present at each of the plurality of locations identified by the identification information; a screen composing step in which the screen composing unit composes one screen using the plurality of images; a screen transmission step in which the screen transmission unit transmits the one screen to the user terminal.
Citation Information
Patent Citations
Advertisement moving picture generating distribution system and method
JP2005286882A
Image display system, display device and display method
JP2008154192A
Medium processing unit, program and method
JP2019041328A
Display device for vehicle
JP2019118066A