Mobile terminal, information processing device, and information processing method

The mobile terminal and information processing device address the limitation of conventional systems by acquiring and outputting moving images from multiple cameras, enabling enhanced situational awareness and navigation assistance through real-time and past video synchronization of vehicles on the same road.

WO2024232011A1PCT designated stage expired Publication Date: 2024-11-14MICWARE CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/017421
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Conventional vehicle drive recorder systems cannot effectively support movement by using a moving image of one moving object and a moving image of another moving object, limiting assistance in navigation and situational awareness.

Method used

A mobile terminal and information processing device that acquire and output moving images from multiple cameras, including those of the user's vehicle and other vehicles on the same road, with features like video reception, processing, and transmission to provide real-time and past video synchronization for enhanced situational awareness.

Benefits of technology

Enables effective assistance in movement by providing real-time and past video synchronization of multiple vehicles, enhancing navigation and situational awareness, particularly for vehicles on the same road.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023017421_14112024_PF_FP_ABST
    Figure JP2023017421_14112024_PF_FP_ABST
Patent Text Reader

Abstract

[Problem] To solve the problem that prior art cannot support movement by using a video of one moving body and a video of another moving body. [Solution] This mobile terminal 2 includes: a movement acquisition unit 242 for acquiring a first video captured by a first camera which is a camera of one moving body; a movement reception unit 23 for receiving a second video captured by a second camera which is a camera of another moving body satisfying a selection condition including traveling on the same road as the one moving body; and a movement output unit 26 for outputting the first moving image and the second moving image. The mobile terminal 2 makes it possible to support the movement by using the video of one moving body and the video of another moving body.
Need to check novelty before this filing date? Find Prior Art

Description

Mobile terminal, information processing device, and information processing method

[0001] The present invention relates to an information processing device or the like that outputs a video of one moving object and a video of another moving object.

[0002] 2. Description of the Related Art Conventionally, there has been a vehicle drive recorder system that can capture images of the vehicle's surrounding environment using a plurality of imaging means while reducing increases in recording capacity and processing load (see Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2023-45448

[0004] However, in the prior art, it was not possible to provide assistance regarding movement using a video of one moving body and a video of another moving body. Note that the video of one moving body is a video taken by a camera installed on the moving body of the user watching the video. Note that the video of another moving body is a video taken by a camera installed on the moving body of another user. Note that the one moving body may also be referred to as the own moving body. The other moving body may also be referred to as another moving body.

[0005] The mobile terminal of the first invention is a mobile terminal that includes a mobile acquisition unit that acquires a first video captured by a first camera that is a camera of one mobile body, a mobile receiving unit that receives a second video captured by a second camera that is a camera of another mobile body that satisfies the selection conditions, and a mobile output unit that outputs the first video and the second video.

[0006] With this configuration, it is possible to output a video of one moving object and a video of another moving object, thereby providing support regarding movement.

[0007] In addition, the mobile terminal of the second invention, compared to the first invention, is a mobile terminal in which the selection condition is that another moving body is traveling on the same road as the first moving body, and the second video is a video of another person traveling on the same road as the first moving body.

[0008] With this configuration, assistance regarding movement can be provided using video of one moving object and video of another moving object traveling on the same road.

[0009] Furthermore, the mobile terminal of the third invention is a mobile terminal in which, compared to the first or second invention, the mobile acquisition unit acquires first videos which are videos from each of a plurality of first cameras of a single mobile object, and the mobile output unit outputs each of the plurality of first videos and the second video.

[0010] With this configuration, assistance regarding movement can be provided using a plurality of different videos of one moving object and videos of other moving objects.

[0011] Furthermore, the mobile terminal of the fourth invention is a mobile terminal in which, compared to any one of the first to third inventions, the mobile output unit outputs a past first video, which is a first video acquired in the past by the mobile acquisition unit.

[0012] With this configuration, assistance regarding movement can be provided using past video of one moving object and video of another moving object.

[0013] Furthermore, the mobile terminal of the fifth invention differs from the mobile terminal of the fourth invention in that, when outputting a past first video, the mobile output unit outputs a past second video, which is a second video previously received by the mobile receiving unit, and which is synchronized in time with the past first video.

[0014] With this configuration, assistance regarding movement can be provided by using past video of one moving object and past video of another moving object that is synchronized with the video.

[0015] Furthermore, the mobile terminal of the sixth invention is a mobile terminal according to any one of the first to fifth inventions, which is installed in a position visible to a user in a passenger seat of a moving object.

[0016] With this configuration, the passenger in the passenger seat can receive assistance with transportation using video of one moving body and video of another moving body.

[0017] In addition, the information processing device of the seventh invention is an information processing device that includes a video receiving unit that receives a second video, which is a video from a second camera corresponding to another mobile terminal; a determination unit that refers to a terminal management unit in which terminal information including location information is stored in correspondence with each of one or more mobile terminals, and determines other mobile terminals that meet selection conditions for one mobile terminal; and a video sending unit that transmits the second video corresponding to the other mobile terminal determined by the determination unit to the one mobile terminal.

[0018] With this configuration, assistance regarding movement can be provided using video of one moving object and video of another moving object.

[0019] In addition, the information processing device of the eighth invention is an information processing device in which, compared to the seventh invention, the selection condition is that another mobile body is traveling on the same road as the one mobile body, and the determination unit determines another mobile terminal for location information corresponding to the same road identifier as the road identifier corresponding to the location information for the one mobile terminal.

[0020] With this configuration, assistance regarding movement can be provided using video of one moving object and video of another moving object traveling on the same road.

[0021] According to the information processing device of the present invention, assistance regarding movement can be provided using a video of one moving object and a video of another moving object.

[0022] FIG. 1 is a conceptual diagram of an information system A in the first embodiment; FIG. 2 is a block diagram of the information system A; FIG. 3 is a flowchart illustrating an example of an operation of the information processing device 1; FIG. 4 is a flowchart illustrating an example of a video acquisition process; FIG. 5 is a flowchart illustrating an example of a fourth maintenance process;

[0023] Hereinafter, embodiments of an information processing device and the like will be described with reference to the drawings. Note that components with the same reference numerals in the embodiments perform similar operations, and therefore repeated description may be omitted.

[0024] (Embodiment 1) In this embodiment, a mobile terminal that outputs one or more videos of one moving object and videos of one or more other moving objects will be described. It is preferable that the one moving object and the other moving objects are traveling on the same road. It is also preferable that the one moving object and the other moving objects are traveling on the same road and that the other moving objects are traveling in front of the one moving object.

[0025] In this embodiment, a mobile terminal that outputs past videos captured in the past of one moving object will be described, and a mobile terminal that, when outputting the past videos, outputs past videos of other moving objects that are synchronized with the past videos will be described.

[0026] Furthermore, in this embodiment, an information processing device that receives a moving image from a mobile terminal of another mobile body and transmits the moving image to a mobile terminal of one mobile body will be described.

[0027] In this specification, information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important. Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc. <Outline of Information System A>

[0028] 1 is a conceptual diagram of an information system A according to this embodiment. The information system A includes an information processing device 1 and one or more mobile terminals 2.

[0029] The information processing device 1 is a device that transmits video received from one mobile terminal 2 to another mobile terminal 2. The information processing device 1 is usually a server that provides video to the mobile terminal 2. The information processing device 1 is, for example, a cloud server, an ASP server, or the like, but the type is not important. The information processing device 1 may also be a device that constitutes a blockchain.

[0030] Furthermore, the time interval between the capture of each of the multiple still images included in the moving image in this specification does not matter. The moving image may be, for example, a moving image at 60 frames per second or 30 frames per second, but may also be a collection of multiple still images captured at intervals of a predetermined time (for example, one minute) or more, or a collection of multiple still images captured when predetermined conditions are met. The still images may also be called fields or frames.

[0031] The mobile terminal 2 is a mobile terminal that can move. The mobile terminal 2 is a device that shoots and outputs video. The mobile terminal 2 is a device that receives and outputs video transmitted from another mobile terminal 2. The mobile terminal 2 usually receives video transmitted from another mobile terminal 2 via the information processing device 1, but may also receive video directly from another mobile terminal 2. The mobile terminal 2 is, for example, a device that shoots video and transmits it to the information processing device 1. The mobile terminal 2 is a terminal installed on a moving object. The mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, camera-equipped glasses, a camera-equipped smartwatch, or a dashcam. Furthermore, "installed" usually means "fixed," but it may also be considered to include being in contact with or held by something. The mobile object is a moving object, such as a car, a motorcycle, or a bicycle.

[0032] 2 is a block diagram of information system A in this embodiment. Information processing device 1 includes a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14. Storage unit 11 includes a terminal management unit 111. Receiving unit 12 includes a video receiving unit 121. Processing unit 13 includes a video accumulation unit 131, a determination unit 132, a video acquisition unit 133, and right holder processing unit 134. Right holder processing unit 134 includes first security means 1341, second security means 1342, third security means 1343, fourth security means 1344, and remuneration means 1345. Transmission unit 14 includes a video transmission unit 141.

[0033] The mobile terminal 2 includes a movement storage unit 21, a movement acceptance unit 22, a movement reception unit 23, a movement processing unit 24, a movement transmission unit 25, and a movement output unit 26. The movement processing unit 24 includes a position acquisition unit 241, a movement acquisition unit 242, an attribute value acquisition unit 243, a movement acquisition unit 242, and a configuration unit 244. <Details of components of information processing device 1>

[0034] Various types of information are stored in the storage unit 11. The various types of information include, for example, terminal information (described later), videos associated with the terminal information, one or more attribute values, and map information. The attribute values ​​are, for example, video attribute values.

[0035] Video attribute values ​​are attribute values ​​of a video. Examples of video attribute values ​​include environmental information. Environmental information is information about the environment in which a video was shot. Examples of environmental information include location information, time information, weather information, temperature information, seasonal information, and road attribute values. Location information is information that identifies a location. Location information is, for example, (latitude, longitude) or (movement, longitude, altitude). Time information is information that identifies the time when a video was shot. The time when a video was shot may be around the time the video was shot, and accuracy is not required. Examples of time information include the time, year / month / date / time, year / month / date / minute, year / month / date / minute / second, year / month / day, and month / day. In other words, the granularity of the time indicated by the time information does not matter. Weather information is information that identifies the weather at the location (or region) where the video was shot. Examples of weather information include "sunny," "rain," "snow," and "cloudy." Temperature information is information that identifies the temperature at the location where the video was shot. The temperature information is, for example, "25 degrees" or "30 degrees or higher." The season information is information that identifies the season at the location where the video was shot. The season information is, for example, "spring," "summer," "early summer," or "winter."

[0036] The road attribute value is an attribute value of the road corresponding to the location where the video was shot. The road attribute value is, for example, the type of road, the road name, the road width, and point information. The point information is information related to a point. The point information is, for example, position information, the point name, and the point ID.

[0037] The terminal management unit 111 stores one or more pieces of terminal information. The terminal information is information related to the mobile terminal 2. The terminal information is associated with the mobile terminal 2. The terminal information typically includes a terminal identifier, which is an identifier of the mobile terminal 2, and terminal communication information. The terminal information typically includes one or more attribute values ​​including location information. One or more attribute values ​​may be referred to as an attribute value set. The attribute value is, for example, a video attribute value. The terminal information includes, for example, a request flag and a selection condition. The request flag is information indicating that the video is sent from another mobile terminal 2 and that the video satisfies the selection condition. The selection condition is a condition for selecting a video to be sent to the mobile terminal 2. The selection condition included in the terminal information is a selection condition specific to the mobile terminal 2. If the terminal information does not include a selection condition, the selection condition of the mobile terminal 2 corresponding to the terminal information is a default selection condition. The default selection condition is stored, for example, in the storage unit 11.

[0038] The terminal identifier is information that identifies the mobile terminal 2. The terminal identifier may be a rights holder identifier that identifies the rights holder who is the user of the mobile terminal 2. The terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.

[0039] A rights holder is a person who has some right to a video shot by the mobile terminal 2. A rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that shot the video, or the person with the right to dispose of the video. A rights holder is, for example, the initial rights holder of the video. The rights holder is usually the owner of the mobile terminal 2, but it may be any person who has the rights to the video shot by the mobile terminal 2.

[0040] The right holder identifier may be a terminal identifier. The right holder identifier is, for example, the right holder's ID, name, email address, or telephone number. The right holder's ID is, for example, a user identifier.

[0041] The terminal communication information is information for communicating with the mobile terminal 2. The terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of the communication application installed in the mobile terminal 2.

[0042] The map information is used to obtain, for example, point information corresponding to the location information, road identifiers corresponding to the location information, or road attribute values ​​corresponding to the location information. The map information is, for example, in the KIWI format, but the data structure is not critical.

[0043] The receiving unit 12 receives various types of information and instructions. The various types of information and instructions are, for example, an attribute value set, a video, an inquiry, and a purchase instruction, which will be described later. An attribute value set is one or more attribute values. An attribute value set typically includes location information. A query is information sent from one mobile terminal 2 requesting a video from another mobile terminal 2. A query typically has selection conditions. A query typically corresponds to a terminal identifier.

[0044] The video receiving unit 121 receives video from the mobile terminal 2. The video receiving unit 121 may receive video from multiple mobile terminals 2. The video receiving unit 121 may receive video that is determined by the mobile terminal 2 to satisfy the selection conditions, or may receive all video shot by the mobile terminal 2. The video receiving unit 121 normally receives video that corresponds to a rights holder identifier from the mobile terminal 2. It is preferable that the video received from the mobile terminal 2 is associated with an attribute value set. The video that is associated with an attribute value set is an additional video.

[0045] The video receiving unit 121 receives a second video. The second video is a video captured by a second camera corresponding to another mobile terminal 2, different from the first mobile terminal 2 to which the video is transmitted. The second video is preferably a video captured by a second camera of another mobile terminal traveling on the same road as the first mobile terminal.

[0046] The second camera corresponding to the other mobile terminal 2 is a camera mounted on a moving body on which the other mobile terminal 2 is mounted. The second camera may be provided in the other mobile terminal 2, or may not be present in the other mobile terminal 2.

[0047] The processing unit 13 performs various types of processing, such as processing performed by a video storage unit 131, a determination unit 132, a video acquisition unit 133, and a rights holder processing unit 134.

[0048] The video accumulation unit 131 accumulates the video received by the video receiving unit 121 from the mobile terminal 2. Such video is a second video. It is preferable that the video accumulation unit 131 accumulates the received video in association with a rights holder identifier associated with the video. The video accumulation unit 131 accumulates the video in, for example, the storage unit 11, but may also accumulate the video in a blockchain or an external device.

[0049] The determination unit 132 refers to the terminal management unit 111 and determines, for one mobile terminal 2, one or more other mobile terminals 2 that match the selection conditions.

[0050] The selection condition is a condition for determining another mobile terminal 2 to which a video is provided. The selection condition is, for example, a condition regarding the relationship between one or more attribute values ​​of a mobile terminal 2 receiving a video and one or more attribute values ​​of another mobile terminal 2 transmitting a video. The selection condition is, for example, a condition regarding the positional relationship, which is the relationship between the position information of a mobile terminal 2 receiving a video and the position information of another mobile terminal 2 transmitting a video. The condition regarding the positional relationship is, for example, a condition regarding the presence of the one mobile terminal 2 and the other mobile terminal 2 on the same road, or a condition regarding the distance between the one mobile terminal 2 and the other mobile terminal 2. The selection condition is, for example, a condition regarding the attribute value of the other mobile terminal 2. The attribute value of the other mobile terminal 2 here is, for example, the attribute value, tag, and video analysis result of the mobile object on which the other mobile terminal 2 is installed. The attribute value of the mobile object is, for example, the type of vehicle (e.g., truck) of the mobile object.

[0051] The determination unit 132 acquires, for example, a selection condition included in the terminal information of one mobile terminal 2 from the terminal management unit 111. Next, the determination unit 132 acquires, for example, one or more terminal identifiers that are paired with one or more attribute values ​​that match the selection condition from the terminal management unit 111.

[0052] For example, when the terminal information of one mobile terminal 2 does not include a selection condition, the determination unit 132 acquires default selection conditions from the storage unit 11. Next, the determination unit 132 acquires, from the terminal management unit 111, one or more terminal identifiers that are paired with one or more attribute values ​​that match the selection condition.

[0053] The determination unit 132 determines, for example, another mobile terminal 2 for which location information corresponds to the same road identifier as the road identifier corresponding to the location information for one mobile terminal 2. In this case, the selection condition is that the other mobile terminal is traveling on the same road as the one mobile terminal 2. Note that the determination unit 132, for example, refers to the map information in the storage unit 11 and acquires the road identifier corresponding to the location information.

[0054] The video acquisition unit 133 acquires the videos transmitted by one or more other mobile terminals 2 determined by the determination unit 132. The videos acquired by the video acquisition unit 133 are preferably additional videos. It is preferable that position information is associated with frames constituting the additional videos.

[0055] The video acquired by the video acquisition unit 133 is, for example, (1) a video that is constantly transmitted by another mobile terminal 2, or (2) a video that is received from another mobile terminal 2 by transmitting a transmission instruction to the other mobile terminal 2. Two cases will be explained below. (1) A case where a video that is constantly transmitted by another mobile terminal 2 is acquired

[0056] The video acquisition unit 133 acquires a video from the storage unit 11, for example. The video acquisition unit 133 may acquire a video from an external device (not shown). The video acquisition unit 133 acquires, for example, a video paired with the terminal identifier of each of one or more mobile terminals 2 determined by the determination unit 132, and stored video. The mobile terminal 2 determined by the determination unit 132 is another mobile terminal 2. (2) When acquiring a video received from a mobile terminal 2 by transmitting a transmission instruction to another mobile terminal 2

[0057] For example, the video acquisition unit 133 transmits a transmission instruction to a mobile terminal 2 identified by the terminal identifier of each of the one or more mobile terminals 2 determined by the determination unit 132. Then, in response to the transmission of the transmission instruction, the video acquisition unit 133 receives video from each of the one or more mobile terminals 2. Note that the mobile terminal 2 determined by the determination unit 132 is another mobile terminal 2.

[0058] The rights holder processing unit 134 performs rights holder processing. The rights holder processing is processing related to the rights holder identified by the rights holder identifier associated with the video. Note that the video here is, for example, a video received by the video receiving unit 121.

[0059] The right holder processing unit 134 performs right holder processing, which is processing in response to the video transmission by the video transmission unit 141 and is processing related to the right holder identified by the right holder identifier associated with the video. The right holder processing is, for example, a first security processing, a second security processing, a third security processing, a fourth security processing, and a compensation processing, which will be described later.

[0060] The right holder identifier associated with one video is, for example, the right holder identifier corresponding to the mobile terminal 2 that transmitted the video, or the identifier of the user of the mobile terminal 2 to which the video was transmitted.

[0061] The first security means 1341 performs a first security process of storing the video received by the video receiving unit 121 in association with a set of attribute values ​​associated with the video. The first security means 1341 stores the video in a blockchain, for example.

[0062] The second security means 1342 performs a second security process of storing the video received by the video receiving unit 121 in association with the right holder identifier corresponding to the video. The second security means 1342 stores the video in a blockchain, for example.

[0063] The third security means 1343 stores the video output by the video transmission unit 141 in association with a rights holder identifier that identifies the user of the mobile terminal 2 to which the video was transmitted. The third security means 1343 stores, for example, the rights holder identifier that identifies the user of the mobile terminal 2 in association with the video. The third security means 1343 stores, for example, the rights holder identifier in the storage unit 11 or the blockchain.

[0064] The video is stored in, for example, the storage unit 11, but may also be stored in other devices, such as other devices that make up the blockchain.

[0065] The fourth security means 1344 performs a fourth security process to store security information. The security information includes access information for accessing the stored video. The order of storing the video and performing the fourth security process on the security information corresponding to the video does not matter.

[0066] The fourth security means 1344 performs a fourth security process, for example, of storing security information including access information for accessing the videos stored in the video storage unit 131 in the blockchain.

[0067] It is preferable that the fourth security means 1344 stores the security information in a blockchain. That is, it is preferable that the fourth security means 1344 stores the security information in a distributed ledger of the blockchain. It is preferable that the fourth security means 1344 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1344 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.

[0068] The preservation information is information for ensuring the originality of a video. It can be said that the preservation information is the header information of the video. The preservation information is, for example, access information and a set of attribute values. It is preferable that the preservation information has, for example, one or more rights holder identifiers. When the preservation information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information. The rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder. The fourth preservation process can ensure the originality of the preservation information of the registered video. By ensuring the originality of the preservation information, the originality of the video corresponding to the preservation information is also guaranteed. The access information is information for accessing the video. The access information is information that identifies the storage location of the video. The access information is, for example, a URL or a URI.

[0069] The security information preferably includes information (which may be called a flag) indicating whether the video can be provided to a third party. The flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.

[0070] The remuneration means 1345 performs remuneration processing for each right holder identified by the right holder identifier associated with the video transmitted by the video transmission unit 141 .

[0071] The reward process is a process of providing a reward. The reward process is, for example, a process of increasing points managed in pairs with one or more rights holder identifiers associated with a video. The reward process is, for example, a process of depositing money to a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is, for example, a process of transmitting a video or other content to a mobile terminal 2 of a rights holder identified by one or more rights holder identifiers associated with a video. The reward process is not limited to the type of merit provided to the rights holder identified by one or more rights holder identifiers associated with the video. The reward may be, for example, money, points, goods, content, or the like, and the type of merit is not limited.

[0072] It is preferable that the compensation means 1345 acquires one or more video attribute values ​​corresponding to the video transmitted by the video transmission unit 141, and performs compensation processing, which is a process of determining compensation to the rights holder and awarding the compensation using the one or more video attribute values.

[0073] Here, the one or more video attribute values ​​are, for example, the amount of video data, the duration of the video, the number of video frames, the resolution of the video, and a road attribute value.

[0074] The reward means 1345 preferably acquires a reward amount corresponding to a service identifier that identifies a service provided for a target video, and performs a reward process that awards a reward corresponding to the reward amount. The service identifier may be, for example, "view" or "purchase." In this case, the storage unit 11 stores, for example, the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.

[0075] The reward means 1345 performs reward processing, which is a process of obtaining a reward amount using, for example, one or more pieces of information from one or more video attribute values ​​and one or more service identifiers, and awarding a reward corresponding to the reward amount. In such a case, for example, an arithmetic expression or a correspondence table corresponding to each of the multiple service identifiers is stored in the storage unit 11. The arithmetic expression is a formula for calculating the reward amount using one or more video attribute values ​​as parameters. The correspondence table is a table having multiple pieces of correspondence information for managing reward amounts corresponding to one or more video attribute values.

[0076] The reward means 1345 typically performs a process of charging a user who has enjoyed a service related to the target video with a reward. The process of charging a user with a reward is, for example, a process of charging the user with the amount of reward obtained. The process of charging a user with a reward is, for example, a process of charging the user with the amount of reward obtained and the amount of profit obtained by the operator of the information processing device 1. The process of charging a user with a reward is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a settlement process using the user's credit card number, etc.

[0077] The transmitter 14 transmits various types of information or instructions. Here, the transmission is usually to one or more mobile terminals 2. The various types of information or instructions are, for example, moving images.

[0078] The video sending unit 141 sends a video. The video sending unit 141 normally sends a video received by the video receiving unit 121. The video sending unit 141 normally sends, to one mobile terminal 2, a second video corresponding to one or more other mobile terminals 2 determined by the determination unit 132. <Details of components of mobile terminal 2>

[0079] Here, the mobile terminal 2 is a device that receives and outputs video transmitted by another mobile terminal 2, and also a device that provides video to the other mobile terminal 2. However, one mobile terminal 2 may be a device that receives and outputs video transmitted by another mobile terminal 2, but does not provide video to the other mobile terminal 2. Furthermore, the other mobile terminal 2 may be a device that provides video to the other mobile terminal 2, but does not receive video transmitted by the other mobile terminal 2.

[0080] Various types of information are stored in the moving storage unit 21. The various types of information include, for example, video, attribute value sets, rights holder identifiers, camera attribute values, map information, and screen layout information. The camera attribute values ​​are attribute values ​​of the camera. The camera attribute values ​​include, for example, the angle of view, direction information, and resolution.

[0081] For example, one or more still images constituting a moving image are associated with one or more moving image attribute values ​​constituting an attribute value set. The one or more moving image attribute values ​​may correspond to all of the still images, some of the still images, or multiple still images.

[0082] The screen layout information is information that specifies the layout of a screen for arranging multiple videos, for example. The layout information is written in HTML, XML, or the like, but the means for realizing the information is not limited.

[0083] The mobile reception unit 22 receives various types of information and instructions. The various types of information and instructions are, for example, a start instruction, an inquiry, and a past video output instruction. A start instruction is an instruction to start an operation. A start instruction is, for example, an instruction to turn on the power of the mobile terminal 2 or to launch a video transmission application. A past video output instruction is an instruction to output past videos that were shot in the past. A past video output instruction may also be an instruction to rewind. Based on the past video output instruction, current information that specifies the point in time at which playback should start can be obtained.

[0084] Here, acceptance refers to the acceptance of information input from input devices such as a keyboard, mouse, or touch panel, or the reception of information transmitted via a wired or wireless communication line, but may also be a concept that includes the acceptance of information read from recording media such as optical disks, magnetic disks, and semiconductor memories.

[0085] The mobile receiving unit 23 receives the second video captured by a second camera of another mobile object that satisfies the selection condition. The mobile receiving unit 23 may receive the second video captured by each of a plurality of second cameras. The mobile receiving unit 23 may receive the second video transmitted from a plurality of mobile terminals 2.

[0086] Although it is preferable for the mobile receiving unit 23 to receive the second moving image via the information processing device 1 , it may also receive the second moving image directly from another mobile terminal 2 .

[0087] The movement processing unit 24 performs various types of processing. The various types of processing are, for example, processing performed by the position acquisition unit 241, the movement acquisition unit 242, the attribute value acquisition unit 243, the movement acquisition unit 242, or the configuration unit 244.

[0088] The movement processing unit 24 may store the video acquired by the movement acquisition unit 242 in the movement storage unit 21. The movement processing unit 24 may store the video received by the movement receiving unit 23 in the movement storage unit 21.

[0089] The movement processing unit 24 may store, in the movement storage unit 21, a time-series of images including two or more moving images output by the movement output unit 26.

[0090] The location acquisition unit 241 acquires location information. The location acquisition unit 241 normally acquires location information that identifies the location of the mobile terminal 2. The location acquisition unit 241 acquires the current location. The location acquisition unit 241 acquires the location information using, for example, a GPS receiver. However, the means or algorithm by which the location acquisition unit 241 acquires the location information is not important. Note that the current location is location information that identifies the current location.

[0091] The movement acquisition unit 242 acquires a first video captured by a first camera that is a camera installed on one mobile body. For example, the first camera is included in the movement acquisition unit 242, but may be included in a device other than the mobile terminal 2. The movement acquisition unit 242 acquires, for example, first videos that are videos captured by each of a plurality of first cameras installed on one mobile body.

[0092] The movement acquisition unit 242, for example, captures a video while the mobile terminal 2 is moving. Preferably, the captured video is associated with location information acquired by the location acquisition unit 241. Preferably, the captured video is associated with one or more attribute values ​​acquired by the attribute value acquisition unit 243, which will be described later. Furthermore, such a video is a first video.

[0093] It is preferable that the moving acquisition unit 242 accumulates the captured video in the moving storage unit 21. When accumulating video in the moving storage unit 21 with a limited storage capacity, it is preferable that the moving acquisition unit 242 overwrites new video in an area where old video is stored. In other words, it is preferable that the structure of the moving storage unit 21 is a ring buffer structure.

[0094] The attribute value acquisition unit 243 acquires one or more camera attribute values ​​including direction information indicating the direction in which the image is captured by the movement acquisition unit 242. It is preferable that the attribute value acquisition unit 243 acquires one or more video attribute values ​​including the camera attribute value.

[0095] The attribute value acquisition unit 243 acquires, for example, one or more attribute values. The one or more attribute values ​​are an attribute value set. The attribute value acquisition unit 243 acquires, for example, one or more attribute values ​​during shooting. The attribute value acquisition unit 243 acquires, for example, one or more attribute values ​​constantly, at predetermined intervals, or when an acquisition condition is satisfied.

[0096] The attribute value acquisition unit 243 acquires time information from, for example, a clock (not shown). The attribute value acquisition unit 243 acquires time information from, for example, a clock (not shown), and acquires seasonal information corresponding to the time information. The movement processing unit 24 acquires weather information corresponding to location information from, for example, a server (not shown). The attribute value acquisition unit 243 acquires temperature information, for example. The movement processing unit 24 acquires temperature information corresponding to location information from, for example, a server (not shown). The movement processing unit 24 acquires temperature information from, for example, a temperature sensor installed in a moving object. Note that the acquisition condition is, for example, when the analysis result of the video satisfies a predetermined condition, or when the video attribute value satisfies a predetermined condition. The predetermined condition is, for example, when there is traffic congestion or when an accident has occurred.

[0097] The attribute value acquisition unit 243, for example, acquires from map information a road attribute value corresponding to the location information acquired by the location acquisition unit 241, and associates the road attribute value with the video. The attribute value acquisition unit 243, for example, acquires from map information spot information corresponding to the location information acquired by the location acquisition unit 241, and associates the spot information with the video. The attribute value acquisition unit 243, for example, acquires from map information spot information that corresponds to the location information acquired by the location acquisition unit 241 and has a specific condition, and associates the spot information with the video. The specific condition is, for example, that the spot information is spot information of a specific type (e.g., a station name, a building name).

[0098] Note that the association with the moving image may be association with frames that make up the moving image, or association with the entire moving image.

[0099] The attribute value acquisition unit 243 acquires, for example, one or more tags for the video acquired by the movement acquisition unit 242, and associates the tags with the video. Note that a tag can also be considered an attribute value.

[0100] The attribute value acquisition unit 243, for example, analyzes the video acquired by the movement acquisition unit 242 and acquires one or more tags for the video.

[0101] The attribute value acquisition unit 243 acquires one or more tags using, for example, one or more moving object attribute values ​​acquired during video capture. The moving object attribute values ​​are, for example, CAN data.

[0102] The attribute value acquisition unit 243 may, for example, determine one or more still images that match the video tag condition and acquire a tag that pairs with the video tag condition. The attribute value acquisition unit 243 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.

[0103] For example, if the video tag condition is "the number of vehicles with a distance between them within a threshold is equal to or greater than a threshold and the vehicle's moving speed is equal to or less than a threshold," and the tag paired with the video tag condition is "traffic jam," the attribute value acquisition unit 243 analyzes frames of the video, recognizes multiple vehicles, and acquires the distances between the multiple vehicles. The attribute value acquisition unit 243 also acquires the number of vehicles with a distance between them within a threshold. The attribute value acquisition unit 243 also acquires the moving distance and frame rate of a single vehicle in multiple frames, and acquires the vehicle's speed. The attribute value acquisition unit 243 then determines whether the video tag condition is met using the number of vehicles with a distance between them within a threshold and the vehicle's speed. If the video tag condition is met, the attribute value acquisition unit 243 acquires the tag "traffic jam" paired with the video tag condition. The attribute value acquisition unit 243 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.

[0104] The attribute value acquisition unit 243 may, for example, determine one or more moving object attribute values ​​that match the attribute value tag condition, and acquire a tag that pairs with the attribute value tag condition. The attribute value acquisition unit 243 may also associate the tag with a video that pairs with the one or more moving object attribute values.

[0105] For example, if the attribute value tag condition is "driving time at a speed of less than 30 km for 10 minutes or more and the proportion of times during that driving time when the speed is less than 30% is 80% or more," and the tag paired with the attribute value tag condition is "traffic jam," the attribute value acquisition unit 243 uses the speed history contained in the CAN data associated with each field of the video to detect CAN data that matches the attribute value tag condition, acquires the tag "traffic jam" that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data. Note that the CAN data associated with each field of the video is CAN data acquired at the same time that the field was captured.

[0106] The composition unit 244 composes a screen to be output using the first video and the second video. It is preferable that the composition unit 244 composes a screen on which the first video and the second video can be compared. Note that the screen on which the first video and the second video can be compared is, for example, a single screen that includes the first video and the second video. The first video is a video acquired by the mobile acquisition unit 242. The second video is a video received by the mobile receiving unit 23.

[0107] The composition unit 244, for example, composes a screen including one or more first videos and one or more second videos. The composition unit 244, for example, composes a screen including past first videos, which are first videos previously acquired by the mobile acquisition unit 242. The composition unit 244, for example, composes a screen including past second videos, which are second videos previously received by the mobile receiving unit 23.

[0108] The mobile transmitting unit 25 transmits one or more first moving images acquired by the mobile acquiring unit 242. Note that the first moving images are second moving images from the perspective of the other mobile terminals 2. The mobile transmitting unit 25 normally transmits moving images to the information processing device 1, but may also transmit moving images to other mobile terminals 2.

[0109] The movement output unit 26 outputs a first video and a second video. The movement output unit 26 outputs, for example, a plurality of first videos and second videos. The movement output unit 26 outputs, for example, a past first video, which is a first video previously acquired by the movement acquisition unit 242. When outputting a past first video, for example, the movement output unit 26 outputs a past second video, which is a second video previously received by the movement receiving unit 23, that is, a past second video that is temporally synchronized with the past first video.

[0110] The movement output unit 26 typically outputs the first video and the second video so that they can be compared. For example, the movement output unit 26 outputs the first video and the second video on one screen. It is preferable that the movement output unit 26 outputs a screen constructed by the construction unit 244.

[0111] Here, output is a concept that includes displaying on a display, projection using a projector, printing on a printer, sound output, transmission to an external device, storage on a recording medium, and delivery of processing results to other processing devices or other programs.

[0112] The storage unit 11, the terminal management unit 111, and the mobile storage unit 21 are preferably non-volatile recording media, but may also be realized by volatile recording media.

[0113] There is no restriction on the process by which information is stored in the storage unit 11 etc. For example, information may be stored in the storage unit 11 etc. via a recording medium, information transmitted via a communication line etc. may be stored in the storage unit 11 etc., or information input via an input device may be stored in the storage unit 11 etc.

[0114] The receiving unit 12, the video receiving unit 121, and the mobile receiving unit 23 are usually realized by wireless or wired communication means, but may also be realized by means for receiving broadcasts.

[0115] The processing unit 13, video storage unit 131, determination unit 132, video acquisition unit 133, rights holder processing unit 134, first security means 1341, second security means 1342, third security means 1343, fourth security means 1344, reward means 1345, movement processing unit 24, attribute value acquisition unit 243, and configuration unit 244 can typically be realized by a processor, memory, etc. The processing procedures of the processing unit 13, etc. are typically realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuit). The processor may be a CPU, MPU, GPU, etc., and the type does not matter.

[0116] The transmitting unit 14, the video transmitting unit 141, and the mobile transmitting unit 25 are usually realized by wireless or wired communication means, but may also be realized by broadcasting means.

[0117] The mobile reception unit 22 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen.

[0118] The position acquisition unit 241 is realized by, for example, a GPS receiver.

[0119] The movement acquisition unit 242 may be realized by a camera.

[0120] The movement output unit 26 may or may not include an output device such as a display or speaker. The movement output unit 26 may be realized by driver software for an output device, or by a combination of driver software for an output device and the output device. <Operation>

[0121] Next, an example of the operation of the information system A will be described. First, an example of the operation of the information processing device 1 will be described with reference to the flowchart of FIG.

[0122] (S301) The receiving unit 12 determines whether or not an attribute value set has been received from the mobile terminal 2. If an attribute value set has been received, the process proceeds to S302, and if an attribute value set has not been received, the process proceeds to S303. Note that the attribute value set is associated with a terminal identifier.

[0123] (S302) The processing unit 13 associates the attribute value set received in S301 with the terminal identifier and stores it in the terminal management unit 111. The process returns to S301.

[0124] (S303) The video receiving unit 121 determines whether or not a video or the like has been received from the mobile terminal 2. If a video or the like has been received, the process proceeds to S304, and if a video or the like has not been received, the process proceeds to S305. Note that the video here is usually an additional video. The video or the like is, for example, an additional video and a rights holder identifier.

[0125] (S304) The video accumulation unit 131 accumulates the video etc. received in S303 in the storage unit 11. The processing unit 13 also accumulates the attribute value set corresponding to the video etc. received in S303 in the terminal management unit 111 in association with the terminal identifier. Return to S301. The video accumulation unit 131, for example, acquires a unique video identifier and accumulates the video in pairs with the video identifier. The video accumulation unit 131 accumulates the video in association with the received rights holder identifier, for example.

[0126] (S305) The inquiry receiving unit 122 determines whether or not an inquiry has been received from the mobile terminal 2. If an inquiry has been received, the process proceeds to S306, and if an inquiry has not been received, the process proceeds to S312. Note that the inquiry may have, for example, a selection condition.

[0127] (S306) The processing unit 13 acquires one or more videos based on the selection conditions included in the inquiry received in S305. An example of such video acquisition processing will be described with reference to the flowchart of FIG.

[0128] (S307) The processing unit 13 assigns 1 to the counter i.

[0129] (S308) The processing unit 13 determines whether or not the i-th video has been acquired in S306. If the i-th video has been acquired, the process proceeds to S309, and if the i-th video has not been acquired, the process returns to S301.

[0130] (S309) The video sending unit 141 sends the i-th video acquired in S306 to the mobile terminal 2 that sent the inquiry. It is preferable that each of the multiple frames constituting the video to be sent is associated with location information and time information. In addition, when the video sending unit 141 has sent a video from another mobile terminal 2 to the first mobile terminal 2, it is preferable that the video sending unit 141 continue to send the video sent from the first mobile terminal 2 to the first mobile terminal 2 until it receives an instruction to end the transmission from the first mobile terminal 2, for example.

[0131] (S310) The fourth security means 1344 acquires the user identifier corresponding to the mobile terminal 2 that sent the inquiry.

[0132] (S311) The fourth security means 1344 performs the fourth security process using the user identifier acquired in S310. An example of the fourth security process will be described with reference to the flowchart in FIG.

[0133] (S312) The compensation means 1345 performs compensation processing for the original rights holder of the i-th video. Return to S301. An example of compensation processing will be described using the flowchart in FIG.

[0134] (S313) The processing unit 13 increments the counter i by 1. The process returns to S308.

[0135] (S314) The receiving unit 12 determines whether or not a purchase instruction has been received from the mobile terminal 2 or a user terminal (not shown). If a purchase instruction has been received, the process proceeds to S315; if not, the process proceeds to S319. The purchase instruction is associated with a user identifier. The purchase instruction also includes, for example, a video identifier.

[0136] (S315) The rights holder processing unit 134 acquires the video corresponding to the purchase instruction received in S314. The rights holder processing unit 134 acquires the video corresponding to the purchase instruction from the videos accumulated by the video accumulation unit 131 in S304, for example. The rights holder processing unit 134 acquires the video identified by the video identifier included in the purchase instruction, for example.

[0137] (S316) The fourth security unit 1344 acquires the user identifier corresponding to the terminal that sent the purchase instruction. This user identifier becomes the rights holder identifier for the purchased video.

[0138] (S317) The fourth security unit 1344 performs the fourth security process using the user identifier acquired in S314. An example of the fourth security process will be described with reference to the flowchart in FIG.

[0139] (S318) The compensation means 1345 performs compensation processing for the original rights holder of the purchased video. Return to S301. An example of compensation processing will be described using the flowchart in FIG.

[0140] (S319) The processing unit 13 performs automatic video transmission processing. An example of the automatic video transmission processing will be described with reference to the flowchart in Fig. 7. The automatic video transmission processing is processing for automatically transmitting video to mobile terminals 2 that have not transmitted an inquiry.

[0141] 3, the information processing device 1 may receive a video viewing instruction from the mobile terminal 2 or a user terminal (not shown). In such a case, the information processing device 1 acquires the video corresponding to the viewing instruction and transmits it to the terminal. In such a case, it is preferable that the information processing device 1 performs a compensation process for the rights holder identified by the rights holder identifier corresponding to the video.

[0142] Furthermore, in the flowchart of FIG. 3, the process ends when the power is turned off or an interrupt occurs to end the process.

[0143] Next, an example of the video acquisition process in S306 will be described with reference to the flowchart of FIG.

[0144] (S401) The determination unit 132 acquires, from the terminal management unit 111, one or more attribute values ​​paired with a terminal identifier paired with a target mobile terminal 2. The target mobile terminal 2 is, for example, the mobile terminal 2 that has sent the inquiry, or a mobile terminal 2 that is a candidate for video transmission.

[0145] (S402) The determination unit 132 acquires a selection condition paired with a terminal identifier paired with the mobile terminal 2 from the terminal management unit 111. If the terminal management unit 111 does not have a selection condition paired with the terminal identifier, the determination unit 132 acquires a default selection condition from the storage unit 11.

[0146] (S403) The determination unit 132 assigns 1 to a counter i.

[0147] (S404) The decision unit 132 determines whether or not the terminal information of the i-th other mobile terminal 2 exists in the terminal management unit 111. If the terminal information of the i-th other mobile terminal 2 exists, the process proceeds to S405; if not, the process proceeds to S409.

[0148] (S405) The determination unit 132 acquires from the terminal management unit 111 one or more attribute values ​​that are contained in the terminal information of the i-th other mobile terminal 2 and that are to be used to determine the selection conditions acquired in S402.

[0149] (S406) The determination unit 132 determines whether the one or more attribute values ​​acquired in S405 satisfy the selection condition acquired in S402. If the selection condition is satisfied, the process proceeds to S407, and if the selection condition is not satisfied, the process proceeds to S408.

[0150] (S407) The decision unit 132 acquires the terminal identifier paired with the terminal information of the i-th other mobile terminal 2, and temporarily stores the terminal identifier in a buffer (not shown).

[0151] (S408) The determination unit 132 increments the counter i by 1. The process returns to S404.

[0152] (S409) The determination unit 132 determines whether the number of terminal identifiers accumulated in the buffer (not shown) in S407 is greater than the planned number. If it is greater than the planned number, the process proceeds to S410, and if it is equal to or less than the planned number, the process proceeds to S411. The planned number is the maximum number of videos to be transmitted to the mobile terminal 2. The planned number is, for example, "1", but may be more than one.

[0153] (S410) The determination unit 132 selects a planned number of terminal identifiers from the terminal identifiers temporarily stored in a buffer (not shown). Note that any conditions for selection are applicable here. For example, the determination unit 132 may acquire the planned number of terminal identifiers from the mobile terminal 2 whose location information has the shortest distance from the location information of the other mobile terminal 2.

[0154] (S411) The moving image acquiring unit 133 assigns 1 to a counter i.

[0155] (S412) The video acquisition unit 133 determines whether there is a terminal identifier of the i-th other mobile terminal 2. If there is a terminal identifier of the i-th other mobile terminal 2, the process proceeds to S413; if there is no terminal identifier of the i-th other mobile terminal 2, the process returns to the upper processing.

[0156] (S413) The video acquisition unit 133 determines whether or not there is a video already stored that pairs with the terminal identifier of the i-th other mobile terminal 2. If there is a video already stored, the process proceeds to S414; if there is no video, the process proceeds to S415.

[0157] (S414) The video acquisition unit 133 acquires, from among the videos already stored, a video that pairs with the terminal identifier of the i-th other mobile terminal 2. The process proceeds to S417. Note that, here, it is preferable that the video acquisition unit 133 acquires the current video and videos stored in the past.

[0158] (S415) The video acquisition unit 133 acquires the terminal communication information of the i-th other mobile terminal 2, and transmits a transmission instruction to the mobile terminal 2 identified by the terminal communication information.

[0159] (S416) The video acquisition unit 133 determines whether or not a video has been received from the i-th other mobile terminal 2. If a video has been received, the process proceeds to S417, and if a video has not been received, the process returns to S416.

[0160] (S417) The video acquisition unit 133 stores the acquired video.

[0161] (S417) The moving image acquiring unit 133 increments the counter i by 1. The process returns to S412.

[0162] Next, an example of the fourth maintenance process of S311 and S317 will be described with reference to the flowchart of FIG.

[0163] (S501) The fourth security unit 1344 acquires access information that identifies the storage destination of the video.

[0164] (S502) The fourth maintenance unit 1344 acquires a set of attribute values ​​corresponding to the stored moving images.

[0165] (S503) The fourth security means 1344 constructs security information having the access information acquired in S501, the attribute value set acquired in S502, and the rights holder identifier of the video. If a new rights holder identifier has been acquired, the fourth security means 1344 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. The new rights holder identifier is, for example, the user identifier of the mobile terminal 2 to which the video has been provided. The original rights holder identifier is, for example, the user identifier of the other mobile terminal 2 that provided the video. (S504) The fourth security means 1344 stores the security information constructed in S503. The process returns to the upper level process.

[0166] In S504, if preservation information for a video corresponding to the preservation information to be stored has been stored, the preservation information is added to the preservation information configured in S503. This allows, for example, the transition of rights holders of the video to be managed. Furthermore, the fourth preservation means 1344 stores the preservation information in a blockchain, for example.

[0167] Next, an example of the reward process in S312 and S318 will be described with reference to the flowchart in FIG.

[0168] (S601) The reward unit 1345 acquires one or more right holder identifiers of the target video. The reward unit 1345 may also acquire the right holder identifiers of the previous right holders of the target video.

[0169] (S602) The reward unit 1345 acquires a set of attribute values ​​of the target video. The target video is a video acquired by the video acquisition unit 133. It is preferable that the target video is a video up to the destination acquired by the video acquisition unit 133.

[0170] (S603) The reward unit 1345 acquires a service identifier that identifies the service provided for the target video. The service identifier is, for example, “view” or “purchase.”

[0171] (S604) The reward unit 1345 acquires a reward amount using one or more pieces of information from the attribute value set acquired in S602 and the service identifier acquired in S603.

[0172] If multiple right holder identifiers are acquired, the remuneration unit 1345 acquires a remuneration amount for each right holder identifier. If history information of right holders including multiple right holder identifiers is acquired, the remuneration unit 1345 may acquire a remuneration amount for each right holder identifier.

[0173] For example, the reward means 1345 is more likely to determine a larger reward amount the greater the data amount, duration, or number of frames of the original video used in the video transmitted by the video transmission unit 141. For example, the reward means 1345 is more likely to determine a larger reward amount the greater the resolution of the original video used in the video transmitted by the video transmission unit 141.

[0174] (S605) The reward unit 1345 performs processing to reward the right holder identified by the right holder identifier acquired in S601, in the amount of reward acquired in S604.

[0175] (S606) The remuneration means 1345 performs processing to charge a remuneration to the user who has enjoyed the service related to the target video. The processing returns to the upper level processing. Note that the target video is usually a video transmitted to the mobile terminal 2.

[0176] In the flowchart of FIG. 8, the profits obtained by the operator of the information processing device 1 may be acquired and accumulated.

[0177] Next, an example of the automatic video transmission process of S319 will be described with reference to the flowchart of FIG.

[0178] (S701) The moving image acquiring unit 133 assigns 1 to a counter j.

[0179] (S702) The video acquisition unit 133 determines whether or not there is a jth mobile terminal 2 that is a candidate for transmitting a video of another mobile terminal 2. If there is a jth mobile terminal 2, the process proceeds to S306, and if there is no jth mobile terminal 2, the process returns to the upper level processing. In S306, one or more videos to be transmitted to the jth mobile terminal 2 are acquired. After the process proceeds to S306, the processes from S307 to S313 are performed.

[0180] (S703) The moving image acquiring unit 133 increments the counter j by 1. The process returns to S702.

[0181] Next, an example of the operation of the mobile terminal 2 will be described with reference to the flowchart of FIG.

[0182] (S801) The mobile terminal 2 determines whether or not a start instruction has been received. If a start instruction has been received, the process proceeds to S802, and if not, the process proceeds to S812.

[0183] (S802) The location acquisition unit 241 acquires location information.

[0184] (S803) The attribute value acquisition unit 243 acquires one or more attribute values ​​excluding the location information. The attribute values ​​include, for example, time information and road attribute values. The attribute value acquisition unit 243 creates an attribute value set that includes multiple attribute values ​​including the acquired location information.

[0185] (S804) The movement processing unit 24 determines whether or not to transmit the attribute value set to the information processing device 1. If the attribute value set is to be transmitted, the process proceeds to S804; if not, the process proceeds to S806. When transmitting the attribute value set, for example, the attribute value set flag may be "ON." Also, for example, the initial value of the attribute value set flag is "ON." Note that the method for determining whether or not to transmit the attribute value set to the information processing device 1 is not important.

[0186] (S805) The mobile sending unit 25 acquires a terminal identifier from the mobile storage unit 21. The mobile sending unit 25 transmits the attribute value set to the information processing device 1 in association with the terminal identifier.

[0187] (S806) The movement acquisition unit 242 acquires video. Note that the movement acquisition unit 242 may acquire video captured by a plurality of cameras.

[0188] (S807) The composition unit 244 composes an additional moving image having a moving image, location information, and one or more attribute values. The composition unit 244 stores the additional moving image in the moving storage unit 21.

[0189] (S808) The moving video transmission unit 242 determines whether or not to transmit the video to the information processing device 1. If the video is to be transmitted, the process proceeds to S809; if not, the process proceeds to S811. Note that when transmitting a video, for example, the video transmission flag may be "ON." Also, the initial value of the video transmission flag may be, for example, "OFF." Also, the method for determining whether or not to transmit the video to the information processing device 1 is not important.

[0190] (S809) The configuration unit 244 acquires the terminal identifier and the like from the movement storage unit 21.

[0191] (S810) The moving video sending unit 242 associates the additional image accumulated in S807 with the terminal identifier acquired in S809 and sends it to the information processing device 1. Note that the amount of video sent at one time is not important.

[0192] (S811) The movement processing unit 24 determines whether to end the transmission of the video. If the transmission is to be ended, the process returns to S801. If the transmission is not to be ended, the process returns to S802. Note that the transmission is ended, for example, when an end instruction is received from the user.

[0193] (S812) The mobile receiving unit 23 determines whether or not a transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S802, and if a transmission instruction has not been received, the process returns to S801. If a transmission instruction has been received, the process determines in S808 that "the video will be transmitted." If a transmission instruction has been received, it is preferable to determine in S804 that "the attribute value set will not be transmitted."

[0194] (S813) The mobility acceptance unit 22 determines whether or not an inquiry has been accepted. If an inquiry has been accepted, the process proceeds to S814, and if an inquiry has not been accepted, the process proceeds to S818.

[0195] (S814) The movement processing unit 24 acquires the terminal identifier from the movement storage unit 21 and composes a query associated with the terminal identifier. The movement transmitting unit 25 transmits the composed query to the information processing device 1.

[0196] (S815) The mobile receiving unit 23 determines whether or not one or more videos have been received from the information processing device 1. If one or more videos have been received, the process proceeds to S816, and if not, the process returns to S815.

[0197] (S816) The composition unit 244 composes a screen to be output. An example of such screen composition processing will be described with reference to the flowchart in FIG.

[0198] (S817) The movement output unit 26 outputs the screen created in S816. Return to S801.

[0199] (S818) The mobile receiving unit 23 determines whether or not one or more videos have been received. If a video has been received, the process proceeds to S816; if a video has not been received, the process proceeds to S819. Note that the mobile receiving unit 23 normally receives videos from the information processing device 1, but may also receive videos from other mobile terminals 2.

[0200] (S819) The movement receiving unit 22 determines whether or not a past video output instruction has been received. If a past video output instruction has been received, the process proceeds to S820, and if not, the process returns to S801.

[0201] (S820) The movement processing unit 24 and the like perform synchronous output processing of a plurality of moving images. Return to S801. An example of the synchronous output processing will be described with reference to the flowchart in FIG.

[0202] In the flowchart of FIG. 8, the process ends when the power is turned off or an interrupt occurs to end the process.

[0203] Next, an example of the screen configuration process in S816 will be described with reference to the flowchart in FIG.

[0204] (S901) The movement acquisition unit 242 acquires one or more first moving images.

[0205] (S902) The composition unit 244 acquires the number of first moving images acquired in S901.

[0206] (S903) The composition unit 244 acquires one or more secondary moving images.

[0207] (S904) The construction unit 244 acquires the number of secondary moving images acquired in S903.

[0208] (S905) The configuration unit 244 acquires screen layout information corresponding to the number of first moving images and the number of second moving images from the movement storage unit 21.

[0209] (S906) The composition unit 244 arranges the acquired one or more first moving images and one or more second moving images on the screen in accordance with the screen layout information acquired in S905, and composes the screen. The process returns to the upper-level process.

[0210] Next, an example of the synchronous output process of S820 will be described with reference to the flowchart of FIG.

[0211] (S1001) The movement processing unit 24 acquires time information corresponding to the accepted instruction to output a past video.

[0212] (S1002) The movement processing unit 24 assigns 1 to a counter i.

[0213] (S1003) The movement processing unit 24 determines whether or not the i-th video to be output exists. If the i-th video exists, the process proceeds to S1004, and if the i-th video does not exist, the process returns to the upper process.

[0214] (S1004) The movement processing unit 24 changes the current information of the i-th video to the time information acquired in S1001.

[0215] (S1005) The movement processing unit 24 plays back the i-th video from the time indicated by the current information.

[0216] (S1006) The movement processing unit 24 increments the counter i by 1. Return to S1003. <Specific Example>

[0217] A specific example of the operation of the information system A in this embodiment will be described below. In this example, the mobile terminal 2 is, for example, a terminal with a drive recorder function or a smartphone equipped with a camera. The mobile terminal 2 is installed in a position where it can be seen by a passenger in the passenger seat of a moving vehicle, such as an automobile.

[0218] 11 is stored in the terminal management unit 111 of the information processing device 1. The terminal management table is a table for managing terminal information of one or more mobile terminals 2.

[0219] The terminal management table manages one or more records each having an "ID," "terminal identifier," "attribute value set," "selection condition," "movement information," "request flag," and "provision flag." The "attribute value set" includes "environmental information" and "tag." The "environmental information" includes "location information," "direction information," "camera information," "time information," "weather information," and "temperature information." The "camera information" includes "angle of view" and "resolution." The "environmental information" is information about the environment around the mobile terminal 2 when the image was captured, etc. The "tag" includes "accident," "traffic jam," and "dangerous driving." In other words, here, one or more tags, for example, "accident," "traffic jam," and "dangerous driving," may be assigned to a field constituting a video transmitted from the mobile terminal 2. The "attribute value set" in the terminal management table is a set of attribute values ​​transmitted continuously (e.g., periodically) by one or more mobile terminals 2. Note that all or some of the one or more mobile terminals 2 may continuously transmit video in addition to the attribute value set.

[0220] "ID" is information for identifying the record. "Terminal Identifier" is an identifier of the mobile terminal 2, and is the same as the rights holder identifier that identifies the rights holder of the image at the time of transmission of the image. "Location Information" here is (latitude, longitude). "Direction Information" is the camera's shooting direction, which is the angle clockwise from due north. In other words, if the camera's shooting direction is due east, the direction information is "90 degrees." "Angle of View" is the camera's angle of view. "Resolution" is the camera's resolution. "Time Information" here is the year, month, day, hour, minute, and second. "Weather Information" is, for example, "Sunny," "Rainy," "Cloudy," or "Snowy." "Temperature Information" is the temperature (°C) outside the mobile object. A value of "1" for "Accident" indicates that an accident has occurred. A value of "1" for "Traffic Jam" indicates that a traffic jam has occurred. A value of "1" for "Reckless Driving" indicates that a vehicle or the like traveling in front is driving recklessly. "Selection Condition" is a condition for selecting another mobile terminal 2. The selection condition "ID=1" indicates that a mobile terminal 2 that is traveling on the same road as the mobile terminal 2 in question, traveling ahead, has a distance less than or equal to a threshold, and has detected the occurrence of congestion will be selected. The selection condition "ID=2" indicates that a mobile terminal 2 that is traveling on the same road as the mobile terminal 2 in question and has transmitted an attribute value set including an attribute value of "accident=1" will be selected. "Movement information=1" indicates that the mobile terminal 2 is currently in a state where it can transmit images. "Movement information=0" indicates that the mobile terminal 2 is currently in a state where it cannot transmit images because it is powered off, etc. "Request flag=1" indicates that a video from another mobile terminal 2 is requested. "Request flag=0" indicates that a video from another mobile terminal 2 is not requested. A "provision flag" of "1" indicates that viewing of the image is permitted. A "provision flag" of "2" indicates that sale of the image (transfer of rights holder) is permitted. The “attribute value set,” “movement information,” “request flag,” and “provision flag” are information transmitted from the mobile terminal 2 and stored in the information processing device 1 .

[0221] In this situation, the following specific example will be described. Suppose now that a mobile terminal 2 identified by a terminal identifier "U001" is traveling on a certain road. Suppose then that another mobile terminal 2 identified by a terminal identifier "U003" is traveling ahead on the same road.

[0222] Here, it is assumed that the initial screen output of the mobile terminal 2 identified by the terminal identifier "U001" is as shown in FIG. 12. In FIG. 12, 1201 is a map including the road on which the automobile equipped with the mobile terminal 2 is traveling. 1202 is an image of the front of the automobile captured by a drive recorder equipped in the automobile. 1203 is an image of the front of the automobile captured by the drive recorder. 1204 is an image captured by a camera corresponding to the left side mirror. 1205 is an image captured by a camera corresponding to the right side mirror. The initial screen does not include any video transmitted by other mobile terminals 2.

[0223] Then, while the mobile body is traveling, a set of attribute values ​​is continuously transmitted from a mobile terminal 2 identified by a terminal identifier "U001" installed on the mobile body to the information processing device 1. As a result, the terminal management table of FIG. 11 is stored in the terminal management unit 111.

[0224] Next, the information processing device 1 performs the automatic video transmission process, for example, as follows. That is, the determination unit 132 acquires the request flag "1" for "ID=1" in FIG. 11 and determines that the mobile terminal 2 with "ID=1" is requesting a video. Next, the determination unit 132 acquires the selection condition paired with the terminal identifier "U001" for "ID=1". Next, the determination unit 132 acquires the location information paired with the terminal identifier "U001". Furthermore, the determination unit 132 acquires the location information and congestion flag "1" paired with the terminal identifier "U003". Next, the determination unit 132 determines that the selection condition "same road AND distance <= threshold" is satisfied from the location information for "ID=1" and the location information for "ID=3". Furthermore, the determination unit 132 determines that the selection condition "congestion = 1" is satisfied from the congestion flag "1" paired with the terminal identifier "U003". That is, the decision unit 132 determines that the mobile terminal 2 with "ID=3" satisfies the selection condition for "ID=1."

[0225] Next, the video acquisition unit 133 acquires the terminal communication information paired with the terminal identifier "U003" from the terminal management table (Figure 11), and sends a transmission instruction including the location information paired with the terminal identifier "U001" to another mobile terminal 2 identified by the terminal communication information.

[0226] Next, the mobile receiving unit 23 of the other mobile terminal 2 identified by the terminal identifier "U003" receives the transmission instruction. Next, the mobile acquisition unit 242 acquires the current video. The mobile acquisition unit 242 also acquires the past video corresponding to the location information contained in the received transmission instruction from the mobile storage unit 21. Next, the mobile sending unit 25 transmits the current video and the past video to the information processing device 1.

[0227] Next, the video acquisition unit 133 of the information processing device 1 receives the current video and the past video transmitted from the other mobile terminal 2. Then, the video transmission unit 141 transmits the current video and the past video to the mobile terminal 2 identified by the terminal identifier "U001".

[0228] Next, the mobile terminal 2 identified by the terminal identifier "U001" receives the current video and past video of the other mobile terminal 2.

[0229] Next, the configuration unit 244 of the mobile terminal 2 configures a screen that includes current video and past video of the other mobile terminal 2, but does not include the map 1201. Next, the movement output unit 26 outputs the screen.

[0230] An example of such output is shown in Fig. 13. In Fig. 13, in addition to the three videos 1201, 1202, and 1203 of the mobile terminal 2, a current video 1301 and a past video 1302 of another mobile terminal 2 are output.

[0231] As described above, according to this embodiment, assistance regarding movement can be provided using one or more videos of one moving object and one or more videos of another moving object.

[0232] Furthermore, according to this embodiment, assistance regarding movement can be provided using video of one moving object and video of another moving object traveling on the same road.

[0233] Furthermore, according to this embodiment, assistance regarding movement can be provided using past video of one moving object and video of another moving object.

[0234] Furthermore, according to this embodiment, assistance regarding movement can be provided by using past video of one moving object and past video of another moving object that is synchronized with the moving object.

[0235] Furthermore, according to this embodiment, the passenger in the passenger seat can receive assistance with transportation using video of one moving body and video of another moving body.

[0236] The processing in this embodiment may be implemented by software. This software may be distributed by software download or the like. This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to other embodiments in this specification. The software implementing the information processing device 1 in this embodiment is the following program. That is, this program causes a computer to function as a video receiving unit that receives a second video, which is a video captured by a second camera corresponding to another mobile terminal; a determination unit that determines, for a given mobile terminal, another mobile terminal that meets a selection condition by referencing a terminal management unit that stores terminal information, including location information, associated with each of one or more mobile terminals; and a video sending unit that transmits the second video corresponding to the other mobile terminal determined by the determination unit to the given mobile terminal.

[0237] The software that realizes the mobile terminal 2 is the following program. In other words, this program causes a computer to function as a mobile acquisition unit that acquires a first video captured by a first camera that is a camera of one mobile object, a mobile receiving unit that receives a second video captured by a second camera that is a camera of another mobile object that satisfies a selection condition, and a mobile output unit that outputs the first video and the second video.

[0238] 14 shows the appearance of a computer that executes the programs described herein to realize the information processing devices and the like of the various embodiments described above. The above-described embodiments can be realized by computer hardware and computer programs executed thereon. FIG. 14 is an overview of this computer system 300, and FIG. 15 is a block diagram of the system 300.

[0239] In FIG. 14, a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

[0240] 15, in addition to a CD-ROM drive 3012, the computer 301 includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 etc., a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions for application programs and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data. Although not shown here, the computer 301 may further include a network card for providing connection to a LAN.

[0241] A program that causes computer system 300 to execute the functions of information processing device 1 and the like of the above-described embodiment may be stored on CD-ROM 3101, inserted into CD-ROM drive 3012, and then transferred to hard disk 3017. Alternatively, the program may be transmitted to computer 301 via a network (not shown) and stored on hard disk 3017. The program is loaded into RAM 3016 when executed. The program may also be loaded directly from CD-ROM 3101 or the network.

[0242] The program does not necessarily have to include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the information processing device 1 of the above-described embodiment. The program only needs to include instructions that call appropriate functions (modules) in a controlled manner and achieve the desired results. How the computer system 300 operates is well known, and a detailed description thereof will be omitted.

[0243] In addition, in the above program, the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).

[0244] The computer that executes the program may be a single computer or a plurality of computers, that is, it may perform centralized processing or distributed processing.

[0245] Furthermore, in each of the above embodiments, it goes without saying that a plurality of communication means present in one device may be physically realized by one medium.

[0246] Furthermore, in each of the above embodiments, each process may be realized by centralized processing in a single device, or may be realized by distributed processing in a plurality of devices.

[0247] The present invention is not limited to the above-described embodiment, and various modifications are possible, and it goes without saying that these modifications are also included within the scope of the present invention.

[0248] As described above, the information processing device 1 according to the present invention has the effect of being able to provide support for movement using video of one moving object and video of another moving object, and is useful as a server that provides video.

Claims

1. A mobile terminal comprising: a mobile acquisition unit that acquires a first video captured by a first camera that is a camera of a moving body; a mobile receiving unit that receives a second video captured by a second camera that is a camera of another moving body that satisfies selection conditions including traveling on the same road as the first moving body; and a mobile output unit that outputs the first video and the second video.

2. A mobile terminal as described in claim 1, wherein the movement acquisition unit acquires first videos which are videos taken by each of a plurality of first cameras of the one moving object, and the movement output unit outputs each of the plurality of first videos and the second video.

3. A mobile terminal according to claim 1 or claim 2, wherein the movement output unit outputs a past first video, which is a first video previously acquired by the movement acquisition unit.

4. A mobile terminal as described in claim 3, wherein when outputting the past first video, the mobile output unit outputs a past second video which is a second video previously received by the mobile receiving unit and which is synchronized in time with the past first video.

5. A mobile terminal according to any one of claims 1 to 4, installed in a position visible to a user in a passenger seat of said one mobile object.

6. An information processing device comprising: a video receiving unit that receives a second video, which is a video captured by a second camera corresponding to another mobile terminal; a determination unit that refers to a terminal management unit in which terminal information including location information is stored in correspondence with each of one or more mobile terminals, and determines, for a given mobile terminal, other mobile terminals that meet selection conditions including traveling on the same road as the given mobile terminal; and a video sending unit that transmits the second video corresponding to the other mobile terminal determined by the determination unit to the given mobile terminal.

7. An information processing device as described in claim 6, wherein the selection condition is that the other mobile body is traveling on the same road as the one mobile body, and the determination unit determines the other mobile terminal for location information corresponding to the same road identifier as the road identifier corresponding to the location information for the one mobile terminal.

8. An information processing device as described in claim 6 or claim 7, further comprising a rights holder processing unit that corresponds the second video transmitted by the video transmission unit to a rights holder identifier that identifies the rights holder of the second video, and performs rights holder processing which is processing related to the rights holder identified by the rights holder identifier corresponding to the second video, and the rights holder processing unit comprises a third security means that stores the second video transmitted by the video transmission unit in correspondence with a rights holder identifier that identifies the user of the mobile terminal to which the second video was transmitted.

9. An information processing method realized by a mobile acquisition unit, a mobile receiving unit, and a mobile output unit, comprising: a mobile acquisition step in which the mobile acquisition unit acquires a first video captured by a first camera that is a camera of a moving body; a mobile reception step in which the mobile receiving unit receives a second video captured by a second camera that is a camera of another moving body that satisfies selection conditions including traveling on the same road as the first moving body; and a mobile output step in which the mobile output unit outputs the first video and the second video.

10. An information processing method comprising a video receiving unit, a determination unit, and a video transmitting unit, comprising: a video receiving step in which the video receiving unit receives a second video which is a video taken by a second camera corresponding to another mobile terminal; a determined video receiving unit in which the determination unit refers to a terminal management unit in which terminal information including location information is stored in correspondence with each of one or more mobile terminals, and determines, for a certain mobile terminal, another mobile terminal which meets selection conditions including traveling on the same road as the certain mobile terminal; and a video transmitting video receiving unit in which the video transmitting unit transmits, to the certain mobile terminal, the second video which corresponds to the other mobile terminal determined by the determined video receiving unit.

Citation Information

Patent Citations

  • Road peripheral object monitoring device and road peripheral object monitoring program

    JP2022045032A