Information processor, user terminal, and information processing method
The information processing apparatus addresses the issue of delayed video delivery by acquiring and transmitting videos or still images that meet time and position conditions, ensuring timely access to critical information.
Patent Information
- Application Number
- JP2023189026
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-11-06
- Publication Date
- 2025-05-19
AI Technical Summary
Existing technologies often fail to provide videos within the desired time, leading to delays in accessing critical information such as road conditions.
An information processing apparatus that receives request information with time and position conditions, acquires videos or still images that meet these conditions, and transmits them to user terminals within the specified time limits.
Ensures that videos or images are provided to user terminals within the desired time, enhancing the efficiency and effectiveness of information delivery.
Smart Images

Figure 2025077092000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus and the like that acquires a video that satisfies a request specified by request information received from a user terminal and transmits the video to the user terminal.
Background Art
[0002] Conventionally, there has been a technology aimed at providing information for checking road conditions that enables visual grasp of the actual traffic congestion situation quickly and without incurring high equipment costs, and at accurately collecting image data necessary for the above-mentioned road condition check information on the vehicle side (see Patent Document 1).
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, in the prior art, there were cases where a video could not be provided within a desired time.
Means for Solving the Problems
[0005] An information processing apparatus according to the first aspect of the present invention includes a request receiving unit that receives request information having a time limit condition regarding the time until a user terminal acquires a video and a position condition corresponding to the video from the user terminal, an image acquisition unit that acquires a video of a position indicated by position information that satisfies the position condition included in the request information and can be provided to the user terminal within a time that satisfies the time limit condition included in the request information, and an image transmission unit that transmits the video acquired by the image acquisition unit to the user terminal.
[0006] With such a configuration, a video can be provided within a desired time.
[0007] Further, in the information processing apparatus of the second invention, when the image acquisition unit determines that it cannot provide a moving image to the user terminal within the time satisfying the time limit condition with respect to the first invention, the still image at the position indicated by the position information satisfying the position condition is acquired, and the image transmission unit is an information processing apparatus that transmits the still image acquired by the image acquisition unit to the user terminal.
[0008] With such a configuration, an image can be provided for a desired time.
[0009] Further, the information processing apparatus of the third invention further includes an image storage unit in which alternative information is stored, with respect to the first invention. The image acquisition unit is a moving image at the position indicated by the position information satisfying the position condition included in the request information, and when it determines that it cannot acquire a moving image that can be provided to the user terminal within the time satisfying the time limit condition included in the request information, the alternative information is acquired from the image storage unit, and the image transmission unit is an information processing apparatus that transmits the alternative information acquired by the image acquisition unit to the user terminal.
[0010] With such a configuration, alternative information can be provided for a desired time.
[0011] Further, in the information processing apparatus of the fourth invention, with respect to the third invention, two or more pieces of alternative information associated with the position information are stored in the image storage unit. The image acquisition unit is a moving image at the position indicated by the position information satisfying the position condition included in the request information, and when it determines that it cannot acquire a moving image that can be provided to the user terminal within the time satisfying the time limit condition included in the request information, it is an information processing apparatus that acquires, from the image storage unit, alternative information that is a still image at the position indicated by the position information satisfying the position condition included in the request information.
[0012] With such a configuration, an appropriate image can be provided for a desired time.
[0013] Further, the user terminal of the fifth invention includes a terminal condition acquisition unit that acquires a time limit condition regarding the time until a video is acquired, a terminal request transmission unit that transmits request information having the time limit condition and a position condition corresponding to the video to be acquired, a terminal image reception unit that receives an image that is a video or a still image in response to the transmission of the request information, and a terminal image output unit that outputs the image received by the terminal reception unit.
[0014] With such a configuration, an image can be acquired and output within a desired time.
[0015] Further, the user terminal of the sixth invention further includes a terminal position acquisition unit that acquires terminal position information indicating the current position and a target position acquisition unit that acquires target position information that is the position information of the target point with respect to the fifth invention, and the terminal condition acquisition unit is a user terminal that acquires the time limit condition using the terminal position information and the target position information.
[0016] With such a configuration, an image can be acquired within an appropriate time.
Effect of the Invention
[0017] According to the information processing apparatus of the present invention, an image can be provided within a desired time.
Brief Description of the Drawings
[0018]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Modes for Carrying Out the Invention
[0019] Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. In the embodiments, components denoted by the same reference numerals perform the same operations, and thus the description may be omitted again.
[0020] (Embodiment 1) FIG. 1 is a conceptual diagram of an information system A in the present embodiment. The information system A includes an information processing apparatus 1, one or two or more user terminals 2, and one or two or more imaging devices 3.
[0021] The information processing device 1 is a device that receives images and the like from the imaging device 3 and transmits the images and the like to the user terminal 2. The images and the like are usually videos, but may also be still images. The information processing device 1 is usually a so-called server. The information processing device 1 is, for example, a cloud server or an ASP server, but its type does not matter.
[0022] The user terminal 2 is a terminal used by a user who requests a video. The user terminal 2 is, for example, a navigation terminal, a smartphone, or a tablet terminal, but its type does not matter. It is preferable that the user terminal 2 is an in-vehicle terminal. The in-vehicle terminal is a terminal mounted on a moving body. The moving body is, for example, an automobile, but may also be a bicycle, a motorcycle, or the like.
[0023] The imaging device 3 is a device that captures images and the like and transmits the images and the like. The imaging device 3 usually transmits images and the like to the information processing device 1. It is preferable that the imaging device 3 is a device that captures a video and transmits the video. However, the imaging device 3 may include a device that captures a video and transmits a still image included in the video, or may include a device that captures a still image and transmits the still image. The imaging device 3 may be, for example, a mobile terminal or a fixed terminal. The mobile terminal is a terminal mounted on a moving body. The fixed terminal is a terminal fixed to an object existing in the external world. The object existing in the external world is, for example, a building, a house, a telephone pole, a road sign, or the like. The mobile terminal is, for example, a drive recorder, a smartphone or a tablet terminal mounted on a moving body. The fixed terminal is, for example, a surveillance camera.
[0024] The information system A may have one or more external devices (not shown). The external device is a device that transmits traffic situation information. The traffic situation information is information regarding the traffic situation. The traffic situation information is, for example, information regarding the occurrence of an accident, information regarding the occurrence of a traffic jam, and information regarding the existence of a fallen object. The traffic situation information usually has location information. The location information is information indicating the location of the point of interest. The point of interest is, for example, the location where an accident occurred, the location where a traffic jam is occurring, and the location where a fallen object exists. The location information is, for example, (latitude, longitude), or (latitude, longitude, altitude). Note that the external device is a known device.
[0025] Figure 2 is a block diagram of the information system A in the present embodiment. Figure 3 is a block diagram of the information processing apparatus 1.
[0026] The information processing apparatus 1 includes a storage unit 11, a reception unit 12, a processing unit 13, and a transmission unit 14. The storage unit 11 includes a photographing device management unit 111 and an image storage unit 112. The reception unit 12 includes a request reception unit 121. The processing unit 13 includes an image acquisition unit 131. The transmission unit 14 includes an image transmission unit 141.
[0027] The user terminal 2 includes a terminal storage unit 21, a terminal reception unit 22, a terminal processing unit 23, a terminal transmission unit 24, a terminal reception unit 25, and a terminal output unit 26. The terminal storage unit 21 includes a condition management unit 211 and a terminal route storage unit 212. The terminal reception unit 22 includes a terminal instruction reception unit 221. The terminal processing unit 23 includes a terminal position acquisition unit 231, a point of interest position acquisition unit 232, a terminal condition acquisition unit 233, and a terminal determination unit 234. The terminal transmission unit 24 includes a terminal request transmission unit 241. The terminal reception unit 25 includes a terminal situation reception unit 251. The terminal output unit 26 includes a terminal inquiry output unit 261 and a terminal image output unit 262.
[0028] The photographing device 3 includes a photographing storage unit 31, a photographing processing unit 32, a photographing transmission unit 33, and a photographing reception unit 34. The photographing processing unit 32 includes a photographing position acquisition unit 321, a photographing unit 322, a photographing information acquisition unit 323, and a photographing storage unit 324.
[0029] Various types of information are stored in the storage unit 11 that constitutes the information processing apparatus 1. The various types of information are, for example, imaging device information, images, etc., which will be described later.
[0030] One or more pieces of imaging device information are stored in the imaging device management unit 111. The imaging device information is information regarding the imaging device 3. The imaging device information has, for example, an imaging device identifier and one or more imaging device attribute values. The imaging device identifier is information for identifying the imaging device 3. The imaging device identifier is, for example, the ID of the imaging device 3, the name of the imaging device 3, or information indicating the location where the imaging device 3 exists. The one or more imaging device attribute values are, for example, imaging device position information, imaging device type information, the angle of view (field of view) of the camera, information indicating whether it is a wide-angle lens or not, the resolution of the camera, and a format identifier.
[0031] The imaging device position information is the position information of the imaging device 3. The imaging device type information is information for specifying the type of the imaging device 3. The type of the imaging device 3 is, for example, a mobile terminal (e.g., "1") or a fixed terminal (e.g., "0"). The format identifier is information for identifying the format of the image captured by the imaging device 3. The format identifier for a moving image can be, for example, "AVI", "mp4", "MOV", "WMV", etc. The format identifier for a still image can be, for example, "RAW", "JPEG", "GIF", "PNG", "TIFF", "PSD", etc.
[0032] One or more images, etc., are stored in the image storage unit 112. The images, etc., are, for example, a moving image transmitted by the imaging device 3, a still image transmitted by the imaging device 3, or alternative information. The alternative information is information that substitutes for the image desired by the user. The alternative information may be a moving image or a still image transmitted by the imaging device 3. The alternative information may also be information prepared in advance (e.g., the character string "Please wait a moment"). Note that the moving image stored in the image storage unit 112 is appropriately referred to as the "stored moving image".
[0033] It is preferable that position information is associated with each of one or more images in the image storage unit 112. The position information here is an image that specifies the position where the image was taken. Each of one or more images in the image storage unit 112 may have image attribute values other than the position information associated therewith. The image attribute values are, for example, environmental information and tags. The environmental information is information regarding the environment in which the image was acquired, and is, for example, position information, time information for specifying the time of shooting, weather information, and temperature information. The tag is information for specifying an event shown in the image, and is, for example, "information indicating that there was an accident", "information indicating traffic congestion", and "information indicating that there is a falling object".
[0034] The receiving unit 12 receives various instructions and information. The various instructions and information are, for example, request information, images, shooting position information, and registration information, which will be described later. Note that the shooting position information is the position information of the imaging device 3.
[0035] The receiving unit 12 receives an image from the imaging device 3, for example. Such an image has, for example, an imaging device identifier associated therewith. Such an image has, for example, one or more imaging device attribute values associated therewith. Such an image has, for example, time information associated therewith. The time information is information for specifying the time (for example, the time) when the image was taken.
[0036] The receiving unit 12 receives position information from the imaging device 3, for example. The receiving unit 12 receives position information from the imaging device 3 of the mobile terminal, for example. The receiving unit 12 receives position information from the imaging device 3 of the mobile terminal constantly or continuously, for example. It is preferable that the receiving unit 12 does not receive position information from the imaging device 3 of the fixed terminal.
[0037] The receiving unit 12 receives registration information from, for example, the imaging device 3 or a terminal (not shown). The registration information is information for registering the imaging device 3. The registration information is information that constitutes the imaging device information. The registration information usually includes one or more imaging device attribute values. The one or more imaging device attribute values are, for example, type information, location information, orientation, field of view, lens type, resolution, and rights holder identifier. The type information is information for specifying the type of the imaging device 3, and is, for example, "fixed terminal" or "mobile terminal". The orientation is the direction in which the camera is facing. The lens type is information for specifying the type of the camera lens. The rights holder identifier is an identifier of the holder of the imaging device 3.
[0038] The request receiving unit 121 receives request information from the user terminal 2. The request information is information for requesting an image. It is preferable that the request information is information for requesting a video. The request information usually has a location condition. It is preferable that the request information has a time limit condition. The request information may not have a time limit condition.
[0039] The location condition is a condition related to the location of the image. The location of the image is the location where the image was taken. The location where the image was taken is usually the location of the imaging device 3 that took the image. The location condition has, for example, location information. The location condition has, for example, route information. The route information is information for specifying a route. The route information is, for example, a set of two or more location information, or information having one or two or more road identifiers.
[0040] The time limit condition is a condition related to the time until the user obtains a video. The time limit condition is, for example, "30 seconds" or "1 minute".
[0041] The processing unit 13 performs various processes. The various processes are, for example, the processes performed by the image acquisition unit 131.
[0042] The image acquisition unit 131 acquires an image or the like to be transmitted to the user terminal 2. The image acquisition unit 131 acquires, for example, a moving image that is paired with position information satisfying the position condition included in the request information and can be provided to the user terminal 2 within the time limit condition included in the request information.
[0043] For example, when the image acquisition unit 131 determines that it cannot provide a moving image to the user terminal 2 within the time limit condition, the image acquisition unit 131 acquires still images constituting the moving image. Note that, for example, when the format of the moving image is different from the format that the user terminal 2 can output, the image acquisition unit 131 determines that it cannot provide the moving image to the user terminal 2 within the time limit condition.
[0044] When the image acquisition unit 131 determines that it cannot acquire an image that is a moving image at the position indicated by the position information satisfying the position condition included in the request information and can be provided to the user terminal 2 within the time limit condition included in the request information, the image acquisition unit 131 may acquire alternative information from the image storage unit 112.
[0045] For example, when the image acquisition unit 131 determines that it cannot acquire an image that is a moving image at the position indicated by the position information satisfying the position condition included in the request information and can be provided to the user terminal 2 within the time limit condition included in the request information, the image acquisition unit 131 acquires, from the image storage unit 112, alternative information that is a moving image at the position indicated by the position information satisfying the position condition included in the request information.
[0046] When the request information does not have a time limit condition, it is preferable for the image acquisition unit 131 to acquire a moving image at the position indicated by the position information satisfying the position condition included in the request information.
[0047] The transmission unit 14 transmits various types of information or instructions. The various types of information or instructions are, for example, a moving image, a still image, alternative information, and a transmission instruction. The transmission instruction is an instruction to transmit an image. The transmission instruction is usually an instruction to transmit a moving image during shooting. The transmission unit 14 transmits the transmission instruction to one or more imaging devices 3.
[0048] The image transmission unit 141 transmits the video, still image, or alternative information acquired by the image acquisition unit 131 to the user terminal 2. Such a user terminal 2 is usually the user terminal 2 that has transmitted the request information.
[0049] Various types of information are stored in the terminal storage unit 21 that constitutes the user terminal 2. The various types of information are, for example, the transmission conditions, route information, format identifier, time limit conditions, user identifier, image request instructions described later, map information, and inquiry information described later. The time limit conditions of the terminal storage unit 21 are fixed time limit conditions.
[0050] The format identifier here is information for identifying the format of an image that can be displayed by the user terminal 2. Also, the time limit conditions here are, for example, the time limit conditions set by the user.
[0051] The condition management unit 211 stores the transmission conditions. The transmission conditions are the conditions for transmitting the request information. The transmission conditions are, for example, conditions related to traffic situation information. The traffic situation information is information related to the traffic situation. The traffic situation is, for example, a situation where an accident has occurred, a situation where a traffic jam has occurred, or a situation where there is a falling object.
[0052] The transmission conditions are, for example, that the position information corresponding to the traffic situation is the position information on the route indicated by the route information.
[0053] The map information is information on the map used for navigation. The map information is, for example, in the KIWI format, but the format is not limited.
[0054] The inquiry information is information for inquiring whether to request the user to acquire a video, and is, for example, information on a panel including "Do you want to acquire a video?".
[0055] The terminal route storage unit 212 stores route information that identifies the route to be traveled. The route information is usually information that identifies the route set by the user. The route information is, for example, information that identifies the route from the current position of the user terminal 2 to the destination set by the user. The route information has, for example, two or more pieces of position information.
[0056] The terminal reception unit 22 receives various types of information, instructions, etc. The various types of information, instructions, etc. are, for example, a destination, a time limit condition, an image request instruction.
[0057] The input means for the various types of information, instructions, etc. can be anything, such as a touch panel, a keyboard, a mouse, or by a menu screen.
[0058] The terminal instruction reception unit 221 receives an image request instruction in response to the output of an inquiry. The image request instruction is an instruction to request an image. The image request instruction is an instruction received in response to the output of an inquiry, but it can also be an instruction spontaneously input by the user without the output of an inquiry.
[0059] The terminal processing unit 23 performs various types of processing. The various types of processing are, for example, processing to convert the received information, instructions, etc. into information, instructions, etc. having a structure for transmission. The various types of processing are, for example, processing to convert the received information into information having a structure for output.
[0060] The terminal processing unit 23 configures, for example, the request information to be transmitted. The request information to be transmitted has a position condition. The position condition has, for example, the position information included in the traffic situation information. The position condition has, for example, the target position information acquired by the target position acquisition unit 232. The position condition has, for example, the position information of the destination. The request information to be transmitted has, for example, a time limit condition. Such a time limit condition is, for example, the dynamic time limit condition acquired by the terminal condition acquisition unit 233, or the time limit condition of the terminal storage unit 21.
[0061] The terminal position acquisition unit 231 acquires terminal position information indicating the current position of the user terminal 2. The terminal position acquisition unit 231 acquires the terminal position information by, for example, a GPS receiver. The terminal position information is the current position information of the user terminal 2.
[0062] The target position acquisition unit 232 acquires target position information which is the position information of the target point. The target position information is included in, for example, the received traffic situation information. The target position information is, for example, the position information of the destination set by the user. The target point is usually a point on the route specified by the route information. The target point is, for example, the occurrence point of a traffic accident, the start point of a traffic jam, the point where a traffic jam is occurring, the destination, the branching point towards the nearest exit of a highway, the entrance point of the nearest service area of a highway.
[0063] The terminal condition acquisition unit 233 acquires a time limit condition. The terminal condition acquisition unit 233 acquires the time limit condition by using, for example, the terminal position information and the target position information. Such a time limit condition is a dynamic time limit condition. The terminal condition acquisition unit 233 acquires, for example, the predicted travel time from the position indicated by the terminal position information to the position indicated by the target position information, and uses the travel time to acquire the time limit condition. The time limit condition is, for example, "the time until the travel time" or "the travel time - α (constant)". The terminal condition acquisition unit 233 may read the time limit condition from the terminal storage unit 21.
[0064] The terminal determination unit 234 determines whether or not the transmission condition is satisfied. The terminal determination unit 234 determines whether or not the received traffic situation information satisfies the transmission condition, for example. The terminal determination unit 234 may determine that the transmission condition is satisfied when, for example, an image transmission instruction from the user is received.
[0065] The terminal transmission unit 24 transmits various information, instructions, etc. to the information processing apparatus 1. The various information, instructions, etc. are, for example, request information.
[0066] When the terminal determination unit 234 determines that the transmission condition is satisfied, the terminal request transmission unit 241 transmits request information. Such request information is, for example, the request information acquired by the terminal processing unit 23.
[0067] When the terminal instruction reception unit 221 receives an image request instruction, the terminal request transmission unit 241 may transmit request information.
[0068] It is preferable that the terminal request transmission unit 241 transmits request information including the time limit condition acquired by the terminal condition acquisition unit 233.
[0069] The terminal reception unit 25 receives various types of information. The various types of information are traffic situation information, images, and the like.
[0070] The terminal output unit 26 outputs various types of information. The various types of information are, for example, images, map information, inquiries described later, alternative information, and the like.
[0071] Here, output generally refers to display on a display, but may also be a concept including projection using a projector, printing by a printer, sound output, transmission to an external device, storage in a recording medium, delivery of a processing result to another processing device or another program, and the like.
[0072] When the terminal determination unit 234 determines that the transmission condition is satisfied, the terminal inquiry output unit 261 outputs an inquiry as to whether to make a request for an image or the like according to the traffic situation information.
[0073] The terminal image output unit 262 outputs the image or the like received by the terminal reception unit 25.
[0074] Various types of information are stored in the photographing storage unit 31 that constitutes the photographing device 3. The various types of information are, for example, images, photographing information described later, and one or more photographing device attribute values.
[0075] The photographing processing unit 32 performs various types of processing. The various types of processing are, for example, the processing performed by the photographing position acquisition unit 321, the photographing unit 322, the photographing information acquisition unit 323, and the photographing storage unit 324.
[0076] The imaging position acquisition unit 321 acquires imaging position information. The imaging position information is information for specifying the position of the imaging device 3. The imaging position information is, for example, (latitude, longitude), or (latitude, longitude, altitude). It is preferable that the imaging position acquisition unit 321 acquires the imaging position information at the time of imaging or periodically.
[0077] The imaging unit 322 performs imaging and acquires an image or the like.
[0078] The imaging information acquisition unit 323 acquires imaging information. The imaging information includes, for example, an image or the like, the imaging position information, and time information for specifying the time of imaging.
[0079] The imaging storage unit 324 stores the imaging information acquired by the imaging information acquisition unit 323 in the imaging storage unit 31.
[0080] The imaging transmission unit 33 transmits various types of information. The various types of information are, for example, imaging information.
[0081] The imaging reception unit 34 receives various types of instructions and information. The various types of instructions and information are, for example, a transmission instruction. The transmission instruction is an instruction to transmit an image. The transmission instruction is an instruction to transmit the image being imaged.
[0082] The storage unit 11, the imaging device management unit 111, the image storage unit 112, the terminal storage unit 21, the condition management unit 211, the terminal route storage unit 212, and the imaging storage unit 31 are preferably non-volatile recording media, but can also be realized with volatile recording media.
[0083] The reception unit 12, the request reception unit 121, the terminal reception unit 25, the terminal status reception unit 251, and the imaging reception unit 34 are usually realized by wireless or wired communication means, but may also be realized by means of receiving broadcasts.
[0084] The processing unit 13, the image acquisition unit 131, the terminal processing unit 23, the target position acquisition unit 232, the terminal condition acquisition unit 233, the terminal determination unit 234, the shooting processing unit 32, the shooting information acquisition unit 323, and the shooting storage unit 324 can generally be realized by a processor, a memory, and the like. The processing procedures of the processing unit 13 and the like are generally realized by software, and the software is recorded on a recording medium such as a ROM. However, it may also be realized by hardware (dedicated circuit).
[0085] The transmission unit 14, the image transmission unit 141, the terminal transmission unit 24, the terminal request transmission unit 241, and the shooting transmission unit 33 are generally realized by wireless or wired communication means, but may also be realized by a broadcast means.
[0086] The terminal reception unit 22 and the terminal instruction reception unit 221 can be realized by a device driver of an input means such as a touch panel or a keyboard, control software of a menu screen, and the like.
[0087] The terminal position acquisition unit 231 and the shooting position acquisition unit 321 are realized by, for example, a GPS receiver.
[0088] The terminal output unit 26, the terminal inquiry output unit 261, and the terminal image output unit 262 may or may not be considered to include output devices such as a display and a speaker. The terminal output unit 26 can be realized by driver software of an output device or driver software of an output device and an output device.
[0089] The shooting unit 322 is realized by a camera. The camera is generally a device that can shoot a moving image, but may also be a device that can only shoot a still image.
[0090] Next, an operation example of the information system A will be described. First, an operation example of the information processing apparatus 1 will be described using the flowchart of FIG. 4.
[0091] (S401) The receiving unit 12 determines whether it has received the shooting position information or the like from the imaging device 3. If it has received the shooting position information or the like, it proceeds to S402; if it has not received the shooting position information or the like, it proceeds to S403.
[0092] Note that the imaging device 3 that transmits the shooting position information or the like is the imaging device 3 that autonomously transmits the shooting position information or the like to the information processing device 1.
[0093] (S402) The processing unit 13 associates the shooting position information or the like received in S401 with the imaging device identifier of the imaging device 3 that has transmitted the shooting position information or the like, and stores it in the imaging device management unit 111. It returns to S401.
[0094] (S403) The receiving unit 12 determines whether it has received an image or the like from the imaging device 3. If it has received an image or the like, it proceeds to S404; if it has not received an image or the like, it proceeds to S405.
[0095] (S404) The processing unit 13 associates the image or the like received in S403 with the imaging device identifier of the imaging device 3 that has transmitted the image or the like, and stores it in the image storage unit 112. It returns to S401.
[0096] (S405) The request receiving unit 121 determines whether it has received request information from the user terminal 2. If it has received the request information, it proceeds to S406; if it has not received the request information, it proceeds to S413.
[0097] (S406) The image acquisition unit 131 performs a process of acquiring an image or the like to be transmitted to the user terminal 2. An example of such an image acquisition process will be described using the flowchart of FIG. 5.
[0098] (S407) The processing unit 13 determines whether it has acquired an image or the like in S406. If it has acquired an image or the like, it proceeds to S408; if it has not acquired an image or the like, it proceeds to S412.
[0099] (S408) The image transmission unit 141 transmits the image or the like acquired in S406 to the user terminal 2 that has transmitted the request information.
[0100] (S409) The processing unit 13 determines whether a video or the like has been continuously received. If a video or the like has been continuously received, the process proceeds to S410; if not, the process returns to S406. Note that when continuously receiving a video or the like, it means continuously receiving a video or the like from the imaging device 3 that is already transmitting the video or the like when the video or the like has already been received.
[0101] (S410) The image transmission unit 141 transmits the continuously received video or the like to the user terminal 2.
[0102] (S411) The processing unit 13 uses the position information of the imaging device 3 that has been transmitting the video or the like to determine whether the imaging device 3 satisfies the target condition. If the target condition is satisfied, the process returns to S409; if not, the process returns to S406. Note that the target condition is a condition indicating that the imaging device 3 that has been transmitting the video or the like is a device that continuously transmits the video or the like. The target condition is, for example, that the latest position information of the imaging device 3 satisfies the position condition included in the request information. The position condition is, for example, that the distance from the point of interest (e.g., the location of a traffic accident, the starting point of a traffic jam, the destination set by the user in the user terminal 2) is within or less than a threshold value.
[0103] Note that when the imaging device 3 is a mobile terminal, when the imaging device 3 moves to a situation where the point of interest cannot be photographed, the imaging device 3 is determined not to satisfy the target condition. When the imaging device 3 is a mobile terminal, the imaging device 3 usually continuously transmits the latest position information to the information processing device 1.
[0104] (S412) The processing unit 13 determines whether to end the transmission of the image or the like to the user terminal 2. If it is to end, the process returns to S401; if not, the process returns to S406. Note that the end condition for the transmission of the image or the like is not limited. The end condition is, for example, receiving an end instruction from the user terminal 2 or transmitting a video for a certain period of time or more.
[0105] (S413) The receiving unit 12 determines whether it has received registration information from the imaging device 3. If it has received the registration information, it proceeds to S414; if it has not received the registration information, it returns to S401.
[0106] (S414) The processing unit 13 acquires a unique imaging device identifier. The processing unit 13 uses the registration information received in S413 and the imaging device identifier to configure imaging device information. Next, the processing unit 13 stores the imaging device information in the imaging device management unit 111. It returns to S401.
[0107] Note that in the flowchart of FIG. 4, the processing ends due to a power-off or a processing end interrupt.
[0108] Next, an example of the image acquisition process in S406 will be described using the flowchart of FIG. 5.
[0109] (S501) The image acquisition unit 131 determines whether the information processing device 1 is transmitting a video to the user terminal 2. If it is transmitting a video, it proceeds to S502; if it is not transmitting a video, it proceeds to S503.
[0110] (S502) The image acquisition unit 131 clears the time limit condition included in the received request information.
[0111] (S503) The image acquisition unit 131 uses the received request information to search for one or more imaging devices 3 capable of transmitting a video. An example of such an imaging device search process will be described using the flowchart of FIG. 6.
[0112] (S504) The image acquisition unit 131 determines whether it has found one or more imaging devices 3 in S503. If it has found one or more imaging devices 3, it proceeds to S505; if it has not found any, it proceeds to S516.
[0113] (S505) The image acquisition unit 131 assigns 1 to the counter i.
[0114] (S506) The image acquisition unit 131 determines whether the i-th imaging device 3 exists among the imaging devices 3 searched in S503. If the i-th imaging device 3 exists, the process proceeds to S507; if not, it returns to the upper-level process.
[0115] (S507) The image acquisition unit 131 sends a transmission instruction to the i-th imaging device 3. Note that the transmission instruction is an instruction to transmit the currently being captured video (real-time video).
[0116] (S508) The image acquisition unit 131 determines whether it has received a video or the like from the i-th imaging device 3 in response to the transmission of the transmission instruction. If it has received a video or the like, the process proceeds to S509; if not, it returns to S508. Note that the video or the like includes, for example, a video and an imaging device identifier. The video or the like may include one or more imaging device attribute values.
[0117] (S509) The image acquisition unit 131 determines whether a time limit condition exists in the received request information. If a time limit condition exists, the process proceeds to S510; if not, it proceeds to S514. Note that if the time limit condition is cleared, it is determined that there is no time limit condition.
[0118] (S510) The image acquisition unit 131 determines whether it satisfies the time limit condition included in the request information. An example of such a time limit condition determination process will be described using the flowchart of FIG. 7.
[0119] (S511) If the determination result in S510 is "satisfies the time limit condition", the image acquisition unit 131 proceeds to S512; if it is "does not satisfy the time limit condition", it proceeds to S513.
[0120] (S512) The image acquisition unit 131 performs a process of acquiring the video to be transmitted to the user terminal 2 using the video received from the i-th imaging device 3. The process proceeds to S515. An example of such a video acquisition process will be described using the flowchart of FIG. 8.
[0121] (S513) The image acquisition unit 131 acquires one still image that constitutes the video received from the i-th imaging device 3. If the format of the one still image is different from the format of the still image that can be displayed on the user terminal 2, the image acquisition unit 131 changes the format of the acquired one still image to the format of the still image that can be displayed on the user terminal 2. Proceed to S515. Note that the image acquisition unit 131 usually acquires a still image that satisfies the position condition in the request information among the still images that constitute the received video.
[0122] (S514) The image acquisition unit 131 performs a process of acquiring a video to be transmitted to the user terminal 2 using the video received from the i-th imaging device 3. Proceed to S515. Note that there is no time limit in the video acquisition process here.
[0123] (S515) The image acquisition unit 131 increments the counter i by 1. Return to S506.
[0124] (S516) Since the image acquisition unit 131 determines that it cannot acquire a real-time video from the imaging device 3, it acquires alternative information. An example of such alternative information acquisition process will be described using the flowchart of FIG. 9. Return to the upper-level process.
[0125] Next, an example of the imaging device search process in S503 will be described using the flowchart of FIG. 6.
[0126] (S601) The image acquisition unit 131 acquires the position condition included in the received request information.
[0127] (S602) The image acquisition unit 131 assigns 1 to the counter i.
[0128] (S603) The image acquisition unit 131 determines whether the i-th imaging device information exists in the imaging device management unit 111. If the i-th imaging device information exists, proceed to S604; if it does not exist, proceed to S608.
[0129] (S604) The image acquisition unit 131 acquires the shooting position information included in the i-th shooting device information.
[0130] (S605) The image acquisition unit 131 determines whether the shooting position information acquired in S604 satisfies the position condition acquired in S601. If it satisfies the position condition, the process proceeds to S606. If it does not satisfy the position condition, the process proceeds to S607.
[0131] (S606) The image acquisition unit 131 acquires the shooting device identifier, etc. included in the i-th shooting device information. The shooting device identifier, etc. here may be only the shooting device identifier, or may be the shooting device identifier and one or more shooting device attribute values.
[0132] (S607) The image acquisition unit 131 increments the counter i by 1 and returns to S603.
[0133] (S608) The image acquisition unit 131 acquires the number of shooting device identifiers acquired in S606.
[0134] (S609) The image acquisition unit 131 determines whether the number of shooting device identifiers acquired in S608 is "0" or 1 or more. If the number is "0", it returns to the upper-level process. If the number is 1 or more, the process proceeds to S610.
[0135] (S610) The image acquisition unit 131 determines whether the number of shooting device identifiers satisfies the adoption condition. If it satisfies the adoption condition, the process proceeds to S616. If it does not satisfy the adoption condition, the process proceeds to S611. The adoption condition is a condition for determining the shooting device 3 that transmits the video. The adoption condition is usually that the number of shooting device identifiers is equal to or less than a threshold value (for example, "1" or "2").
[0136] (S611) The image acquisition unit 131 substitutes 1 for the counter i.
[0137] (S612) The image acquisition unit 131 determines whether the j-th imaging device 3 identified by the imaging device identifier acquired in S608 exists. If the j-th imaging device 3 exists, the process proceeds to S61; if it does not exist, the process proceeds to S616.
[0138] (S613) The image acquisition unit 131 acquires one or more imaging device attribute values of the j-th imaging device 3. Note that the imaging device attribute value is, for example, the angle of view, the resolution, or the distance between the point of interest and the position indicated by the position information of the imaging device 3.
[0139] (S614) The image acquisition unit 131 uses the one or more imaging device attribute values acquired in S613 to obtain the score of the j-th imaging device 3. Note that the score is, for example, larger as the angle of view is larger, larger as the resolution is larger, and larger as the distance between the point of interest and the position indicated by the position information of the imaging device 3 is smaller.
[0140] (S615) The image acquisition unit 131 sets the counter i to 1 and increments it. Then it returns to S612.
[0141] (S616) The image acquisition unit 131 acquires the imaging device identifiers of one or more imaging devices 3 to be adopted and returns to the upper-level process.
[0142] Note that, for example, the maximum number (N) of imaging devices 3 to be adopted is determined, and the image acquisition unit 131 acquires, for example, the imaging device identifiers of the imaging devices 3 up to the top N in terms of score. Also, when the adoption conditions are met, the image acquisition unit 131 acquires all the imaging device identifiers acquired in S606.
[0143] Also, in the flowchart of FIG. 6, when the number of acquired imaging device identifiers is 2 or more, for example, the image acquisition unit 131 may preferentially acquire the imaging device identifiers of the imaging devices 3 whose type information is "fixed terminal" over the imaging device identifiers of the imaging devices 3 whose type information is "mobile terminal".
[0144] Next, an example of the time limit condition determination process in S510 will be described with reference to the flowchart of FIG. 7.
[0145] (S701) The image acquisition unit 131 acquires a time limit condition.
[0146] (S702) The image acquisition unit 131 acquires the format identifier of the received video.
[0147] (S703) The image acquisition unit 131 acquires the format identifier of the video that can be displayed on the user terminal 2.
[0148] (S704) The image acquisition unit 131 determines whether the format identifier acquired in S702 matches or is different from the format identifier acquired in S703. If they match, the image acquisition unit 131 acquires the conversion presence / absence information "conversion not required", and if they are different, the image acquisition unit 131 acquires the conversion presence / absence information "conversion required".
[0149] (S705) The image acquisition unit 131 acquires the elapsed time since the request information was received.
[0150] (S706) The image acquisition unit 131 determines whether the time limit condition is satisfied using the time of the time limit condition, the elapsed time acquired in S705, and the conversion presence / absence information, and acquires the determination result. Return to the upper-level process.
[0151] Note that the judgment result is either "meets the time limit condition" or "does not meet the time limit condition". Also, for example, when the conversion presence / absence information is "conversion not required", if the time of the time limit condition >= the elapsed time obtained at S705 + the margin time, the image acquisition unit 131 obtains the judgment result "meets the time limit condition", and if the time of the time limit condition < the elapsed time obtained at S705 + the margin time, the image acquisition unit 131 obtains the judgment result "does not meet the time limit condition". The margin time is a constant, for example, "30 seconds" or "10 seconds". Also, for example, when the conversion presence / absence information is "conversion required", if the time of the time limit condition >= the elapsed time obtained at S705 + the margin time + the conversion time, the image acquisition unit 131 obtains the judgment result "meets the time limit condition", and if the time of the time limit condition < the elapsed time obtained at S705 + the margin time + the conversion time, the image acquisition unit 131 obtains the judgment result "does not meet the time limit condition". The conversion time is a constant, for example, "20 seconds" or "10 seconds".
[0152] Next, an example of the video acquisition process of S512 and S514 will be described using the flowchart of FIG. 8.
[0153] (S801) The image acquisition unit 131 acquires the received video.
[0154] (S802) The image acquisition unit 131 determines whether format conversion of the received video is necessary. If format conversion is necessary, the process proceeds to S803; if format conversion is not necessary, the process returns to the upper-level process.
[0155] (S803) The image acquisition unit 131 converts the format of the received video into a format that can be displayed by the user terminal 2. The process returns to the upper-level process.
[0156] Note that in the flowchart of FIG. 8, since the process of video format conversion is a known technique, detailed description is omitted.
[0157] Next, an example of the alternative information acquisition process of S516 will be described using the flowchart of FIG. 9.
[0158] (S901) The image acquisition unit 131 acquires the position condition included in the received request information.
[0159] (S902) The image acquisition unit 131 assigns 1 to the counter i.
[0160] (S903) The image acquisition unit 131 determines whether the i-th stored video exists in the image storage unit 112. If the i-th stored video exists, the process proceeds to S904; if not, the process proceeds to S908.
[0161] (S904) The image acquisition unit 131 acquires the position information corresponding to the i-th stored video from the image storage unit 112.
[0162] (S905) The image acquisition unit 131 determines whether the position information acquired in S904 satisfies the position condition acquired in S901. If the position condition is satisfied, the process proceeds to S906; if not, the process proceeds to S907.
[0163] (S906) The image acquisition unit 131 acquires the stored video identifier corresponding to the i-th stored video from the image storage unit 112.
[0164] (S907) The image acquisition unit 131 increments the counter i by 1. The process returns to S903.
[0165] (S908) The image acquisition unit 131 acquires the number of stored video identifiers acquired in S906.
[0166] (S909) The image acquisition unit 131 determines whether the number of stored video identifiers acquired in S908 is "0" or 1 or more. If the number of stored video identifiers is "0", the process proceeds to S910; if it is 1 or more, the process proceeds to S911.
[0167] (S910) The image acquisition unit 131 acquires alternative information indicating that there is no image. The process returns to the upper-level process.
[0168] (S911) The image acquisition unit 131 determines whether the number of the accumulated video identifiers acquired in S908 meets the adoption conditions. If the adoption conditions are met, the process proceeds to S916; if not, the process proceeds to S912.
[0169] (S912) The image acquisition unit 131 assigns 1 to the counter j.
[0170] (S913) The image acquisition unit 131 determines whether the j-th accumulated video identified by the accumulated video identifier acquired in S908 exists. If the j-th accumulated video exists, the process proceeds to S914; if not, the process proceeds to S916.
[0171] (S914) The image acquisition unit 131 acquires one or more accumulated video attribute values of the j-th accumulated video. Next, the image acquisition unit 131 acquires the score of the j-th accumulated video using the one or more accumulated video attribute values.
[0172] Note that the one or more accumulated video attribute values are, for example, the viewing angle, the resolution, and the distance from the point of interest to the position indicated by the position information paired with the accumulated video. The image acquisition unit 131 acquires a larger score as the viewing angle is larger, acquires a larger score as the resolution is larger, and acquires a larger score as the distance from the point of interest to the position indicated by the position information paired with the accumulated video is smaller.
[0173] (S915) The image acquisition unit 131 increments the counter j by 1. The process returns to S913.
[0174] (S916) The image acquisition unit 131 acquires one or more accumulated videos to be adopted from the image storage unit 112. Return to the upper-level process.
[0175] Note that when the maximum number of accumulated videos to be adopted is "N", the image acquisition unit 131 acquires, for example, the accumulated videos with the top N scores from the image storage unit 112. When the adoption conditions are met, the image acquisition unit 131 acquires the accumulated videos identified by the one or more accumulated video identifiers acquired in S906 from the image storage unit 112.
[0176] Next, an operation example of the user terminal 2 will be described using the flowchart of FIG. 10.
[0177] (S1001) The terminal position acquisition unit 231 acquires the current position of the user terminal 2.
[0178] (S1002) The terminal processing unit 23 acquires a map corresponding to the current position from the terminal storage unit 21. The terminal output unit 26 outputs the map.
[0179] (S1003) The terminal status reception unit 251 determines whether traffic status information has been received from an external device (not shown). If the traffic status information has been received, the process proceeds to S1004; if not, the process proceeds to S1005.
[0180] (S1004) The terminal processing unit 23 temporarily stores the traffic status information received in S1003 in the terminal storage unit 21. The process returns to S1001.
[0181] (S1005) The terminal reception unit 22 determines whether a destination has been received from the user. If a destination has been received, the process proceeds to S1006; if not, the process proceeds to S1009.
[0182] (S1006) The terminal position acquisition unit 231 acquires the current position of the user terminal 2.
[0183] (S1007) The terminal processing unit 23 acquires route information for specifying a route from the current position to the destination using the current position acquired in S1006 and the destination received in S1005, and stores the route information in the terminal storage unit 21.
[0184] (S1008) The terminal processing unit 23 outputs the route specified by the route information on the output map. The process returns to S1001.
[0185] (S1009) The terminal condition acquisition unit 233 acquires the transmission conditions of the condition management unit 211.
[0186] (S1010) The terminal determination unit 234 determines whether or not the transmission conditions are satisfied. An example of such terminal determination processing will be described using the flowchart of FIG. 11.
[0187] (S1011) If the determination result in S1010 is "the transmission conditions are satisfied", the process proceeds to S1012. If the determination result is "the transmission conditions are not satisfied", the process returns to S1001.
[0188] (S1012) The terminal processing unit 23 acquires the flag in the terminal storage unit 21 and determines whether the flag indicates information indicating "output an inquiry" or information indicating "do not output an inquiry". If the flag indicates information indicating "output an inquiry", the process proceeds to S1013. If the flag indicates information indicating "do not output an inquiry", the process proceeds to S1015.
[0189] (S1013) The terminal inquiry output unit 261 reads out an inquiry from the terminal storage unit 21 and outputs the inquiry. Such an inquiry is information for inquiring the user whether or not to request a video.
[0190] (S1014) The terminal instruction reception unit 221 determines whether or not a request instruction for an image (usually a video) has been received from the user in response to the output of the inquiry. If a request instruction for an image has been received, the process proceeds to S1015. If a request instruction for an image has not been received, the process returns to S1001.
[0191] (S1015) The terminal processing unit 23 acquires the request information. An example of such request information acquisition processing will be described using the flowchart of FIG. 12.
[0192] (S1016) The terminal request transmission unit 241 transmits the request information acquired in S1015 to the information processing apparatus 1.
[0193] (S1017) The terminal reception unit 25 determines whether or not information has been received from the information processing apparatus 1 in response to the transmission of the request information in S1016. If information has been received, the process proceeds to S1018. If information has not been received, the process returns to S1017.
[0194] (S1018) The terminal image output unit 262 outputs the information received in S1017. Note that such information is usually a video, but it may also be a still image, a character string, or the like.
[0195] (S1019) The terminal processing unit 23 determines whether to end the output of the information. If it is determined to end the output of the information, it returns to S1001; if it is determined not to end the output of the information, it returns to S1017. Note that the trigger for ending the output of the information is not limited.
[0196] Note that in the flowchart of FIG. 10, the process ends due to a power-off or a processing end interrupt.
[0197] Next, an example of the terminal determination process in S1010 will be described using the flowchart of FIG. 11.
[0198] (S1101) The terminal determination unit 234 determines whether the received traffic situation information exists in the terminal storage unit 21. If the traffic situation information exists, it proceeds to S1102; if it does not exist, it proceeds to S1106.
[0199] (S1102) The terminal determination unit 234 acquires the route information of the terminal storage unit 21. Note that if the route information does not exist in the terminal storage unit 21, the terminal determination unit 234 acquires the route information of a route having one or more consecutive roads in the traveling direction including the current position.
[0200] (S1103) The terminal determination unit 234 determines whether a point indicated by the position information of the target point included in the traffic situation information exists on the route specified by the route information acquired in S1102. If the target point exists on the route, it is determined that the transmission condition is satisfied and it proceeds to S1104; if the target point does not exist on the route, it is determined that the transmission condition is not satisfied and it proceeds to S1105.
[0201] (S1104) The terminal determination unit 234 substitutes "satisfied" into the determination result. It returns to the upper-level process.
[0202] (S1105) The terminal determination unit 234 substitutes "not satisfied" into the determination result and returns to the upper-level process.
[0203] (S1106) The terminal determination unit 234 determines whether the terminal reception unit 22 has received an image transmission instruction from the user. If an image transmission instruction has been received, it proceeds to S1104; if not, it proceeds to S1105.
[0204] Next, an example of the request information acquisition process in S1015 will be described using the flowchart in FIG. 12.
[0205] (S1201) The attention position acquisition unit 232 acquires the position information of the attention point.
[0206] (S1202) The terminal condition acquisition unit 233 determines whether there is a time limit condition in the condition management unit 211. If there is a time limit condition, it proceeds to S1207; if not, it proceeds to S1203.
[0207] (S1203) The terminal position acquisition unit 231 acquires the current position of the user terminal 2.
[0208] (S1204) The terminal condition acquisition unit 233 performs a restricted point determination process. An example of the restricted point determination process will be described using the flowchart in FIG. 13. Note that the restricted point determination process is a process of determining the restricted point, which is the limit point where a video is desired to be output.
[0209] (S1205) The terminal condition acquisition unit 233 acquires the travel time from the current position to the restricted point.
[0210] (S1206) The terminal condition acquisition unit 233 acquires the time limit condition using the travel time acquired in S1205. For example, the terminal condition acquisition unit 233 acquires "the travel time acquired in S1205 + buffer time (the buffer time is, for example, 20 seconds)" as the time limit condition.
[0211] (S1207) The terminal condition acquisition unit 233 reads out the time limit condition from the condition management unit 211.
[0212] (S1208) The terminal condition acquisition unit 233 acquires a position condition by using the position information of the point of interest. Note that the position condition is, for example, "the distance from the point indicated by the position information of the point of interest is within a threshold value" and "the position information of the point of interest".
[0213] (S1209) The terminal condition acquisition unit 233 constructs request information having the time limit condition and the position condition, and returns to the upper-level process.
[0214] Next, an example of the restricted point determination process of S1204 will be described using the flowchart of FIG. 13.
[0215] (S1301) The terminal condition acquisition unit 233 determines whether the current position is a position on a highway by using the acquired current position and the map information. If the current position is a position on a highway, the process proceeds to S1302. If the current position is not a position on a highway, the process proceeds to S1305.
[0216] (S1302) The terminal condition acquisition unit 233 acquires the position information of the branch point of the exit (highway exit) that is the farthest from the current position among the points between the current position and the point of interest by using the map information of the terminal storage unit 21.
[0217] (S1303) The terminal condition acquisition unit 233 determines whether the position information could be acquired in S1302. If the position information could be acquired, it returns to the upper-level process. If the position information could not be acquired, the process proceeds to S1304.
[0218] (S1304) The terminal condition acquisition unit 233 acquires the position information of the point of the entrance to the service area that is the farthest from the current position among the points between the current position and the point of interest by using the map information of the terminal storage unit 21, and returns to the upper-level process.
[0219] (S1305) The terminal condition acquisition unit 233 acquires the position information of the intersection that is the farthest from the current position among the points between the current position and the target point, using the map information in the terminal storage unit 21. Return to the upper-level process.
[0220] In addition, in the flowchart of FIG. 13, S1302 and S1304 may be interchanged, or both processes may be performed.
[0221] Next, an operation example of the imaging device 3 will be described using the flowchart of FIG. 14.
[0222] (S1401) The imaging position acquisition unit 321 acquires imaging position information that specifies the position of the imaging device 3.
[0223] (S1402) The imaging unit 322 performs imaging and acquires a moving image.
[0224] (S1403) The imaging information acquisition unit 323 constructs imaging information having the imaging position information and the moving image. The imaging storage unit 324 stores the imaging information in the imaging storage unit 31.
[0225] Note that the imaging information may have, for example, one or more imaging device attribute values. The one or more imaging device attribute values are, for example, an angle of view, a resolution, and a format identifier.
[0226] (S1404) The imaging reception unit 34 determines whether a transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S1405. If a transmission instruction has not been received, the process proceeds to S1406.
[0227] (S1405) The imaging transmission unit 33 acquires the latest moving image or the like from the imaging storage unit 31 and transmits the moving image or the like to the information processing device 1. Return to the upper-level process.
[0228] Note that the moving image or the like is, for example, a moving image and an imaging device identifier. The moving image or the like is, for example, a moving image, an imaging device identifier, and one or more imaging device attribute values.
[0229] (S1406) The imaging processing unit 32 determines whether to transmit the information to the information processing apparatus 1. If it is to transmit the information, it proceeds to S1407; if not, it returns to S1401.
[0230] Whether the imaging apparatus 3 spontaneously transmits information to the information processing apparatus 1 is usually determined in advance. Also, the information that the imaging apparatus 3 spontaneously transmits to the information processing apparatus 1 is determined in advance.
[0231] When the imaging apparatus 3 is a mobile terminal, the imaging apparatus 3 usually spontaneously transmits position information or videos, etc. The videos, etc. here usually include videos and position information. When the imaging apparatus 3 is a fixed terminal, the imaging apparatus 3 may spontaneously transmit videos or may not spontaneously transmit information.
[0232] (S1407) The imaging processing unit 32 configures the information to be transmitted to the information processing apparatus 1. Note that the information to be transmitted includes videos or position information. The information to be transmitted usually includes an imaging apparatus identifier. The information to be transmitted may also include one or more imaging apparatus attribute values.
[0233] (S1408) The imaging transmission unit 33 transmits the information configured in S1407 to the information processing apparatus 1. Then it returns to S1401.
[0234] Note that in the flowchart of FIG. 14, the processing ends due to a power-off or a processing end interrupt.
[0235] Hereinafter, a specific operation example of the information system A in the present embodiment will be described.
[0236] Now, assume that the imaging device management unit 111 of the information processing apparatus 1 stores the imaging device management table shown in FIG. 15. The imaging device management table is a table that manages one or more pieces of imaging device information. The imaging device management table manages one or more records having "ID" and "imaging device information". "ID" is information for identifying a record. "Imaging device information" has "imaging device identifier" and "imaging device attribute value". "Imaging device attribute value" has "type information", "location information", "direction", "angle of view", "resolution", "format identifier", and "rights holder identifier". "Type information" is information for specifying the type of the imaging device 3. Type information "0" indicates that the imaging device 3 is a fixed terminal, and "1" indicates that it is a mobile terminal. "Location information" is information for specifying the location of the imaging device 3. Here, the location information is (latitude, longitude), but it may also be (latitude, longitude, altitude). "Direction" indicates the direction of the camera that captures a video. "Angle of view" is the angle of view of the camera. "Resolution" indicates the resolution of the captured image. "Format identifier" indicates the format of the captured video. "Rights holder identifier" is the owner of the imaging device 3 and indicates the rights holder of the video.
[0237] Assume that the image storage unit 112 stores the video management table shown in FIG. 16. The video management table is a table that manages videos transmitted from one or two or more imaging devices 3. The video management table manages one or more records having "ID", "video identifier", "access information", "rights holder identifier", and "video information". "Video information" has "frame identifier" and "video attribute value". "Video attribute value" has "environment information" and "tag". "Environment information" has "location information", "time information", "weather information", and "temperature information". "Tag" has "accident", "traffic jam", and "falling object".
[0238] In FIG. 16, "access information" is the location where the video exists, usually a URL. Also, "frame identifier" is the ID of the frame that constitutes the video. A frame can also be referred to as a field or a still image. "Location information" here is (latitude, longitude). "Time information" here is the year, month, day, hour, minute, and second. "Weather information" is, for example, "sunny", "rainy", "cloudy", or "snowy". "Temperature information" is the outside air temperature (°C) of the moving object. The value "1" for "accident" indicates that a tag indicating an accident has occurred is attached to the corresponding frame. The value "1" for "traffic jam" indicates that a tag indicating a traffic jam has occurred is attached to the corresponding frame. The value "1" for "falling object" indicates that a tag indicating a falling object is shown is attached to the corresponding frame. Note that "environmental information" is the information acquired by the imaging device 3 that transmits the video and transmitted to the information processing device 1 in association with the video. "Tag" may be the information acquired by the imaging device 3 that transmits the video and transmitted to the information processing device 1 in association with the video, or may be the information acquired by the processing unit 13 of the information processing device 1 by analyzing each frame that constitutes the video. Note that the process of analyzing each frame that constitutes the video and determining whether an accident has occurred, whether a traffic jam has occurred, and whether a falling object exists is a known technique, so the description is omitted. Also, the occurrence of "accident" and "traffic jam" may be information received by the imaging device 3 from an external device (not shown).
[0239] In the above situation, the following four specific examples will be described. Specific example 1 is the case where, when an accident occurs on the route set in the user terminal 2, the user terminal 2 receives and outputs a video that meets the time limit condition. Specific example 2 is the case where, before arriving at the destination, the user terminal 2 receives and outputs a video that meets the time limit condition. Specific example 3 is the case where, when an accident occurs on the route set in the user terminal 2 and it is determined that the time limit condition is not met, the user terminal 2 receives and outputs a still image. Specific example 4 is the case where, when an accident occurs on the route set in the user terminal 2 and there is no video or the like of the accident scene, the user terminal 2 receives and outputs an alternative video.
[0240] (Specific Example 1) Now, assume that the condition management unit 211 of the user terminal 2 of the user identified by the user identifier "U005" stores a transmission condition "<Traffic condition> Accident occurred OR Traffic jam occurred <Location condition> The target point is a point on the route". Also assume that the condition management unit 211 stores a time limit condition "30 seconds". Also assume that the terminal storage unit 21 stores an identifier "mp4" of the format of the video that the user terminal 2 can output. Also assume that the terminal storage unit 21 stores a flag "Do not output an inquiry". Further, in the user terminal 2, a route to the destination set by the user is set, and route information for specifying the route is stored in the terminal route storage unit 212.
[0241] Next, assume that the terminal status reception unit 251 of the user terminal 2 receives traffic status information "<Traffic status> Accident occurred <Location information> (Xa, Ya)" from an external device (not shown). The image diagram of the accident site is shown in FIG. 17. In FIG. 17, assume that the moving body 40 has an accident, and the subsequent moving bodies 41, 42, 43, etc. are involved in a traffic jam due to the accident. Also assume that the moving body 44 is about to be involved in a traffic jam soon.
[0242] Next, the terminal determination unit 234 of the user terminal 2 determines that the traffic condition condition included in the transmission condition is satisfied based on the transmission condition "<Traffic condition> Accident occurred OR Traffic jam occurred..." and the traffic status information "<Traffic status> Accident occurred...". Also, the terminal determination unit 234 determines that the location condition included in the transmission condition is satisfied based on the transmission condition "...<Location condition> The target point is a point on the route", the route information in the terminal route storage unit 212, and the traffic status information "...<Location information> (Xa, Ya)". That is, the terminal determination unit 234 determines that the transmission condition is satisfied.
[0243] Next, the terminal processing unit 23 detects the flag "Do not output inquiry" in the terminal storage unit 21, and obtains the request information as follows without outputting an inquiry. First, the target position acquisition unit 232 acquires the position information (Xa, Ya) of the target point included in the traffic situation information. Also, the terminal condition acquisition unit 233 acquires the time limit condition "30 seconds" of the condition management unit 211. Next, the terminal condition acquisition unit 233 uses the position information of the target point to acquire the position condition "(range of Xm centered on (Xa, Ya))". Here, X is, for example, a constant, for example, "20". Further, the terminal condition acquisition unit 233 acquires the format identifier "mp4" of the terminal storage unit 21. From the above, the terminal condition acquisition unit 233 constructs the request information "<position condition> (range of Xm centered on (Xa, Ya)) <time limit condition> 30 seconds <format identifier> mp4". Next, the terminal request transmission unit 241 transmits the request information to the information processing apparatus 1.
[0244] Next, the request reception unit 121 of the information processing apparatus 1 receives the request information from the user terminal 2.
[0245] Next, the image acquisition unit 131 acquires a moving image that matches the request information according to the operation of the flowchart in FIG. 5. That is, the image acquisition unit 131 searches for one or more imaging devices 3 corresponding to the position information that satisfies the condition of "(range of Xm centered on (Xa, Ya))" using the position information of each imaging device 3 in the imaging device management table (FIG. 15), and it is assumed that the imaging device identifiers "C01, C02" that satisfy the position condition are obtained.
[0246] Next, the image acquisition unit 131 acquires the format identifier "mp4" of the user terminal 2, and determines whether the format identifier paired with the imaging device identifier "C01, C02" matches the format identifier "mp4". Then, the image acquisition unit 131 acquires the imaging device identifier "C01" paired with the format identifier that matches "mp4", and does not acquire the imaging device identifier "C02" paired with the format identifier that does not match "mp4". That is, here, it is assumed that the image acquisition unit 131 determines that the time limit condition is not satisfied when video format conversion is necessary, and determines that the time limit condition is satisfied when video format conversion is not necessary.
[0247] Next, the image acquisition unit 131 sends a video transmission instruction to the imaging device 3 identified by the imaging device identifier "C01".
[0248] Next, the imaging device 3 identified by the imaging device identifier "C01" receives the video transmission instruction from the information processing device 1, and transmits the video being shot to the information processing device 1.
[0249] Next, the image acquisition unit 131 of the information processing device 1 receives the video from the imaging device 3 identified by the imaging device identifier "C01". Then, the image transmission unit 141 transmits the video to the user terminal 2.
[0250] Next, the user terminal 2 receives and outputs the video. Such an output example is 441 in FIG. 17.
[0251] In addition, in Specific Example 1, when the information processing device 1 determines that the video transmitted from the imaging device 3 identified by the imaging device identifier "C02" also satisfies the time limit condition, the information processing device 1 also receives the video C021 corresponding to the imaging device identifier "C02" from the imaging device 3 and transmits it to the user terminal 2.
[0252] And in such a case, the user terminal 2 receives and outputs the two videos C011 and C021.
[0253] As described above, in this specific example, when an accident occurs on the route set in the user terminal 2, the user terminal 2 can receive and output a video that meets the time limit condition. As a result, before arriving at the location where the accident occurred, the user can grasp the situation at the accident scene, so that the user can exit the highway, change the planned route, or take a detour.
[0254] (Specific Example 2) Now, assume that in the condition management unit 211 of the user terminal 2 of the user identified by the user identifier "U005", the transmission condition "<time condition> 5 minutes before arriving at the destination <location condition> location information of the destination" is stored. Also, assume that the time limit condition "1 minute" is stored in the condition management unit 211. Also, assume that in the terminal storage unit 21, the identifier "mp4" of the format of the video that the user terminal 2 can output is stored. Also, assume that the flag "output an inquiry" is stored in the terminal storage unit 21. Further, in the user terminal 2, the route to the destination D set by the user is set, and the route information specifying the route is stored in the terminal route storage unit 212. Note that the route information includes the location information (Xd, Yd) of the destination D.
[0255] Next, assume that the user is driving their own moving body (automobile). Then, when it is 5 minutes before arriving at the destination, the terminal condition acquisition unit 233 of the user terminal 2 determines that the transmission condition "<time condition> 5 minutes before arriving at the destination" of the condition management unit 211 is satisfied.
[0256] Next, the terminal processing unit 23 of the user terminal 2 acquires the flag in the terminal storage unit 21, detects that the flag is information indicating "output an inquiry", and outputs a panel for inquiring the user whether to request a video.
[0257] Next, the user presses the "video request instruction" button included in the panel. Then, the terminal instruction reception unit 221 receives an image request instruction from the user in response to the output of the inquiry.
[0258] Next, in response to receiving the image request instruction, the terminal processing unit 23 of the user terminal 2 acquires the request information "<Time limit condition> 1 minute <Location condition> Location information (Xd, Yd) of the destination". Next, the terminal request transmission unit 241 transmits the said request information to the information processing apparatus 1.
[0259] Next, the request reception unit 121 of the information processing apparatus 1 receives the request information "<Time limit condition> 1 minute <Location condition> Location information (Xd, Yd) of the destination" from the user terminal 2.
[0260] Next, the image acquisition unit 131 acquires the imaging device identifiers "C01, C02" of the two imaging devices 3 that satisfy the request information by the process described using the flowchart of FIG. 5. Then, the image acquisition unit 131 transmits an image transmission instruction to the two imaging devices 3.
[0261] Next, the two imaging devices 3 receive the transmission instruction and transmit the captured video to the information processing apparatus 1.
[0262] Next, the user terminal 2 receives and outputs the two videos. Images of such videos are 1801 and 1802 in FIG. 18.
[0263] As described above, in this specific example, shortly before arriving at the destination, the user terminal 2 can receive and output a video that meets the time limit condition. As a result, the user can know the state of the destination shortly before arriving at the destination.
[0264] (Specific Example 3) Assume that in the same situation as in Specific Example 1, the request reception unit 121 of the information processing apparatus 1 has received the request information "<Location condition> Range of Xm centered on (Xa, Ya) <Time limit condition> 30 seconds <Format identifier> mp4" from the user terminal 2.
[0265] Next, the image acquisition unit 131 acquires a video that matches the request information according to the operation of the flowchart in FIG. 5. That is, here, the image acquisition unit 131 searches for one or more imaging devices 3 corresponding to the position information that satisfies the condition of "within a range of Xm centered on the <position condition> (Xa, Ya)" using the position information of each imaging device 3 in the imaging device management table (FIG. 15), and it is assumed that the imaging device identifier "C02" that satisfies the position condition is obtained.
[0266] Next, the image acquisition unit 131 sends a video transmission instruction to the imaging device 3 identified by the imaging device identifier "C02".
[0267] Next, the imaging device 3 receives the transmission instruction, acquires the video being shot, and sends the video to the information processing device 1.
[0268] Next, the image acquisition unit 131 of the information processing device 1 receives the video from the imaging device 3 identified by the imaging device identifier "C02".
[0269] Next, the image acquisition unit 131 acquires the format identifier "mp4" of the user terminal 2, and determines that the format identifier "MOV" paired with the imaging device identifier "C02" does not match the format identifier "mp4". And it is assumed that the image acquisition unit 131 determines that video format conversion is necessary and the time limit condition is not satisfied.
[0270] Next, the image acquisition unit 131 acquires one still image constituting the video received from the imaging device 3 identified by the imaging device identifier "C02".
[0271] Next, the image transmission unit 141 sends the acquired still image to the user terminal 2 that has sent the request information.
[0272] Next, the user terminal 2 receives and outputs the still image.
[0273] As described above, in this specific example, when an accident occurred on the route set in the user terminal 2, if it was determined that the information processing apparatus 1 did not satisfy the time limit condition by transmitting a video, still images constituting the video were transmitted to the user terminal 2, and the user terminal 2 was able to receive and output the still images. As a result, the user can know the situation at the accident site within a time as short as satisfying the time limit condition.
[0274] (Specific Example 4) In the same situation as in Specific Example 1, it is assumed that the request receiving unit 121 of the information processing apparatus 1 received request information "<Position Condition> (Xa, Ya) as the center, range of Xm <Time Limit Condition> 30 seconds <Format Identifier> mp4" from the user terminal 2.
[0275] Next, the image acquisition unit 131 attempts to acquire a video that matches the request information according to the operation of the flowchart in FIG. 5. That is, the image acquisition unit 131 searches for one or more imaging devices 3 corresponding to position information that satisfies the condition of "range of Xm centered on <Position Condition> (Xa, Ya)" using the position information of each imaging device 3 in the imaging device management table (FIG. 15), and attempts to acquire an imaging device identifier, but here it is assumed that the imaging device identifier could not be acquired.
[0276] Next, since the image acquisition unit 131 determines that it cannot acquire a real-time video from the imaging device 3, it acquires a video that satisfies the position condition of "<Position Condition> (Xa, Ya) as the center, range of Xm" from the video management table (FIG. 16). Here, it is assumed that the image acquisition unit 131 determines that there is position information that satisfies the condition of "range of Xm centered on <Position Condition> (Xa, Ya)" among the position information paired with the video identifier "NFT01". Then, the image acquisition unit 131 acquires the stored video paired with the video identifier "NFT01" using the access information "Address 01".
[0277] Next, the image transmission unit 141 transmits the acquired stored image to the user terminal 2 that has transmitted the request information.
[0278] Next, the user terminal 2 receives and outputs the video.
[0279] As described above, in this specific example, when an accident occurs on the path set for the user terminal 2 and there is no video or the like of the accident scene, the information processing device 1 acquires a video that satisfies the position condition from the stored videos and transmits it to the user terminal 2. As a result, the user terminal 2 can receive and output the alternative video.
[0280] As described above, according to this embodiment, the information processing device 1 can provide an image for a desired period of time. According to this embodiment, in particular, the information processing device 1 can provide a video to the user terminal 2 during the time indicated by the time limit condition.
[0281] Also, according to this embodiment, the information processing device 1 can acquire a video that can be provided for a desired period of time and provide it to the user terminal 2.
[0282] Furthermore, according to this embodiment, the information processing device 1 can provide an appropriate image for a desired period of time.
[0283] Note that the processing in this embodiment may be realized by software. And this software may be distributed by software download or the like. Also, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification. The software for realizing the information processing device 1 in this embodiment is a program as follows. That is, this program causes a computer to function as a request receiving unit that receives request information having a time limit condition regarding the time until a user obtains a video and a position condition corresponding to the video from a user terminal, an image acquisition unit that acquires a video that is a video at the position indicated by the position information that satisfies the position condition included in the request information and can be provided to the user terminal within the time that satisfies the time limit condition included in the request information, and an image transmission unit that transmits the video acquired by the image acquisition unit to the user terminal.
[0284] Also, the software that realizes the user terminal 2 in the present embodiment is a program as follows. That is, this program enables a computer that can access a condition management unit that stores a transmission condition, which is a condition for transmitting request information, to function as a terminal determination unit that determines whether or not the transmission condition is satisfied, a terminal request transmission unit that transmits request information when the terminal determination unit determines that the transmission condition is satisfied, a terminal image reception unit that receives an image that is a moving image or a still image in response to the transmission of the request information, and a terminal image output unit that outputs the image received by the terminal reception unit.
[0285] FIG. 19 is a block diagram of the system 300. In FIG. 19, in addition to the CD-ROM drive 3012, the computer 301 includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 and the like, a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions of an application program and providing a temporary storage space, and a hard disk 3017 for storing an application program, a system program, and data. Here, although not shown, the computer 301 may further include a network card that provides a connection to a LAN.
[0286] A program for causing the computer system 300 to execute the functions of the information processing apparatus 1 and the like in the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored in the hard disk 3017. The program is loaded into the RAM 3016 when executed. The program may be loaded directly from the CD-ROM 3101 or the network.
[0287] Also, the computer that executes the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.
[0288] Also, in each of the above embodiments, it goes without saying that two or more communication means existing in one device may be physically realized by one medium.
[0289] Also, in each of the above embodiments, each process may be realized by being centrally processed by a single device, or may be realized by being distributedly processed by a plurality of devices.
[0290] It goes without saying that the present invention is not limited to the above embodiments, and various modifications are possible and are also included in the scope of the present invention.
Industrial Applicability
[0291] As described above, the information processing apparatus 1 according to the present invention has an effect of being able to provide an image for a desired period of time and is useful as a server or the like that provides a moving image.
Explanation of Signs
[0292] A Information system 1 Information processing apparatus 2 User terminal 3 Photographing apparatus 11 Storage unit 12 Reception unit 13 Processing unit 14 Transmission unit 21 Terminal storage unit 22 Terminal reception unit 23 Terminal processing unit 24 Terminal transmission unit 25 Terminal reception unit 26 Terminal output unit 31 Photographing storage unit 32 Photographing processing unit 33 Photographing transmission unit 34 Photographing reception unit 111 Imaging Device Management Unit 112 Image Storage Unit 121 Request Reception Unit 131 Image Acquisition Unit 141 Image Transmission Unit 211 Condition Management Unit 212 Terminal Route Storage Unit 221 Terminal Instruction Reception Unit 231 Terminal Location Acquisition Unit 232 Target Location Acquisition Unit 233 Terminal Condition Acquisition Unit 234 Terminal Judgment Unit 241 Terminal Request Transmission Unit 251 Terminal Status Reception Unit 261 Terminal Inquiry Output Unit 262 Terminal Image Output Unit 321 Shooting Location Acquisition Unit 322 Shooting Unit 323 Shooting Information Acquisition Unit 324 Shooting Accumulation Unit
Claims
1. a request receiving unit that receives request information from the user terminal, the request information having a time limit condition regarding a time until the user terminal acquires a video and a position condition corresponding to the video; an image acquisition unit that acquires a video at a position indicated by position information that satisfies the position condition of the request information, and that can be provided to the user terminal within a time that satisfies the time limit condition of the request information; and an image transmission unit that transmits the video acquired by the image acquisition unit to the user terminal.
2. The image acquisition unit includes: When it is determined that the video cannot be provided to the user terminal within the time that satisfies the time limit condition, a still image is acquired at a position indicated by location information that satisfies the location condition; The image transmission unit is The information processing apparatus according to claim 1 , wherein the still image acquired by the image acquisition unit is transmitted to the user terminal.
3. Further comprising an image storage unit in which the replacement information is stored, The image acquisition unit includes: acquires the alternative information from the image storage unit when it is determined that the alternative information is a video at a position indicated by position information that satisfies the position condition of the request information and that the video can be provided to the user terminal within a time period that satisfies the time limit condition of the request information; The image transmission unit is The information processing apparatus according to claim 1 , wherein the substitute information acquired by the image acquisition unit is transmitted to the user terminal.
4. The image storage unit stores two or more pieces of alternative information corresponding to the location information, The image acquisition unit includes: An information processing device as described in claim 3, wherein when it is determined that a video that is a video of a location indicated by location information that satisfies the location condition of the request information and that can be provided to the user terminal cannot be obtained within a time period that satisfies the time limit condition of the request information, alternative information that is an image of the location indicated by the location information that satisfies the location condition of the request information is obtained from the image storage unit.
5. a terminal condition acquisition unit that acquires a time limit condition related to a time required for acquiring a video; a terminal request transmission unit that transmits request information having the time limit condition and a position condition corresponding to the video to be acquired; a terminal image receiving unit that receives an image, which is a moving image or a still image, in response to the transmission of the request information; a terminal image output unit that outputs the image received by the terminal receiving unit.
6. a terminal location acquisition unit that acquires terminal location information indicating a current location; a focus position acquisition unit that acquires focus position information, which is position information of a focus point; The terminal condition acquisition unit The user terminal according to claim 5 , wherein the time limit condition is acquired by using the terminal location information and the target location information.
7. An information processing method implemented by a request receiving unit, an image acquiring unit, and an image transmitting unit, comprising: a request receiving step in which the request receiving unit receives, from a user terminal, request information having a time limit condition relating to a time until the user obtains a video and a position condition corresponding to the video; an image acquisition step in which the image acquisition unit acquires a video at a position indicated by position information that satisfies the position condition of the request information and that can be provided to the user terminal within a time period that satisfies the time limit condition of the request information; and an image transmitting step in which the image transmitting unit transmits the video acquired by the image acquiring unit to the user terminal.
Citation Information
Patent Citations
Information processor
JP2006118997A
Traffic information providing system, traffic information providing center, and on-vehicle information collecting device
JP2006221537A
Road information distribution system and moving object terminal apparatus
JP2009288212A
Mobile information processing system
JP2013152587A
Driving support method, center device, and driving support system
JP2015064675A