Image extraction device, image extraction system, image extraction method, and program

Abstract

To extract an image of a favorite scene among images of his / her own face during traveling in a vehicle and the vehicle.SOLUTION: A center server 30 as an image extraction device includes: a collection part for collecting imaging information of imaging dates and imaging places of pickup images attached to the pickup images imaged by an imaging device mounted on a vehicle 12; a retrieval part for retrieving pickup images obtained by imaging a vehicle of a specific user; and an extraction part for extracting pickup images of a range corresponding to the imaging information related to a condition inputted by the specific user among the retrieved pickup images.SELECTED DRAWING: Figure 7

Description

Technical Field

[0001] The present invention relates to an image extraction device, an image extraction system, an image extraction method, and a program for extracting an imaging image obtained by imaging a vehicle.

Background Art

[0002] Patent Document 1 discloses a car navigation device that instructs photographing at the timing when a first vehicle and a second vehicle pass by each other.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Patent Document 1 can only acquire an imaging image from a specific vehicle that passes by, and cannot necessarily acquire an image of a desired scene.

[0005] An object of the present invention is to provide an image extraction device, an image extraction system, an image extraction method, and a program that enable extraction of an image of a desired scene from an image of one's own face or the vehicle while moving in the vehicle.

Means for Solving the Problems

[0006] The image extraction device according to claim 1 includes: a collection unit that collects at least one of imaging information of the imaging date and time and the imaging location of the imaging image, which is given to the imaging image photographed by an imaging device mounted on a vehicle or installed on a fixed object; a search unit that searches for an imaging image of a vehicle of a specific user; and an extraction unit that extracts an imaging image within a range corresponding to the imaging information related to the conditions input by the specific user from among the searched imaging images.

[0007] The image extraction device according to claim 1 is a device that extracts captured images taken by an imaging device mounted on a vehicle or installed on a fixed object according to the request of a specific user. In this image extraction device, a collection unit collects imaging information attached to the captured images. Here, the captured images include at least one of the imaging date and time and the imaging location. And in this image extraction device, a search unit searches for captured images of the vehicle of the specific user, and an extraction unit extracts the captured images. The extracted captured images are captured images within a range corresponding to the conditions input by the specific user. According to this image extraction device, it is possible to extract images of scenes that the user likes among images of their own face or the vehicle while moving in the vehicle.

[0008] The image extraction device according to claim 2 is the image extraction device according to claim 1, wherein the collection unit collects identification information corresponding to the identification number of the vehicle of the specific user attached to the captured image in addition to the imaging information for the captured image, and the search unit searches for captured images having the identification information.

[0009] According to the image extraction device according to claim 2, it is possible to extract captured images of the vehicle of a specific user based on the identification number.

[0010] The image extraction system according to claim 3 is an image extraction system including the image extraction device according to claim 1 or 2 and in-vehicle devices mounted on each of one or more vehicles, wherein the in-vehicle device includes a storage unit that stores the captured images captured by the imaging device and the imaging information attached to the captured images, a permission unit that permits the provision of the captured images to the image extraction device, and an output unit that outputs the captured images stored in the storage unit and extracted by the image extraction device to the image extraction device when the provision of the captured images is permitted by the permission unit.

[0011] In the image extraction system according to claim 3, when the provision of the captured image is permitted by the permission unit in the in-vehicle device, the output unit outputs the captured image extracted by the image extraction device to the image extraction device. Therefore, according to the image extraction system, the provision of the captured image to a third party can be restricted.

[0012] The image extraction system according to claim 4 is the image extraction system according to claim 3, wherein the image extraction device includes a provision unit that provides a benefit to the user of the vehicle on which the in-vehicle device is mounted when the provision of the captured image is permitted by the permission unit.

[0013] In the image extraction system according to claim 4, when the provision of the captured image is permitted, the provision unit in the image extraction device provides a benefit to the user of the vehicle on which the in-vehicle device is mounted. According to the image extraction system, the provision of the captured image to a third party can be promoted.

[0014] The image extraction method according to claim 5 is a method of collecting at least one of the imaging information of the imaging date and time and the imaging location of the captured image given to the captured image captured by an imaging device mounted on a vehicle or installed on a fixed object, searching for a captured image of a specific user's vehicle, and extracting, by a computer, a captured image in a range corresponding to the imaging information related to the conditions input by the specific user from among the searched captured images.

[0015] The image extraction method according to claim 5 is a method of extracting a captured image captured by an imaging device mounted on a vehicle or installed on a fixed object according to the request of a specific user. In the image extraction method, the imaging information given to the captured image is collected, a captured image of a specific user's vehicle is searched, and further a captured image is extracted. The extracted captured image is a captured image in a range corresponding to the conditions input by the specific user. According to the image extraction method, an image of a favorite scene can be extracted from images of one's own face or the vehicle while moving in the vehicle.

[0016] The program according to claim 6 causes a computer to execute a process of collecting at least one of imaging information of the imaging date and time and the imaging location of the imaging image given to the imaging image captured by an imaging device mounted on a vehicle or installed on a fixture, searching for an imaging image that captures a vehicle of a specific user, and extracting an imaging image within a range corresponding to the imaging information related to the conditions input by the specific user from among the searched imaging images.

[0017] The program according to claim 7 is executed when extracting an imaging image captured by an imaging device mounted on a vehicle or installed on a fixture according to the request of a specific user. The computer on which the program is executed collects the imaging information given to the imaging image, searches for an imaging image that captures a vehicle of a specific user, and further extracts the imaging image. The extracted imaging image is an imaging image within a range corresponding to the conditions input by the specific user. According to the program, an image of a favorite scene can be extracted from among images of one's own face or the vehicle while moving in the vehicle.

Effect of the Invention

[0018] According to the present invention, an image of a favorite scene can be extracted from among images of one's own face or the vehicle while moving in the vehicle.

Brief Description of the Drawings

[0019]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0020] An image extraction system including the image extraction device of the present invention will be described. The image extraction system is a system that receives the provision of an imaging image of the own vehicle from another vehicle when the own vehicle driven by the user is imaged by a camera mounted on the other vehicle.

[0021] [First Embodiment] (Overall Configuration) As shown in FIG. 1, the image extraction system 10 of the first embodiment includes a vehicle 12, a center server 30 as an image extraction device, a terminal 42, and a terminal 44. Further, an in-vehicle device 20 and a camera 28 are mounted on the vehicle 12. The in-vehicle device 20, the center server 30, the terminal 42, and the terminal 44 are interconnected through a network N. Note that in FIG. 1, one center server 30, one vehicle 12 and in-vehicle device 20, one terminal 42, and one terminal 44 are shown, but the numbers of the vehicle 12, the in-vehicle device 20, the terminal 42, and the terminal 44 are not limited to this.

[0022] The center server 30 is installed, for example, at the manufacturer that manufactures the vehicle 12 or the company operated by the manufacturer. The terminal 42 is exemplified by a smartphone or a personal computer owned by the owner of the vehicle 12. The owners of the vehicle 12 and the terminal 42 are the providers P of the captured images and correspond to the users of the vehicle equipped with the vehicle-mounted device.

[0023] Also, the terminal 44 is exemplified by a smartphone or a personal computer owned by the owner of the vehicle 14 imaged by the vehicle 12. The vehicle 14 corresponds to the vehicle of a specific user. Also, the owners of the vehicle 14 and the terminal 44 are the users R who wish to use the captured images and correspond to the specific user.

[0024] (Vehicle) As shown in FIG. 2, the vehicle 12 according to the present embodiment includes an in-vehicle device 20, an ECU (Electronic Control Unit) 22, in-vehicle equipment 23, a car navigation system 24, a GPS device 25, a drive recorder 26, and a camera 28.

[0025] The in-vehicle device 20 includes a CPU (Central Processing Unit) 20A, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, an in-vehicle communication I / F (Interface) 20D, and a wireless communication I / F 20E. The CPU 20A, the ROM 20B, the RAM 20C, the in-vehicle communication I / F 20D, and the wireless communication I / F 20E are communicably connected to each other via an internal bus 20G.

[0026] The CPU 20A is a central processing unit that executes various programs and controls each part. That is, the CPU 20A reads a program from the ROM 20B and executes the program using the RAM 20C as a work area.

[0027] The ROM 20B as a memory unit stores various programs and various data. As shown in FIG. 3, the ROM 20B of the present embodiment stores a control program 100, image data 110, an image index 120, and identification number information 130.

[0028] The control program 100 collects the captured images captured by the camera 28 and executes a process of providing them in response to a request from the center server 30. The image data 110 is data related to the captured images which are videos captured by the camera 28. Note that the image data 110 may be stored in the drive recorder 26.

[0029] The image index 120 is data that associates the capture date and time and the capture location of the captured images captured by the camera 28 with the captured images. The identification number information 130 is data related to the identification number that identifies the vehicle 12. Here, examples of the identification number that identifies the vehicle 12 include the number of the vehicle 12, the vehicle body number, and other unique numbers.

[0030] As shown in FIG. 2, the RAM 20C temporarily stores programs or data as a work area.

[0031] The in-vehicle communication I / F 20D is an interface for connecting to the ECU 22 and the car navigation system 24. The communication standard based on the CAN protocol is used for the interface. The in-vehicle communication I / F 2D is connected to the external bus 20H.

[0032] The wireless communication I / F 20E is a wireless communication module for communicating with the center server 30. The communication standard such as 5G, LTE, Wi-Fi (registered trademark), etc. is used for the wireless communication module. The wireless communication I / F 20E is connected to the network N.

[0033] The ECU 22 includes, for example, an ADAS (Advanced Driver Assistance System)-ECU, an engine ECU, a body ECU, etc. The in-vehicle device 23 is a device such as a sensor or an actuator connected to the ECU 22. For example, when the ECU 22 is an ADAS-ECU, examples of the in-vehicle device 23 include a vehicle speed sensor, an acceleration sensor, etc.

[0034] The car navigation system 24 is a device that displays the current position of the vehicle 12 on a map and guides the driving route.

[0035] The GPS device 25 is a device that measures the current position of the vehicle 12. The GPS device 25 includes an antenna (not shown) that receives signals from GPS satellites. Note that the GPS device 25 may be directly connected to the in-vehicle unit 20.

[0036] The drive recorder 26 is a device that records the video imaged by the camera 28, which is an imaging device, provided near the rearview mirror.

[0037] As shown in FIG. 4, in the in-vehicle unit 20 of the present embodiment, the CPU 20A functions as an acquisition unit 200, a permission unit 210, and an output unit 220 by executing the control program 100.

[0038] The acquisition unit 200 has a function of acquiring the captured image captured by the camera 28 from the drive recorder 26. The captured image acquired by the acquisition unit 200 in the present embodiment is a video, but it is not limited to this and may be a still image.

[0039] The permission unit 210 has a function of determining whether it is possible to provide the captured image captured by the camera 28 to the center server 30. When receiving a command to permit the provision of the captured image from the terminal 42 possessed by the provider P, the permission unit 210 permits the provision of the captured image to the center server 30 in response to a request from the center server 30. On the other hand, when receiving a command not to permit the provision of the image from the terminal 42 possessed by the provider P, the permission unit 210 prohibits the provision of the captured image to the center server 30 regardless of the request from the center server 30.

[0040] The output unit 220 has a function of outputting the captured image captured by the camera 28 toward the center server 30. Also, when the provision of the captured image is not permitted in the permission unit 210, the output unit 220 outputs to the center server 30 that the captured image cannot be provided.

[0041] (Center server) As shown in FIG. 5, the center server 30 includes a CPU 30A, a ROM 30B, a RAM 30C, a storage 30D, and a communication I / F 30E. The CPU 30A, the ROM 30B, the RAM 30C, the storage 30D, and the communication I / F 30E are connected to be communicable with each other via an internal bus 30G. The functions of the CPU 30A, the ROM 30B, the RAM 30C, and the communication I / F 30E are the same as those of the CPU 20A, the ROM 20B, the RAM 20C, and the wireless communication I / F 20E of the in-vehicle device 20 described above. Note that the communication I / F 30E may perform wired communication.

[0042] The storage 30D as a memory is configured by an HDD (Hard Disk Drive) or an SSD (Solid State Drive) and stores various programs and various data. In the storage 30D of the present embodiment, a processing program 150 and a reference information DB (database) 160 are stored. Note that the ROM 30B may store the processing program 150 and the reference information DB 160.

[0043] The processing program 150 as a program is a program for controlling the center server 30. With the execution of the processing program 150, the center server 30 executes each process.

[0044] The reference information DB 160 is a database that stores the imaging date and time and imaging location of the captured image, as well as the identification information of the vehicle 14 captured in the captured image. In the reference information DB 160, for each vehicle 12 that captured the captured image, the imaging date and time of the captured image, the imaging location, and the identification information of the captured vehicle 14 are stored.

[0045] As shown in FIG. 6, in the center server 30 of the present embodiment, the CPU 30A functions as a collection unit 250, a search unit 260, an extraction unit 270, a notification unit 280, and a provision unit 290 by executing the processing program 150.

[0046] The collection unit 250 has a function of collecting imaging information, which is the imaging date and time and imaging location of the captured image, and an identification number as the identification information of the vehicle 14 captured in the captured image. Here, examples of the identification number of the vehicle 14 include the number of the vehicle 14, the vehicle body number, and other unique numbers. The image information and the identification number are information given to the captured image captured by the camera 28 mounted on the vehicle 12. The image information and the identification number collected by the collection unit 250 are stored in the reference information DB 160 for each vehicle 12.

[0047] The search unit 260 has a function of searching for a captured image of the vehicle 14 of the user R who wishes to use it. Specifically, the search unit 260 searches the reference information DB 160 for a captured image to which the identification number of the vehicle 14 is assigned in order to extract the captured image of the vehicle 14.

[0048] The extraction unit 270 has a function of extracting specific captured images from the searched captured images. Specifically, the extraction unit 270 extracts captured images in a range corresponding to the captured information related to the conditions input by the user R among the captured images in which the vehicle 14 is captured. For example, when the captured image is a video, a range (i.e., frame) that meets the conditions is cut out from the video.

[0049] The notification unit 280 has a function of notifying the user of information regarding the presence or absence of captured images and the availability of providing captured images.

[0050] The provision unit 290 has a function of providing benefits to the provider P of the vehicle 12 that has permitted the provision of captured images. Here, "benefits" refers to values that can be used for the purchase of goods or the provision of services, such as electronic money, points, discount coupons, etc. The provision unit 290 transmits benefit information related to the benefits to the terminal 44 of the provider P for whom the provision of captured images is permitted.

[0051] (Flow of control) The flow of the process executed in the image extraction system 10 of the present embodiment will be described with reference to the sequence diagrams of FIGS. 7 and 10, and the flowcharts of FIGS. 8 and 9. The process in the in-vehicle device 20 is executed by the CPU 20A of the in-vehicle device 20 functioning as the acquisition unit 200, the permission unit 210, and the output unit 220. Also, the process in the center server 30 is executed by the CPU 30A of the center server 30 functioning as the collection unit 250, the search unit 260, the extraction unit 270, the notification unit 280, and the provision unit 290.

[0052] First, FIG. 7 shows the flow of the process of providing the captured images captured in the vehicle 12 according to the request of the user R. [[ID=S20]]

[0053] In step S10 of FIG. 7, the in-vehicle device 20 executes an imaging process. That is, the surroundings of the vehicle 12 are imaged by the camera 28 mounted on the vehicle 12. As a result, the in-vehicle device 20 collects captured images of one or more vehicles 14.

[0054] In step S11, the in-vehicle device 20 acquires the identification number of the vehicle 14 in the captured image. For example, the in-vehicle device 20 acquires the numbers and characters on the license plate as the identification number by a known image recognition technique.

[0055] In step S12, the in-vehicle device 20 assigns the imaging date and time and the position information corresponding to the captured image.

[0056] In step S13, the in-vehicle device 20 transmits an image index to the center server 30. The image index is information indicating the existence of the captured image of the vehicle 14 at a certain time and at a certain position, and the imaging date and time, the imaging location of the captured image, and the identification information as the identification number of the captured vehicle 14 are assigned together with the identification information of the vehicle 12 that captured the captured image.

[0057] In step S14, the center server 30 stores the image index received from the in-vehicle device 20 as reference information in the storage 30D. That is, the image index is stored in the reference information DB160.

[0058] In step S20, the terminal 44 possessed by the user R who wishes to use receives an input of search conditions input by the user R who wishes to use. As the search conditions, at least any one of the imaging date, the imaging date and time, and the imaging area is input. Note that the identification number of the vehicle 14 of the user R who wishes to use may be input as a search condition, or may be given to a search command described later in advance.

[0059] In step S21, the terminal 44 that has received the input of the search conditions transmits a search command including the search conditions to the center server 30.

[0060] In step S22, the center server 30 executes a search process. Specifically, the center server 30 searches for the captured image of the vehicle 14 from the reference information DB160.

[0061] In step S23, the center server 30 determines whether or not there are captured images of the vehicle 14. If the center server 30 determines that there are no captured images of the vehicle 14, the process proceeds to step S24. On the other hand, if the center server 30 determines that there are captured images of the vehicle 14, the process proceeds to step S25.

[0062] In step S24, the center server 30 transmits a response signal to the terminal 44 indicating that there are no captured images.

[0063] In step S25, the center server 30 executes an extraction process. Specifically, the center server 30 extracts images within a range that matches the search conditions from the captured images of the vehicle 14 that have been searched.

[0064] In step S26, the center server 30 transmits to the vehicle-mounted device 20 an image request command requesting the retrieved captured image.

[0065] In step S27, the vehicle-mounted device 20 executes a response process, which will be described in detail later.

[0066] In step S28, the vehicle-mounted device 20 transmits a response signal to the center server 30.

[0067] In step S29, the center server 30 transmits a response signal to the terminal 44. When executing step S29, the center server 30 may store the result of the response process in the vehicle-mounted device 20, i.e., information on whether or not the captured image has been provided in response to the request of the user R.

[0068] In step S30, the terminal 44 executes a display process, the details of which will be described later.

[0069] Next, the response process in step S27 will be described in detail. In step S100 of FIG. 8, CPU 20A receives an image request command.

[0070] In step S101, the CPU 20A determines whether image provision is permitted. Regarding the setting related to permission of the captured image, it will be described later. If the CPU 20A determines that image provision is permitted (YES in step S101), it proceeds to step S102. On the other hand, if the CPU 20A determines that image provision is not permitted (NO in step S101), it proceeds to step S104.

[0071] In step S102, the CPU 20A extracts the captured image within the requested range.

[0072] In step S103, the CPU 20A transmits the captured image extracted as a response signal to the center server 30. Then, the response process ends.

[0073] In step S104, the CPU 20A transmits a non - permission notice indicating that image provision is impossible as a response signal to the center server 30. Then, the response process ends.

[0074] Next, the details of the display process in step S30 will be described. The display process is executed by the CPU of the terminal 44. In step S200 of FIG. 9, the terminal 44 receives a response signal.

[0075] In step S201, the terminal 44 determines whether the response signal includes a captured image. If the terminal 44 determines that the response signal includes a captured image (YES in step S201), it proceeds to step S202. On the other hand, if the terminal 44 determines that the response signal does not include a captured image (NO in step S201), it proceeds to step S203.

[0076] In step S202, the terminal 44 causes the received captured image to be displayed on a display (not shown). Then, the display process ends.

[0077] In step S203, the terminal 44 determines whether the response signal includes a non - permission notice. If the terminal 44 determines that the response signal includes a non - permission notice (YES in step S203), it proceeds to step S204. On the other hand, if the terminal 44 determines that the response signal does not include a non - permission notice (NO in step S203), that is, if it determines that the response signal includes information indicating that there is no captured image, it proceeds to step S205.

[0078] In step S204, the terminal 44 causes a display (not shown) to display that the retrieved captured image is unavailable. Then, the display process ends.

[0079] In step S205, the terminal 44 causes a display (not shown) to display that as a result of the search, there is no captured image. Then, the display process ends.

[0080] Next, the provider P of the captured image sets the availability of providing the captured image taken in the vehicle 12, and the flowchart of the process when receiving a profit is shown in FIG. 10.

[0081] In step S40, the terminal 42 held by the provider P receives the availability of providing the captured image from the provider P.

[0082] In step S41, the terminal 42 transmits permission information regarding the availability of providing the captured image to the in - vehicle device 20. Also, in step S42, the terminal 42 transmits the permission information to the center server 30.

[0083] In step S43, the in - vehicle device 20 reflects the setting regarding the availability of providing the captured image.

[0084] In step S44, the center server 30 executes a registration process for registering the availability of providing the captured image.

[0085] In step S45, the center server 30 determines whether the provision of the captured image is permitted. If the center server 30 determines that the provision of the captured image is permitted, it proceeds to step S46. On the other hand, if the center server 30 determines that the provision of the captured image is not permitted, the process ends.

[0086] In step S46, the center server 30 transmits profit information related to the profit available at the terminal 42 to the terminal 42.

[0087] In step S47, the terminal 42 executes a notification process. Specifically, at the terminal 42, the content of the acquired profit information is notified to the provider P.

[0088] (Summary) In the image extraction system 10 of the present embodiment, the captured image captured by the camera 28 mounted on the vehicle 12 is extracted according to the request of the user R who desires to use it. First, in the in-vehicle device 20, the captured image captured by the camera 28 is collected, and imaging information of the imaging date and time and the imaging location, as well as identification information which is the identification number of the vehicle 14 captured in the image, are attached to the captured image together with the identification information of the vehicle 12.

[0089] On the other hand, in the center server 30 as an image extraction device, the collection unit 250 collects the imaging information attached to the captured image from the in-vehicle device 20. Then, the search unit 260 searches for the captured image that captures the vehicle 14 of the user R who desires to use it, and the extraction unit 270 extracts the captured image that matches the conditions input by the user R who desires to use it. The extracted captured image becomes a video of a frame cut out according to the conditions input by the user R to the terminal 44. According to the present embodiment, it is possible to extract an image of a favorite scene from among images of one's own face or the image of the vehicle while moving in the vehicle.

[0090] In the image extraction system 10 of the present embodiment, when the provision of the captured image is permitted by the permission unit 210 in the vehicle-mounted device 20, the output unit 220 outputs the captured image to the center server 30. Therefore, according to the present embodiment, the provision of the captured image to a third party can be restricted.

[0091] In the image extraction system 10 of the present embodiment, when the provision of the captured image is permitted, the provision unit 290 in the center server 30 provides a benefit to the provider P who permitted the provision. Therefore, according to the present embodiment, it is possible to encourage the user of the vehicle 12 that captures the captured image of the camera to provide the captured image to a third party. Further, by increasing the available captured images in the image extraction system 10, it is possible to encourage further participation of the user R who wishes to use.

[0092] [Second Embodiment] The image extraction system 10 of the first embodiment was configured to be able to provide the captured image captured in the vehicle 12 to the user R who wishes to use. On the other hand, in the second embodiment, in addition to the vehicle 12, the captured image captured by the cameras fixed to the fixed objects on and around the road is configured to be able to be provided to the user R who wishes to use. Hereinafter, the differences from the first embodiment will be described. Note that the same configurations as those in the first embodiment are given the same reference numerals.

[0093] As shown in FIG. 11, the image extraction system 10 of the present embodiment includes a vehicle 12, a center server 30 as an image extraction device, a terminal 42, a terminal 44, and an information collection device 50.

[0094] The information collection device 50 is installed, for example, on a utility pole 16 which is a fixed object, and is configured to be able to capture a vehicle 14 traveling on the road by a camera 50D as an imaging device. The vehicle-mounted device 20, the center server 30, the terminal 42, the terminal 44, and the information collection device 50 are interconnected through a network N.

[0095] (Information Collection Device) As shown in FIG. 12, the information collection device 50 of this embodiment includes a CPU 50A, a ROM 50B, a RAM 50C, a camera 50D, and a communication I / F 50E. The CPU 50A, ROM 50B, RAM 50C, camera 50D, and communication I / F 50E are communicably connected to each other via an internal bus 50G. The functions of the CPU 50A, ROM 50B, RAM 50C, and communication I / F 50E are the same as those of the CPU 20A, ROM 20B, RAM 20C, and wireless communication I / F 20E of the in-vehicle device 20 described above.

[0096] In the ROM 50B of this embodiment, a control program 100, image data 110, an image index 120, and identification number information 130 are stored in the same manner as in the ROM 20B of the in-vehicle device 20 (see FIG. 3). Examples of the identification number stored in the identification number information 130 include a unique number that can identify the information collection device 50 or the utility pole 16 on which the information collection device 50 is installed.

[0097] Also, in the information collection device 50 of this embodiment, similar to the in-vehicle device 20, the CPU 50A functions as an acquisition unit 200, a permission unit 210, and an output unit 220 by executing the control program 100.

[0098] According to this embodiment, in addition to the vehicle 12 traveling on the road, imaging images captured by cameras installed on fixed objects on and around the road can be provided to the user R who wishes to use them, and more imaging images than those desired by the user R can be provided.

[0099] [Remarks] In the above embodiment, the center server 30 is used as the image extraction device, but this is not the only case. The in-vehicle device 20 may also be used as the image extraction device. In this case, the in-vehicle device 20 is configured to directly receive a search command from the terminal 44 of the user R who wishes to use it, execute a search process (step S22) and an extraction process (step S25), and provide the extracted images to the terminal 44.

[0100] Also, in the above-described embodiment, the imaging date and time and the imaging location are exemplified as the imaging information collected by the center server 30. However, if at least one of the imaging date and time and the imaging location is used as the imaging information, it is possible to search for and extract the imaging images related to the vehicle 14. Further, as the imaging information, in addition to the imaging date and time and the imaging location, the imaging images related to the vehicle 14 may be searched for and extracted including the weather at the time of imaging, the traveling speed of the vehicle 14, and the like.

[0101] Note that in the above-described embodiment, the various processes executed by the CPUs 20A, 30A, and 50A by reading software (programs) may be executed by various processors other than the CPU. Examples of the processor in this case include a PLD (Programmable Logic Device) whose circuit configuration can be changed after manufacture, such as an FPGA (Field-Programmable Gate Array), and a dedicated electric circuit such as an ASIC (Application Specific Integrated Circuit) having a circuit configuration designed specifically for executing a specific process. Further, each of the above-described processes may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs, and a combination of a CPU and an FPGA). Further, the hardware structure of these various processors is, more specifically, an electric circuit combining circuit elements such as semiconductor elements.

[0102] Also, in the above embodiment, each program has been described in a mode where it is pre-stored (installed) in a non-transitory computer-readable recording medium. For example, the control program 100 in the vehicle-mounted device 20 is pre-stored in the ROM 20B, and the processing program 150 in the center server 30 is pre-stored in the storage 30D. However, not limited to this, each program may be provided in a form recorded in a non-transitory recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. Also, the program may be in a form downloaded from an external device via a network.

[0103] The processing flow described in the above embodiment is an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope not departing from the gist.

Explanation of Reference Numerals

[0104] 10 Image extraction system 12 Vehicle 14 Vehicle (vehicle of a specific user) 16 Utility pole (fixed object) 20 Vehicle-mounted device 20B ROM (storage unit) 28 Camera (imaging device) 30 Center server (image extraction device) 50D Camera (imaging device) 150 Processing program (program) 210 Permission unit 220 Output unit 250 Collection unit 260 Search unit 270 Extraction unit 290 Provision unit P Provider (user of the vehicle equipped with the vehicle-mounted device) R Prospective user (specific user)

Claims

1. An image extraction system comprising an image extraction device and in-vehicle devices each mounted on one or a plurality of vehicles, wherein the image extraction device comprises a collection unit that collects at least one of imaging information of the imaging date and time and the imaging location of the imaging image, which is given to the imaging image captured by an imaging device mounted on a vehicle or installed on a fixed object; a search unit that searches for imaging images that capture the vehicle of a specific user; an extraction unit that extracts imaging images within a range corresponding to the imaging information related to the conditions input by the specific user from among the searched imaging images; and is configured to request the in-vehicle device for the imaging images searched by the search unit, wherein the in-vehicle device comprises a storage unit that stores the imaging image captured by the imaging device and the imaging information given to the imaging image; a permission unit that permits the provision of the imaging image to the image extraction device; and an output unit that outputs the imaging image stored in the storage unit and extracted by the image extraction device to the image extraction device when the provision of the imaging image is permitted by the permission unit. An image extraction system.

2. The collection unit collects identification information corresponding to the identification number of the vehicle of the specific user, which is given to the imaging image in addition to the imaging information, and the search unit searches for imaging images having the identification information. The image extraction system according to Claim 1.

3. The image extraction device comprises a provision unit that provides benefits to the user of the vehicle on which the in-vehicle device is mounted when the provision of the imaging image is permitted by the permission unit. The image extraction system according to Claim 1.

4. In an in-vehicle device mounted on a vehicle, the imaging image captured by an imaging device mounted on the vehicle or installed on a fixed object and the imaging information given to the imaging image are stored, the in-vehicle device permits the provision of the imaging image to an image extraction device, when the provision of the imaging image is permitted, the imaging image stored in the in-vehicle device and extracted by the image extraction device is output to the image extraction device, in the image extraction device, at least one of imaging information of the imaging date and time and the imaging location of the imaging image is collected, and in the image extraction device, imaging images that capture the vehicle of a specific user are searched. In the image extraction device, among the captured images that have been searched, extract the captured images within the range corresponding to the imaging information related to the conditions input by the specific user. Request the in-vehicle device for the captured images that have been searched. An image extraction method in which a computer executes a process.

5. In an in-vehicle device mounted on a vehicle, store the captured images captured by an imaging device mounted on the vehicle or installed on a fixed object and the imaging information attached to the captured images. In the in-vehicle device, permit the provision of the captured images to the image extraction device. When the provision of the captured images is permitted, output the captured images stored in the in-vehicle device and extracted by the image extraction device to the image extraction device. In the image extraction device, collect at least one of the imaging date and time and imaging location of the captured images, which are attached to the captured images. Search for the captured images that have captured the vehicle of the specific user. Among the captured images that have been searched, extract the captured images within the range corresponding to the imaging information related to the conditions input by the specific user. Request the in-vehicle device for the captured images that have been searched. A program that causes a computer to execute a process.

Images