Data extraction device, data extraction method, and data transmission device

Abstract

The data extraction apparatus (1) of the present invention extracts images for transmission from images obtained by a camera mounted on the vehicle after capturing images of the exterior of the vehicle each time the vehicle advances an extraction distance. The apparatus includes: an information acquisition unit (111) that acquires images obtained after capturing images of the exterior of the vehicle; an image analysis unit (112) that takes an image captured at a position after advancing an extraction distance from the position of the previously extracted image as the analysis object and calculates an occlusion distance representing the actual distance from the position closest to the camera in the image to the occlusion captured in the image; an extraction distance determination unit (113) that outputs the occlusion distance as the extraction distance for the next time; and an image extraction unit (114) that extracts the image set as the analysis object by the image analysis unit.

Description

Technical Field

[0001] This disclosure relates to a data extraction apparatus for extracting information for transmission from information obtained by a device mounted on a vehicle. Background Technology

[0002] In recent years, communication between vehicle-mounted devices and external servers has become increasingly common, resulting in a surge in communication volume. Therefore, technologies exist to reduce this communication volume. For example, Patent Document 1 discloses an image management device that, in the technology of outputting images obtained by photographing the exterior of a moving body to an external server, determines and saves a portion of the multiple images obtained by photographing the exterior of the moving body based on the speed of the moving body. Specifically, the image management device in Patent Document 1 determines, based on the speed of the moving body, at least one of the following conditions: the time interval between when an image is determined to be a saveable image and when the next image to be a saveable image is determined; and the distance the moving body travels during the period between when an image is determined to be a saveable image and when the next image to be a saveable image is determined. Existing technical documents Patent documents

[0003] Patent Document 1 Japanese Patent Application Publication No. 2020-80462 Summary of the Invention The technical problem that the invention aims to solve

[0004] However, the image management device in Patent Document 1 has the following problem: since it only stores images captured at each time interval or distance based on the speed of the moving body, these images sometimes contain obstructions. Furthermore, the image management device in Patent Document 1 cannot transmit necessary information when information is required in the absence of obstructions.

[0005] This disclosure is intended to solve the above-mentioned problems, and its purpose is to provide a data extraction device that can reduce communication volume and extract information from the acquired information in the absence of obstructions. Technical means for solving technical problems

[0006] The data extraction apparatus disclosed herein extracts images for transmission from images obtained by a camera mounted on the vehicle after capturing images of the exterior of the vehicle each time the vehicle advances an extraction distance. The data extraction apparatus includes: an information acquisition unit that acquires images obtained after capturing images of the exterior of the vehicle; an image analysis unit that uses an image captured at a position after advancing an extraction distance from the position of the previously extracted image as the analysis object to calculate the distance to an obstruction, the distance representing the actual distance from the position closest to the camera in the image to the obstruction captured in the image; an extraction distance determination unit that outputs the obstruction distance as the extraction distance for the next time; and an image extraction unit that extracts images from the images set as the analysis object by the image analysis unit. Invention Effects

[0007] According to this disclosure, due to the above-described structure, a data extraction apparatus can be provided that can reduce communication volume and extract information from the acquired information in the absence of obstructions. Attached Figure Description

[0008] Figure 1 This is a diagram illustrating the structure of the data extraction device, the data transmission device, and the data transmission system including the data extraction device and the data transmission device according to Embodiment 1. Figure 2 Figure 2A and Figure 2B This is a diagram showing the hardware structure of the data transmission device. Figure 3 This is a flowchart illustrating the processing of a data transmission system that includes the data extraction device and the data transmission device involved in Embodiment 1. Figure 4 It means Figure 3 The flowchart for information acquisition and processing in the process. Figure 5 It means Figure 3 The flowchart for information analysis and information extraction in the process. Figure 6 It means Figure 3 The flowchart for information transmission and processing. Figure 7 This indicates that the reception has been successful. Figure 6 The flowchart shown illustrates the process of processing the sent information. Figure 8 This is a diagram illustrating an example of the processing concept of the data extraction apparatus involved in Embodiment 1. Figure 9 This is a diagram illustrating another example of the processing concept of the data extraction apparatus involved in Embodiment 1. Figure 10 This is a diagram illustrating the structure of the data extraction device, the data transmission device, and the data transmission system including the data extraction device and the data transmission device according to Embodiment 2. Figure 11A This is a flowchart illustrating the processing of the data extraction device involved in Implementation Method 2. Figure 11B This is a flowchart illustrating the processing of the data extraction device involved in Implementation Method 2. Figure 12 This is a diagram illustrating an example of the processing concept of the data extraction apparatus involved in Embodiment 2. Figure 13 This is a diagram illustrating the structure of the data extraction device, the data transmission device, and the data transmission system including the data extraction device and the data transmission device according to Embodiment 3. Figure 14 This is a flowchart illustrating the processing of the data extraction device involved in Implementation 3. Figure 15 This is a diagram illustrating an example of the processing concept of the data extraction apparatus involved in Embodiment 3. Figure 16 This is a diagram illustrating the structure of the data extraction device, the data transmission device, and the diagnostic system including the data extraction device and the data transmission device according to Embodiment 4. Figure 17 This is a flowchart illustrating the processing of the data extraction device involved in Implementation 4. Figure 18 This is a diagram illustrating an example of the processing concept of the data extraction apparatus involved in Embodiment 4. Detailed Implementation

[0009] The following description, in order to illustrate the present disclosure in more detail, describes the manner in which the present disclosure is carried out with reference to the accompanying drawings. Implementation method 1. Figure 1 This is a diagram illustrating the structure of the data extraction device, the data transmission device, and the data transmission system including the data extraction device and the data transmission device according to Embodiment 1. Data transmission system 1 is a system for acquiring information and transmitting the acquired information to an external system. For example, data transmission system 1 acquires images from a camera mounted on a vehicle, extracts images for transmission from the acquired images, and transmits them to an external server 400. The data transmission system 1 may consist of, for example, a data transmission device 100, an imaging unit 200, a sensor unit 300, and a server 400.

[0010] The data transmission device 100 is a device that transmits images captured by the camera unit 200 mounted on the vehicle to an external server as the vehicle travels a certain distance. The data transmission device 100 can be communicatively connected to the imaging unit 200, the sensor unit 300, and the server. The data transmission device 100 acquires images from the imaging unit 200 at predetermined time units, and at each moment when the imaging unit 200 captures an image, it acquires information related to the vehicle and its surroundings from the sensor unit. The data transmitting device 100 extracts and transmits images from the acquired multiple images. The details of the data transmission device 100 will be described later.

[0011] The camera unit 200 consists of camera and other shooting devices and is mounted on a vehicle. The camera unit 200 takes pictures of the exterior of the vehicle from the vehicle at predetermined time units and outputs the captured images. The images captured by the imaging unit 200 are, for example, images that include the road and its surroundings, and are used to analyze the condition of the road and surrounding equipment. For example, the server 400 that receives the image can use the image to diagnose the condition of the road and the equipment around it.

[0012] The sensor unit 300 includes multiple sensors mounted on the vehicle and outputs measurement information representing the results measured about the vehicle. Multiple sensors output measurement information indicating the timing of the shooting at the imaging unit 200. The multiple sensors are vehicle position sensor 301, vehicle speed sensor 302, acceleration sensor 303, time sensor 304, illuminance sensor 305, weather sensor 306, and biosensor 307. The vehicle position sensor 301 outputs measurement information indicating the position of the vehicle. The vehicle speed sensor 302 outputs measurement information indicating the speed of the vehicle. The acceleration sensor 303 outputs measurement information indicating the acceleration of the vehicle. The time sensor 304 outputs time measurement information obtained from timing by a clock not shown. The illuminance sensor 305 outputs measurement information indicating illuminance. The weather sensor 306 outputs weather measurement information indicating the location of the vehicle. The biosensor 307 outputs measurement information representing biological information related to the passengers of the vehicle.

[0013] The data transmission device 100 includes a data extraction device 110, an image information storage unit 115, an image information transmission unit 116, and a transmission unit 117.

[0014] The data extraction device 110 acquires images captured by the imaging unit 200 and measurement information output by the sensor unit 300, and extracts images and measurement information for transmission from the acquired images and measurement information. For example, the data extraction device 110 extracts images for transmission from images captured by the camera unit 200 mounted on the vehicle every time the vehicle travels a certain distance. Extraction distance represents the distance the vehicle travels from the start of the last image and measurement data extraction to the next image and measurement data extraction. The data extraction device 110 includes an information acquisition unit 111, an image analysis unit 112, an extraction distance determination unit 113, and an image extraction unit 114.

[0015] The information acquisition unit 111 acquires images of the exterior of the vehicle and measurement information during the shooting process. Specifically, the information acquisition unit 111 acquires images from the imaging unit 200 and acquires measurement information representing the measurement results from the sensor unit. Hereinafter, in the description, unless there is a special distinction between the images acquired by the information acquisition unit 111 and the measurement information, they will be simply referred to as "information". The information acquisition unit 111 stores the acquired information. The information acquisition unit 111 stores multiple pieces of information each time information is acquired, at least during the period from when information is previously extracted from the image extraction unit 114 until the next information extraction. At this time, the information acquisition unit 111 uses the acquired information each time it acquires information to calculate the distance traveled from the vehicle's position at the time when the previously extracted information was acquired. The information acquisition unit 111 stores the image, information representing the measurement results, and the driving distance in association. If the image extraction unit 114 extracts information, the information acquisition unit 111 may discard the information stored from the previous extraction process to the current extraction process, and then store the information extracted by the image extraction unit 114 for the next extraction process.

[0016] When extracting distances while the vehicle is traveling, the image analysis unit 112 determines the information of the object to be analyzed and analyzes the information determined to be the object to be analyzed. Specifically, the image analysis unit 112 takes an image taken at a position that is a distance forward from the position where the previously extracted image was taken as the analysis object, and calculates the occlusion distance. The occlusion distance represents the actual distance from the position closest to the shooting device in the image of the analysis object (hereinafter also referred to as the shooting start position) to the occlusion captured in the image. The image analysis unit 112, for example, stores information related to the actual distance corresponding to the vertical and horizontal lengths in the image, and can calculate the actual distance by analyzing the image. The extraction distance used by the image analysis unit 112 is the next extraction distance received from the extraction distance determination unit 113. Furthermore, when the extraction distance is received from the extraction distance determination unit 113, the image analysis unit 112 notifies the image extraction unit 114 that the information being analyzed is candidate information. Furthermore, before receiving the extraction distance from the extraction distance determination unit 113, the image analysis unit 112 can use the image initially acquired by the information acquisition unit 111 as the analysis object.

[0017] The extraction distance determination unit 113 outputs the distance to the obstruction or the first distance as the extraction distance for the next extraction. Specifically, the extraction distance determination unit 113 obtains the occlusion distance from the image analysis unit 112. The extraction distance determination unit 113 compares the occlusion distance with a predetermined first distance. If it is determined that the occlusion distance is less than the first distance, the extraction distance determination unit 113 outputs the occlusion distance as the extraction distance for the next time; if it is determined that the occlusion distance is greater than or equal to the first distance, the extraction distance determination unit 113 outputs the first distance as the extraction distance for the next time. The first distance is a threshold representing the distance within an image based on factors such as resolution, and the degree to which the image can be analyzed.

[0018] The image extraction unit 114 outputs the image set as the object of analysis by the image analysis unit 112. Specifically, when the image analysis unit 112 notifies the candidate information to be transmitted and the extraction distance, the image extraction unit 114 uses the notified information to extract information from the information acquisition unit 111. The image extraction unit 114 stores the extracted information in the transmission image information storage unit 115.

[0019] The image information storage unit 115 stores the information extracted by the image extraction unit 114 as transmission candidates.

[0020] The image information transmitting unit 116 obtains information from the image information storage unit 115 and sends the information to the transmitting unit 117.

[0021] When information is received from the image information sending unit 116, the sending unit 117 sends the information.

[0022] Although the example of the data extraction device 110 consisting of an information acquisition unit 111, an image analysis unit 112, an extraction distance determination unit 113, and an image extraction unit 114 has been described, the data extraction device 110 may also include at least one or all of the image information storage unit 115, the image information transmission unit 116, and the transmission unit 117 in the data transmission device 100.

[0023] Server 400 is, for example, a server that has the function of diagnosing roads and structures using images. Server 400 includes a receiving unit 401, an image information storage unit 402, and an image information recording unit 403. Furthermore, the server 400 can perform analysis and other processing using the images sent by the data sending device 100, and is not limited to the example described above.

[0024] The hardware structure of the data transmission device 100 will be described. Figure 2A and Figure 2B These are figures illustrating an example of the hardware structure of the data transmission device 100. like Figure 2A As shown, the data transmission device 100 includes a processor 1001, a first memory 1002, a second memory 1003, and a transmitter 1004. The processor 1001, the first memory 1002, and the second memory 1003 are, for example, mounted in a computer. The first memory 1002 stores programs that enable the computer to function as a data extraction device 110, an image information transmission unit 116, and a control unit (not shown). The processor 1001 reads and executes the programs stored in the first memory 1002, thereby enabling the functions of the data extraction device 110, the image information transmission unit 116, and the control unit (not shown). The second memory 1003 implements the image information storage unit 115. The transmitter 1004 implements the image information transmission unit 116 and the transmission unit 117.

[0025] The processor 1001 may be a CPU (Central Processing Unit), GPU (Graphics Processing Unit), microprocessor, microcontroller, or DSP (Digital Signal Processor).

[0026] The first memory 1002 and the second memory 1003 can be non-volatile or volatile semiconductor memories such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), or flash memory; they can also be disks such as hard disks or floppy disks; they can also be optical disks such as CD (Compact Disc) or DVD (Digital Versatile Disc); or they can be magneto-optical disks.

[0027] Or, such as Figure 2B As shown, the functions of the data extraction device 110, the image information transmission unit 116, and the control unit (not shown) can be implemented by a dedicated processing circuit 1005.

[0028] The processing circuit 1005 may use a single circuit, a composite circuit, a programmable processor, a parallel programmable processor, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), a SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration), etc. Furthermore, the functions of the data extraction device 110, the image information transmission unit 116, and the control unit (not shown) can be implemented by different processing circuits, or they can be implemented by a combination of processing circuits.

[0029] Furthermore, some of the functions of the data extraction device 110, the image information transmission unit 116, and the control unit (not shown) can be implemented by the processor 1001 and the first memory 1002, and the remaining functions can be implemented by the processing circuit 1005.

[0030] Figure 3 This is a flowchart illustrating the processing of the data transmission system 1, which includes the data extraction device 110 and the data transmission device 100 according to Embodiment 1. In the data transmission system 1, the imaging unit 200 and the sensor unit 300 generate information respectively (step ST10). Specifically, the imaging unit 200 takes pictures of the exterior of the vehicle from the vehicle and outputs the captured images. Additionally, the sensor unit 300 outputs information representing the measurement results of each sensor. The sensor unit 300 outputs, for example, location information, shooting time, and vehicle speed information indicating the moment when the shooting unit 200 took a picture. When the imaging unit 200 and the sensor unit 300 output information, proceed to step ST20. Step ST20 is the processing of the data extraction device 110. In step ST20, the information acquisition unit 111 of the data extraction device 110 acquires information (step ST21). In the data extraction device 110, the image analysis unit 112 and the extraction distance determination unit 113 cooperate to analyze information (step ST22). The image extraction unit 114 receives the analysis results from the image analysis unit 112. The image extraction unit 114 uses the analysis results to extract information from the information acquisition unit 111 (step ST23), and stores the extracted information in the transmission image information storage unit 115. When the image information storage unit 115 stores information, the image information sending unit 116 retrieves the information from the image information storage unit 115 and sends the information to the sending unit 117. When information is received from the image information transmitting unit 116, the transmitting unit 117 transmits the information (step ST30). When information is sent from the data sending device 100, the receiving unit 401 in the server 400 receives the information, the image information storage unit 402 and the image information recording unit 403 store the received information, and the diagnostic processing unit (not shown) uses the information to perform a diagnosis (step ST40).

[0031] Figure 4 It means Figure 3 The flowchart for information acquisition and processing in the process. When the information acquisition unit 111 starts the repeated processing of information acquisition, the information acquisition unit 111 acquires measurement information representing the image captured by the imaging unit 200 and the measurement results obtained by the sensor (step ST101). Specifically, it acquires any one of the following: measurement information indicating the vehicle's position, measurement information indicating the vehicle's speed, measurement information indicating the time, and measurement information indicating the vehicle's acceleration. The information acquisition unit 111 uses the information (image and measurement information representing the measurement result) at the time when the previous information was extracted and the information acquired this time to calculate the driving distance (step ST102). The information acquisition unit 111 stores the image, measurement information indicating the measurement results of this measurement, and the driving distance (step ST103). The information acquisition unit 111 repeats the process, for example, until it receives an instruction to end information acquisition.

[0032] Figure 5 It is shown Figure 3 The flowchart for information analysis and information extraction in the process. For example, when a command is received to begin information analysis and extraction processing, the data extraction device 110 begins processing. The image analysis unit 112 determines the information to be analyzed (step ST201). Specifically, for example, the image analysis unit 112 stores information representing the previously sent image to the server 400, and for the information acquired by the information acquisition unit 111, it determines the travel distance from the shooting location of the previously sent image according to the acquisition order (shooting order). The image analysis unit 112 acquires an image that is closest to the extraction distance from the shooting location of the last transmitted image, with a travel distance not exceeding the extraction distance in the last transmitted image, and uses that image as the analysis object.

[0033] The image analysis unit 112 determines whether there are multiple pieces of information that are the objects of analysis (step ST202). Specifically, for example, when there are multiple corresponding captured images due to the vehicle stopping, the image analysis unit 112 acquires the multiple captured images, and when the multiple captured images are determined to be the object of analysis, the image analysis unit 112 determines that there is information that is the object of analysis.

[0034] If it is determined that there are multiple objects to be analyzed (step ST202 "Yes"), the image analysis unit 112 performs analysis processing on the multiple objects in sequence. The image analysis unit 112 calculates the distance to the occlusion (step ST203). The repetitive processing ends when the analysis and processing of all analyzed objects is completed. Based on the occlusion distance of all analyzed objects, a candidate to send is determined from the information of the analyzed objects (step ST204). Specifically, the image analysis unit 112 compares the occlusion distances of each image, and determines the image with the largest occlusion distance as a candidate image for transmission. In the following description, the occlusion distance of the candidate image for transmission will be used as the occlusion distance for subsequent processing. If it is determined that there are no multiple objects to be analyzed (step ST202 "No"), the image analysis unit 112 calculates the distance to the occlusion (step ST205). Specifically, for example, when there is only one captured image as the object of analysis, the image analysis unit 112 calculates the distance of the occluder in the captured image from the shooting point to the foremost occluder through image recognition. The identification of obstructions can be achieved by using existing functions for identifying vehicles, pedestrians, etc. The calculation of the distance to the obstruction can be achieved by pre-estimating the correlation between the vertical and horizontal lengths of the image and the actual distance, and then using this correlation. Alternatively, it can be implemented by combining information from ranging devices such as LiDAR. Other known techniques can also be used. Then, the image analysis unit 112 determines the information that is the object of analysis as the information to be sent as a candidate (step ST206). The image analysis unit 112 notifies the extraction distance determination unit 113 of the calculated distance of the occluder in the candidate image to be sent. The extraction distance determination unit 113 determines whether the distance to the obstruction is greater than the first distance (step ST207). If the distance to the obstruction is determined to be greater than or equal to the first distance (step ST207 "Yes"), the extraction distance determination unit 113 determines the first distance as the extraction distance for the next extraction (step ST208). If it is determined that the distance to the obstruction is not greater than the first distance (step ST207 "No"), the extraction distance determination unit 113 determines the distance to the obstruction as the extraction distance for the next time (step ST209). The extraction distance determination unit 113 notifies the image analysis unit 112 of the determined extraction distance. The image analysis unit 112 notifies the image extraction unit 114 of the information to send the candidate and the extraction distance. Upon receiving a notification from the image analysis unit 112, the image extraction unit 114 extracts information from the information acquisition unit 111 based on the information of the transmission candidate and the extraction distance, and stores the extracted information in the transmission image information storage unit 115 (step ST210). At this time, the image extraction unit 114 can extract only the region from the shooting starting point to the position where the extraction distance has been advanced, and store this region as transmission candidate information. As a result, since only a minimum amount of image is transmitted, the amount of communication can be reduced. In addition to sending candidate information, the information acquisition unit 111 can also acquire information acquired from the sensor unit 300 at the moment of capturing the image of the candidate to be sent, and store that information. In the data extraction device 110, information analysis and information extraction are repeated until an instruction to end the information analysis and information extraction is received.

[0035] Figure 6 It means Figure 3 The flowchart shows the information transmission process. When the information is stored in the image information storage unit 115, the image information transmission unit 116 in the data transmission device 100 acquires the information (step ST301). The image information sending unit 116 sends the information to the sending unit 117. The sending unit 117 sends the information to the server 400 (step ST302). When the image information storage unit 115 no longer contains the information to be transmitted, the image information transmission unit 116 and the transmission unit 117 end the repetitive processing.

[0036] Figure 7 This indicates that the reception has been successful. Figure 6 The flowchart shown illustrates the process of processing the sent information. Server 400 receives information from data transmission device 100 via receiving unit 401 (step ST401). The image information storage unit 402 in server 400 saves the received information in image information recording unit 403. (Step ST402) In server 400, the process from step ST401 to step ST402 is repeated periodically.

[0037] Figure 8 This is a diagram illustrating an example of the processing concept of the data extraction device 110 according to Embodiment 1. exist Figure 8 The image shows the state of the image capture (upper part) and the captured image (lower part) during the capture process from time t0 to time t3, with images extracted at times t0 and t3. In the diagram, point A represents the position closest to the camera 200 at time t0 (the starting position of the shot). Point B represents the position of the obstruction when the vehicle 1102 in front becomes an obstruction at time t0. Arrow C represents the distance to the obstruction. Arrow D represents the first distance. Arrow E represents the extraction distance. At time t0, images captured within a distance C of the obstruction between point A and point B are extracted. As time passes t1 and t2, point B approaches the vehicle. At time t3, point B becomes the closest point to the camera 200, i.e., point A'. The image and measurement information at this point are extracted, and the extraction distance (arrow E') based on the position of the obstruction (point B') is calculated from point A' at time t3 as the extraction distance for the next time, thus enabling the extraction of images without missing any intervals.

[0038] Figure 9 This is a diagram illustrating another example of the processing concept of the data extraction device 110 involved in Embodiment 1. Figure 9 This represents, for example, a situation where vehicle 1101 is stopped at an intersection, and vehicle 1103 in front crosses the intersection. In this case, the data extraction device 110 uses multiple images during the period when vehicle 1101 is stopped as the analysis object, calculates the occlusion distance C in each analysis object, and can extract the image of the situation with the longest occlusion distance C (C=∞: no occlusion).

[0039] Therefore, compared with sending all captured images, the amount of communication can be reduced, and images of roads / structures can be sent to the server 400 without the roads / structures being covered by obstructions or missing any sections. In addition, regarding traffic reduction, when sending images that only extract the area up to the obstruction, the traffic can be reduced because it becomes the minimum traffic without missing any intervals or sending them repeatedly.

[0040] As described above, the data extraction apparatus disclosed herein is a data extraction apparatus that extracts images for transmission from images obtained after a camera mounted on the vehicle captures images of the exterior of the vehicle each time the vehicle advances an extraction distance. It is configured to include: an information acquisition unit that acquires images obtained from capturing images of the exterior of the vehicle; an image analysis unit that takes an image captured at a position after advancing an extraction distance from the position where the previously extracted image was captured as the analysis object, and calculates an obstruction distance representing the actual distance from the position closest to the camera in the image to an obstruction captured in the image; an extraction distance determination unit that outputs the obstruction distance as the extraction distance for the next extraction; and an image extraction unit that outputs the image set as the analysis object by the image analysis unit. This results in the following effect: a data extraction device that can reduce communication volume and extract information from acquired information in the absence of obstructions.

[0041] Furthermore, the data extraction apparatus disclosed herein is configured such that, when the distance to the obstruction is less than a first distance, the extraction distance determination unit outputs the distance to the obstruction as the extraction distance for the next extraction. This achieves the following effect: it provides a data extraction device that extracts, for example, analyzable information from acquired information, and this information is available in the absence of obstructions.

[0042] Furthermore, the data extraction apparatus disclosed herein is configured such that, when the distance to the obstruction is less than a predetermined first distance, the extraction distance determination unit outputs the obstruction distance as the extraction distance for the next time, and when the distance to the obstruction is greater than or equal to the first distance, the extraction distance determination unit outputs the first distance as the extraction distance for the next time. This achieves the following effect: it provides a data extraction device that extracts, for example, analyzable information from acquired information, and this information is available in the absence of obstructions.

[0043] Implementation method 2. use Figures 10 to 12 The data extraction device 110a and the data transmission device 100a according to Embodiment 2 will be described. The difference between the data transmission system 1a in Embodiment 2 and the data extraction device 110 in the data transmission system 1 in Embodiment 1 is that the data extraction device 110 is changed to a data extraction device 110a. The difference between the data extraction device 110a and the data extraction device 110a is that the data extraction device 110a also analyzes the stored information and extracts the information during the extraction time.

[0044] Figure 10 This is a diagram showing the structure of the data extraction device 110a, the data transmission device 100a, and the data transmission system 1a including the data extraction device 110a and the data transmission device 100a according to Embodiment 2. Figure 11 is a flowchart illustrating the processing of the data extraction apparatus 110a according to Embodiment 2. Figure 12 This is a diagram illustrating an example of the processing concept of the data extraction device 110a according to Embodiment 2. Figure 10 The data extraction device 110a shown is configured to extract data from the data source. Figure 1 The image analysis unit 112, extraction distance determination unit 113, and image extraction unit 114 of the data extraction device 110 shown are replaced with image analysis unit 112a, extraction distance determination unit 113a, and image extraction unit 114a. The following explanation is related to... Figure 1 The differences between the data extraction device 110 shown are omitted. Figure 1 Description of the same or equivalent content as the data extraction device 110 shown.

[0045] If the extraction distance involved in the image extracted by the image analysis unit 112a is less than the first distance, the image analysis unit 112a calculates the distance from the shooting start position in the image to the nearest occluder, and the distance from the shooting start position in the previously extracted image to the position where the extraction distance has been advanced, in each image acquired by the information acquisition unit during the period from the previous extraction to the current extraction.

[0046] The extraction distance determination unit 113a calculates the calculated distance obtained by subtracting the distance from the shooting start position to the position where the shooting start position in the previous transmitted image has advanced by the previous extraction distance.

[0047] The image extraction unit 114a also extracts the image that is determined to have the largest calculated distance as a transmission candidate.

[0048] The hardware structure of the data transmission device 100a, which includes the data extraction device 110a, in Embodiment 2 is the same as that in Embodiment 1, except that the components are different in function. Therefore, detailed description is omitted.

[0049] The processing from step ST201 to step ST209 in Figure 11 is... Figure 5 The processes shown from step ST201 to step ST209 are the same, so detailed descriptions are omitted. When the extraction distance determination unit 113a determines the distance of the obstruction as the next extraction distance (step ST209) and notifies the image analysis unit 112a, the image analysis unit 112a determines whether the determined extraction distance is equal to the first distance (extraction distance = first distance?) (step ST220). Thus, it can be determined whether there is an obstruction between the starting position of the image capture and the first distance.

[0050] In step ST220, if the extraction distance is equal to the first distance (step ST220 "Yes"), proceed to step ST210. Step ST210 is the same as step ST210 shown in FIG11, therefore the following description is omitted.

[0051] In step ST220, if the extraction distance is not equal to the first distance (step ST220 "No"), the image analysis unit 112a determines the analysis object (step ST221). In this case, such as Figure 12As shown, if we look back at past images, there may be images of a larger area that is not covered by obstructions (images taken at time t-2). Specifically, the image analysis unit 112a acquires from the information held by the information acquisition unit 111 the images from the last extracted image and used as a transmission candidate to the current transmission candidate, as well as the travel distance between the images, and determines them as the analysis objects.

[0052] The image analysis unit 112a repeats the analysis process for all analyzed objects. The image analysis unit 112a calculates the distance to the obstruction and the distance using the extraction distance since the last transmission (step ST222). Specifically, the image analysis unit 112a calculates the following for each image that is the object of analysis through image recognition. The calculated value, together with information representing each captured image, is then sent to the extraction distance determination unit 113a. • Distance from the starting position of the shot to the foremost cover • The distance from the starting position of the capture to the position where the capture distance has been moved forward from the starting position of the last captured image. ※The latter is equivalent to the distance traveled from the location where the candidate image was captured and sent.

[0053] The extraction distance determination unit 113a determines whether the distance to the obstruction is greater than the first distance (step ST223). Specifically, for each of the notified images, the distance determination unit 113a first determines whether the distance to the occluder is greater than or equal to the first distance (occluder distance ≥ first distance?).

[0054] If it is determined that the distance to the obstruction is greater than or equal to the first distance (step ST223 "Yes"), the extraction distance determination unit 113a determines the first distance as the extraction distance (step ST224).

[0055] If it is determined that the distance to the obstruction is not greater than the first distance, that is, the distance to the obstruction is less than the first distance (step ST223 "No"), the extraction distance determination unit 113a determines the distance to the obstruction as the extraction distance (step ST225).

[0056] If step ST224 or step ST225 is executed, the distance determination unit 113a then calculates the distance.

[0057] The extraction distance determination unit 113a calculates the extraction distance from the determined extraction distance. Figure 12 (E) minus the distance from the starting position of the capture to the position where the extraction distance has advanced from the starting position of the capture in the last extracted image. Figure 12 The value obtained by the arrow G in the middle (corresponding to) Figure 12 The value of arrow F in the diagram (hereinafter referred to as the distance calculation).

[0058] Once the analysis and processing for all analyzed objects has been completed, the distance determination unit 113a ends the repetitive processing and proceeds to step ST227.

[0059] In step ST227, the distance determination unit 113a extracts the distance to calculate ( Figure 12 Arrow F in the diagram represents the maximum (max) information as a candidate for transmission, and determines the extraction distance for the next step (step ST228). Specifically, if the extraction distance determination unit 113a calculates the extraction distance and the calculated distance of each of the notified captured images, it will re-determine the captured image with the largest calculated distance as the transmission candidate. The extraction distance determination unit 113a sets the extraction distance of the captured image that has been re-determined as a candidate for transmission to the extraction distance used to determine the next candidate for transmission.

[0060] The distance extraction determination unit 113a notifies the image analysis unit 112a of the information indicating that it has re-determined to send the candidate image, the extraction distance, and the calculated distance.

[0061] In order to determine the next transmission candidate, the image analysis unit 112a pre-stores the notified extraction distance and notifies the image extraction unit 114a of the information of the image that has been re-determined as the transmission candidate and calculates the distance.

[0062] The image extraction unit 114a stores the re-determined information as a transmission candidate (step ST229). Specifically, the image extraction unit 114a extracts the captured image that has been re-determined as a transmission candidate from the image analysis unit 112a, which was notified from the information acquisition unit 111, and stores the captured image as transmission candidate information in the transmission image information storage unit 115. At this point, only the region where the distance is calculated can be extracted and saved as a candidate for transmission. Thus, by sending only a minimal amount of image data, the amount of communication can be reduced. In addition, the image extraction unit 114a may also obtain information from the information acquisition unit 111 at the moment when the image is captured and re-determined as a transmission candidate, which was obtained from the sensor unit 300, and add it to the transmission candidate information. The above processing is repeated periodically while the information acquisition unit 111 holds the image.

[0063] The processed images described above are explained. For example... Figure 12As shown, for example, in a scenario where vehicle 1104 cuts in from the side, if in the past (time t) -1 ,time t-2 If the image contains an image taken before vehicle 1104 entered the road, then compared to the image taken before vehicle 1104 entered the road, the area of ​​the road / structure not covered by obstructions in the previous image (at time t) is considered more significant. -2 The areas of roads / structures not covered by obstructions in the captured images are larger (obstruction distance C). -2 =∞). Therefore, it is assumed that the data extraction device 110a will determine the image to be transmitted as the largest image of the area not covered by any obstruction, including past images. As mentioned above, the image with the largest area not covered by obstructions, including past images, can be selected as the candidate to be sent.

[0064] As described above, the data extraction apparatus disclosed herein is configured such that, when the extraction distance of the image being analyzed is less than a first distance, during the period from the last extraction to the current extraction, in each image acquired by the information acquisition unit, the image analysis unit calculates the distance from the shooting start position in the image to the nearest occluder, and the distance from the shooting start position in the previously extracted image to the position where the extraction distance has been advanced. The extraction distance determination unit calculates the calculated distance obtained by subtracting the distance from the shooting start position to the position where the extraction distance has been advanced from the shooting start position in the previously transmitted image. The image determined to have the largest calculated distance is selected as a transmission candidate, and the image extraction unit extracts the images of the transmission candidates selected by the extraction distance determination unit. This achieves the following effect: it provides a data extraction device that determines the image with the largest unobstructed area as a candidate for transmission.

[0065] Implementation method 3. In Implementation 3, the following method will be described: when the obstruction remains stationary while the vehicle is in motion, the method will be changed to extract information by targeting the current obstruction and the next obstruction.

[0066] Figure 13 This is a diagram showing the structure of the data extraction device 110b, the data transmission device 100b, and the diagnostic system including the data extraction device 110b and the data transmission device 100b, according to Embodiment 3. Figure 13 The data extraction device 110b shown is configured to extract data from the data source. Figure 1The image analysis unit 112 and the image extraction unit 114 of the data extraction device 110 shown are replaced with the image analysis unit 112b and the image extraction unit 114b. Figure 13 The data extraction device 110b shown is configured to extract data from the data source. Figure 10 The image analysis unit 112a and the image extraction unit 114a of the data extraction device 110a shown are replaced with the image analysis unit 112b and the image extraction unit 114b. The following description will explain the relationship between... Figure 1 The data extraction device 110 shown and Figure 10 The differences between the data extraction device 110a shown are omitted and those of the data extraction device 110a shown. Figure 1 or Figure 10 Explanation of content that is the same as or equivalent to the content shown.

[0067] When the extraction distance is zero, the image analysis unit 112b calculates the location information of the occluded area covered by the occluder, and calculates the distance to the occluder by taking the next occluder of the occluder as the object. The image extraction unit 114b extracts the location information of the occluded area together with the extracted image as a transmission candidate.

[0068] The hardware structure of the data transmission device 100b, which includes the data extraction device 110b in Embodiment 3, is the same as that described in Embodiment 1, except that the components are different in function. Therefore, detailed description is omitted.

[0069] Figure 14 This is a flowchart illustrating the processing of the data extraction device 110b according to Embodiment 3. Figure 15 This is a diagram illustrating an example of the processing concept of the data extraction device 110b involved in Embodiment 3. Assuming the processing of the data extraction device 110b involved in Embodiment 3 is as described in Embodiment 1. Figure 5 Step ST231 is added between steps ST209 and ST210, and the process proceeds from step ST231 to the process that replaces step ST210 (steps ST232, ST233 and ST234). Furthermore, assuming that the processing of the data extraction device 110b involved in Embodiment 3 is as described in Embodiment 2... Figure 11B Step ST231 is added between steps ST228 and ST229, and the process proceeds from step ST231 to the process that replaces step ST229. exist Figure 14 In the middle, the part with is omitted. Figure 5 The processing shown and Figure 11A and Figure 11B The process shown is the same as the detailed description of the process. The following description details steps ST231, ST232, ST233, and ST234.

[0070] In the case where the same processing as that in data extraction device 110b is performed, execution is performed. Figure 5 The process up to step ST209 is shown, and then proceeds to step ST231. If the same processing as that in data extraction device 110a is performed in data extraction device 110b, the processing up to step ST228 is executed, and then the process proceeds to step ST231.

[0071] In step ST231, it is determined whether the extraction distance related to the stored information is greater than zero. Specifically, the image analysis unit 112b determines whether the extraction distance in the candidate image received from the extraction distance determination unit 113 (or extraction distance determination unit 113a) is greater than zero. If the image analysis unit 112b determines that the extraction distance is greater than zero (step ST231 "Yes"), and there is an area not covered by any obstruction in the direction from the shooting start position, then the image analysis unit 112b does not need to notify the re-investigation of the area and proceeds to... Figure 5 The steps shown in ST210 or Figure 11B The process shown is ST229.

[0072] If, in step ST231, it is determined that the extraction distance related to the stored information is zero (step ST231 "No"), the image analysis unit 112b calculates the position of the occlusion area of ​​the occlusion object (step ST232). Regarding this point, such as Figure 15 As shown, when the extraction distance is zero (extraction distance E = 0), there is an obstruction at the same position as the starting position of the shot. Figure 15 The stopped vehicle (1105) did not have any images showing the area covered by the corresponding obstruction. In other words, during this trip, the area was not visible in the images even when it was not covered by the obstruction, indicating that a reinvestigation will be necessary sooner or later. The image analysis unit 112b calculates the position of the occlusion area covered by the nearest occlusion from the shooting start position in the transmitted candidate image by image recognition. Regarding the extent of the obscured area, if the distance traveled in the image from the center of the shooting origin to the vertex of the obscured object is known, the obscured area can be calculated based on relevant information about the actual distance and the vehicle's position. (Refer to...) Figure 15(Bottom image)

[0073] Image analysis unit 112b excludes occlusions from the processing objects. Figure 15 Stopped vehicle 1105 (step ST233). Specifically, the image analysis unit 112b ignores the corresponding occluder in the next processing and decides to process the next occluder that approaches the corresponding occluder. In addition, the image analysis unit 112b notifies the image extraction unit 114b of information indicating the candidate image to be sent and the location information of the occluded area.

[0074] The image extraction unit 114b stores the location of the occluded area along with information (step ST234). Specifically, the image extraction unit 114b extracts the captured image of the notified transmission candidate from the information acquisition unit 111, and stores the captured image together with the location information of the occluded area as transmission candidate information in the transmission image information storage unit 115. At this time, the image extraction unit 114b may also obtain from the information acquisition unit 111 the information obtained from the sensor unit 300 at the moment of capturing the image of the transmission candidate, and add the information to the information of the transmission candidate. Alternatively, the candidate images can be excluded, and only the location information of the occluded area can be included. While the information acquisition unit 111 retains the previously transmitted image, the above process is repeated periodically. As described above, if there is no image that is not covered by the obstruction even after implementing Embodiment 1 or Embodiment 2, the area covered by the corresponding obstruction can be notified as a re-investigation area.

[0075] As described above, the data extraction apparatus disclosed herein is configured such that, when the extraction distance is zero, the image analysis unit calculates the location information of the occluded area covered by the occluder, and calculates the distance to the occluder with the next occluder as the target, and the image extraction unit extracts the location information of the occluded area and the extracted image together as a transmission candidate. Therefore, a data extraction device can be provided that extracts information to notify the area covered by the obstruction as a re-investigation area.

[0076] Implementation method 4. In Embodiment 4, a method for notifying the vehicle ahead of the vehicle by maintaining a distance between the vehicles is described, thereby enabling the extraction of necessary information. In Embodiment 4, when the extraction distance is less than a predetermined second distance under Embodiments 1, 2, or 3, the data extraction device 110c maintains a distance of at least a third distance between the vehicle and the vehicle ahead to reduce the transmission load.

[0077] Figure 16 This is a diagram showing the structure of the data extraction device 110c, the data transmission device 100c, and the diagnostic system including the data extraction device 110c and the data transmission device 100c according to Embodiment 4. Figure 17 This is a flowchart illustrating the processing of the data extraction device 110c according to Embodiment 4. Figure 18 This is a diagram illustrating an example of the processing concept of the data extraction device 110c involved in Embodiment 4.

[0078] Figure 16 The data extraction device 110c shown is configured to extract data from the data source. Figure 1 The image analysis unit 112 of the data extraction device 110 shown is replaced with an image analysis unit 112c. In addition, a workshop distance adjustment unit 131 is added. Figure 16 The data extraction device 110c shown is configured to extract data from the data source. Figure 10 The image analysis unit 112a of the data extraction device 110a shown is replaced with an image analysis unit 112c. Additionally, a workshop distance adjustment unit 131 is added. Figure 16 The data extraction device 110c shown is configured to extract data from the data source. Figure 13 The image analysis unit 112b of the data extraction device 110b shown is replaced with an image analysis unit 112c. Additionally, a workshop distance adjustment unit 131 is added. In the following description, the explanation will be related to... Figure 1 The data extraction device 110 shown Figure 10 The data extraction device 110a shown, or Figure 13 The differences between the data extraction device 110b shown are omitted. Figure 1 , Figure 10 or Figure 13 Explanation of content that is the same as or equivalent to the content shown.

[0079] The data extraction device 110c also includes a workshop distance adjustment unit 131. If the extraction distance is less than the second distance, the vehicle-to-vehicle distance adjustment unit 131 notifies the vehicle to make the vehicle-to-vehicle distance between the vehicle and the vehicle in front of the vehicle a third distance or more, or issues a control instruction to make the vehicle-to-vehicle distance more than a third distance. like Figure 18 As shown, the second distance is the distance that reduces the number of images sent, and is, for example, a distance below the first distance. Similar to the second distance, the third distance is a distance that reduces the number of images sent, such as a distance greater than the first distance.

[0080] The inter-vehicle distance adjustment unit 131 is connected to an external notification device and the inter-vehicle distance control unit 700 in ACC (Auto Cruise Control). Specifically, the external notification device is at least one of a sound output device such as a speaker 500 and a display device such as a display 600.

[0081] The hardware structure of the data transmission device 100c, including the data extraction device 110c of Embodiment 4, is the same as that of Embodiment 1, but with the addition of the function of the structural part that is equivalent to the structure described in Embodiment 1. Therefore, detailed description is omitted.

[0082] The concept of processing in the data extraction device 110c of Embodiment 4 will be explained. like Figure 18 As shown, the number of images sent to server 400 increases when the extraction distance is smaller compared to when the extraction distance is larger. Therefore, the objective is to notify or control the vehicle to maintain a distance between vehicles when the extraction distance is less than a certain distance (second distance), thereby reducing the transmission load by decreasing the number of images sent to server 400.

[0083] The processing of the data extraction device 110c according to Embodiment 4 will be described. Assume that the processing of the data extraction device 110c involved in Embodiment 4 is as described in Embodiment 1. Figure 5 Between steps ST209 and ST210, additional processing from steps ST241 to ST243 is added. Assume that the processing of the data extraction device 110c involved in Embodiment 4 is the same as that described in Embodiment 2. Figure 11B Between steps ST228 and ST229, additional processing from steps ST241 to ST243 is added. Assume that the processing of the data extraction device 110c involved in Embodiment 4 is the same as that described in Embodiment 3. Figure 14Between steps ST233 and ST234, additional processing from steps ST241 to ST243 is added. exist Figure 17 In the middle, the part with is omitted. Figure 5 The processing shown Figure 11A and Figure 11B The processing shown, and Figure 14 The detailed description of the same process is shown. Steps ST241, ST242, and ST243 are described in detail below.

[0084] The image analysis unit 112c determines whether the extraction distance is above the second distance (step ST241). If the extraction distance is greater than the second distance (step ST241 "Yes"), proceed to the processing of step ST210, step ST229 or step ST234.

[0085] The case of less than the second distance indicates that the inter-vehicle distance is relatively small if the obstruction is a vehicle in front. Therefore, when the extraction distance is less than the second distance (step ST241 "No"), the image analysis unit 112c instructs the inter-vehicle distance adjustment unit to separate the inter-vehicle distance from the vehicle in front by a certain distance or more. The vehicle distance adjustment unit receives an instruction from the image analysis unit 112c, notifies the driver of the instruction (step ST242), and generates and outputs vehicle control information (step ST243). Specifically, the vehicle distance adjustment unit notifies the driver via speaker 500 or display 600 to maintain a pre-defined third distance or more between the vehicle and the vehicle in front. Alternatively, the vehicle distance adjustment unit controls the vehicle by using the ACC control function or other vehicle distance control unit 700 to maintain a pre-defined third distance or more between the vehicle and the vehicle in front. This only adjusts the vehicle-to-vehicle distance. Therefore, even if the extraction distance is less than the second distance, the distance to the obstruction will not be adjusted if the obstruction is not the vehicle in front. Thus, it does not separate the vehicle-to-vehicle distance from pedestrians, light vehicles, parked vehicles, etc.

[0086] When the processing in steps ST242 and ST243 is completed, proceed to the processing in steps ST210, ST229 or ST234.

[0087] Furthermore, regarding the data extraction device 110c involved in Embodiment 4, it only maintains a certain distance or more between vehicles ahead. For pedestrians, light vehicles, parked vehicles, etc., since this vehicle often overtakes, the type of obstruction can be detected, and the distance between vehicles can be determined based on the type of obstruction. While the information acquisition unit 111 retains the previously extracted image, the above processing is repeated periodically.

[0088] As described above, it is possible to control the distance between the vehicle and the vehicle in front to be above a certain distance, thereby reducing the transmission load.

[0089] As described above, the data extraction device involved in this disclosure includes a vehicle-to-vehicle distance adjustment unit, which, when the extraction distance is less than a second distance, notifies the vehicle to increase the vehicle-to-vehicle distance to a third distance or more, or issues a control instruction to increase the vehicle-to-vehicle distance to a third distance or more. Therefore, by transmitting the acquired information while maintaining a certain distance from the vehicle ahead, the number of transmissions can be reduced, thus lowering the transmission load. Furthermore, by reducing the number of transmissions, the amount of communication is also reduced.

[0090] Furthermore, within the scope of this disclosure, various embodiments can be freely combined, or any constituent elements of each embodiment can be modified, or any constituent elements can be omitted in each embodiment. Industrial practicality

[0091] Since the extraction distance for extracting information for transmission varies depending on the distance from the vehicle to the obstruction, the data extraction apparatus disclosed herein is suitable for use as a data transmission apparatus, etc., for extracting information for transmission from information obtained by a device mounted on a vehicle and transmitting it. Additionally, it is suitable for diagnostic systems that use images acquired by devices mounted on vehicles to diagnose the condition of roads and structures. Label Explanation

[0092] 1. Data transmission system (1a, 1b, 1c); data transmission devices (100, 100a, 100b, 100c); data extraction devices (110, 110a, 110b, 110c); information acquisition unit (111); image analysis unit (112, 112a, 112b, 112c); distance determination unit (113, 113a); image extraction unit (114, 114a, 114b); image information storage unit (115); image information transmission unit (116); transmission unit (117); distance adjustment unit (131); imaging unit (200); sensor unit (300); vehicle position sensor (30); 30 2. Vehicle speed sensor, 303. Acceleration sensor, 304. Time sensor, 305. Illumination sensor, 306. Weather sensor, 307. Biosensor, 400. Server, 401. Receiver, 402. Image information storage unit, 403. Image information recording unit, 500. Speaker, 600. Display, 700. Vehicle distance control unit, 1001. Processor, 1002. First memory, 1003. Second memory, 1004. Transmitter, 1005. Processing circuit, 1101. This vehicle, 1102, 1103, 1104, 1106. Vehicles ahead, 1105. Stopped vehicle, 1200. Road.

Claims

1. A data extraction apparatus that extracts images for transmission from images captured by a camera mounted on the vehicle exterior each time the vehicle travels a distance, the data extraction apparatus characterized by comprising: An information acquisition unit acquires images obtained after photographing the exterior of the vehicle. The image analysis unit takes an image taken at a position that has advanced the extraction distance from the position of the previously extracted image as the analysis object, and calculates the occlusion distance, which represents the actual distance from the starting position of the image taken in the image to the position of the occlusion captured in the image. If the distance to the obstruction is less than a first distance, the extraction distance determination unit outputs the obstruction distance as the extraction distance for the next time; if the distance to the obstruction is greater than or equal to the first distance, the extraction distance determination unit outputs the first distance as the extraction distance for the next time. as well as An image extraction unit extracts images that are set as the analysis object by the image analysis unit.

2. The data extraction device as described in claim 1, characterized in that, When the extraction distance of the image being analyzed is less than a first distance, the image analysis unit performs the following calculations for each historical image acquired by the information acquisition unit during the period from the previous extraction to the current extraction: Calculate the historical occlusion distance of the historical image, where the historical occlusion distance represents the distance from the starting position of the historical image capture to the nearest occlusion captured in the historical image; Calculate the historical repetition distance of the historical image, where the historical repetition distance represents the distance from the starting position of the historical image capture to the position where the image has moved forward the previous extraction distance from the starting position of the previously extracted image capture. The extraction distance determination unit determines the extraction distance of the historical image based on the historical occlusion distance, and calculates the calculated distance of the historical image by subtracting the historical repetition distance of the historical image from the extraction distance of the historical image. The historical image with the largest calculated distance is selected as a transmission candidate. The image extraction unit extracts the images of the transmission candidates determined by the extraction distance determination unit.

3. The data extraction device as described in claim 1 or 2, characterized in that, When the extraction distance calculated based on the distance to the occluder is zero, the image analysis unit calculates the position information of the occluded area covered by the occluder, and calculates the distance to the next occluder in front of the occluder. The image extraction unit extracts the location information of the occluded area as a transmission candidate.

4. The data extraction device as described in claim 1 or 2, characterized in that, The system includes a vehicle distance adjustment unit that, when the extraction distance is less than a second distance, notifies the vehicle to increase the vehicle distance to a third distance or more between the vehicle and the vehicle in front of it, or issues a control instruction to increase the vehicle distance to a third distance or more.

5. A data extraction method, wherein an image for transmission is extracted from images captured by a camera mounted on the vehicle exterior at each forward distance, the data extraction method being characterized by comprising: The steps of the information acquisition unit to acquire images obtained after photographing the exterior of the vehicle; The image analysis unit calculates the occlusion distance by taking an image taken at a position that has advanced the extraction distance from the position of the previously extracted image as the analysis object. The occlusion distance represents the actual distance from the starting position of the image to the position of the occlusion captured in the image. The extraction distance determination unit outputs the occlusion distance as the extraction distance for the next time when the occlusion distance is less than the first distance, and outputs the first distance as the extraction distance for the next time when the occlusion distance is greater than or equal to the first distance. as well as The image extraction unit is a step of extracting images that are set as the analysis objects by the image analysis unit.

6. A data transmitting device that, each time a vehicle travels a distance, extracts an image for transmission from an image obtained by a camera mounted on the vehicle that captures images of the exterior of the vehicle and transmits the image to the exterior of the vehicle, the data transmitting device being characterized by comprising: An information acquisition unit acquires images obtained after photographing the exterior of the vehicle. The image analysis unit takes an image taken at a position that has advanced the extraction distance from the position of the previously extracted image as the analysis object, and calculates the occlusion distance, which represents the actual distance from the starting position of the image taken in the image to the position of the occlusion captured in the image. If the distance to the obstruction is less than a first distance, the extraction distance determination unit outputs the obstruction distance as the extraction distance for the next time; if the distance to the obstruction is greater than or equal to the first distance, the extraction distance determination unit outputs the first distance as the extraction distance for the next time. An image extraction unit that outputs an image set as the object of analysis by the image analysis unit; and The transmitting unit transmits the image extracted by the image extraction unit.

Images