DATA EXTRACTION DEVICE, DATA EXTRACTION METHOD, AND DATA TRANSMISSION DEVICE
Patent Information
- Application Number
- JP2023514183
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-04-12
- Publication Date
- 2025-02-17
- Estimated Expiration
- 2041-04-12
AI Technical Summary
【0007】 本開示によれば、上記のように構成したので、通信量を削減するとともに、取得した情報の中から、遮蔽物が存在しない状況における情報を抽出する、データ抽出装置を提供できる。
Smart Images

Figure 0007630056000001 
Figure 0007630056000002 
Figure 0007630056000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a data extraction device that extracts information to be transmitted from information acquired by a device mounted on a vehicle. [Background technology]
[0002] In recent years, communication between devices mounted on vehicles and external servers and the like has become more common, resulting in a large amount of communication traffic. In response to this, there are techniques for reducing the amount of communication traffic. For example, Patent Document 1 discloses a technology for outputting images captured outside a moving body to an external server, in which an image management device determines and stores a portion of multiple images captured outside a moving body depending on the speed of the moving body. Specifically, the image management device of Patent Document 1 determines, based on the speed of the moving body, at least one of the following conditions for determining the images to be saved: a condition regarding the time interval from when an image is determined as an image to be saved until the next image to be saved is determined, and a condition regarding the distance traveled by the moving body from when an image is determined as an image to be saved until the next image to be saved is determined. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2020-80462 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the image management device of Patent Document 1 has a problem that the images captured at time intervals or distances based on the speed of the moving object are simply saved, and therefore the images may contain obstructions. Furthermore, the image management device of Patent Document 1 cannot transmit the necessary information when information is required in a situation where there is no obstruction.
[0005] The present disclosure is intended to solve the above-mentioned problem, and aims to provide a data extraction device that can reduce communication traffic and extract information in a situation where no obstructions are present from acquired information. [Means for solving the problem]
[0006] The data extraction device disclosed herein is a data extraction device that extracts images for transmission from images taken of the outside of the vehicle by an imaging device mounted on the vehicle each time the vehicle moves an extraction distance, and is equipped with an information acquisition unit that acquires images taken of the outside of the vehicle, an image analysis unit that analyzes an image taken at a position moved the extraction distance from the position at which the previously extracted image was taken, and calculates an obstruction distance indicating the actual distance from a position closest to the imaging device in the image to be analyzed to an obstruction imaged in the image, an extraction distance determination unit that outputs the obstruction distance as the next extraction distance, and an image extraction unit that extracts the image that the image analysis unit has analyzed. Effect of the Invention
[0007] According to the present disclosure, with the above-described configuration, it is possible to provide a data extraction device that reduces the amount of communication and extracts information in a situation where no obstruction is present from acquired information. [Brief description of the drawings]
[0008] [Figure 1] 1 is a diagram showing configurations of a data extraction device, a data transmission device, and a data transfer system including the data extraction device and the data transmission device according to a first embodiment; [Diagram 2] 2A and 2B are diagrams illustrating the hardware configuration of a data transmission device. [Diagram 3] 4 is a flowchart showing the processing of the data transfer system including the data extraction device and the data transmission device according to the first embodiment. [Figure 4] 4 is a flowchart showing the information acquisition process in FIG. 3. [Diagram 5]4 is a flowchart showing the information analysis process and the information extraction process in FIG. 3. [Figure 6] 4 is a flowchart showing the information transmission process in FIG. 3. [Figure 7] 7 is a flowchart showing a process for receiving information transmitted by the process shown in FIG. 6. [Figure 8] FIG. 2 is a diagram showing an example of an image of processing performed by the data extraction device according to the first embodiment; [Figure 9] FIG. 11 is a diagram showing another example of the image of the process performed by the data extraction device according to the first embodiment. [Figure 10] FIG. 11 is a diagram showing the configurations of a data extraction device, a data transmission device, and a data transfer system including the same according to a second embodiment. [Figure 11A] 13 is a flowchart showing a process of the data extraction device according to the second embodiment. [Figure 11B] 13 is a flowchart showing a process of the data extraction device according to the second embodiment. [Figure 12] FIG. 11 is a diagram showing an example of an image of processing performed by a data extraction device according to the second embodiment. [Figure 13] FIG. 11 is a diagram showing the configurations of a data extraction device, a data transmission device, and a data transfer system including the same according to a third embodiment. [Figure 14] 13 is a flowchart showing a process of the data extraction device according to the third embodiment. [Figure 15] FIG. 11 is a diagram showing an example of an image of processing performed by a data extraction device according to a third embodiment. [Figure 16] FIG. 13 is a diagram showing the configuration of a data extraction device, a data transmission device, and a diagnostic system including the same according to a fourth embodiment. [Figure 17] 13 is a flowchart showing a process of the data extraction device according to the fourth embodiment. [Figure 18] FIG. 13 is a diagram showing an example of an image of processing performed by a data extraction device according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] In order to describe the present disclosure in more detail, embodiments of the present disclosure will be described below with reference to the accompanying drawings. Embodiment 1 FIG. 1 is a diagram showing configurations of a data extraction device, a data transmission device, and a data transfer system including the data extraction device and the data transmission device according to the first embodiment. The data transfer system 1 is a system that acquires information and transfers the acquired information to an external device. For example, the data transfer system 1 is a system that acquires images from an imaging device mounted on a vehicle, extracts images to be transmitted from the acquired images, and transfers the images to an external server 400. The data transfer system 1 includes, for example, a data transmission device 100, an imaging unit 200, a sensor unit 300, and a server 400.
[0010] The data transmission device 100 is a device that transmits to an external server an image extracted from images of the outside of the vehicle captured by an imaging unit 200 mounted on the vehicle each time the vehicle travels an extraction distance. The data transmission device 100 is communicably connected to an imaging unit 200, a sensor unit 300, and a server. The data transmission device 100 acquires images from the imaging unit 200 at predetermined time intervals, and acquires information about the vehicle and the surroundings of the vehicle from the sensor unit for each image captured by the imaging unit 200 . The data transmission device 100 extracts an image for transmission from among the multiple acquired images and transmits it. The data transmitting device 100 will be described in detail later.
[0011] The imaging unit 200 is composed of an imaging device such as a camera, and is mounted on the vehicle. The imaging unit 200 captures images of the outside of the vehicle from the vehicle at predetermined time intervals and outputs the captured images. The image captured by the imaging unit 200 is, for example, an image including a road and its surroundings, and is an image used to analyze the state of the road and its surrounding facilities. For example, the server 400 that receives this image can use the image to diagnose the state of the road and the facilities around the road.
[0012] The sensor unit 300 is equipped with a plurality of sensors that are mounted on the vehicle and output measurement information indicating the results of measurements made on the vehicle. The multiple sensors output measurement information indicating the results of measurements at least at the timing when the imaging unit 200 captures an image. The multiple sensors include a vehicle position sensor 301 , a vehicle speed sensor 302 , an acceleration sensor 303 , a time sensor 304 , an illuminance sensor 305 , a weather sensor 306 , and a biometric sensor 307 . The vehicle position sensor 301 outputs measurement information indicating the position of the vehicle. The vehicle speed sensor 302 outputs measurement information indicating the speed of the host vehicle. The acceleration sensor 303 outputs measurement information indicating the acceleration of the host vehicle. The time sensor 304 outputs measurement information indicating the time measured by a clock (not shown). The illuminance sensor 305 outputs measurement information indicating the illuminance. The weather sensor 306 outputs measurement information indicating the weather at the vehicle's location. The biosensor 307 outputs measurement information indicating bioinformation related to an occupant of the host vehicle.
[0013] The data transmitting device 100 includes a data extracting device 110 , a transmitted image information storage unit 115 , an image information transmitting unit 116 , and a transmitting unit 117 .
[0014] The data extraction device 110 acquires images captured by the imaging unit 200 and measurement information output by the sensor unit 300, and extracts images and measurement information to be transmitted from the acquired images and measurement information. For example, the data extraction device 110 extracts an image to be transmitted from images captured outside the vehicle by the imaging unit 200 mounted on the vehicle, each time the vehicle travels an extraction distance. The extraction distance indicates the distance traveled by the vehicle from the previous extraction of the image and measurement information to the next extraction of the image and measurement information. The data extraction device 110 includes an information acquisition unit 111 , an image analysis unit 112 , an extracted distance determination unit 113 , and an image extraction unit 114 .
[0015] The information acquisition unit 111 acquires an image of the outside of the vehicle and measurement information at the time of capturing the image. Specifically, the information acquiring unit 111 acquires an image from the imaging unit 200, and acquires measurement information indicating a measurement result from the sensor unit. In the following description, the image and measurement information acquired by the information acquiring unit 111 are also simply referred to as "information" unless there is a particular need to distinguish between them. The information acquiring unit 111 stores the acquired information. The information acquiring unit 111 accumulates a plurality of pieces of information each time the information is acquired, at least during the period from when the image extracting unit 114 previously extracted information until when the information is next extracted. At this time, every time information is acquired, the information acquisition unit 111 uses the acquired information to calculate the travel distance from the vehicle position at the time when the previously extracted information was acquired. The information acquisition unit 111 stores the image, information indicating the measurement result, and the traveled distance in association with each other. When image extraction section 114 extracts information, information acquisition section 111 may discard the information accumulated between the previous extraction process and the current extraction process, and then accumulate the information for the next extraction process.
[0016] When the vehicle travels the extraction distance, the image analysis unit 112 determines information to be analyzed, and performs analysis on the information determined to be the analysis target. Specifically, the image analysis unit 112 analyzes an image captured at a position that is the extraction distance away from the position where the previously extracted image was captured, and calculates an obstruction distance that indicates the actual distance from the position closest to the imaging device in the image to be analyzed (hereinafter also referred to as the imaging start position) to the obstruction captured in the image. The image analysis unit 112 holds correlation information of the actual distance according to, for example, the vertical and horizontal lengths in the image, and can calculate the actual distance by analyzing the image. The extraction distance used by the image analysis unit 112 is the next extraction distance received from the extraction distance determination unit 113 . Furthermore, when the image analysis unit 112 receives an extraction distance from the extraction distance determination unit 113, it notifies the image extraction unit 114 that the information that has been analyzed is a candidate for transmission. Note that before receiving the extraction distance from the extraction distance determination unit 113, the image analysis unit 112 may take the image acquired first by the information acquisition unit 111 as the analysis target.
[0017] The extraction distance determination unit 113 outputs the obstruction distance or the first distance as the next extraction distance. Specifically, the extraction distance determination unit 113 acquires the obstruction distance from the image analysis unit 112. The extraction distance determination unit 113 compares the obstruction distance with a predetermined first distance. When the extraction distance determination unit 113 determines that the obstruction distance is less than the first distance, it outputs the obstruction distance as the next extraction distance, and when the extraction distance determination unit 113 determines that the obstruction distance is equal to or greater than the first distance, it outputs the first distance as the next extraction distance. The first distance is a threshold value that indicates a distance within an image that allows analysis using the image, for example, based on the resolution or the like.
[0018] The image extraction unit 114 outputs the image that is the subject of analysis by the image analysis unit 112 . Specifically, when the image extraction unit 114 is notified of the information of the transmission candidates and the extraction distance from the image analysis unit 112, the image extraction unit 114 uses the notified information to extract information from the information acquisition unit 111. The image extraction unit 114 stores the extracted information in the transmission image information storage unit 115.
[0019] The transmission image information storage unit 115 stores the information extracted by the image extraction unit 114 as a transmission candidate.
[0020] The image information transmitting unit 116 acquires information from the transmitted image information storage unit 115 and sends it to the transmitting unit 117 .
[0021] When the transmitting unit 117 receives the information from the image information transmitting unit 116, it transmits the information.
[0022] An example will be described in which the data extraction device 110 is configured by an information acquisition unit 111, an image analysis unit 112, an extraction distance determination unit 113, and an image extraction unit 114, but it may further include at least one or all of a transmission image information storage unit 115, an image information transmission unit 116, and a transmission unit 117 of the data transmission device 100.
[0023] The server 400 is, for example, a server having a function for diagnosing roads and structures using images. The server 400 includes a receiving unit 401 , an image information accumulation unit 402 , and an image information storage unit 403 . The server 400 is not limited to the above example as long as it performs processing such as analysis using the image transmitted by the data transmission device 100.
[0024] The hardware configuration of the data transmitting device 100 will be described. 2A and 2B are diagrams illustrating an example of a hardware configuration of the data transmitting device 100. In FIG. As shown in FIG. 2A, the data transmitting device 100 includes a processor 1001, a first memory 1002, a second memory 1003, and a transmitter 1004. The processor 1001, the first memory 1002, and the second memory 1003 are, for example, installed in a computer. The first memory 1002 stores a program for causing the computer to function as the data extracting device 110, the image information transmitting unit 116, and a control unit (not shown). The processor 1001 reads and executes the program stored in the first memory 1002, thereby realizing the functions of the data extracting device 110, the image information transmitting unit 116, and the control unit (not shown). The second memory 1003 realizes the transmitted image information storage unit 115 . The transmitter 1004 realizes an image information transmitting unit 116 and a transmitting unit 117 .
[0025] The processor 1001 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor, a microcontroller, or a digital signal processor (DSP).
[0026] The first memory 1002 and the second memory 1003 may be non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable Read Only Memory) or flash memory, or may be a magnetic disk such as a hard disk or a flexible disk, or may be an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or may be a magneto-optical disk.
[0027] Alternatively, as shown in FIG. 2B, the functions of the data extracting device 110, the image information transmitting unit 116, and a control unit (not shown) may be realized by a dedicated processing circuit 1005.
[0028] The processing circuit 1005 may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), an FPGA (Field-Programmable Gate Array), a SoC (System-on-a-Chip), or a system LSI (Large-Scale Integration), etc. The functions of the data extracting device 110, the image information transmitting unit 116, and a control unit (not shown) may be realized by separate processing circuits, or may be realized collectively by a processing circuit.
[0029] Alternatively, some of the functions of the data extraction device 110, the image information transmission unit 116, and a control unit (not shown) may be realized by the processor 1001 and the first memory 1002, and the remaining functions may be realized by the processing circuit 1005.
[0030] FIG. 3 is a flowchart showing the processing of the data transfer system 1 including the data extracting device 110 and the data transmitting device 100 according to the first embodiment. In the data transfer system 1, the imaging section 200 and the sensor section 300 each generate information (step ST10). Specifically, the imaging unit 200 captures an image of the outside of the vehicle from the vehicle and outputs the captured image. The sensor unit 300 outputs information indicating the measurement results of each sensor. The sensor unit 300 outputs, for example, position information indicating the position at the time when the imaging unit 200 captured an image, the image capture time, and vehicle speed information. When the imaging unit 200 and the sensor unit 300 output information, the process proceeds to step ST20. Step ST20 is a process performed by the data extracting device 110. In step ST20, the information acquiring section 111 of the data extracting device 110 acquires information (step ST21). In the data extracting device 110, the image analyzing section 112 cooperates with the extracted distance determining section 113 to analyze the information (step ST22). The image extraction unit 114 receives the analysis result from the image analysis unit 112. The image extraction unit 114 extracts information from the information acquisition unit 111 using the analysis result (step ST23), and stores the extracted information in the transmission image information storage unit 115. When the transmission image information storage unit 115 stores the information, the image information transmission unit 116 obtains the information from the transmission image information storage unit 115 and sends it to the transmission unit 117 . When the transmitting unit 117 receives the information from the image information transmitting unit 116, it transmits the information (step ST30). When information is transmitted from the data transmission device 100, in the server 400, the receiving unit 401 receives the information, the received information is stored by the image information accumulation unit 402 and the image information storage unit 403, and a diagnosis is performed using the information by a diagnostic processing unit not shown (step ST40).
[0031] FIG. 4 is a flowchart showing the information acquisition process in FIG. When the information acquiring section 111 starts repeating the information acquiring process, it acquires the image captured by the imaging section 200 and measurement information indicating the measurement results by the sensor (step ST101). Specifically, any one of measurement information indicating the position of the host vehicle, measurement information indicating the speed of the host vehicle and measurement information indicating the time, and measurement information indicating the acceleration of the host vehicle is obtained. The information acquisition unit 111 calculates the traveled distance using the information (images and measurement information indicating measurement results) at the time when the previous information was extracted and the currently acquired information (step ST102). The information acquisition unit 111 stores the image, measurement information indicating the current measurement result, and the traveled distance (step ST103). The information acquisition unit 111 repeats the process, for example, until it receives a command to end the information acquisition.
[0032] FIG. 5 is a flowchart showing the information analysis process and the information extraction process in FIG. For example, when the data extraction device 110 receives a command to start the information analysis process and the information extraction process, the data extraction device 110 starts the process. The image analysis unit 112 determines information to be analyzed (step ST201). Specifically, for example, the image analysis unit 112 stores information indicating the image that was last transmitted to the server 400, and checks the distance traveled from the shooting point of the last transmitted image for the information acquired by the information acquisition unit 111 in the order of acquisition (order of shooting). The image analysis unit 112 acquires a captured image in which the travel distance from the shooting point of the previously transmitted image does not exceed the extraction distance in the previously transmitted image and is closest to the extraction distance, and sets the captured image as an object of analysis.
[0033] The image analysis unit 112 judges whether there is a plurality of pieces of information to be analyzed (step ST202). Specifically, when there are multiple relevant captured images, for example due to the vehicle being stopped, the image analysis unit 112 acquires those multiple captured images, and when it determines that an image is to be analyzed, it determines that there is information to be analyzed.
[0034] When it is determined that there are a plurality of analysis targets ("YES" in step ST202), the image analysis unit 112 repeats the analysis process for the plurality of analysis targets in order. The image analysis unit 112 calculates the obstacle distance (step ST203). When the analysis process has been completed for all analysis targets, the repetitive process ends. Based on the obstruction distances of all analysis targets, transmission candidates are determined from the information of the analysis targets (step ST204). Specifically, the image analysis unit 112, for example, compares the obstacle distances of each image and determines the image with the largest obstacle distance as the image to be transmitted. In the following description, the obstacle distance of the image that has become the transmission candidate is used as the obstacle distance used in the subsequent processing. When it is determined that there are not a plurality of analysis targets (step ST202 "NO"), the image analysis unit 112 calculates the obstruction distance (step ST205). Specifically, for example, when there is one captured image to be analyzed, the image analysis unit 112 calculates the obstruction distance from the capture start point to the foremost obstruction in the captured image by image recognition. Obstruction recognition can be achieved by using existing functions to recognize vehicles, pedestrians, etc. The calculation of the obstacle distance can be realized by storing correlation information between the vertical and horizontal lengths of the image and the distance in reality in advance and using the correlation. It may also be performed in combination with information from a distance measuring device such as LiDAR. It may also be a method using other known technologies. Then, the image analysis unit 112 determines the information to be analyzed as information to be transmitted (step ST206). The image analysis unit 112 notifies the extraction distance determination unit 113 of the calculated obstruction distance in the image of the transmission candidate. The extracted distance determination unit 113 determines whether the obstruction distance is equal to or greater than the first distance (step ST207). When it is determined that the obstruction distance is equal to or greater than the first distance (step ST207 "YES"), the extraction distance determination unit 113 determines the first distance as the next extraction distance (step ST208). When it is determined that the obstruction distance is not equal to or greater than the first distance ("NO" in step ST207), the extracted distance determination unit 113 determines the obstruction distance as the next extracted distance (step ST209). The extraction distance determination unit 113 notifies the image analysis unit 112 of the determined extraction distance. The image analysis unit 112 notifies the image extraction unit 114 of the information on the transmission candidates and the extraction distance. When the image extraction unit 114 receives a notification from the image analysis unit 112, it extracts information from the information acquisition unit 111 based on the information of the transmission candidate and the extraction distance, and stores the extracted information in the transmission image information storage unit 115 (step ST210). At this time, the image extraction unit 114 may extract only the area from the shooting start point to the position that is the extraction distance away, and store it as information on the transmission candidate. This allows only the minimum amount of images to be transmitted, thereby reducing the amount of communication traffic. Furthermore, information acquired from the sensor unit 300 at the time when an image of a transmission candidate is captured may also be acquired from the information acquisition unit 111 and stored in addition to the information of the transmission candidate. In the data extraction device 110, the information analysis and information extraction are repeated until a command to end the information analysis and information extraction is received.
[0035] FIG. 6 is a flowchart showing the information transmission process in FIG. When information is stored in the transmission image information storage unit 115, the image information transmission unit 116 in the data transmission device 100 acquires the information (step ST301). The image information transmitting unit 116 sends the information to a transmitting unit 117 . The transmitting section 117 transmits the information to the server 400 (step ST302). When there is no more information to be transmitted in the transmission image information storage unit 115, the image information transmitting unit 116 and the transmitting unit 117 end the repetitive process.
[0036] FIG. 7 is a flowchart showing a process for receiving information transmitted by the process shown in FIG. The server 400 receives information from the data transmitting device 100 via the receiving section 401 (step ST401). The image information accumulation unit 402 in the server 400 stores the received information in the image information storage unit 403. (Step ST402) In the server 400, the processes from step ST401 to step ST402 are repeated periodically.
[0037] FIG. 8 is a diagram showing an example of an image of the process of the data extraction device 110 according to the first embodiment. FIG. 8 shows the transition between the situation at the time of image capture (upper part) and the captured image (lower part) when extracting images at times t0 and t3 from time t0 to time t3. In the figure, point A indicates the position closest to the imaging unit 200 at time t0 (imaging start position). Point B indicates the obstruction position when the preceding vehicle 1102 is an obstruction at time t0. Arrow C indicates the obstruction distance. Arrow D indicates the first distance. Arrow E indicates the extraction distance. At time t0, an image captured between point A and point B, distance C from the obstruction, is extracted, and as time t1 and time t2 pass, point B approaches the vehicle, and at time t3, point B becomes point A', which is the closest position to the imaging unit 200. By extracting the image and measurement information at this time, and calculating the extraction distance (arrow E') from point A' at time t3 based on the position of the obstruction (point B') and setting this as the next extraction distance, it is possible to extract an image in which no section is missing.
[0038] FIG. 9 is a diagram showing another example of the image of the process of data extraction device 110 according to the first embodiment. 9 shows, for example, a situation in which a vehicle 1101 stops at an intersection and a preceding vehicle 1103 crosses an intersecting road. In this case, the data extraction device 110 can analyze a plurality of images taken while the vehicle 1101 is stopped, calculate the obstacle distance C for each of the analysis targets, and extract an image in which the obstacle distance C is the longest (C=∞: no obstacle).
[0039] In this way, the amount of communication traffic can be reduced compared to transmitting all captured images, and images of roads and structures can be transmitted to server 400 without the roads and structures being covered by obstructions and without any sections being missed. In addition, in terms of reducing communication volume, if an image of only the area up to the obstruction is transmitted, the communication volume can be reduced because the communication volume is minimized to transmit without missing or overlapping sections.
[0040] As described above, the data extraction device of the present disclosure is a data extraction device that extracts images for transmission from images taken of the outside of the vehicle by an imaging device mounted on the vehicle, each time the vehicle moves an extraction distance, and is configured to include an information acquisition unit that acquires images taken of the outside of the vehicle, an image analysis unit that analyzes an image taken at a position moved the extraction distance from the position at which the previously extracted image was taken, and calculates an obstruction distance indicating the actual distance from a position closest to the imaging device in the image to be analyzed to an obstruction imaged in the image, an extraction distance determination unit that outputs the obstruction distance as the next extraction distance, and an image extraction unit that outputs the image analyzed by the image analysis unit. This has the effect of reducing the amount of communication and providing a data extraction device that extracts information in a situation where no obstruction is present from the acquired information.
[0041] In addition, the data extraction device according to the present disclosure is further configured such that, when the obstruction distance is less than the first distance, the extraction distance determination unit outputs the obstruction distance as the next extraction distance. This has the effect of providing a data extraction device that extracts, from the acquired information, for example, information that can be analyzed and is in a situation where no obstructions are present.
[0042] In addition, the data extraction device according to the present disclosure is further configured such that, when the obstruction distance is less than a predetermined first distance, the extraction distance determination unit outputs the obstruction distance as the next extraction distance, and when the obstruction distance is equal to or greater than the first distance, the extraction distance determination unit outputs the first distance as the next extraction distance. This has the effect of providing a data extraction device that extracts, from the acquired information, for example, information that can be analyzed and is in a situation where no obstructions are present.
[0043] Embodiment 2 A data extracting device 110a and a data transmitting device 100a according to the second embodiment will be described with reference to FIGS. The data transfer system 1a according to the second embodiment differs from the data transfer system 1 according to the first embodiment in that the data extracting device 110 is changed to a data extracting device 110a. Data extraction device 110a differs from data extraction device 110a in that data extraction device 110a analyzes information including accumulated information at the timing of extraction and extracts information.
[0044] FIG. 10 is a diagram showing the configuration of a data extracting device 110a, a data transmitting device 100a, and a data transfer system 1a including these according to the second embodiment. FIG. 11 is a flowchart showing the process of the data extraction device 110a according to the second embodiment. FIG. 12 is a diagram showing an example of an image of the process performed by the data extraction device 110a according to the second embodiment. The data extraction device 110a shown in FIG. 10 is configured by replacing the image analysis unit 112, the extraction distance determination unit 113, and the image extraction unit 114 of the data extraction device 110 shown in FIG. 1 with an image analysis unit 112a, an extraction distance determination unit 113a, and an image extraction unit 114a. In the following description, only the points that differ from data extraction device 110 shown in FIG. 1 will be described, and a description of the same or equivalent content as data extraction device 110 shown in FIG. 1 will be omitted.
[0045] When the extraction distance for an image extracted by the image analysis unit 112a is less than the first distance, the image analysis unit 112a calculates, for each image acquired by the information acquisition unit between the previous extraction and the current extraction, the obstruction distance from the imaging start position in the image to the nearest obstruction, and the distance from the imaging start position in the previously extracted image to a position that is the extraction distance away.
[0046] The extraction distance determination unit 113a calculates, as the extraction distance, a calculated distance by subtracting the distance from the shooting start position to a position that is the previous extraction distance from the shooting start position in the previous transmission image.
[0047] The image extracting unit 114a further extracts the image for which the calculated distance is determined to be the longest as a transmission candidate.
[0048] The hardware configuration of the data transmission device 100a including the data extraction device 110a of the second embodiment is the same as that of the first embodiment, except for the functions of the components described in the first embodiment, and therefore a detailed description thereof will be omitted.
[0049] The processes from step ST201 to step ST209 in FIG. 11 are the same as the processes from step ST201 to step ST209 shown in FIG. 5, and therefore detailed description thereof will be omitted. When the extraction distance determination unit 113a determines the obstruction distance as the next extraction distance (step ST209) and notifies the image analysis unit 112a, the image analysis unit 112a determines whether the determined extraction distance is equal to the first distance (extraction distance=first distance?) (step ST220). This makes it possible to determine whether an obstruction exists between the imaging start position in the image and the first distance.
[0050] In step ST220, if the extraction distance is equal to the first distance (step ST220 "YES"), the process proceeds to step ST210. Step ST210 is the same as step ST210 shown in FIG. 11, and therefore the following description will be omitted.
[0051] In step ST220, if the extraction distance is not equal to the first distance (step ST220 "NO"), the image analysis unit 112a determines an analysis target (step ST221). In this case, as shown in FIG. 12, when looking back at the previous captured images, there are images (time t -2 There is a possibility that images taken during the Specifically, the image analysis unit 112a acquires from the information held by the information acquisition unit 111 the images from the image previously extracted and selected as a transmission candidate to the current transmission candidate, as well as the distance traveled between the images, and determines these as the subject of analysis.
[0052] The image analysis unit 112a repeats the analysis process for all the analysis targets. The image analysis unit 112a calculates the distance using the obstruction distance and the extracted distance after the previous transmission (step ST222). Specifically, the image analysis unit 112a calculates the following for each image to be analyzed by image recognition: The calculated values are notified to the extraction distance determination unit 113a together with information indicating each captured image. - Obstruction distance from the shooting start position to the nearest obstruction Distance from the shooting start position to the position that is the extraction distance from the shooting start position in the previously extracted image *The latter corresponds to the distance traveled from the position where the image of the transmission candidate was captured to the return distance.
[0053] The extracted distance determining unit 113a determines whether the obstruction distance is equal to or greater than the first distance (step ST223). Specifically, for each notified image, the extracted distance determining unit 113a first determines whether the obstruction distance is equal to or greater than a first distance (obstruction distance≧first distance?).
[0054] When it is determined that the obstruction distance is equal to or greater than the first distance ("YES" in step ST223), the extraction distance determination unit 113a determines the first distance as the extraction distance (step ST224).
[0055] When it is determined that the obstacle distance is not equal to or greater than the first distance, that is, the obstacle distance is less than the first distance ("NO" in step ST223), the extraction distance determination unit 113a determines the obstacle distance to be the extraction distance (step ST225).
[0056] After executing the process of step ST224 or step ST225, the extracted distance determining unit 113a next determines the calculated distance by calculation.
[0057] The extraction distance determination unit 113a calculates a value (the value corresponding to arrow F in FIG. 12) obtained by subtracting the distance (arrow G in FIG. 12) from the determined extraction distance (arrow E in FIG. 12) from the position that is the extraction distance from the shooting start position in the previously extracted image. (Hereinafter, this will be referred to as the calculated distance.)
[0058] If the analysis process for all analysis targets is completed, the extracted distance judging section 113a ends the repetitive process, and proceeds to the process of step ST227.
[0059] In step ST227, the extracted distance decision unit 113a determines the information with the maximum (max) calculated distance (arrow F in FIG. 12) as a transmission candidate, and determines the next extracted distance (step ST228). Specifically, the extracted distance determining unit 113a calculates the extracted distance and the calculated distance for each of the notified captured images, and then re-determines the captured image with the largest calculated distance as the transmission candidate. The extraction distance determination unit 113a sets the extraction distance of the photographed image that has been redetermined as a transmission candidate as the extraction distance for determining the next transmission candidate.
[0060] The extraction distance determination unit 113a notifies the image analysis unit 112a of information indicating the image redetermined as a transmission candidate, the extraction distance, and the calculated distance.
[0061] The image analysis unit 112a stores the notified extraction distance in order to determine the next transmission candidate, and notifies the image extraction unit 114a of the calculated distance and information indicating the image that has been re-determined as the transmission candidate.
[0062] The image extraction section 114a stores the re-determined information in the transmission candidate (step ST229). Specifically, the image extraction unit 114a extracts the captured images that have been re-determined as transmission candidates, as notified by the image analysis unit 112a, from the information acquisition unit 111, and stores them in the transmission image information storage unit 115 as information on the transmission candidates. At this time, only the area of the calculated distance may be extracted and stored as information on the transmission candidate. This allows only the minimum amount of image to be transmitted, thereby reducing the amount of communication traffic. Furthermore, image extraction section 114a may also obtain, from information acquisition section 111, information obtained from sensor section 300 at the time when an image that has been redetermined as a transmission candidate is captured, and add this information to the information on the transmission candidates. The above process is repeated periodically while the image is being held in the information acquisition unit 111.
[0063] The image of the above process will be described. As shown in FIG. 12, for example, in a scene where a leading vehicle 1104 cuts in from the side, -1 , time t -2 ), if there is an image captured before the preceding vehicle 1104 cuts in, the image captured after the preceding vehicle 1104 cuts in will be compared to the area where the road and structures are not covered by obstacles in the image captured in the past (at time t -2 The area of the road and structures that are not covered by obstructions is larger in the image captured at the obstruction distance C -2 =∞). Therefore, it is assumed that the data extracting device 110a determines, as the image to be transmitted, the captured image that has the largest area not covered by any obstruction, including past captured images. In this way, the image with the largest area not covered by obstructions, including previously captured images, can be determined as the image to be transmitted.
[0064] As described above, the data extraction device of the present disclosure is configured so that, when the extraction distance for the image to be analyzed is less than the first distance, the image analysis unit calculates, for each image acquired by the information acquisition unit between the previous extraction and the current extraction, the obstruction distance from the imaging start position in the image to the nearest obstruction and the distance from the imaging start position in the previously extracted image to a position advanced by the extraction distance, the extraction distance determination unit calculates a calculated distance by subtracting the distance from the shooting start position to a position advanced by the previous extraction distance from the shooting start position in the previously transmitted image, and determines the image determined to have the largest calculated distance as a transmission candidate, and the image extraction unit extracts the image of the transmission candidate determined by the extraction distance determination unit. This provides an advantage in that it is possible to provide a data extraction device that determines, as a transmission candidate, an image having the largest area that is not covered by an obstruction.
[0065] Embodiment 3 In the third embodiment, a mode will be described in which, when an obstacle does not move while the host vehicle is traveling, information is extracted from the next obstacle instead of from the current obstacle.
[0066] FIG. 13 is a diagram showing the configuration of a data extraction device 110b, a data transmission device 100b, and a diagnostic system including these according to the third embodiment. A data extraction device 110b shown in FIG. 13 is configured by replacing the image analysis unit 112 and the image extraction unit 114 of the data extraction device 110 shown in FIG. 1 with an image analysis unit 112b and an image extraction unit 114b. Moreover, data extraction device 110b shown in FIG. 13 is configured by replacing image analysis unit 112a and image extraction unit 114a of data extraction device 110a shown in FIG. 10 with image analysis unit 112b and image extraction unit 114b. In the following description, differences from data extraction device 110 shown in FIG. 1 and data extraction device 110a shown in FIG. 10 will be described, and description of contents that are the same as or equivalent to those shown in FIG. 1 or FIG. 10 will be omitted.
[0067] When the extraction distance is zero, the image analysis unit 112b calculates the position information of the obstructed area covered by the obstruction, and calculates the obstruction distance to the obstruction next to the obstruction. The image extraction unit 114b extracts the position information of the blocked area together with the extracted image as a transmission candidate.
[0068] The hardware configuration of the data transmitting device 100b including the data extracting device 110b of the third embodiment is the same as that of the first embodiment, except for the functions of the components described in the first embodiment, and therefore a detailed description thereof will be omitted.
[0069] FIG. 14 is a flowchart showing the process of the data extraction device 110b according to the third embodiment. FIG. 15 is a diagram showing an example of an image of the process performed by the data extraction device 110b according to the third embodiment. The processing of the data extracting device 110b according to the third embodiment is assumed to add step ST231 between step ST209 and step ST210 shown in FIG. 5 described in the first embodiment, and to proceed from step ST231 to processing (step ST232, step ST233, and step ST234) replacing step ST210. Moreover, the processing of the data extracting device 110b according to the third embodiment is assumed to add step ST231 between step ST228 and step ST229 shown in FIG. 11B described in the second embodiment, and to proceed from step ST231 to processing replacing step ST229. In FIG. 14, detailed description of the same processes as those shown in FIG. 5 and those shown in FIGS. 11A and 11B is omitted. In the following description, steps ST231, ST232, ST233, and ST234 will be described in detail.
[0070] In the data extracting device 110b, when the same processing as that of the data extracting device 110 is performed, the process proceeds to step ST231 after executing the processing up to step ST209 shown in FIG. In the data extracting device 110b, if the same processing as that of the data extracting device 110a is performed, the process proceeds to step ST231 after executing the processing up to step ST228.
[0071] In step ST231, it is determined whether the extraction distance related to the stored information is greater than zero. Specifically, the image analysis unit 112b determines whether the extraction distance in the transmission candidate image received from the extraction distance determination unit 113 (or the extraction distance determination unit 113a) is greater than zero. If the image analysis unit 112b determines that the extraction distance is greater than zero (step ST231 "YES"), this means that there is an area that is not covered by any obstructions from the shooting start position toward the shooting direction, so there is no need to notify the re-survey area and the image analysis unit 112b proceeds to processing of step ST210 shown in Figure 5 or step ST229 shown in Figure 11B.
[0072] When it is determined in step ST231 that the extraction distance related to the stored information is zero (step ST231 "NO"), the image analysis unit 112b calculates the position of the blocked area caused by the blocking object (step ST232). As shown in Fig. 15, when the extraction distance is zero (extraction distance E = 0), an obstruction (stopped vehicle 1105 in Fig. 15) is present at the same position as the shooting start position, and there is no captured image showing the area covered by the obstruction. In other words, this area cannot be seen in the captured image when it is not covered by the obstruction during the current drive, and this indicates that it will be necessary to re-investigate at some point. The image analysis unit 112b calculates, by image recognition, the position of the obstructed area covered by the obstructing object closest to the shooting start position in the image of the transmission candidate. If the distance traveled in the image from the center of the starting point of shooting to the vertex of the obstructing object is known, the extent of the obstructed area can be calculated from correlation information with the actual distance and the position of the vehicle (see the bottom diagram in Figure 15).
[0073] The image analysis unit 112b excludes the obstructing object (the stopped vehicle 1105 in FIG. 15) from the processing target (step ST233). Specifically, the image analysis unit 112b decides to ignore the obstruction in question at the next processing time, and to perform processing on the next closest obstruction to the obstruction in question. Moreover, the image analysis unit 112b notifies the image extraction unit 114b of information indicating the image to be transmitted and the position information of the blocked area.
[0074] The image extraction unit 114b stores the position of the blocked area together with the information (step ST234). Specifically, the image extraction unit 114b extracts and acquires the captured image of the notified transmission candidate from the information acquisition unit 111, and stores it in the transmission image information storage unit 115 as information of the transmission candidate together with the position information of the blocked area. At this time, image extraction unit 114b may also obtain, from information acquisition unit 111, information obtained from sensor unit 300 at the time the image of the transmission candidate was captured, and add this information to the information of the transmission candidate. Also, it may be possible to only include position information of the blocked area without including images of the transmission candidates. The above process is periodically repeated while the information acquisition unit 111 holds the previously transmitted image. As described above, when an image not covered by an obstruction does not exist even after implementing embodiment 1 or embodiment 2, the area covered by the obstruction can be notified as a re-survey area.
[0075] As described above, the data extraction device according to the present disclosure is configured such that, when the extraction distance is zero, the image analysis unit calculates the position information of the obscured area covered by an obstruction and calculates the obstruction distance for the object next to the obstruction, and the image extraction unit extracts the position information of the obscured area together with the extracted image as a transmission candidate. This makes it possible to provide a data extraction device that extracts information notifying an area covered by an obstruction as a re-survey area.
[0076] Embodiment 4 In the fourth embodiment, a form of notification to increase the distance between the vehicles so that necessary information can be extracted will be described. In the data extraction device 110c of the fourth embodiment, when the extracted distance is less than a predetermined second distance by implementing the first, second, or third embodiment, the data extraction device 110c increases the distance between the vehicle and the preceding vehicle by a third distance or more, thereby reducing the transmission load.
[0077] FIG. 16 is a diagram showing the configuration of a data extraction device 110c, a data transmission device 100c, and a diagnostic system including these according to the fourth embodiment. FIG. 17 is a flowchart showing the process of the data extraction device 110c according to the fourth embodiment. FIG. 18 is a diagram showing an example of an image of the process performed by the data extraction device 110c according to the fourth embodiment.
[0078] A data extracting device 110c shown in Fig. 16 is configured by replacing the image analyzing unit 112 of the data extracting device 110 shown in Fig. 1 with an image analyzing unit 112c. Also, a vehicle distance adjusting unit 131 is added. The data extracting device 110c shown in Fig. 16 is configured by replacing the image analyzing unit 112a of the data extracting device 110a shown in Fig. 10 with an image analyzing unit 112c, and further including an inter-vehicle distance adjusting unit 131. The data extracting device 110c shown in Fig. 16 is configured by replacing the image analyzing unit 112b of the data extracting device 110b shown in Fig. 13 with an image analyzing unit 112c, and further including an inter-vehicle distance adjusting unit 131. In the following explanation, differences from data extraction device 110 shown in FIG. 1, data extraction device 110a shown in FIG. 10, or data extraction device 110b shown in FIG. 13 will be explained, and explanations of contents that are the same as or equivalent to those shown in FIG. 1, FIG. 10, or FIG. 13 will be omitted.
[0079] The data extracting device 110c further includes a vehicle distance adjusting unit 131. If the extracted distance is less than the second distance, the vehicle distance adjustment unit 131 notifies the vehicle to keep the distance between the vehicle and the vehicle ahead of the vehicle at a third distance or more, or instructs control so that the vehicle distance is kept at the third distance or more. The second distance is a distance at which the number of transmitted images is reduced, as shown in FIG. 18, and is, for example, a distance equal to or less than the first distance. The third distance is a distance that reduces the number of transmitted images, similar to the second distance, and is, for example, a distance equal to or greater than the first distance.
[0080] The inter-vehicle distance adjustment unit 131 is connected to an external notification device and an inter-vehicle distance control unit 700 in an ACC (Auto Cruise Control). Specifically, the external notification device is at least one of an audio output device such as a speaker 500 and a display device such as a display 600.
[0081] The hardware configuration of the data transmission device 100c including the data extraction device 110c of the fourth embodiment has the same functions as those of the components described in the first embodiment, and further includes the function of a vehicle distance adjustment unit 131. Since the hardware configuration is the same as that of the first embodiment, detailed description thereof will be omitted.
[0082] An overview of the processing performed by the data extracting device 110c according to the fourth embodiment will be described. 18, when the extraction distance is small, the number of images transmitted to server 400 increases compared to when the extraction distance is large. Therefore, when the extraction distance is smaller than a certain value (second distance), the host vehicle is notified or controlled to increase the distance between the vehicles, and the number of images transmitted to server 400 is reduced, thereby aiming to reduce the transmission load.
[0083] The process of the data extraction device 110c according to the fourth embodiment will be described. The process of the data extracting device 110c according to the fourth embodiment assumes that the processes of steps ST241 to ST243 are added between step ST209 and step ST210 shown in FIG. 5 and described in the first embodiment. Moreover, the processing of the data extraction device 110c according to the fourth embodiment is assumed to add processing of steps ST241 to ST243 between steps ST228 and ST229 shown in FIG. 11B described in the second embodiment. Moreover, the processing of the data extraction device 110c according to the fourth embodiment is assumed to add processing of steps ST241 to ST243 between steps ST233 and ST234 shown in FIG. 14 described in the third embodiment. 17, detailed descriptions of the same processes as those shown in FIG. 5, those shown in FIGS. 11A and 11B, and those shown in FIG. 14 are omitted. In the following description, steps ST241, ST242, and ST243 will be described in detail.
[0084] The image analysis unit 112c determines whether the extraction distance is equal to or greater than the second distance (step ST241). If the extraction distance is equal to or greater than the second distance ("YES" in step ST241), the process proceeds to step ST210, step ST229, or step ST234.
[0085] If the extracted distance is less than the second distance, if the obstructing object is a preceding vehicle, it indicates that the inter-vehicle distance is relatively small. Therefore, if the extracted distance is less than the second distance (step ST241 "NO"), the image analysis unit 112c instructs the inter-vehicle distance adjustment unit to keep a certain distance or more from the preceding vehicle. The vehicle distance adjustment unit receives the instruction from the image analysis unit 112c, notifies the driver (step ST242), and generates and outputs vehicle control information (step ST243). Specifically, the inter-vehicle distance adjustment unit notifies the driver via speaker 500 or display 600 to maintain a distance from the preceding vehicle that is equal to or greater than a predetermined third distance. Alternatively, the following distance adjustment unit controls the host vehicle using the following distance control unit 700 such as an ACC control function so as to keep the following distance from the preceding vehicle at a predetermined third distance or more. Here, the only thing that is adjusted is the distance between the vehicle and the preceding vehicle, so even if the extracted distance is less than the second distance, if the obstacle is something other than the preceding vehicle, the distance between the obstacle and the vehicle will not be adjusted, and therefore no distance will be allowed between pedestrians, light vehicles, stopped vehicles, etc.
[0086] After the processes of steps ST242 and ST243 are completed, the process proceeds to step ST210, step ST229, or step ST234.
[0087] In the data extraction device 110c according to the fourth embodiment, a certain distance is always kept from the preceding vehicle. Since the vehicle often overtakes pedestrians, light vehicles, stopped vehicles, etc., the type of obstacle may be detected and it may be determined whether to keep a certain distance from the preceding vehicle depending on the type of obstacle. The above process is periodically repeated while the information acquisition unit 111 holds the previously extracted image.
[0088] In this way, the distance between the vehicle and the preceding vehicle is controlled to be at least a certain distance, and the transmission load can be reduced.
[0089] As described above, the data extraction device according to the present disclosure is configured to include a vehicle distance adjustment unit that notifies the vehicle to keep the vehicle distance between the vehicle and the vehicle ahead of the vehicle at a third distance or more when the extracted distance is less than the second distance, or instructs control so that the vehicle distance is kept at the third distance or more. This has the effect of reducing the number of transmissions and the transmission load because the information acquired is transmitted when the vehicle is at a certain distance from the preceding vehicle. Furthermore, the reduction in the number of transmissions also reduces the amount of communication traffic.
[0090] It should be noted that, within the scope of the disclosure, the embodiments may be freely combined, any component of each embodiment may be modified, or any component of each embodiment may be omitted. [Industrial Applicability]
[0091] The data extraction device of the present disclosure is suitable for use in a data transmission device or the like that extracts and transmits information for transmission from information acquired by a device mounted on a vehicle, since the extraction distance for extracting information for transmission changes depending on the distance from the vehicle to the obstruction. The present invention is also suitable for use in diagnostic systems that diagnose the condition of roads and structures using images acquired by a device mounted on a vehicle. [Explanation of symbols]
[0092] 1, 1a, 1b, 1c data transfer system, 100, 100a, 100b, 100c data transmission device, 110, 110a, 110b, 110c data extraction device, 111 information acquisition unit, 112, 112a, 112b, 112c image analysis unit, 113, 113a extraction distance determination unit, 114, 114a, 114b image extraction unit, 115 transmitted image information storage unit, 116 image information transmission unit, 117 transmission unit, 131 inter-vehicle distance adjustment unit, 200 imaging unit, 300 sensor unit, 301 vehicle position sensor, 302 vehicle speed sensor, 303 acceleration sensor, 304 time sensor, 305 illuminance sensor, 306 weather sensor, 307 biosensor, 400 server, 401 receiving unit, 402 Image information accumulation unit, 403 image information storage unit, 500 speaker, 600 display, 700 vehicle distance control unit, 1001 processor, 1002 first memory, 1003 second memory, 1004 transmitter, 1005 processing circuit, 1101 host vehicle, 1102, 1103, 1104, 1106 preceding vehicles, 1105 stopped vehicle, 1200 road.
Claims
1. A data extraction device that extracts an image for transmission from images of the outside of a vehicle captured by an imaging device mounted on the vehicle, each time the vehicle travels an extraction distance, an information acquisition unit that acquires an image of the outside of the vehicle; an image analysis unit that analyzes an image captured at a position that is the extraction distance away from the position at which the previously extracted image was captured, and calculates an obstruction distance that indicates the actual distance from the capture start position in the image to be analyzed to the position of the obstruction captured in the image; an extraction distance determination unit that outputs the obstruction distance calculated by the image analysis unit as a next extraction distance; an image extraction unit that extracts an image that is the analysis target of the image analysis unit; A data extraction device comprising:
2. The data extraction device according to claim 1 , wherein the extraction distance determination unit outputs the obstruction distance as a next extraction distance when the obstruction distance is less than a first distance.
3. 2. The data extraction device according to claim 1, wherein the extraction distance determination unit outputs the obstruction distance as a next extraction distance when the obstruction distance is less than a first distance, and outputs the first distance as the next extraction distance when the obstruction distance is equal to or greater than the first distance.
4. When the extraction distance related to the image to be analyzed is less than the first distance, the image analysis unit calculates, for each image acquired by the information acquisition unit between the previous extraction and the current extraction, an obstruction distance from the imaging start position in the image to the nearest obstruction, and a distance from the imaging start position in the previously extracted image to a position that is the extraction distance ahead, the extraction distance determination unit calculates a calculated distance by subtracting a distance from a shooting start position to a position that is the previous extraction distance from the shooting start position in the previous transmission image, and determines an image that is determined to have the largest calculated distance as a transmission candidate; The image extraction unit extracts an image of the transmission candidate determined by the extraction distance determination unit. The data extraction device according to any one of claims 1 to 3.
5. When the extraction distance is zero, the image analysis unit calculates position information of an obstruction area covered by the obstruction and calculates an obstruction distance to an obstruction next to the obstruction, The image extraction unit extracts position information of the blocked area as a transmission candidate. The data extraction device according to any one of claims 1 to 4.
6. and a vehicle distance adjustment unit that notifies the driver to increase the vehicle distance between the vehicle and a preceding vehicle to a third distance or more when the extracted distance is less than a second distance, or instructs control so that the vehicle distance is increased to the third distance or more. The data extraction device according to any one of claims 1 to 5.
7. A data extraction method for extracting an image to be transmitted from images of an outside of a vehicle captured by an imaging device mounted on the vehicle, each time the vehicle travels an extraction distance, comprising: An information acquisition unit acquires an image of an area outside the vehicle; an image analysis unit analyzes an image captured at a position that is the extraction distance away from the position where the previously extracted image was captured, and calculates an obstruction distance that indicates the actual distance from the capture start position in the image to be analyzed to the position of the obstruction captured in the image; an extraction distance determination unit outputting the obstruction distance calculated by the image analysis unit as a next extraction distance; An image extraction unit extracts an image that is an object of analysis by the image analysis unit; A data extraction method comprising:
8. A data transmission device that extracts an image for transmission from images of the outside of the vehicle captured by an imaging device mounted on the vehicle and transmits the image to an outside of the vehicle every time the vehicle travels an extraction distance, an information acquisition unit that acquires an image of the outside of the vehicle; an image analysis unit that analyzes an image captured at a position that is the extraction distance away from the position at which the previously extracted image was captured, and calculates an obstruction distance that indicates the actual distance from the capture start position in the image to be analyzed to the position of the obstruction captured in the image; an extraction distance determination unit that outputs the obstruction distance calculated by the image analysis unit as a next extraction distance; an image extraction unit that extracts an image that is the analysis target of the image analysis unit; a transmission unit that transmits the image extracted by the image extraction unit; A data transmission device comprising:
Citation Information
Patent Citations
Operation support system
JP2008070987A
Information collection device, information collection method, and program
JP2016071497A
Traffic information estimation device and traffic information estimation method
JP2017211957A
Vehicle-side device, server, method, and storage medium
JP2020038362A
Image management device, road information management system, vehicle, program and image management method
JP2020080462A