Image processing apparatus and image processing method, and image processing program and recording medium

Abstract

To provide an image processing apparatus capable of reducing a processing load on a transmission destination or the like as compared with a case where image information corresponding to an imaging result in each vehicle is always transmitted.SOLUTION: An image processing apparatus comprises: a camera 1 whose image capturing range is in front of the own vehicle; a processing unit 2 for determining whether or not a relationship between a forward vehicle appearing within the image capturing range and the own vehicle has become a specific relationship that an image capturing result of the camera 1 can be employed as the image capturing result indicating a surrounding situation of the own vehicle; and an interface 3 for externally transmitting image data corresponding to the image capturing result of the camera 1 corresponding to a timing at which the relationship between the forward vehicle and the own vehicle has become the specific relationship.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] This application belongs to the technical field of image processing apparatuses, image processing methods, image processing programs, and recording media. More specifically, it belongs to the technical field of an image processing apparatus and an image processing method for processing image information corresponding to an imaging result obtained by imaging the front of a moving object such as a vehicle as an imaging range, a program for the image processing apparatus, and a recording medium on which the program is recorded.

Background Art

[0002] In recent years, research and development have been carried out on a traffic information providing system that collects image information corresponding to an imaging result obtained by a camera mounted on a general vehicle and having the front thereof as an imaging range from each vehicle via a network such as the Internet in a server apparatus, and provides the image information itself together with information indicating the road conditions detected based on them to other vehicles and the like. In such a traffic information providing system, it is necessary to evaluate in the server apparatus whether the collected image information is useful for the driver of the vehicle. As a prior art document disclosing such a technique, for example, Patent Document 1 below can be cited. In the technique disclosed in this Patent Document 1, predetermined image analysis processing is respectively performed on each piece of image information collected in the server apparatus as described above. For example, when it is analyzed that a large number of vehicles have not moved for a certain period of time, it is configured to determine that it is useful image information indicating a traffic jam.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technology described in Patent Document 1, since it is necessary to perform the above-described image analysis process on all of the collected image information, there is a problem that the processing load on the server device becomes an issue, particularly when a large number of vehicles are concentrated due to traffic congestion or the like.

[0005] Also, in this case, for example, a configuration may be considered in which the results of performing the above-described image analysis process on each vehicle are transmitted to the server device. However, even in this case, since it is necessary to constantly execute necessary image recognition processing and the like in each vehicle, there is also a problem that the processing load in each vehicle increases as a result.

[0006] Therefore, the present application has been made in view of the above problems, and an example of the problem is to reduce the processing load at the transmission destination or the like of the image information as compared with the case of constantly transmitting the image information corresponding to the imaging result in each vehicle, and to provide an image processing apparatus, an image processing method, a program for the image processing apparatus, and a recording medium on which the program is recorded.

Means for Solving the Problem

[0007] In order to solve the above problems, the invention according to claim 1 includes imaging means having the front of a moving body as an imaging range, determination means for determining whether or not the distance between another moving body reflected in the imaging range and the moving body is equal to or greater than a preset threshold distance, and recording means for recording image information corresponding to the imaging result corresponding to the timing when it is determined that the distance is equal to or greater than the threshold distance.

[0008] In order to solve the above problems, the invention according to claim 7 is an image processing method executed in an image processing apparatus including imaging means having the front of a moving body as an imaging range, determination means, and transmission means, the method including: an imaging step of imaging the imaging range by the imaging means; a determination step of determining by the determination means whether or not the distance between another moving body reflected in the imaging range and the moving body is equal to or greater than a preset threshold distance; and a transmission step of transmitting, by the transmission means, external image information corresponding to the imaging result corresponding to the timing when the distance becomes equal to or greater than the threshold distance.

[0009] In order to solve the above problems, the invention according to claim 8 causes a computer connected to imaging means having the front of a moving body as an imaging range to function as the image processing apparatus according to any one of claims 1 to 7 excluding the imaging means.

[0010] In order to solve the above problems, the invention according to claim 9 is such that the image processing program according to claim 8 is recordable in a readable manner by a computer connected to imaging means having the front of a moving body as an imaging range.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Modes for Carrying Out the Invention

[0012] Next, a mode for carrying out the present application will be described with reference to FIG. 1. Note that FIG. 1 is a block diagram showing the schematic configuration of an image processing apparatus according to an embodiment.

[0013] As shown in FIG. 1, an image processing apparatus S according to an embodiment includes an imaging unit 1, a determination unit 2, and a recording unit 2-1.

[0014] In this configuration, the imaging unit 1 is an imaging unit that images the front of the moving body as an imaging range.

[0015] Then, the determination unit 2 determines whether or not the relationship between another moving body reflected in the imaging range of the imaging unit 1 and the moving body has become a specific relationship that enables the use of the imaging result of the imaging unit as an imaging result indicating the situation around the moving body.

[0016] Thereby, the recording unit 2-1 records image information corresponding to the imaging result of the imaging unit 1 corresponding to the timing when the relationship determined by the determination unit 2 becomes the specific relationship.

[0017] As described above, according to the operation of the image processing apparatus S according to the embodiment, image information corresponding to the imaging result corresponding to the timing when the relationship with another moving body reflected in the front imaging range becomes a specific relationship that enables the use of the imaging result as an imaging result indicating the surrounding situation is recorded. Therefore, the processing load of the image processing apparatus can be reduced as compared with the case where the image processing is constantly performed.

Example

[0018] Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. 2 to 4. Note that the examples described below are examples when the present application is applied to image processing in a drive recorder provided in a vehicle as an example of the “moving body” according to the present application. In the following description, the vehicle equipped with the drive recorder is simply referred to as “own vehicle”.

[0019] Further, FIG. 2 is a block diagram showing the schematic configuration of a drive recorder according to an embodiment, FIG. 3 is a flowchart showing the image processing according to the embodiment, and FIG. 4 is a diagram exemplifying the effects of the image processing according to the embodiment. At this time, in FIG. 2, for each component member of the embodiment corresponding to each component member in the image processing apparatus S according to the embodiment shown in FIG. 1, the same member number as that of each component member in the image processing apparatus S is used.

[0020] As shown in FIG. 2, the drive recorder DR according to the embodiment includes a camera 1 composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) imaging element, etc., a processing unit 2 composed of a CPU, a RAM (Random Access Memory), a ROM (Read Only Memory), etc., an interface 3, an operation unit 4 composed of operation buttons or a touch panel, etc., a recording unit 5 composed of an HDD (Hard Disc Drive) or an SSD (Solid State Drive), etc., a sensor unit 6 composed of, for example, an acceleration sensor and an inter-vehicle distance sensor, etc., and a display 7 composed of a liquid crystal display, etc. At this time, the camera 1 corresponds to an example of the imaging means 1 according to the embodiment, the processing unit 2 corresponds to an example of the determination means 2 and an example of the recording means 2-1 according to the embodiment, respectively, and the interface 3 corresponds to an example of the transmission means 3 according to the embodiment. Further, the processing unit 2 corresponds to an example of the "first determination means", an example of the "second determination means", and an example of the "detection means" according to the present application, respectively.

[0021] In the above configuration, the camera 1 has the front of the host vehicle as its imaging range, and under the control of the processing unit 2, images the imaging range cyclically (i.e., circularly), and outputs image data corresponding to the imaging result to the processing unit 2. This image data corresponds to an example of the "image information" according to the present application. On the other hand, the interface 3 controls the exchange of data with an external server device (not shown) via a network such as the Internet or the so-called vehicle-to-vehicle communication with a navigation device (not shown) mounted on another vehicle under the control of the processing unit 2. In the following description, the external server device (not shown) or the navigation device (not shown) mounted on another vehicle is simply referred to as the "server device etc.". Further, when an operation by the user for designating an operation in the drive recorder DR is performed on the operation unit 4, the operation unit 4 generates an operation signal corresponding to the operation and outputs it to the processing unit 2. Furthermore, the sensor unit 6 detects the acceleration applied to the host vehicle for each of, for example, three axial directions, and outputs acceleration data indicating the detected acceleration to the processing unit 2. The sensor unit 6 also detects the inter-vehicle distance between the host vehicle and another vehicle existing in front of the host vehicle, and outputs distance data indicating the detected inter-vehicle distance to the processing unit 2. In the following description, the other vehicle is simply referred to as the "front vehicle". Thus, the processing unit 2 causes the recording unit 5 to record the above image data output from the camera 1 in a non-volatile manner. Then, the processing unit 2 reads out necessary image data by image processing according to the embodiment described below and transmits it to the server device etc. via the interface 3. Furthermore, the processing unit 2 detects the acceleration or speed of the host vehicle based on the above acceleration data output from the sensor unit 2, and detects the inter-vehicle distance between the front vehicle and the host vehicle based on the above distance data output from the sensor unit 2. The processing unit 2 also comprehensively controls the processing as a drive recorder DR including image processing according to the embodiment based on the above operation signal output from the operation unit 4.

[0022] Next, the image processing according to the embodiment will be specifically described with reference to FIGS. 2 and 3. As shown in the flowchart of FIG. 3, the image processing according to the embodiment starts, for example, at regular intervals after a power switch (not shown) as the drive recorder DR is turned on. When the image processing according to the embodiment starts, first, the processing unit 2 acquires congestion (traffic jam) information including, for example, a point in front of the host vehicle (step S1). In this step S1, for example, it may be estimated that there is congestion when the speed of the host vehicle is equal to or lower than a certain speed, or the congestion information itself may be acquired by, for example, VICS (registered trademark) (Vehicle Information Communication System) or vehicle-to-vehicle communication. When the congestion information is acquired in step S1, it is presumed that the rear part of another vehicle existing in front of the host vehicle is reflected in the imaging range of the camera 1. Therefore, the processing unit 2 then detects whether the front vehicle has started, that is, whether the state of the front vehicle has changed from the stopped state to the moving state (driving state) (step S2). As this step S2, for example, the processing unit 2 may detect that the front vehicle has started when the inter-vehicle distance gradually becomes longer from a certain value, or may analyze the image of the front vehicle shown in the camera 1 and detect that the front vehicle has started when the image becomes smaller. Further, the start of the front vehicle may be detected by performing so-called edge detection processing on the image. Thereafter, the processing unit 2 determines whether the start of the front vehicle has actually been detected in step S2 (step S3). And, for example, if there is no front vehicle in the first place for reasons such as low accuracy of the congestion information acquired in step S1, the start is not detected (step S3: NO), and the processing unit 2 returns to step S1 above and repeats the above-described processing. On the other hand, when the start of the front vehicle is detected in the determination of step S3 (step S3: YES), next, the processing unit 2 detects whether the host vehicle has started, that is, whether the state of the host vehicle has changed from the stopped state to the starting state (step S4). As this step S4, for example, the processing unit 2 can be configured to detect that the host vehicle has started when the host vehicle has a significant acceleration or speed forward based on the acceleration data output from the sensor unit 6.The post-processing unit 2 then determines whether the start of the host vehicle has actually been detected in step S4 (step S5). If the start of the host vehicle has not been detected yet (step S5: NO), the processing unit 2 returns to step S4 above and waits for the detection of the start of the host vehicle. On the other hand, if the start of the host vehicle is detected in the determination of step S5 (step S5: YES), since the preceding vehicle has started before that (refer to step S3: YES), there is a distance (interval) between the host vehicle and the preceding vehicle that is sufficient to effectively utilize the image data corresponding to the imaging result obtained by imaging that state with camera 1 as image data indicating, for example, a congested (traffic jam) situation around the host vehicle in the server device or the like obtained from the drive recorder DR according to the embodiment. That is, the server device or the like can obtain image data in which the situation around the host vehicle is more easily recognized due to the space (space corresponding to the above distance (interval)) vacated by the preceding vehicle starting first (refer to step S3: YES). Therefore, the processing unit 2 reads out from the recording unit 5 the image data corresponding to the imaging result captured at a point in time a preset time (for example, 0.5 seconds before) before the timing when the start of the host vehicle is detected in step S5, and transmits (uploads) the read image data to the server device or the like via the interface 3 (step S6).

[0023] Then, the post-processing unit 2 determines whether to end the image processing according to the embodiment, for example, due to reasons such as the power of the drive recorder DR being turned off (step S7). In the determination of step S7, if the image processing according to the embodiment is to be ended (step S7: YES), the processing unit 2 ends the image processing as it is. On the other hand, in the determination of step S7, if the image processing according to the embodiment is to be continued (step S7: NO), the processing unit 2 returns to step S1 above and repeats the above-described processing.

[0024] As described above, according to the image processing according to the embodiment, the image data corresponding to the imaging result corresponding to the timing when the distance from the preceding vehicle reflected in the front imaging range has opened to a distance at which the imaging result can be used as an imaging result indicating the surrounding situation (see FIG. 3, step S5: YES) is transmitted to an external server device or the like. Therefore, compared with the case where the image data is constantly transmitted from the drive recorder DR, the processing load on the processing unit 2 and the processing destination of the image data can be reduced, and at the transmission destination, the imaging result corresponding to the image data can be usefully utilized for processing related to, for example, congestion determination. More specifically, regarding this effect, with reference to FIG. 4, for example, in the imaging result G captured by the camera 1 of the host vehicle in a state where the distance from the preceding vehicle is not open, as illustrated in FIG. 4(a), the preceding vehicle C is reflected extremely closely. Even if the server device or the like acquires the image data corresponding to the imaging result G in this state, it cannot be usefully used for determining, for example, the congestion situation around the host vehicle. On the other hand, in the imaging result G captured by the camera 1 in a state where the distance from the preceding vehicle C is sufficiently open (see step S5: YES), as illustrated in FIG. 4(b), the preceding vehicle C is reflected farther away compared to the case illustrated in FIG. 4(a). Therefore, in this case, there is a distance between the host vehicle and the preceding vehicle C that allows the image data corresponding to the imaging result G to be effectively utilized for determining the situation around the host vehicle in the server device or the like. Therefore, if the server device or the like acquires the image data corresponding to the imaging result in the state illustrated in FIG. 4(b), it can be usefully used for determining, for example, the congestion situation in the lane where the host vehicle is located or other lanes around the host vehicle.

[0025] In addition, since the image data corresponding to the imaging result corresponding to the time point when the preceding vehicle is in a moving state and the host vehicle changes from a stopped state to a moving state is transmitted to an external server device or the like (see FIG. 3, step S5: YES), the processing load on the processing unit 2 and the processing destination of the image data can be reduced, and at the transmission destination, the imaging result accurately indicating the surrounding congestion situation can be usefully utilized.

[0026] Furthermore, after the leading vehicle changes from the stopped state to the moving state (see FIG. 3, step S3: YES), when the host vehicle changes from the stopped state to the moving state (see FIG. 3, step 5: YES), the image data corresponding to the imaging result at that time is transmitted to an external server device or the like. Therefore, the processing load on the processing unit 2 and at the transmission destination of the image data can be reduced, and at the transmission destination, the imaging result that more accurately shows the surrounding traffic congestion situation can be beneficially utilized.

[0027] Furthermore, when determining whether or not the leading vehicle is in a moving state based on the imaging result in which the leading vehicle is captured (see FIG. 3, step S2), it is possible to surely detect that the leading vehicle is in a moving state and transmit necessary image data to the outside.

[0028] Also, when determining whether or not the host vehicle has changed from the stopped state to the moving state based on the acceleration or speed of the host vehicle (see FIG. 3, step S4), it is possible to surely detect that the host vehicle has changed from the stopped state to the moving state and transmit necessary image data to the outside.

[0029] In the above-described embodiment, the start of each of the preceding vehicle and the host vehicle is detected to determine whether the distance between the preceding vehicle and the host vehicle has increased (see steps S2 to S5 in FIG. 3). Here, for example, when both the preceding vehicle and the host vehicle are present in a traffic jam moving at a low speed, the inter-vehicle distance may not easily increase. Therefore, in such a case, for example, when the time from when the preceding vehicle changes from the stopped state to the moving state until the host vehicle changes from the stopped state to the moving state becomes equal to or longer than a threshold time preset according to experience, experiment, or regional characteristics (e.g., the specificity of the traffic jam at that location), the image data corresponding to the imaging result corresponding to that time point may be configured to be transmitted to an external server device or the like. Also in this case, the processing load on the processing unit 2 and at the transmission destination of the image data can be reduced, and at the transmission destination, the imaging result accurately indicating the surrounding congestion situation can be beneficially utilized. Further, when the distance between the preceding vehicle and the host vehicle when the preceding vehicle changes from the stopped state to the moving state and the host vehicle changes from the stopped state to the moving state becomes equal to or longer than a threshold distance preset according to experience, experiment, or regional characteristics (e.g., the specificity of the traffic jam at that location), the image data corresponding to the imaging result corresponding to that time point may be configured to be transmitted to an external server device or the like. Also in this case, the processing load on the processing unit 2 and at the transmission destination of the image data can be reduced, and at the transmission destination, the imaging result accurately indicating the surrounding congestion situation can be beneficially utilized.

[0030] Also, in the above-described embodiment, the case where the embodiment is applied to the image processing in the drive recorder DR mounted on the host vehicle has been described. However, in addition to this, the embodiment can also be applied to the image processing in the drive recorders mounted on two-wheeled vehicles and railway vehicles.

[0031] Furthermore, in addition to the above-described embodiment, for example, when the host vehicle is waiting for a signal and the preceding vehicle disappears from the imaging range of the host vehicle, this may be set as the timing of step S5: YES. In this case, the image data in a state where the forward visibility is opened can be transmitted to an external server device or the like.

[0032] Furthermore, a program corresponding to the flowchart shown in FIG. 3 may be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and read and executed by a general-purpose microcomputer or the like, thereby causing the microcomputer or the like to function as the processing unit 2 according to the embodiment.

Explanation of Signs

[0033] 1 Imaging means (camera) 2 Determination means (processing unit) 2-1 Recording means 3 Interface DR Drive recorder S Image processing apparatus C Leading vehicle G Imaging result

Claims

[Claim 1] An imaging means having an imaging range in front of the moving object; a determination means for determining whether or not a relationship between the moving body and other moving bodies captured within the imaging range has become a specific relationship that allows the imaging result of the imaging means to be used as an imaging result showing the surroundings of the moving body; a recording means for recording image information corresponding to the imaging result at a time when the relationship becomes the specific relationship; An image processing device comprising:

Images