Control processing apparatus, control processing method, and control processing system

By using cameras to capture images and line detection technology in autonomous vehicles to calculate visual distance values, combined with obstacle detection, the impact of changes in weather conditions on vehicle control is solved, and the operation stability and safety of the vehicle in bad weather is improved. .

CN119002329APending Publication Date: 2024-11-22KK TOSHIBA
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410608414.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-16
Filing Date
2024-05-16
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

Changes in weather conditions affect the control processing of autonomous driving vehicles, resulting in unstable control processing of deceleration, stopping or sirens.

Method used

A control processing device is designed to capture images of the driving direction of the railway vehicle through a camera, and to calculate values ​​related to the visible distance using the line detection and visual distance calculation unit, and to combine obstacle detection and image processing to generate suitable meteorological conditions. Control signals to stabilize vehicle operation.

Benefits of technology

It effectively suppresses the impact of changes in meteorological conditions on vehicle control, improves the accuracy of visual distance measurement of autonomous vehicles in severe weather such as fog, rain, and snow, and ensures safe operation of the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119002329A_ABST
    Figure CN119002329A_ABST
Patent Text Reader

Abstract

The embodiment of the invention relates to a control processing apparatus, a control processing method, and a control processing system. A control processing device according to an embodiment includes an image acquisition unit, a route information acquisition unit, a route detection unit, and a first visible distance calculation unit. The image acquisition unit acquires a captured image in the direction of travel of the railway vehicle. The route detection unit detects, on the basis of a predetermined reference, a route in the direction in which the railway vehicle travels in the captured image. The first visible distance calculation unit calculates a first visible distance value relating to the visible distance on the basis of the detected length of the line.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is based on Japanese Patent Application No. 2023-080825 (filing date: 5 / 16 / 2023) and claims priority based on the Japanese Patent Application. This application includes all the contents of the Japanese Patent Application. Technical Field

[0002] Embodiments of the present invention relate to a control processing device, a control processing method, and a control processing system. Background Art

[0003] The automatic driving of railway vehicles, automobiles, etc. is advancing. In the control processing device for driving assistance or automatic driving that performs such automatic driving, control processing such as slowing down the vehicle, stopping the vehicle relative to an obstacle, or sounding a siren is performed. However, the control processing may be affected by weather conditions. Summary of the invention

[0004] An object of the present invention is to provide a control processing device, a control processing method, and a control processing system that can suppress the influence of changes in weather conditions.

[0005] In this embodiment, a control processing device is provided, comprising: an image acquisition unit, which obtains a captured image of the direction of travel of a railway vehicle; a line detection unit, which detects the line in the direction of travel of the railway vehicle in the captured image according to a prescribed standard; and a first visible distance calculation unit, which calculates a first visible distance value related to the visible distance based on the length of the detected line. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 It is a block diagram showing a configuration example of a control processing system according to the present embodiment.

[0007] Figure 2 It is a block diagram showing a detailed configuration example of the control processing device according to the present embodiment.

[0008] Figure 3 It is a diagram showing a processing example in the first mode.

[0009] Figure 4 It is a diagram showing a processing example in the second mode.

[0010] Figure 5 : is a flowchart showing a processing example of the first visible distance processing unit.

[0011] Figure 6 It is a block diagram showing a configuration example of a control processing device according to the second embodiment.

[0012] Figure 7 This is a flowchart showing a processing example of the control processing device.

[0013] Figure 8 It is a block diagram showing a configuration example of a control processing device according to the third embodiment.

[0014] Fig. 9 This is a flowchart showing a processing example of the control processing device according to the third embodiment.

[0015] Fig.10 It is a block diagram showing a configuration example of a control processing device according to the fourth embodiment.

[0016] Fig.11 This is a flowchart showing a processing example of the control processing device according to the fourth embodiment.

[0017] Fig.12 It is a block diagram showing a configuration example of a control processing device according to the fifth embodiment.

[0018] Fig.13 This is a flowchart showing a processing example of the control processing device according to the fifth embodiment.

[0019] Fig.14 It is a block diagram showing a configuration example of a control processing device according to the sixth embodiment.

[0020] Fig.15 This is a flowchart showing a processing example of the control processing device according to the sixth embodiment.

[0021] Description of Reference Numerals

[0022] 1: control processing system, 5: railway vehicle, 10: control processing device, 11: first visible distance processing unit, 12: determination processing unit, 13: second visible distance processing unit, 14: rainfall processing unit, 15: wind speed processing unit, 16: speed processing unit, 30: obstacle sensing device, 111: camera, 112: line detection unit, 113: first visible distance calculation unit, 123: control unit, 131: illumination unit, 132: receiving unit, 140: image processing unit, R100: line. DETAILED DESCRIPTION

[0023] In the drawings attached to this specification, for the convenience of illustration and understanding, the scale and aspect ratio of the drawings are appropriately changed and exaggerated based on the scale and aspect ratio of the actual objects.

[0024] (First Embodiment)

[0025] Figure 1 1 is a block diagram showing a configuration example of the control processing system 1 of the present embodiment. Figure 1As shown, the control processing system 1 of this embodiment includes a control processing device 10 mounted on a railway vehicle 5, a travel position information collection device 20, an obstacle sensing device 30, a motor 40, a siren unit 50, and a communication device 60. The railway vehicle 5 travels on a track R100 which is a fixed track. A monitoring device 70 and a display device 80 are arranged in a centralized control room M110.

[0026] The control processing device 10 executes control processing of the railway vehicle 5 using the image captured by the camera 111. For example, the control processing device 10 can calculate the visible distance and execute control processing according to the visible distance.

[0027] The camera 111 can continuously capture, for example, R, G, and B images as a running dynamic image. The camera 111 is fixed, for example, in front of the railway vehicle 5. Therefore, when each image constituting the running dynamic image captured while the railway vehicle 5 is running on the line is captured, for example, at the same position, it becomes an image with the same angle and the same shooting magnification. The camera 111 according to this embodiment corresponds to an image acquisition unit.

[0028] Moreover, a lighting device not shown is mounted on the railway vehicle 5. The lighting device is fixed, for example, in front of the railway vehicle 5, and irradiates light of the same illumination and the same wavelength to the front. Therefore, if the external environment is the same, each image constituting the driving dynamic image captured while the railway vehicle 5 is traveling on the line can be captured with the same illumination. Therefore, if it is the same environment, the image captured at the same position becomes an image with reproducibility. In other words, the state change of the captured object, such as the line, in the image captured at the same position is affected by the change of the external environment. In addition, the details of the control processing device 10 will be described later.

[0029] The travel position information collection device 20 obtains the current position of the railway vehicle 5, and outputs information of a predetermined route range for the current position in the traveling direction of the railway vehicle 5. For example, the travel position information collection device 20 outputs information related to the route R100 corresponding to the current position of the railway vehicle 5. The information about the route R100 is pre-determined in consideration of the weather conditions as a reference. For example, the weather conditions include relative humidity, temperature, date and time, and illumination.

[0030] The travel position information collection device 20 can obtain the current position through, for example, a travel distance meter or a global positioning system (GPS: Global Positioning System, Global Positioning Satellite).

[0031] The obstacle detection device 30 detects obstacles that become obstacles when the railway vehicle 5 travels based on the captured images captured by the control processing device 10 and the detected track. The obstacle detection device 30 can change the warning information according to the visible distance value calculated by the control processing device 10. For example, the obstacle detection device 30 can make the first warning signal, which is a signal for an obstacle detected at a distance closer to the front side than the visible distance value calculated by the control processing device 10, and the second warning signal, which is a signal for an obstacle detected at a distance farther than the first visible distance value, different from each other.

[0032] The motor 40 drives the wheels of the railway vehicle 5 . The motor 40 can be controlled by an operation signal from a driver or a control signal from the control processing device 10 .

[0033] The siren unit 50 generates a siren. The siren unit 50 can be controlled by an operation signal from the driver or a control signal from the control processing device 10 .

[0034] The control processing device 10 outputs a deceleration control signal to the motor 40 and a siren output signal to the siren unit 50 according to the warning signal generated by the obstacle detection device 30. For example, the control processing device 10 performs different controls on the motor 40 based on the first warning signal and the second warning signal. For example, the control processing device 10 performs control on the motor 40 so that the stopping distance for the first warning signal is shorter than the stopping distance for the second warning signal. Alternatively, the control processing device 10 performs control so that the siren unit 50 only generates a siren for the second warning signal.

[0035] The communication device 60 communicates with the monitoring device 70 in the centralized control room M110. For example, the communication device 60 sends the image captured by the camera 111 to the monitoring device 70. The communication may be wired or wireless. In addition, the communication device 60 can also send the image captured by the camera 111 to the monitoring device 70 according to the control signal of the control processing device 10. For example, the communication device 60 can also send the image to the monitoring device 70 when the control processing device 10 outputs a deceleration control signal, a siren output signal, etc. according to the warning signal.

[0036] The monitoring device 70 is used, for example, to monitor the driving state of the railway vehicle 5. For example, the monitoring device 70 stores information such as images, visible distance values, warning signals, deceleration control signals, and siren output signals sent from the control processing device 10 via the communication device 60, and displays them on the display device 80. The display device 80 is, for example, a monitor, and displays the images sent from the communication device 60.

[0037] Figure 21 is a block diagram showing a detailed configuration example of the control processing device 10 of this embodiment. Figure 2 As shown, the control processing device 10 is a device that can change the control processing of the railway vehicle 5 according to the external environment. For example, as described above, the control processing device 10 changes the control processing method according to the visibility distance value.

[0038] The visible distance value of the present embodiment is a value related to the visible distance, and may also be a value of the visible distance. The visible distance value is a value correlated with the concentration of fog, etc. For example, in the present embodiment, sometimes an evaluation value in the control processing such as whether the driving speed needs to be adjusted or not is referred to as a visible distance value. Therefore, the visible distance value of the present embodiment is correlated with the general visible distance representing the limit visual field of the naked eye, but deviations may occur. For example, when the visual field deteriorates due to heavy rain, snow, darkness, etc., the visible distance generally decreases. On the other hand, the reduction in the visible distance value in the control processing is sometimes further suppressed by the control processing including image processing compared to the reduction in the limit value of the visual field.

[0039] The control processing device 10 can control the motor 40 and the siren unit 50 of the railway vehicle 5, and includes a first visible distance processing unit 11 and a determination processing unit 12. The first visible distance processing unit 11 generates a first visible distance value related to the visible distance based on the line length using an image captured by a camera 111. In addition, the visible distance value of this embodiment is sometimes referred to as the visible distance.

[0040] The determination processing unit 12 outputs a control signal corresponding to the first visible distance value generated by the first visible distance processing unit 11, and can change the control processing method of the railway vehicle 5. Alternatively, the determination processing unit 12 outputs a control signal corresponding to the first warning signal and the second warning signal output by the obstacle detection device 30 to the motor 40 and the siren unit 50. In addition, the details of the determination processing unit 12 are described later.

[0041] Here, the first visible distance processing unit 11 is described in detail. The first visible distance processing unit 11 includes a camera 111, a line detection unit 112, and a first visible distance calculation unit 113. As described above, the camera 111 captures an image including a line at a fixed angle. The first visible distance processing unit 11 of the present embodiment has: a first mode for calculating a first visible distance value based on a difference (Japanese: difference) between a first reference length and a detected line length; and a second mode for calculating a first visible distance value based on a difference between a second reference length whose value is changed according to the current position of the railway vehicle 5 and the detected line length.

[0042] Figure 3 1 is a diagram showing an example of processing in the first mode. The first mode is mainly used for routes with many lines having high linearity. Figure 3 (a), (b), (c), and (d) are diagrams showing examples of the line R100 detected by the line detection unit 112. The relative humidity increases in the order of Figure 3 (a), (b), (c), and (d). For example, the fog gradually thickens, and the length of the line detected by the line detection unit 112 becomes shorter.

[0043] Figure 4 It is a diagram showing an example of processing in the second mode. The second mode is mainly used for a route with many lines having high linearity. Figure 3 (a), (b), (c), and (d) are diagrams showing examples of the line R100 detected by the line detection unit 112. The relative humidity increases in the order of Figure 3 (a), (b), (c), and (d). For example, the fog gradually thickens, and the length of the line detected by the line detection unit 112 becomes shorter.

[0044] The line detection unit 112 detects a line based on a specified reference. As Figure 3 shown, generally, the line R100 extends in the y direction from the front side to the inside in the viewing direction of the camera 111. Therefore, in the first mode, the line detection unit 112 in the present embodiment calculates the gradient (in Japanese: 勾配) in the horizontal axis (x-axis) direction of the luminance value as a feature amount, and detects a line with a point having a specified gradient value or more as a reference point. More specifically, the difference value in the horizontal axis (x-axis) direction of the luminance value is calculated, and a range within a specified distance of the difference value between a pixel representing a specified positive value and a pixel representing a specified negative value is detected as the area of the line R100. That is, a range in which the absolute value of the difference value is a specified value or more and the interval between the position representing a positive difference value and the position representing a negative difference value is within a specified distance (within a specified number of pixels) is detected as the area of the line R100. In addition, sometimes the positive and negative of the difference value are reversed depending on the image used and the direction of the difference operation. In addition, the line detection method is an example, and other detection methods may also be used.

[0045] As Figure 4As shown, in the curved line R100, an image region may also be generated in which the gradient of the brightness value in the vertical axis (y-axis) direction is larger than the gradient of the brightness value in the horizontal axis direction. Therefore, in the second mode, attention is paid to both the gradient of the brightness value in the horizontal axis direction and the gradient in the vertical axis direction, and feature data is acquired while switching the gradient of interest according to the area (pixel group) to be detected. In the second mode, the line detection unit 112 obtains the calculation area and calculation method of the difference value from the driving position information collection device 20 according to the position of the railway vehicle 5. That is, the shooting angle of the camera 111 is fixed, so the driving position information collection device 20 can pre-store the calculation area and calculation method of the difference value corresponding to the position of the railway vehicle 5. Therefore, in the second mode, the line detection unit 112 detects the line R100 while changing the calculation area and calculation method of the difference value according to the position of the railway vehicle 5.

[0046] The first visible distance calculation unit 113 calculates the first visible distance value based on the difference value between the first reference length and the detected length of the line R100. That is, the first visible distance calculation unit 113 calculates the first visible distance value in such a manner that the first visible distance value increases as the absolute value of the difference value between the first reference length and the detected length of the line R100 decreases. In this case, the first visible distance calculation unit 113 uses the first reference length, which is a predetermined fixed value, in the first mode, and can therefore perform visible distance calculation at a higher speed.

[0047] On the other hand, in the curved line R100, even if the visible distance is the same, the length of the line R100 detected on the image changes according to the curvature of the line R100. In addition, there is also a case where it is affected by the gradient angle (Japanese: hook angle) of the line R100. Therefore, in the second mode, the first visible distance calculation unit 113 obtains the second reference length corresponding to the position of the railway vehicle 5 from the driving position information collection device 20, and uses the second reference length as the reference length. That is, the first visible distance calculation unit 113 calculates in the second mode in such a way that the first visible distance value becomes larger as the absolute value of the difference between the second reference length and the length of the detected line R100 becomes smaller. Thereby, it is possible to suppress the reduction in the accuracy of the visible distance calculation of the line R100 with high curvature and the area where the gradient of the line R100 in the image changes. In addition, the second mode can also be used for the line R100 with high linearity. In addition, the calculation of the first visible distance value can also be calculated at predetermined intervals. For example, the first visible distance calculation unit 113 calculates the first visible distance value at one-minute intervals.

[0048] Again Figure 2As shown, the determination processing unit 12 includes a storage unit 121, a visual distance determination unit 122, and a control unit 123. The storage unit 121 stores, for example, the position information and time of the railway vehicle 5 in association with the detected line length of the line R100 and the first visual distance value. For example, the time can use the time of the reference clock of the determination processing unit 12. In addition, the position information of the railway vehicle 5 can use the information output by the travel position information collection device 20.

[0049] The visible distance determination unit 122 outputs a control command signal corresponding to the first visible distance value calculated by the first visible distance calculation unit 113 to the control unit 123. For example, when the first visible distance value is less than a predetermined distance value, the visible distance determination unit 122 outputs a control command signal having information of the first visible distance value to the control unit 123. For example, when the first visible distance value is less than a predetermined distance value, the visible distance determination unit 122 outputs a control command signal having information of the first visible distance value to the control unit 123.

[0050] The control unit 123 can perform control processing of the railway vehicle 5. For example, when the first visible distance value is less than a specified distance, the control unit 123 controls the motor 40 to decelerate the railway vehicle 5. Alternatively, when the first visible distance value is less than a specified distance, the control unit 123 sends an alarm signal having information of the first visible distance value to the monitoring device 70 via the communication device 60. Thus, the monitoring device displays the image of the camera 111 together with the alarm information having information of the visible distance through the display device 80, for example. In addition, when the railway vehicle 5 is manned, the control unit 123 notifies the driver's seat of the railway vehicle 5 of the alarm information when the first visible distance value is less than a specified distance. For example, the alarm information can be notified together with the first visible distance value through the display unit, speaker, etc. of the driver's seat. Thus, the driver can objectively grasp the external situation and can reflect it in the driving of the railway vehicle 5.

[0051] Figure 5 1 is a flowchart showing an example of processing by the first visible distance processing unit 11 of the present embodiment. Here, the first mode will be described as an example.

[0052] like Figure 5 As shown, first, the camera 111 captures an image (step S11). Then, the line detection unit 112 detects the line R100 from the image (step S12). Then, the first visible distance calculation unit 113 calculates the length of the line R100 detected by the line detection unit 112 (step S13). Then, the first visible distance calculation unit 113 calculates the difference between the first reference length and the calculated length of the line R100 (step S14), and calculates the first visible distance value based on the difference (step S15).

[0053] As described above, the control processing device 10 of the present embodiment captures the line R100, detects the line R100 from the image with the same reference, and calculates the first visible distance value based on the length of the line R100 in the image. The line R100 is of the same size and homogeneity regardless of the position. Therefore, if the line R100 is detected from the image with the same detection reference such as the size of the difference value, the length of the line R100 changes according to the external environment such as the concentration of the fog. Therefore, by comparing the length of the line R100 detected from the image with the length of the reference value, the first visible distance value can be obtained with higher accuracy. In particular, the length of the line R100 in the captured image is highly similar to the visual field limit of the driver's naked eye, so it is easy to set the reference for detecting the line R100 in a manner closer to the visual field limit of the naked eye. As a result, the first visible distance value closer to the visual field limit of the naked eye can be obtained.

[0054] (Second Embodiment)

[0055] The control processing device 10 of the second embodiment is different from the control processing device 10 of the first embodiment in that it further includes a second visible distance processing unit 13 that calculates a second visible distance value based on received radio waves. The differences from the control processing device 10 of the first embodiment will be described below.

[0056] Figure 6 1 is a block diagram showing an example of the configuration of the control processing device 10 according to the second embodiment. Figure 6 As shown, the control processing device 10 of the second embodiment further includes a second visible distance processing unit 13. The second visible distance processing unit 13 calculates a second visible distance value based on the attenuation of the received radio wave. The second visible distance processing unit 13 includes an irradiation unit 131, a receiving unit 132, and a second visible distance calculation unit 133. The irradiation unit 131 irradiates millimeter waves or lasers. The irradiation unit 131 irradiates millimeter waves or lasers, for example, when the railway vehicle 5 becomes a reference position based on an indication signal of the driving position information collection device 20. In front of the reference position, a measurement object with a known reflectivity and a position at a known distance from the reference position is pre-set.

[0057] The receiving unit 132 receives the reflected light of the millimeter wave or the laser. The second visible distance calculation unit 133 calculates the second visible distance value based on the attenuation of the received signal received by the receiving unit 132 within a specified time. For example, a preliminary experiment is conducted in advance according to the relative humidity classification or the fog concentration classification, and the second visible distance calculation unit 133 uses the measured data to calculate the second visible distance value. That is, the second visible distance calculation unit 133 performs the calculation of reducing the second visible distance value as the attenuation of the received signal increases. The second visible distance calculation unit 133 is not affected by the amount of light from the outside world, so it can be measured in a dark place even without illumination light.

[0058] When using laser, the second visible distance calculation unit 133 can measure the distance to the measured object based on ToF (Time of Flight). It is known that the distance to the measured object varies according to the humidity. Therefore, the second visible distance calculation unit 133 can also calculate the second visible distance value according to the distance to the measured object. In this case, a preliminary experiment is performed in advance according to the relative humidity classification or the fog concentration classification, and the second visible distance calculation unit 133 uses the measurement data to calculate the second visible distance value. That is, the second visible distance calculation unit 133 performs the calculation of reducing the second visible distance value as the distance to the measured object becomes smaller. In this case, the second visible distance calculation unit 133 is not affected by the amount of light from the outside world, so it can be measured in the dark even without shooting light.

[0059] The storage unit 121 stores the visible distance calculated by the second visible distance calculation unit 133 in association with the time and the measurement position. The visible distance determination unit 122 of this embodiment can complementarily determine and generate a visible distance value based on the first visible distance value calculated by the first visible distance processing unit 11 and the second visible distance value calculated by the second visible distance processing unit 13.

[0060] For example, the visible distance determination unit 122 generates the visible distance value based on the second visible distance value calculated by the second visible distance processing unit 13 at night or in a dark place, and in a time period or place where the detection accuracy of the first visible distance processing unit 11 is reduced. Alternatively, when the line detection unit 112 cannot detect the line R100, the visible distance determination unit 122 generates the visible distance value based on the second visible distance value calculated by the second visible distance processing unit 13. In this case, even at night, etc., the visible distance value can be generated with higher accuracy.

[0061] On the other hand, when the line detection unit 112 can detect the line R100, the visible distance value is generated based on the first visible distance value. In this case, the visible distance value can be generated even at a position other than the reference position.

[0062] Figure 7 1 is a flowchart showing an example of processing by the control processing device 10 according to the present embodiment. Here, an example of the first mode will be described.

[0063] like Figure 7 As shown, steps S11, 13, 14, and 15 are performed in the same manner as Figure 5 Same processing. On the other hand, the line detection unit 112 of the present embodiment performs a detection accuracy determination process (step S12a) after performing a process of detecting the line R100 from the image. For example, when the line detection unit 112 cannot detect the line R100 due to conditions such as nighttime, it outputs an error signal to the visible distance determination unit 122 (No in step S12a). On the other hand, when the line detection unit 112 can detect the line R100 from the image (Yes in step S12a), it outputs the information of the detected line R100 to the first visible distance calculation unit 113. Thus, the first visible distance processing unit 11 performs the processes of steps S13 to S15.

[0064] On the other hand, when the irradiation unit 131 of the second visible distance processing unit 13 reaches the reference position, it irradiates the millimeter wave or laser forward (step S16). Then, the receiving unit 132 receives the reflected light of the millimeter wave or laser (step S17). The second visible distance calculation unit 133 calculates the second visible distance value based on the attenuation of the received signal received by the receiving unit 132 within a specified time (step S18).

[0065] As described above, the control processing device 10 of the present embodiment generates a visible distance value by complementarily using the first visible distance value generated by the first visible distance processing unit 11 and the second visible distance value generated by the second visible distance processing unit 13 using millimeter waves or lasers. Thus, by using the visible distance value generated by the second visible distance processing unit 13 in a time period or place where the generation accuracy of the first visible distance processing unit 11 is reduced, it is possible to suppress the reduction in the measurement accuracy of the visible distance value.

[0066] (Third Embodiment)

[0067] The control processing device 10 of the third embodiment is different from the control processing device 10 of the second embodiment in that it further includes an image processing unit 140 that performs image processing according to the visible distance value. The differences from the control processing device 10 of the second embodiment will be described below.

[0068] Figure 8 1 is a block diagram showing an example of the configuration of the control processing device 10 according to the third embodiment. Figure 8As shown, the control processing device 10 of the third embodiment further includes an image processing unit 140. The image processing unit 140 performs image processing corresponding to the visible distance value generated by the visible distance determination unit 122 on the image captured by the camera 111. For example, the image processing unit 140 performs image processing that increases the intensity of the defogging process on the image captured by the camera 111 as the visible distance value decreases. For example, the distribution of the brightness value of the human body map (Japanese: ヒトグラム) relative to the image captured by the camera 111 is changed to a distribution in which the concentration of fog, etc. is reduced. The image processing unit 140 increases the degree of this change as the visible distance value decreases. Alternatively, the image processing unit 140 performs a sharpening process that emphasizes the contrast. In this case, the image processing unit 140 also increases the intensity of the sharpening as the visible distance value decreases.

[0069] The obstacle sensing device 30 senses obstacles using, for example, an image obtained by changing the distribution of the human body map according to the visible distance by the image processing unit 140. In this case, the detection accuracy of the obstacle sensing device 30 is improved. As a result, the generation accuracy of the warning signal generated by the obstacle sensing device 30 is also improved.

[0070] Fig. 9 1 is a flowchart showing an example of processing by the control processing device 10 of the third embodiment. Fig. 9 As shown, the image processing unit 140 obtains the visible distance value generated by the visible distance determination unit 122 and the image captured by the camera 111 (step S21). Next, the image processing unit 140 performs image processing according to the visible distance value on the image captured by the camera 111 (step S22).

[0071] As described above, the image processing unit 140 of the control processing device 10 of the present embodiment performs image processing of the defogging process corresponding to the visible distance value generated by the visible distance determination unit 122 on the image captured by the camera 111. Thus, the image processing unit 140 can perform image processing corresponding to the visible distance value, and thus can perform image processing suitable for the processing intensity.

[0072] (Fourth Embodiment)

[0073] The control processing device 10 of the fourth embodiment is different from the control processing device 10 of the third embodiment in that it further includes a rainfall processing unit 14. The differences from the control processing device 10 of the third embodiment will be described below.

[0074] Fig.10 1 is a block diagram showing an example of the configuration of the control processing device 10 according to the fourth embodiment. Fig.10As shown, the control processing device 10 of the fourth embodiment further includes a rain processing unit 14. The rain processing unit 14 generates rain. The rain processing unit 14 includes a water drop sensor 141 and a rain calculation unit 142. The water drop sensor 141 detects the amount of water droplets in a specified area per unit time. The rain calculation unit 142 calculates the rain based on the amount of water droplets measured by the water drop sensor 141. The visible distance also changes according to the rain. Therefore, the control processing device 10 of this embodiment can correct the visible distance value according to the rain.

[0075] That is, the first visible distance calculation unit 113 corrects the first visible distance value based on the rainfall calculated by the rainfall calculation unit 142. The control processing device 10 obtains the first correction data indicating the relationship between the rainfall and the first visible distance value through a preliminary experiment in advance, and stores it in the storage unit 121. Thus, the first visible distance calculation unit 113 can correct the first visible distance value based on the rainfall calculated by the rainfall calculation unit 142 and the first correction data. Similarly, the second visible distance calculation unit 133 corrects the second visible distance value based on the rainfall calculated by the rainfall calculation unit 142. The control processing device 10 obtains the second correction data indicating the relationship between the rainfall and the second visible distance value through a preliminary experiment in advance, and stores it in the storage unit 121. Thus, the second visible distance calculation unit 133 can correct the second visible distance value based on the rainfall calculated by the rainfall calculation unit 142 and the second correction data. The visible distance determination unit 122 generates a final visible distance value based on the corrected first visible distance value and the second visible distance value.

[0076] Fig.11 4 is a flowchart showing a processing example of the control processing device 10 of the fourth embodiment. Fig.11 As shown, the water drop sensor 141 detects the amount of water drops (step S31). Next, the rain calculation unit 142 calculates the amount of water drops within a specified time (step S32). Then, the rain calculation unit 142 determines whether the amount of water drops within the specified time exceeds a threshold value (step S33). If the amount of water drops within the specified time is less than the threshold value, the rain calculation unit 142 determines that it is not rainfall (No in step S33), and repeats the process from step S31.

[0077] On the other hand, when the amount of water drops within the predetermined time is equal to or greater than the threshold value (Yes in step S33), the rainfall calculation unit 142 determines that it is rainfall (step S34). Next, the rainfall calculation unit 142 calculates the rainfall amount based on the amount of water drops (step S35).

[0078] The first visible distance calculation unit 113 corrects the first visible distance value based on the rainfall calculated by the rainfall calculation unit 142. Similarly, the second visible distance calculation unit 133 corrects the second visible distance value based on the rainfall calculated by the rainfall calculation unit 142. The visible distance determination unit 122 generates a final visible distance value based on the corrected first visible distance value and the second visible distance value (step S36).

[0079] As described above, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 of the control processing device 10 of the present embodiment perform correction according to the rainfall calculated by the rainfall processing unit 14. Thus, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 can perform correction according to the rainfall, and thus can generate a visible distance value that suppresses the influence of the rainfall.

[0080] (Fifth Embodiment)

[0081] The control processing device 10 of the fifth embodiment is different from the control processing device 10 of the fifth embodiment in that it further includes a wind speed processing unit 15. The differences from the control processing device 10 of the fourth embodiment will be described below.

[0082] Fig.12 1 is a block diagram showing an example of the configuration of the control processing device 10 according to the fifth embodiment. Fig.12 As shown, the control processing device 10 of the fifth embodiment further includes a wind speed processing unit 15. The wind speed processing unit 15 generates wind speed. The wind speed processing unit 15 includes an air volume sensor 151 and a wind speed calculation unit 152. The air volume sensor 151 detects the air volume per unit time. The wind speed calculation unit 152 calculates the wind speed based on the air volume per unit time of the air volume sensor 151. The visible distance also changes according to the wind speed. Therefore, the control processing device 10 of this embodiment can correct the visible distance value according to the wind speed.

[0083] That is, the first visible distance calculation unit 113 corrects the first visible distance value based on the wind speed calculated by the wind speed calculation unit 152. The control processing device 10 obtains the third correction data indicating the relationship between the wind speed and the first visible distance value through a preliminary experiment in advance, and stores it in the storage unit 121. Thus, the first visible distance calculation unit 113 can correct the first visible distance value based on the wind speed calculated by the wind speed calculation unit 152 and the third correction data. Similarly, the second visible distance calculation unit 133 corrects the second visible distance value based on the wind speed calculated by the wind speed calculation unit 152. The control processing device 10 obtains the fourth correction data indicating the relationship between the wind speed and the second visible distance value through a preliminary experiment in advance, and stores it in the storage unit 121. Thus, the second visible distance calculation unit 133 can correct the second visible distance value based on the wind speed calculated by the rainfall calculation unit 142 and the fourth correction data. The visible distance determination unit 122 generates a final visible distance value based on the corrected first visible distance value and the second visible distance value.

[0084] Fig.13 1 is a flowchart showing an example of processing by the control processing device 10 of the fifth embodiment. Fig.11 As shown, the wind speed calculation unit 152 calculates the wind speed based on the wind volume per unit time measured by the wind volume sensor 151. (Step S51) The first visible distance calculation unit 113 corrects the first visible distance value based on the wind speed calculated by the wind speed calculation unit 152. Similarly, the second visible distance calculation unit 133 corrects the second visible distance value based on the wind speed calculated by the wind speed calculation unit 152. The visible distance determination unit 122 generates a final visible distance value based on the corrected first visible distance value and the second visible distance value (Step S52).

[0085] As described above, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 of the control processing device 10 of the present embodiment perform correction according to the wind speed calculated by the wind speed calculation unit 152. Thus, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 can perform correction according to the wind speed, and thus can generate a visible distance value that suppresses the influence of the wind speed.

[0086] (Sixth Embodiment)

[0087] The control processing device 10 of the sixth embodiment is different from the control processing device 10 of the fifth embodiment in that it further includes a speed processing unit 16. The differences from the control processing device 10 of the fifth embodiment will be described below.

[0088] Fig.14 1 is a block diagram showing an example of the configuration of the control processing device 10 according to the sixth embodiment. Fig.14As shown in FIG. 1 , the control processing device 10 of the sixth embodiment further includes a speed processing unit 16 . The speed processing unit 16 can correct the wind speed calculated by the wind speed calculation unit 152 and the rainfall calculated by the rainfall processing unit 14 .

[0089] The speed processing unit 16 includes an acceleration sensor 161 and a speed calculation unit 162. The acceleration sensor 161 detects the acceleration of the railway vehicle 5. The wind speed calculation unit 152 calculates the speed based on the output value of the acceleration sensor 161 which is accumulated over time.

[0090] The rainfall calculated by the rainfall processing unit 14 and the wind speed calculated by the wind speed calculation unit 152 also change according to the speed of the railway vehicle 5. Therefore, the control processing device 10 of this embodiment can correct the rainfall calculated by the rainfall processing unit 14 and the wind speed calculated by the wind speed calculation unit 152 according to the speed of the railway vehicle 5.

[0091] That is, the rainfall calculated by the rainfall processing unit 14 is corrected according to the speed of the railway vehicle 5. The control processing device 10 obtains the fifth correction data indicating the relationship between the speed and rainfall of the railway vehicle 5 in advance through a preliminary experiment, and stores it in the storage unit 121. Thus, the rainfall processing unit 14 can correct the rainfall based on the speed calculated by the speed processing unit 16 and the fifth correction data. The first visible distance calculation unit 113 and the second visible distance calculation unit 133 correct the first visible distance value and the second visible distance value based on the corrected rainfall.

[0092] Similarly, the wind speed calculated by the wind speed calculation unit 152 is corrected according to the speed of the railway vehicle 5. The wind speed calculation unit 152 can correct the wind speed based on the speed calculated by the speed processing unit 16. The first visible distance calculation unit 113 and the second visible distance calculation unit 133 correct the first visible distance value and the second visible distance value based on the corrected wind speed. The visible distance determination unit 122 generates a final visible distance value based on the corrected first visible distance value and the second visible distance value.

[0093] Fig.15 1 is a flowchart showing an example of processing by the control processing device 10 of the sixth embodiment. Fig.15As shown, first, the acceleration sensor 161 measures the acceleration (step S61). The speed processing unit 16 calculates the speed based on the output value of the time-accumulated acceleration sensor 161 (step S62). Next, the rainfall processing unit 14 generates the rainfall corrected according to the speed of the railway vehicle 5. The first visible distance calculation unit 113 and the second visible distance calculation unit 133 further correct the first visible distance value and the second visible distance value based on the corrected rainfall. Similarly, the wind speed calculation unit 152 generates the wind speed corrected according to the speed of the railway vehicle 5. The first visible distance calculation unit 113 and the second visible distance calculation unit 133 further correct the first visible distance value and the second visible distance value based on the corrected wind speed (step S63).

[0094] As described above, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 of the control processing device 10 of the present embodiment perform corrections according to the amount of rain corrected according to the speed of the railway vehicle 5. Similarly, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 perform corrections according to the wind speed corrected according to the speed of the railway vehicle 5. Thus, the first visible distance calculation unit 113 and the second visible distance calculation unit 133 can perform corrections according to the amount of rain and the wind speed corrected according to the speed of the railway vehicle 5, and thus can generate a visible distance value that suppresses the influence of the speed of the railway vehicle 5, the wind speed, and the amount of rain.

[0095] In addition, the above-mentioned embodiments can be summarized into the following technical solutions.

[0096] (Technical Solution 1)

[0097] A control processing device comprises: an image acquisition unit for obtaining a captured image of a traveling direction of a railway vehicle; a line detection unit for detecting a line in the traveling direction of the railway vehicle in the captured image according to a prescribed reference; and a first visible distance calculation unit for calculating a first visible distance value related to the visible distance based on the length of the detected line.

[0098] (Technical Solution 2)

[0099] According to the control processing device according to claim 1, the first visible distance calculation unit increases the first visible distance value as the length of the detected line becomes longer.

[0100] (Technical Solution 3)

[0101] According to the control processing device according to claim 1, the first visible distance calculation unit calculates the first visible distance value based on a difference between the detected line length and a first reference value.

[0102] (Technical Solution 4)

[0103] According to the control processing device according to claim 1, the first visible distance calculation unit calculates the first visible distance value based on a difference between the detected line length and a second reference value that varies according to the position of the railway vehicle.

[0104] (Technical Solution 5)

[0105] The control processing device according to any one of claims 1 to 4 further comprises: an irradiation unit that irradiates an irradiation wave of either a millimeter wave or a laser; a receiving unit that receives a reflected wave after being reflected from either the millimeter wave or the laser; and a second visible distance calculation unit that calculates a second visible distance value related to the visible distance based on a signal strength of the reflected wave received by the receiving unit within a specified time.

[0106] (Technical Solution 6)

[0107] According to the control processing device according to claim 5, the first visible distance value and the second visible distance value are respectively values ​​of visible distance, and the control processing device further includes a visible distance determination unit, which generates a visible distance value based on at least one of the first visible distance value and the second visible distance value.

[0108] (Technical Solution 7)

[0109] According to the control processing device of claim 6, the visible distance determination unit makes a determination to select at least one of the first visible distance value and the second visible distance value based on the detection result of the line detection unit.

[0110] (Technical Solution 8)

[0111] According to the control processing device of claim 7, the visible distance determination unit makes a determination to select one of the first visible distance value and the second visible distance value based on at least one of external illuminance and time.

[0112] (Technical Solution 9)

[0113] The control processing device according to claim 7 further comprises a control unit configured to change the control processing of the railway vehicle according to the visible distance value.

[0114] (Technical Solution 10)

[0115] According to the control processing device according to claim 9, the control unit changes at least one of a braking distance and a speed of the railway vehicle according to the visible distance value.

[0116] (Technical Solution 11)

[0117] The control processing device according to claim 7, further comprising an image processing unit configured to change image processing to be performed on the captured image in accordance with the visible distance value.

[0118] (Technical Solution 12)

[0119] According to the control processing device according to claim 11, the image processing is a defogging process, and the intensity of the defogging process is increased as the visible distance value becomes shorter.

[0120] (Technical Solution 13)

[0121] The control processing device according to claim 6, further comprising a rainfall processing unit that generates rainfall, and the first visible distance calculation unit and the second visible distance calculation unit respectively correct the first visible distance value and the second visible distance value based on the rainfall.

[0122] (Technical Solution 14)

[0123] The control processing device according to claim 6 further comprises a wind speed processing unit, wherein the wind speed processing unit generates a wind speed, and the first visible distance calculation unit and the second visible distance calculation unit respectively correct the first visible distance value and the second visible distance value based on the wind speed.

[0124] (Technical Solution 15)

[0125] The control processing device according to claim 13 further comprises a speed processing unit, the speed processing unit generates the speed of the railway vehicle, the rainfall processing unit corrects the rainfall according to the speed of the railway vehicle, and the first visible distance calculation unit and the second visible distance calculation unit each generate the first visible distance value and the second visible distance value according to the corrected rainfall.

[0126] (Technical Solution 16)

[0127] The control processing device according to claim 14 further includes a speed processing unit, which generates the speed of the railway vehicle, the wind speed processing unit corrects the wind speed according to the speed of the railway vehicle, and the first visible distance calculation unit and the second visible distance calculation unit each generate the first visible distance value and the second visible distance value according to the corrected wind speed.

[0128] (Technical Solution 17)

[0129] A control processing method comprises: an image acquisition step for obtaining a captured image of a traveling direction of a railway vehicle; a line detection step for detecting a line in the traveling direction of the railway vehicle in the captured image according to a prescribed reference; and a first visible distance calculation step for calculating a first visible distance value related to the visible distance based on the length of the detected line.

[0130] (Technical Solution 18)

[0131] A control processing system comprises: a control processing device; and an obstacle sensing device, which senses obstacles based on a line, wherein the control processing device comprises: an image acquisition unit, which obtains a captured image of a traveling direction of a railway vehicle; a line detection unit, which detects the line in the traveling direction of the railway vehicle in the captured image according to a prescribed reference; and a first visible distance calculation unit, which calculates a first visible distance value related to the visible distance based on the length of the detected line.

[0132] (Technical Solution 19)

[0133] According to the control processing system according to claim 18, the obstacle sensing device changes the warning signal according to whether the position of the sensed obstacle is closer to the railway vehicle side than the first visible distance value.

[0134] (Technical Solution 20)

[0135] The control processing system according to claim 19 further comprises a travel position information collecting device, wherein the travel position information collecting device detects the position of the railway vehicle, and the first visible distance calculating unit changes a calculation method of the first visible distance value according to the position of the railway vehicle.

[0136] So far, several embodiments of the present invention have been described, but these embodiments are presented as examples and are not intended to limit the scope of the invention. These new embodiments can be implemented in various other ways, and various omissions, substitutions, and changes can be made without departing from the scope of the subject matter of the invention. These embodiments and their variations are included in the scope and subject matter of the invention, and are included in the invention described in the claims and the scope of their equivalents.

Claims

1. A control processing device, comprising: An image acquisition unit that acquires a photographed image of a traveling direction of a railway vehicle; a track detection unit that detects a track in the direction in which the railway vehicle is traveling in the captured image according to a predetermined reference; and The first visible distance calculation unit calculates a first visible distance value related to the visible distance based on the detected length of the line.

2. The control processing device according to claim 1, The first visible distance calculation unit increases the first visible distance value as the length of the detected line becomes longer.

3. The control processing device according to claim 1, The first visible distance calculation unit calculates the first visible distance value based on a difference between the detected line length and a first reference value.

4. The control processing device according to claim 1, The first visible distance calculation unit calculates the first visible distance value based on a difference between the detected link length and a second reference value that varies according to a position of the railway vehicle.

5. The control processing device according to any one of claims 1 to 4, further comprising: An irradiation unit that irradiates an irradiation wave of either a millimeter wave or a laser; a receiving unit that receives a reflected wave after any one of the millimeter wave and the laser is reflected; and The second visible distance calculation unit calculates a second visible distance value related to the visible distance based on the signal strength of the reflected wave received by the receiving unit within a predetermined time.

6. The control processing device according to claim 5, The first visible distance value and the second visible distance value are respectively values ​​of visible distances, The control processing device further includes a visible distance determination unit configured to generate a visible distance value based on at least one of the first visible distance value and the second visible distance value.

7. The control processing device according to claim 6, The visible distance determination unit determines to select at least one of the first visible distance value and the second visible distance value based on the detection result of the line detection unit.

8. The control processing device according to claim 7, The visible distance determination unit determines whether to select the first visible distance value or the second visible distance value based on at least one of external illuminance and time.

9. The control processing device according to claim 7, The invention further includes a control unit configured to change a control process of the railway vehicle according to the visibility distance value.

10. The control processing device according to claim 9, The control unit changes at least one of a braking distance and a speed of the railway vehicle according to the visible distance value.

11. The control processing device according to claim 7, The device further includes an image processing unit configured to change image processing to be performed on the captured image in accordance with the visible distance value.

12. The control processing device according to claim 11, The image processing is a defogging process, and as the visible distance value becomes shorter, the intensity of the defogging process is increased.

13. The control processing device according to claim 6, The device further comprises a rainfall processing unit, wherein the rainfall processing unit generates rainfall. The first visible distance calculation unit and the second visible distance calculation unit correct the first visible distance value and the second visible distance value, respectively, according to the rainfall amount.

14. The control processing device according to claim 6, The device further comprises a wind speed processing unit, wherein the wind speed processing unit generates a wind speed. The first visible distance calculation unit and the second visible distance calculation unit respectively correct the first visible distance value and the second visible distance value according to the wind speed.

15. The control processing device according to claim 13, further comprising a speed processing unit for generating a speed of the railway vehicle, The rainfall processing unit corrects the rainfall according to the speed of the railway vehicle. The first visible distance calculation unit and the second visible distance calculation unit generate the first visible distance value and the second visible distance value respectively according to the corrected rainfall amount.

16. The control processing device according to claim 14, further comprising a speed processing unit for generating a speed of the railway vehicle, The wind speed processing unit corrects the wind speed according to the speed of the railway vehicle. The first visible distance calculation unit and the second visible distance calculation unit generate the first visible distance value and the second visible distance value respectively according to the corrected wind speed.

17. A control processing method, comprising: An image acquisition step of acquiring an image taken in the traveling direction of the railway vehicle; a route detection step of detecting a route in the direction in which the railway vehicle is traveling in the captured image according to a predetermined reference; and The first visible distance calculation step calculates a first visible distance value related to the visible distance based on the detected line length.

18. A control processing system comprising: controlling the processing device; and Obstacle sensing device, based on line sensing obstacles, The control processing device comprises: An image acquisition unit that acquires a photographed image of a traveling direction of a railway vehicle; a track detection unit that detects the track in the direction in which the railway vehicle is traveling in the captured image according to a predetermined reference; as well as The first visible distance calculation unit calculates a first visible distance value related to the visible distance based on the detected length of the line.

19. The control processing system according to claim 18, The obstacle sensing device changes the warning signal according to whether the position of the sensed obstacle is closer to the railway vehicle than the first visible distance value.

20. The control processing system according to claim 19, The vehicle further comprises a travel position information collecting device, wherein the travel position information collecting device detects the position of the railway vehicle. The first visible distance calculation unit changes a calculation method of the first visible distance value according to the position of the railway vehicle.