Obstacle detection system

The obstacle detection system in rail transportation systems addresses detection challenges by using past track information to pre-determine ROIs, enhancing accuracy and reducing processing time for obstacle detection.

WO2025263103A1PCT designated stage Publication Date: 2025-12-26HITACHI LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2025/015249
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-21
Filing Date
2025-04-18
Publication Date
2025-12-26

AI Technical Summary

Technical Problem

Existing obstacle detection systems in rail transportation face challenges in detecting small objects due to computational limitations, leading to extended processing times and reduced detection accuracy, especially when high-resolution images are resized for real-time processing.

Method used

An obstacle detection system that includes a track detection unit, an ROI processing unit, and an object detection unit, which utilizes past track information to pre-determine ROI regions for image processing, allowing simultaneous detection of objects at various distances and reducing processing time by using previous cycle's track information for short-distance ROIs.

Benefits of technology

The system enhances obstacle detection performance by selecting appropriate ROIs, thereby reducing processing time and improving detection accuracy for both short and long-range objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025015249_26122025_PF_FP_ABST
    Figure JP2025015249_26122025_PF_FP_ABST
Patent Text Reader

Abstract

The purpose of this invention is to reduce the time required for image processing-based obstacle detection processing while selecting an appropriate ROI in order to improve obstacle detection performance in an obstacle detection system mounted on a track transportation system. This obstacle detection system comprises: a track detection unit that detects track information from data of an external sensor for recognizing the environment around a train; an ROI processing unit that cuts out, from the track information, a region of interest to be subjected to object detection processing; and an object detection unit that detects an object. The obstacle detection system is characterized by including a track information recording unit that records the track information detected by the track detection unit, and by the ROI processing unit changing the track information used for cutting out the region of interest on the basis of information about either the size of the region of interest or the track shape ahead of the train.
Need to check novelty before this filing date? Find Prior Art

Description

Obstacle Detection System

[0001] The present invention relates to an obstacle detection system mounted on a rail transportation system that travels on a fixed track.

[0002] In rail transport systems, where transport vehicles travel on a track, detecting obstacles on the track is important for improving the safety and operability of rail transport systems, since obstacles on the track cannot be avoided by steering. In recent years, research has been conducted on obstacle detection support systems that use external sensors such as millimeter-wave radar, laser radar, and cameras to detect obstacles on the track and support the driver by notifying the driver of the detection results. One example of detecting obstacles on the track using external sensors is obstacle detection using cameras and image processing. As a technology for recognizing and detecting objects using image processing, there is general object recognition technology, whose accuracy has rapidly improved in recent years thanks to deep learning. However, general object recognition technology tends to have a lower detection accuracy for objects with a small number of pixels in the image.

[0003] Generic object recognition technology has difficulty detecting objects with a small number of pixels in an image. Due to limitations in the computational cost of real-time processing, the input image size for generic object recognition technology is limited to a certain size, such as 608 x 608 or 416 x 416. Therefore, even if a high-resolution image is captured, it will be reduced in size when input to generic object recognition technology.

[0004] When the image is reduced, it becomes difficult to detect objects with a small number of pixels, such as obstacles at a distance. To detect objects with a small number of pixels, one possible solution is to set a specific region within the image as a ROI (Region of Interest) and process only the ROI. That is, the extracted ROI is enlarged or reduced to an input image size such as 608 x 608 or 416 x 416. However, since the area outside the ROI is not processed, it is necessary to select the coordinates and size of the ROI appropriately in order to achieve the objective of obstacle detection.

[0005] Patent Document 1 discloses the following technology for the purpose of providing a system for detecting objects in an image at high speed and with high accuracy: "In a system 10 for detecting obstacles within a structure gauge, an auxiliary storage device 113 includes an image acquisition unit 101 that acquires images captured from a mobile object moving on a track, a track detection unit 103 that detects the track in the image, an ROI processing unit 106 that determines the width of the track at a reference ordinate value selected in the image, determines the size of a region of interest in the image based on the track width and a coefficient, and determines the position coordinates in the image of the region of interest based on the selected ordinate value and the detected track, and an obstacle detection unit 107 that executes object detection processing in the region of interest at the determined position coordinates."

[0006] Japanese Patent Application Laid-Open No. 2023-34917

[0007] The obstacle detection system detects obstacles on the track and outputs a brake operation request to avoid collisions. Therefore, the shorter the processing time required for obstacle detection, the more likely it is that the train will run at a speed that avoids collisions with obstacles. As a result, the time required for travel between stations can be reduced, achieving both safety and convenience. However, the technology described in Patent Document 1 selects an ROI based on track information, and therefore obstacle detection by image processing cannot begin until track detection processing, which identifies the track position on the image, is complete. It is generally known that track detection processing by image processing imposes a high computational load. This poses a problem of extending the time required for obstacle detection processing by image processing.

[0008] In order to address the above-mentioned problems, the present invention aims to reduce the time required for obstacle detection processing using image processing in an obstacle detection system installed in a rail transportation system, while selecting an appropriate ROI to improve obstacle detection performance.

[0009] In order to solve the above-mentioned problems, one representative obstacle detection system of the present invention is an obstacle detection system comprising a track detection unit that detects track information from data from external sensors that recognize the environment around the train, an ROI processing unit that extracts a region of interest to be subjected to object detection processing from the track information, and an object detection unit that detects objects, and is characterized by comprising a track information recording unit that records the track information detected by the track detection unit, and the ROI processing unit that changes the track information used to extract the region of interest based on information on either the size of the region of interest or the shape of the track ahead of the train.

[0010] According to the present invention, in an obstacle detection system installed in a rail transportation system, it is possible to select an appropriate ROI to improve obstacle detection performance while reducing the time required for obstacle detection processing using image processing.

[0011] Problems, configurations, and effects other than those described above will become apparent from the following description of the embodiments.

[0012] FIG. 1 is a diagram showing the configuration of an obstacle detection system in a first embodiment of the present invention. FIG. 2 is a diagram schematically showing an example of an input image. FIG. 3 is a flowchart showing processing executed by an ROI processing unit in the first embodiment of the present invention. FIG. 4 is a diagram showing the relationship between an input image from an external sensor and an ROI cut-out image. FIG. 5 is a diagram showing how the track appears for each calculation cycle when a train is traveling in a curved section. FIG. 6 is a flowchart showing processing executed by an ROI processing unit in a second embodiment of the present invention. FIG. 7 is a diagram schematically showing a method for determining straight sections and curved sections in the second embodiment of the present invention.

[0013] Hereinafter, an embodiment will be described with reference to the drawings.

[0014] The configuration of an obstacle detection system according to a first embodiment of the present invention will be described with reference to FIGS. 1 and 2. FIG.

[0015] 1 is a diagram showing the configuration of an obstacle detection system. The obstacle detection system comprises an external sensor 110 mounted on a train 100 and capable of sensing the external environment, and an obstacle detection device 120 capable of detecting obstacles ahead of the train 100. The obstacle detection device 120 comprises a track detection unit 121 that detects track information (track information) on the track along which the train 100 is traveling based on sensor information from the external sensor 110, a track information recording unit 122 that records the track information detected by the track detection unit 121 in chronological order, an ROI processing unit 123 that determines an ROI based on the track information from the track detection unit 121 and past track information from the track information recording unit 122 and generates an image in which one or more ROI regions are cut out from an input image, and an object detection unit 124 that detects objects based on the ROI region cut-out image from the ROI processing unit 123.

[0016] An object detected by the object detection unit 124 is determined to be an obstacle if its three-dimensional position is near the track detected by the track detection unit 121. When the obstacle detection device 120 detects an obstacle near the track, it determines whether or not it is necessary to immediately issue a brake operation request based on the current train speed. When there is an obstacle ahead of the train and immediate brake operation is required, the obstacle detection device 120 outputs a brake operation request to a safety device (not shown) or a driver (not shown).

[0017] The external sensor 110 senses the conditions around the train 100 (particularly ahead) and transmits the sensing data to the track detection unit 121 and the ROI processing unit 123. The external sensor 110 includes a camera, a LIDAR (laser range finder), a millimeter-wave radar, etc. The camera includes a monocular camera, a stereo camera, an infrared camera, etc. It is common for multiple sensors to be mounted for redundancy. When the train 100 moves forward in the direction of travel, the external sensor installed in the leading car on the side facing the direction of travel is used. In this embodiment, a case will be described in which a camera is used as the external sensor.

[0018] 2 is a diagram schematically illustrating an example of an input image. The input image 200 includes a track 210 extending forward from the train 100. The track 210 includes a left rail 211 and a right rail 212, which define the width of the track 210. The upper left corner of the input image 200 is the origin, with the vertical direction being the v coordinate and the horizontal direction being the u coordinate.

[0019] The track detection unit 121 detects the track on which the train 100 is traveling from the input image. Track detection may be performed by image processing, or the coordinates of the track in the input image may be calculated from GNSS (Global Navigation Satellite System) or map data. For example, a track over a long distance that cannot be detected by a camera may be calculated from GNSS or map data. Specific methods for detecting rails using image processing include a method of searching for rails using brightness gradient information in an image and a method of detecting rails using semantic segmentation using DNN. In the present invention, the method is not critical as long as the rails can be detected. Because the track extends from the front end of the train 100, it can be easily detected by comparing it with obstacles, etc. The track coordinates indicate, for example, the center line between the left and right rails. The upper left corner of the input image is the origin, and the vertical direction is the v coordinate and the horizontal direction is the u coordinate. The track coordinates indicate the u coordinate and v coordinate of each point on the center line. For example, the v coordinate value increases from top to bottom of the image, and the u coordinate value increases from left to right.

[0020] The trajectory information recording unit 122 records the trajectory information detected by the trajectory detection unit 121. The trajectory information recording unit 122 transmits to the ROI processing unit 123 the trajectory information detected by the trajectory detection unit 121 one cycle before the current calculation cycle.

[0021] The ROI processing unit 123 generates one or more ROI clipped images, which serve as input images for object detection processing using image processing, from the track information for the current calculation cycle received from the track detection unit 121, the track information for the previous calculation cycle received from the track information recording unit 122, and the input image from the external sensor 110. The generated ROI clipped images are sent to the object detection unit 124. Note that although this embodiment describes an example in which multiple ROI regions are defined, a single ROI region may also be used. For example, if the speed of the train 100 is slow, an ROI region may be defined only for a short distance. The number of ROI regions defined may be any number, as long as it corresponds to the region in which an object is desired to be detected (focused on).

[0022] The object detection unit 124 performs object detection using the ROI cropped image received from the ROI processing unit 123. Object detection processing using image processing includes a method of creating a parallax image using a stereo camera and detecting an object ahead from the parallax image, and a method of detecting an object within an image using a DNN. A DNN is one of the methods used in machine learning, and detects various objects by extracting and learning the features of the objects. Methods other than those described above may also be used for object detection processing using image processing, and the present invention does not limit the method.

[0023] Next, the processing of the ROI processing unit 123 according to the first embodiment of the present invention will be described with reference to Fig. 3 to Fig. 5. In the first embodiment, an example will be described in which there are two ROI regions, one for long distances and one for short distances, but as mentioned above, the number of ROI regions is not important.

[0024] FIG. 3 is a flowchart showing the processing executed by the ROI processing unit 123.

[0025] Step 301: An image is received as sensor information from the external sensor 110. The input image is, for example, an image as shown in Fig. 2. The process proceeds to step 302.

[0026] Step 302: Determine the ROI region. Figure 4 shows the relationship between the entire input image 400 from the external sensor and the ROI cropped image. To perform object detection using image processing across all distances, from close to long distances, it is necessary to define ROI regions of various sizes. For example, when detecting close-range objects, the detection target occupies a larger proportion of the image. Furthermore, even for objects located at the same distance from the center of trajectory in the real world, the deviation (number of pixels) from the center of trajectory is greater at close range than at long range. Therefore, a larger ROI region 401 must be defined to detect close-range objects. On the other hand, even for objects of the same size in the real world, the number of pixels is smaller at long range than at close range. In such cases, object detection performance can be improved by cropping out the region near the detection target and generating a pseudo-long-range image (increasing the number of pixels). Therefore, a smaller ROI region 402 must be defined to detect long-range objects. In step 302, it is determined whether the ROI to be extracted is for a short distance (large ROI) or a long distance (small ROI).

[0027] Step 303: If the ROI region to be extracted is for a short distance, proceed to step 304; if the ROI region to be extracted is for a long distance, proceed to step 305.

[0028] Step 304: If the ROI region is for short distances, track information from one cycle before the current calculation cycle is obtained from the track information recording unit 122 as track information to be used in the ROI determination process. Figure 5 shows how the track appears for each calculation cycle when the train 100 is traveling on a curved section. Compared to track 510 from one cycle before the current calculation cycle, track 520 in the current calculation cycle is observed such that the distant track 520 is further away from the center of the input screen 500 as the train approaches the curved section. ROI 512 is for short distances and ROI 513 is for long distances, selected based on information about track 510 from one cycle before the current calculation cycle. ROI 522 is for short distances and ROI 523 is for long distances, selected based on information about track 520 in the current calculation cycle. There is no significant change in the positions of short distance ROIs 512 and 522. On the other hand, the positions of long distance ROIs 513 and 523 change significantly.

[0029] As described above, at short distances, the change in the positions (u, v coordinates) of the trajectory centers 511 and 521 on the image for each calculation cycle is small, and the ROI area is large. Therefore, even if the ROI is determined based on the trajectory information from one calculation cycle before the current calculation cycle, the trajectory will be included in the ROI cropped image. Therefore, even if the ROI cropped image is generated using the trajectory information from one calculation cycle before the current calculation cycle, it is possible to detect objects near the trajectory. Furthermore, because the trajectory information from one calculation cycle before the current calculation cycle is used, there is no need to wait for trajectory information from the trajectory detection unit 121 in the current calculation cycle, and object detection processing using image processing for short distances can begin at the start of the current calculation cycle. Therefore, it is possible to shorten the processing time for object detection processing using image processing. Proceed to step 306.

[0030] In Figure 5, there are parts of the track 520 for the current calculation cycle that are not included in either the short-distance ROI 522 or the long-distance ROI 523. This is an exaggerated representation of the large changes in the positions of the long-distance ROIs 513 and 523 as the train approaches a curved section.

[0031] Step 305: If the ROI region is for long distances, orbit information for the current calculation cycle is obtained from the orbit detection unit 121 as orbit information to be used in the ROI determination process. As shown in Figure 5, at long distances, the positions (u, v coordinates) of the orbit centers 511 and 521 on the image change significantly for each calculation cycle. Furthermore, since the ROI region is small, if the ROI is determined based on orbit information from the previous calculation cycle (long distance ROI 513), the orbit will not be included in the ROI cropped image. Therefore, it is necessary to generate an ROI cropped image corresponding to the ROI (long distance ROI 523) determined using orbit information for the current calculation cycle. Proceed to step 306.

[0032] Step 306: Determine the ROI based on the trajectory information. As described above, when determining an ROI for a short distance, the trajectory information received is the trajectory information from one calculation cycle before the current calculation cycle, and when determining an ROI for a long distance, the trajectory information received is the trajectory information for the current calculation cycle. In the ROI determination process, the v coordinate of the detection start point in the input image (the point on the detected trajectory that is farthest from the vehicle) is determined. When the ROI region to be extracted is for a long distance, the v coordinate of the point farthest from the vehicle in the coordinates of the detected trajectory (coordinates of the trajectory centerline) is set to v1, and the u coordinate of the trajectory corresponding to v1 is set to u1. Using u1 and v1 as references, a predetermined range in the u and v directions is determined as the long-distance ROI. When the ROI region to be extracted is for a short distance, the v coordinate of the bottom edge point on the image in the coordinates of the detected trajectory (coordinates of the trajectory centerline) is set to v2, and the u coordinate of the trajectory corresponding to v2 is set to u2. Using u2 and v2 as references, a predetermined range in the u and v directions is determined as a short-distance ROI.

[0033] Although an example has been described in which the ROI is determined within a fixed range (number of pixels) from the reference u and v coordinates, the range may be dynamically changed. For example, the ROI required for object detection may depend on the required detection accuracy of the object detection model and the clarity of the input image. The clarity of the input image may change depending on the surrounding environment, such as weather or time of day. The ROI may be dynamically changed (enlarged or reduced) depending on these conditions. Furthermore, the v coordinate serving as the reference for the ROI may be defined by a method other than that based on detected trajectory information. For example, the v coordinate may be fixed for short distances, medium distances, and long distances. In the present invention, the u coordinate serving as the reference for the ROI may be defined based on trajectory information, and the method for defining the reference v coordinate is not important.

[0034] Step 307: The input image from the external sensor is extracted based on the determined ROI, and an ROI extracted image is generated.

[0035] Step 308: Determine whether ROI cutout images have been generated for all of the target ROI regions. If ROI cutout images have been generated for all ROI regions, proceed to step 309. If there are ROI regions for which ROI cutout images have not been generated, proceed to step 302.

[0036] Step 309: The generated ROI cut-out image is sent to the object detection unit 124.

[0037] In this embodiment, the trajectory information from one calculation cycle before the current calculation cycle is used to generate a short-distance ROI cutout image, so there is no need to wait for the trajectory information from the trajectory detection unit 121 in the current calculation cycle, and object detection processing by image processing for short distances can start at the same time as the current calculation cycle starts, which makes it possible to shorten the processing time for object detection processing by image processing.

[0038] In this embodiment, the ROI regions are described as two regions, one for long distances and one for short distances. However, as mentioned above, the number of ROI regions is not limited. For example, three ROI regions may be used, one for long distances, one for medium distances, and one for short distances. In this case, it is preferable to use the trajectory information from the trajectory information recording unit 122 from one cycle before the current calculation cycle as the trajectory information used in the ROI determination process for short distances and medium distances, in which the deviation in the trajectory position on the image between the current calculation cycle and the calculation cycle one cycle before the current calculation cycle is considered to be relatively small. In this way, object detection processing using image processing for short distances and medium distances can be performed in parallel with the trajectory detection processing by the trajectory detection unit 121 in the current calculation cycle. This makes it possible to shorten the processing time for object detection processing using image processing, even when the number of ROI cropped images to be processed increases.

[0039] The processing of the ROI processing unit 123 according to the second embodiment of the present invention will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the processing executed by the ROI processing unit 123. In the first embodiment, the size of the ROI region is used as a determination criterion to select the trajectory information to be used for determining the ROI, but in this embodiment, an example will be described in which the trajectory information to be used for determining the ROI is selected according to the trajectory shape.

[0040] Step 601: An image is received as sensor information from the external sensor 110. The input image is, for example, an image as shown in Fig. 2. The process proceeds to step 602.

[0041] Step 602: Determine the track shape ahead of the train 100. The method for determining the track shape will be described later. Proceed to step 603.

[0042] Step 603: If the track shape ahead of the train 100 is straight, proceed to step 604; if the track shape ahead of the train 100 is curved, proceed to step 605.

[0043] Step 604: When the track shape ahead of the train is straight, the amount of change in track coordinates on the image over time (particularly in the u-coordinate direction) is small. Therefore, the difference between the ROI determined based on the track position on the image in the current calculation cycle and the ROI determined based on the track position on the image in the calculation cycle one cycle before the current calculation cycle is also small. Therefore, the ROI cropped image, which is cropped based on the ROI determined based on the track position on the image in the calculation cycle one cycle before the current calculation cycle, includes the area where object detection is desired (near the track). In straight sections, the processing time can be further reduced by using track information from the calculation cycle one cycle before the current calculation cycle to determine the ROIs for short and long distances. Using the reduced time to generate new ROI cropped images and perform image processing can also improve object detection performance through image processing. In step 604, track information from the calculation cycle one cycle before the current calculation cycle is obtained from the track information recording unit 122. Proceed to step 607.

[0044] Step 605: When the track shape ahead of the train is curved, the amount of change in track coordinates on the image over time (especially in the u-coordinate direction) is large, even for short distances. Therefore, there is a large difference between the ROI determined based on the track position on the image in the current calculation cycle and the ROI determined based on the track position on the image in the calculation cycle one cycle before the current calculation cycle. Even for short distances, the ROI cropped based on the ROI determined based on the track position on the image in the calculation cycle one cycle before the current calculation cycle may not include the area where object detection is desired (near the track). Therefore, in curved sections, by using track information for the current calculation cycle in the ROI determination process for short and medium distances, it is possible to ensure that the ROI cropped image includes the area where object detection is desired (near the track). In step 605, track information for the current calculation cycle is obtained from the track detection unit 121. Proceed to step 606.

[0045] Step 606: If the track shape ahead of the train is curved, the image processing-based object detection process takes a long time because track information from the current calculation cycle is used. In curved sections, the influence of trackside structures often makes it impossible to see the track area in the image in the first place. Therefore, by skipping the long-distance object detection process and using track information from the current calculation cycle for the short- and medium-distance ROI determination process, it is possible to shorten the image processing-based object detection process while maintaining object detection performance in curved sections. In step 606, an ROI region for object detection processing is selected. Specifically, it is decided to skip the long-distance ROI determination process, where visibility is thought to be poor in curved sections, and to perform only the short- and medium-distance ROI determination process. Proceed to step 607.

[0046] Step 607: The ROI is determined based on the ROI area information that was selected as the processing target in step 606 and the trajectory information acquired in steps 604 and 605. The process proceeds to step 608.

[0047] Step 608: The input image from the external sensor is extracted based on the determined ROI, and an ROI extracted image is generated.

[0048] Step 609: Determine whether ROI cutout images have been generated for all of the target ROI regions. If ROI cutout images have been generated for all ROI regions, proceed to step 610. If there are ROI regions for which ROI cutout images have not been generated, proceed to step 602.

[0049] Step 610: The generated ROI cut-out image is sent to the object detection unit 124.

[0050] Next, the method of determining whether the section is a straight line section or a curved line section in step 602 will be described with reference to FIG.

[0051] The left diagram of Fig. 7(a) shows an example of a straight section. In the left diagram of Fig. 7(a), the actual trajectory is represented by a dotted line 700, the detection result of the trajectory detected by image processing is represented by a trajectory detection result 710, and the trajectory center position 720 of the trajectory coordinates (u) on the left and right of the trajectory detection result 710. In this case, the relationship between the ordinate (v) of the trajectory detection result 710 on the image and the trajectory center position 720 is expressed by a linear function 730 as shown in the right diagram of Fig. 7(a). In such a case, it is determined to be a straight section.

[0052] Next, an example of a section including a curved portion will be described. In the left diagram of Fig. 7(b), the actual trajectory is represented by a dotted line 701, the trajectory detection result detected by image processing is represented by a trajectory detection result 711, and the trajectory center position 721 of the trajectory coordinates (u) on the left and right of the trajectory detection result 711. In this case, the relationship between the ordinate (v) of the trajectory detection result 711 on the image and the trajectory center position 721 is represented by a curve (a quadratic or higher degree function) 741, as shown in the right diagram of Fig. 7(b).

[0053] If the relationship between the ordinate (v) of the track detection result 711 and the track center position 721 forms a curve (a function of second degree or higher) 741 as shown in the right diagram of FIG. 7B, it is determined to be a curved section.

[0054] In addition to the relationship between the ordinate (v) of the trajectory detection result 711 and the trajectory center position 721 being a quadratic or higher function, if the difference between the farthest trajectory center position 751, which is the trajectory center position of the point in the trajectory detection result 711 with the smallest ordinate (v) value (the farthest part of the trajectory detection result), and the straight section trajectory center position 761, which is one of the trajectory center positions 730 in the straight section and has the same v coordinate as the farthest trajectory center position 751, is equal to or greater than a predetermined threshold, the section may be recognized as a curved section. This makes it possible to determine whether the section is straight or curved with a simpler calculation.

[0055] In this embodiment, the processing time can be reduced by using the trajectory information from the calculation cycle one cycle before the current calculation cycle to determine the ROIs for short distances and long distances in the straight section. The reduced time can be used to generate a new ROI cut-out image and perform image processing, thereby improving the object detection performance through image processing.

[0056] In addition, by skipping the long-distance object detection processing in curved sections and using the trajectory information in the current calculation cycle for the ROI determination processing for short and medium distances, it is possible to shorten the processing time for object detection processing using image processing while maintaining object detection performance in curved sections.

[0057] According to the embodiment described above, in an obstacle detection system installed in a rail transportation system, it is possible to select an appropriate ROI to improve obstacle detection performance, while reducing the time required for obstacle detection processing through image processing.

[0058] The present invention is not limited to the above-described embodiments and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace part of the configuration of each embodiment with other configurations. Furthermore, the above-described configurations, functions, processing units, processing means, etc. may be implemented in hardware, in part or in whole, by designing, for example, an integrated circuit. Furthermore, the above-described configurations, functions, etc. may be implemented in software, by a processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be stored in memory, a recording device such as a hard disk or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, or DVD.

[0059] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present invention.

[0060] 100: Train, 110: External sensor, 120: Obstacle detection device in Example 1, 121: Track detection unit in Example 1, 122: Track information recording unit in Example 1, 123: ROI processing unit in Example 1, 124: Object detection unit in Example 1.

Claims

1. An obstacle detection system comprising: a track detection unit that detects track information from data from external sensors for recognizing the environment around the train; an ROI processing unit that extracts a region of interest to be subjected to object detection processing from the track information; and an object detection unit that detects objects, wherein the obstacle detection system further comprises a track information recording unit that records the track information detected by the track detection unit, and the ROI processing unit changes the track information used to extract the region of interest based on information on either the size of the region of interest or the shape of the track ahead of the train.

2. An obstacle detection system as described in claim 1, characterized in that the ROI processing unit extracts the region of interest from the trajectory information from the trajectory information recording unit when the region of interest is large, and extracts the region of interest from the trajectory information from the trajectory detection unit when the region of interest is small.

3. An obstacle detection system as described in claim 1, wherein the ROI processing unit extracts a region of interest from track information from the track information recording unit when the track shape ahead of the train is straight, and extracts a region of interest from track information from the track detection unit when the track shape ahead of the train is curved.

4. An obstacle detection system according to claim 3, wherein the ROI processing unit does not perform the process of extracting the smallest region of interest when the track shape ahead of the train is curved.

5. An obstacle detection system according to any one of claims 1 to 4, comprising an external sensor.

6. An obstacle detection system according to any one of claims 1 to 5, wherein the external sensor is a camera.

7. An obstacle detection method in which a track detection unit detects track information from data from external sensors for recognizing the environment around the train, an ROI processing unit extracts a region of interest to be subjected to object detection processing from the track information, and an object detection unit detects an object, wherein a track information recording unit records the track information detected by the track detection unit, and the ROI processing unit changes the track information used to extract the region of interest based on information on either the size of the region of interest or the shape of the track ahead of the train.

8. An obstacle detection method according to claim 7, characterized in that the ROI processing unit extracts the region of interest from the trajectory information from the trajectory information recording unit when the region of interest is large, and extracts the region of interest from the trajectory information from the trajectory detection unit when the region of interest is small.

9. An obstacle detection method as set forth in claim 7, characterized in that the ROI processing unit extracts a region of interest from track information from the track information recording unit when the track shape ahead of the train is straight, and extracts a region of interest from track information from the track detection unit when the track shape ahead of the train is curved.

10. An obstacle detection method according to claim 9, characterized in that the ROI processing unit does not perform the process of extracting the smallest region of interest when the track shape ahead of the train is curved.

Citation Information

Patent Citations

  • Obstacle detection system and railway vehicle

    JP2016088183A

  • Obstacle detection system

    JP2022077655A

  • System for detecting object and method for detecting object

    JP2023034917A