Pruning location determination system

The pruning location determination system accurately determines locations where plants are at risk of falling onto the road by comparing plant height to the road boundary, enhancing the precision of pruning point identification.

JP7953830B2Active Publication Date: 2026-11-19AISIN CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022171952
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-10-27
Publication Date
2026-11-19
Estimated Expiration
2042-10-27

Smart Images

  • Figure 0007953830000001
    Figure 0007953830000001
  • Figure 0007953830000002
    Figure 0007953830000002
  • Figure 0007953830000003
    Figure 0007953830000003
Patent Text Reader

Abstract

To provide a system that can give a spot where plants, including roadside trees and flowers, are at risk of falling onto the road and need to be pruned.SOLUTION: The present invention comprises: an acquisition unit that acquires the height of a plant and the distance from the plant to a roadway boundary that is the boundary of the roadway; a determination unit that determines whether the acquired height of the plant is greater than or equal to the distance to the roadway boundary, and records on a recording medium the spot where the plant is located as a pruning-required spot where pruning is necessary when determining that the height of the plant is the length greater than or equal to the distance to the roadway boundary; and a display control unit that causes a display unit to display the spot where pruning is required when the plant satisfies a criterion that there is a risk of the plant falling toward the roadway.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present invention relates to a pruning point determination system.

BACKGROUND ART

[0002] Conventionally, systems that support judgment of the necessity of pruning street trees are known. For example, in Patent Document 1, a laser sensor is used to irradiate the branches and leaves of street trees with laser light, the heights of the branches and leaves of the street trees are identified from the intensity of the reflected light, and a configuration for judging the necessity of pruning the street trees is disclosed.

PRIOR ART DOCUMENTS

PATENT DOCUMENTS

[0003]

PATENT DOCUMENT 1

SUMMARY OF THE INVENTION

PROBLEMS TO BE SOLVED BY THE INVENTION

[0004] In the conventional art, the possibility that street trees may fall toward the road side is not taken into consideration. Therefore, the judgment of the possibility that a street tree may fall toward the road side is assumed to be, for example, judgment by a road administrator or judgment based on a report from a citizen. However, such judgment may lead to an error in selecting points that require pruning of street trees.

[0005] The present invention has been made in view of the above problems, and an object thereof is to provide a system capable of providing points that require pruning where plants including street trees, flowers and the like are at risk of falling toward the road side.

MEANS FOR SOLVING THE PROBLEMS

[0006] To achieve the above objective, the pruning location determination system comprises: an acquisition unit that acquires the height of a plant and the distance from the plant to the road boundary, which is the boundary of the roadway; a determination unit that determines whether the acquired height of the plant is greater than or equal to the distance to the road boundary, and if it is determined that the height of the plant is greater than or equal to the distance to the road boundary, records the location of the plant as a pruning location on a recording medium; and a display control unit that displays the pruning location on a display unit if the plant meets the criteria for being at risk of falling towards the roadway.

[0007] In other words, the pruning location determination system, when it determines that the height of a plant is greater than the distance from the plant to the road boundary, displays on the display unit (for example, the display unit of the administrator terminal) that the location of the plant meeting the criteria for potentially falling onto the road is a location where pruning is necessary. This makes it possible to reliably identify locations where plants are at risk of falling onto the road and require pruning, compared to, for example, determining the need for pruning based on the judgment of the road administrator or reports from citizens. In short, it reduces the likelihood of misidentifying or overlooking locations that require pruning. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram showing the configuration of the pruning location determination system. [Figure 2] This flowchart shows an example of processing in an in-vehicle system. [Figure 3] Figure 3A shows an example of a captured image, and Figure 3B shows a plane including the vehicle width axis and vehicle length axis. [Figure 4] This figure shows an example of information regarding locations where pruning is necessary. [Figure 5] This flowchart shows an example of server processing. [Figure 6] This is a diagram showing an example of a patrol route. [Modes for carrying out the invention]

[0009] Here, embodiments of the present invention will be described in the following order. (1) System configuration: (2) Configuration and processing of the in-vehicle system: (3) Server configuration and processing: (4) Other embodiments:

[0010] (1) System configuration: Figure 1 is a block diagram showing the configuration of the pruning location determination system in the present invention. In this embodiment, the pruning location determination system comprises an in-vehicle system 10 and a server 50. The in-vehicle system 10 and the server 50 can communicate with each other via wireless communication. The in-vehicle system 10 is installed in a vehicle that functions as a probe vehicle in this embodiment, and detects plants around the vehicle based on images captured by a camera mounted on the vehicle. Here, "plants" is a concept that includes grasses, street trees, flowers, etc. In the following description, grasses, etc. will be collectively referred to simply as "plants." The in-vehicle system 10 then determines whether the location where plants are detected is a pruning location where pruning of the plants is necessary, and if it determines that the location is a pruning location, it transmits information (pruning location information) associated with the pruning location to the server 50. The server 50, having received this information from the probe vehicle, displays the pruning locations of plants that meet the criteria for plants that are likely to fall onto the road on the display unit of the user I / F unit 110 of the administrator terminal 100. Furthermore, as shown in Figure 1, the server 50 collaborates with the administrator terminal 100 and the weather information management system 200 via communication. The administrator terminal 100 is a terminal used by an administrator (for example, a road administrator) who manages the pruning locations of plants. The administrator uses the administrator terminal 100 to display, for example, the pruning locations received from the server 50 on the display unit of the user I / F section 110 of the administrator terminal. The weather information management system 200 is a system that generates current weather information showing the weather for each section. In other words, the server 50 can communicate wirelessly with the in-vehicle system 10, the administrator terminal 100, and the weather information management system 200, respectively.

[0011] (2) Configuration and processing of the in-vehicle system: The in-vehicle system 10 comprises a control unit 20, a recording medium 30, a communication unit 40, a camera 41, a GNSS receiver 42, a vehicle speed sensor 43, a gyro sensor 44, and a user interface unit 45. The control unit 20 is a computer equipped with a CPU, RAM, ROM, etc. The in-vehicle system 10 can execute programs stored in the recording medium 30 and ROM using the control unit 20. Map information 30a is pre-recorded in the recording medium 30.

[0012] Map information 30a is information used to determine the current position of the probe vehicle, and includes node data indicating the location of nodes set on the road the probe vehicle is traveling on, shape interpolation point data indicating the location of shape interpolation points for determining the shape of the road between nodes, link data indicating the connections between nodes, and feature data indicating the location and shape of features on the road and its surroundings. In this embodiment, nodes indicate intersections. Link data is associated with information indicating the number and type of lanes and the width of the lanes in the road section indicated by the link data. In this embodiment, the locations indicated by nodes and shape interpolation points indicate the location of the center line on the road section, and the location of the lanes and the range in which the lanes exist can be determined by this location and the number and width of the lanes.

[0013] Camera 41 is a device that acquires images within the field of view directed forward of the probe vehicle. It captures images at predetermined intervals and generates and outputs image information indicating the captured images. The optical axis of camera 41 is fixed to the probe vehicle, and it is sufficient that the direction of the optical axis is known to the in-vehicle system 10. In this embodiment, camera 41 is mounted on the probe vehicle in a manner such that the optical axis center is perpendicular to the vehicle width direction of the probe vehicle and the field of view includes the area in front of the probe vehicle in the direction of travel. The control unit 20 can acquire the images output by camera 41 and analyze the images by extracting features, etc., to detect the images to be detected that are included in the captured images.

[0014] The GNSS receiver 42 is a device that receives signals from the Global Navigation Satellite System. It receives radio waves from navigation satellites and outputs a signal to calculate the current position of the probe vehicle via an interface (not shown). The control unit 20 acquires this signal and obtains the current position (latitude, longitude, etc.) of the probe vehicle in the map coordinate system. The vehicle speed sensor 43 outputs a signal corresponding to the rotational speed of the wheels of the probe vehicle. The control unit 20 acquires this signal via an interface (not shown) and obtains the vehicle speed. The gyro sensor 44 detects the angular acceleration of the probe vehicle's turning in the horizontal plane and outputs a signal corresponding to the orientation of the probe vehicle. The control unit 20 acquires this signal and obtains the direction of travel of the probe vehicle. The vehicle speed sensor 43 and the gyro sensor 44 are used to determine the trajectory of the probe vehicle. In this embodiment, the current position is determined based on the probe vehicle's starting point and trajectory, and the current position of the probe vehicle determined based on the starting point and trajectory is corrected based on the output signal of the GNSS receiver 42.

[0015] The user interface unit 45 is an interface unit for receiving user instructions and providing various information to the user, and includes a display unit consisting of a touch panel display (not shown), input units such as switches, and output units such as speakers. The configuration of this user interface unit is the same as that of the user interface unit 110 in the administrator terminal 100. The communication unit 40 includes a circuit for wireless communication with other devices. In this embodiment, the control unit 20 can exchange information with the server 50 via wireless communication through the communication unit 40.

[0016] When the control unit 20 detects at least a plant among the objects present on the road from the image captured by the camera 41, it can realize a function of acquiring information in which the position of the plant is associated with the relevant image, and a function of determining whether or not the plant requires pruning and generating information of points requiring pruning. The relevant functions can be realized by the pruning required point information generation program 21 stored in the recording medium 30 or the ROM. To realize the relevant functions, the pruning required point information generation program 21 includes an acquisition unit 21a and a determination unit 21b. When the pruning required point information generation program 21 is executed, the control unit 20 functions as the acquisition unit 21a and the determination unit 21b. Further, when the pruning required point information generation program 21 is executed by the control unit 20, pruning required point information including the pruning required points where plant pruning is necessary is generated, and the generated pruning required point information is recorded in the recording medium 30. Then, the pruning required point information is transmitted to the server 50 via the communication unit 40. In the following description, the processes described as being performed by the acquisition unit 21a and the determination unit 21b are processes realized by the control unit 20.

[0017] The acquisition unit 21a has a function of acquiring an image obtained by photographing an object while the probe vehicle is traveling. The acquisition unit 21a acquires various types of information based on the captured relevant image, such as the position coordinates of the plant, the height of the plant, and the distance to the roadway boundary that is the boundary of the roadway from the plant. In the present embodiment, during the process in which the probe vehicle is traveling, the control unit 20 controls the camera 41 at regular intervals to photograph the scenery including the road and objects ahead of the probe vehicle. The acquisition unit 21a performs image recognition processing based on the image captured by the camera 41 to detect the plant that is the detection target. The detection targets include, in addition to plants, road markings (characters, crosswalks, white lines, center lines, roadway outer lines, roadway boundary lines, etc.), surrounding vehicles (passenger cars, trucks, buses, two-wheeled vehicles, etc.), traffic signs, traffic signals, structures around roads (utility poles, curbs, fences, protective fences, medians, guardrails, etc.) and the like. The specific aspect of the image recognition processing will be described later with reference to the flowchart.

[0018] The determination unit 21b has a function of comparing the height of the plant acquired by the acquisition unit 21a with the distance to the roadway boundary, and determining whether the height of the plant is equal to or greater than the distance to the roadway boundary. Then, when the determination unit 21b determines that the height of the plant is equal to or greater than the distance to the roadway boundary, the determination unit 21b records the point where the plant is located on the recording medium 30 as a pruning-required point that requires pruning. A specific aspect of the processing of this determination unit 21b will be described later with reference to a flowchart.

[0019] Next, the pruning-required point information generation processing executed by the control unit 20 in the in-vehicle system 10 of the probe vehicle will be described. Figure 2 is a flowchart for explaining the pruning-required point information generation processing. This processing is executed at regular intervals, for example, while the probe vehicle is traveling. When the pruning-required point information generation processing of Figure 2 is started, the control unit 20 uses the function of the acquisition unit 21a to capture an image in front of the probe vehicle, and performs image recognition processing on the captured image (Step S1). Specifically, the control unit 20 captures an image in front of the probe vehicle with the aforementioned camera 41, and acquires the captured image. After acquiring the image using the function of the acquisition unit 21a, the control unit 20 performs image recognition. That is, the control unit 20 performs image recognition processing for detecting a detection target on the acquired image. Note that in the present embodiment, the control unit 20 acquires the current position of the probe vehicle based on the output signals of the GNSS receiver 42, the vehicle speed sensor 43, and the gyro sensor 44, and records the current position of the probe vehicle at the time the image was captured and the capturing time in association with each other on the recording medium 30. In addition, the control unit 20 acquires the road section on which the probe vehicle is traveling through map matching processing.

[0020] In image recognition processing, the control unit 20 uses the functions of the acquisition unit 21a to identify objects on the road (e.g., preceding vehicles) and objects outside the width of the roadway (e.g., plants and signs) from the image. Based on the acquired image, the control unit 20 performs distortion correction due to the lens, etc. After distortion correction, the control unit 20 recognizes lines painted on the road, such as roadway edge lines, lane boundaries, and center lines. Specifically, the control unit 20 performs lane marking recognition processing to recognize painted lines. Lane marking recognition processing can be performed using various methods. For example, the control unit 20 may perform a process to detect straight lines using Hough transform, etc., and recognize the area enclosed by the detected straight lines as a line painted on the road, such as a lane boundary or center line, if the color of the area is a predetermined color such as white and the width of the area is within a predetermined distance. Furthermore, the control unit 20 performs image recognition processing to detect the above-mentioned detection targets using YOLO (You Only Look Once) or pattern matching, etc. As a result of the image recognition processing, the control unit 20 detects the target image from the captured image. Note that the above-mentioned lane line recognition processing may be performed by YOLO or pattern matching, etc.

[0021] After performing image recognition processing using the function of the acquisition unit 21a, the control unit 20 determines whether or not plants are present in the detected image (step S2). That is, the control unit 20 uses the function of the determination unit 21b to refer to the image detected by YOLO, etc., and determines whether or not plants are included in the image. If the control unit 20 determines in step S2 that plants are included in the detected image, it proceeds to step S3. If the control unit 20 determines that plants are not included in the detected image, it terminates the process shown in Figure 2.

[0022] In step S3, the control unit 20 obtains the position coordinates of plants present in the image. The processes described below (processing in steps S3 to S8) are performed on all plants in the image, but for the sake of explanation, one plant is extracted from all the plants, and the processing of that extracted plant will be described. Specifically, the control unit 20 uses the function of the acquisition unit 21a to extract one plant from the plants present in the image and obtains the position coordinates of the boundary between the plant and the ground (i.e., the base of the plant), for example. The position coordinates of the plant may be determined by various methods. For example, the control unit 20 obtains the position coordinates of the plant based on the current position of the probe vehicle received from the GNSS receiver 42. Specifically, the control unit 20 uses the function of the acquisition unit 21a to obtain the position coordinates of the plant (i.e., latitude and longitude) from the current position of the vehicle, the relative orientation of the plant, and the straight-line distance to the plant.

[0023] More specifically, for example, when the control unit 20 recognizes a plant, which is one of the detection targets, it identifies a bounding box surrounding the plant in the image. The size and position of the bounding box indicate the size of the plant image and the position of the object in the captured image. Figure 3A is a diagram showing an example of image I after it has been captured by camera 41 and distortion correction has been performed. As shown in Figure 3A, in this embodiment, bounding box B is a rectangular area surrounding the plant (street tree in Figure 3A) detected from image I. Note that in Figure 3A, two representative plants are labeled with reference numerals from among the multiple plants present.

[0024] The size and position of bounding box B are represented, for example, by the coordinates of the top-left and bottom-right vertices of bounding box B. The control unit 20 obtains the height (number of pixels) of bounding box B and the representative coordinates Bo(x, y) of bounding box B from the coordinates of the two diagonal vertices of bounding box B. The representative coordinates Bo are, for example, predetermined coordinates of bounding box B, and in this embodiment, the representative coordinates Bo are the base of the plant. Based on the position of the representative coordinates Bo of bounding box B, the control unit 20 determines the relative orientation of the plant as seen from the probe vehicle. The control unit 20 also determines the distance from the probe vehicle to the plant based on the pixels of bounding box B.

[0025] Specifically, each coordinate within image I (and bounding box B) is pre-associated with the relative orientation of the object captured at that coordinate, relative to the probe vehicle, and information indicating the correspondence between the coordinate and the relative orientation is recorded in the recording medium 30. Based on this correspondence, the control unit 20 acquires the relative orientation of the plant captured at the representative coordinate Bo. In this embodiment, a vehicle coordinate system is defined relative to the probe vehicle. The vehicle coordinate system is a coordinate system defined by the vehicle width axis (X-axis shown in Figure 3B) and the vehicle length axis (Y-axis shown in Figure 3B), which are orthogonal to each other.

[0026] Figure 3B shows a plane containing the vehicle width axis and vehicle length axis. In this figure, point O is the origin of the vehicle coordinate system for the probe vehicle. In the example in Figure 3B, the vehicle length axis is parallel to the link indicating the road section on which the probe vehicle is traveling. The relative direction is expressed, for example, by the angle (θ) between the vehicle length axis and the line SL connecting the origin O of the vehicle coordinate system and point P corresponding to representative coordinate Bo (for example, a negative value of θ indicates the left side of the vehicle length axis in the direction of travel, and a positive value indicates the right side).

[0027] Furthermore, the straight-line distance between the probe vehicle and the plant, and the position of each pixel in the image when the plant is photographed by the camera 41 are predetermined. Information showing the correspondence between the position of each pixel and the straight-line distance relative to the origin of the vehicle coordinate system is recorded on the recording medium 30. In other words, by pre-determining the distance between the object (the base of the plant) and the vehicle when an image of the object (a plant in this embodiment) exists at each pixel in the image, and associating this with the pixels, the straight-line distance from the origin O can be determined by determining the distance corresponding to the pixel in which the plant is photographed. Based on this correspondence, the control unit 20 calculates the straight-line distance D corresponding to each pixel of the bounding box B. In this way, the control unit 20 obtains the relative orientation θ of the plant included in the image and the straight-line distance D from the probe vehicle based on the image captured by the camera 41.

[0028] Furthermore, the control unit 20 acquires the current position of the probe vehicle (i.e., the current position when the image was taken by the camera 41) and the direction of travel (the direction indicated by the vehicle's long axis), which were associated with the images from which the relative direction θ and straight-line distance D were calculated. Then, based on the relative direction θ, straight-line distance D, the current position of the probe vehicle, and the direction of travel of the probe vehicle, the control unit 20 acquires the position coordinates of the plants in the map coordinate system. Once the control unit 20 has acquired the position coordinates of the plants in this way, it proceeds to step S4.

[0029] In step S4, the control unit 20 acquires the height of the plant using the function of the acquisition unit 21a. Similar to the process in step S3, each pixel is pre-associated with the height of the bounding box B, and this associated information is recorded in the recording medium 30. The control unit 20 uses the function of the acquisition unit 21a to refer to the recording medium 30 to identify the height of the bounding box B and acquires the height of the plant based on the relationship between the representative coordinate Bo and that height.

[0030] Next, the control unit 20 acquires the distance from the plant to the road boundary using the function of the acquisition unit 21a (step S5). The road boundary refers to the boundary on a road that separates the inside of the roadway from the outside of the roadway, excluding the sidewalk. In this embodiment, the outer edge of the roadway is the road boundary. The control unit 20 draws a perpendicular line from the position coordinates of the plant (the base of the plant) acquired in step S3 to the road boundary and identifies the intersection point of the perpendicular line and the road boundary. By identifying this intersection point, the position coordinates at the intersection point can be identified, and the control unit 20 identifies the distance between the identified intersection point and the plant (i.e., the distance from the plant to the road boundary). The recognition process of the outer edge of the roadway, which is the road boundary, may be performed by the road boundary recognition process described above. For example, the control unit 20 may perform a process to detect straight lines using the Hough transform or the like, and recognize the area enclosed by the detected straight lines as a solid line of a predetermined color such as white.

[0031] Next, the control unit 20, using the function of the determination unit 21b, determines whether the height of the plant is greater than or equal to the distance from the plant to the road boundary (step S6). That is, the control unit 20 compares the height of the plant obtained in step S4 with the distance from the plant to the road boundary obtained in step S5 to determine whether the height of the plant is greater than or equal to the distance to the road boundary. By performing this comparison, the control unit 20 can understand how much the plant will protrude (or stick out) into the road when it falls towards the road. In other words, the control unit 20 can recognize the degree of impact on the road when the plant falls. It is assumed that the degree of impact will be greater the longer the length that protrudes into the road.

[0032] In step S6, the control unit 20 compares the height of the plant with the distance from the plant to the road boundary. If it determines that the height of the plant is greater than or equal to the distance from the plant to the road boundary, it proceeds to step S7. If the control unit 20 compares the height of the plant with the distance from the plant to the road boundary and determines that the height of the plant is less than the distance from the plant to the road boundary, it terminates the process shown in Figure 2.

[0033] In step S7, the control unit 20 obtains the orientation of the road boundary as seen from the plant using the determination unit 21b. Specifically, the control unit 20 obtains the orientation of the road boundary as seen from the plant by drawing a perpendicular line from the position coordinates of the plant (the base of the plant) to the road boundary. The orientation to the road boundary can be, for example, 8 directions, 16 directions, 32 directions, etc. This process is the same as the process in step S5. Therefore, the orientation of the road boundary as seen from the plant may be obtained during the process in step S5. In that case, the process in step S7 may be skipped.

[0034] In this way, once the control unit 20 has acquired the plant's position coordinates, plant height, distance from the plant to the road boundary, and orientation of the road boundary from the plant, the determination unit 21b uses its function to associate the acquired information with each other and transmits the associated information to the server 50 as pruning required location information (step S8). In other words, the control unit 20 generates pruning required location information based on the information acquired in the process shown in Figure 2 and transmits this pruning required location information to the server 50. When the server 50 receives the pruning required location information transmitted to the server 50, it records it as pruning required location information 70a on the server 50's recording medium 70.

[0035] Figure 4 shows an example of pruning requirement location information generated by the control unit 20. The pruning requirement location information shown in Figure 4 contains information obtained by executing the pruning requirement location information generation process described in Figure 2 above. Specifically, as shown in Figure 4, the pruning requirement location information includes position coordinates, height, distance to the road boundary, and orientation of the road boundary. The position coordinates are P A Plant identification information (P) such as (Xa,Ya) A This is information that associates a point with coordinates ((Xa,Ya)), where these position coordinates correspond to the points where pruning is required on the plant. The coordinates, as mentioned above, indicate, for example, the coordinates of the base of the plant.

[0036] The height refers to the height of the plant mentioned above, and in the example shown in Figure 4, it is indicated as "h1", "h2", etc. The distance to the road boundary refers to the distance from the plant to the road boundary, and in the example shown in Figure 4, it is indicated as "D1", "D2", etc. The direction of the road boundary refers to the direction of the road boundary as seen from the plant, and in the example shown in Figure 4, it is indicated as eight directions such as east and northeast. In this way, the control unit 20 executes the pruning required location information generation process shown in Figure 2, thereby generating the pruning required location information. Note that the pruning required location information shown in Figure 4 is just an example, and other information may be defined. Also, the generation of this pruning required location information is just an example, and for example, at least some of the information in Figure 4 may be generated by the in-vehicle system 10, and the remaining information may be generated by the server 50.

[0037] (3) Server configuration and processing: Next, the configuration of server 50 and the processing of server 50 will be described. Server 50 is, for example, a stationary general-purpose computer or a cloud-type server computer, and includes a control unit 60 equipped with a CPU, RAM, ROM, etc., a recording medium 70, and a communication unit 80. The communication unit 80 is equipped with a circuit for exchanging information with the in-vehicle system 10, the administrator terminal 100, and the weather information management system 200. The control unit 60 can communicate with the in-vehicle system 10, the administrator terminal 100, and the weather information management system 200 via the communication unit 80.

[0038] The recording medium 70 stores pruning requirement location information 70a and map information 70b. The pruning requirement location information 70a is pruning requirement location information generated by the in-vehicle system 10 described above, and is recorded on the recording medium 70 after being transmitted from the in-vehicle system 10 to the server 50.

[0039] Map information 70b is information used for searching for routes to visit locations where plant pruning is needed and for identifying the location of probe vehicles. It includes node data indicating the location of nodes set on the roads the probe vehicles travel on, shape interpolation point data indicating the location of shape interpolation points to identify the shape of the roads between nodes, link data indicating the connections between nodes, and feature data indicating the location and attributes of features on and around the roads. Link data is associated with information indicating the cost for each road section indicated by the link data. Features can be the starting point and destination of a route.

[0040] The control unit 60 can execute programs stored in the recording medium 70 or ROM. In this embodiment, the pruning location determination program 61 can be executed as this program. Conventionally, the determination of whether or not plants need to be pruned is known to be based on the judgment of road administrators or reports from citizens. In such cases, there is a risk of selecting the wrong locations for pruning or overlooking locations that need pruning. Therefore, in this embodiment, locations that need pruning can be provided to administrators, etc. The pruning location determination program 61 is a program that displays locations that need pruning on the display unit when the criteria for plants that are likely to fall towards the roadway are met, and also guides a route to visit the locations that need pruning. When the pruning location determination program 61 is executed, the control unit 60 functions as a display control unit 61a and a route guidance unit 61b. In the following, the processes described as being performed by the display control unit 61a and the route guidance unit 61b are processes implemented by the control unit 60.

[0041] The display control unit 61a has the function of determining whether the criteria for the risk of plants falling toward the roadway are met, and if the criteria are met, it displays the pruning locations on the user interface unit 110 of the administrator terminal 100. In other words, the control unit 60, using the function of the display control unit 61a, refers to the pruning location information 70a and determines whether the criteria for the risk of plants falling toward the roadway are met at the locations included in the pruning location information 70a. The criteria here refer to, for example, that the direction from the plant toward the roadway boundary matches the wind direction based on the information of the weather information management system 200. Alternatively, it refers to adverse weather conditions that meet at least one of the following conditions based on the information of the weather information management system 200: rainfall, snowfall, or wind speed above a threshold. Then, the control unit 60, using the function of the display control unit 61a, transmits information on the pruning locations that meet the criteria to the administrator terminal 100, and displays it on the user interface unit 110 of the administrator terminal 100. Furthermore, the control unit 20, using the functions of the display control unit 61a, transmits a route to the administrator terminal 100 that visits the pruning-required points, which will be generated by the route guidance unit 61b described later, and displays the route on the user interface unit 110 of the administrator terminal 100. When the administrator terminal 100 receives this information, the control unit of the administrator terminal 100 displays the information on the display unit of the user interface unit 110. The specific details will be described later in a flowchart.

[0042] The route guidance unit 61b has the function of generating a route that visits pruning sites that meet the criteria for the risk of falling onto the roadway. That is, the control unit 20 uses the function of the route guidance unit 61b to search for a route that visits the starting point and each pruning site, and generates a route based on the search results. The actual route search process may be performed by the control unit 60, or it may be performed by a route search server (not shown) that searches for a route that allows travel between two points with the minimum travel cost using a known algorithm. The specific processing of the route guidance unit 61b will be described later in the flowchart.

[0043] Next, the pruning location determination process executed by the control unit 60 in the server 50 will be described. Figure 5 is a flowchart illustrating the pruning location determination process. This process is executed at regular intervals, for example, when a request for display of pruning locations is made from the administrator terminal 100. As mentioned above, when pruning location information is received from the in-vehicle system 10, this pruning location information is recorded in the recording medium 70 as pruning location information 70a.

[0044] When the pruning point determination process shown in Figure 5 is started, the control unit 60 determines whether or not a bad weather area has been acquired using the function of the display control unit 61a (step S10). Specifically, the control unit 20 communicates with the weather information management system 200 via the communication unit 80 and acquires weather information for a predetermined area (for example, an area designated by the administrator) from the weather information management system 200. Then, the control unit 60 determines whether or not a bad weather area is included in the acquired weather information. Bad weather, as described above, means when at least one of the following conditions is met: rainfall, snowfall, or wind speed above a predetermined threshold. In addition, in the case of rainfall or snowfall, bad weather may be considered to occur if the conditions are above a predetermined threshold, similar to wind speed.

[0045] Here, the configuration of the weather information management system 200 will be described. The weather information management system 200 is a system that generates weather information based on information from various sensors and databases, and includes a control unit (not shown), a recording medium, and a communication unit. In this embodiment, the weather information management system 200 generates weather information for each pre-divided area (for example, each mesh used in map information or each area defined by the government), showing the general weather conditions (sunny, cloudy, rainy, snowy, etc.), wind direction, wind speed, rainfall, snowfall, and temperature for that area. The generated weather information is recorded on the recording medium. The weather information management system 200 receives a request from the server 50 to transmit weather information for any area at any time. When a transmission request is received, the weather information management system 200 transmits the weather information for the specified area. When the weather information is transmitted, the server 50 acquires the weather information.

[0046] In other words, in step S10, the control unit 60, using the functions of the display control unit 61a, acquires weather information from the weather information management system 200 for the area that includes the predetermined area (the area designated by the administrator). If the acquired weather information includes an area with bad weather, the process proceeds to step S20. Conversely, if the acquired weather information does not include an area with bad weather, the process shown in Figure 5 is terminated.

[0047] In step S20, the control unit 60 obtains the wind direction within the aggravated weather area using the function of the display control unit 61a. That is, the control unit 60 obtains the wind direction in the relevant aggravated weather area by referring to the weather information obtained from the weather information management system 200 described above.

[0048] Next, the control unit 60, using the functions of the display control unit 61a, acquires the position coordinates of plants located within the bad weather area and the direction of the road boundary as seen from those plants (step S30). That is, based on the bad weather area information acquired in step S10 and the pruning required point information 70a, the control unit 60 identifies the position coordinates of plants located within the bad weather area and the direction of the road boundary as seen from those plants.

[0049] Then, the control unit 60, using the function of the display control unit 61a, extracts position coordinates where the wind direction of the bad weather area acquired in step S20 and the direction of the road boundary as seen from the plants acquired in step S30 coincide (step S40). That is, the control unit 60 extracts pruning locations from the direction of the road boundary as seen from the plants acquired in step S30 based on the pruning location information 70a, where the direction matches the wind direction of the bad weather area acquired in step S20. Note that the definition of direction may differ in the pruning location information and weather information, such as 4 directions, 8 directions, 16 directions, or 32 directions. The agreement between wind direction and direction in this embodiment is not limited to a perfect match. For example, even if the definition of direction does not match the wind direction, "east" and "east-southeast" may be considered the same direction. In other words, a predetermined range may be allowed for the agreement of directions in this embodiment. The control unit 60 can then determine that the plant at the position coordinates extracted in step S40 meets the criteria for being at risk of falling towards the roadway.

[0050] Next, the control unit 60 generates a route that visits the position coordinates extracted in step S40 using the function of the route guidance unit 61b (step S50). That is, the control unit 60 generates a route that visits pruning locations that meet the criteria for being at risk of falling towards the roadway. The generation of the tour route can be done by various methods. For example, the control unit 60 transmits information necessary for generating the tour route, such as pruning locations, to a route search server (not shown) via the communication unit 80 and performs a route search. The route search server may determine the order in which to visit the pruning locations by, for example, obtaining a solution to the delivery planning problem using a known algorithm. The route search server then refers to map information recorded on a recording medium (not shown) and searches for a route that visits the pruning locations in that order. The route search can be performed using various algorithms. For example, Dijkstra's algorithm, A* algorithm, or improved versions thereof can be used. Furthermore, the travel cost when searching for a route may be, for example, the travel cost included in the map information recorded on the route search server. The map information on the route search server includes, for example, the travel cost of each link. The travel cost may be determined by various methods. For example, the travel time obtained from probe traffic information corresponding to each link or the travel time generated from VICS (registered trademark) information may be considered as the travel cost.

[0051] Furthermore, if there are multiple pruning locations within the same link, it is inevitable to travel along that link. Therefore, the route search server may consider the pruning locations within the same link as one location and generate a route accordingly. In this manner, the control unit 60 generates a route that visits each pruning location.

[0052] The information indicating the patrol route generated in this way is then transmitted from the route search server to the server 50. The server 50 receives the transmitted patrol route. Furthermore, the control unit 60, using the function of the display control unit 61a, causes the patrol route to be displayed on the display unit of the administrator terminal (step S60). That is, the control unit 60, using the function of the display control unit 61a, refers to the map information 70b and generates an image in which the administrator's starting point, each pruning required point, and the route are superimposed on the map, and displays this image on the display unit of the user I / F unit 110.

[0053] Figure 6 shows an example of a map that the control unit 60 displays on the display unit 110 of the administrator terminal's user interface 61a using the functions of the display control unit 61a. In Figure 6, "●" indicates pruning required locations, and "☆" indicates the administrator's starting point. Roads are shown as thin straight lines, and the thick straight lines superimposed on the roads are the routes generated in step S50. In this way, the administrator can understand the route for visiting the pruning required locations.

[0054] As described above, the pruning location determination system in this embodiment works in cooperation with the in-vehicle system 10 and the server 50 to determine whether there is a risk of plants falling towards the roadway. Specifically, the control unit 20 determines whether the height of the plants is greater than or equal to the distance from the plants to the roadway boundary. If the height of the plants is greater than or equal to the distance to the roadway boundary, the control unit 60 extracts pruning locations that meet the criteria for plants falling towards the roadway and displays these pruning locations on the display unit of the user I / F unit 110. This allows administrators to reliably identify locations where plants are at risk of falling towards the roadway and require pruning, compared to, for example, determining the need for pruning based on the judgment of road administrators or reports from citizens. In other words, it reduces the likelihood of misidentifying or overlooking locations that require pruning.

[0055] Furthermore, in this embodiment, the criteria for when a plant is likely to fall towards the roadway are defined as when the direction of the roadway boundary as seen from the plant coincides with the wind direction, and during adverse weather conditions such as rain or snow. Therefore, locations where the direction and wind direction do not coincide, or locations where adverse weather conditions do not occur, are excluded from the locations requiring pruning. As a result, compared to simply defining a location as requiring pruning if the plant's height is greater than the distance from the plant to the roadway boundary, more locations requiring pruning can be identified. Therefore, managers can identify these locations that require more pruning.

[0056] Furthermore, the control unit 60 generates a route for visiting the pruning locations and displays this route on the display unit of the user interface unit 110. This allows the administrator to understand the information about the pruning locations and the route for visiting them.

[0057] (4) Other embodiments: The above embodiments are just examples of how to implement the present invention, and various other embodiments can be adopted. For example, in the above embodiments, the control unit 20 determines, using the function of the determination unit 21b, whether the height of the plant is greater than or equal to the distance to the road boundary, thereby determining how much the plant will protrude (or stick out) into the road when it falls towards the road. In addition, the control unit 20 may use the function of the determination unit 21b to calculate the value (length) of the plant that will protrude when it falls towards the road, and determine that locations with a larger value have a higher priority as locations where pruning is necessary. This is because locations with a larger value are assumed to have a greater degree of road obstruction when the plant falls, i.e., a greater impact on the road. In other words, the control unit 20 uses the function of the determination unit 21b to subtract the distance to the road boundary from the height of the plant, and the location with a larger subtracted value has a higher priority as a location where pruning is necessary. The determination unit 21b then records the determined priority in the pruning necessary location information.

[0058] The recorded pruning location information is then transmitted from the in-vehicle system 10 to the server 50, as described above, and recorded on the recording medium 70 as pruning location information 70a. The control unit 60 generates a route that visits the pruning locations that meet the criteria among the pruning locations included in this pruning location information 70a. When generating this route, the control unit 60 of the server 50 may, using the function of the route guidance unit 61b, generate a route that visits locations with a priority higher than a predetermined rank (in other words, locations with a priority lower than the predetermined rank are not included in the route). This allows the administrator to identify high-priority pruning locations and to identify a route that visits these high-priority pruning locations.

[0059] Furthermore, in the above-described embodiment, plants were used as objects that could potentially fall toward the roadway, and it was determined that the plants could potentially fall toward the roadway if their height was greater than or equal to the distance to the roadway boundary. The objects subject to this determination may not be plants. For example, signs, utility poles, or markers could be used instead of plants. In other words, any object that could potentially fall toward the roadway is acceptable.

[0060] Furthermore, the wind speed threshold, which is a condition for severe weather, may differ from region to region, as climatic characteristics may vary depending on the region. Similarly, snowfall amount and snowfall thresholds may be set differently for each region.

[0061] Furthermore, in the above-described embodiment, in step S40, position coordinates were extracted where the wind direction in the bad weather area and the direction of the road boundary as seen from the plants coincided. However, during bad weather, the weather is more prone to change than during sunny weather, such as when the weather changes suddenly. Therefore, during bad weather, even if the wind direction and the direction do not coincide, if, for example, the wind speed is above a predetermined wind speed (e.g., 10 m / s or more), the rainfall is above a predetermined rainfall amount (e.g., 20 mm or more per hour), or the snowfall is above a predetermined snowfall amount (e.g., 3 cm or more), the points where plants are located within the bad weather area may be considered as points where pruning is necessary, without considering the wind direction.

[0062] Furthermore, while the direction in which objects such as plants may fall was described as the roadway side in the above embodiment, this direction may be applied to other directions besides the roadway side. For example, this direction may be set according to the requirements of the road or railway management authority, such as the sidewalk side or the railway side.

[0063] Furthermore, for example, each system or device constituting the above-described embodiment may be composed of fewer devices that share functions. An example of this is the case in which at least one system shown in Figure 1 is composed of the same device as one or more other systems. For example, the server 50 and the in-vehicle system 10 may be composed of an integrated device, the server 50 and the administrator terminal 100 may be composed of an integrated device, the server 50 and the weather information management system 200 may be composed of an integrated device, the in-vehicle system 10 and the administrator terminal 100 may be composed of an integrated device, the in-vehicle system 10 and the weather information management system 200 may be composed of an integrated device, or the administrator terminal 100 and the weather information management system 200 may be composed of an integrated device. Also, some functions of the in-vehicle system 10 (at least some of the acquisition unit 21a and the determination unit 21b) may be implemented in the in-vehicle system 10. Also, some functions of the server 50 (at least some of the display control unit 61a and the route guidance unit 61b) may be implemented in the server 50. Furthermore, the system shown in Figure 1 may be composed of a larger number of systems. For example, at least a portion of the in-vehicle system 10, server 50, administrator terminal 100, and weather information management system 200 may be configured as a cloud server.

[0064] Furthermore, at least some of the components constituting the in-vehicle system 10 (acquisition unit 21a, determination unit 21b) and the components constituting the server 50 (display control unit 61a, route guidance unit 61b) may be divided among multiple devices. In addition, configurations in which some of the components of the above-described embodiment are omitted, or configurations in which processing is varied or omitted, can also be envisioned.

[0065] Furthermore, the methods of the present invention can also be applied as programs and methods. Moreover, such systems, programs, and methods may be implemented as standalone devices, or they may be implemented using parts shared with various components of a vehicle, encompassing a variety of embodiments. They can also be modified as appropriate, such as being partly software and partly hardware. Furthermore, the invention also functions as a recording medium for a program that controls the system. Of course, the recording medium for the program may be a magnetic recording medium, a semiconductor memory, or any recording medium developed in the future can be considered in exactly the same way. [Explanation of symbols]

[0066] 10...In-vehicle system, 20...Control unit, 21...Program for generating pruning required location information, 21a...Acquisition unit, 21b...Determination unit, 30...Recording medium, 30a...Map information, 40...Communication unit, 41...Camera, 42...GNSS receiver, 43...Vehicle speed sensor, 44...Gyro sensor, 45...User I / F unit, 50...Server, 60...Control unit, 61...Pruning location determination program, 61a...Display control unit, 61b...Route guidance unit, 70...Recording medium, 70a...Pruning required location information, 70b...Map information, 80...Communication unit, 100...Administrator terminal, 110...User I / F unit, 200...Weather information management system.

Claims

1. An acquisition unit that acquires the height of the plant and the distance from the plant to the road boundary, which is the boundary of the roadway, A determination unit determines whether the height of the acquired plant is greater than or equal to the distance to the road boundary, and if it is determined that the height of the plant is greater than or equal to the distance to the road boundary, it records the location of the plant as a pruning point where pruning is required on a recording medium. The system includes a display control unit that displays the pruning points on a display unit when the plant meets the criteria for being at risk of falling towards the roadway, Pruning location determination system.

2. The aforementioned standards are, The orientation from the plant to the road boundary coincides with the wind direction. The pruning location determination system according to claim 1.

3. The aforementioned standards are, This refers to severe weather conditions that meet at least one of the following conditions: rainfall, snowfall, or wind speed above a certain threshold. The pruning location determination system according to claim 1.

4. The determination unit, The greater the value obtained by subtracting the distance from the height of the plant to the road boundary, the higher the priority of the location as a location requiring pruning. The pruning location determination system according to claim 1.

5. The system further includes a route guidance unit that generates a route for visiting the aforementioned pruning locations. The pruning location determination system according to claim 1.

Citation Information

Patent Citations

  • Automatic measuring sensor system for branch and leaf height of street tree

    JP2012187091A

  • Obstacle detection method and obstacle detection system

    JP2013246483A

  • Data collection device, road status evaluation support device, and program

    JP2018120409A

  • Street tree management device, portable information terminal, and street tree management system

    JP2019075049A

  • Tree management system using gis

    KR1020210084173A