Repair support system, repair support method, and program

Abstract

A repair assistance system according to the present disclosure comprises: a detection means that detects a road surface deterioration that is unrepaired from a road surface image obtained by capturing a road surface; a determination means that determines, on the basis of the detection result, the area of road surface deterioration to be temporarily repaired; and a calculation means that calculates, on the basis of the determined area, the amount of material for use in the temporary repair.

Description

[Technical field]

[0001] The present disclosure relates to a repair support system and the like. [Background technology]

[0002] Over time, road surface deterioration, including cracks and potholes, occurs. To ensure safety, road surfaces are inspected and repaired periodically. Road surface inspections are carried out, for example, by personnel in charge visually observing the surface or by quantitatively measuring the surface condition using sensors installed in inspection vehicles.

[0003] Road surface repairs are generally subject to budgetary constraints, so plans are made to allocate repair costs within a budget to road surfaces that require repair. Patent Document 1 discloses a road surface repair support device that allocates repair costs to each unit section obtained by dividing an inspection section and calculates the total repair costs within the inspection section. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-108755 A Summary of the Invention [Problem to be solved by the invention]

[0005] Since full-scale pavement construction is costly, temporary repairs are performed using repair materials such as rubber materials. In this case, there is a demand to know the cost required for temporary pavement repairs. Patent Document 1 does not mention the calculation of the cost required for temporary repairs.

[0006] The present disclosure aims to provide a repair support system, etc. that supports calculation of the amount of material required for temporary repair. [Means for solving the problem]

[0007] The repair support system of the present disclosure comprises a detection means for detecting unrepaired road surface deterioration from a road surface image captured of the road surface, a determination means for determining an area of ​​road surface deterioration to be temporarily repaired based on the detection result, and a calculation means for calculating the amount of material to be used for the temporary road surface repair based on the determined area.

[0008] The repair support method disclosed herein detects unrepaired road surface deterioration from a road surface image captured of the road surface, determines an area of ​​road surface deterioration to be temporarily repaired based on the detection results, and calculates the amount of material to be used for the temporary road surface repair based on the determined area.

[0009] The program according to the present disclosure causes a computer to execute a process of detecting unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface, determining an area of ​​the unrepaired road surface deterioration based on a detection result, and calculating an amount of material to be used for temporary repair of the road surface based on the determined area. The program may be stored in a non-transitory computer-readable recording medium. Effect of the Invention

[0010] The present disclosure can assist in calculating the amount of material required for a temporary repair. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing an example of a configuration according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of a road surface image. [Diagram 3] 5 is a flowchart showing an operation example according to the first embodiment. [Figure 4] FIG. 11 is a block diagram showing an example of a configuration according to a second embodiment. [Diagram 5] 10 is a flowchart showing an operation example according to the second embodiment. [Figure 6] FIG. 13 is a diagram illustrating an example of a screen displayed to a user. [Figure 7] FIG. 11 is a diagram showing another example of a screen displayed to a user. [Figure 8] FIG. 13 is a block diagram showing an example of a configuration according to a third embodiment. [Figure 9] 13 is a flowchart showing an operation example according to the third embodiment. [Figure 10] 13 is an example of a material type selection table. [Figure 11] FIG. 13 is a diagram showing an example of a material comparison screen. [Figure 12] FIG. 13 illustrates an example screen showing material types selected based on budget. [Figure 13] FIG. 13 is a diagram showing an example of a screen showing an area of ​​road surface deterioration that can be repaired within a budget. [Figure 14] FIG. 2 is a block diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, with reference to the drawings, embodiments of a repair support system, a repair support method, a program, and a non-transitory recording medium for recording a program according to the present disclosure will be described in detail. The disclosed technology is not limited to the embodiments.

[0013] [First embodiment] 1 is a block diagram showing an example of the configuration of a repair support system 100 according to an embodiment. The repair support system 100 according to the first embodiment includes a detection unit 101, a determination unit 102, and a calculation unit 103.

[0014] In one embodiment, the repair assistance system 100 is used to calculate the amount of material required to temporarily repair a road surface.

[0015] A temporary repair is a repair that restores a deteriorated area of ​​pavement to a state where it is passable. Deterioration that occurs on pavement can include cracks, potholes, rutting, and other irregularities in the road surface. Temporary road repairs are also called partial repairs, provisional repairs, temporary repairs, and patching repairs.

[0016] When road surface deterioration is widespread and temporary repairs are not enough to ensure safety, full repairs are carried out. Full repairs involve repaving the road surface. Construction methods for full repairs include the replacement method and the overlay method.

[0017] The larger the area of ​​road surface deterioration, the more materials are used for the temporary repair. Any material can be used for the temporary repair, including granular, injected, or sprayed. The repair can be asphalt- or cement-based, such as rubber-based asphalt, resin mortar, gravel, or soil. However, the types of materials used for the repair are not limited to these.

[0018] The road surfaces targeted by the repair support system 100 are not limited to general roads on which vehicles and people pass, but also include vehicle test courses, airport runways and taxiways, etc. In other words, the repair support system 100 can be widely targeted to surfaces paved with concrete or asphalt.

[0019] The detection unit 101 of the repair assistance system 100 detects unrepaired road surface deterioration from a road surface image captured of the road surface. Unrepaired road surface deterioration is road surface deterioration that is not covered with repair material. The detection unit 101 detects unrepaired road surface deterioration by recognizing the color and shape of the unrepaired road surface deterioration using a known image recognition technology. The detection unit 101 may determine whether or not the road surface deterioration is unrepaired for each pixel. By determining road surface deterioration for each pixel, the detection unit 101 can, for example, accurately identify the area of ​​a crack. Therefore, the detection unit 101 can detect differences in the length, width, and area of ​​the crack.

[0020] The road surface image is captured by an on-board camera such as a drive recorder. However, the type of camera is not limited to this, and various types of cameras may be used. For example, the road surface image may be captured by a camera mounted on another moving object such as a bicycle or a drone, a camera carried by a person, or a fixed camera installed on the road. The road surface image may be captured by a person or automatically.

[0021] The road surface image captured by the camera may be stored in a database (not shown). In this case, the detection unit 101 may acquire the road surface image from the database. Alternatively, when the repair support system 100 is connected to an arbitrary camera by wire or wirelessly, the detection unit 101 may acquire the road surface image from the camera.

[0022] Furthermore, the detection unit 101 may acquire the date and time when the road surface image was captured together with the road surface image. The detection unit 101 may also acquire information on the position where the road surface image was captured together with the road surface image. The position information includes, for example, a position on a map, latitude and longitude, and position information by a Global Navigation Satellite System (GNSS) or a Global Positioning System (GPS).

[0023] Fig. 2 is a diagram showing an example of a road surface image captured of a road on which a car runs. The road in Fig. 2 has an unrepaired crack on the left edge and a temporarily repaired crack on the right side. The detection unit 101 may detect temporarily repaired road surface deterioration in addition to unrepaired road surface deterioration by image recognition. The detection unit 101 detects temporarily repaired road surface deterioration, for example, by recognizing repair materials on the road.

[0024] The determining unit 102 determines the area of ​​road surface deterioration for which temporary repair is to be performed based on the detection result by the detecting unit 101. The area of ​​road surface deterioration represents the area occupied by the deteriorated portion on the actual road surface.

[0025] In the first embodiment, the determining unit 102 determines the area of ​​unrepaired road surface deterioration included in the road surface image as the area of ​​road surface deterioration to be temporarily repaired. For example, based on the definition of the area of ​​the road surface indicated by one pixel of the road surface image, the determining unit 102 converts the number of pixels indicating road surface deterioration into the area of ​​road surface deterioration.

[0026] The determination unit 102 does not have to determine all road surface deteriorations included in the road surface image as targets for temporary repair. The determination of road surface deteriorations for which temporary repair is to be performed will be described later.

[0027] The calculation unit 103 calculates the amount of material to be used for the temporary repair of the road surface based on the area of ​​the road surface deterioration determined by the determination unit 102. The amount of material to be used is, for example, the volume or weight of the material predicted to be used. The calculation unit 103 calculates the amount of material by, for example, multiplying the determined area by a definition of the amount used per unit area. The calculation unit 103 may estimate the volume of the road surface deterioration based on the determined area and the estimated depth of the road surface deterioration. The calculation unit 103 may calculate the amount of material based on the estimated volume.

[0028] The calculation unit 103 may further calculate a price corresponding to the amount of material used based on the calculated amount of material. For example, the calculation unit 103 calculates the price corresponding to the amount of material used by multiplying the price per unit amount by the amount of material used. The calculation unit 103 may output a result of comparing the calculated price with a budget set by the user.

[0029] FIG. 3 is a flowchart showing an operation example of the repair support system 100 according to an embodiment.

[0030] The detection unit 101 detects unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface (step S11). The detection unit 101 calculates, for example, the number of pixels of the detected unrepaired road surface deterioration.

[0031] The determination unit 102 determines the area of ​​the detected unrepaired road surface deterioration (step S12). For example, the determination unit 102 converts the number of pixels into an area of ​​the actual road surface.

[0032] The calculation unit 103 calculates the amount of material to be used for the temporary repair based on the determined area (step S13).

[0033] According to the above embodiment, the detection unit 101 detects unrepaired road surface deterioration from a road surface image captured of the road surface. Furthermore, the determination unit 102 determines the area of ​​the detected unrepaired road surface deterioration as the area of ​​road surface deterioration to be temporarily repaired. Furthermore, the calculation unit 103 calculates the amount of material to be used for the temporary road surface repair based on the determined area. Thus, the amount of material to be used for the temporary road surface repair is calculated from the road surface image. Thus, according to the embodiment, it is possible to assist in the calculation of the cost required for the temporary repair. The cost includes, for example, at least one of the amount of material, the price of the material, the time, and the labor required for the temporary repair.

[0034] [Variations] In one embodiment, the determination unit 102 may determine an area of ​​road surface deterioration to be temporarily repaired, which is included in one or more regions among the regions obtained by dividing the road surface into a predetermined range. Furthermore, the calculation unit 103 may calculate an amount of material to be used for the temporary repair of the road surface deterioration included in the one or more regions.

[0035] The method for dividing the road surface is not particularly limited. For example, the road surface may be divided into unit regions.

[0036] A unit area is an area defined as a unit for managing a road surface. The unit area may be, for example, an area obtained by dividing a map into a grid, or an area obtained by dividing a road surface into any length and width. However, the unit area may be defined by any method. The size of each unit area may be uniform or different.

[0037] The area set for determining the area or calculating the amount of material may be a unit area. For example, the determination unit 102 may determine, for each unit area, an area of ​​road surface deterioration to be temporarily repaired that is included in the unit area. The determination unit 102 may also determine the total area of ​​road surface deterioration to be temporarily repaired that is included in a plurality of unit areas.

[0038] The calculation unit 103 may calculate, for each unit area, the amount of material to be used for temporary repair of road surface deterioration included in the unit area. The calculation unit 103 may also calculate the total amount of material to be used for temporary repair of multiple unit areas.

[0039] The detection unit 101 may detect unrepaired road surface deterioration from one road surface image for each unit area. Alternatively, the detection unit 101 may detect unrepaired road surface deterioration from multiple road surface images captured at multiple points within each unit area.

[0040] When there are multiple road surface images captured within a unit area, the detection unit 101 may extract one or multiple road surface images as a representative road surface image. For example, when a video of a road is captured while a vehicle is moving, a representative road surface image to be used for detecting road surface deterioration may be extracted. The detection unit 101 detects unrepaired road surface deterioration from the representative road surface image. Based on the detection result from the representative road surface image, the determination unit 102 may determine the area of ​​road surface deterioration within the unit area. By using the extracted representative road surface image, the number of images for which detection processing and area determination processing are performed is reduced, thereby preventing a decrease in processing speed.

[0041] Note that there may be cases where the state of road surface deterioration is unknown in some of the unit areas targeted by the detection unit 101 to detect road surface deterioration. For example, when the extraction interval of the representative road surface images exceeds the shooting range of the camera, it is assumed that one or more road surface images captured for each unit area do not capture the entire road surface within the unit area. It is also assumed that the road surface image for only one lane out of multiple lanes is captured. In this case, the detection unit 101 cannot detect road surface deterioration that has not been captured.

[0042] At this time, the determining unit 102 may estimate the area of ​​unrepaired road surface deterioration that exists on the unphotographed road surface based on one or more road surface images that capture a part of the unit area.

[0043] It can be assumed that the area of ​​road surface deterioration per unit area is the same for road surfaces in the same unit area. Therefore, the determining unit 102 can estimate the area of ​​road surface deterioration in a unit area by multiplying the average area of ​​road surface deterioration per unit area obtained from one or more road surface images by the area of ​​the unit area. The average area of ​​road surface deterioration per unit area can be obtained, for example, by dividing the total area of ​​road surface deterioration detected from multiple road surface images by the total area of ​​the road surface included in the multiple road surface images.

[0044] The determining unit 102 determines the estimated area of ​​road surface deterioration within the unit area as the area of ​​road surface deterioration to be subjected to temporary repair.

[0045] The determination unit 102 may determine whether or not to perform temporary repairs for the estimated unrepaired road surface deterioration that has not been photographed. The determination of the road surface deterioration that will be subjected to temporary repairs will be described later.

[0046] [Second embodiment] 4 is a block diagram showing an example of the configuration of a repair support system 100 according to the second embodiment. The repair support system 100 according to the second embodiment differs from the repair support system 100 according to the first embodiment in that the repair support system 100 according to the second embodiment includes a display control unit 104. Regarding the configurations of the detection unit 101, the determination unit 102, and the calculation unit 103 according to the second embodiment, detailed descriptions of the configurations similar to those of the first embodiment will be omitted.

[0047] The display control unit 104 displays the amounts of the ingredients calculated by the calculation unit 103. The display control unit 104 displays the amounts of the ingredients on a display (not shown), such as a display or tablet connected to a computer.

[0048] For example, the display control unit 104 may display the amount of material to be used for temporary repair of road surface deterioration included in one or more areas among areas obtained by dividing the road surface into a predetermined range.

[0049] The display control unit 104 may receive a selection of an area in which the amount of material is to be displayed, among the areas into which the road surface is divided. For example, the display control unit 104 may display an area selection screen. The user selects one or more areas, for example, using an input device connected to the computer. The input device is, for example, a mouse, a keyboard, or a touch panel display. Note that the method of selecting an area is not particularly limited.

[0050] The selection target is not limited to a rectangle, and the display control unit 104 may accept the selection of an area of ​​any shape. The display control unit 104 displays the calculated amounts of ingredients for one or more selected areas.

[0051] When multiple regions are selected, the display control unit 104 displays the total amount of material calculated for the multiple selected regions. Furthermore, the display control unit 104 may display the amount of material to be used for the temporary repair of each of the multiple selected regions.

[0052] The display control unit 104 may receive a selection of an area in which to display the amount of ingredients for each unit area. The display control unit 104 displays the calculated amount of ingredients for the selected unit area.

[0053] Each unit area may be represented on the map by a rectangle or an arrow. For example, a unit area on an airport runway or taxiway may be represented by a rectangle. Also, a unit area on a general road may be represented by an arrow. The direction of the arrow indicates the traveling direction of the road. However, the way in which a unit area is represented is not limited to these.

[0054] FIG. 5 is a flowchart showing an operation example of the repair support system 100 according to the second embodiment.

[0055] The detection unit 101 detects unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface (step S21). The detection unit 101 passes the detection result to the determination unit .

[0056] The determination unit 102 determines the area of ​​road surface deterioration to be temporarily repaired based on the detection result (step S22). The determination unit 102 transfers the determined area of ​​road surface deterioration to the calculation unit 103.

[0057] The calculation unit 103 calculates the amount of material to be used for the temporary repair based on the determined area (step S23). The calculation unit 103 may store the calculation result in a storage unit (not shown).

[0058] The display control unit 104 receives a selection of which region the amount of ingredients is to be displayed for (step S24). The display control unit 104 obtains the calculated amount of ingredients for the selected region. Then, the display control unit 104 displays the amount of ingredients for the selected region (step S25).

[0059] The above operation example is merely an example, and step S24 may be performed before any of step S21, step S22, or step S23. That is, based on the selection of a detection target area in the display control unit 104, the detection unit 101 may detect road surface deterioration from a road surface image capturing the road surface of the selected area. Also, based on the selection of a determination target area in the display control unit 104, the determination unit 102 may determine an area of ​​road surface deterioration included in the selected area for which temporary repair is to be performed. Based on the selection of a calculation target area in the display control unit 104, the calculation unit 103 may calculate the amount of material to be used for temporary repair of the road surface deterioration included in the selected area.

[0060] FIG. 6 is a diagram showing an example of a screen displayed to a user. D1 in FIG. 6 displays a selected area on a map. In D1, four unit areas included in a road section displayed on a map are represented by arrows. Two of the four unit areas are selected. The user selects and deselects a unit area, for example, by clicking an arrow indicating the unit area. In D1, a triangle indicates a point where a road surface image was captured. Note that the point where the road surface image was captured may be displayed by an icon other than a triangle. Also, the point in the unit area where the road surface image was captured may not be displayed.

[0061] D2 shows information about the selected unit area. Each unit area is also called a section. In FIG. 6, information about cracks is particularly displayed as an example of road surface deterioration. D2 includes the number of selected unit areas, the area of ​​road surface deterioration included in each selected unit area, and the total of each area. Furthermore, D2 includes the type, amount, and price of materials to be used for temporary repair of the road surface deterioration in that area.

[0062] D3 displays, for example, information for each unit area. For example, D3 displays indices such as the crack rate of the unit area, the International Roughness Index (IRI), the crack area, the maximum crack width, and the average crack width. The IRI may be calculated based on the value of an acceleration sensor attached to the vehicle while it is traveling. The detection unit 101 may obtain these indices together with the road surface image, and transfer the indices to the display control unit 104.

[0063] D3 may further display a road surface image received from the detection unit 101. In response to clicking on a triangle displayed in D1, the display control unit 104 may display on D3 a road surface image of a corresponding point. In response to clicking on an arrow displayed on the left or right of the road surface image, the display control unit 104 may display, for example, another road surface image of the same unit area. Alternatively, in response to clicking on the arrow, the display control unit 104 may display information of a different unit area on D3.

[0064] In D1, the color of the triangle represents the degree of deterioration of the road surface at the point corresponding to the position of the triangle on the map. The degree of deterioration of the point is detected from a road surface image captured at the point. In FIG. 6, for example, the darker the color of the triangle, the more the road surface deterioration at the point is advanced. The degree of deterioration of the road surface may be calculated based on at least one of the indexes of the shape, size, area, or crack rate of the road surface deterioration. The shape of the road surface deterioration generally progresses from linear cracks, tortoiseshell cracks, to potholes. The degree of deterioration of the road surface may be calculated based on the presence or absence of dust emission from the road surface deterioration point such as cracks. The generation of dust can be detected from the road surface image.

[0065] Also, in D1, the color of the arrow indicates the degree of progress of road surface deterioration in the unit area. In FIG. 6, for example, the darker the color of the arrow, the more progressed the road surface deterioration in the unit area is. The degree of progress of road surface deterioration in the unit area may be represented by an average of the degrees of progress of road surface deterioration detected from a plurality of road surface images in the unit area. Also, the degree of progress of road surface deterioration in the unit area may be calculated from the value of a sensor attached to a vehicle, such as an IRI. The degree of progress of road surface deterioration may be calculated based on a combination of the degree of progress of road surface deterioration detected from the road surface images and the value of the sensor. In D1, the degree of road surface deterioration is expressed in three stages. For example, the highest stage of road surface deterioration may be expressed in red, the lowest stage in green, and the intermediate stage in yellow. However, the way of expressing the colors is not limited to this. The degree of road surface deterioration may also be expressed in two stages, or in four or more stages.

[0066] Fig. 7 is a diagram showing another example of a screen displayed to a user. Fig. 7 differs from Fig. 6 in that in D1, each unit area is represented by a rectangle. Each unit area is also called a unit.

[0067] 6 and 7 are merely examples, and the display control unit 104 may omit some of the above-mentioned information. Furthermore, the display control unit 104 may further display information other than the above-mentioned information. For example, the display control unit 104 may output the result of comparing the price of the material with the budget set by the user.

[0068] According to the above embodiment, the display control unit 104 displays the calculated amount of material. Thus, the amount of material used for temporary repair is displayed to the user. Thus, according to the embodiment, calculation of the cost required for temporary repair can be assisted. Furthermore, the display control unit 104 displays the amount of material used for temporary repair for the selected area. Thus, calculation of the cost required for temporary repair for the area of ​​interest to the user can be assisted.

[0069] [Third embodiment] 8 is a block diagram showing a configuration example of a repair support system 100 according to the third embodiment. The repair support system 100 according to the third embodiment differs from the repair support system 100 according to the second embodiment in that the repair support system 100 according to the third embodiment includes a material selection unit 105. The material selection unit 105 may be added to the repair support system 100 according to the first embodiment.

[0070] Regarding the configurations of the detection unit 101, the determination unit 102, the calculation unit 103, and the display control unit 104 according to the third embodiment, detailed description of the configurations similar to those of the first or second embodiment will be omitted.

[0071] The type of material to be used may differ depending on the road surface. Therefore, the material selection unit 105 selects the type of material to be used for the temporary repair. The material selection unit 105 may select a combination of multiple material types. The selection method will be described later.

[0072] Depending on the type of material, the amount of material used to temporarily repair the same area of ​​road deterioration may vary. For example, depending on the material, the volume is expected to change before and after use. Also, the price may vary depending on the type of material.

[0073] Therefore, the calculation unit 103 may calculate the amount of material to be used for the temporary repair for the selected type of material. The calculation unit 103 calculates the price corresponding to the amount of material to be used, for example, by referring to the price per unit amount for each type of material.

[0074] FIG. 9 is a flowchart showing an operation example of the repair support system 100 according to the third embodiment.

[0075] The detection unit 101 detects unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface (step S31). The detection unit 101 passes the detection result to the determination unit .

[0076] The determination unit 102 determines the area of ​​road surface deterioration to be temporarily repaired based on the detection result (step S32). The determination unit 102 transfers the determined area of ​​road surface deterioration to the calculation unit 103.

[0077] The material selection unit 105 selects which type of material to use (step S33). The material selection unit 105 transmits the selected type of material to the calculation unit 103. Note that step S33 may be executed before step S31 or step S32.

[0078] The calculation unit 103 calculates the amount of material to be used for the temporary repair based on the determined area and the selected type of material (step S34). The calculation unit 103 transmits the calculation result to the display control unit 104.

[0079] The display control unit 104 displays the calculated amounts of ingredients for the selected types of ingredients (step S35).

[0080] The type of material may be selected, for example, by any of the methods described below. Also, the type of material may be selected by a combination of a plurality of methods.

[0081] For example, the material selection unit 105 may select the type of material for the temporary repair according to parameters related to the road surface. The parameters related to the road surface include, for example, the pavement material, the type of road surface deterioration, the progress of road surface deterioration, the road shape, the traffic volume, and driving situation information. The material selection unit 105 acquires the parameters from, for example, the detection unit 101. Alternatively, the material selection unit 105 may acquire the parameters from a database that associates and stores location information of the position where the road surface image was captured with the parameters. The material selection unit 105 may select the type of material according to at least one of the parameters related to the road surface.

[0082] The type of material to be used varies depending on the pavement material, the type of road surface deterioration, and the degree of road surface deterioration.

[0083] The detection unit 101 may detect the material of the pavement from the road surface image. For example, the detection unit 101 may detect whether the pavement is asphalt-based or concrete-based. The detection unit 101 may also distinguish the type of road surface deterioration. For example, the detection unit 101 may detect each type of road surface deterioration including linear cracks, tortoiseshell cracks, potholes, ruts, or other irregularities in flatness. The degree of road surface deterioration may be detected from the road surface image or calculated from the value of a sensor attached to the vehicle.

[0084] The road shape indicates, for example, whether the road is straight or curved, and whether it is flat or has a slope. Since safety is particularly required on curves and slopes, a type of material that is not slippery may be selected.

[0085] Roads with heavy traffic tend to deteriorate quickly, so a more durable type of material may be selected. Note that traffic volume includes the number of vehicles or people traveling on a road per unit time.

[0086] The driving situation information indicates whether a dangerous event related to driving has occurred. The dangerous event is, for example, a traffic accident or a dangerous driving operation. A material that is not slippery or has a high durability may be selected for the road where the dangerous event has occurred.

[0087] The driving situation information may include the number of traffic accidents or the number of dangerous driving operations. The number of traffic accidents may be recorded based on the acceleration caused by the impact at the time of the collision accident acquired from the vehicle. The dangerous driving operations may be detected, for example, using the steering angle or the brake depression amount acquired from the vehicle. When the driver suddenly performs a large steering operation or applies sudden brakes, the number of dangerous operations is recorded.

[0088] The material selection unit 105 may select the type of material based on, for example, a table as shown in Fig. 10. In Fig. 10, the type of material to be used for repair is selected according to the type of road surface deterioration and the pavement material. The calculation unit 103 may calculate the amount of the selected type of material by referring to the usage amount per unit area included in the table of Fig. 10.

[0089] Furthermore, the material selection unit 105 may select the type of material based on the type of material that has been used in the past. The material selection unit 105 may select the same material as that used in the past on a road surface near the road surface on which the temporary repair is to be performed.

[0090] Nearby road surfaces are, for example, road surfaces where the same local government is responsible for temporary repairs. This is because the same materials may be used in the same local government. The material selection unit 105 refers to records related to temporary repairs in the local government. The material selection unit 105 refers to the types of materials used for repairs, which are included in the records, and selects the same or similar materials.

[0091] Alternatively, the nearby road surface may be a road surface within a predetermined distance. Road surfaces that are close to each other may have similar parameters related to the road surface, and therefore the same material may be suitable for the road surfaces. The material selection unit 105, for example, acquires information on the position of the road surface on which the temporary repair is to be performed from the detection unit 101. The material selection unit 105 refers to a record including the material used for the temporary repair and the position of the road surface on which the temporary repair was performed.

[0092] Also, the material selection unit 105 may select a material designated by the user. For example, the display control unit 104 displays a screen for accepting the selection of the type of material. The calculation unit 103 calculates the amount of the material designated by the user.

[0093] To allow the user to appropriately select the type of material, the display control unit 104 may display at least one of the price, life span, and construction characteristics of a plurality of materials in a comparative manner. The price of the material may be any of the price corresponding to the amount of material used, the price per unit area, and the price per unit amount. The life span of the material represents, for example, the period until the repair material peels off or the period until deterioration occurs. The construction characteristics include, for example, whether water or heating is required when used, and the work time until construction is completed, or the time from the start of construction until the road becomes passable.

[0094] Fig. 11 is a diagram showing an example of a material comparison screen. This type of display allows the user to consider the lifespan and price when deciding which material to use. If the lifespan of a repair material will last until the next full repair, the user can consider using a cheaper material.

[0095] Furthermore, the material selection unit 105 may select the type of material based on a budget. For example, the user sets a budget. The material selection unit 105, for example, calculates an upper limit of the amount of material that can be used within the budget for each type of material. Furthermore, the material selection unit 105 acquires the amount of material used for temporary repair calculated by the calculation unit 103. Then, the material selection unit 105 selects a type of material such that the amount of material used for temporary repair calculated by the calculation unit 103 does not exceed the upper limit of the amount of material that can be used within the budget.

[0096] The method of selecting materials based on the budget is not limited to the above. The material selection unit 105 requests the calculation unit 103 to calculate the price of the materials to be used for one or more types of materials. For example, if the calculated price of the material exceeds the budget set by the user, the material selection unit 105 requests the calculation unit 103 to calculate the price of the material when the material to be used is switched to another type of material that is cheaper. Alternatively, if multiple types of materials are combined, the material selection unit 105 requests the calculation unit 103 to calculate the price of the material when the proportion of the other type of cheaper material used is increased. In this way, the material selection unit 105 selects the type of material that can repair the unrepaired road surface deterioration of the area determined by the determination unit 102 within the budget.

[0097] Furthermore, if the difference between the price of one or more ingredients calculated by calculation unit 103 and the budget set by the user is equal to or greater than a predetermined amount and the calculated price of the ingredient is smaller, ingredient selection unit 105 may select an ingredient type with a higher price. If the difference between the calculated price of the ingredient and the budget set by the user is small, ingredient selection unit 105 does not need to select another ingredient type.

[0098] The display control unit 104 may display the types of materials selected based on the budget as in a screen shown in Fig. 12. Information such as that in Fig. 12 may be displayed together with the screens in Fig. 6 and Fig. 7. The display control unit 104 may further display on a map or on a road surface image which type of material is used for which road surface or road surface deterioration.

[0099] The calculation unit 103 may further calculate an area of ​​road surface deterioration that can be repaired within the budget when the selected material is used. For example, the calculation unit 103 obtains an area of ​​road surface deterioration that can be repaired within the budget by dividing the budget by the price of the selected material per unit area. The area of ​​road surface deterioration that can be repaired within the budget may be larger or smaller than the area of ​​road surface deterioration that requires temporary repair as determined by the determination unit 102.

[0100] The display control unit 104 may display the area of ​​road surface deterioration that can be repaired within the budget as shown in a screen as in Fig. 13. Information as in Fig. 13 may be displayed together with the screens of Fig. 6 and Fig. 7. The display control unit 104 may further display the road surface or road surface deterioration that can be repaired within the budget on a map or on a road surface image.

[0101] If the area of ​​road surface deterioration that can be repaired within the budget is larger than the area of ​​road surface deterioration for which temporary repair is required as determined by the determination unit 102, the user knows that there is a surplus in the budget. In this case, the user may add an area of ​​road surface deterioration for which temporary repair is required. In addition, the user may select a more expensive repair material.

[0102] According to the third embodiment, the material selection unit 105 selects which type of material to use. Therefore, the user can use an appropriate type of material from multiple types. Furthermore, the calculation unit 103 calculates the amount of material to be used for the selected material. Therefore, the user can properly grasp the cost of the material to be used for the temporary repair.

[0103] [Variations] The repair support system 100 according to each of the above embodiments can be modified as follows, for example.

[0104] (Displaying detection results) The display control unit 104 may display unrepaired road surface deterioration detected by the detection unit 101 on the road surface image. For example, the display control unit 104 may color the deteriorated parts of the road surface image. The display control unit 104 may display the road surface deterioration in different colors depending on the type of road surface deterioration. For example, the display control unit 104 may display vertical cracks, horizontal cracks, tortoiseshell cracks, and potholes in different colors. The display control unit 104 may further display road surface deterioration that has been temporarily repaired, lane markings, road markings, road surface, shadows, and manholes in different colors.

[0105] (Fixed detection results) There is a possibility that erroneous detection or missed detection may occur in image recognition of unrepaired road surface deterioration by the detection unit 101. The display control unit 104 may display a screen that accepts corrections to the detection result by the detection unit 101. For example, a user may select an area of ​​the road surface image on the screen, and input a correction to the detection result as to whether or not the selected area is unrepaired road surface deterioration. The detection unit 101 may output a detection result that detects unrepaired road surface deterioration based on the correction by the user. According to the above process, the detection unit 101 can correct erroneous detection.

[0106] The determination unit 102 may re-determine the area of ​​the road surface deterioration based on the correction of the detection result. The calculation unit 103 may re-calculate the amount of material to be used for the temporary repair based on the re-determination of the area. The display control unit 104 displays the re-calculated amount of material.

[0107] (Determination of temporary repair targets) The determining unit 102 may determine whether or not to perform temporary repair for the unrepaired road surface deterioration. The determining unit 102 determines the area of ​​the determined road surface deterioration.

[0108] The determination unit 102 may determine whether or not to perform temporary repair for each portion of road surface deterioration included in the same road surface image. Alternatively, whether or not to perform temporary repair may be determined for each unit area.

[0109] The road surface deterioration for which temporary repair is required may be determined, for example, by any of the methods described below. In addition, the road surface deterioration for which temporary repair is required may be determined by a combination of a plurality of methods.

[0110] For example, the determination unit 102 may determine the road surface deterioration to be temporarily repaired based on a user's input. The display control unit 104 may display a screen that accepts, from the user, the selection of the road surface deterioration to be temporarily repaired from among the detected road surface deterioration. The user may select whether or not to make the road surface deterioration a repair target by clicking on a portion of the road surface deterioration on the road surface image. Alternatively, the user may select a unit area to be repaired by clicking on a unit area on the map.

[0111] The display control unit 104 may display a result of comparing the price of materials used for the temporary repair of the selected road surface deterioration with the budget set by the user. The user may delete and add road surface deterioration to be temporarily repaired while checking the road surface deterioration that can be repaired within the budget.

[0112] The determining unit 102 may determine, as a temporary repair target, a road surface deterioration whose degree of progress satisfies a predetermined standard. The degree of progress of the road surface deterioration is determined based on, for example, a crack rate, a crack width, a crack length, a pothole diameter, or an area of ​​the road surface deterioration.

[0113] The determination unit 102 may, for example, determine that road surface deterioration whose degree of progress exceeds a lower threshold is to be subject to temporary repair. This is because minor road surface deterioration equal to or less than the lower threshold does not require temporary repair. The determination unit 102 may determine that road surface deterioration whose degree of progress is less than an upper threshold is to be subject to temporary repair. This is because major road surface deterioration equal to or greater than the upper threshold may be subject to full repair rather than temporary repair. Each threshold may be set by the user. This is because the size of the budget varies depending on the local government responsible for temporary repair.

[0114] The determination unit 102 may determine, as a target for temporary repair, a unit area in which the degree of progress of road surface deterioration in each unit area satisfies a predetermined criterion. The predetermined criterion may be either an upper limit or a lower limit of the degree of progress.

[0115] The calculation unit 103 may calculate the amount and price of materials based on the area of ​​the deteriorated road surface determined as the temporary repair target. The display control unit 104 displays the amount and price of materials to be used for the road surface that is the temporary repair target.

[0116] (Determination of repair priority) The determination unit 102 may determine the priority of temporary repair for each unit area based on the degree of progress of road surface deterioration for each unit area. For example, the determination unit 102 may determine the priority in descending order of the area of ​​road surface deterioration in the unit area.

[0117] The display control unit 104 may display the determined priorities. The user may start temporary repairs in the order of highest priority displayed.

[0118] Furthermore, the determination unit 102 may determine road surface deterioration in a unit area as a target for temporary repair in descending order of priority. The determination unit 102 determines the target for temporary repair so as not to exceed the area of ​​road surface deterioration that can be repaired within the budget, for example. The calculation unit 103 calculates the price of materials to be used for the temporary repair of the unit area determined as a target for temporary repair. By determining the priority, the determination unit 102 can determine the road surface deterioration to be repaired within the budget.

[0119] (Calculation of the amount of material used for full repair) The repair assistance system 100 may be used to calculate the amount of material to be used in a full repair.

[0120] The determination unit 102 determines, for example, the area of ​​the road surface to be fully repaired. The determination unit 102 may determine the target of the full repair based on a user's selection, or may determine the target based on the progress of road surface deterioration. The calculation unit 103 calculates the amount of material to be used for the full repair based on the determined area. The display control unit 104 displays the amount of material to be used for the full repair.

[0121] (Map location of road surface deterioration) The display control unit 104 may display the position of unrepaired road surface deterioration on a map. The display control unit 104 acquires the position of unrepaired road surface deterioration from the detection unit 101, for example. Similarly, the display control unit 104 may display the position of road surface deterioration that has been temporarily repaired on a map. The display control unit 104 may display unrepaired road surface deterioration and temporarily repaired road surface deterioration using different icons.

[0122] Furthermore, the display control unit 104 may display on the map the location of road surface deterioration that is to be temporarily repaired among unrepaired road surface deterioration. The display control unit 104 may display the road surface deterioration that is to be temporarily repaired and the road surface deterioration that is not to be temporarily repaired using different icons.

[0123] (Management of deterioration of repaired road surfaces) The repair assistance system 100 may include a management unit that manages the repaired road surface deterioration. For example, the management unit generates a record regarding the temporary repair. The record may include the location of the road surface where the temporary repair was performed and the time of the temporary repair.

[0124] The management unit may record, based on an input by a user, that a road surface deterioration detected in the past has been repaired. The determination unit 102 may exclude the repaired road surface deterioration from the repair target by referring to the record.

[0125] Alternatively, the management unit may generate a history of temporary repairs based on the detection results. The detection unit 101 detects that unrepaired road surface deterioration has been repaired by comparing road surface images captured at two points in time. Similarly, the detection unit 101 may detect peeling of repair material or deterioration of the repair material. The management unit records the positions of the road surface from which the repair material has peeled and the deteriorated road surface.

[0126] [Hardware configuration] In the above-described embodiment, each component of the repair support system 100 is represented as a functional block. A part or all of the components of the repair support system 100 may be realized by any combination of the computer 500 and a program.

[0127] Fig. 14 is a block diagram showing an example of a hardware configuration of a computer 500. Referring to Fig. 14, the computer 500 includes, for example, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, a program 504, a storage device 505, a drive device 507, a communication interface 508, an input device 509, an input / output interface 511, and a bus 512.

[0128] The program 504 includes instructions for implementing each function of the repair support system 100. The program 504 is stored in advance in the ROM 502, the RAM 503, or the storage device 505. The CPU 501 implements each function of each device by executing the instructions included in the program 504. For example, the CPU 501 of the repair support system 100 implements the functions of the repair support system 100 by executing the instructions included in the program 504. The RAM 503 may also store data to be processed in each function of the repair support system 100. For example, a road surface image may be stored in the RAM 503 of the computer 500.

[0129] The drive device 507 reads and writes data from and to the recording medium 506. The communication interface 508 provides an interface with a communication network. The input device 509 is, for example, a mouse or a keyboard, and receives information input from a user. The output device 510 is, for example, a display, and outputs (displays) information to the user. The input / output interface 511 provides an interface with peripheral devices. The bus 512 connects these hardware components. The program 504 may be supplied to the CPU 501 via a communication network, or may be stored in advance in the recording medium 506, read by the drive device 507, and supplied to the CPU 501.

[0130] It should be noted that the hardware configuration shown in FIG. 14 is merely an example, and other components may be added, or some components may not be included.

[0131] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be realized by any combination of a single computer and program.

[0132] In addition, some or all of the components of each device may be realized by general-purpose or dedicated circuits including a processor, etc., or a combination of these. These circuits may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program.

[0133] Furthermore, when some or all of the components of each device are realized by a plurality of computers, circuits, etc., the plurality of computers, circuits, etc. may be arranged in a centralized manner or in a distributed manner.

[0134] At least a part of the repair support system 100 may be provided in a Software as a Service (SaaS) format. That is, at least a part of the functions for realizing the repair support system 100 may be executed by software executed via a network.

[0135] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, the configurations in the embodiments and each modified example can be combined with each other without departing from the scope of the present disclosure.

[0136] A part or all of the above-described embodiments may be described as, but are not limited to, the following supplementary notes.

[0137] [Appendix 1] A detection means for detecting unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface; A determination means for determining an area of ​​road surface deterioration to be temporarily repaired based on the detection result; a calculation means for calculating an amount of material to be used for the temporary repair of the road surface based on the determined area; A repair support system equipped with: [Appendix 2] The determining means determines the area of ​​road surface deterioration to be temporarily repaired, the area being included in one or more of the areas obtained by dividing the road surface into a predetermined range; The calculation means calculates the amount of the material to be used in the one or more regions. 2. A repair assistance system as described in appendix 1. [Appendix 3] The device further includes a material selection means for selecting the type of material to be used for the temporary repair. 3. A repair support system according to claim 1 or 2. [Appendix 4] The material selection means selects the type of material depending on at least one of the pavement material, the type of road surface deterioration, the progress of the road surface deterioration, the road shape, the traffic volume, and the driving situation information. 4. A repair assistance system as described in appendix 3. [Appendix 5] The material selection means selects the type of material based on the type of material used in the past. 5. A repair support system according to claim 3 or 4. [Appendix 6] The display control means further includes a display control means for displaying at least one of the prices, life spans, and construction features of a plurality of materials in a comparative manner. A repair support system according to any one of appendix 3 to 5. [Appendix 7] The material selection means receives a selection of a type of material from a user. A repair support system according to any one of appendix 3 to 6. [Appendix 8] The calculation means calculates an area of ​​road surface deterioration that can be repaired within the budget based on the price of the material per area when the selected material is used. A repair support system according to any one of appendix 3 to 7. [Appendix 9] The calculation means calculates a price of the material corresponding to the calculated amount of the material; The material selection means selects the type of material based on a budget. A repair support system according to any one of appendix 3 to 8. [Appendix 10] The calculation means calculates a price of the material corresponding to the calculated amount of the material. A repair support system according to any one of appendix 1 to 8. [Appendix 11] The determination means determines whether or not to perform temporary repairs for unrepaired road surface deterioration. A repair support system according to any one of claims 1 to 10. [Appendix 12] The determining means determines a priority of temporary repair for each area based on a degree of road surface deterioration for each area. A repair support system according to any one of claims 1 to 11. [Appendix 13] The detection means further detects road surface deterioration that has been temporarily repaired from the road surface image. A repair support system according to any one of appendix 1 to 12. [Appendix 14] Unrepaired road surface deterioration is detected from road surface images, Based on the detection results, the area of ​​road surface deterioration to be temporarily repaired is determined; Calculate the amount of material to be used for the temporary road surface repair based on the determined area. Repair assistance methods. [Appendix 15] Unrepaired road surface deterioration is detected from road surface images, Based on the detection results, the area of ​​unrepaired road surface deterioration is determined; calculating an amount of material to be used for the temporary road surface repair based on the determined area; A recording medium that non-temporarily records a program that causes a computer to execute a process. [Explanation of symbols]

[0138] 100 Repair Support System 101 Detection unit 102 Decision Section 103 Calculation section 104 Display control unit 105 Material Selection Section

Claims

1. A detection means for detecting unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface; A determination means for determining an area of ​​road surface deterioration to be repaired based on the detection result; a calculation means for calculating an amount of material to be used to repair the road surface based on the determined area; A display control means for displaying at least one of the prices, life spans, and construction features of the plurality of materials in a comparative manner; A repair support system.

2. A repair support system as described in claim 1, further comprising a material selection means for selecting the type of material to be used for the repair.

3. A detection means for detecting unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface; A determination means for determining an area of ​​road surface deterioration to be repaired based on the detection result; a calculation means for calculating an amount of material to be used to repair the road surface based on the determined area; Equipped with A repair support system, wherein the calculation means calculates an area of ​​the road surface deterioration that can be repaired within the repair budget based on the price of the material per area.

4. Further comprising a material selection means for selecting a type of material to be used for the repair, The repair assistance system according to claim 3, wherein the calculation means calculates an area of ​​the road surface deterioration that can be repaired within the repair budget based on a price per area of ​​the selected material when the selected material is used for the repair.

5. A detection means for detecting unrepaired road surface deterioration from a road surface image obtained by capturing an image of the road surface; A determination means for determining an area of ​​road surface deterioration to be repaired based on the detection result; a calculation means for calculating an amount of material to be used for repairing the road surface based on the determined area, and calculating a price of the material corresponding to the amount of material; a material selection means for selecting a type of material to be used for the repair based on the price of the material and the budget for the repair; A repair support system.

6. The determining means determines the area of ​​road surface deterioration to be repaired, which is included in one or more of the areas obtained by dividing the road surface into a predetermined range, The calculation means calculates the amount of the material to be used to repair the road surface in the one or more regions. The repair support system according to any one of claims 1 to 5.

7. The material selection means selects the type of material to be used for repairing the road surface according to at least one of the pavement material, the type of road surface deterioration, the progress of the road surface deterioration, the road shape, the traffic volume, and the driving condition information. The repair support system according to any one of claims 2, 4 and 5.

8. The material selection means receives a selection of a type of material from a user. The repair support system according to any one of claims 2, 4, 5 and 7.

9. Unrepaired road surface deterioration is detected from road surface images, Based on the detection results, the area of ​​road surface deterioration to be repaired is determined; Calculating an amount of material to be used to repair the road surface based on the determined area; At least one of the prices, life spans, and construction features of the plurality of materials is displayed in a comparative manner. Repair assistance methods.

10. Unrepaired road surface deterioration is detected from road surface images, Based on the detection results, the area of ​​road surface deterioration to be repaired is determined; Calculating an amount of material to be used to repair the road surface based on the determined area; At least one of the prices, life spans, and construction features of the plurality of materials is displayed in a comparative manner. A program that causes a computer to carry out processing.

Images