Information processing device, information processing method, and information processing program

Abstract

To easily estimate a road surface state from vehicle state information on a plurality of vehicles using a learned model which is preliminarily generated by machine learning.SOLUTION: An information processing device 13 acquires vehicle state information with regard to each of a plurality of vehicles. The information processing device 13 estimates information on the state of a road surface on which each of the plurality of vehicles has traveled, on the basis of the acquired vehicle state information with regard to each of the plurality of vehicles. The information processing device 13 inputs the acquired vehicle state information to a learned model that outputs the road surface state information upon input of the vehicle state information and which has preliminarily been learned using learning data in which the vehicle state information and the road surface state information are correlated, thereby estimating the road surface state information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, a road surface evaluation device that eliminates sensor installation location dependency in a road surface diagnosis method using vehicle response is known (see, for example, Patent Document 1). The road surface evaluation device of Patent Document 1 synchronizes and records the pitching angular velocity of a vehicle acquired by an angular velocity sensor with GPS information acquired by a GPS. Then, the road surface evaluation device estimates the acceleration response of a quarter car, which is a virtual vehicle serving as a reference, from the angular velocity response of the measurement vehicle using a transfer function from the acquired pitching angular velocity of the vehicle. Then, the road surface evaluation device estimates an International Roughness Index (IRI) from the estimated acceleration response of the quarter car using a correlation function. Note that the technology of Patent Document 1 proposes an IRI estimation method using a smartphone (for example, paragraph

[0051] ), in which the smartphone is fixed to the front center of the vehicle using double-sided tape (for example, paragraph

[0054] ), and various values ​​are measured using the smartphone.

[0003] There is also known a technology that allows a user to more easily plan maintenance plans according to the type of road abnormality (see, for example, Patent Document 2). The display processing device of Patent Document 2 detects a first abnormal section, which is a road section whose road condition is a first abnormality, and a second abnormal section, which is a road section whose road condition is a second abnormality different from the first abnormality, based on vehicle information from a plurality of vehicles. Then, the display processing device assigns status information in a first display mode to the first abnormal section among the roads on the displayed map, and assigns status information in a second display mode different from the first display mode to the second abnormal section, and displays them on the display device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-028456 A [Patent Document 2] Patent Publication No. 2021-033130 Summary of the Invention [Problem to be solved by the invention]

[0005] The technology disclosed in Patent Document 1 cannot obtain road surface condition information (for example, road surface roughness information indicating the roughness of the road surface) that indicates the condition of the road surface of the road on which a vehicle not equipped with a smartphone has traveled. Therefore, the technology in Patent Document 1 has a problem in that it cannot obtain road surface condition information for more roads.

[0006] Furthermore, the display processing device disclosed in Patent Document 2 estimates road conditions based on vehicle information from multiple vehicles and displays the road conditions. However, the display processing device disclosed in Patent Document 2 requires complex processing, such as determining that the road conditions in the target section are abnormal when the maximum wheel speed fluctuation rate of all target vehicles in the target section is equal to or greater than a threshold value, or when the avoidance behavior ratio is equal to or greater than a threshold value (for example, paragraph

[0093] of Patent Document 2). For this reason, the technology in Patent Document 2 has the problem that it cannot easily estimate road surface condition information.

[0007] For this reason, the conventional technology has a problem in that it is not possible to easily estimate road surface conditions from vehicle condition information of multiple vehicles.

[0008] In consideration of the above facts, the present disclosure aims to easily estimate road surface conditions from vehicle condition information of multiple vehicles using a trained model generated in advance by machine learning. [Means for solving the problem]

[0009] A first aspect of the present disclosure is an information processing device that has an acquisition unit that acquires vehicle state information for each of a plurality of vehicles, and an estimation unit that estimates road surface state information on which each of the plurality of vehicles has traveled based on the vehicle state information for each of the plurality of vehicles acquired by the acquisition unit, wherein the estimation unit is a trained model that outputs the road surface state information when the vehicle state information is input, and estimates the road surface state information by inputting the vehicle state information acquired by the acquisition unit to a trained model that has been trained in advance based on learning data in which the vehicle state information and the road surface state information are associated with each other.

[0010] The information processing device of the first aspect of the present disclosure acquires vehicle state information for each of a plurality of vehicles. The information processing device estimates road surface state information on which each of the plurality of vehicles has traveled, based on the acquired vehicle state information for each of the plurality of vehicles. The information processing device estimates the road surface state information by inputting the vehicle state information to a trained model that outputs road surface state information when the vehicle state information is input, and that has been trained in advance based on learning data in which the vehicle state information and the road surface state information are associated with each other. According to the information processing device of the first aspect of the present disclosure, it is possible to easily estimate the road surface state from the vehicle state information of the plurality of vehicles, using the trained model that has been generated in advance by machine learning.

[0011] The information processing device according to the second aspect of the present disclosure further includes a driving route generating unit that generates a driving route for a vehicle without including a road corresponding to the road surface in the driving route for the vehicle when the road surface condition information of the road surface indicates an abnormal state, thereby making it possible to present a driving route that avoids roads whose road surfaces are in an abnormal state.

[0012] The vehicle state information of the information processing device of the third aspect of the present disclosure includes at least one of information representing the longitudinal vehicle body acceleration of the vehicle, information representing the lateral vehicle body acceleration of the vehicle, and information representing the yaw rate of the vehicle. This makes it possible to accurately estimate road surface state information using at least one of information representing the longitudinal vehicle body acceleration of the vehicle, information representing the lateral vehicle body acceleration of the vehicle, and information representing the yaw rate of the vehicle, which are considered to be affected by road surface conditions.

[0013] The vehicle condition information of the information processing device according to the fourth aspect of the present disclosure includes wheel speed information representing a wheel speed of the vehicle. This makes it possible to accurately estimate road surface condition information using the wheel speed that is considered to be affected by the road surface condition.

[0014] The estimation unit of the information processing device according to the fifth aspect of the present disclosure calculates a differential value of the wheel speed of the vehicle by differentiating wheel speed information representing the wheel speed of the vehicle included in the vehicle state information of the vehicle, and estimates the road surface state information of the road surface on which the vehicle has traveled by inputting the differential value of the wheel speed of the vehicle to the trained model. This makes it possible to accurately estimate road surface state information using the differential value of the wheel speed that is considered to be affected by the road surface state.

[0015] The acquisition unit of the information processing device of the sixth aspect of the present disclosure acquires the travel information from a storage unit in which travel information representing a combination of the vehicle state information for each of a plurality of vehicles and position information at the time when the vehicle state information was acquired is stored, the estimation unit estimates the road surface state information on which the vehicle traveled based on the vehicle state information in the travel information of the vehicle acquired by the acquisition unit for each of the plurality of vehicles, and further includes a generation unit that generates map data to which the road surface state information is added by adding the road surface state information to a position in map data corresponding to the position information based on the position information in the travel information of the vehicle acquired by the acquisition unit and the estimated road surface state information for each of the plurality of vehicles. This makes it possible to visualize information on the road surface state of a plurality of roads.

[0016] The information processing method of the seventh aspect of the present disclosure is an information processing method in which a computer executes a process to acquire vehicle state information for each of a plurality of vehicles, estimate road surface state information on which each of the plurality of vehicles has traveled based on the acquired vehicle state information for each of the plurality of vehicles, and, when estimating the road surface state information, estimate the road surface state information by inputting the acquired vehicle state information into a trained model that outputs the road surface state information when the vehicle state information is input and that has been trained in advance based on learning data in which the vehicle state information and the road surface state information are associated with each other. As in the first aspect, the seventh aspect of the present disclosure is an information processing method in which a computer executes a process to acquire vehicle state information for each of a plurality of vehicles, estimates the road surface state information by inputting the acquired vehicle state information into a trained model that is trained in advance based on learning data in which the vehicle state information and the road surface state information are associated with each other. Similarly to the first aspect, the seventh aspect of the present disclosure can easily estimate a road surface state from the vehicle state information of a plurality of vehicles using a trained model that is generated in advance by machine learning.

[0017] An information processing program according to an eighth aspect of the present disclosure is an information processing program for causing a computer to execute a process of acquiring vehicle state information for each of a plurality of vehicles, estimating road surface state information on which each of the plurality of vehicles has traveled based on the acquired vehicle state information for each of the plurality of vehicles, and estimating the road surface state information by inputting the acquired vehicle state information into a trained model that outputs the road surface state information when the vehicle state information is input and that has been trained in advance based on learning data in which the vehicle state information and the road surface state information are associated with each other. As in the first aspect, the eighth aspect of the present disclosure is an information processing program for causing a computer to execute a process of acquiring vehicle state information for each of a plurality of vehicles, estimating the road surface state information from the vehicle state information of the plurality of vehicles by using a trained model that has been generated in advance by machine learning.

[0018] A ninth aspect of the present disclosure is an information processing device that includes an acquisition unit that acquires driving information from a memory unit in which driving information representing a combination of vehicle state information representing the driving state of the vehicle obtained when the vehicle is driving and position information on the road where the vehicle has driven is stored for each of a plurality of vehicles; an estimation unit that estimates road surface roughness information of the road surface on which the vehicle has driven based on the vehicle state information from the driving information of the vehicle acquired by the acquisition unit for each of the plurality of vehicles; and a generation unit that generates map data to which the road surface roughness information has been added by adding the road surface roughness information to a position in map data corresponding to the position information for each of the plurality of vehicles based on the position information from the driving information of the vehicle acquired by the acquisition unit and the road surface roughness information estimated by the estimation unit for each of the plurality of vehicles.

[0019] The information processing device of the ninth aspect of the present disclosure acquires driving information for each of a plurality of vehicles from a storage unit in which driving information representing a combination of vehicle state information representing a driving state of the vehicle obtained when the vehicle is driven and position information on the road on which the vehicle has driven is stored. Then, for each of the plurality of vehicles, the information processing device estimates road surface roughness information of the road surface on which the vehicle has driven based on the vehicle state information in the acquired vehicle driving information. For each of the plurality of vehicles, the information processing device generates map data to which road surface roughness information has been added by adding the road surface roughness information to a position in the map data corresponding to the position information based on the position information in the acquired vehicle driving information and the estimated road surface roughness information. This makes it possible to visualize information regarding the road surface roughness of a plurality of roads.

[0020] The vehicle state information of the information processing device of the tenth aspect of the present disclosure includes wheel speed information representing a wheel speed of the vehicle. This makes it possible to accurately estimate road surface roughness information using the wheel speed that is considered to be affected by road surface roughness.

[0021] The estimation unit of the information processing device of the eleventh aspect of the present disclosure estimates the road surface roughness information of the road surface on which the vehicle has traveled by inputting the vehicle state information acquired by the acquisition unit into a trained model that outputs road surface roughness information on which the vehicle has traveled when the vehicle state information of the vehicle is input, and that has been trained in advance based on training data in which the vehicle state information for training and the road surface roughness information for training are associated with each other. This makes it possible to accurately estimate the road surface roughness information using the trained model generated based on training data in which the vehicle state information for training and the road surface roughness information for training are associated with each other.

[0022] The estimation unit of the information processing device of the twelfth aspect of the present disclosure calculates a differential value of the wheel speed of the vehicle by differentiating wheel speed information representing the wheel speed of the vehicle included in the vehicle state information of the vehicle, and estimates road surface roughness information of the road surface on which the vehicle has traveled by inputting the vehicle state information including the differential value of the wheel speed of the vehicle to the trained model. This makes it possible to accurately estimate road surface roughness information using the differential value of the wheel speed that is considered to be affected by road surface roughness.

[0023] The vehicle state information of the information processing device of the thirteenth aspect of the present disclosure includes at least one of information representing the longitudinal vehicle body acceleration of the vehicle, information representing the lateral vehicle body acceleration of the vehicle, and information representing the yaw rate of the vehicle. This makes it possible to accurately estimate road surface roughness information using at least one of information representing the longitudinal vehicle body acceleration of the vehicle, information representing the lateral vehicle body acceleration of the vehicle, and information representing the yaw rate of the vehicle, which are considered to be affected by road surface roughness.

[0024] A fourteenth aspect of the present disclosure is an information processing method in which a computer executes a process of acquiring driving information representing a combination of vehicle state information representing a driving state of each of a plurality of vehicles obtained when the vehicle is traveling and position information on the road where the vehicle has traveled from a storage unit in which the driving information is stored, estimating road surface roughness information of the road surface on which the vehicle has traveled based on the vehicle state information in the acquired driving information of the vehicle for each of the plurality of vehicles, and generating map data to which the road surface roughness information has been added by adding the road surface roughness information to a position corresponding to the position information in the map data based on the position information in the acquired driving information of the vehicle and the estimated road surface roughness information for each of the plurality of vehicles. The fourteenth aspect of the present disclosure is capable of visualizing information on the road surface roughness of a plurality of roads, similar to the ninth aspect.

[0025] A fifteenth aspect of the present disclosure is an information processing program for causing a computer to execute a process of acquiring driving information representing a combination of vehicle state information representing a driving state of each of a plurality of vehicles obtained when the vehicle is traveling and position information on which the vehicle has traveled from a storage unit storing the driving information, estimating road surface roughness information of a road surface on which the vehicle has traveled based on the vehicle state information of the acquired driving information of the vehicle for each of the plurality of vehicles, and generating map data to which the road surface roughness information has been added by adding the road surface roughness information to a position corresponding to the position information in map data based on the position information of the acquired driving information of the vehicle and the estimated road surface roughness information for each of the plurality of vehicles. The fifteenth aspect of the present disclosure is capable of visualizing information on the road surface roughness of a plurality of roads, similar to the ninth aspect. Effect of the Invention

[0026] As described above, the present disclosure has the advantage of being able to easily estimate road surface conditions from vehicle condition information of multiple vehicles using a trained model generated in advance by machine learning. [Brief description of the drawings]

[0027] [Figure 1] 1 is a schematic block diagram of an information processing system according to an embodiment. [Diagram 2] 4A to 4C are diagrams for explaining an example of travel information and sensor information according to an embodiment; [Diagram 3] FIG. 1 is a diagram for explaining a trained model of an embodiment. [Figure 4] FIG. 13 is a diagram showing a single wheel spring mass model. [Diagram 5] FIG. 4 is a diagram showing the relationship between tire radius and ground load. [Figure 6] FIG. 1 is a diagram illustrating an example of learning data used to generate a trained model. [Figure 7] FIG. 1 is a diagram showing an example of map data with IRIs of road surfaces. [Figure 8] FIG. 2 is a diagram illustrating an example of the configuration of a computer that constitutes an information processing device. [Figure 9] FIG. 2 is a diagram illustrating an example of information processing executed by the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0028] <Embodiment>

[0029] The information processing system of this embodiment will be described below with reference to the drawings.

[0030] FIG. 1 is a block diagram showing an example of the configuration of an information processing system 10 according to this embodiment. As shown in FIG. 1, the information processing system 10 includes a plurality of vehicles 11-1, 11-2, and 11-3, and an information processing device 13. The plurality of vehicles 11-1, 11-2, and 11-3 and the information processing device 13 are communicatively connected by a predetermined communication means NW. In the following, any one of the plurality of vehicles 11-1, 11-2, and 11-3 will simply be referred to as a "vehicle 11." In the example of FIG. 1, three vehicles 11-1, 11-2, and 11-3 are shown, but more vehicles may be present.

[0031] (Vehicle 11) The vehicle 11 is equipped with a GPS (Global Positioning System) 110, a wheel speed sensor 112, an acceleration sensor 114, a yaw rate sensor 116, and a vehicle control device 118. The vehicle control device 118 is, for example, an ECU (Electronic Control Unit).

[0032] The GPS 110 sequentially acquires the position information of the vehicle 11 .

[0033] The wheel speed sensor 112 sequentially acquires wheel speed information indicating the wheel speed of the vehicle 11 .

[0034] The acceleration sensor 114 sequentially acquires front-rear vehicle body acceleration information representing the front-rear vehicle body acceleration of the vehicle 11 and left-right vehicle body acceleration information representing the left-right vehicle body acceleration of the vehicle 11 .

[0035] The yaw rate sensor 116 sequentially acquires yaw rate information indicating the yaw rate of the vehicle 11 .

[0036] (Vehicle control device 118) As shown in FIG. 1, the vehicle control device 118 functionally comprises a control unit 120, an information storage unit 122, and a transmission / reception unit .

[0037] The control unit 120 sequentially acquires position information acquired by the GPS 110, wheel speed information acquired by the wheel speed sensor 112, front / rear vehicle body acceleration information and left / right vehicle body acceleration information acquired by the acceleration sensor 114, and yaw rate information acquired by the yaw rate sensor 116, and stores these pieces of information in association with time information in the information storage unit 122. The time information indicates the time when each piece of information was acquired by each sensor.

[0038] The information storage unit 122 stores position information, wheel speed information, front and rear vehicle body acceleration information, left and right vehicle body acceleration information, and yaw rate information of the vehicle 11 at each time.

[0039] The transmitter / receiver 124 transmits, every time a predetermined time elapses, the position information, wheel speed information, front / rear vehicle body acceleration information, left / right vehicle body acceleration information, and yaw rate information of the vehicle 11, which are stored in the information storage unit 122, as well as time information when these pieces of information were acquired, to the information processing device 13. Note that, hereinafter, the wheel speed information, front / rear vehicle body acceleration information, left / right vehicle body acceleration information, and yaw rate information are also simply referred to as "sensor information".

[0040] (Information processing device 13) As shown in FIG. 1, the information processing device 13 functionally includes a reception unit 130, a driving information storage unit 132, a trained model storage unit 134, an acquisition unit 136, an estimation unit 138, a generation unit 140, and a display control unit 142.

[0041] The reception unit 130 receives various information transmitted from the vehicle control device 118 of each of the multiple vehicles 11-1, 11-2, and 11-3. Specifically, the reception unit 130 receives a combination of position information, sensor information, and time information transmitted from the vehicle control device 118 of each of the multiple vehicles 11-1, 11-2, and 11-3, and stores the information in the travel information storage unit 132 as travel information.

[0042] The travel information storage unit 132 stores travel information that is a combination of position information and sensor information transmitted from the vehicle control devices 118 of the multiple vehicles 11-1, 11-2, and 11-3.

[0043] Fig. 2 shows an example of the driving information stored in the driving information storage unit 132. In the example shown in Fig. 2, a vehicle ID, which is identification information of the vehicle 11, time information, position information, and sensor information are stored in association with each other. The combination of the position information and the sensor information at each time transmitted from the vehicle control device 118 constitutes the driving information.

[0044] The trained model storage unit 134 stores a trained model that outputs road surface condition information on which the vehicle 11 has traveled when differential value information of the wheel speed of the vehicle 11, front-rear vehicle body acceleration information, left-right vehicle body acceleration information, yaw rate information, and time information are input. Note that hereinafter, the wheel speed differential value information, front-rear vehicle body acceleration information, left-right vehicle body acceleration information, and yaw rate information are also simply referred to as "vehicle condition information." Note that the trained model of this embodiment outputs road surface roughness information that indicates the roughness of the road surface as an example of road surface condition information.

[0045] FIG. 3 shows an example of the trained model of this embodiment. As shown in FIG. 3, when time information and vehicle state information are input, the trained model of this embodiment outputs road surface roughness information of the road surface on which the vehicle 11 has traveled. In addition, in the wheel speed differential value information, "FR" represents the differential value of the wheel speed of the right front wheel of the vehicle 11, "FL" represents the differential value of the wheel speed of the left front wheel of the vehicle 11, "RR" represents the differential value of the wheel speed of the right rear wheel of the vehicle 11, and "RL" represents the differential value of the wheel speed of the left rear wheel of the vehicle 11. Since the trained model of this embodiment is an LSTM (Long Short Term Memory) network, which is a type of neural network model, time information when the vehicle state information is acquired is also input. In addition, a, b, c,..., h in the trained model of FIG. 3 represent each node of the input layer, and A, B, C, D,... represent each node of the intermediate layer. In the example of Figure 3, the number of nodes in the input layer is 8, and the number of nodes in the intermediate layer is 200. Weight parameters are added to the edges connecting these nodes, and these weight parameters are adjusted in advance by machine learning.

[0046] The trained model of this embodiment outputs an International Roughness Index (IRI), which is an example of road surface roughness information, as shown in Fig. 3. Using this trained model, the IRI of the road surface on which the vehicle 11 has traveled is estimated. In this embodiment, the differential value of the wheel speed is adopted as a factor for estimating the IRI of the road surface.

[0047] Here, the relationship between the IRI of the road surface and the differential value of the wheel speed will be explained below.

[0048] FIG. 4 shows a diagram of a known single wheel spring-mass model. As shown in FIG. 4, the single wheel spring-mass model has a sprung mass m s and the unsprung mass m u The coil Co, the absorber Ab, and the simulated tire Ti are modeled. S represents the spring, and the sprung mass m s Also, the displacement of X in Fig. 4 U represents the unsprung mass m u represents the displacement of X O represents the ground and represents the displacement of the contact surface.

[0049] As shown in the following equation, the IRI of the road surface is the ratio of the cumulative value of the vertical motion displacement experienced by a vehicle in a single wheel spring mass model when the vehicle is traveling at a constant speed to the travel distance L. Note that the dots in the following equations "·" represent differentiation.

[0050]

number

[0051] In this embodiment, the IRI of the road surface is estimated using a trained model without calculating the above formula.

[0052] FIG. 5 shows the relationship between tire radius and ground load. In FIG. 5, V represents the vehicle speed, r represents the tire radius, ω represents the wheel speed, O represents the center of the tire T, and F t represents the ground contact load received by the tire T, and δ represents the amount of change.

[0053] Considering the single wheel spring mass model shown in FIG. 4 and the relationship shown in FIG. 5, the following equation is derived. t represents the spring constant of the tire.

[0054]

number

[0055] The change in wheel speed δω and the change in the ground load on the tire δF t Therefore, the wheel speed ω is proportional to the ground load F t As shown in Fig. 5, the tire T is affected by the ground load F t is a quantity related to the IRI, which is the road surface roughness. Therefore, it is believed that if the wheel speed ω is used to estimate the IRI of the road surface, the IRI of the road surface can be estimated with high accuracy.

[0056] Therefore, in this embodiment, the IRI of the road surface is estimated by using the wheel speed ω when estimating the IRI of the road surface. Specifically, the IRI of the road surface is estimated with high accuracy by including a differential value of the wheel speed ω in the input of the trained model. Note that, as shown in the above formula, the change amount δω of the wheel speed is proportional to the change amount δF of the ground contact load. t Therefore, in this embodiment, the IRI of the road surface is estimated by inputting the differential value of the wheel speed ω to the learned model.

[0057] The trained model in Fig. 3 is generated by performing machine learning in advance based on training data collected in advance. Specifically, the trained model in this embodiment is generated by performing machine learning in advance based on training data as shown in Fig. 6.

[0058] The acquisition unit 136 acquires, from the travel information storage unit 132, the travel information of each of the multiple vehicles 11-1, 11-2, and 11-3.

[0059] The estimation unit 138 acquires wheel speed information for each of the vehicles 11-1, 11-2, and 11-3 from the sensor information included in the travel information of the vehicle 11 acquired by the acquisition unit 136. Next, the estimation unit 138 calculates wheel speed differential value information by differentiating the wheel speed information for each of the vehicles 11-1, 11-2, and 11-3. The estimation unit 138 sets a combination of the wheel speed differential value information, front-rear vehicle body acceleration information, left-right vehicle body acceleration information, and yaw rate information as vehicle state information of the vehicle 11 for each of the vehicles 11-1, 11-2, and 11-3.

[0060] Then, the estimation unit 138 inputs the vehicle state information and time information of each of the multiple vehicles 11-1, 11-2, and 11-3 into the learned model stored in the learned model memory unit 134, thereby estimating the IRI of the road surface on which each of the multiple vehicles 11-1, 11-2, and 11-3 has traveled.

[0061] The generation unit 140 generates map data with the IRI of the road surface added by adding the IRI of the road surface to a position in the map data corresponding to the position information of the driving information of the vehicle 11 based on the position information of the vehicle 11 acquired by the acquisition unit 136 and the IRI of the road surface estimated by the estimation unit 138 for each of the multiple vehicles 11-1, 11-2, 11-3.

[0062] The display control unit 142 controls the map data to which the IRI generated by the generation unit 140 is added to be displayed on a display device (not shown). Note that the display control unit 142 may store the map data to which the IRI of the road surface generated by the generation unit 140 is added in a predetermined storage unit (not shown).

[0063] FIG. 7 shows an example of map data to which the IRI of a road surface has been added. The dots in FIG. 7 represent roads to which an IRI has been added. For example, the map data in FIG. 7 may be displayed so that the higher the IRI value of the road surface, the darker the dot is, and the lower the IRI value of the road surface, the lighter the dot is. Alternatively, for example, the IRI value of the road surface may be represented by color. This allows the surface roughness information of multiple roads to be properly visualized.

[0064] The information processing device 13 can be realized by, for example, a computer 50 as shown in Fig. 8. The computer 50 includes a CPU 51, a memory 52 as a temporary storage area, and a non-volatile storage unit 53. The computer 50 also includes an input / output interface (I / F) 54 to which an input / output device or the like (not shown) is connected, and a read / write (R / W) unit 55 that controls reading and writing of data from and to a recording medium 59. The computer 50 also includes a network I / F 56 that is connected to a network such as the Internet. The CPU 51, the memory 52, the storage unit 53, the input / output I / F 54, the R / W unit 55, and the network I / F 56 are connected to one another via a bus 57.

[0065] The storage unit 53 can be realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. The storage unit 53 as a storage medium stores a program for operating the computer 50. The CPU 51 reads the program from the storage unit 53, expands it in the memory 52, and sequentially executes the processes contained in the program.

[0066] Next, the operation of the information processing device 13 of the embodiment will be described.

[0067] The vehicle control devices 118 of the multiple vehicles 11-1, 11-2, and 11-3 sequentially transmit position information and sensor information at each time to the information processing device 13, whereby multiple pieces of travel information are stored in the travel information storage unit 132 of the information processing device 13. Then, when the information processing device 13 receives an instruction signal to generate map data with an IRI, the information processing device 13 executes an information processing routine shown in FIG.

[0068] In step S100, the acquisition unit 136 acquires, from the travel information storage unit 132, the travel information of each of the plurality of vehicles 11-1, 11-2, and 11-3 and time information indicating the time when the travel information was acquired.

[0069] In step S102, the estimation unit 138 reads out the trained model stored in the trained model storage unit 134.

[0070] In step S104, the estimation unit 138 calculates a differential value of the wheel speed by differentiating the wheel speed information of the vehicle state information of each of the vehicles 11-1, 11-2, and 11-3 acquired in step S100. Then, the estimation unit 138 sets the wheel speed differential value information, the front-rear vehicle body acceleration information, the left-right vehicle body acceleration information, and the yaw rate information as the vehicle state information for each of the vehicles 11-1, 11-2, and 11-3.

[0071] In step S106, the estimation unit 138 inputs the time information and vehicle state information into the learned model stored in the learned model memory unit 134, thereby estimating the IRI of the road surface on which each of the multiple vehicles 11-1, 11-2, and 11-3 has traveled.

[0072] In step S108, the generation unit 140 generates map data to which the IRI of the road surface has been added by adding the IRI of the road surface estimated in step S106 to the position in the map data corresponding to the position information obtained in step S100.

[0073] In step S110, the display control unit 142 displays the map data with the IRI generated in step S108 on a display device (not shown), and ends the information processing routine.

[0074] As described above, the information processing device 13 according to the present embodiment acquires vehicle state information for each of the multiple vehicles. The information processing device 13 estimates road surface state information on which each of the multiple vehicles has traveled, based on the acquired vehicle state information for each of the multiple vehicles. The information processing device 13 estimates road surface state information by inputting vehicle state information to a trained model that outputs road surface state information when vehicle state information is input, and that has been trained in advance based on learning data in which the vehicle state information and the road surface state information are associated with each other. This makes it possible to easily estimate the road surface state from the vehicle state information of the multiple vehicles, using the trained model that has been generated in advance by machine learning.

[0075] The information processing device 13 according to the present embodiment acquires driving information from a driving information storage unit in which driving information representing a combination of vehicle state information representing the driving state of the vehicle obtained when the vehicle is driven and position information on the road on which the vehicle has driven is stored for each of the multiple vehicles. The information processing device 13 estimates road surface roughness information of the road surface on which the vehicle has driven for each of the multiple vehicles, based on the vehicle state information in the acquired vehicle driving information. Then, the information processing device 13 generates map data to which road surface roughness information has been added by adding the road surface roughness information to a position corresponding to the position information in the map data for each of the multiple vehicles, based on the position information in the acquired vehicle driving information and the estimated road surface roughness information. This makes it possible to visualize information on the road surface roughness of multiple roads.

[0076] Moreover, the information processing device 13 according to the present embodiment can estimate the IRI of the road surface with high accuracy by using the wheel speed information of the vehicle.

[0077] In the above embodiment, the processes performed by each device have been described as software processes performed by executing a program, but they may be hardware processes. Alternatively, they may be a combination of both software and hardware processes. Furthermore, the programs stored in the ROM may be stored in various storage media and distributed.

[0078] Furthermore, the processes performed by each device in the above embodiments may be executed by one of various processors, or may be executed by a combination of two or more processors of the same or different types.

[0079] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit and scope of the present invention.

[0080] For example, in the above embodiment, a trained model is used to estimate the IRI of a road surface, but the present invention is not limited to this. For example, a predetermined correlation function such as that disclosed in Japanese Patent Application Laid-Open No. 2015-028456 may be used.

[0081] In the above embodiment, the LSTM network is used as an example, but the present invention is not limited to this. For example, other types of neural networks may be used as trained models. When a neural network other than the LSTM network is used as a trained model, the time information as input information may not be necessary.

[0082] In the above embodiment, the IRI of the road surface is estimated using the differential value information of the wheel speed, but the present invention is not limited to this. For example, the IRI of the road surface may be estimated using the wheel speed information itself. In this case, the wheel speed information, the front and rear vehicle body acceleration information, the left and right vehicle body acceleration information, and the yaw rate information are set as the vehicle state information, and when the vehicle state information is input to the trained model, the IRI of the road surface is output. In addition, instead of using the differential value information of the wheel speed or the wheel speed information, the front and rear vehicle body acceleration information, the left and right vehicle body acceleration information, and the yaw rate information as the vehicle state information, the IRI of the road surface may be estimated using at least one of the information as the vehicle state information.

[0083] In the above embodiment, the IRI is estimated as information on road surface roughness, but the present invention is not limited to this. Other types of road surface roughness information may be estimated.

[0084] In the above embodiment, the road surface roughness information is estimated as the road surface condition information, but the present invention is not limited thereto. Other types of road surface conditions may be estimated. For example, foreign object information representing the degree of presence of a foreign object on the road surface may be estimated as the road surface condition information. In this case, for example, the yaw rate information of the vehicle is input to the trained model, and the trained model outputs a probability representing the degree of presence of a foreign object as the foreign object information. When a foreign object exists on the road surface, it is expected that the vehicle will run in such a way as to quickly avoid the foreign object. In this case, the behavior of the vehicle to avoid the foreign object appears in the yaw rate of the vehicle. Therefore, a trained model is generated based on the training data in which the training yaw rate information and the training foreign object information are associated, and the trained model is used to easily and accurately estimate the foreign object information from the yaw rate information of the vehicle.

[0085] Alternatively, for example, slip information indicating the likelihood of a vehicle traveling on a road surface slipping or the likelihood of hydroplaning may be estimated as road surface condition information. For example, in rainy weather and snowfall, a vehicle traveling on a road surface is likely to slip. In this case, for example, information indicating at least one of wheel speed, vehicle speed, friction coefficient, and lateral acceleration (for example, left and right vehicle body acceleration) is input to the trained model, and the trained model outputs a probability indicating the likelihood of a vehicle slipping or the likelihood of hydroplaning as slip information. A trained model is generated based on training data in which information indicating at least one of wheel speed, vehicle speed, friction coefficient, and lateral acceleration for training is associated with training slip information, and by using the trained model, slip information can be easily and accurately estimated from information indicating at least one of wheel speed, vehicle speed, friction coefficient, and lateral acceleration.

[0086] In the above embodiment, the map data with IRI, which is an example of road surface roughness information, is displayed on a display device (not shown), but the present invention is not limited to this. For example, at least one of the information processing device 13 and the vehicle control device 118 may further include a driving route generating unit that generates a driving route for the vehicle. The driving route generating unit has a function of a so-called navigation system. In this case, for example, when the road surface condition information of the road surface indicates an abnormal state, the driving route generating unit of at least one of the information processing device 13 and the vehicle control device 118 may generate a driving route for the vehicle without including a road corresponding to the road surface in the driving route for the vehicle. For example, the driving route generating unit of at least one of the information processing device 13 and the vehicle control device 118 executes a process such as not guiding a road with a bad road surface condition as a driving route based on the estimated road surface condition information. For example, when the road surface roughness information is equal to or greater than a threshold, the foreign object information is equal to or greater than a threshold, or the road surface slippage information is equal to or greater than a threshold, the driving route generating unit determines that the road surface condition is poor or abnormal, and generates a driving route for the vehicle without including the road corresponding to the road surface in the driving route for the vehicle. This allows a driving route that avoids roads with abnormal road surfaces to be appropriately presented. [Explanation of symbols]

[0087] 10. Information Processing Systems 11 Vehicles 13. Information processing equipment 50 Computer 112 Wheel speed sensor 114 Acceleration Sensor 116 Yaw rate sensor 118 Vehicle control device 120 Control section 122 Information storage section 124 Transmitter / Receiver 130 Reception 132 Travel information storage unit 134 Trained model memory 136 Acquisition Department 138 Estimation Department 140 Generation part 142 Display control section

Claims

1. an acquisition unit that acquires vehicle state information for each of a plurality of vehicles; an estimation unit that estimates road surface condition information on which each of the plurality of vehicles has traveled based on the vehicle condition information for each of the plurality of vehicles acquired by the acquisition unit, the estimation unit estimates the road surface condition information by inputting the vehicle state information acquired by the acquisition unit to a trained model that outputs the road surface condition information when the vehicle state information is input, the trained model having been trained in advance based on training data in which the vehicle state information and the road surface condition information are associated with each other; The trained model is a trained Long Short Term Memory (LSTM) neural network model, The vehicle state information includes at least one of information representing a longitudinal vehicle body acceleration of the vehicle, information representing a lateral vehicle body acceleration of the vehicle, and information representing a yaw rate of the vehicle, and time information representing a time when the at least one piece of information is acquired by a sensor. Information processing device.

2. and a travel route generating unit configured to generate a travel route for a vehicle without including a road corresponding to the road surface in the travel route for the vehicle when the road surface condition information indicates an abnormal state. The information processing device according to claim 1 .

3. The vehicle state information includes wheel speed information representing a wheel speed of the vehicle.

3. The information processing device according to claim 1 or 2.

4. the estimation unit calculates a differential value of the wheel speed of the vehicle by differentiating wheel speed information representing a wheel speed of the vehicle, which is included in the vehicle state information of the vehicle, and estimates the road surface state information of the road surface on which the vehicle has traveled by inputting the differential value of the wheel speed of the vehicle to the trained model. The information processing device according to claim 3 .

5. The acquisition unit acquires the travel information from a storage unit in which travel information representing a combination of the vehicle state information for each of a plurality of vehicles and position information at the time when the vehicle state information was acquired is stored, The estimation unit estimates, for each of a plurality of vehicles, the road surface condition information on which the vehicle has traveled based on the vehicle condition information included in the vehicle travel information acquired by the acquisition unit; and a generating unit configured to generate map data to which road surface condition information has been added by adding the road surface condition information to a position in map data corresponding to the position information based on the position information of the vehicle in the traveling information of the vehicle acquired by the acquiring unit and the estimated road surface condition information for each of the plurality of vehicles, The information processing device according to any one of claims 1 to 4.

6. The road surface condition information is at least one of road surface roughness information indicating the roughness of the road surface, foreign matter information indicating the degree to which foreign matter is present on the road surface, and slippage information indicating the ease with which a vehicle traveling on the road surface will slip or the ease with which hydroplaning will occur. The information processing device according to any one of claims 1 to 5.

7. Obtaining vehicle status information for each of a plurality of vehicles; estimating road surface condition information on which each of the plurality of vehicles has traveled based on the acquired vehicle condition information for each of the plurality of vehicles; a trained model that outputs the road surface condition information when the vehicle condition information is input, and that is trained in advance based on learning data in which the vehicle condition information and the road surface condition information are associated with each other, when estimating the road surface condition information, by inputting the acquired vehicle condition information to the trained model; An information processing method in which a process is executed by a computer, comprising the steps of: The trained model is a trained Long Short Term Memory (LSTM) neural network model, The vehicle state information includes at least one of information representing a longitudinal vehicle body acceleration of the vehicle, information representing a lateral vehicle body acceleration of the vehicle, and information representing a yaw rate of the vehicle, and time information representing a time when the at least one piece of information is acquired by a sensor. Information processing methods.

8. Obtaining vehicle status information for each of a plurality of vehicles; estimating road surface condition information on which each of the plurality of vehicles has traveled based on the acquired vehicle condition information for each of the plurality of vehicles; a trained model that outputs the road surface condition information when the vehicle condition information is input, and that is trained in advance based on learning data in which the vehicle condition information and the road surface condition information are associated with each other, when estimating the road surface condition information, by inputting the acquired vehicle condition information to the trained model; An information processing program for causing a computer to execute a process, The trained model is a trained Long Short Term Memory (LSTM) neural network model, The vehicle state information includes at least one of information representing a longitudinal vehicle body acceleration of the vehicle, information representing a lateral vehicle body acceleration of the vehicle, and information representing a yaw rate of the vehicle, and time information representing a time when the at least one piece of information is acquired by a sensor. Information processing program.

Images