Driving assistance system, vehicle, and recording medium having a computer program recorded thereon

Abstract

The present invention provides a driving assistance system that makes it possible to reduce the risk of a head-on accident between an assistance target vehicle and a first mobile body which is in a state of being unable to transmit action data of the first mobile body to the assistance target vehicle. Provided is a driving assistance system that assists with driving of a vehicle, wherein: first action data, which is action data of a first mobile body detected by an environment recognition device that is provided to a body other than a prescribed first mobile body, is acquired; second action data, which is action data of a second mobile body that exists on a planned travel route of the first mobile body and that has a communication means for transmitting action data of the second mobile body to an assistance target vehicle, is acquired; and, at or after a first time at which the first mobile body was last detected by the environment recognition device, a collision between the first mobile body and the assistance target vehicle is predicted on the basis of the first action data of the first mobile body acquired at or before the first time, and the second action data acquired from the communication means of the second mobile body.

Description

[Technical field]

[0001] The present disclosure relates to a driving assistance system, a vehicle, and a recording medium having a computer program recorded thereon. [Background technology]

[0002] As a technology for preventing head-on accidents at intersections, there are known technologies that use vehicle-to-vehicle communication means or road-to-vehicle communication means to issue an alarm to at least one of multiple vehicles entering the intersection, or control the automatic driving of the vehicles to avoid collisions between the vehicles. However, the conventional technologies cannot be operated appropriately if any of the vehicles is not equipped with a vehicle-to-vehicle communication function, or if the intersection is not equipped with a road-to-vehicle communication function.

[0003] In response to this, Patent Document 1 discloses an information providing device that provides an occupant of a vehicle with a vehicle-to-vehicle communication function with information on a moving object that does not have a vehicle-to-vehicle communication function and that may approach the vehicle on the path of the vehicle, as a technology for avoiding a head-on accident involving a vehicle that does not have a device such as a vehicle-to-vehicle communication means. Specifically, an information providing device is proposed that transmits vehicle information, moving object information including the position, traveling speed, and traveling direction of the moving object, and the time when this information was obtained to a base station, receives predicted information of moving objects that exist within a predetermined range including the vehicle position obtained by the base station, and provides information to the occupant of the vehicle. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2010-224762 A Summary of the Invention [Problem to be solved by the invention]

[0005] In Patent Document 1, a base station predicts the probability of a moving body not having vehicle-to-vehicle communication capability being present at a specified position based on the time elapsed since the moving body was detected, predicts the probability of a moving body being present at a specified position based on the distance from the position where the moving body was detected to the specified position, and predicts the probability of a moving body being present at a specified position based on road branch information in map data.

[0006] However, in the method described in Patent Document 1, if a situation occurs in which the moving body cannot continue traveling because, for example, a pedestrian crosses in front of the moving body, forcing the moving body to slow down between the time when the moving body last acquires information about the moving body and the time when the moving body arrives at a predetermined position, the time when the moving body arrives at the predetermined position may deviate from the actual arrival time. In this case, the information provided may not be useful to the driver.

[0007] Furthermore, similar problems can occur not only in mobile bodies that do not have vehicle-to-vehicle communication capabilities, but also in mobile bodies that do have vehicle-to-vehicle communication capabilities, when the communication environment is poor or the communication system is malfunctioning.

[0008] The present disclosure has been made in consideration of the above problems, and an object of the present disclosure is to provide a driving assistance system and vehicle, as well as a recording medium having a computer program recorded thereon, that can reduce the risk of a head-on accident between a first moving body that is in a situation where it is unable to transmit its own behavioral data to a vehicle to be assisted and a vehicle to be assisted. [Means for solving the problem]

[0009] In order to solve the above problem, according to one aspect of the present disclosure, a driving assistance system that assists in driving a vehicle is provided, comprising one or more processors and one or more memories communicatively connected to the one or more processors, wherein the one or more processors acquire first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided other than a specific first moving body, from the environment recognition device directly or via an external server, and acquire second behavior data, which is behavior data of a second moving body that is present on a planned driving path of the first moving body and has communication means for transmitting its own behavior data to a vehicle to be assisted, directly or via an external server, and predict a collision between the first moving body and a vehicle to be assisted based on the first behavior data of the first moving body acquired before a first time after a first time when the first moving body was last detected by the environment recognition device and the second behavior data acquired from the communication means of the second moving body.

[0010] In addition, in order to solve the above problem, according to another aspect of the present disclosure, there is provided a vehicle equipped with a driving assistance device that assists in driving the vehicle, wherein the driving assistance device acquires first behavioral data, which is behavioral data of a first moving body detected by an environment recognition device provided other than a specific first moving body, from the environment recognition device directly or via an external server, and acquires second behavioral data, which is behavioral data of a second moving body that is present on a planned driving route of the first moving body and has communication means for transmitting its own behavioral data to the vehicle to be assisted, directly or via an external server, and predicts a collision between the first moving body and the vehicle to be assisted based on the first behavioral data of the first moving body acquired before a first time after a first time when the first moving body was last detected by the environment recognition device and the second behavioral data acquired from the communication means of the second moving body.

[0011] In addition, in order to solve the above problem, according to another aspect of the present disclosure, there is provided a recording medium having recorded thereon a computer program applied to a driving assistance system that assists driving of a vehicle, the computer program causing one or more processors to execute processes including: acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided other than a specific first moving body, from the environment recognition device directly or via an external server; acquiring second behavior data, which is behavior data of a second moving body that is present on the planned driving path of the first moving body and has communication means for transmitting its own behavior data to the supported vehicle, directly or via an external server; and predicting a collision between the first moving body and the supported vehicle based on the first behavior data of the first moving body acquired before a first time after a first time when the first moving body was last detected by the environment recognition device and the second behavior data acquired from the communication means of the second moving body. Effect of the Invention

[0012] As described above, according to the present disclosure, it is possible to reduce the risk of a head-on accident between a first moving body that is in a situation where it is unable to transmit its own behavioral data to a vehicle that is a support target and the vehicle that is a support target. [Brief description of the drawings]

[0013] [Figure 1] 1 is a schematic diagram showing a basic configuration of a driving assistance system according to a first embodiment of the present disclosure. [Diagram 2] 2 is a block diagram showing an example of the configuration of an environment recognition device (road camera) of the driving assistance system according to the embodiment. FIG. [Diagram 3] 5 is a flowchart showing a processing operation by an environment recognition device (road camera) of the driving assistance system according to the embodiment. [Figure 4] 2 is a block diagram showing a configuration example of a mobile terminal of the driving assistance system according to the embodiment. FIG. [Diagram 5] 6 is a flowchart showing a processing operation by the mobile terminal of the driving assistance system according to the embodiment; [Figure 6] 2 is a block diagram showing an example of the configuration of a management server of the driving assistance system according to the embodiment. FIG. [Figure 7] 5 is a flowchart showing a processing operation by a management server of the driving assistance system according to the embodiment; [Figure 8] FIG. 2 is a schematic diagram showing an example of the configuration of a vehicle to be assisted by the driving assistance system according to the embodiment; [Figure 9] 2 is a block diagram showing an example of the configuration of a driving assistance device of the driving assistance system according to the embodiment. FIG. [Figure 10] 4 is a flowchart showing a main routine of a processing operation by a driving assistance device of the driving assistance system according to the embodiment; [Figure 11] 5 is a flowchart showing a collision prediction process performed by the driving assistance device of the driving assistance system according to the embodiment. [Figure 12] 5 is a flowchart showing a collision prediction process performed by the driving assistance device of the driving assistance system according to the embodiment. [Figure 13] 5 is a flowchart showing a collision prediction process performed by the driving assistance device of the driving assistance system according to the embodiment. [Figure 14] 10 is a flowchart showing a process of calculating a predicted arrival time of a first moving object at an intersection position by a driving assistance device of the driving assistance system according to the embodiment. [Figure 15] FIG. 11 is an explanatory diagram showing an application example of the embodiment. [Figure 16] FIG. 11 is an explanatory diagram showing an application example of the embodiment. [Figure 17] FIG. 11 is an explanatory diagram showing an application example of the embodiment. [Figure 18] FIG. 11 is an explanatory diagram showing an application example of the embodiment. [Figure 19] FIG. 11 is a block diagram showing a configuration example of a mobile terminal of a driving assistance system according to a second embodiment of the present disclosure. [Figure 20] 6 is a flowchart showing a processing operation by the mobile terminal of the driving assistance system according to the embodiment; [Figure 21]5 is a flowchart showing a collision prediction process performed by the driving assistance device of the driving assistance system according to the embodiment. [Figure 22] 5 is a flowchart showing a collision prediction process performed by the driving assistance device of the driving assistance system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.

[0015] In the embodiment described below, an example will be described in which the "other vehicle" is the "first moving body", the "pedestrian" is the "second moving body", the "mobile terminal" is the "communication means for transmitting behavior data of the second moving body", and the "road camera" is the "environment recognition device". However, each component is not limited to the above.

[0016] <<1. First embodiment>> <1-1. Basic configuration of driving assistance system> First, an example of a basic configuration of a driving assistance system according to a first embodiment of the present disclosure will be described.

[0017] FIG. 1 is an explanatory diagram showing an example of a basic configuration of a driving assistance system 100. As shown in FIG. The driving assistance system 100 includes a driving assistance device 50 mounted on a vehicle 1 to be assisted, a road camera 150 installed on a road, for example, a mobile terminal 130 carried by a pedestrian H, for example, and a management server 110. For ease of understanding, one each of the driving assistance device 50, road camera 150, mobile terminal 130, and management server 110 is illustrated, but a plurality of each of these may be provided.

[0018] The driving assistance device 50, the road camera 150, and the mobile terminal 130 are each communicatively connected to the management server 110 via one or more communication networks 105. For example, the driving assistance device 50 and the mobile terminal 130 are connected to the management server 110 via a mobile communication network. The road camera 150 may be connected to the management server 110 via a mobile communication network, or may be connected to the management server 110 via a wired communication network or a dedicated line.

[0019] The road camera 150 is one aspect of an environment recognition device, which is installed on a road and generates image data of the shooting range in a predetermined processing cycle, and performs object recognition processing by image processing of the captured image. However, the environment recognition device is not limited to the road camera 150, and may be a LiDAR or radar sensor fixed at a predetermined position, an ultrasonic camera, or other device capable of object recognition, or may be an object recognition system using a camera or LiDAR mounted on a moving body such as a vehicle.

[0020] In the present disclosure, the road camera 150 detects moving objects such as vehicles, bicycles, and pedestrians at each predetermined processing cycle, and calculates the moving direction and moving speed of the moving object based on the time change in the position of the detected moving object. The road camera 150 transmits information on the detected moving object to the management server 110 at each predetermined processing cycle, together with information on the moving direction and moving speed, and information on the installation position and shooting direction of the road camera 150 on the map data. Information on the installation position of the road camera 150 is recorded in advance as information on longitude and latitude on the map data, for example. Information on the shooting direction of the road camera 150 may be recorded as a vector value in a coordinate system with longitude and latitude as the x and y axes, or may be recorded as information on the direction with respect to the road on which the road camera 150 is installed. In this embodiment, information on the position, moving direction, and moving speed of the moving object detected by the road camera 150 corresponds to first behavior data, which is behavior data of the first moving object (other vehicle).

[0021] The mobile terminal 130 is, for example, a smartphone, a smartwatch, or other wearable device, and detects the position information of the mobile terminal 130 in a predetermined processing cycle, and calculates the moving direction and moving speed of the mobile terminal 130 based on the time change in the position of the mobile terminal 130. The position information of the mobile terminal 130 is acquired based on a satellite signal transmitted from a GNSS (Global Navigation Satellite System) satellite such as a GPS (Global Positioning System). The mobile terminal 130 transmits information on the position, moving direction, and moving speed of the mobile terminal 130 to the management server 110 in a predetermined processing cycle. In this embodiment, the information on the position, moving direction, and moving speed of the mobile terminal 130 corresponds to second behavior data that is behavior data of a second moving body (pedestrian H) that holds the mobile terminal 130.

[0022] The management server 110 is an information processing device communicatively connected to the road camera 150, the mobile terminal 130, and the driving assistance device 50 via the communication network 105 by, for example, cloud computing technology. The management server 110 receives captured images and information on the result of the object recognition processing from the road camera 150 in a predetermined processing cycle. The information on the result of the object recognition processing includes information on the detected first moving object and the first behavior data of the first moving object. The management server 110 also receives information on the position, moving direction, and moving speed of the mobile terminal 130 (second behavior data) from the mobile terminal 130 in a predetermined processing cycle.

[0023] Furthermore, the management server 110 receives position information of the vehicle 1 from the driving support device 50 at a predetermined processing cycle. The management server 110 identifies the road cameras 150 and the mobile terminals 130 that exist within a predetermined area according to the position of the vehicle 1, and transmits the first behavior data and the second behavior data received from the road cameras 150 and the mobile terminals 130 to the driving support device 50. In other words, the management server 110 collects information from the road cameras 150 and the mobile terminals 130, and provides the vehicle 1 with information on other moving objects that exist within the area surrounding the driving position of the vehicle 1.

[0024] The driving assistance device 50 is mounted on the vehicle 1 to be assisted, detects position information of the vehicle 1 in a predetermined processing cycle, and transmits the detected position information to the management server 110. The position information of the vehicle 1 is acquired based on a satellite signal transmitted from a GNSS satellite such as a GPS. The driving assistance device 50 also receives first behavior data and second behavior data from the management server 110 in a predetermined processing cycle, and predicts a collision between the vehicle 1 to be assisted and another moving body (another vehicle). When a collision between the vehicle 1 to be assisted and another moving body (another vehicle) is predicted, the driving assistance device 50 executes a process to avoid the collision.

[0025] The functional configurations and operations of the road camera 150, the mobile terminal 130, the management server 110 and the driving support device 50 will be specifically described below.

[0026] <1-2. Street cameras> First, the road camera 150 as one aspect of the environment recognition device will be described in detail.

[0027] (1-2-1. Functional configuration) FIG. 2 is a block diagram showing the functional configuration of the road camera 150. As shown in FIG. The road camera 150 includes an image generation unit 151 and an image capture processing device 160. The image generation unit 151 includes an image capture element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), and generates image data of the capture range. The image generation unit 151 generates image data for each predetermined processing cycle and outputs the image data to the image capture processing device 160.

[0028] The imaging processing device 160 includes a communication unit 161, a processing unit 163, and a storage unit 169. The communication unit 161 is an interface for communicating with the management server 110 via the communication network 105. The processing unit 163 includes one or more CPUs (Central processing Units) such as a GPU (Graphics Processing Unit), and executes a predetermined object recognition process based on image data input from the image generation unit 151 at each predetermined processing cycle, and transmits information on the recognition result to the management server 110.

[0029] The storage unit 169 includes one or more memories, and stores computer programs executed by the processing unit 163, various parameters used in arithmetic processing, and information on the results of arithmetic processing. The storage unit 169 may be a magnetic medium such as a hard disk, a floppy disk, or a magnetic tape, an optical recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD (Digital Versatile Disk), or a Blu-ray (registered trademark), a magneto-optical medium such as a floptical disk, a storage element such as a RAM (Random Access Memory) or a ROM (Read Only Memory), a flash memory such as a USB (Universal Serial Bus) memory or an SSD (Solid State Drive), or other recording medium.

[0030] The processing unit 163 includes an image processing unit 165 and a communication control unit 167. The functions of these units are realized by the execution of a computer program by the processor. The image processing unit 165 executes object recognition processing based on image data input from the image generation unit 151 in a predetermined processing cycle. The image processing unit 165 extracts feature points from the image data using techniques such as edge detection processing, and performs matching with pre-stored data on the feature points of various obstacles (also called pattern matching processing), thereby executing processing to recognize objects present in the shooting range. In the road camera 150, processing to recognize moving objects is mainly performed. Typically, other vehicles, pedestrians, and bicycles are recognized as moving objects.

[0031] Furthermore, the image processing unit 165 obtains information regarding the moving speed and moving direction of the recognized moving object. For example, the image processing unit 165 can obtain the moving speed and moving direction of the moving object by calculation based on the time change in the position and size of the moving object in the image data input at each predetermined processing cycle. However, the method of obtaining the speed and moving direction of the recognized moving object by image processing may be performed using a conventionally known technology, and is not particularly limited.

[0032] The communication control unit 167 transmits information on the type of moving object determined by the image processing unit 165 and information on the moving speed and moving direction of the moving object to the management server 110. At this time, the communication control unit 167 also transmits information on the installation position and shooting direction of the road camera 150 to the management server 110. If the management server 110 stores data on the installation position and shooting direction of each road camera 150, the road camera 150 may transmit identification information for identifying each road camera 150 to the management server 110.

[0033] (1-2-2. Processing Operation) Fig. 3 shows a flowchart of the processing operation by the image capture processing device 160 of the road camera 150. The flowchart shown in Fig. 3 is repeatedly executed for each predetermined processing cycle.

[0034] The image processing unit 165 of the processing unit 163 acquires image data output from the image generating unit 151 (step S11).

[0035] Next, the image processing unit 165 executes object recognition processing based on the acquired image data (step S13). As described above, the image processing unit 165 extracts feature points from the image data using a technique such as edge detection processing, matches the feature points with data on the feature points of various obstacles stored in advance, and executes processing to recognize objects present in the shooting range. In the road camera 150, processing to recognize moving objects is mainly performed. Representative moving objects recognized are other vehicles, pedestrians, and bicycles. In addition, the image processing unit 165 calculates the moving speed and moving direction of the recognized moving object. For example, the image processing unit 165 calculates the moving speed and moving direction of the moving object based on the time change in the position and size of the moving object in the image data input at each predetermined processing cycle.

[0036] Next, the communication control unit 167 transmits information on the type of the moving object obtained by the image processing unit 165, and information on the moving speed and moving direction of the moving object to the management server 110 (step S15). The communication control unit 167 also transmits information on the installation position of the road camera 150 on the map data and the shooting direction to the management server 110. The transmitted information corresponds to the first behavior data of the moving object (first moving object). The imaging processing device 160 repeatedly executes the processes of steps S11 to S15 described above for each predetermined processing cycle.

[0037] The first moving object detected by the road camera 150 is typically a vehicle, but is not limited to this and may be a bicycle, a motorcycle, or any other object that can move at a predetermined speed.

[0038] <1-3.Mobile devices> Next, the mobile terminal 130 will be described in detail.

[0039] (1-3-1. Functional configuration) FIG. 4 is a block diagram showing the functional configuration of the mobile terminal 130. The mobile terminal 130 includes a communication unit 131, a processing unit 133, a storage unit 139, and a GNSS sensor 141. The communication unit 131 is an interface for communicating with the management server 110 via the communication network 105. The GNSS sensor 141 receives satellite signals transmitted from GNSS satellites such as GPS. The satellite signals include information indicating the position of the mobile terminal 130 on map data. For example, the position of the mobile terminal 130 is indicated as longitude and latitude data. The GNSS sensor 141 outputs the acquired position information of the mobile terminal 130 to the processing unit 133.

[0040] The processing unit 133 includes one or more CPUs, acquires position information of the mobile terminal 130 at each predetermined processing cycle, calculates the moving speed and moving direction of the mobile terminal 130, and transmits information on the calculation results to the management server 110. The storage unit 139 includes one or more memories, and stores computer programs executed by the processing unit 133, various parameters used in the calculation processing, and information on the calculation results. The storage unit 139 may be a storage element such as a RAM or a ROM, a flash memory such as an SSD, or other recording medium.

[0041] The processing unit 133 includes a data processing unit 135 and a communication control unit 137. The functions of these units are realized by the execution of a computer program by a processor. The data processing unit 135 calculates the moving speed and moving direction of the mobile terminal 130 based on the position information input from the GNSS sensor 141 in a predetermined processing cycle. For example, the data processing unit 135 can calculate the moving speed and moving direction of the mobile terminal 130 based on the time change of the position information input for each predetermined processing cycle.

[0042] The communication control unit 137 transmits to the management server 110 the position information of the mobile terminal 130 input from the GNSS sensor 141 and the information on the moving speed and moving direction of the mobile terminal 130 calculated by the data processing unit 135 .

[0043] (1-3-2. Processing Operation) Fig. 5 shows a flowchart of the processing operation by the mobile terminal 130. The flowchart shown in Fig. 5 is repeatedly executed for each predetermined processing cycle.

[0044] The data processing unit 135 of the processing unit 133 acquires the position information input from the GNSS sensor 141 (step S21). Next, the data processing unit 135 calculates the moving direction and moving speed of the mobile terminal 130 based on the acquired position information (step S23). Specifically, the data processing unit 135 calculates the moving speed by time-differentiating the moving distance based on the position information input at each predetermined processing cycle. In addition, the data processing unit 135 acquires a moving vector (moving direction) on the map data based on the position information input at each predetermined processing cycle.

[0045] Next, the communication control unit 137 transmits the position information acquired from the GNSS sensor 141 and the calculated information on the moving speed and moving direction to the management server 110 (step S25). The transmitted information corresponds to the second behavior data of the walker (second moving body) H carrying the mobile terminal 130. The mobile terminal 130 repeatedly executes the processes of the above steps S21 to S25 for each predetermined processing cycle.

[0046] The second moving object holding the mobile terminal 130 is not limited to a pedestrian, but may be a vehicle, a motorcycle, a bicycle, or any other object that moves at a predetermined speed.

[0047] <1-4. Management Server> Next, the management server 110 will be described in detail.

[0048] (1-4-1. Functional configuration) FIG. 6 is a block diagram showing the functional configuration of the management server 110. As shown in FIG. The management server 110 includes a communication unit 111, a processing unit 113, and a storage unit 119. The communication unit 111 is an interface for communicating with the road cameras 150, the mobile terminal 130, and the driving support device 50 via the communication network 105. The processing unit 113 includes one or more CPUs, and acquires information transmitted from the road cameras 150, the mobile terminal 130, and the driving support device 50 at each predetermined processing cycle, and transmits information acquired from the road cameras 150 and the mobile terminal 130 that are present within a predetermined area corresponding to the position of the driving support device 50 to the driving support device 50.

[0049] The storage unit 119 includes one or more memories, and stores computer programs executed by the processing unit 113, various parameters used in arithmetic processing, and information on calculation results. The storage unit 119 may be a magnetic medium such as a hard disk, a floppy disk, or a magnetic tape, an optical recording medium such as a CD-ROM, a DVD, or a Blu-ray (registered trademark), a magneto-optical medium such as a floptical disk, a memory element such as a RAM or a ROM, a flash memory such as a USB memory or an SSD, or other recording medium.

[0050] The processing unit 113 includes a data processing unit 115 and a communication control unit 117. The functions of these units are realized by the execution of a computer program by a processor. The data processing unit 115 identifies the position of the vehicle 1 to be assisted on the map data based on the position information transmitted from the driving support device 50, and extracts the road cameras 150 and the mobile terminals 130 that exist within an area of ​​a predetermined radius from the position of the vehicle 1. The communication control unit 117 transmits information on the type, moving speed, and moving direction of the moving object received from the extracted road cameras 150 to the driving support device 50 together with the position information on the map data of the road cameras 150. The communication control unit 117 also transmits the position information, moving speed, and moving direction information of the mobile terminal 130 received from the extracted mobile terminal 130 to the driving support device 50.

[0051] The data processing unit 115 may obtain the traveling direction of the vehicle 1 to be assisted based on the position information transmitted from the driving assistance device 50, or may obtain information on the traveling direction of the vehicle 1 to be assisted from the driving assistance device 50 and extract the road cameras 150 and the mobile terminals 130 present on roads leading to (intersecting) the road in the traveling direction. This makes it possible to prevent information other than information for predicting a collision between the vehicle 1 to be assisted and a moving object with a risk of collision from being transmitted to the driving assistance device 50, and reduces the load of the calculation processing of the management server 110 and the driving assistance device 50.

[0052] (1-4-2. Processing Operation) Fig. 7 shows a flowchart of the processing operation by the management server 110. The flowchart shown in Fig. 7 is repeatedly executed for each predetermined processing cycle.

[0053] The data processing unit 115 of the processing unit 113 acquires first behavior data transmitted from one or more environment recognition devices (street cameras 150) (step S31). The data processing unit 115 acquires information on the type of detected moving object and information on the installation position and shooting direction of the sending road camera 150 along with the first behavior data. From this information, it is possible to grasp what type of moving object is moving, in what position, in what direction, and at what speed.

[0054] Next, the data processing unit 115 acquires the second behavior data transmitted from one or more mobile terminals 130 (step S33). From the second behavior data, it is possible to know where, in what direction, and at what speed the moving body (pedestrian H) holding the mobile terminal 130 is moving.

[0055] Next, the data processing unit 115 acquires position information of the vehicle 1 from the driving assistance device 50 mounted on the vehicle 1 to be assisted (step S35). The position information of the vehicle 1 is information indicating the position of the vehicle 1 on the map data, and is indicated by, for example, longitude and latitude.

[0056] Next, the data processing unit 115 extracts the environment recognition devices (road cameras 150) and the mobile terminals 130 that are present within a predetermined distance from the position of the vehicle 1 to be assisted (step S37). For example, the data processing unit 115 extracts the road cameras 150 and the mobile terminals 130 that are present within an area of ​​a predetermined radius from the position of the vehicle 1.

[0057] Next, the communication control unit 117 transmits the first behavior data and the second behavior data acquired from the extracted environment recognition device (road camera 150) and the mobile terminal 130, respectively, to the support target vehicle 1 (step S39). The management server 110 repeatedly executes the processes of the above steps S31 to S39 for each predetermined processing cycle.

[0058] <1-5. Driving support devices> (1-5-1. Vehicles) Before describing the functional configuration of the driving assistance device 50 according to the embodiment of the present disclosure, an example of the overall configuration of the assisted vehicle 1 equipped with the driving assistance device 50 will be described.

[0059] FIG. 8 is a schematic diagram showing a configuration example of a vehicle 1 equipped with a driving support device 50. As shown in FIG. The vehicle 1 shown in Fig. 8 is configured as a four-wheel drive vehicle in which a driving torque output from a driving force source 9 that generates a driving torque for the vehicle is transmitted to a left front wheel 3LF, a right front wheel 3RF, a left rear wheel 3LR, and a right rear wheel 3RR (hereinafter collectively referred to as "wheels 3" unless a distinction is required). The driving force source 9 may be an internal combustion engine such as a gasoline engine or a diesel engine, a driving motor, or may include both an internal combustion engine and a driving motor.

[0060] The vehicle 1 may be an electric vehicle equipped with two drive motors, for example a front-wheel drive motor and a rear-wheel drive motor, or an electric vehicle equipped with drive motors corresponding to each of the wheels 3. If the vehicle 1 is an electric vehicle or a hybrid electric vehicle, the vehicle 1 is equipped with a secondary battery that stores power supplied to the drive motors, and a generator such as a motor or fuel cell that generates power to charge the battery.

[0061] The vehicle 1 is equipped with a driving force source 9, an electric steering device 15, and brake devices 17LF, 17RF, 17LR, 17RR (hereinafter collectively referred to as "brake devices 17" unless a distinction is required) as devices used to control the operation of the vehicle 1. The driving force source 9 outputs a driving torque that is transmitted to the front drive shaft 5F and the rear drive shaft 5R via a transmission, a front wheel differential mechanism 7F, and a rear wheel differential mechanism 7R (not shown). The operation of the driving force source 9 and the transmission is controlled by a vehicle control unit 41 that includes one or more electronic control units (ECUs: Electronic Control Units).

[0062] The front-wheel drive shaft 5F is provided with an electric steering device 15. The electric steering device 15 includes an electric motor and a gear mechanism (not shown), and is controlled by a vehicle control unit 41 to adjust the steering angles of the left front wheel 3LF and the right front wheel 3RF. During manual driving, the vehicle control unit 41 controls the electric steering device 15 based on the steering angle of the steering wheel 13 by the driver. During automatic driving, the vehicle control unit 41 controls the electric steering device 15 based on a set driving trajectory.

[0063] Brake devices 17LF, 17RF, 17LR, and 17RR apply braking forces to the front, rear, left, and right drive wheels 3LF, 3RF, 3LR, and 3RR, respectively. Brake devices 17 are configured as hydraulic brake devices, for example, and generate a predetermined braking force by controlling the hydraulic pressure supplied to each brake device 17 by the vehicle control unit 41. When the vehicle 1 is an electric vehicle or a hybrid electric vehicle, brake devices 17 are used in combination with regenerative braking by a drive motor.

[0064] The vehicle control unit 41 includes one or more electronic control devices that control the driving of the driving force source 9 that outputs the driving torque of the vehicle 1, the electric steering device 15 that controls the steering angle of the steering wheel or the steering wheels, and the brake device 17 that controls the braking force of the vehicle 1. The vehicle control unit 41 may have a function of controlling the driving of a transmission that changes the speed of the output output from the driving force source 9 and transmits it to the wheels 3. The vehicle control unit 41 is configured to be able to acquire information transmitted from the driving assistance device 50, and is configured to be able to execute automatic driving control of the vehicle 1.

[0065] The vehicle 1 also includes a vehicle state sensor 35, a GNSS sensor 37, and an HMI (Human Machine Interface) 43. The vehicle state sensor 35 is composed of at least one sensor that detects the operation state and behavior of the vehicle 1. The vehicle state sensor 35 includes at least one of a steering angle sensor, an accelerator position sensor, a brake stroke sensor, a brake pressure sensor, and an engine speed sensor, and detects the operation state of the vehicle 1, such as the steering angle of the steering wheel or steering wheels, the accelerator opening, the brake operation amount, or the engine speed. The vehicle state sensor 35 also includes at least one of a vehicle speed sensor, an acceleration sensor, and an angular velocity sensor, and detects the behavior of the vehicle, such as the vehicle speed, the longitudinal acceleration, the lateral acceleration, or the yaw rate. The vehicle state sensor 35 transmits a sensor signal including the detected information to the driving assistance device 50.

[0066] The GNSS sensor 37 receives satellite signals from GNSS satellites such as GPS. The GNSS sensor 37 outputs position information on the map data of the vehicle 1, which is included in the received satellite signals, to the driving assistance device 50. Note that the GNSS sensor 37 is not limited to a GPS sensor, and may be provided with an antenna for receiving satellite signals from other satellite systems that identify the position of the vehicle 1.

[0067] The HMI 43 is driven by the driving support device 50 and presents various information to the driver by means of image display, audio output, etc. The HMI 43 includes, for example, a display device provided in an instrument panel and a speaker provided in the vehicle. The display device may be a display device of a navigation system. The HMI 43 may also include a HUD (head-up display) that displays information on the front window by superimposing it on the scenery around the vehicle 1.

[0068] (1-5-2. Functional configuration) Next, the functional configuration of the driving support device 50 will be described. The driving assistance device 50 functions as a device that assists in driving a vehicle by executing a computer program by one or more processors such as CPUs. The computer program is a computer program for causing the processor to execute operations to be performed by the driving assistance device 50, which will be described later. The computer program executed by the processor may be recorded on a recording medium that functions as a storage unit (memory) 61 provided in the driving assistance device 50, or may be recorded on a recording medium built into the driving assistance device 50 or any recording medium that can be externally attached to the driving assistance device 50.

[0069] Examples of recording media for recording computer programs include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs, DVDs, and Blu-ray (registered trademark); magneto-optical media such as floptical disks; memory elements such as RAMs and ROMs; flash memories such as USB memories and SSDs; and other media capable of storing programs.

[0070] FIG. 9 is a block diagram showing the functional configuration of the driving support device 50. As shown in FIG. A vehicle state sensor 35 and a GNSS sensor 37 are connected to the driving assistance device 50 directly or via communication means such as a controller area network (CAN) or a local inter net (LIN). A vehicle control unit 41 and an HMI 43 are also connected to the driving assistance device 50. Note that the driving assistance device 50 is not limited to an electronic control device mounted on the vehicle 1, and may be a terminal device such as a smartphone or a wearable device.

[0071] The driving support device 50 includes a communication unit 51, a processing unit 53, and a storage unit 61. The communication unit 51 is an interface for communicating with the management server 110 via the communication network 105. The processing unit 53 is configured with one or more processors such as CPUs. A part or all of the processing unit 53 may be configured with updatable firmware or the like, or may be a program module or the like executed by a command from the CPU or the like.

[0072] The storage unit 61 is composed of one or more memories such as RAM or ROM, and is communicatively connected to the processing unit 53. However, the number and type of the storage units 61 are not particularly limited. The storage unit 61 stores information such as computer programs executed by the processing unit 53, various parameters used in arithmetic processing, detection data, and arithmetic results. The storage unit 61 also stores map data.

[0073] The processing unit 53 includes a communication control unit 55, a collision risk determination unit 57, and a driving control unit 59. The functions of these units are realized by a processor executing a computer program. Note that some of the communication control unit 55, the collision risk determination unit 57, and the driving control unit 59 may be configured by hardware such as an analog circuit.

[0074] The communication control unit 55 transmits the position information of the vehicle 1 input from the GNSS sensor 37 to the management server 110 at a predetermined processing cycle. The communication control unit 55 may transmit information on the moving direction of the vehicle 1 to the management server 110 together with the position information of the vehicle 1.

[0075] The collision risk determination unit 57 predicts a collision between the vehicle 1 to be supported and another moving body. In this embodiment, the collision risk determination unit 57 predicts a collision between the vehicle 1 and another moving body based on the first behavior data of the first moving body detected by the road camera 150 transmitted from the management server 110, information on the position, moving speed, and moving direction of the mobile terminal 130 (second behavior data), and information on the moving speed and course of the vehicle 1. Specifically, the collision risk determination unit 57 estimates the time when the first moving body crosses the course of the vehicle 1 to be supported based on the first behavior data of the moving body acquired before the first time after the first behavior data of the first moving body detected by the road camera 150 was last acquired and the second behavior data acquired from the mobile terminal 130. Then, the collision risk determination unit 57 predicts a collision between the vehicle 1 and the first moving body based on the time difference between the estimated time when the first moving body crosses the course of the vehicle 1 to be supported and the estimated time when the vehicle 1 passes the intersection position. The specific processing performed by the collision risk determination unit 57 will be explained in detail later.

[0076] The driving control unit 59 sets driving conditions for the vehicle 1 to reduce the risk of collision when the collision risk determination unit 57 predicts that the vehicle 1 and the first moving body will collide. The driving conditions include, for example, a condition of a target deceleration for decelerating the vehicle 1. The driving conditions may include a condition of a target steering angular velocity for changing the traveling trajectory of the vehicle 1 in addition to the target deceleration. The driving control unit 59 transmits information on the set driving conditions to the vehicle control unit 41. The vehicle control unit 41 controls the traveling of the vehicle 1 based on the acquired driving conditions. The driving control unit 59 may set the target deceleration or the target steering angular velocity so as not to exceed a preset upper limit value of the deceleration or an upper limit value of the steering angular velocity. This makes it possible to prevent the vehicle 1 from being suddenly turned or suddenly decelerated.

[0077] (1-5-3. Processing Operation) Fig. 10 is a flowchart showing a main routine of the processing operation by the driving support device 50. The flowchart shown in Fig. 10 is repeatedly executed for each predetermined processing cycle.

[0078] When the in-vehicle system including the driving assistance device 50 is started (step S41), the communication control unit 55 of the processing unit 53 acquires location information input from the GNSS sensor 37 (step S43) and transmits the acquired location information to the management server 110 (step S45).

[0079] Next, the collision risk determination unit 57 calculates the moving direction and moving speed of the vehicle 1 (step S47). Specifically, the collision risk determination unit 57 calculates the moving direction and moving speed of the vehicle 1 on the map data based on a time change in the position information input from the GNSS sensor 37 for each predetermined processing cycle. If the position information input from the GNSS sensor 37 includes information on the orientation of the vehicle 1, the moving direction of the vehicle 1 may be determined based on that information. In addition, the moving speed of the vehicle 1 may be obtained by acquiring information detected by a vehicle speed sensor mounted on the vehicle 1.

[0080] Next, the collision risk determination unit 57 acquires the first behavior data and the second behavior data transmitted from the management server 110 (step S49). As a result, when a first moving object such as another vehicle is detected by the road camera 150, information on the installation position of the road camera 150 on the map data and the moving direction and moving speed of the moving object is acquired. Also, when a pedestrian H or the like (second moving object) holding the mobile terminal 130 is present within a predetermined distance from the vehicle 1, information on the position, moving direction and moving speed of the second moving object on the map data is acquired.

[0081] Next, the collision risk determination unit 57 executes a process (collision prediction process) of predicting a collision of the vehicle 1 based on information on the position, moving direction, and moving speed of the vehicle 1 and the acquired first behavior data and second behavior data (step S51). Specifically, the collision risk determination unit 57 predicts a collision between the first moving object and the supported vehicle 1 based on the first behavior data of the first moving object acquired before the first time when the first behavior data of the first moving object detected by the road camera 150 was last acquired and the second behavior data acquired from the mobile terminal 130 of the pedestrian H or the like (second moving object).

[0082] 11 to 13 are flowcharts showing a specific example of the collision prediction process. First, the collision risk determination unit 57 refers to the first behavior data acquired from the management server 110 (step S61). Next, the collision risk determination unit 57 determines whether or not a first moving object moving forward in the moving direction of the vehicle 1 is detected based on the first behavior data (step S63). Specifically, the collision risk determination unit 57 determines whether or not a moving object moving forward in the moving direction of the vehicle 1 on a road leading forward in the moving direction of the road on which the vehicle 1 is traveling on the map data is detected based on the position and moving direction of the moving object indicated by the first behavior data.

[0083] When a first moving object moving forward in the moving direction of the vehicle 1 is detected (S63 / Yes), the moving object is moving forward in the moving direction of the vehicle 1, but is still at the installation position of the road camera 150, and there is no risk of colliding with the vehicle 1 immediately after, so the collision risk determination unit 57 continues to monitor the first behavior data. On the other hand, when a first moving object moving forward in the moving direction of the vehicle 1 is not detected (S63 / No), the collision risk determination unit 57 determines whether or not a first moving object moving forward in the moving direction of the vehicle 1 was detected in the previous processing cycle (step S65). When a first moving object moving forward in the moving direction of the vehicle 1 was not detected in the previous processing cycle (S65 / No), there is a high possibility that a moving object moving forward in the moving direction of the vehicle 1 does not exist, so the collision risk determination unit 57 continues to monitor the first behavior data.

[0084] On the other hand, if a first moving object moving forward in the moving direction of the vehicle 1 was detected in the previous processing cycle (S65 / Yes), the collision risk determination unit 57 identifies an intersection position between the travel path of the first moving object and the travel path of the vehicle 1 (step S67). Specifically, the collision risk determination unit 57 identifies the travel path of the moving object according to the moving direction of the first moving object on the map data, and identifies the travel path of the vehicle 1 according to the moving direction of the vehicle 1, and identifies a point where the two travel paths intersect.

[0085] Next, the collision risk determination unit 57 refers to the second behavior data acquired from the management server 110 (step S69). Next, the collision risk determination unit 57 determines whether or not the second moving body holding the mobile terminal 130 is located on the travel route of the first moving body based on the second behavior data (step S71). Here, it is determined whether or not the position of the mobile terminal 130 included in the second behavior data is on a road that is the travel route of the first moving body.

[0086] If the second moving object is not located on the travel path of the first moving object (S71 / No), the time at which the first moving object will arrive at the intersection position is calculated based on the first behavior data of the first moving object acquired before the first time at which the first moving object was last detected by the road camera 150 (step S81). Specifically, the collision risk determination unit 57 assumes that the movement speed of the first moving object passing the installation position of the road camera 150 will be maintained as it is, calculates the required time by dividing the distance from the installation position of the road camera 150 to the intersection position by the movement speed, and adds this to the first time to calculate the predicted arrival time.

[0087] Next, the collision risk determination unit 57 calculates the time when the vehicle 1 will arrive at the intersection position based on the information on the moving speed of the vehicle 1 (step S83). Specifically, the collision risk determination unit 57 obtains the required time by dividing the distance from the position of the vehicle 1 at the first time to the intersection position by the moving speed of the vehicle 1, and adds it to the first time to calculate the predicted arrival time.

[0088] Next, the collision risk determination unit 57 determines whether or not there is a possibility of a collision between the first moving body and the vehicle 1 (step S85). Specifically, when the predicted arrival time of the first moving body calculated in step S81 and the predicted arrival time of the vehicle 1 calculated in step S83 are within a predetermined time difference, the collision risk determination unit 57 determines that there is a possibility of a collision between the first moving body and the vehicle 1. The predetermined time difference may be set to an arbitrary value taking into consideration a change in speed of the first moving body or the vehicle 1, and a need not to make each other feel dangerous even if a collision does not occur.

[0089] If there is a possibility that the first moving body and the vehicle 1 will collide (S85 / Yes), the collision risk determination unit 57 sets a collision avoidance process execution flag (step S87) and ends the collision prediction process. On the other hand, if there is no possibility that the first moving body and the vehicle 1 will collide (S85 / No), the collision risk determination unit 57 ends the collision prediction process as it is.

[0090] On the other hand, in the above-mentioned step S71, if the second moving object is located on the travel path of the first moving object (S71 / Yes), the collision risk determination unit 57 calculates the time when the first moving object will reach the intersection position based on the first behavior data of the first moving object and the second behavior data of the second moving object (step S91). Specifically, the collision risk determination unit 57 calculates the time when the first moving object will reach the intersection position based on the first behavior data of the first moving object acquired before the first time when the first moving object was last detected by the road camera 150 and the second behavior data of the second moving object after the first time.

[0091] FIG. 14 is a flowchart showing an example of a process for calculating a predicted arrival time of a first moving object at an intersection position when a second moving object is located on a travel path of the first moving object. The collision risk determination unit 57 determines whether or not the travel of the first moving object is obstructed by the second moving object based on the second behavior data of the second moving object after the first time when the first moving object was detected by the road camera 150 (step S101). For example, the collision risk determination unit 57 determines that the travel of the first moving object is obstructed by the second moving object when the second moving object enters the route on which the first moving object passes or when the second moving object moves in a direction intersecting the route on which the first moving object passes.

[0092] At this time, the collision risk determination unit 57 may determine that the travel of the first moving body will be obstructed by the second moving body when the second moving body is predicted to enter the passing area of ​​the first moving body at the same time as the predicted passing time of the first moving body, based on the moving speed and moving direction of the second moving body and the moving speed and moving direction of the first moving body detected by the road camera 150. The predicted passing time of the first moving body at each point can be predicted based on the moving speed and elapsed time of the first moving body. Similarly, the predicted route of the second moving body can be predicted based on the moving speed, moving direction, and moving time of the second moving body.

[0093] If it is not determined that the second moving object will impede the travel of the first moving object (S101 / No), the collision risk determination unit 57 assumes that the first moving object will maintain the moving speed when detected by the road camera 150 without accelerating or decelerating, and proceeds to step S111. In this case, the collision risk determination unit 57 obtains the required time by dividing the distance from the position of the first moving object at the first time to the intersection position by the moving speed, and adds this to the first time to calculate the predicted arrival time (step S111).

[0094] On the other hand, when it is determined that the second moving body is obstructing the travel of the first moving body (S101 / Yes), the collision risk determination unit 57 assumes that the first moving body starts decelerating at a predetermined deceleration and decelerates to a predetermined low-speed travel speed (step S105). The predetermined deceleration may be set according to the distance from the first moving body to the second moving body at the start of deceleration. In this case, the closer the distance from the first moving body to the second moving body is, the larger the deceleration value is set. In addition, the predetermined low-speed travel speed may be set according to the width of the road on which the first moving body travels. In this case, the smaller the width of the road is, the smaller the low-speed travel speed is set. Furthermore, the deceleration and the low-speed travel speed may be set according to the travel speed of the first moving body based on statistical data that collects general deceleration timing.

[0095] Next, the collision risk determination unit 57 determines whether the first moving body has overtaken the second moving body (step S107). Specifically, the collision risk determination unit 57 determines that the first moving body has overtaken the second moving body when the position of the first moving body estimated based on the moving speed when the first moving body was detected by the road camera 150, the deceleration and low speed running speed assumed in step S105, and the running time at each moving speed passes the position of the second moving body specified as the position information of the mobile terminal 130, which changes from moment to moment.

[0096] If the first moving body has not passed the second moving body (S107 / No), the collision risk determination unit 57 assumes that the first moving body continues moving in a decelerated state and calculates a predicted arrival time at which the first moving body will arrive at the intersection position (step S111). Specifically, the collision risk determination unit 57 calculates the required time for the first moving body to travel at the deceleration and low travel speed assumed in step S105 by subtracting the travel distance obtained by the travel speed at which the first moving body was detected by the road camera 150 from the distance from the position of the first moving body to the intersection position at the first time from the travel speed at the first time. Then, the collision risk determination unit 57 adds the sum of the time traveled at the travel speed before deceleration and the required time after the start of deceleration to the first time to calculate the predicted arrival time.

[0097] On the other hand, when the first moving object overtakes the second moving object (S107 / Yes), the collision risk determination unit 57 assumes that the first moving object accelerates after the second time when the first moving object overtakes the second moving object, and recovers to the moving speed before deceleration (step S109). The acceleration at this time may be a constant acceleration set in advance, or may be any acceleration according to the moving speed after recovery. In addition, when information indicating the tendency of the acceleration of the first moving object is obtained from the first behavior data of the first moving object detected by the road camera 150, the acceleration may be set according to the information.

[0098] Next, the collision risk determination unit 57 assumes that the first moving body has decelerated and accelerated after the second time, and calculates the predicted arrival time when the first moving body will arrive at the intersection position (step S111). Specifically, the collision risk determination unit 57 calculates the travel distance obtained by adding the travel speed when the first moving body was detected by the road camera 150 to the time spent traveling at the travel speed after the first time. The collision risk determination unit 57 also calculates the deceleration and low speed travel speed assumed in step S105, and further the time from the second time onwards when the first moving body traveled at the acceleration assumed in step S109, and the travel distance during that time. Furthermore, the collision risk determination unit 57 calculates the remaining distance obtained by subtracting the sum of the travel distance traveled at the travel speed when the first moving body was detected by the road camera 150 and the travel distance traveled from the start of deceleration until recovery to the travel speed before deceleration from the distance from the position of the first moving body to the intersection position at the first time, by the travel speed after recovery, thereby calculating the required time for the remaining distance. Then, the predicted arrival time is calculated by adding to the first time the sum of the time taken to travel at the travel speed before deceleration, the time required from the start of deceleration to recovering to the travel speed before deceleration, and the time required to travel the remaining distance at the travel speed after recovery.

[0099] 13, after calculating the predicted arrival time for the first moving object to arrive at the intersection, the collision risk determination unit 57 calculates the time for the vehicle 1 to arrive at the intersection based on information on the moving speed of the vehicle 1 (step S93). Specifically, the collision risk determination unit 57 obtains the required time by dividing the distance from the position of the vehicle 1 at the first time to the intersection by the moving speed of the vehicle 1, and adds it to the first time to calculate the predicted arrival time.

[0100] Next, the collision risk determination unit 57 determines whether or not there is a possibility of collision between the first moving body and the vehicle 1 in the same procedure as in step S85 described above (step S95). If there is a possibility of collision between the first moving body and the vehicle 1 (S95 / Yes), the collision risk determination unit 57 sets a collision avoidance process execution flag (step S97) and ends the collision prediction process. On the other hand, if there is no possibility of collision between the first moving body and the vehicle 1 (S95 / No), the collision risk determination unit 57 ends the collision prediction process as it is.

[0101] Returning to FIG. 10, after the collision prediction process is performed in step S51, the driving control unit 59 executes the collision avoidance process (step S53). Specifically, when the collision avoidance process execution flag is set as a result of the collision prediction process, the driving control unit 59 executes a process for avoiding a collision between the vehicle 1 and the first moving body. For example, the driving control unit 59 may avoid a collision between the vehicle 1 and the first moving body by slowing down the vehicle 1 to delay the time when the vehicle 1 reaches the intersection position. Alternatively, when the road on which the vehicle 1 travels is wide or has multiple lanes, the driving control unit 59 may avoid a collision between the vehicle 1 and the first moving body by changing the traveling trajectory of the vehicle 1 instead of or in addition to the deceleration of the vehicle 1. The driving control unit 59 sets an instruction value for the deceleration rate of the vehicle 1 and an instruction value for the steering angle, and transmits the instruction values ​​to the vehicle control unit 41.

[0102] As described above, after the first time when the first moving object that cannot communicate with the supported vehicle 1 is no longer detected by the road cameras 150, the driving support device 50 predicts the predicted arrival time when the first moving object will reach the intersection position, taking into consideration not only the moving speed when it was detected by the road cameras 150, but also deceleration and acceleration due to the influence of the second moving object that exists in the travel path of the first moving object. This makes it possible to improve the prediction accuracy of a collision between the vehicle 1 and the first moving object.

[0103] <1-6. Application Examples> So far, the driving assistance system 100 according to this embodiment has been described. Hereinafter, an example in which the driving assistance system 100 according to this embodiment is applied will be described.

[0104] Figures 15 to 18 are explanatory diagrams for explaining application examples of the driving assistance system 100 of this embodiment, and show application examples in a driving scene in which the assisted vehicle 1 and another vehicle 90 as a first moving body are each traveling toward an intersection C.

[0105] As shown in Fig. 15, another vehicle 90 is traveling toward an intersection C ahead of the vehicle 1 in the traveling direction. Fig. 15 shows a state in which the other vehicle 90 is located within a shooting range 153 of a road camera 150 serving as an environment recognition device and is recognized by the road camera 150. In this application example, it is assumed that the time when the other vehicle 90 reaches the intersection C while maintaining the current traveling speed and the time when the vehicle 1 reaches the intersection C overlap, and there is a risk of a collision between the other vehicle 90 and the vehicle 1 to be supported. A pedestrian H who owns a mobile terminal 130 is present ahead of the other vehicle 90 in the traveling direction as a second moving body.

[0106] FIG. 16 shows a state where the other vehicle 90 moves toward the intersection C and moves out of the shooting range 153 of the road camera 150. In the state shown in FIG. 16, the pedestrian H is moving along the side of the road and is not in a situation where he or she is obstructing the travel of the other vehicle 90. FIG. 17 shows a state where the pedestrian H has entered the path on which the other vehicle 90 is traveling. The other vehicle 90 decelerates to avoid a collision with the pedestrian H. FIG. 18 shows a state where the other vehicle 90 has overtaken the pedestrian H after the pedestrian H has crossed in front of the other vehicle 90. The other vehicle 90 accelerates because there is no longer a pedestrian H ahead.

[0107] In such a driving scene, it is assumed that the driving support device of the vehicle 1 to be assisted determines the predicted arrival time of the other vehicle 90 at the intersection C based on the moving speed of the other vehicle 90 detected by the road camera 150 and the distance from the installation position of the road camera 150 to the intersection C without considering the information of the pedestrian H. In this case, the predicted arrival time of the vehicle 1 to be assisted and the predicted arrival time of the other vehicle 90 at the intersection C are within a predetermined time difference, and the driving support device predicts that the other vehicle 90 (other vehicle 90a shown by the broken line in FIG. 18) will collide with the vehicle 1 to be assisted. Therefore, even though the other vehicle 90 has not actually arrived at the intersection C, the driving support device decelerates the vehicle 1 to be assisted or changes the route of the vehicle 1, which causes a sense of distrust among the occupants of the vehicle 1 to be assisted.

[0108] On the other hand, the driving support device 50 according to the present embodiment assumes that the other vehicle 90 will decelerate when it is determined that the pedestrian H is obstructing the travel of the other vehicle 90, and further assumes that the other vehicle 90 will recover to the travel speed before deceleration after overtaking the pedestrian H. Therefore, the predicted arrival time at which the other vehicle 90 will arrive at the intersection C and the predicted arrival time at which the assisted vehicle 1 will arrive at the intersection C exceed a predetermined time difference, and the driving support device 50 does not predict that the other vehicle 90 will collide with the assisted vehicle 1. Therefore, the driving support device 50 does not decelerate the assisted vehicle 1 or change the route of the vehicle 1, and can prevent the driver or other passengers of the assisted vehicle 1 from feeling distrustful.

[0109] <1-7.Effects> As described above, in the driving assistance system 100 according to the first embodiment of the present disclosure, the driving assistance device 50 acquires the first behavior data of the first moving body detected by the road camera 150 provided on a vehicle other than the first moving body via the management server 110, and acquires the second behavior data of the second moving body, which is a second moving body that exists on the planned travel route of the first moving body and has a mobile terminal 130 that transmits its own behavior data to the vehicle 1 to be supported via the management server 110. Furthermore, the driving assistance device 50 predicts a collision between the first moving body and the vehicle 1 to be supported, based on the first behavior data of the first moving body acquired before the first time when the first moving body was last detected by the road camera 150 and the second behavior data acquired from the mobile terminal 130 of the second moving body, after the first time when the first moving body was last detected by the road camera 150. As a result, even if the first moving body does not have a vehicle-to-vehicle communication means or a road-to-vehicle communication means, it is possible to predict a collision between the first moving body and the vehicle 1 to be supported, taking into account the deceleration and acceleration of the first moving body after the vehicle 1 to be supported is no longer able to acquire the first behavior data of the first moving body.

[0110] Therefore, it is possible to reduce the risk of a head-on accident between the first moving body, which is in a situation where it cannot transmit its own behavioral data to the supported vehicle, and the supported vehicle 1. It is also possible to prevent the driver and other occupants of the vehicle 1 from feeling distrustful of the vehicle 1, which would be caused by decelerating the vehicle 1 or changing the route of the vehicle 1 even though there is no risk of the supported vehicle 1 colliding with the first moving body. It is also possible to reduce the risk of putting the supported vehicle 1 in danger by determining that there is no risk of collision even though there is a risk of the supported vehicle 1 colliding with the first moving body.

[0111] In addition, in the driving assistance system 100 according to this embodiment, the driving assistance device 50 predicts that the first moving body will decelerate when it is determined that the second moving body will obstruct the travel of the first moving body, and estimates a change in the moving speed of the first moving body. Therefore, it is possible to predict a collision between the first moving body and the vehicle 1 to be assisted, taking into consideration the delay in the time at which the first moving body arrives at the intersection position due to the second moving body.

[0112] In addition, in the driving assistance system 100 according to this embodiment, when the second moving body is predicted to enter the passing area of ​​the first moving body at the same time as the predicted passing time of the first moving body, the driving assistance device 50 determines that the second moving body will obstruct the traveling of the first moving body. This makes it possible to predict not only the existence of the second moving body in the traveling path of the first moving body, but also a specific situation in which the first moving body will decelerate, and to predict a collision between the first moving body and the vehicle 1 to be assisted.

[0113] Furthermore, in the driving assistance system 100 according to this embodiment, the driving assistance device 50 predicts that the first moving body will recover to the speed before deceleration after the second time when it is estimated that the first moving body has overtaken the second moving body, and predicts a collision between the first moving body and the assisted vehicle 1. Therefore, it is possible to predict a collision between the first moving body and the assisted vehicle 1 in consideration of the acceleration after the first moving body has overtaken the second moving body.

[0114] <<2. Second embodiment>> Next, a driving assistance system according to a second embodiment will be described. In the driving assistance system according to the second embodiment, the second moving body existing in the travel path of the first moving body is configured to be able to transmit at least one of its surrounding sounds and its own biometric information to the vehicle to be supported directly or via an external server. In this case, the biometric information of the second moving body is biometric information of a pedestrian or a person riding a moving body such as a bicycle. The vehicle to be supported estimates the position of the first moving body using the surrounding sounds or biometric information of the second moving body in addition to the second behavior data, and predicts a collision between the first moving body and the vehicle to be supported. The driving assistance system according to the second embodiment will be described below, focusing mainly on the differences from the driving assistance system according to the first embodiment.

[0115] <2-1. Basic configuration of driving assistance system) The basic configuration of the driving assistance system according to this embodiment may be configured similarly to the basic configuration of the driving assistance system according to the first embodiment shown in FIG. In the driving assistance system according to this embodiment, the functional configuration of the environment recognition device (road camera 150) may be the same as that of the environment recognition device of the driving assistance system according to the first embodiment. The mobile terminal 130 may be the same as the mobile terminal 130 of the driving assistance system according to the first embodiment, except that it is equipped with a microphone array that collects surrounding sounds and a biosensor that detects bioinformation of the second moving body, and is configured to be able to transmit the detected collected sound waveform and bioinformation to the management server 110. The management server 110 may be the same as the management server 110 of the driving assistance system according to the first embodiment, except that it is configured to acquire the collected sound waveform and bioinformation transmitted from the mobile terminal 130 and transmit them to the driving assistance device 50. The driving assistance device 50 predicts a collision between the first moving body and the vehicle 1 to be assisted, based on the sounds and bioinformation around the second moving body, together with the first behavior data of the first moving body and the second behavior data of the second moving body.

[0116] In this embodiment, an example will be described in which the mobile terminal 130 includes both a microphone array and a biosensor. However, the mobile terminal 130 may include only one of the microphone array or the biosensor.

[0117] <2-2.Mobile devices> FIG. 19 is a block diagram showing the functional configuration of the mobile terminal 130A. The mobile terminal 130A includes a communication unit 131, a processing unit 133, a storage unit 139, a GNSS sensor 141, a microphone array 143, and a biosensor 145. Among these, the functions of the communication unit 131, the storage unit 139, and the GNSS sensor 141 may be similar to those of the mobile terminal 130 of the driving assistance system according to the first embodiment.

[0118] The microphone array 143 outputs the sound around the mobile terminal 130A as waveform data to the processing unit 133. The biosensor 145 may be, for example, a non-wearable or wearable sensor that detects the heartbeat or pulse of the second moving body, or may be a sensor having a function of detecting bioinformation such as blood pressure or body temperature of the second moving body. The biosensor 145 may be provided in the mobile terminal 130A main body, or may be provided in a wearable device that is communicatively connected to the processing unit 133 of the mobile terminal 130A. In this case, the biosensor 145 may be configured to be communicable with the processing unit 133 via wireless communication means such as Bluetooth (registered trademark), NFC (Near Field Communication), wifi (wireless fidelity), and wireless LAN (Local Area Network).

[0119] The processing unit 133 includes one or more CPUs, and acquires position information of the mobile terminal 130A at each predetermined processing cycle, and obtains the moving speed and moving direction of the mobile terminal 130. The processing unit 133 also acquires waveform data (collected sound waveform) of sounds around the mobile terminal 130A and biometric information of the second moving body at each predetermined processing cycle. Furthermore, the processing unit 133 transmits the acquired information and information of the calculation result at each predetermined processing cycle to the management server 110. The storage unit 139 includes one or more memories, and stores computer programs executed by the processing unit 133, various parameters used in the calculation processing, and information of the calculation result. The storage unit 139 may be a storage element such as a RAM and a ROM, a flash memory such as an SSD, or other recording medium.

[0120] The processing unit 133 includes a data processing unit 136 and a communication control unit 137. The functions of these units are realized by the execution of a computer program by a processor. The data processing unit 136 calculates the moving speed and moving direction of the mobile terminal 130 based on the position information input from the GNSS sensor 141 in a predetermined processing cycle. For example, the data processing unit 135 can calculate the moving speed and moving direction of the mobile terminal 130 based on the time change of the position information input for each predetermined processing cycle.

[0121] The communication control unit 137 transmits to the management server 110 the location information of the mobile terminal 130 input from the GNSS sensor 141, information on the moving speed and moving direction of the mobile terminal 130 calculated by the data processing unit 135, the collected sound waveform, and the biometric information of the second moving body.

[0122] Fig. 20 shows a flowchart of the processing operation by the mobile terminal 130 A. The flowchart shown in Fig. 20 is repeatedly executed for each predetermined processing cycle.

[0123] The data processing unit 136 of the processing unit 133 acquires the position information input from the GNSS sensor 141, the waveform data input from the microphone array 143, and the biometric information input from the biometric sensor 145 (step S22). Next, the data processing unit 136 calculates the moving direction and moving speed of the mobile terminal 130 based on the acquired position information in a similar procedure to step S23 described in the first embodiment (step S24).

[0124] Next, the communication control unit 137 transmits the location information acquired from the GNSS sensor 141, the calculated information on the moving speed and moving direction, the acquired collected sound waveform, and the biological information to the management server 110 (step S26). The mobile terminal 130A repeatedly executes the processes of steps S22 to S26 described above for each predetermined processing cycle.

[0125] The second moving object holding the mobile terminal 130 is not limited to a pedestrian, but may be a vehicle, a motorcycle, a bicycle, or any other object that moves at a predetermined speed.

[0126] <2-3. Driving support devices> The basic functional configuration of the driving assistance device in the driving assistance system according to this embodiment and the configuration of a vehicle to which the driving assistance device can be applied may be similar to the functional configuration of the driving assistance device according to the first embodiment and the configuration of a vehicle to which the driving assistance device can be applied. Hereinafter, the processing operation of the driving assistance device of the driving assistance system according to this embodiment will be described.

[0127] The main routine of the processing operation by the driving assistance device 50 may be similar to the processing operation by the driving assistance device of the driving assistance system according to the first embodiment shown in Fig. 10. Among these, the content of the processing for predicting a collision between the first moving body and the assisted vehicle 1 is different from that in the first embodiment, and therefore, hereinafter, the collision prediction processing by the driving assistance device 50 according to this embodiment will be described with reference to Figs. 11, 12, 21, and 22.

[0128] The collision risk determination unit 57 executes the processes of steps S61 to S71 described above according to the flowchart shown in Fig. 11. Furthermore, in step S71, if the second moving body is not located on the travel path of the first moving body (S71 / No), the collision risk determination unit 57 executes the processes of steps S81 to S87 described above according to the flowchart shown in Fig. 12.

[0129] On the other hand, in step S71, if the second moving object is located on the travel path of the first moving object (S71 / Yes), the collision risk determination unit 57 calculates the time when the first moving object will reach the intersection position based on the first behavior data of the first moving object, the second behavior data of the second moving object, the collected sound waveform, and the biological information (step S92). Specifically, the collision risk determination unit 57 calculates the time when the first moving object will reach the intersection position based on the first behavior data of the first moving object acquired before the first time when the first moving object was last detected by the road camera 150, and the second behavior data of the second moving object, the collected sound waveform, and the biological information after the first time.

[0130] FIG. 22 is a flowchart showing an example of a process for calculating a predicted arrival time of a first moving object at an intersection position when a second moving object is located on a travel path of the first moving object. The collision risk determination unit 57 estimates the position of the first moving body based on the acquired waveform data (collected sound waveform) of the sound around the second moving body (step S121). Specifically, the collision risk determination unit 57 estimates the situation in which the first moving body approaches the second moving body and the situation in which the first moving body moves away from the second moving body based on the waveform data output from the microphone array 143. For example, the collision risk determination unit 57 may determine that the first moving body approaches the second moving body when the sound around the second moving body gradually increases, and then that the first moving body moves away from the second moving body when the sound around the second moving body gradually decreases. Alternatively, when the microphone array 143 is a directional microphone array, the collision risk determination unit 57 may determine the approach and departure of the first moving body by identifying the moving direction of the sound source based on the collected sound waveform.

[0131] Next, the collision risk determination unit 57 estimates the position of the first moving body based on the acquired biometric information of the second moving body (step S123). When a pedestrian or a bicycle corresponding to the second moving body crosses or crosses in front of the first moving body, it is considered that the second moving body becomes in a state of urgency (tension) according to the degree of proximity between the first moving body and the second moving body, and this state appears in the biometric information of the second moving body. Therefore, the collision risk determination unit 57 monitors the biometric information of the second moving body, and when the heart rate, pulse rate, blood pressure, or body temperature rises suddenly, it determines that the first moving body is located within a predetermined range from the second moving body. The value of the predetermined range may be set in advance to any appropriate value.

[0132] Next, the collision risk determination unit 57 calculates a predicted arrival time at which the first moving body will arrive at the intersection with the vehicle 1 to be supported, taking into consideration the position of the first moving body estimated in step S121 or step S123 (step S125). Specifically, the collision risk determination unit 57 divides the distance from the position of the first moving body to the intersection position at the first time by the moving speed at which the first moving body was detected by the road camera 150, as the basic required time. Furthermore, when it is estimated in step S121 or step S125 that the first moving body has approached the second moving body, the collision risk determination unit 57 obtains the distance from the position of the first moving body to the position of the second moving body at the first time based on the position information of the second moving body at that time. Furthermore, the collision risk determination unit 57 calculates the average moving speed to the position where the first moving body approaches the second moving body by dividing the obtained distance value by the required time from the first time to the time when the first moving body approaches the second moving body.

[0133] Then, the collision risk determination unit 57 obtains the remaining required time by dividing the remaining distance from the position where the first moving body approaches the second moving body to the intersection position by the average moving speed, and calculates the predicted arrival time at which the first moving body will arrive at the intersection position by adding the sum of the required times to the first time.

[0134] Returning to Fig. 21, after calculating the predicted arrival time when the first moving body will arrive at the intersection position, the collision risk determination unit 57 predicts a collision between the first moving body and the support target vehicle 1 according to the processes of steps S93 to S97 of the flowchart shown in Fig. 13, and ends the collision prediction process. Thereafter, according to the flowchart shown in Fig. 10, if a collision between the first moving body and the support target vehicle 1 is predicted and the collision avoidance process execution flag is set, the collision avoidance process is executed by the driving control unit 59 in step S53.

[0135] <2-4.Effects> As described above, in the driving assistance system according to the second embodiment of the present disclosure, the driving assistance device 50 acquires the first behavior data of the first moving body detected by the road camera 150 provided on a vehicle other than the first moving body via the management server 110, and acquires the second behavior data, collected sound waveforms, and biological information of the second moving body, which is present on the planned driving route of the first moving body and has a mobile terminal 130 that transmits its own behavior data to the vehicle 1 to be supported via the management server 110. In addition, the driving assistance device 50 predicts a collision between the first moving body and the vehicle 1 to be supported based on the first behavior data of the first moving body acquired before the first time after the first time when the first moving body was last detected by the road camera 150, and the second behavior data, collected sound waveforms, and biological information acquired from the mobile terminal 130 of the second moving body. As a result, even if the first moving body does not have vehicle-to-vehicle communication means or road-to-vehicle communication means, etc., it is possible to predict a collision between the first moving body and the supported vehicle 1, taking into account the deceleration and acceleration of the first moving body after the supported vehicle 1 is no longer able to acquire the first behavior data of the first moving body.

[0136] Therefore, it is possible to reduce the risk of a head-on accident between the first moving body, which is in a situation where it cannot transmit its own behavioral data to the supported vehicle, and the supported vehicle 1. It is also possible to prevent the driver and other occupants of the vehicle 1 from feeling distrustful of the vehicle 1, which would be caused by decelerating the vehicle 1 or changing the route of the vehicle 1 even though there is no risk of the supported vehicle 1 colliding with the first moving body. It is also possible to reduce the risk of putting the supported vehicle 1 in danger by determining that there is no risk of collision even though there is a risk of the supported vehicle 1 colliding with the first moving body.

[0137] In addition, in the driving assistance system according to this embodiment, the driving assistance device 50 estimates the position of the first moving body based on sound information or biometric information around the second moving body transmitted from the mobile terminal 130, and predicts a collision between the first moving body and the vehicle 1 to be assisted. Therefore, it is possible to estimate the position of the first moving body at an intermediate point before arriving at the intersection position after the first time when the first moving body was last detected by the road camera 150, and it is possible to improve the estimation accuracy of the predicted arrival time when the first moving body arrives at the intersection position. Therefore, it is possible to improve the prediction accuracy of a collision between the first moving body and the vehicle 1 to be assisted.

[0138] Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technology of the present disclosure is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field to which the present disclosure belongs can conceive of various modified or amended examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure.

[0139] For example, in the above embodiment, the driving support device mounted on the vehicle to be assisted executes a process of calculating a predicted arrival time of the first moving object based on various information, but the management server 110 may have a function of calculating the predicted arrival time. Also, in the above embodiment, the driving support device mounted on the vehicle to be assisted executes a process of predicting a collision between the first moving object and the vehicle to be assisted based on various information, but the management server 110 may have a function of predicting the collision. In addition, some of the functions of the environment recognition device (road camera), the mobile terminal, the management server, and the driving support device described in the above embodiment may be provided in other components.

[0140] In the above embodiment, both the environment recognition device (road camera) and the mobile terminal are configured to transmit information to the driving support device via the management server, but the technology of the present disclosure is not limited to such an example. At least one of the environment recognition device (road camera) and the mobile terminal may be configured to transmit information directly to the driving support device via a communication network. Even in such a configuration, the same effects as those of the above embodiment can be obtained.

[0141] In the above embodiment, the first moving body does not have a vehicle-to-vehicle communication means or a road-to-vehicle communication means, etc., and cannot communicate with the support target vehicle, but the technology of the present disclosure is not limited to the above example. Even if the first moving body is a moving body that has a vehicle-to-vehicle communication means or a road-to-vehicle communication means, etc., and the communication means is disabled due to some factor, the technology of the present disclosure can predict a collision between the first moving body and the support target vehicle. [Explanation of symbols]

[0142] 1: vehicle (support target), 50: driving support device, 53: processing unit, 55: communication control unit, 57: collision risk determination unit, 59: driving control unit, 90: other vehicle, 90a: other vehicle, 100: driving support system, 105: communication network, 110: management server, 113: processing unit, 130: mobile terminal, 133: processing unit, 141: GNSS sensor, 143: microphone array, 145: biosensor, 150: road camera, 151: image generation unit, 153: shooting range, 160: imaging processing device, 163: processing unit, 165: image processing unit, C: intersection, H: pedestrian

Claims

1. In a driving assistance system that assists driving of a vehicle, one or more processors; and one or more memories communicatively coupled to the one or more processors; the one or more processors: acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided on a predetermined first moving body other than a vehicle to be supported, directly from the environment recognition device or via an external server; a second moving body that is present on a planned travel route of the first moving body and has a communication means for transmitting its own behavior data and information about sounds around the second moving body to the support target vehicle directly or via an external server, and acquires second behavior data, which is behavior data of the second moving body, and information about sounds around the second moving body; A driving assistance system which, after a first time at which a first moving body that was detected by the environmental recognition device but is no longer detected by the environmental recognition device was last detected by the environmental recognition device, determines the approach and passage of the first moving body relative to the second moving body based on the first behavior data of the first moving body acquired before the first time, the second behavior data acquired from the communication means of the second moving body, and information on sounds around the second moving body, and predicts a collision between the first moving body and the vehicle to be assisted.

2. A driving assistance system for assisting driving of a vehicle, comprising: one or more processors; and one or more memories communicatively coupled to the one or more processors; the one or more processors: acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided on a predetermined first moving body other than a vehicle to be supported, directly from the environment recognition device or via an external server; a second moving body that is present on a planned travel route of the first moving body and has a communication means for transmitting its own behavior data and its own biometric information detected by a biometric sensor to the support target vehicle directly or via an external server, the second behavior data being behavior data of the second moving body and the biometric information of the second moving body; A driving assistance system which, after a first time at which a first moving body that was detected by the environmental recognition device but is no longer detected by the environmental recognition device was last detected by the environmental recognition device, determines the presence of the first moving body around the second moving body based on the first behavior data of the first moving body acquired before the first time, the second behavior data acquired from the communication means of the second moving body, and biometric information of the second moving body, and predicts a collision between the first moving body and the vehicle to be assisted.

3. the one or more processors: calculating an average moving speed of the first moving body to a position where the first moving body approaches the second moving body based on a distance from a position of the first moving body to a position of the second moving body at the first time and a first required time from the first time to a time when the first moving body approaches the second moving body; 2. The driving assistance system of claim 1, further comprising: a remaining distance from a position where the first moving body approaches the second moving body to an intersection position between the assisted vehicle and the first moving body being divided by the average moving speed to obtain a remaining second required time; and a predicted arrival time at which the first moving body will arrive at the intersection position being calculated by adding a sum of the first required time and the second required time to the first time.

4. In a vehicle equipped with a driving assistance device that assists in driving the vehicle, The driving assistance device includes: acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided on a predetermined first moving body other than a vehicle to be supported, directly from the environment recognition device or via an external server; a second moving body that is present on a planned travel route of the first moving body and has a communication means for transmitting its own behavior data and information about sounds around the second moving body to the support target vehicle directly or via an external server, and second behavior data that is information about behavior data of the second moving body and sounds around the second moving body; A vehicle that, after a first time at which a first moving body that was detected by the environmental recognition device but is no longer detected by the environmental recognition device was last detected by the environmental recognition device, determines the approach and passage of the first moving body relative to the second moving body based on the first behavior data of the first moving body acquired before the first time, the second behavior data acquired from the communication means of the second moving body, and information regarding sounds around the second moving body, and predicts a collision between the first moving body and the vehicle to be supported.

5. A vehicle equipped with a driving assistance device that assists in driving the vehicle, The driving assistance device includes: acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided on a predetermined first moving body other than a vehicle to be supported, directly from the environment recognition device or via an external server; a second moving body that is present on a planned travel route of the first moving body and has a communication means for transmitting its own behavior data and its own biometric information detected by a biometric sensor to the support target vehicle directly or via an external server, the second behavior data being behavior data of the second moving body and the biometric information of the second moving body; A vehicle which, after a first time at which a first moving body, which was detected by the environmental recognition device but is no longer detected by the environmental recognition device, was last detected by the environmental recognition device, determines the presence of the first moving body around the second moving body based on the first behavior data of the first moving body acquired before the first time, the second behavior data acquired from the communication means of the second moving body, and biometric information of the second moving body, and predicts a collision between the first moving body and the vehicle to be supported.

6. A recording medium having a computer program applied to a driving assistance system that assists driving of a vehicle, One or more processors, Acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided on a predetermined first moving body other than a vehicle to be supported, directly from the environment recognition device or via an external server; acquiring second behavior data, which is behavior data of the second moving body that is present on a planned travel route of the first moving body and has a communication means for transmitting its own behavior data and information about sounds around the second moving body, to the support target vehicle directly or via an external server, and information about sounds around the second moving body; After a first time at which a first moving body that was detected by the environment recognition device but is no longer detected by the environment recognition device was last detected by the environment recognition device, determining the approach and passage of the first moving body relative to the second moving body based on the first behavior data of the first moving body acquired before the first time, the second behavior data acquired from the communication means of the second moving body, and information regarding sounds around the second moving body, and predicting a collision between the first moving body and the support target vehicle; A recording medium on which a computer program for executing a process including the steps of:

7. A recording medium having a computer program applied to a driving assistance system that assists driving of a vehicle, One or more processors, Acquiring first behavior data, which is behavior data of a first moving body detected by an environment recognition device provided on a predetermined first moving body other than a vehicle to be supported, directly from the environment recognition device or via an external server; acquiring second behavior data, which is behavior data of the second moving body, and the biometric information of the second moving body, the second moving body being present on a planned travel route of the first moving body and having a communication means for transmitting the behavior data of the second moving body and its own biometric information detected by a biometric sensor to the support target vehicle directly or via an external server; determining the presence of the first moving body around the second moving body based on the first behavior data of the first moving body acquired before the first time, the second behavior data acquired from the communication means of the second moving body, and biometric information of the second moving body, after a first time when the first moving body, which was detected by the environment recognition device but is no longer detected by the environment recognition device, is last detected by the environment recognition device, and predicting a collision between the first moving body and the support target vehicle; A recording medium on which a computer program for executing a process including the steps of:

Images