Vehicle control system and vehicle control method

By installing infrastructure cameras outside the vehicle, combining on-board sensors to detect targets around the vehicle, setting a judgment area and performing deceleration control, the problem that the vehicle cannot detect targets such as bends or steep slopes in front of the vehicle is solved, and the safety of the vehicle is improved sex.

CN119058670APending Publication Date: 2024-12-03TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410597114.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-05-14
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The existing vehicle driving assistance devices cannot detect targets such as curves or steep slopes in front of the vehicle through the on-board camera, resulting in an increase in the necessity of emergency braking and reducing the safety of the vehicle.

Method used

Infrastructure cameras are used to detect targets around the vehicle, and by combining them with on-board sensors, setting the determination area and performing deceleration control to ensure that the vehicle slows down in advance to avoid collisions.

Benefits of technology

By detecting targets that the vehicle cannot see, deceleration control is performed in advance, reducing the necessity of emergency braking and improving the safety of the vehicle.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119058670A_ABST
    Figure CN119058670A_ABST
Patent Text Reader

Abstract

A vehicle control system for controlling a vehicle traveling in a predetermined area is provided. A vehicle control system acquires vehicle information indicating a position of a vehicle. The vehicle control system sets a determination area around the vehicle on the basis of the vehicle information. A vehicle control system acquires an image captured by an infrastructure camera mounted outside the vehicle and imaging a condition of a predetermined area. The vehicle control system determines whether a target is present in the determination area based on an image captured by the infrastructure camera. The vehicle control system decelerates the vehicle when the target is present in the determination area.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a technology for controlling a vehicle traveling in a predetermined area. Background Art

[0002] Patent document 1 discloses a driving assistance device for a vehicle. The driving assistance device sets a determination area for collision risk determination in front of the vehicle. The driving assistance device uses an on-board camera to detect a preceding vehicle in front of the vehicle. When the preceding vehicle enters the determination area, the driving assistance device determines that there is a collision risk and issues a warning to the occupants. Related technology list

[0003] Patent Document 1: Japanese Published Patent Application No. JP-2021-062759 Summary of the invention

[0004] According to the technology described in Patent Document 1, only the targets that can be viewed by the vehicle-mounted camera are regarded as targets for collision risk determination. For example, since the vehicle-mounted camera cannot see the target in front of the curve in front of the vehicle, the collision risk with respect to the target cannot be determined. When the target enters the field of view of the vehicle-mounted camera after the vehicle is very close to the target, emergency braking may be caused.

[0005] An object of the present disclosure is to provide a technology capable of improving safety when controlling a vehicle traveling in a predetermined area.

[0006] A first aspect relates to a vehicle control system for controlling a vehicle traveling in a predetermined area. The vehicle control system includes one or more processors. The one or more processors obtain vehicle information indicative of a location of the vehicle. The one or more processors set a determination area around the vehicle based on the vehicle information. The one or more processors acquire images captured by an infrastructure camera mounted on the exterior of the vehicle and imaging conditions in a predetermined area. The one or more processors determine whether an object is present in a determination area based on images captured by the infrastructure camera. The one or more processors decelerate the vehicle when an object is present in the determination area.

[0007] A second aspect relates to a vehicle control method for controlling a vehicle in a predetermined area by a computer. The vehicle control method comprises: obtaining vehicle information indicating a location of the vehicle; Based on the vehicle information, setting a determination area around the vehicle; acquiring an image captured by an infrastructure camera mounted on the exterior of the vehicle and imaging conditions in a predetermined area; Determining whether a target exists in a determination area based on an image captured by an infrastructure camera; and When a target exists in the determination area, the vehicle is decelerated.

[0008] According to the present disclosure, an infrastructure camera is used to control a vehicle. Using an infrastructure camera makes it possible to detect a target that cannot be detected by an onboard sensor (such as an onboard camera). Then, vehicle control is performed taking into account the target that cannot be detected by the onboard sensor. More specifically, when there is a target in a determination area around the vehicle, the vehicle is decelerated. Since the target that cannot be detected by the onboard sensor is also taken into account, the vehicle can be decelerated well in advance, which can reduce the necessity of emergency braking. Therefore, the safety of controlling the vehicle is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a conceptual diagram for explaining an overview of a vehicle control system according to a first embodiment; Figure 2 is a conceptual diagram for explaining an example of a determination area for risk avoidance control according to the first embodiment; Figure 3 is a conceptual diagram for explaining another example of a determination area for risk avoidance control according to the first embodiment; Figure 4 is a block diagram showing an example of the configuration of the vehicle-mounted system according to the first embodiment; Figure 5 is a block diagram showing an example of the configuration of a vehicle control system according to the first embodiment; Figure 6 is a flowchart summarizing the processing related to risk avoidance control according to the first embodiment; Figure 7 is a diagram for explaining a method of updating a front boundary of a front determination area according to a second embodiment; Figure 8 is a diagram for explaining an example of updating of a front boundary of a front determination area according to the second embodiment; Fig. 9 is a diagram for explaining an example of block setting according to vehicle speed according to the second embodiment; Fig.10 is a conceptual diagram for explaining a front determination area and a rear determination area according to a third embodiment; Fig.11 is a diagram for explaining a method of updating a rear determination area according to a fifth embodiment; Fig.12is a diagram for explaining an example of updating of a rear determination area according to the fifth embodiment; and Fig.13 is a diagram for explaining an example of block setting according to the fifth embodiment. DETAILED DESCRIPTION

[0010] Embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0011] 1. First Embodiment 1-1. Overview Figure 1 1 is a conceptual diagram for explaining the overview of the vehicle control system 100 according to the first embodiment. The vehicle control system 100 controls the vehicle 1 traveling in a predetermined area AR.

[0012] The predetermined area AR in which the vehicle 1 travels is, for example, an elongated area extending in a first direction S. It can be said that the first direction S is the longitudinal direction of the predetermined area AR. Examples of the predetermined area AR include roads (e.g., highways, ordinary roads), passages in parking lots, passages in factories, etc. The center line of the predetermined area AR parallel to the first direction S may be the same as the center line of the road or passage. On the other hand, the width of the predetermined area AR orthogonal to the first direction S does not need to be completely equal to the width of the road or passage. The width of the predetermined area AR may be the width obtained by adding the marginal width to the vehicle width of an ordinary vehicle. The width of the predetermined area AR may be increased in a curved section.

[0013] The vehicle control system 100 may include at least a portion of an onboard system 10 installed on the vehicle 1. The onboard system 10 obtains the current position of the vehicle 1 by using a Global Navigation Satellite System (GNSS). In addition, the onboard system 10 obtains images captured (photographed) by an onboard camera. The onboard system 10 may control the vehicle 1 based on the images captured by the onboard camera. For example, the onboard system 10 may control the automatic driving of the vehicle 1 based on the images captured by the onboard camera. That is, the vehicle 1 may be an automatic driving vehicle. Here, automatic driving means that at least a portion of the steering, acceleration, and deceleration of the vehicle 1 is automatically performed independently of the driver's driving operation. As an example, the automatic driving may be one of Level 3 or higher.

[0014] The vehicle control system 100 may include an external device located outside the vehicle 1. For example, the external device is a management server that manages the vehicle 1. The management server may be a distributed server that performs distributed processing. The external device communicates with the vehicle 1 (ie, the in-vehicle system 10) and remotely controls the vehicle 1.

[0015] The vehicle control system 100 may be distributed to the in-vehicle system 10 and external devices.

[0016] According to the present embodiment, an "infrastructure camera CAM" installed outside the vehicle 1 is also used to control the vehicle 1. The infrastructure camera CAM is installed to be able to image the conditions of the predetermined area AR and its surroundings. Typically, a plurality of infrastructure cameras CAM are installed along the longitudinal direction (i.e., the first direction S) of the predetermined area AR. The respective viewing angles of the plurality of infrastructure cameras CAM may partially overlap with each other. The image 250 captured (photographed) by the infrastructure camera CAM indicates the conditions of the predetermined area AR and its surroundings.

[0017] The vehicle control system 100 communicates with the infrastructure camera CAM to acquire an image 250 captured (photographed) by the infrastructure camera CAM. A target TGT existing in a predetermined area AR may be shown in the image 250. Here, the target TGT is an object other than the vehicle 1 as a control target. Examples of the target TGT include pedestrians, bicycles, another vehicle other than the vehicle 1 (e.g., a preceding vehicle, a parked vehicle), and the like.

[0018] The vehicle control system 100 is capable of detecting (recognizing) a target TGT present in a predetermined area AR based on an image 250 captured by the infrastructure camera CAM. For example, the vehicle control system 100 utilizes image recognition AI (Artificial Intelligence) to recognize the target TGT shown in the image 250. The image recognition AI is pre-generated through machine learning. The installation information (installation position, installation direction, viewing angle, etc.) of the infrastructure camera CAM is known information. Based on the installation information of the infrastructure camera CAM and the image position of the target TGT in the image 250, the vehicle control system 100 is capable of detecting the target TGT present in the predetermined area AR and further calculating the position of the target TGT in the absolute coordinate system.

[0019] By using the infrastructure camera CAM, it is possible to detect target TGTs that cannot be detected by vehicle-mounted sensors (such as vehicle-mounted cameras). Figure 1 For example, there is a target TGT in a predetermined area AR in front of a curve in front of the vehicle 1. The target TGT in front of the curve in front of the vehicle 1 cannot be detected by the on-board sensor, but it can be detected by the infrastructure camera CAM. The same applies to the case where there is a steep slope in front of the vehicle 1.

[0020] The target TGT present in the predetermined area AR may be a "risk" for the vehicle 1 traveling in the predetermined area AR. Therefore, the vehicle control system 100 performs a "risk avoidance control" for avoiding the risk as needed. More specifically, the vehicle control system 100 automatically performs at least one of steering and deceleration of the vehicle 1 in order to avoid a collision between the vehicle 1 and the target TGT. That is, the risk avoidance control includes at least one of steering control and deceleration control.

[0021] Hereinafter, in particular, the deceleration control in the risk avoidance control will be described in detail. In addition to the deceleration control described below, a steering control may also be performed.

[0022] Figure 2 : is a conceptual diagram for explaining an example of a "determination area D" for risk avoidance control. Determination area D is an area for determining whether to activate risk avoidance control. In the case where the target TGT exists in determination area D, risk avoidance control (deceleration control) is activated. Figure 2 As shown, a determination area D is set around the vehicle 1. Generally, the determination area D is set to extend in the first direction S, similar to the predetermined area AR. The width of the determination area D orthogonal to the first direction S may be equal to the width of the predetermined area AR. Alternatively, the width of the determination area D orthogonal to the first direction S may be slightly larger than the width of the predetermined area AR.

[0023] The vehicle position PV is the position of the vehicle 1 in the absolute coordinate system. The traveling direction X is the traveling direction of the vehicle 1. The "front direction (forward)" is the traveling direction X, and the "rear direction (rear)" is the direction opposite to the traveling direction X. The determination area D can be divided into a "front determination area Df" and a "rear determination area Dr".

[0024] The front determination area Df is a determination area D in front of the vehicle 1 and is located in the front direction (i.e., the traveling direction X) when viewed from the vehicle position PV. The front boundary DBf is the front end of the front determination area Df. It can be said that the front determination area Df is an area between the front boundary DBf and the vehicle position PV. The front distance Lf is the distance from the vehicle position PV to the front boundary DBf along the first direction S. The front distance Lf is set to a distance at which the vehicle 1 can easily stop without emergency braking. The position of the front boundary DBf can be changed in conjunction with the vehicle position PV. In this case, the front determination area Df is also changed in conjunction with the vehicle position PV.

[0025] On the other hand, the rear determination region Dr is a determination region D behind the vehicle 1 and is located in the rear direction when viewed from the vehicle position PV. The rear boundary DBr is the rear end of the rear determination region Dr. It can be said that the rear determination region Dr is a region between the rear boundary DBr and the vehicle position PV. The rear distance Lr is the distance from the vehicle position PV to the rear boundary DBr along the first direction S. The position of the rear boundary DBr may be changed in conjunction with the vehicle position PV. In this case, the rear determination region Dr also changes in conjunction with the vehicle position PV.

[0026] The vehicle control system 100 sets the determination area D (the front determination area Df and the rear determination area Dr) based on the vehicle position PV. In addition, as described above, the vehicle control system 100 detects the target TGT existing in the predetermined area AR based on the image 250 captured by the infrastructure camera CAM. In addition, the vehicle control system 100 calculates the position of the target TGT in the absolute coordinate system based on the installation information (installation position, installation direction, viewing angle, etc.) of the infrastructure camera CAM. In addition, the vehicle control system 100 can detect the target TGT around the vehicle 1 by using an on-vehicle sensor (such as an on-vehicle camera).

[0027] Then, the vehicle control system 100 determines whether the target TGT exists in the determination area D. An example of the determination process is as follows. The vehicle control system 100 sets a target area covering the detected target TGT and its vicinity. For example, the target area has a circular shape. As the size of the target TGT becomes larger, the target area also becomes larger. As the moving speed of the target TGT becomes higher, the target area may become larger. The target area may have a shape in which it is widened in the moving direction of the target TGT. When the target area at least partially overlaps with the determination area D, the vehicle control system 100 determines that the target TGT exists in the determination area D.

[0028] When the target TGT exists in the determination area D, the vehicle control system 100 activates the risk avoidance control (deceleration control). That is, when the target TGT exists in the determination area D, the vehicle control system 100 decelerates the vehicle 1. Here, deceleration is a concept including deceleration to stop. That is, the vehicle control system 100 can stop the vehicle 1.

[0029] Figure 3 is a conceptual diagram for explaining another example of the determination area D. Figure 3 In the example shown, the determination area D is divided into a first determination area D1 and a second determination area D2. The first determination area D1 is located inside, and the second determination area D2 is located outside. In other words, the second determination area D2 surrounds the first determination area D1.

[0030] The front determination area Df is divided into a first front determination area D1f and a second front determination area D2f. The first front determination area D1f is located on the inner side, and the second front determination area D2f is located on the outer side. In other words, the second front determination area D2f surrounds the first front determination area D1f. The first front boundary DB1f is the front end of the first front determination area D1f. The second front boundary DB2f is the front end of the second front determination area D2f.

[0031] The rear determination area Dr is divided into a first rear determination area D1r and a second rear determination area D2r. The first rear determination area D1r is located on the inner side, and the second rear determination area D2r is located on the outer side. In other words, the second rear determination area D2r surrounds the first rear determination area D1r. The first rear boundary DB1r is the rear end of the first rear determination area D1r. The second rear boundary DB2r is the rear end of the second rear determination area D2r.

[0032] The vehicle control system 100 determines whether the target TGT exists in the determination area D. When the target TGT exists in the first determination area D1 on the inner side, the vehicle control system 100 decelerates the vehicle 1 to stop the vehicle 1. This corresponds to the emergency stop control. On the other hand, when the target TGT exists in the second determination area D2 on the outer side, the vehicle control system 100 decelerates the vehicle 1 more slowly than in the case of the emergency stop control. This corresponds to the normal deceleration control. The deceleration in the normal deceleration control is lower than the deceleration in the emergency stop control.

[0033] As described above, according to the present embodiment, the infrastructure camera CAM is used to control the vehicle 1. The use of the infrastructure camera CAM makes it possible to detect a target TGT that cannot be detected by an onboard sensor (such as an onboard camera). For example, even a target TGT that exists in front of a curve in front of the vehicle 1 can be detected by the infrastructure camera CAM. Then, the control of the vehicle 1 is performed taking into account the target TGT that cannot be detected by the onboard sensor. More specifically, when the target TGT exists in the determination area D around the vehicle 1, the vehicle 1 is decelerated. Since the target TGT that cannot be detected by the onboard sensor is also taken into account, the vehicle 1 can be decelerated well in advance, which can reduce the necessity of emergency braking. Therefore, the safety of controlling the vehicle 1 is improved.

[0034] 1-2. Example of in-vehicle system Figure 4 1 is a block diagram showing an example of a configuration of an in-vehicle system 10 mounted on a vehicle 1. The in-vehicle system 10 includes a sensor group 20, a communication device 30, a traveling device 40, and a control device 50.

[0035] The sensor group 20 includes an identification sensor, a vehicle state sensor, and a position sensor. The identification sensor identifies (detects) the conditions around the vehicle 1. Examples of the identification sensor include a camera, a laser imaging detection and ranging (LIDAR), a radar, and the like. The vehicle state sensor detects the state of the vehicle 1. For example, the vehicle state sensor includes a speed sensor, an acceleration sensor, a yaw rate sensor, a steering angle sensor, and the like. The position sensor detects the position and orientation of the vehicle 1. For example, the position sensor includes a GNSS sensor.

[0036] The communication device 30 communicates with the outside via a communication network. For example, the communication device 30 communicates with the infrastructure camera CAM, a management server, and the like.

[0037] The traveling device 40 includes a steering device, a driving device, and a braking device. The steering device steers the wheels. For example, the steering device includes an Electric Power Steering (EPS) device. The driving device is a power source that generates a driving force. Examples of the driving device include an engine, an electric motor, an in-wheel motor, etc. The braking device generates a braking force.

[0038] The control device (controller) 50 is a computer that controls the vehicle 1. The control device 50 includes one or more processors 60 (hereinafter, referred to as the processor 60 or processing circuit) and one or more storage devices 70 (hereinafter, referred to as the storage device 70). The processor 60 performs various processes. Examples of the processor 60 include a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc. The storage device 70 stores various information. Examples of the storage device 70 include a hard disk drive (HDD), a solid state drive (SSD), a volatile memory, a non-volatile memory, etc.

[0039] The vehicle control program 80 is a computer program for controlling the vehicle 1. The functions of the control device 50 can be realized by the cooperation of the processor 60 and the storage device 70 executing the vehicle control program 80. The vehicle control program 80 is stored in the storage device 70. Alternatively, the vehicle control program 80 may be recorded on a non-volatile computer-readable recording medium.

[0040] The control device 50 acquires driving environment information 90 indicating the driving environment of the vehicle 1. The driving environment information 90 is stored in the storage device 70.

[0041] The driving environment information 90 includes surrounding condition information acquired based on the recognition sensor. For example, the surrounding condition information includes an image captured by a camera. As another example, the surrounding condition information may include point group information acquired by LIDAR. The surrounding condition information includes object information related to objects (targets) around the vehicle 1. Examples of objects around the vehicle 1 include pedestrians, another vehicle, obstacles, white lines, landmarks, traffic lights, etc. The object information indicates the relative position and relative speed of the object relative to the vehicle 1.

[0042] The driving environment information 90 also includes position information indicating the vehicle position PV in the absolute coordinate system (i.e., the current position of the vehicle 1). The control device 50 acquires the position information based on the detection result of the position sensor. The control device 50 can obtain high-precision position information through a well-known positioning process using object information and map information.

[0043] The driving environment information 90 also includes vehicle state information detected by the vehicle state sensor.

[0044] In addition, the control device 50 performs vehicle travel control that controls the travel of the vehicle 1. The vehicle travel control includes steering control, acceleration control, and deceleration control. The control device 50 performs vehicle travel control by controlling the travel device 40 (ie, the steering device, the driving device, and the braking device).

[0045] In addition, the control device 50 can perform automatic driving control to control the automatic driving of the vehicle 1. Here, automatic driving means that at least part of the steering, acceleration and deceleration of the vehicle 1 is automatically performed independently of the driver's driving operation. The control device 50 generates a travel plan for the vehicle 1 based on the driving environment information 90. Examples of travel plans include maintaining the current travel lane, making lane changes, making right turns or left turns, avoiding collisions with objects, etc. In addition, the control device 50 generates a target trajectory for implementing the travel plan. The target trajectory includes a target position and a target speed of the vehicle 1. Then, the control device 50 performs the above-mentioned vehicle travel control so that the vehicle 1 follows the target trajectory.

[0046] 1-3. Example of vehicle control system Figure 51 is a block diagram showing an example of the configuration of the vehicle control system 100. The vehicle control system 100 includes one or more processors 110 (hereinafter, referred to as the processor 110 or processing circuit), one or more storage devices 120 (hereinafter, referred to as the storage device 120), and a communication device 130. The processor 110 performs various processes. Examples of the processor 110 include a CPU, a GPU, an ASIC, an FPGA, etc. The storage device 120 stores various information. Examples of the storage device 120 include an HDD, an SSD, a volatile memory, a non-volatile memory, etc. The communication device 130 communicates with the outside via a communication network. For example, the communication device 130 communicates with an infrastructure camera CAM. The communication device 130 can communicate with the vehicle 1 (i.e., the vehicle-mounted system 10).

[0047] The vehicle control program 140 is a computer program for controlling the vehicle 1. The functions of the vehicle control system 100 can be realized by the cooperation of the processor 110 and the storage device 120 that execute the vehicle control program 140. The vehicle control program 140 is stored in the storage device 120. Alternatively, the vehicle control program 140 may be recorded on a non-volatile computer-readable recording medium.

[0048] The vehicle control system 100 may be partially identical to the above-described vehicle-mounted system 10. That is, the processor 60 and the processor 110 may be identical. The storage device 70 and the storage device 120 may be identical. The vehicle control program 80 and the vehicle control program 140 may be identical.

[0049] The processor 110 acquires various information 200. The various information 200 is stored in the storage device 120. The various information 200 includes map information 210, vehicle information 220, determination area information 230, infrastructure camera information 240, an image 250, target information 260, and the like.

[0050] The map information 210 is map information of a predetermined area AR in which the vehicle 1 travels. The map information 210 is provided to the vehicle control system 100 in advance.

[0051] The vehicle information 220 is information related to the vehicle 1 as a control target. The vehicle information 220 includes at least position information indicating the vehicle position PV in the absolute coordinate system (i.e., the current position of the vehicle 1). The position information is obtained from the in-vehicle system 10. The vehicle information 220 may further include information about the traveling direction X of the vehicle 1. The traveling direction X of the vehicle 1 may be determined based on the vehicle position PV. The vehicle information 220 may further include speed information of the vehicle 1. The speed information is also obtained from the in-vehicle system 10.

[0052] The determination area information 230 is information related to the determination area D for risk avoidance control. For example, the determination area information 230 includes a setting strategy for setting the determination area D. The determination area information 230 may include a setting value of a front distance Lf from the vehicle position PV to the front boundary DBf along the first direction S. The determination area information 230 may include a setting value of a rear distance Lr from the vehicle position PV to the rear boundary DBr along the first direction S.

[0053] The infrastructure camera information 240 indicates the installation position, installation direction, viewing angle, etc. of each infrastructure camera CAM. The infrastructure camera information 240 is provided to the vehicle control system 100 in advance.

[0054] The image 250 captured (photographed) by the infrastructure camera CAM indicates the conditions of the predetermined area AR and its surroundings. The processor 110 acquires the image 250 from the infrastructure camera CAM via the communication device 130 .

[0055] The target information 260 is information about a target TGT present in a predetermined area AR. The processor 110 detects a target TGT present in the predetermined area AR based on an image 250 captured by the infrastructure camera CAM. For example, the processor 110 uses an image recognition AI to recognize the target TGT shown in the image 250. The processor 110 calculates the position of the target TGT in the absolute coordinate system based on the infrastructure camera information 240 and the image position of the target TGT in the image 250. In addition, the target information 260 may include information about a target detected by the vehicle-mounted system 10.

[0056] It should be noted that the vehicle 1 as the control target is distinguished from other target TGTs. For example, comparing the vehicle position PV with the position of the target TGT enables the vehicle 1 to be distinguished from other target TGTs. For example, a target area covering the detected target TGT and its vicinity is set. When the vehicle position PV is within the target area, the target TGT is regarded as the vehicle 1 as the control target.

[0057] The processor 110 controls the vehicle 1. When the vehicle control system 100 includes the vehicle-mounted system 10, the processor 110 controls the vehicle 1 by controlling the traveling device 40. When the vehicle control system 100 is provided outside the vehicle-mounted system 10, the processor 110 remotely controls the vehicle 1 by issuing a control instruction to the vehicle-mounted system 10 via the communication device 130.

[0058] Specifically, the processor 110 performs risk avoidance control to avoid a collision between the target TGT and the vehicle 1 . Figure 6 It is a flow chart summarizing the processes associated with risk avoidance controls.

[0059] In step S100 , the processor 110 acquires various information 200 .

[0060] In step S110, the processor 110 sets the determination area D based on the map information 210, the vehicle information 220, and the determination area information 230. The processor 110 may set the front determination area Df and the rear determination area Dr in consideration of the traveling direction X of the vehicle 1.

[0061] In step S120, the processor 110 determines whether the target TGT exists in the determination area D based on the target information 260 and the determination area D. For example, the processor 110 sets a target area that covers the detected target TGT and its vicinity. For example, the target area has a circular shape. As the size of the target TGT becomes larger, the target area also becomes larger. As the moving speed of the target TGT becomes larger, the target area may become larger. The target area may have a shape in which it is widened in the moving direction of the target TGT. When the target area at least partially overlaps with the determination area D, the processor 110 determines that the target TGT exists in the determination area D.

[0062] In the case where it is determined that the target TGT does not exist in the area D (step S120: No), the process proceeds to step S130. In step S130, the processor 110 performs normal vehicle travel control.

[0063] On the other hand, when it is determined that the target TGT exists in the area D (step 120: YES), the process proceeds to step S140. In step S140, the processor 110 executes deceleration control for decelerating the vehicle 1. The processor 110 may decelerate the vehicle 1 to stop the vehicle 1.

[0064] 1-4. Effect As described above, according to the present embodiment, the infrastructure camera CAM is used to control the vehicle 1. The use of the infrastructure camera CAM makes it possible to detect a target TGT that cannot be detected by an onboard sensor (such as an onboard camera). For example, even a target TGT that exists in front of a curve in front of the vehicle 1 can be detected by the infrastructure camera CAM. Then, the control of the vehicle 1 is performed taking into account the target TGT that cannot be detected by the onboard sensor. More specifically, when the target TGT exists in the determination area D around the vehicle 1, the vehicle 1 is decelerated. Since the target TGT that cannot be detected by the onboard sensor is also taken into account, the vehicle 1 can be decelerated well in advance, which can reduce the necessity of emergency braking. Therefore, the safety of controlling the vehicle 1 is improved.

[0065] Other embodiments will be described below. The configurations of the in-vehicle system 10 and the vehicle control system 100 are the same as those in the first embodiment.

[0066] 2. Second Embodiment Figure 7 An example of updating the front boundary DBf of the front determination area Df is shown. The horizontal axis represents time, and the vertical axis represents the vehicle position PV and the front boundary DBf. The front determination area Df is the area between the vehicle position PV and the front boundary DBf. The front distance Lf between the vehicle position PV and the front boundary DBf is set to a distance at which the vehicle 1 can easily stop without emergency braking.

[0067] according to Figure 7 In the mode (A) shown, the front boundary DBf is updated every time the vehicle position PV is updated. That is, the update frequency of the front boundary DBf is the same as the update frequency (sampling frequency) of the vehicle position PV. It can also be said that the front boundary DBf changes completely in conjunction with the vehicle position PV. However, when the update frequency of the front boundary DBf becomes higher, the processing load of the processor 110 also increases. From the viewpoint of the processing load, it may not be preferable to increase the update frequency of the front boundary DBf more than necessary.

[0068] In view of the above situation, according to the second embodiment, Figure 7 As shown in the mode (B), the update frequency of the front boundary DBf of the front determination area Df is set to be lower than the update frequency of the vehicle position PV. That is, the processor 110 updates the front boundary DBf of the front determination area Df at a frequency lower than the update frequency of the vehicle position PV (i.e., the vehicle information 220). As a result, the processing load of the processor 110 can be reduced.

[0069] As the speed of the vehicle 1 becomes lower, the processor 110 may reduce the update frequency of the front boundary DBf. The speed of the vehicle 1 is obtained from the vehicle information 220. The update frequency of the front boundary DBf may be reduced monotonically or stepwise according to the speed of the vehicle 1. For example, the update frequency when the speed of the vehicle 1 is equal to or higher than a predetermined threshold is a first update frequency, and the update frequency when the speed of the vehicle 1 is lower than the predetermined threshold is a second update frequency lower than the first update frequency. Changing the update frequency of the front boundary DBf in consideration of the speed of the vehicle 1 makes it possible to more effectively reduce the processing load of the processor 110.

[0070] Figure 8is a diagram for explaining an example of updating the front boundary DBf of the front determination area Df. The predetermined area AR in which the vehicle 1 travels is divided into a plurality of blocks BK along the first direction S. Each block BK is an area between the front block boundary BKBf and the rear block boundary BKBr. The front block boundary BKBf is located in the traveling direction X of the vehicle 1 when viewed from the rear block boundary BKBr. The block length Lbk is the length of the block BK along the first direction S. That is, the block length Lbk of the block BK is the length between the front block boundary BKBf and the rear block boundary BKBr along the first direction S. The block length Lbk is set to a distance at which the vehicle 1 can be easily stopped without emergency braking.

[0071] The block arrangement information indicates the arrangement of the plurality of blocks BK in the absolute coordinate system. That is, the block arrangement information indicates the positions of the front block boundary BKBf and the rear block boundary BKBr of each block BK in the absolute coordinate system. Such block arrangement information is pre-registered in the map information 210.

[0072] The processor 110 sets and updates the front boundary DBf of the front determination area Df based on the vehicle position PV and the block arrangement information. For ease of description, the block BK in which the vehicle 1 is currently located is referred to as the "first block BK1" below. The block BK adjacent to and in front of the first block BK1 is referred to as the "second block BK2" below. That is, when viewed from the first block BK1, the second block BK2 is located in the traveling direction X of the vehicle 1. The processor 110 identifies the first block BK1 and the second block BK2 based on the vehicle position PV and the block arrangement information. Then, the processor 110 sets the front block boundary BKBf of the second block BK2 as the front boundary DBf of the front determination area Df.

[0073] exist Figure 8 In the example shown, the vehicle 1 initially exists in the block BK(i). That is, the first block BK1 is the block BK(i), and the second block BK2 is the block BK(i+1). At this time, the front boundary DBf of the front determination area Df is the front block boundary BKBf(i+1) of the block BK(i+1). When the vehicle 1 travels in the block BK(i), the front boundary DBf is maintained without being updated.

[0074] The vehicle 1 eventually reaches the front block boundary BKBf(i) of the block BK(i). The processor 110 determines whether a predetermined portion of the vehicle 1 has passed the front block boundary BKBf(i) of the block BK(i) based on the vehicle position PV and the block arrangement information. The predetermined portion is arbitrary. When the predetermined portion of the vehicle 1 passes the front block boundary BKBf(i) of the block BK(i), the processor 110 determines that the vehicle 1 passes the front block boundary BKBf(i) and enters the adjacent block BK(i+1).

[0075] When the vehicle 1 enters the block BK(i+1), the block BK(i+1) becomes the new first block BK1, and the block BK(i+2) becomes the new second block BK2. That is, the first block BK1 and the second block BK2 are updated. Therefore, the processor 110 sets the front block boundary BKBf(i+2) of the block BK(i+2) as the new front boundary DBf. That is, the front boundary DBf of the front determination area Df is updated.

[0076] Thereafter, the same process is repeated. Whenever the vehicle 1 passes the front block boundary BKBf of the first block BK1, the processor 110 updates the front boundary DBf of the first block BK1, the second block BK2, and the front determination area Df. This method makes it possible to set the update frequency of the front boundary DBf of the front determination area Df to be lower than the update frequency of the vehicle position PV.

[0077] like Fig. 9 As shown, the block length Lbk of each block BK may become longer as the speed of the vehicle 1 becomes higher. The block length Lbk may change monotonically or stepwise according to the speed of the vehicle 1. Fig. 9 In the example shown, the block length Lbk in the case where the speed of the vehicle 1 is less than a predetermined threshold is a first block length Lbk-1. The block length Lbk in the case where the speed of the vehicle 1 is equal to or higher than the predetermined threshold is a second block length Lbk-h longer than the first block length Lbk-1. Block arrangement information for each case of the first block length Lbk-1 and the second block length Lbk-h is registered in the map information 210. The speed of the vehicle 1 is obtained from the vehicle information 220. The processor 110 acquires the block arrangement information corresponding to the speed of the vehicle 1. <<Effect>> As described above, according to the second embodiment, the update frequency of the front boundary DBf of the front determination area Df is set lower than the update frequency of the vehicle position PV. As a result, it is possible to reduce the processing load of the processor 110. In particular, when a large number of vehicles 1 are controlled simultaneously and in parallel based on the images 250 captured by a large number of infrastructure cameras CAM, it is preferable to reduce the processing load.

[0078] like Figure 8 As shown, the front boundary DBf of the front determination area Df can be set and updated based on the block BK. This makes it possible to reduce the update frequency of the front boundary DBf, thereby reducing the processing load. In addition, in the case of using the preset block BK, the processor 110 does not need to consider the road shape at each moment to draw the front boundary DBf. This also helps to reduce the processing load. In addition, the front boundary DBf is prevented from becoming an unnatural line.

[0079] 3. Third embodiment Fig.10: is a conceptual diagram for explaining the front determination area Df and the rear determination area Dr according to the third embodiment. The front determination area Df is an area that the vehicle 1 is about to pass. On the other hand, the rear determination area Dr is an area that the vehicle 1 has already passed. Even if there is a target TGT in the rear determination area Dr, the risk of the target TGT is low. If the rear determination area Dr is set to be unnecessarily wide, the deceleration control may be activated even if the target TGT is far away from the vehicle 1. Excessive deceleration control may deteriorate the continuity of travel and cause the user of the vehicle 1 to feel uncomfortable.

[0080] In view of this, according to the third embodiment, the rear determination area Dr is set to be narrower than the front determination area Df. More specifically, the processor 110 sets the front determination area Df and the rear determination area Dr so that the rear distance Lr is shorter than the front distance Lf (Lf>Lr). The front distance Lf and the rear distance Lr can be predetermined values ​​respectively.

[0081] According to the third embodiment, it is possible to suppress excessive activation of the deceleration control while ensuring safety. Therefore, the continuity of travel is ensured. In addition, the user of the vehicle 1 is prevented from feeling a sense of discomfort.

[0082] 4. Fourth embodiment A combination of the second embodiment and the third embodiment described above is also possible. In this case, the update frequency of the front boundary DBf of the front determination area Df is set lower than the update frequency of the vehicle position PV. Additionally, the rear determination area Dr is set narrower than the front determination area Df. As a result, both effects of reducing the processing load and suppressing excessive activation of the deceleration control can be achieved.

[0083] 5. Fifth embodiment In the fifth embodiment, the update frequency of the rear boundary DBr of the rear determination region Dr is set lower than the update frequency of the vehicle position PV. Descriptions overlapping with the above-described second embodiment will be appropriately omitted.

[0084] Fig.11 An example of updating the rear boundary DBr of the rear determination area Dr is shown. According to mode (A), the rear boundary DBr is updated each time the vehicle position PV is updated. That is, the update frequency of the rear boundary DBr is the same as the update frequency (sampling frequency) of the vehicle position PV. In this case, the processing load increases. On the other hand, according to mode (B), the update frequency of the rear boundary DBr is lower than the update frequency of the vehicle position PV. Therefore, the processing load of the processor 110 is reduced.

[0085] The processor 110 may reduce the updating frequency of the rear boundary DBr as the speed of the vehicle 1 becomes lower. Thus, the processing load can be reduced more effectively.

[0086] Fig.12 is a diagram for explaining an example of updating the rear boundary DBr of the rear determination area Dr. The first block BK1 is a block BK in which the vehicle 1 currently exists. The second block BK2 is a block BK adjacent to and behind the first block BK1. That is, when viewed from the first block BK1, the second block BK2 is located in a direction opposite to the traveling direction X of the vehicle 1. The processor 110 identifies the first block BK1 and the second block BK2 based on the vehicle position PV and the block arrangement information. Then, the processor 110 sets the rear block boundary BKBr of the second block BK2 as the rear boundary DBr of the rear determination area Dr. Whenever the vehicle 1 passes the front block boundary BKBf of the first block BK1, the processor 110 updates the first block BK1, the second block BK2, and the rear boundary DBr of the rear determination area Dr. In this way, the update frequency of the rear boundary DBr of the rear determination area Dr can be set to be lower than the update frequency of the vehicle position PV.

[0087] According to the fifth embodiment, it is possible to reduce the processing load of the processor 110. In particular, when a large number of vehicles 1 are controlled simultaneously and in parallel based on the images 250 captured by a large number of infrastructure cameras CAM, it is preferable to reduce the processing load.

[0088] A combination of the fifth embodiment and any of the above embodiments is also possible.

[0089] Fig.13 1 is a diagram for explaining a combination of the fifth embodiment and the fourth embodiment. When setting the front boundary DBf of the front determination area Df, a block BK having a block length Lbk-f is used. On the other hand, when setting the rear boundary DBr of the rear determination area Dr, a block BK having a block length Lbk-r is used. The block length Lbk-r is shorter than the block length Lbk-f. As a result, the rear distance Lr becomes shorter than the front distance Lf. Therefore, both effects of reducing the processing load and suppressing excessive activation of the deceleration control can be obtained.

Claims

1. A vehicle control system for controlling a vehicle traveling in a predetermined area, The vehicle control system includes one or more processors configured to: obtaining vehicle information indicating a location of the vehicle; Based on the vehicle information, setting a determination area around the vehicle; acquiring an image captured by an infrastructure camera mounted on the exterior of the vehicle and imaging conditions of the predetermined area; determining whether a target exists in the determination area based on the image captured by the infrastructure camera; as well as When the target exists in the determination area, the vehicle is decelerated.

2. The vehicle control system according to claim 1, in, The vehicle information further indicates a traveling direction of the vehicle, and The one or more processors are further configured to: setting a front determination area as the determination area in front of the vehicle based on the vehicle information; as well as The front end of the front determination area is updated at a frequency lower than an update frequency of the vehicle information.

3. The vehicle control system according to claim 2, in, The one or more processors are further configured to reduce an update frequency of the front end of the front determination area as the speed of the vehicle becomes lower.

4. The vehicle control system according to claim 2, in, The predetermined area extends in a first direction and is divided into a plurality of blocks along the first direction, Each block of the plurality of blocks is a region between a front block boundary and a rear block boundary, The front block boundary is located in the traveling direction of the vehicle when viewed from the rear block boundary, The plurality of blocks include: a first block in which the vehicle exists, and a second block located in the traveling direction of the vehicle when viewed from the first block; and The one or more processors are further configured to: Based on the vehicle information, identifying the first block and the second block; Setting the front block boundary of the second block as the front end of the front determination area; and Whenever the vehicle passes a front block boundary of the first block, the first block, the second block, and a front end of the front determination area are updated.

5. The vehicle control system according to claim 4, in, The block length is the length of each block in the plurality of blocks along the first direction, and As the speed of the vehicle becomes higher, the block length becomes longer.

6. The vehicle control system according to any one of claims 1 to 5, in, The vehicle information further indicates a traveling direction of the vehicle, and The one or more processors are further configured to set a front determination area as the determination area in front of the vehicle and a rear determination area as the determination area in rear of the vehicle based on the vehicle information.

7. The vehicle control system according to claim 6, in, The front distance is the distance from the position of the vehicle to the front end of the front determination area. The rear distance is the distance from the position of the vehicle to the rear end of the rear determination area, and The one or more processors are further configured to set the front determination area and the rear determination area so that the rear distance is shorter than the front distance.

8. The vehicle control system according to claim 7, in, The rear distance is a predetermined distance.

9. The vehicle control system according to claim 6, in, The one or more processors are further configured to update the rear end of the rear determination area at a frequency lower than an update frequency of the vehicle information.

10. The vehicle control system according to any one of claims 1 to 4, in, The determination area includes a first determination area and a second determination area surrounding the first determination area, and The one or more processors are further configured to: When the target is present in the first determination area, executing a stop control of decelerating the vehicle to stop the vehicle; and When the target exists in the second determination area, the vehicle is decelerated more slowly than in the case of the stop control.

11. A vehicle control method for controlling a vehicle in a predetermined area by a computer, The vehicle control method include: obtaining vehicle information indicating a location of the vehicle; Based on the vehicle information, setting a determination area around the vehicle; acquiring an image captured by an infrastructure camera mounted on the exterior of the vehicle and imaging conditions of the predetermined area; determining whether a target exists in the determination area based on the image captured by the infrastructure camera; as well as When the target exists in the determination area, the vehicle is decelerated.