Information providing apparatus and information providing method
By identifying and determining the intersection area close to the autonomous driving vehicle, providing information on whether it can pass, solving the problem of uneasiness caused by the failure of the autonomous driving vehicle to provide information when approaching the crosswalk, and improving the sense of security of the occupants.
Patent Information
- Application Number
- CN202380030940.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-05
- Filing Date
- 2023-03-17
- Publication Date
- 2024-11-12
AI Technical Summary
When an autonomous vehicle passes through a crosswalk without a signal light, whether the vehicle needs to park depends on whether the pedestrian exists, resulting in no information provided when the vehicle approaches the crosswalk, causing the occupants to feel uneasy.
By obtaining the intersection area on the vehicle's driving path and the movable area of other moving bodies, identifying the surrounding environment, determining whether it can pass through the intersection area, and providing information based on the change of the judgment result during the vehicle approaches the intersection area, providing the occupant with whether it can pass through the intersection area, and providing information to the occupant whether it can pass through the intersection area during the vehicle approaches the intersection area, information.
It effectively suppresses the occupants' sense of uneasiness, reduces concerns about the vehicle's possible stop or not, and improves the occupants' sense of security and confidence by providing accurate information.
Smart Images

Figure CN118946491A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to an information providing device and an information providing method. Background Art
[0002] The following technology is known: when displaying the parking state of a vehicle with an automatic driving function, the surrounding conditions of the vehicle are detected, and when the vehicle will become a parking state in the future under the surrounding conditions during automatic driving, a stop display extending upward from the road surface of the surrounding conditions is displayed on the display device (Patent Document 1).
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-27996
[0006] Problems to be solved by the invention
[0007] For example, when a vehicle passes through a crosswalk without a traffic light, it may sometimes slow down to confirm that there are no pedestrians. In this case, in the above-mentioned prior art, whether the vehicle needs to stop depends on whether there are pedestrians on the crosswalk. Therefore, no information is provided to the vehicle occupants until a pedestrian crossing the crosswalk is detected and it is determined that the vehicle needs to stop. As a result, in the above-mentioned prior art, there is a problem that the vehicle sometimes approaches the crosswalk without providing any information to the vehicle occupants, causing the vehicle occupants to feel uneasy. Summary of the invention
[0008] An object of the present invention is to provide an information providing device and an information providing method that can suppress the feeling of uneasiness given to a vehicle occupant.
[0009] The present invention solves the above-mentioned problem through the following processing: obtaining an intersection area that intersects with an area where other mobile bodies can move on a driving path set by autonomous driving control, determining whether the vehicle can pass through the intersection area based on the driving environment around the vehicle, and providing information to the on-board terminal and / or electronic terminal in the vehicle to notify that the vehicle is approaching the intersection area. During the period until the vehicle drives to the intersection area, the information is changed according to the determination result of whether the vehicle can pass through the intersection area.
[0010] Effects of the Invention
[0011] According to the present invention, it is possible to suppress the feeling of uneasiness given to the occupants of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1This is a block diagram showing an example of a driving assistance system including a driving assistance device according to the present invention.
[0013] Figure 2A Yes means through Figure 1 FIG. 1 is a diagram showing an example of an image displayed when the driving assistance system shown executes driving assistance (part 1).
[0014] Figure 2B Yes means through Figure 1 FIG. 2 is a diagram showing an example of an image displayed when the driving assistance system shown in FIG. 1 performs driving assistance (part 2).
[0015] Figure 2C Yes means through Figure 1 FIG. 3 is a diagram showing an example of an image displayed when the driving assistance system shown in FIG. 1 performs driving assistance.
[0016] Figure 3A Yes means Figure 1 Flowchart (part 1) of an example of a processing sequence in a driving assistance device.
[0017] Figure 3B Yes means Figure 1 Flowchart of an example of a processing sequence in a driving assistance device (part 2). DETAILED DESCRIPTION
[0018] The following is a description of the embodiments of the present invention based on the accompanying drawings. In addition, the following description is based on the premise that in countries with laws for driving on the left, vehicles drive on the left. In countries with laws for driving on the right, vehicles drive on the right, so the left and right in the following description are symmetrically replaced.
[0019] (Structure of driver assistance system)
[0020] Figure 1 : is a block diagram showing the driving assistance system 10 of the present invention. The driving assistance system 10 is a vehicle-mounted system that drives the vehicle to a destination set by the vehicle's occupants (including the driver) through autonomous driving control. Autonomous driving control refers to autonomously controlling the vehicle's driving movements using a driving assistance device described later, and the driving movements include all driving movements such as acceleration, deceleration, starting, parking, turning right or left, lane changes, and pulling over. In addition, autonomously controlling driving movements refers to the driving assistance device controlling the driving movements using the vehicle's devices. That is, the driving assistance device intervenes and controls these driving movements within a pre-set range. For driving movements that are not intervened, the driver performs manual operations.
[0021] like Figure 1As shown, the driving assistance system 10 includes: a camera device 11, a distance measuring device 12, a state detection device 13, map information 14, a position detection device 15, a navigation device 16, a vehicle control device 17, a display device 18, and a driving assistance device 19. Figure 1 As shown, the driving support device 19 of the present embodiment includes an information providing device having an information providing function as a part thereof. The devices constituting the driving support system 10 are connected via a CAN (Controller Area Network) or other in-vehicle LAN and can send and receive information to each other.
[0022] The camera device 11 is a device for recognizing objects around the vehicle through images, and is, for example, a camera having an image pickup element such as a CCD, an ultrasonic camera, an infrared camera, etc. A plurality of camera devices 11 may be provided on a vehicle, for example, they may be arranged at the front grille of the vehicle, the lower part of the left and right door mirrors, and near the rear bumper. This can reduce blind spots when recognizing objects around the vehicle.
[0023] The distance measuring device 12 is a device for calculating the relative distance and relative speed between the vehicle and the object, and is a radar device or sonar such as a laser radar, a millimeter wave radar, etc. (LRF, etc.), a LiDAR (light detection and ranging) unit, an ultrasonic radar, etc. A plurality of distance measuring devices 12 can be set on a vehicle, for example, they can be arranged in front, on the right side, on the left side, and on the rear of the vehicle. In this way, the relative distance and relative speed between the vehicle and the surrounding objects can be accurately calculated.
[0024] The objects detected by the camera device 11 and the distance measuring device 12 are lane boundaries, center lines, road markings, central median strips, guardrails, curbs, side walls of highways, road markings, traffic lights, crosswalks, construction sites, accident sites, traffic restrictions, etc. In addition, the objects also include obstacles that may affect the driving of the vehicle, such as cars (other vehicles) other than the vehicle, automatic two-wheeled vehicles (motorcycles), bicycles, pedestrians, etc. The detection results of the camera device 11 and the distance measuring device 12 are obtained by the driving assistance device 19 at a prescribed time interval as needed.
[0025] In addition, the detection results of the camera 11 and the distance measuring device 12 can be integrated or synthesized by the driving assistance device 19 (so-called sensor fusion), thereby supplementing the missing information of the detected object. For example, the position information of the object can be calculated by the driving assistance device 19 based on the position of the vehicle, that is, the vehicle's own position information obtained by the position detection device 15, and the relative position (distance and direction) between the vehicle and the object. The driving assistance device 19 integrates the calculated position information of the object with the detection results of the camera 11 and the distance measuring device 12, and the map information 14 and other information to obtain the driving environment information around the vehicle. In addition, the detection results of the camera 11 and the distance measuring device 12 and the map information 14 can also be used to identify the objects around the vehicle and predict their movements.
[0026] The state detection device 13 is a device for detecting the driving state of the vehicle, and examples thereof include a vehicle speed sensor, an acceleration sensor, a yaw rate sensor (e.g., a gyro sensor), a steering angle sensor, an inertial measurement unit, etc. These devices are not particularly limited, and known devices can be used. In addition, the configuration and number of these devices can be appropriately set within the range of appropriately detecting the driving state of the vehicle. The detection results of each device are obtained by the driving assistance device 19 at a prescribed time interval as needed.
[0027] The map information 14 is information used to generate a driving route, control driving actions, etc., and includes road information, facility information, and their attribute information. The road information and road attribute information include: road width, road curvature radius, shoulder structure, road traffic regulations (speed limit, lane change), road merging points and branch points, lane increase / decrease positions, etc. The map information 14 is high-precision map information that can grasp the movement trajectory of each lane, including two-dimensional position information and / or three-dimensional position information in each map coordinate, road / lane boundary information in each map coordinate, road attribute information, lane up / down information, lane recognition information, connection target lane information, etc.
[0028] The road / lane boundary information of the high-definition map information is information indicating the boundary between the road on which the vehicle is traveling and other roads. The driving road on which the vehicle is traveling refers to the road used for the vehicle to travel, and the form of the driving road is not particularly limited. The boundary exists on the left and right relative to the direction of travel of the vehicle, and the form is not particularly limited. Boundaries are, for example, road surface markings or road structures. Road surface markings include lane boundary lines, center lines, etc., and road structures include central isolation strips, guardrails, curbs, tunnels, and side walls of highways. In addition, at locations such as intersections where the driving road boundary cannot be clearly determined, a boundary is set in advance on the driving road. The boundary is fictitious and is not an actual road surface marking or road structure.
[0029] The map information 14 is stored in a readable state in a recording medium in the driving support device 19, an in-vehicle device, or a server provided on a network. The driving support device 19 acquires the map information 14 as necessary.
[0030] The position detection device 15 is a positioning system for detecting the current position of the vehicle. It is not particularly limited and a known device can be used. The position detection device 15 calculates the current position of the vehicle based on radio waves received from satellites for GPS (Global Positioning System), for example. In addition, the position detection device 15 can also estimate the current position of the vehicle based on the vehicle speed information and acceleration information obtained from the vehicle speed sensor, acceleration sensor and gyro sensor as the state detection device 13, and compare the estimated current position with the map information 14 to calculate the current position of the vehicle.
[0031] The navigation device 16 is a device that refers to the map information 14 and calculates a driving route from the current position of the vehicle detected by the position detection device 15 to the destination set by the occupant (including the driver). The navigation device 16 uses the road information and facility information of the map information 14 to search for a driving route for the vehicle to reach the destination from the current position. The driving route includes at least information about the road, driving lane, and driving direction of the vehicle, and is represented by a line, for example. Depending on the search conditions, there may be a plurality of driving routes. The driving route calculated by the navigation device 16 is output to the driving assistance device 19.
[0032] The vehicle control device 17 is an on-board computer such as an electronic control unit (ECU) that electronically controls on-board equipment that restricts the vehicle's travel. The vehicle control device 17 includes: a vehicle speed control device 171 that controls the vehicle's travel speed, and a steering control device 172 that controls the vehicle's steering operation. The vehicle speed control device 171 and the steering control device 172 autonomously control the actions of these drive devices and steering devices based on the control signal input from the driving assistance device 19. As a result, the vehicle can travel autonomously according to the set travel path. The information required for autonomous control based on the vehicle speed control device 171 and the steering control device 172, such as the vehicle's travel speed, acceleration, steering angle and posture, is obtained from the state detection device 13.
[0033] The driving devices controlled by the vehicle speed control device 171 include: an electric motor and / or an internal combustion engine as a driving source; a power transmission device including a drive shaft and an automatic transmission that transmits the output from these driving sources to the driving wheels; a driving device that controls the power transmission device, etc. In addition, the braking device controlled by the vehicle speed control device 171 is, for example, a braking device for braking the wheels. A control signal corresponding to the set driving speed is input from the driving assistance device 19 to the vehicle speed control device 171. Based on the control signal input from the driving assistance device 19, the vehicle speed control device 171 generates a signal to control these driving devices and sends the signal to the driving device, thereby autonomously controlling the driving speed of the vehicle.
[0034] On the other hand, the steering device controlled by the steering control device 172 is a steering device that controls the steering wheel according to the steering angle of the steering wheel, and for example, a steering actuator such as an electric motor installed on the column shaft of the steering gear can be cited. The steering control device 172 autonomously controls the operation of the steering device based on the control signal input from the driving assistance device 19 so that the vehicle travels while maintaining a predetermined lateral position (the position of the vehicle in the left and right direction) relative to the set driving path. In this control, at least one of the detection results of the camera device 11 and the distance measuring device 12, the driving state of the vehicle obtained by the state detection device 13, the map information 14, and the information on the current position of the vehicle obtained by the position detection device 15 is used.
[0035] The display device 18 is a device for providing necessary information to the occupants of the vehicle, and is, for example, a projector such as a liquid crystal display or a head-up display (HUD) provided on the instrument panel. The display device 18 may also include an input device for the occupants of the vehicle to input instructions to the driving assistance device 19. Examples of the input device include a touch panel that is input by a user's finger touch or a stylus, a microphone that obtains instructions from the user's voice, and a switch installed on the steering wheel of the vehicle. In addition, the display device 18 may include a speaker as an output device.
[0036] The driving assistance device 19 is a device for controlling the driving of the vehicle by controlling the devices constituting the driving assistance system 10 and making them cooperate to control the driving of the vehicle, so that the vehicle drives to a set destination. The destination is set by, for example, a passenger of the vehicle. The driving assistance device 19 is, for example, a computer, and includes: a CPU (Central Processing Unit) 191 as a processor, a ROM (Read Only Memory) 192 storing a program, and a RAM (Random Access Memory) 193 functioning as an accessible storage device. The CPU 191 is an action circuit for executing the program stored in the ROM 192 to realize the functions of the driving assistance device 19.
[0037] The driving assistance device 19 has a driving assistance function that causes the vehicle to travel to a set destination through autonomous driving control. In addition, the driving assistance device 19 of the present embodiment includes an information providing device as a part thereof. As an information providing function, the information providing device has: an intersection area acquisition function for acquiring an intersection area on the vehicle's driving path that intersects with an area where other moving bodies can move; a driving environment recognition function for recognizing the driving environment around the vehicle; a passing determination function for determining whether the vehicle can pass through the intersection area; and an approach notification function for providing information to the occupants of the vehicle that the vehicle is approaching an intersection area. The program stored in ROM192 has programs for realizing these functions, and these functions are realized by causing CPU191 to execute the programs stored in ROM192. Figure 1 In the figure, for convenience, each function is extracted into a functional module and shown.
[0038] (Function of functional module)
[0039] Below, use Figure 2A~2C Functions realized by the control unit 20 , the acquisition unit 21 , the identification unit 22 , the determination unit 23 , and the provision unit 24 as functional blocks will be described.
[0040] The control unit 20 has a function of driving the vehicle to a set destination by autonomous driving control (ie, a driving assistance function). When performing driving assistance by the driving assistance function, the driving assistance device 19 displays an image showing the driving environment of the host vehicle on the display device 18 . Figure 2A The figure shows an example of an image displayed on the display device 18. Figure 2A The image shown is a bird's-eye view image obtained when a virtual viewpoint is set diagonally above and behind the host vehicle V and the front of the host vehicle V is photographed from the position of the viewpoint. In the bird's-eye view image, information such as the lanes and signs of the road on which the host vehicle V is traveling, the driving position of the host vehicle V, and obstacles existing around the host vehicle V are displayed.
[0041] in addition, Figure 2A The image shown is a two-dimensional image generated by computer graphics (CG), but the image representing the running environment of the vehicle V displayed on the display device 18 is not limited to this. For example, the image representing the running environment may be a three-dimensional image or an image obtained by the camera device 11. In addition, an image created by CG may be displayed in an overlapping manner on the image obtained by the camera device 11.
[0042] Figure 2A The driving scene shown corresponds to the actual driving scene of the vehicle V. Figure 2AIn the driving scene shown, the vehicle V is driving on a road with two lanes on one side. The driving direction of the vehicles on lanes L1 and L2 is from the lower side to the upper side (from the front side to the inner side) of the figure, and the driving direction of the vehicles on lanes L3 and L4 is from the upper side to the lower side (from the inner side to the front side) of the figure. The road on which the vehicle V is driving intersects with a road with one lane on one side in front of the vehicle V. On the road with one lane on one side, the driving direction of the vehicles on lane L5 is from the right side to the left side of the figure, and the driving direction of the vehicles on lane L6 is from the left side to the right side of the figure.
[0043] like Figure 2A As shown, the area where the two roads intersect is intersection C. At intersection C, there are crosswalks CW1 and CW2 for pedestrians and bicycles to cross a single-lane road, and crosswalks CW3 and CW4 for pedestrians and bicycles to cross a single-lane road. In addition, it is assumed that a traffic light is installed at intersection C. Figure 2A In the driving scenario shown, it is assumed that vehicles traveling in lanes L1 and L3 can go straight or turn left at intersection C, and vehicles traveling in lanes L2 and L4 can go straight or turn right at intersection C. In addition, the destination Px (not shown) is set by the occupant of the host vehicle V to the position of the target for going straight to the left side of the figure in lane L5.
[0044] In this case, the navigation device 16 sets the travel route R of the host vehicle V through the driving assistance function of the control unit 20. For example, the navigation device 16 sets Figure 2A The driving path R shown in FIG. The driving path R is a path that travels on lane L1, turns left at intersection C, travels on lane L5, and reaches the destination Px. Figure 2A As shown, the host vehicle V is traveling along the driving path R in the lane L1.
[0045] The driving of the vehicle V is controlled by autonomous driving control based on the driving assistance function of the driving assistance device 19. A plurality of assistance levels of driving assistance based on the driving assistance device 19 are set. The assistance level is a level indicating the extent to which the driving assistance device 19 intervenes in the control of the driving action of the vehicle V (in other words, the extent to which the driver's manual operation intervenes). The driving assistance device 19 implements the driving assistance defined in each assistance level through the driving assistance function. The assistance level can be set, for example, based on the driving automation level defined in SAE J3016: SEP2016, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles, published by the Society of Automotive Engineers (SAE).
[0046] exist Figure 2A In the driving scenario shown, the driving assistance device 19 assumes, for example, that the driving assistance device 19 performs all driving tasks of the host vehicle V and performs driving assistance of assistance level 4, which is a level of response to a situation where it is difficult to continue to control the host vehicle in a limited area. In this case, when approaching the intersection C, the driving assistance device 19 decelerates the host vehicle V and detects the state of the traffic light set at the intersection C and pedestrians and bicycles crossing the crosswalks CW1 and CW3. In addition, when the state of the traffic light does not indicate that the host vehicle V stops and there are no pedestrians and bicycles crossing the crosswalks CW1 and CW3, it is determined that the host vehicle V can turn left at the intersection C and enter the intersection C.
[0047] When the driving assistance device 19 performs this series of determinations and autonomous driving control, if appropriate information cannot be provided to the occupants of the host vehicle V, the occupants of the host vehicle V may feel uneasy. That is, when the determination of the state of the traffic light, the determination of avoiding contact with pedestrians and bicycles, and the determination results are not provided, and the occupants of the host vehicle V enter the intersection C through autonomous driving control, the occupants of the host vehicle V may worry whether the host vehicle V will make an emergency stop in front of the intersection C or in the intersection C. Therefore, the driving assistance device 19 of this embodiment controls the display device 18 so that appropriate information can be provided to the occupants of the host vehicle V. This control is mainly achieved by the functions of the acquisition unit 21, the recognition unit 22, the determination unit 23, and the provision unit 24.
[0048] The acquisition unit 21 has a function of acquiring an intersection area that intersects with an area where other moving bodies can move on the driving path R set by the autonomous driving control (i.e., an intersection area acquisition function). Other moving bodies refer to traffic participants other than the vehicle V, such as other vehicles, two-wheeled motor vehicles, bicycles, and pedestrians. The area where other moving bodies can move refers to an area where traffic participants other than the vehicle V can move when moving from the current position to the destination. For example, the area where pedestrians can move is an area where pedestrians can walk, such as a sidewalk, a crosswalk, and a pedestrian bridge. The area where other vehicles and two-wheeled motor vehicles can move is the same as the vehicle V, which is an area where the road can be driven.
[0049] The driving assistance device 19 acquires the driving route R from the navigation device 16 through the intersection area acquisition function of the acquisition unit 21. Next, an intersection area that intersects with an area where other moving bodies can move on the driving route R is acquired. The intersection of the driving route R with the area where other moving bodies can move means that when the host vehicle V travels along the driving route R, the host vehicle V contacts the other moving bodies when a traffic participant other than the host vehicle V exists in the area where the traffic participant can move. That is, the driving route R of the host vehicle V and the area where traffic participants other than the host vehicle V can move exist on the same plane, and when viewed from above, the driving route R of the host vehicle V overlaps partly or entirely with the area where traffic participants other than the host vehicle V can move.
[0050] For example, if there is a crosswalk on the travel path R, when there are pedestrians on the crosswalk, if the host vehicle V travels along the travel path R, the host vehicle V comes into contact with the pedestrian. Therefore, the crosswalk on the travel path R becomes an intersection area. On the other hand, if there is a pedestrian bridge on the travel path R, when pedestrians walk on the pedestrian bridge, even if the host vehicle V travels along the travel path R, the host vehicle V does not come into contact with the pedestrian. This is because the road on which the host vehicle V travels and the pedestrian bridge on which the pedestrians walk are not on the same plane.
[0051] The map information 14 includes road information of the roads that the host vehicle V passes through when traveling along the driving route R. In addition, the map information 14 also includes information on areas where traffic participants other than the host vehicle V can move on the roads that the host vehicle V passes through, and their attributes. Therefore, the driving assistance device 19 can extract the intersection area existing on the driving route R through the intersection area acquisition function of the acquisition unit 21.
[0052] Specifically, the intersection area includes an intersection where the road on which the host vehicle V is traveling intersects with the road on which other vehicles are traveling, a crosswalk provided on the road on which the host vehicle V is traveling, and the like. In addition, when the host vehicle V enters a facility located facing the road, if a sidewalk is provided between the lane and the facility, the sidewalk facing the facility becomes the intersection area. That is, when a pedestrian is walking on the sidewalk between the facility and the lane, if the host vehicle V enters the facility, the host vehicle V will come into contact with the pedestrian, and thus the sidewalk becomes the intersection area.
[0053] exist Figure 2A In the case of the driving scenario shown, if there are other vehicles at the intersection C, if the vehicle V enters the intersection C, the vehicle V may come into contact with the other vehicles. Therefore, the intersection C becomes an intersection area. In addition, if pedestrians or bicycles cross the crosswalks CW1 and CW2 when the vehicle V goes straight at the intersection C, the vehicle V may come into contact with the pedestrians or bicycles. Therefore, the crosswalks CW1 and CW2 become intersection areas. Similarly, when the vehicle V turns left at the intersection C, the crosswalks CW1 and CW3 become intersection areas, and when the vehicle V turns right at the intersection C, the crosswalks CW1 and CW4 become intersection areas.
[0054] The recognition unit 22 has a function of recognizing the driving environment around the host vehicle V (i.e., a driving environment recognition function). The driving assistance device 19 obtains the detection results of the camera device 11 and the distance measuring device 12 through the driving environment recognition function of the recognition unit 22, performs pattern matching and sensor fusion processing on the obtained detection results, and recognizes the driving environment of the host vehicle V. For example, the driving assistance device 19 detects other vehicles driving around the host vehicle V based on the detection results of the camera device 11, detects the distance from the host vehicle V to the other vehicles and the direction in which the other vehicles exist relative to the host vehicle V based on the detection results of the distance measuring device 12, and recognizes the position of the other vehicles relative to the host vehicle V. In addition, the driving assistance device 19 detects pedestrians crossing the crosswalk in front of the host vehicle V based on the detection results of the camera device 11, detects the distance from the host vehicle V to the pedestrian based on the detection results of the distance measuring device 12, and recognizes the position of the other vehicles relative to the host vehicle V.
[0055] Sometimes, a traffic light is installed at the intersection C, which is an intersection area. In order to recognize the state of the traffic light as the driving environment, the driving assistance device 19 determines whether there is a traffic light in front of the vehicle V based on the detection result of the camera 11 and the map information 14 through the driving environment recognition function of the recognition unit 22. Then, when it is determined that there is a traffic light in front of the vehicle V, the state of the traffic light is detected as the driving environment. The state of the traffic light is, for example, the state of the light of the traffic light, specifically, the state of the traffic light is red (that is, the state in which the vehicle V must stop in front of the intersection C), the state of the traffic light is yellow (that is, the state in which the vehicle V cannot enter the intersection C except when it cannot stop), and the state of the traffic light is green (that is, the state in which the vehicle V can enter the intersection C). The state of the traffic light is detected based on the image acquired by the camera 11.
[0056] exist Figure 2A In the case of the driving scene shown, the driving assistance device 19 detects the preceding vehicle and the following vehicle traveling in lane L1, the parallel vehicle traveling in lane L2, and the oncoming vehicle traveling in lanes L3 and L4 as other vehicles through the driving environment recognition function of the recognition unit 22. In addition, the positions of other vehicles traveling around the vehicle V are recognized based on the direction and distance of other vehicles relative to the vehicle V. Figure 2A In the driving scene shown, since there are no vehicles other than the host vehicle V, it is recognized that there are no other vehicles driving around the host vehicle V. In addition, the driving assistance device 19 detects pedestrians crossing the crosswalks CW1, CW2, CW3, and CW4, and recognizes the presence of pedestrians as the driving environment of the host vehicle V. Figure 2A In the driving scene shown, no pedestrians are detected, so it is recognized that there are no pedestrians around the host vehicle V. Furthermore, the driving assistance device 19 determines whether a traffic light is installed at the intersection C. Figure 2A In the driving scenario shown, it is assumed that a traffic light is provided at the intersection C, and the state of the traffic light is a yellow light state.
[0057] The determination unit 23 has a function of determining whether the host vehicle V can pass through the intersection area based on the driving environment of the host vehicle V identified by the driving environment recognition function (i.e., a passing determination function). The driving assistance device 19 determines whether there is an obstacle in the intersection area through the passing determination function of the determination unit 23, and determines that the host vehicle V can pass through the intersection area if it is determined that there is no obstacle in the intersection area. On the other hand, if it is determined that there is an obstacle in the intersection area, it is determined that the host vehicle V cannot pass through the intersection area.
[0058] In addition, when a signal light is provided in the intersection area (specifically, the intersection C), the driving assistance device 19 determines whether the state of the signal light is a state indicating a stop. If it is determined that the state of the signal light is a state indicating a stop (i.e., a red light state), it is determined that the host vehicle V cannot pass through the intersection area, and if it is determined that the state of the signal light is not a state indicating a stop (i.e., a green light state), it is determined that the host vehicle V can pass through the intersection area.
[0059] In addition, for the yellow light state, it is determined whether the own vehicle V can stop in front of the intersection C based on the driving state of the own vehicle V (particularly the driving speed of the own vehicle V) and the distance from the own vehicle V to the intersection area (intersection C). When it is determined that the own vehicle V cannot stop in front of the intersection C, the driving assistance device 19 determines that the state of the signal light is not a state indicating a stop, and the own vehicle V can pass through the intersection area. On the other hand, when it is determined that the own vehicle V can stop in front of the intersection C, the driving assistance device 19 determines that the state of the signal light is a state indicating a stop, and the own vehicle V cannot pass through the intersection area.
[0060] Therefore, when it is necessary to determine the presence or absence of obstacles and the state of the traffic lights in the intersection area, such as at an intersection with a traffic light, the driving assistance device 19 determines that the host vehicle V can pass through the intersection area when it is determined that there is no obstacle in the intersection area and the state of the traffic light is not a state indicating a stop. In contrast, the driving assistance device 19 determines that the host vehicle V cannot pass through the intersection area when it is determined that there is an obstacle in the intersection area or when it is determined that the state of the traffic light is a state indicating a stop. In addition, the driving assistance device 19 also determines whether the host vehicle V can pass through the intersection area when the host vehicle V stops in front of the intersection area and then starts. For example, when the host vehicle V stops at a position in front of the intersection C according to the stop signal and then starts, it is determined whether the host vehicle V can pass through the intersection C.
[0061] exist Figure 2A In the case of the driving scene shown in FIG. 1 , since a traffic light is installed at the intersection C, it is determined whether there are obstacles and the state of the traffic light at the intersection C. Figure 2A In the driving scene shown, the driving assistance device 19 recognizes, through the driving environment recognition function, that there are no other vehicles traveling around the vehicle V and no pedestrians around the vehicle V as the driving environment. Therefore, the driving assistance device 19 determines that there are no other vehicles and pedestrians at the intersection C. Figure 2AIn the driving scene shown, the driving assistance device 19 recognizes that the state of the signal light is yellow through the driving environment recognition function. Figure 2A In the driving scenario shown, it is assumed that the distance from the host vehicle V to the intersection C is a distance sufficient for the host vehicle V to stop in front of the intersection C. In this case, the driving assistance device 19 determines that the state of the traffic light is a state indicating parking. Figure 2A In the driving scenario shown, the driving assistance device 19 determines that the host vehicle V cannot pass through the intersection area.
[0062] The providing unit 24 has a function of providing information notifying that the vehicle V is approaching an intersection area to an onboard terminal and / or an electronic terminal in the vehicle V (i.e., an approach notification function). The onboard terminal and the electronic terminal of the vehicle V are, for example, the display device 18, but are not limited thereto, and include a display portion of the instrument panel of the vehicle V, a terminal for providing information to the occupants of the vehicle V when the driving assistance of the assistance level 3 or 4 is performed, and the like. The driving assistance device 19 uses the onboard terminal and / or the electronic terminal of the vehicle V to provide the occupants of the vehicle V with information notifying that the vehicle V is approaching an intersection area through the approach notification function of the providing unit 24. In addition, the driving assistance device 19 repeatedly performs a process of passing determination based on the passing determination function while the vehicle V is traveling from the current position to the intersection area. Then, the information provided to the onboard terminal and / or the electronic terminal in the vehicle V (i.e., the information provided to the occupants of the vehicle V) is changed according to the obtained determination result.
[0063] The information notifying that the vehicle V is approaching an intersection area includes information related to the intersection area that the vehicle V is approaching. For example, it includes information indicating whether the intersection area belongs to an intersection, a crosswalk, or a sidewalk facing a facility that the vehicle V can enter. In addition, it may also include information indicating the distance from the current position of the vehicle V to the intersection area. The driving assistance device 19 obtains the current position of the vehicle V from the position detection device 15, and when the distance from the current position of the vehicle V to the intersection area is less than a specified distance, the information notifying that the vehicle V is approaching the intersection area is provided for the intersection area. The specified distance is an appropriate distance set within the range in which obstacles in the intersection area can be detected using the camera device 11 and the distance measuring device 12 of the vehicle V.
[0064] In addition, the information provided by the driving assistance device 19 includes: information corresponding to the determination result of whether the vehicle V can pass through the intersection area, and information related to the determination of whether the vehicle V can pass through the intersection area. Specifically, information indicating whether there is an obstacle in the intersection area, information indicating the type of obstacles (i.e., traffic participants) in the intersection area, information indicating the light state of the traffic lights set in the intersection area, and information indicating whether the vehicle V can pass through the intersection area. These information are displayed on the display device 18 for the purpose of showing it to the passengers of the vehicle V, but instead, they can be output as voice from the speaker provided by the display device 18. That is, it is also possible to notify the passengers that the vehicle is approaching the intersection area only by voice such as "It is about to be an intersection". The information corresponding to the determination result of whether the vehicle V can pass through the intersection area and the information related to the determination of whether the vehicle V can pass through the intersection area are the same. The voice can use a recorded voice or a synthesized voice.
[0065] In addition, this information may be displayed together with the distance from the vehicle V to the intersection area. Alternatively or in addition, this information may be displayed at the position of the intersection area on the driving path R displayed on the display device 18. Alternatively or in addition, this information may be displayed superimposed on the image outside the vehicle acquired from the camera device 11. In addition, the display device 18 that displays this information includes not only the display mounted on the vehicle V, but also the display of the terminal owned by the occupant of the vehicle V. Furthermore, in the case where the driving assistance device 19 performs all driving tasks of the vehicle V and the supervisor monitors the driving of the vehicle V at a remote location away from the vehicle V, as in an unmanned taxi, the above information may also be displayed on the display of the terminal used to monitor the driving of the vehicle V.
[0066] exist Figure 2A In the case of the driving scene shown, since the host vehicle V is approaching the intersection C, the host vehicle V needs to slow down or stop, so an image (icon) X with the words "approaching an intersection" is displayed on the display device 18. This image X is information notifying that the host vehicle V is approaching an intersection area. The position where the image X is displayed is the position of the intersection C on the driving path R displayed on the display device 18. As a result, the occupant of the host vehicle V can confirm that the driving assistance device 19 recognizes that the host vehicle V is approaching the intersection C. In addition, when the image X is displayed, a special effect sound may be output from the speaker provided in the display device 18. The timing of outputting the special effect sound is, for example, simultaneous with the display of the image X.
[0067] In addition, an image Va representing the host vehicle V, an image D representing the distance from the host vehicle V to the intersection C, and an image Y representing the light state of the traffic light are displayed in the area A. The distance from the left end of the image D to the position represented by the black triangle C corresponds to the distance from the host vehicle V to the intersection C, and the distance from the left end to the right end of the image D corresponds to the distance from the host vehicle V to the destination Px. Figure 2A The image Y shown represents a horizontal signal, which corresponds to the light states of green, yellow and red in sequence from the left. Figure 2A The image Y shown corresponds to the light state of the traffic light at the intersection C, and shows a yellow light state.
[0068] The driving assistance device 19 changes the information provided to the occupants of the vehicle V according to the determination result obtained by the determination function. Specifically, when it is determined that the vehicle V cannot pass through the intersection area, the emphasis of the display part of the information displayed on the display device 18 is increased. For example, at least one of enlarging the size of the display part of the information, deepening the color of the display part of the information, increasing the brightness of the display part of the information, reducing the transparency of the display part of the information, and performing a demonstration of emphasizing the display part of the information is performed. As a demonstration of emphasizing the display part of the information, it is possible to cite the display part of the information as flashing. At this time, a special sound effect that attracts the attention of the occupants can be output from the speaker provided in the display device 18. In addition, when the display part of the information has been emphasized, the driving assistance device 19 may maintain the display form of the information without changing the emphasis of the display part of the information displayed on the display device 18 when it is determined that the vehicle V cannot pass through the intersection area.
[0069] On the other hand, when it is determined that the host vehicle V can pass through the intersection area, the emphasis of the display portion of the information displayed on the display device 18 is reduced. For example, at least one of reducing the size of the display portion of the information, making the color of the display portion of the information lighter, reducing the brightness of the display portion of the information, increasing the transparency of the display portion of the information, and performing a presentation to make the display portion of the information inconspicuous is performed. As a presentation to make the display portion of the information inconspicuous, fading out the display portion of the information can be cited. In addition, when it is determined that the host vehicle V can pass through the intersection area, the driving assistance device 19 may not display the display portion of the information displayed on the display device 18 and stop providing the information. In particular, when it is determined that the host vehicle V can pass through the intersection area before the host vehicle V passes through the intersection area, even before the host vehicle V passes through the intersection area, the information notifying that the host vehicle V is approaching the intersection area is not displayed and the information is stopped. In this way, the driving assistance device 19 can notify the occupants of the host vehicle V that the vehicle is driven based on the determination of whether it is possible to pass through the intersection area.
[0070] Figure 2B is Figure 2A In the driving scene shown, after the image X is displayed, the state of the traffic light at the intersection C changes to a red light state, and an image is displayed on the display device 18. Figure 2B In the driving scene shown, as the host vehicle V moves forward, the driving position of the host vehicle V on the lane L1 moves to a position close to the intersection C, and the length of the image Da representing the distance to the intersection C and the destination Px is shorter than the image D. In addition, the image representing the light state of the traffic light at the intersection C changes to the image Ya representing the red light state.
[0071] exist Figure 2B In the driving scene shown, since the state of the traffic light installed at the intersection C becomes a red light state, the host vehicle V must stop in front of the intersection C. Therefore, since it is determined that the host vehicle V cannot pass through the intersection C (intersection area), the image X, which is information notifying that the host vehicle V is approaching the intersection area, is changed to an image Xa corresponding to the determination result. Image Xa is information notifying the occupants of the host vehicle V that the host vehicle V is stopped in front of the intersection C, and indicates the position of the intersection C. By displaying the image Xa, the occupants of the host vehicle V can be notified that the host vehicle V is stopped at the position where the image is displayed. In addition, it is possible to prompt the occupants of the host vehicle V that the driving assistance device 19 has executed a determination on whether the crosswalk CW1 and the intersection C can be passed. As a result, when approaching the intersection C, appropriate information can be provided to the occupants of the host vehicle V.
[0072] Compared with image X, image Xa has a larger display portion, and the emphasis is increased by using a bold font. This can increase the emphasis of the display. Figure 2B As shown in the driving scenario, when a traffic light is set in the intersection area, the driving assistance device 19 can also provide the occupant with information corresponding to the determination result of whether there is an obstacle in the intersection area and information corresponding to the state of the traffic light. Figure 2B In the case of the driving scene shown, the determination result of whether there is an obstacle in the intersection area is displayed at the intersection C, and the determination result of whether the light state of the traffic light is in a state indicating parking is displayed as an image Ya in the lower area A. This can further increase the emphasis of the display.
[0073] Figure 2C is Figure 2B The image Xa is displayed in the driving scene shown, and the image is displayed on the display device 18 when the state of the traffic light changes to the green light state after the host vehicle V stops at the position in front of the intersection C. Figure 2CIn the driving scene shown, the vehicle V is driving at the position on the crosswalk CW1, and the length of the image Db indicating the distance to the intersection C and the destination Px is shorter than the image Da. In addition, the image indicating the light state of the traffic light at the intersection C changes to the image Yb indicating the green light state. Since the light state of the traffic light installed at the intersection C is green, the vehicle V does not need to stop in front of the intersection C. Therefore, Figure 2C In the illustrated driving scenario, the image Xa for notifying the occupant that the host vehicle V has stopped in front of the intersection C is not displayed.
[0074] exist Figure 2C In the driving scenario shown, it is assumed that a pedestrian is detected crossing the crosswalk CW3. In this case, in order to notify the occupants that there is a pedestrian on the crosswalk CW3, an image Z is displayed at the position of the crosswalk CW3. Image Z is an image that notifies the occupants of the presence of a pedestrian. Then, in order to notify the occupants that the vehicle V has stopped because the pedestrian is crossing, an image Xb with the words "a pedestrian is crossing" is displayed next to image Z. That is, based on Figure 2C The image Xa is changed to the image Xb by judging whether the crossing area can be passed in the driving scene shown. The size of the display portion of the image Xb is smaller than that of the image Xa, and the emphasis is reduced by using a normal font instead of a bold font. After the pedestrian has completed the crossing of the crosswalk CW3, the display of the images Xb and Z stops (is set to non-display), and the vehicle V turns left at the intersection C and enters the lane L5 through the driving assistance function of the control unit 20.
[0075] Hereinafter, an example of specific processing in the driving assistance device 19 will be described for each of the case where the host vehicle V turns left and the case where it turns right at the intersection C.
[0076] First, the case where the host vehicle V turns left at the intersection C will be described. When the host vehicle V turns left along the driving path R at the intersection C with a traffic light, the driving assistance device 19 detects pedestrians and bicycles crossing the intersection C and the state of the traffic light through the driving environment recognition function of the recognition unit 22, and recognizes the driving environment. Next, the passing judgment function of the judgment unit 23 determines whether the host vehicle V can pass through the intersection area based on the state of the traffic light. When it is determined that the host vehicle V can pass through the intersection C based on the state of the traffic light (specifically, the light state), the emphasis of the display part of the information provided to the occupant of the host vehicle V is reduced through the approach notification function of the providing unit 24. In contrast, when it is determined that the host vehicle V cannot pass through the intersection C based on the state of the traffic light, the emphasis of the display part of the information provided to the occupant of the host vehicle V is increased, or the display part of the information is maintained unchanged.
[0077] In addition, after the driving assistance device 19 determines that the host vehicle V can pass through the intersection C based on the state of the traffic light and reduces the emphasis of the display part of the information, it determines whether the host vehicle V can pass through the intersection C based on the detection results of pedestrians and bicycles. Then, if it is determined that the host vehicle V can pass through the intersection C based on the detection results of pedestrians and bicycles, the information related to whether the host vehicle V can pass through the intersection C is stopped from being provided to the occupants. In contrast, if it is determined that the host vehicle V can pass through the intersection C based on the detection results of pedestrians and bicycles, the emphasis of the display part of the information provided to the occupants is increased or the display part of the information is maintained unchanged. In this way, the information notifying that the host vehicle V is approaching the intersection area can be changed in stages according to the determination of whether the host vehicle V can pass through the intersection area.
[0078] Next, the case where the vehicle V turns right at the intersection C is described. When the vehicle V turns right along the driving path R at the intersection with traffic lights, the driving assistance device 19 detects pedestrians and bicycles crossing the intersection C, as well as the oncoming vehicles of the vehicle V and the state of the traffic lights through the driving environment recognition function of the recognition unit 22, and recognizes the driving environment. Figure 2A In the case of the driving scenario shown, the oncoming vehicle of the host vehicle V is a vehicle traveling in lane L3 or lane L4. Next, the passing determination function of the determination unit 23 determines whether the host vehicle V can pass through the intersection C based on the state of the signal light (specifically, the light state). If it is determined that the host vehicle V can pass through the intersection C based on the state of the signal light, the emphasis of the display portion of the information provided to the occupant of the host vehicle V is reduced by the approach notification function of the providing unit 24. In contrast, if it is determined that the host vehicle V cannot pass through the intersection C based on the state of the signal light, the emphasis of the display portion of the information provided to the occupant of the host vehicle V is increased or the display portion of the information is maintained unchanged.
[0079] In addition, after the driving assistance device 19 determines that the host vehicle V can pass through the intersection C based on the state of the traffic light and reduces the emphasis of the display part of the information provided to the occupant of the host vehicle V, it determines whether the host vehicle V can pass through the intersection C based on the detection results of pedestrians, bicycles, and oncoming vehicles. Then, if it is determined that the host vehicle V can pass through the intersection C based on the detection results of pedestrians, bicycles, and oncoming vehicles, the information related to whether the intersection C can be passed is stopped from being provided to the occupant. On the other hand, if it is determined that the host vehicle V cannot pass through the intersection C based on the detection results of pedestrians, bicycles, and oncoming vehicles, the emphasis of the display part of the information provided to the occupant of the host vehicle V is increased or the display part of the information is maintained unchanged. In this way, the information notifying that the host vehicle V is approaching the intersection area can be changed in stages according to the determination of whether the intersection area can be passed.
[0080] (Processing in driver assistance systems)
[0081] Reference Figure 3A~3B , the steps when the driving assistance device 19 processes information are explained. Figure 3A~3B This is an example of a flowchart showing information processing executed in the driving assistance system 10 of the present embodiment. The processing described below is executed by the CPU 191 which is a processor of the driving assistance system 19 at predetermined time intervals.
[0082] First, in Figure 3A In step S1, the driving route R is obtained from the navigation device 16 through the intersection area acquisition function of the acquisition unit 21. In the following step S2, the area where other mobile bodies can move is obtained from the map information 14. In the following step S3, the intersection area is obtained. Then, in step S4, the current position of the vehicle V is obtained from the position detection device 15 through the driving environment recognition function of the recognition unit 22. In the following step S5, it is determined whether the distance from the vehicle V to the intersection area is less than the specified distance. If it is determined that the distance from the vehicle V to the intersection area exceeds the specified distance, enter Figure 3B Alternatively, step S5 may be repeated until the distance from the vehicle V to the intersection area is less than a predetermined distance. On the other hand, when it is determined that the distance from the vehicle V to the intersection area is less than a predetermined distance, the process proceeds to step S6.
[0083] In step S6, an image notifying that the vehicle is approaching an intersection area is displayed at the position of the intersection area on the driving route displayed on the display device 18 by the approach notification function of the providing unit 24. Figure 3B In step S7, the passing judgment function of the judgment unit 23 is used to determine whether a traffic light is installed in the intersection area. When it is determined that a traffic light is not installed in the intersection area, the process proceeds to step S8, detects obstacles existing in the intersection area and proceeds to step S11. In contrast, when it is determined that a traffic light is installed in the intersection area, the process proceeds to step S9, detects the state of the traffic light installed in the intersection area and the obstacles existing in the intersection area. In step S10 after step S9, it is determined whether the state of the traffic light indicates parking. When it is determined that the state of the traffic light indicates parking, the process proceeds to step S15. In contrast, when it is determined that the state of the traffic light does not indicate parking, the process proceeds to step S11. In step S11, it is determined whether there is an obstacle in the intersection area. When it is determined that there is no obstacle in the intersection area, the process proceeds to step S12, and it is determined that the vehicle V can pass through the intersection area.
[0084] If it is determined that the host vehicle V can pass through the intersection area after entering step S12, the process proceeds to step S13. In step S13, the emphasis of the display of the image related to whether the host vehicle V can pass through the intersection area is reduced or the display of the image is stopped (not displayed) through the approach notification function of the providing unit 24. Next, in step S14, the driving of the host vehicle V is autonomously controlled via the vehicle control device 17 through the driving assistance function of the control unit 20 so that the host vehicle V travels along the driving path R. Then, the process shown in FIG. 3 is stopped, and the display control processing in the driving assistance device 19 is terminated.
[0085] On the other hand, if it is determined that there is an obstacle in the intersection area, the process proceeds to step S15, and it is determined that the vehicle V cannot pass through the intersection area. In this case, in the following step S16, the emphasis of the display of the image related to whether the intersection area can be passed is increased, or the display of the image is maintained, through the proximity notification function of the providing unit 24. In the following step S17, it is determined whether the passing judgment of the intersection area is repeated more than a prescribed number of times (for example, 5 times). In the case where it is determined that the passing judgment of the intersection area is not repeated more than a prescribed number of times, the process proceeds to step S7, and the passing judgment of the intersection area is repeated. On the other hand, when it is determined that the passing judgment of the intersection area is repeated more than a prescribed number of times, the process shown in FIG. 3 is stopped, and the display control processing in the driving assistance device 19 is terminated. Then, through the driving assistance function of the control unit 20, the driver is requested to drive based on manual operation.
[0086] (Embodiment of the present invention)
[0087] As described above, the present embodiment provides an information providing device, comprising: an acquisition unit 21, which acquires an intersection area that intersects with an area where other mobile bodies can move on a driving route R set by autonomous driving control; an identification unit 22, which identifies the driving environment around the host vehicle V; a determination unit 23, which determines whether the host vehicle V can pass through the intersection area based on the driving environment; a providing unit 24, which provides information notifying that the host vehicle V is approaching the intersection area to an onboard terminal and / or an electronic terminal in the host vehicle V, and the providing unit 24 changes the information according to the determination result of the determination unit 23 until the host vehicle V drives to the intersection area. Thus, when approaching an intersection area such as an intersection C, appropriate information can be provided to the occupants of the vehicle, and the sense of uneasiness caused to the occupants of the vehicle can be suppressed.
[0088] Furthermore, according to the information providing device of the present embodiment, the intersection area includes an intersection, a crosswalk, and a sidewalk facing a facility that the host vehicle V can enter. This makes it possible to more accurately identify the intersection area.
[0089] Furthermore, according to the information providing device of the present embodiment, the providing unit 24 changes at least one of the color, brightness, and size of the display portion of the information. This allows the information to be changed more effectively.
[0090] In addition, according to the information providing device of the present embodiment, the providing unit 24 increases the emphasis of the display portion of the information when the determining unit 23 determines that the host vehicle V cannot pass through the intersection area, and reduces the emphasis of the display portion of the information or stops providing the information when the determining unit 23 determines that the host vehicle V can pass through the intersection area. As a result, when approaching an intersection area such as an intersection C, it is possible to notify the occupants of the vehicle that it has been determined whether the host vehicle V can pass through the intersection area, and it is possible to suppress the sense of uneasiness caused to the occupants of the vehicle.
[0091] In addition, according to the information providing device of the present embodiment, the providing unit 24 performs at least one of displaying the information together with the distance from the host vehicle V to the intersection area, displaying the information at the position of the intersection area on the travel path R displayed by the display device 18, and displaying the information in an overlapping manner with the image outside the vehicle acquired from the camera device 11. Thus, information can be effectively displayed to the occupants of the vehicle.
[0092] In addition, according to the information providing device of the present embodiment, when the determining unit 23 determines that the host vehicle V can pass through the intersection area, the providing unit 24 reduces the emphasis of the display portion of the information even before the host vehicle V passes through the intersection area. As a result, when approaching the intersection area, the occupants of the vehicle can be notified in advance that it has been determined whether the host vehicle V can pass through the intersection area, and the sense of uneasiness caused to the occupants of the vehicle can be suppressed.
[0093] In addition, according to the information providing device of the present embodiment, when there is a traffic light in front of the host vehicle V, the recognition unit 22 detects obstacles existing around the host vehicle V and the state of the traffic light as the driving environment, and the determination unit 23 determines whether the obstacle exists in the intersection area and whether the state of the traffic light is a state indicating a stop, and when it is determined that the obstacle does not exist in the intersection area and the state of the traffic light is not a state indicating a stop, it is determined that the host vehicle V can pass through the intersection area. Thus, when a traffic light is provided in the intersection area, it can be appropriately determined whether the intersection area can be passed.
[0094] In addition, according to the information providing device of this embodiment, the providing unit 24 provides the vehicle-mounted terminal and / or the electronic terminal with information corresponding to the result of the determination of whether the obstacle exists in the intersection area and information corresponding to the result of the determination of whether the state of the signal light is a state indicating parking. Thus, the environment in the intersection area can be presented in more detail.
[0095] In addition, according to the information providing device of this embodiment, the determination unit 23 determines whether the host vehicle V can pass through the intersection area when the host vehicle V stops in front of the intersection area and then starts again. This makes it possible to more reliably determine whether the host vehicle V can pass through the intersection area.
[0096] In addition, according to the information providing device of the present embodiment, when the host vehicle V turns left along the travel path R at the intersection C provided with a traffic light, the recognition unit 22 detects pedestrians and bicycles crossing the intersection C and the state of the traffic light as the travel environment, the determination unit 23 determines whether the host vehicle V can pass through the intersection C based on the state of the traffic light, the providing unit 24 reduces the emphasis level of the display portion of the information when the determination unit 23 determines that the host vehicle V can pass through the intersection C based on the state of the traffic light, the determination unit 23 determines whether the host vehicle V can pass through the intersection C based on the detection results of the pedestrians and bicycles after reducing the emphasis level, and the providing unit 24 stops providing the information when the determination unit 23 determines that the host vehicle V can pass through the intersection C based on the detection results of the pedestrians and bicycles. Thus, when the host vehicle V turns left, information can be effectively displayed to the occupants of the vehicle.
[0097] In addition, according to the information providing device of the present embodiment, when the host vehicle V turns right along the travel path R at an intersection C provided with a traffic light, the recognition unit 22 detects pedestrians, bicycles, and oncoming vehicles of the host vehicle V crossing the intersection C and the state of the traffic light as the travel environment, the determination unit 23 determines whether the host vehicle V can pass through the intersection C based on the state of the traffic light, the providing unit 24 reduces the emphasis level of the display portion of the information when the determination unit 23 determines that the host vehicle V can pass through the intersection C based on the state of the traffic light, the determination unit 23 determines whether the host vehicle V can pass through the intersection C based on the detection results of the pedestrians, bicycles, and oncoming vehicles after reducing the emphasis level, and the providing unit 24 stops providing the information when the determination unit 23 determines that the host vehicle V can pass through the intersection C based on the detection results of the pedestrians, bicycles, and oncoming vehicles. Thus, when the host vehicle V turns right, information can be effectively displayed to the occupants of the vehicle.
[0098] Furthermore, according to the information providing device of the present embodiment, the providing unit 24 displays the information on at least one of a display mounted on the host vehicle V, a display provided on a terminal for monitoring the travel of the host vehicle V, and a display on a terminal of an occupant of the host vehicle V. Thus, information on whether or not the vehicle can pass through the intersection area can be provided to a person supervising the travel of the vehicle.
[0099] In addition, the present embodiment provides an information providing method, in which the processor obtains an intersection area that intersects with an area where other mobile bodies can move on a driving route R set by autonomous driving control, identifies the driving environment around the host vehicle V, determines whether the host vehicle V can pass through the intersection area based on the driving environment, and provides information notifying that the host vehicle V is approaching the intersection area to an on-board terminal and / or an electronic terminal in the host vehicle V, and changes the information according to the determination result of whether the host vehicle V can pass through the intersection area until the host vehicle V drives to the intersection area. As a result, when approaching an intersection area such as an intersection C, appropriate information can be provided to the occupants of the vehicle, and the sense of uneasiness caused to the occupants of the vehicle can be suppressed.
[0100] Explanation of symbols
[0101] 10: Driver assistance systems
[0102] 11: Camera device
[0103] 12: Distance measuring device
[0104] 13: Status detection device
[0105] 14: Map information
[0106] 15: Position detection device
[0107] 16: Navigation device
[0108] 17: Vehicle Control Device
[0109] 171: Vehicle speed control device
[0110] 172: Steering Controls
[0111] 18: Display device
[0112] 19: Driving assistance device (information providing device)
[0113] 191: CPU (processor)
[0114] 192: ROM
[0115] 193: RAM
[0116] 20: Control Department
[0117] 21: Get Department
[0118] 22: Identification Department
[0119] 23: Judgment Department
[0120] 24: Provide Department
[0121] A: Area
[0122] C: Intersection
[0123] CW1, CW2, CW3, CW4: Pedestrian crossing
[0124] L1, L2, L3, L4, L5, L6: Lanes
[0125] Px: Destination
[0126] R: Driving path
[0127] V: This vehicle
[0128] D, Da, Db, Va, X, Xa, Xb, Y, Ya, Yb, Z: Image
Claims
1. An information providing device, comprising: an acquisition unit that acquires an intersection area that intersects an area where other moving bodies can move on a driving path set by autonomous driving control; A recognition unit that recognizes a driving environment around the vehicle; a determination unit that determines whether the host vehicle can pass through the intersection area based on the driving environment; a providing unit that provides information notifying that the host vehicle is approaching the intersection area to an onboard terminal and / or an electronic terminal in the host vehicle, The providing unit changes the information according to a determination result of the determining unit until the host vehicle travels to the intersection area.
2. The information providing device according to claim 1, wherein: The intersection area includes an intersection, a crosswalk, and a sidewalk facing the facility that the host vehicle can enter.
3. The information providing device according to claim 1 or 2, wherein: The providing unit changes at least one of a color, a brightness, and a size of a display portion of the information.
4. The information providing device according to any one of claims 1 to 3, wherein: The providing unit performs the following processing: When the determination unit determines that the host vehicle cannot pass through the intersection area, increasing the emphasis of the display portion of the information, When the determination unit determines that the host vehicle can pass through the intersection area, the emphasis level of the display portion of the information is reduced or provision of the information is stopped.
5. The information providing device according to any one of claims 1 to 4, wherein: The providing unit performs at least one of the following processes: displaying the information together with a distance from the host vehicle to the intersection area; Displaying the information at a position of the intersection area on the driving path displayed on a display device; The information is displayed by being superimposed on an image outside the vehicle acquired from the camera device.
6. The information providing device according to any one of claims 1 to 5, wherein: When the determination unit determines that the host vehicle can pass through the intersection area, the providing unit reduces the emphasis degree of the display portion of the information even before the host vehicle passes through the intersection area.
7. The information providing device according to any one of claims 1 to 6, wherein: When there is a traffic light in front of the host vehicle, the recognition unit detects obstacles existing around the host vehicle and the state of the traffic light as the driving environment, The determination unit determines whether the obstacle is present in the intersection area and whether the state of the traffic light is a state indicating parking. When it is determined that the obstacle does not exist in the intersection area and the state of the signal light is not a state indicating a stop, it is determined that the host vehicle can pass through the intersection area.
8. The information providing device according to claim 7, wherein: The providing unit provides information corresponding to the determination result of whether the obstacle exists in the intersection area and information corresponding to the determination result of whether the state of the signal light is a state indicating parking to the vehicle terminal and / or the electronic terminal respectively.
9. The information providing device according to any one of claims 1 to 8, wherein: The determination unit determines whether the host vehicle can pass through the intersection area when the host vehicle starts after stopping in front of the intersection area.
10. The information providing device according to any one of claims 1 to 9, wherein: When the host vehicle turns left along the travel path at an intersection with a traffic light, the recognition unit detects pedestrians and bicycles crossing the intersection and the state of the traffic light as the travel environment, The determination unit determines whether the host vehicle can pass through the intersection based on the state of the traffic light, the providing unit reduces the emphasis of a display portion of the information when the determining unit determines that the host vehicle can pass through the intersection based on the state of the traffic light, The determination unit determines whether the host vehicle can pass through the intersection based on the detection results of the pedestrian and the bicycle after reducing the emphasis level, The providing unit stops providing the information when the determining unit determines that the host vehicle can pass through the intersection based on the detection results of the pedestrian and the bicycle.
11. The information providing device according to any one of claims 1 to 10, wherein: When the host vehicle turns right along the driving path at an intersection with a traffic light, the recognition unit detects pedestrians, bicycles, and oncoming vehicles of the host vehicle and the state of the traffic light crossing the intersection as the driving environment, The determination unit determines whether the host vehicle can pass through the intersection based on the state of the traffic light, When the determination unit determines that the host vehicle can pass through the intersection based on the state of the traffic light, the providing unit reduces the emphasis of the display portion of the information, After reducing the emphasis level, the determination unit determines whether the host vehicle can pass through the intersection based on the detection results of the pedestrian, the bicycle, and the oncoming vehicle, The providing unit stops providing the information when the determining unit determines that the host vehicle can pass through the intersection based on the detection results of the pedestrian, the bicycle, and the oncoming vehicle.
12. The information providing device according to any one of claims 1 to 11, wherein: The providing unit displays the information on at least one of a display mounted on the host vehicle, a display provided in a terminal for monitoring travel of the host vehicle, and a display of a terminal of an occupant of the host vehicle.
13. A method for providing information, executed by a processor, wherein: The processor is caused to perform the following processing: Acquire an intersection area that intersects with an area where other moving objects can move on the driving path set by the autonomous driving control, Identify the driving environment around the vehicle, Based on the driving environment, determining whether the host vehicle can pass through the intersection area, providing information notifying that the host vehicle is approaching the intersection area to an onboard terminal and / or an electronic terminal in the host vehicle, During the period until the host vehicle reaches the intersection area, the information is changed according to a determination result of whether the host vehicle can pass through the intersection area.
