Information providing apparatus and information providing method
By identifying and notifying the main reasons for parking of autonomous vehicles, the problem of occupants feeling uneasy before the vehicle starts is solved, a clearer notification of parking reasons is achieved, and the driving experience is improved.
Patent Information
- Application Number
- CN202380031636.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-05
- Filing Date
- 2023-03-17
- Publication Date
- 2024-11-19
AI Technical Summary
When the autonomous vehicle is parked, the occupants cannot understand the main reasons for the vehicle to park in a timely manner, which leads to uneasiness before starting.
By obtaining the intersection area on the vehicle's driving path and other movable areas of the movable areas of the mobile body, identifying the driving environment around the vehicle, and notifying the on-board terminal and electronic terminal the main reasons, including obstacle types and signal lights, when determining that the vehicle cannot pass through the crossover area, the vehicle-mounted terminal and electronic terminal are notified of the main reasons, including obstacle types and signal lights, when determining that the vehicle cannot pass through the crossover area. state.
It effectively suppresses the uneasiness of the passengers before the vehicle starts, reduces waiting time by clarifying the reasons for parking, and improves the driving experience.
Smart Images

Figure CN118984789A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to an information providing device and an information providing method. Background Art
[0002] The following technology is known: when displaying the parking state of a vehicle with an automatic driving function, the surrounding conditions of the vehicle are detected, and when the vehicle will be parked in the future under the surrounding conditions during automatic driving, a stop display indicating the reason for the vehicle's stop is displayed on a display device, extending upward from the road surface of the surrounding conditions (Patent Document 1).
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2019-27996
[0006] Problems to be solved by the invention
[0007] In the above-mentioned prior art, the reasons for stopping notified to the vehicle occupants are limited to those corresponding to the traffic regulations, road signs and signal light states. Therefore, when the vehicle stops mainly due to an obstacle, for example, the reasons for stopping are different from the traffic regulations, road signs and signal light states, the reasons for stopping are not notified to the occupants. Therefore, in the above-mentioned prior art, there is a problem that the vehicle occupants have to wait until the vehicle starts without any indication of the main reason for stopping, and feel uneasy. Summary of the invention
[0008] An object of the present invention is to provide an information providing device and an information providing method that can suppress the anxiety felt by a passenger before a vehicle starts.
[0009] The present invention solves the above-mentioned problem through the following processing: obtaining an intersection area that intersects with other movable areas on the driving path set by autonomous driving control, identifying the driving environment around the vehicle, and determining whether the vehicle can pass through the intersection area based on the identified driving environment. If it is determined that the vehicle cannot pass through the intersection area, when the vehicle's parking time is longer than the specified time, notifying the on-board terminal and / or electronic terminal in the vehicle of the main reason why the vehicle cannot pass through the intersection area.
[0010] Effects of the Invention
[0011] According to the present invention, it is possible to suppress the anxiety felt by the occupant before the vehicle starts. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] Figure 1 This is a block diagram showing an example of a driving assistance system including a driving assistance device according to the present invention.
[0013] Figure 2A Yes means through Figure 1 FIG. 1 is a diagram showing an example of an image displayed when the driving assistance system shown executes driving assistance (part 1).
[0014] Figure 2B Yes means through Figure 1 FIG. 2 is a diagram showing an example of an image displayed when the driving assistance system shown in FIG. 1 performs driving assistance (part 2).
[0015] Figure 2C Yes means through Figure 1 FIG. 3 is a diagram showing an example of an image displayed when the driving assistance system shown in FIG. 1 performs driving assistance.
[0016] Figure 2D Yes means through Figure 1 FIG. 4 is a diagram showing an example of an image displayed when the driving assistance system shown in FIG. 1 performs driving assistance.
[0017] Figure 2E Yes means through Figure 1 FIG. 5 is a diagram showing an example of an image displayed when the driving assistance system shown in FIG. 1 performs driving assistance.
[0018] Figure 3A Yes means Figure 1 Flowchart (part 1) of an example of a processing sequence in a driving assistance device.
[0019] Figure 3B Yes means Figure 1 Flowchart of an example of a processing sequence in a driving assistance device (part 2).
[0020] Figure 3C Yes means Figure 1 Flowchart of an example of the processing sequence in the driving assistance device (part 3).
[0021] Figure 3D Yes means Figure 1 Flowchart of an example of the processing sequence in the driving assistance device (Part 4). DETAILED DESCRIPTION
[0022] The following is a description of the embodiments of the present invention based on the accompanying drawings. In addition, the following description is based on the premise that in countries with laws for driving on the left, vehicles drive on the left. In countries with laws for driving on the right, vehicles drive on the right, so the left and right in the following description are symmetrically replaced.
[0023] (Structure of driver assistance system)
[0024] Figure 1: is a block diagram showing the driving assistance system 10 of the present invention. The driving assistance system 10 is a vehicle-mounted system that drives the vehicle to a destination set by the vehicle's occupants (including the driver) through autonomous driving control. Autonomous driving control refers to autonomously controlling the vehicle's driving movements using a driving assistance device described later, and the driving movements include all driving movements such as acceleration, deceleration, starting, parking, turning right or left, lane changes, and pulling over. In addition, autonomously controlling driving movements refers to the driving assistance device controlling the driving movements using the vehicle's devices. That is, the driving assistance device intervenes and controls these driving movements within a pre-set range. For driving movements that are not intervened, the driver performs manual operations.
[0025] like Figure 1 As shown, the driving assistance system 10 includes: a camera device 11, a distance measuring device 12, a state detection device 13, map information 14, a position detection device 15, a navigation device 16, a vehicle control device 17, a display device 18, and a driving assistance device 19. Figure 1 As shown, the driving support device 19 of the present embodiment includes an information providing device having an information providing function as a part thereof. The devices constituting the driving support system 10 are connected via a CAN (Controller Area Network) or other in-vehicle LAN and can send and receive information to each other.
[0026] The camera device 11 is a device for recognizing objects around the vehicle through images, and is, for example, a camera having an image pickup element such as a CCD, an ultrasonic camera, an infrared camera, etc. A plurality of camera devices 11 may be provided on a vehicle, for example, they may be arranged at the front grille of the vehicle, the lower part of the left and right door mirrors, and near the rear bumper. This can reduce blind spots when recognizing objects around the vehicle.
[0027] The distance measuring device 12 is a device for calculating the relative distance and relative speed between the vehicle and the object, and is a radar device or sonar such as a laser radar, a millimeter wave radar, etc. (LRF, etc.), a LiDAR (light detection and ranging) unit, an ultrasonic radar, etc. A plurality of distance measuring devices 12 can be set on a vehicle, for example, they can be arranged in front, on the right side, on the left side, and on the rear of the vehicle. In this way, the relative distance and relative speed between the vehicle and the surrounding objects can be accurately calculated.
[0028] The objects detected by the camera device 11 and the distance measuring device 12 are lane boundary lines, center lines, road surface markings, central median strips, guardrails, curbs, side walls of highways, road markings, traffic lights, crosswalks, construction sites, accident sites, traffic restrictions, etc. In addition, the objects also include obstacles that may affect the driving of the vehicle, such as cars (other vehicles) other than the vehicle, two-wheeled automatic vehicles (motorcycles), bicycles, pedestrians, etc. The detection results of the camera device 11 and the distance measuring device 12 are obtained by the driving assistance device 19 at a prescribed time interval as needed.
[0029] In addition, the detection results of the camera 11 and the distance measuring device 12 can be integrated or synthesized by the driving assistance device 19 (so-called sensor fusion), thereby supplementing the missing information of the detected object. For example, the position information of the object can be calculated by the driving assistance device 19 based on the position of the vehicle, that is, the vehicle's own position information obtained by the position detection device 15, and the relative position (distance and direction) between the vehicle and the object. The driving assistance device 19 integrates the calculated position information of the object with the detection results of the camera 11 and the distance measuring device 12, and the map information 14 and other information to obtain the driving environment information around the vehicle. In addition, the detection results of the camera 11 and the distance measuring device 12 and the map information 14 can also be used to identify the objects around the vehicle and predict their movements.
[0030] The state detection device 13 is a device for detecting the driving state of the vehicle, and examples thereof include a vehicle speed sensor, an acceleration sensor, a yaw rate sensor (e.g., a gyro sensor), a steering angle sensor, an inertial measurement unit, etc. These devices are not particularly limited, and known devices can be used. In addition, the configuration and number of these devices can be appropriately set within the range of appropriately detecting the driving state of the vehicle. The detection results of each device are obtained by the driving assistance device 19 at a prescribed time interval as needed.
[0031] The map information 14 is information used to generate a driving route, control driving actions, etc., and includes road information, facility information, and their attribute information. The road information and road attribute information include: road width, road curvature radius, shoulder structure, road traffic regulations (speed limit, lane change), road merging points and branch points, lane increase / decrease positions, etc. The map information 14 is high-precision map information that can grasp the movement trajectory of each lane, including two-dimensional position information and / or three-dimensional position information in each map coordinate, road / lane boundary information in each map coordinate, road attribute information, lane up / down information, lane recognition information, connection target lane information, etc.
[0032] The road / lane boundary information of the high-definition map information is information indicating the boundary between the road on which the vehicle is traveling and other roads. The driving road on which the vehicle is traveling refers to the road used for the vehicle to travel, and the form of the driving road is not particularly limited. The boundary exists on the left and right relative to the direction of travel of the vehicle, and the form is not particularly limited. Boundaries are, for example, road surface markings or road structures. Road surface markings include lane boundary lines, center lines, etc., and road structures include central isolation strips, guardrails, curbs, tunnels, and side walls of highways. In addition, at locations such as intersections where the driving road boundary cannot be clearly determined, a boundary is set in advance on the driving road. The boundary is fictitious and is not an actual road surface marking or road structure.
[0033] The map information 14 is stored in a readable state in a recording medium in the driving support device 19, an in-vehicle device, or a server provided on a network. The driving support device 19 acquires the map information 14 as necessary.
[0034] The position detection device 15 is a positioning system for detecting the current position of the vehicle. It is not particularly limited and a known device can be used. The position detection device 15 calculates the current position of the vehicle based on radio waves received from satellites for GPS (Global Positioning System), for example. In addition, the position detection device 15 can also estimate the current position of the vehicle based on the vehicle speed information and acceleration information obtained from the vehicle speed sensor, acceleration sensor and gyro sensor as the state detection device 13, and compare the estimated current position with the map information 14 to calculate the current position of the vehicle.
[0035] The navigation device 16 is a device that refers to the map information 14 and calculates a driving route from the current position of the vehicle detected by the position detection device 15 to the destination set by the occupant (including the driver). The navigation device 16 uses the road information and facility information of the map information 14 to search for a driving route for the vehicle to reach the destination from the current position. The driving route includes at least information about the road, driving lane, and driving direction of the vehicle, and is represented by a line, for example. Depending on the search conditions, there may be a plurality of driving routes. The driving route calculated by the navigation device 16 is output to the driving assistance device 19.
[0036] The vehicle control device 17 is an on-board computer such as an electronic control unit (ECU) that electronically controls on-board equipment that restricts the vehicle's travel. The vehicle control device 17 includes: a vehicle speed control device 171 that controls the vehicle's travel speed, and a steering control device 172 that controls the vehicle's steering operation. The vehicle speed control device 171 and the steering control device 172 autonomously control the actions of these drive devices and steering devices based on the control signal input from the driving assistance device 19. As a result, the vehicle can travel autonomously according to the set travel path. The information required for autonomous control based on the vehicle speed control device 171 and the steering control device 172, such as the vehicle's travel speed, acceleration, steering angle and posture, is obtained from the state detection device 13.
[0037] The driving devices controlled by the vehicle speed control device 171 include: an electric motor and / or an internal combustion engine as a driving source; a power transmission device including a drive shaft and an automatic transmission that transmits the output from these driving sources to the driving wheels; a driving device that controls the power transmission device, etc. In addition, the braking device controlled by the vehicle speed control device 171 is, for example, a braking device for braking the wheels. A control signal corresponding to the set driving speed is input from the driving assistance device 19 to the vehicle speed control device 171. Based on the control signal input from the driving assistance device 19, the vehicle speed control device 171 generates a signal to control these driving devices and sends the signal to the driving device, thereby autonomously controlling the driving speed of the vehicle.
[0038] On the other hand, the steering device controlled by the steering control device 172 is a steering device that controls the steering wheel according to the steering angle of the steering wheel, and for example, a steering actuator such as an electric motor installed on the column shaft of the steering gear can be cited. The steering control device 172 autonomously controls the operation of the steering device based on the control signal input from the driving assistance device 19 so that the vehicle travels while maintaining a predetermined lateral position (the position of the vehicle in the left and right direction) relative to the set driving path. In this control, at least one of the detection results of the camera device 11 and the distance measuring device 12, the driving state of the vehicle obtained by the state detection device 13, the map information 14, and the information on the current position of the vehicle obtained by the position detection device 15 is used.
[0039] The display device 18 is a device for providing necessary information to the occupants of the vehicle, and is, for example, a projector such as a liquid crystal display or a head-up display (HUD) provided on the instrument panel. The display device 18 may also include an input device for the occupants of the vehicle to input instructions to the driving assistance device 19. Examples of the input device include a touch panel that is input by a user's finger touch or a stylus, a microphone that obtains instructions from the user's voice, and a switch installed on the steering wheel of the vehicle. In addition, the display device 18 may include a speaker as an output device.
[0040] The driving assistance device 19 is a device for controlling the driving of the vehicle by controlling the devices constituting the driving assistance system 10 and making them cooperate to control the driving of the vehicle, so that the vehicle drives to a set destination. The destination is set by, for example, a passenger of the vehicle. The driving assistance device 19 is, for example, a computer, and includes: a CPU (Central Processing Unit) 191 as a processor, a ROM (Read Only Memory) 192 storing a program, and a RAM (Random Access Memory) 193 functioning as an accessible storage device. The CPU 191 is an action circuit for executing the program stored in the ROM 192 to realize the functions of the driving assistance device 19.
[0041] The driving assistance device 19 has a driving assistance function that causes the vehicle to travel to a set destination through autonomous driving control. In addition, the driving assistance device 19 of the present embodiment includes an information providing device as a part thereof. As an information providing function, the information providing device has: an intersection area acquisition function for acquiring an intersection area that intersects with an area where other movable bodies can move on the vehicle's driving path; a driving environment recognition function for recognizing the driving environment around the vehicle; a passing determination function for determining whether the vehicle can pass through the intersection area; and an approach notification function for providing information to the occupants of the vehicle that the vehicle is approaching an intersection area. The program stored in ROM192 has programs for realizing these functions, and these functions are realized by causing CPU191 to execute the programs stored in ROM192. Figure 1 In the figure, for convenience, each function is extracted into a functional module and shown.
[0042] (Function of function block)
[0043] Below, use Figure 2A~2E right Figure 1 The functions of the functional blocks of the assisting unit 20, the acquiring unit 21, the identifying unit 22, the determining unit 23, and the notifying unit 24 shown in the figure will be described.
[0044] The assist unit 20 has a driving assist function for driving the vehicle to a set destination by autonomous driving control. The driving assist device 19 displays an image showing the driving environment of the vehicle on the display device 18 by an information providing function while performing driving assistance by the driving assist function. Figure 2A The figure shows an example of an image displayed on the display device 18. Figure 2AThe image shown is a bird's-eye view image obtained when a virtual viewpoint is set diagonally above and behind the vehicle V and the front of the vehicle V is photographed from the viewpoint position. In the bird's-eye view image, information such as the lanes and signs of the road on which the vehicle V is traveling, the traveling position of the vehicle V, and obstacles existing around the vehicle V are displayed. In the following description, in order to distinguish it from other vehicles, the vehicle V is also referred to as the host vehicle V.
[0045] in addition, Figure 2A The image shown is a two-dimensional image generated by computer graphics (CG), but the image representing the running environment of the vehicle V displayed on the display device 18 is not limited to this. For example, the image representing the running environment may be a three-dimensional image or an image obtained by the camera device 11. In addition, an image created by CG may be displayed in an overlapping manner on the image obtained by the camera device 11.
[0046] Figure 2A The driving scenario shown corresponds to the actual driving scenario of the vehicle V. That is, Figure 2A In the driving scene shown, vehicle V is driving on a single-lane road. The driving direction of vehicles on lane L1 is from the lower side to the upper side (from the front side to the inner side) of the figure, and the driving direction of vehicles on lane L2 is from the upper side to the lower side (from the inner side to the front side) of the figure. The road on which vehicle V is driving intersects with the single-lane road in front of vehicle V. On the single-lane road, the driving direction of vehicles on lane L3 is from the left side to the right side of the figure, and the driving direction of vehicles on lane L4 is from the right side to the left side of the figure.
[0047] like Figure 2A As shown in , the intersection of the two roads is the intersection X. Assume that Figure 2A The intersection X shown in the figure has no traffic lights. At the intersection X, there are: a crosswalk C1 for pedestrians and bicycles to cross the road with lanes L1 and L2 in the left-right direction of the figure; and crosswalks C2 and C3 for pedestrians to cross the road with lanes L3 and L4 in the up-down direction of the figure. Figure 2A In the driving scenario shown, it is assumed that vehicles traveling on lane L1 can turn left or right at intersection X, vehicles traveling on lane L3 can go straight or turn right at intersection X, and vehicles traveling on lane L4 can go straight or turn left at intersection X.
[0048] exist Figure 2A In the driving scenario shown, the destination Px of the vehicle V is set by the occupant of the vehicle V to the position of the target going straight to the right in the drawing on the lane L3. In this case, the navigation device 16 sets the driving path R of the vehicle V through the driving assistance function of the assistance unit 20. For example, the navigation device 16 sets Figure 2A The driving route R shown in FIG. The driving route R is a path that goes straight on lane L1, turns right at intersection X, and drives on lane L3 to reach the destination Px. Figure 2A In the driving scenario shown, Figure 2A As shown, it is assumed that the vehicle V is traveling along the driving path R in the lane L1.
[0049] In addition, Figure 2A In the driving scene shown, it is assumed that a pedestrian Y1 at position P1 moves from position P1 to position P2 by walking and crosses the crosswalk C1, and a pedestrian Y2 at position P3 moves from position P3 to position P4 by walking and crosses the crosswalk C3. Furthermore, another vehicle Z is parked at position P5 in front of the crosswalk C2 on the lane L3. In this case, the driving assistance device 19 provides appropriate information to the occupants of the vehicle through the information providing device of the information providing device included as a part thereof, and performs driving assistance for driving the vehicle V to the destination Px through the driving assistance function. In addition, driving assistance including information provision is mainly realized by the functions of the acquisition unit 21, the recognition unit 22, the determination unit 23 and the notification unit 24.
[0050] The acquisition unit 21 has an intersection area acquisition function of acquiring an intersection area that intersects with an area where other moving bodies can move on the driving route R set by the autonomous driving control. Other moving bodies refer to traffic participants other than the vehicle V, such as other vehicles, two-wheeled motor vehicles, bicycles, and pedestrians. The area where other moving bodies can move refers to an area where traffic participants other than the vehicle V can move when moving from the current position to the destination. For example, the area where pedestrians can move is an area where pedestrians can walk, such as a sidewalk, a crosswalk, and a pedestrian bridge. The area where other vehicles and two-wheeled motor vehicles can move is the same as the area where the vehicle V can travel on the road.
[0051] The driving assistance device 19 acquires the driving route R from the navigation device 16 through the intersection area acquisition function of the acquisition unit 21. Next, an intersection area that intersects with an area where other moving bodies can move on the driving route R is acquired. The intersection of the driving route R with the area where other moving bodies can move means that when a traffic participant other than the vehicle V exists in the area where the traffic participant can move, the vehicle V contacts the other moving body when the vehicle V travels along the driving route R. That is, it means that the driving route R of the vehicle V and the area where the traffic participant other than the vehicle V can move exist on the same plane, and when viewed from above, the driving route R of the vehicle V overlaps partly or entirely with the area where the traffic participant other than the vehicle V can move.
[0052] For example, when there is a crosswalk on the travel path R, if there are pedestrians on the crosswalk, if the vehicle V travels along the travel path R, the vehicle V comes into contact with the pedestrian. Therefore, the crosswalk on the travel path R becomes an intersection area. On the other hand, when there is a pedestrian bridge on the travel path R, if there are pedestrians walking on the pedestrian bridge, even if the vehicle V travels along the travel path R, the vehicle V does not come into contact with the pedestrian. This is because the road on which the vehicle V travels and the pedestrian bridge on which the pedestrian walks are not on the same plane.
[0053] The map information 14 includes road information of the roads that the vehicle V passes through when traveling along the travel route R. In addition, the map information 14 also includes information on areas where traffic participants other than the vehicle V can move on the roads that the vehicle V passes through and their attributes. Therefore, the driving assistance device 19 can extract the intersection area existing on the travel route R through the intersection area acquisition function of the acquisition unit 21.
[0054] Specifically, the intersection area includes an intersection where the road on which the vehicle V is traveling intersects with the road on which other vehicles other than the vehicle V are traveling, a crosswalk provided on the road on which the vehicle V is traveling, and the like. In addition, when the vehicle V enters a facility located facing the road, if a sidewalk is provided between the lane and the facility, the sidewalk facing the facility becomes the intersection area. That is, when a pedestrian is walking on the sidewalk between the facility and the lane, if the vehicle V enters the facility, the vehicle V will come into contact with the pedestrian, and thus the sidewalk becomes the intersection area.
[0055] exist Figure 2A In the driving scenario shown, if there are other vehicles at the intersection X, if the vehicle V enters the intersection X, the vehicle V may come into contact with the other vehicles. Therefore, the intersection X becomes an intersection area. In addition, if a pedestrian or a bicycle crosses the crosswalk C1 when the vehicle V enters the intersection X, the vehicle V may come into contact with the pedestrian or the bicycle. Therefore, the crosswalk C1 becomes an intersection area. Similarly, when the vehicle V turns left at the intersection X, the crosswalk C2 becomes an intersection area, and when the vehicle V turns right at the intersection X, the crosswalk C3 becomes an intersection area.
[0056] The recognition unit 22 has a driving environment recognition function for recognizing the driving environment around the vehicle V. The driving assistance device 19 obtains the detection results of the camera device 11 and the distance measuring device 12 through the driving environment recognition function of the recognition unit 22, performs pattern matching and sensor fusion processing on the obtained detection results, and recognizes the driving environment of the vehicle V. For example, the driving assistance device 19 detects other vehicles traveling around the vehicle V based on the detection results of the camera device 11, detects the distance from the vehicle V to the other vehicles and the direction of the other vehicles relative to the vehicle V based on the detection results of the distance measuring device 12, and recognizes the position of the other vehicles relative to the vehicle V. In addition, the driving assistance device 19 detects a pedestrian crossing the crosswalk in front of the vehicle V based on the detection results of the camera device 11, detects the distance from the vehicle V to the pedestrian based on the detection results of the distance measuring device 12, and recognizes the position of the other vehicles relative to the vehicle V.
[0057] Sometimes, a traffic light is installed at the intersection X, which is an intersection area. In order to recognize the state of the traffic light as the driving environment, the driving assistance device 19 determines whether there is a traffic light in front of the vehicle V based on the detection result of the camera 11 and the map information 14 through the driving environment recognition function of the recognition unit 22. Then, when it is determined that there is a traffic light in front of the vehicle V, the state of the traffic light is detected as the driving environment. The state of the traffic light is, for example, the state of the light of the traffic light, specifically, the state of the traffic light is red (that is, the state in which the vehicle V must stop in front of the intersection X), the state of the traffic light is yellow (that is, the state in which the vehicle V cannot enter the intersection X except when it cannot stop), and the state of the traffic light is green (that is, the state in which the vehicle V can enter the intersection X). The state of the traffic light is detected based on the image acquired by the camera 11.
[0058] exist Figure 2A In the case of the driving scene shown, the driving assistance device 19 detects the preceding vehicle and the following vehicle traveling in lane L1, the oncoming vehicle traveling in lane L2, and the vehicles traveling in lanes L3 and L4 as other vehicles through the driving environment recognition function of the recognition unit 22. Then, the positions of other vehicles traveling around the vehicle V are recognized based on the direction and distance of the other vehicles relative to the vehicle V. Figure 2A In the illustrated driving scenario, another vehicle Z that is parked at a position P5 in front of the crosswalk C2 in the lane L3 is recognized as another vehicle traveling around the vehicle V.
[0059] In addition, the driving assistance device 19 detects pedestrians crossing the crosswalks C1, C2, and C3, and recognizes the presence of pedestrians as the driving environment of the vehicle V. Figure 2AIn the driving scene shown, pedestrian Y1 about to cross the crosswalk C1 and pedestrian Y2 crossing the crosswalk C3 are detected, so pedestrians Y1 and Y2 are recognized as pedestrians around the vehicle V. Furthermore, the driving assistance device 19 determines whether a traffic light is installed at the intersection X. Figure 2A In the driving scenario shown, since no traffic light is installed at the intersection X, it is recognized that no traffic light exists at the intersection X.
[0060] The determination unit 23 has a passing determination function for determining whether the vehicle V can pass through the intersection area based on the driving environment of the vehicle V recognized by the driving environment recognition function. The driving assistance device 19 determines whether there is an obstacle in the intersection area through the passing determination function of the determination unit 23, and when it is determined that there is no obstacle in the intersection area, it is determined that the vehicle V can pass through the intersection area. On the other hand, when it is determined that there is an obstacle in the intersection area, it is determined that the vehicle V cannot pass through the intersection area.
[0061] In addition, the driving assistance device 19 determines whether a traffic light is provided in the intersection area (specifically, the intersection X) through the passing determination function of the determination unit 23. The driving assistance device 19 obtains the position information of the traffic light from the map information 14, for example, and compares the position of the intersection area with the position of the traffic light to determine whether a traffic light is provided in the intersection area. Then, when it is determined that a traffic light is provided in the intersection area (specifically, the intersection X), it is determined whether the state of the traffic light is a state indicating a stop. When it is determined that the state of the traffic light is a state indicating a stop (i.e., a red light state), it is determined that the vehicle V cannot pass through the intersection area, and when it is determined that the state of the traffic light is not a state indicating a stop (i.e., a green light state), it is determined that the vehicle V can pass through the intersection area.
[0062] In addition, for the yellow light state, it is determined whether the vehicle V can stop in front of the intersection X based on the driving state of the vehicle V (particularly the driving speed of the vehicle V) and the distance from the vehicle V to the intersection area (intersection X). In the case where it is determined that the vehicle V cannot stop in front of the intersection X, the driving assistance device 19 determines that the state of the signal light is not a state that indicates stopping, and the vehicle V can pass through the intersection area (intersection X). In contrast, in the case where it is determined that the vehicle V can stop in front of the intersection area (intersection X), the driving assistance device 19 determines that the state of the signal light is a state that indicates stopping, and the vehicle V cannot pass through the intersection area.
[0063] Therefore, when it is necessary to determine the presence or absence of an obstacle and the state of the signal light in the intersection area, such as at an intersection with a signal light, the driving assistance device 19 determines that the vehicle V can pass through the intersection area when it is determined that there is no obstacle in the intersection area and the state of the signal light is not a state indicating a stop. On the other hand, when it is determined that there is an obstacle in the intersection area or when it is determined that the state of the signal light is a state indicating a stop, the driving assistance device 19 determines that the vehicle V cannot pass through the intersection area. The determination of the presence or absence of an obstacle in the intersection area and the state of the signal light may be performed simultaneously, or the state of the signal light may be determined first, and then the presence or absence of an obstacle in the intersection area may be determined.
[0064] As mentioned above, in Figure 2A In the driving scene shown, the driving assistance device 19 recognizes that the intersection X and the crosswalks C1 and C2 are intersection areas, and no traffic lights are installed at the intersection X. Figure 2A In the driving scenario shown, since there is no traffic light at the intersection X, the driving assistance device 19 determines whether there are obstacles at the intersection X and the crosswalks C1 , C2 , and C3 .
[0065] For the presence or absence of obstacles, as mentioned above, Figure 2A In the driving scene shown, the driving assistance device 19 recognizes that there is another vehicle Z parked at position P5 in front of the crosswalk C2 in lane L3, a pedestrian Y1 about to cross the crosswalk C1, and a pedestrian Y2 currently crossing the crosswalk C3. Based on this recognition, the driving assistance device 19 determines that there are pedestrians Y1 and Y2 at the crosswalks C1 and C3, respectively, and the vehicle V cannot pass through the crosswalks C1 and C3. In addition, the driving assistance device 19 determines that there is a possibility that another parked vehicle Z may enter the crosswalks C1 to C3 and the intersection X. Therefore, in Figure 2A In the driving scenario shown, the driving assistance device 19 determines that the vehicle V cannot pass through the intersection area.
[0066] In addition, the driving assistance device 19 determines whether there are multiple intersection areas at one location through the passing determination function of the determination unit 23. The existence of multiple intersection areas at one location means, for example, that multiple intersection areas exist adjacent to each other. Specifically, Figure 2AAs shown in the driving scenario shown in FIG. 1 , when crosswalks C1 to C3 are provided at the intersection X, the driving assistance device 19 determines that there are multiple intersection areas at one location. On the other hand, when only one crosswalk is provided at a location other than an intersection of roads, since there is no intersection area adjacent to the crosswalk as an intersection area, it is determined that there are no multiple intersection areas at one location. Examples of the absence of multiple intersection areas (i.e., the presence of only one intersection area) include a location where a crosswalk is provided in front of a facility facing a road for the convenience of the facility users.
[0067] The notification unit 24 has a notification function of notifying the vehicle-mounted terminal and / or electronic terminal in the vehicle V whether the vehicle V can pass through the intersection area. The vehicle-mounted terminal and electronic terminal of the vehicle V are, for example, the display device 18, but are not limited thereto, and include a display portion of the instrument panel, a terminal for providing information to the occupants of the vehicle V when the driving assistance of the above-mentioned assistance level 3 or 4 is performed, etc. The driving assistance device 19 uses the vehicle-mounted terminal and / or electronic terminal in the vehicle V to notify the occupants of the vehicle V whether the vehicle V can pass through the intersection area through the notification function of the notification unit 24. In addition, the driving assistance device 19 repeatedly performs the passing determination processing based on the passing determination function while the vehicle V travels from the current position to the intersection area. Then, according to the obtained determination result, the information provided to the vehicle-mounted terminal and / or electronic terminal in the vehicle V (that is, the occupants of the vehicle V) is changed.
[0068] The information provided by the driving assistance device 19 to the occupants of the vehicle V specifically includes: information indicating whether an obstacle is being determined in the intersection area, information indicating the type of obstacles (i.e., traffic participants) in the intersection area, information indicating the light state of the traffic lights set in the intersection area, and information indicating whether the vehicle V can pass through the intersection area. These information are displayed on the display device 18 for the purpose of showing it to the occupants of the vehicle V, but can also be output as voice from the speaker provided by the display device 18 instead. For example, when the vehicle V approaches the intersection area, the occupants are notified that the vehicle V is approaching the intersection area with a voice such as "It is about to be an intersection". In addition, when the vehicle V can pass through the intersection area, the occupants are notified with a voice such as "The intersection ahead can be passed directly". The voice can use a recorded voice or a synthesized voice.
[0069] This information may also be displayed together with the distance from the vehicle V to the intersection area. Alternatively or in addition to this, this information may also be displayed at the position of the intersection area on the driving path R displayed by the display device 18. Alternatively or in addition to this, this information may also be displayed superimposed on the image outside the vehicle obtained from the camera device 11. In addition, the display device 18 that displays this information includes not only a display mounted on the vehicle V, but also a display of a terminal owned by an occupant of the vehicle V. In addition, in the case where the driving assistance device 19 performs all driving tasks of the vehicle V and the supervisor monitors the driving of the vehicle V at a remote location away from the vehicle V, as in an unmanned taxi, the above information may also be displayed on a display possessed by the terminal used to monitor the driving of the vehicle V.
[0070] exist Figure 2A In the driving scene shown, as described above, the driving assistance device 19 determines that the crosswalk C1 cannot be passed due to the presence of the pedestrian Y1. Based on the determination result, the driving assistance device 19 notifies the occupants of the vehicle V through the notification function of the notification unit 24 that the vehicle will stop in front of the crosswalk C1 because the crosswalk C1 cannot be passed. The driving assistance device 19 notifies the occupants of the vehicle V of the stop in front of the crosswalk C1 by, for example, changing the color of the display portion of the driving path R displayed on the display device 18. Figure 2A On the driving path R shown, as an example, the portion of the displayed portion of the driving path R up to the pedestrian crossing C1 is marked with lighter hatching as a drivable portion, and the pedestrian crossing C1 and the portion forward from the pedestrian crossing C1 are marked with darker hatching as a non-drivable portion.
[0071] Based on this, the driving assistance device 19 displays on the display device 18 Figure 2A The image (icon) I1 with the word "STOP" shown in the image (icon) I1 notifies the occupants that the vehicle V has stopped in front of the crosswalk C1. The position where the image I1 is displayed is the position of the intersection X on the travel path R displayed on the display device 18. Alternatively or in addition, the driving assistance device 19 may output a voice message "Stop in front of the crosswalk ahead" from the speaker of the display device 18 to notify the occupants that the vehicle V has stopped in front of the crosswalk C1.
[0072] After the driving assistance device 19 notifies the occupant of the vehicle stopping in front of the crosswalk C1 through the above-mentioned display and voice, the vehicle V is driven along the driving path R through the driving assistance function of the assistance unit 20. Specifically, the driving speed of the vehicle V is controlled by the vehicle speed control device 171 of the vehicle control device 17, so that the vehicle V stops in front of the crosswalk C1. During this period, the steering wheel of the vehicle V is also controlled by the steering control device 172.
[0073] Figure 2B This is an example of an image displayed on the display device 18 when the vehicle V stops in front of the crosswalk C1. Figure 2B In the driving scene shown, pedestrian Y1 is walking at position P1a of crosswalk C1 toward position P2. In addition, pedestrian Y2 is walking at position P3a of crosswalk C3 toward position P4. The driving assistance device 19 identifies the positions of pedestrians Y1 and Y2 based on the detection results of the camera device 11 and the distance measuring device 12. Then, the driving assistance device 19 determines that the vehicle V cannot pass through the crosswalks C1 and C3 because pedestrians Y1 and Y2 are respectively present on the crosswalks C1 and C3. The driving assistance device 19 controls the driving action of the vehicle V via the vehicle control device 17 to maintain the parking state of the vehicle V.
[0074] In addition, Figure 2B In the driving scene shown, another vehicle Z is parked at position P5 in lane L3. The driving assistance device 19 recognizes the other vehicle Z parked at position P5 and infers that Figure 2B In the driving scenario shown, other vehicle Z continues to park at the same Figure 2A The main reason for the same driving scene as shown in the position P5. Figure 2B In the driving scenario shown, the driving assistance device 19 infers that the vehicle Z stops in front of the crosswalk C2 to avoid stopping at the intersection X. When the other vehicle Z is traveling straight at the intersection X, it stops in front of the crosswalk C3 to avoid contact with the pedestrian Y2. When the other vehicle Z is turning right at the intersection X, it stops in front of the crosswalk C1 to avoid contact with the pedestrian Y1. That is, this is because the other vehicle Z needs to stop at the intersection X whether traveling straight or turning right.
[0075] Figure 2C This is an example of an image displayed on the display device 18 after the vehicle V stops in front of the crosswalk C1 and the pedestrians Y1 and Y2 respectively cross the crosswalks C1 and C3. Figure 2C In the driving scene shown, pedestrian Y1 walks at position P2, and pedestrian Y2 walks at position P4. The driving assistance device 19 recognizes the positions of pedestrians Y1 and Y2 based on the detection results of the camera device 11 and the distance measuring device 12. Then, since there are no obstacles on the crosswalks C1 and C3, the driving assistance device 19 determines that the vehicle V can pass through the crosswalks C1 and C3.
[0076] In addition, Figure 2C In the driving scene shown, another vehicle Z is parked at position P5 in lane L3. The driving assistance device 19 recognizes the other vehicle Z parked at position P5 and determines Figure 2CIn the driving scene shown, whether another vehicle Z starts and enters the intersection X. The driving assistance device 19 infers that Figure 2B In the driving scenario shown, another vehicle Z needs to stop at the intersection X to avoid contact with pedestrians Y1 and Y2, so it stops in front of the crosswalk C2. Figure 2C In the driving scenario shown, pedestrians Y1 and Y2 have already crossed the crosswalk, and the other vehicle Z does not need to stop at the intersection X to avoid contact with the pedestrians Y1 and Y2. Therefore, the driving assistance device 19 determines that the other vehicle Z starts and enters the intersection X. In contrast, when obstacles other than the pedestrians Y1 and Y2 exist at the intersection X and the crosswalks C1 to C3, the driving assistance device 19 determines that the other vehicle Z continues to stop in front of the crosswalk C2.
[0077] Driving assistance device 19 Figure 2C In the driving scenario shown, as described above, the driving action of the vehicle V is autonomously controlled by the vehicle control device 17 so that the vehicle V starts after the other vehicle Z passes the intersection X. This is to reliably avoid contact between the vehicle V and the other vehicle Z. However, the occupants of the vehicle V Figure 2C In the driving scenario shown, if pedestrians Y1 and Y2 cross the crosswalk, the vehicle V is expected to start. Figure 2C The intersection X shown is not equipped with a traffic light, so the occupants of the vehicle V believe that if there are no obstacles at the intersection X and the crosswalks C1 and C3 on the travel path R of the vehicle V, the intersection X can be passed. Figure 2C In the driving scene shown, the occupants of vehicle V are Figure 2B Pedestrian Y2 moves from position P1a to position P2. Figure 2B During the period from the position P3a shown to the position P4, the vehicle V is in a state of waiting to start inside the vehicle. Therefore, it is more strongly expected that the vehicle V will start if the pedestrians Y1 and Y2 cross the crosswalk.
[0078] However, in Figure 2C In the driving scenario shown, even if pedestrians Y1 and Y2 cross the crosswalk, the image I1 notifying the occupants that the vehicle V has stopped continues to be displayed on the display device 18, and the vehicle V continues to stop. This is because, as described above, the driving assistance device 19 determines that another vehicle Z has entered the intersection X, and controls the vehicle V to start after the other vehicle Z has passed the intersection X. At this time, the occupants of the vehicle V will not properly perform the autonomous driving control based on the driving assistance device 19 because the vehicle V continues to stop contrary to expectations, and as a result, they will feel uneasy about whether the vehicle V is stopped or not. In particular, in a case such as Figure 2CIn a place where there is no traffic light, such as the intersection X shown in the figure, and there are crosswalks C1 to C3 in addition to the intersection X, it is necessary to determine whether the vehicle can pass through multiple intersections in a relatively short time. This is because if all the intersections are not determined to be passable, the vehicle V cannot start. Figure 2C In the driving scene shown, it is difficult for the occupants of the vehicle V to intuitively understand the main reason for the parking of the vehicle V, and the occupants are likely to feel uneasy. In addition, if the start of another vehicle Z is delayed or another vehicle Z is a parked vehicle, the start of the vehicle V will also be delayed, and the occupants of the vehicle V will feel uneasy.
[0079] Therefore, in order to suppress the feeling of uneasiness felt by the occupants, the notification unit 24 of the present embodiment has a function of notifying the occupants of the vehicle V of the main reason why the vehicle V cannot pass through the intersection area when the vehicle V has been stopped for longer than a predetermined time, when the determination unit 23 determines that the vehicle V cannot pass through the intersection area. When the determination unit 23 determines that the vehicle V cannot pass through the intersection area, the driving assistance device 19 acquires the stopping time of the vehicle V through the notification function of the notification unit 24. Then, when the vehicle V has been stopped for longer than a predetermined time, the occupants of the vehicle V are notified of the main reason why the vehicle V cannot pass through the intersection area. In contrast, when the vehicle V has been stopped for less than the predetermined time, the occupants of the vehicle V are not notified of the main reason why the vehicle V cannot pass through the intersection area.
[0080] The parking time of the vehicle V refers to the time that has passed since the vehicle V stopped in front of the intersection area determined to be impassable. Whether the vehicle V has stopped is determined based on, for example, the running speed of the vehicle V obtained from the state detection device 13 and the position information of the vehicle V obtained from the position detection device 15. Specifically, when the running speed of the vehicle V obtained from the state detection device 13 is 0 km / h and the position information of the vehicle V obtained from the position detection device 15 has not changed, it is determined that the vehicle V has stopped. The driving assistance device 19 stores the time when the driving assistance function of the assistance unit 20 determines that the vehicle V has stopped in the RAM 193 or the like. Then, as needed, the time that has passed since the time when the vehicle V was determined to have stopped is obtained as the parking time.
[0081] The prescribed time as a reference for notifying the main reason for stopping can be set to an appropriate value within a range where the occupants of the vehicle V do not feel uneasy when the occupants of the vehicle V cannot grasp the main reason for stopping the vehicle V. For example, the time when the state of the traffic light is in a state indicating stopping (i.e., a red light state) is generally set as the prescribed time. Alternatively, the parking time required for passing each intersection area is recorded, and the average value of the parking time recorded for each intersection area is set as the prescribed time. In addition, alternatively, the time at which the occupants do not feel uneasy and wait for starting can be obtained in advance through experiments, and the parking time obtained through the experiments is set as the prescribed time.
[0082] The main reason why the vehicle V cannot pass through the intersection area is other moving objects existing in the intersection area determined to be impassable to the vehicle V. For example, bicycles and pedestrians walking on the crosswalk, other vehicles and motorcycles existing in the intersection, etc.
[0083] exist Figure 2C In the driving scenario shown, it is assumed that Figure 2B In the driving scenario shown, a predetermined time has passed after the vehicle V stopped. In this case, the driving assistance device 19 determines that the vehicle V cannot pass through the crosswalk C1 using the passing determination function of the determination unit 23, so the stopping time of the vehicle V is acquired through the notification function of the notification unit 24. In addition, since the stopping time of the vehicle V has exceeded the predetermined time, the main reason why the vehicle V cannot pass through the intersection X is notified to the occupants of the vehicle V that the other vehicle Z has started. As described above, this is because the driving assistance device 19 determines that the other vehicle Z has started and entered the intersection X.
[0084] When the driving assistance device 19 notifies the vehicle V of the main reason that it cannot pass through the intersection area through the notification function of the notification unit 24, for example, Figure 2C As shown, the display portion of the other vehicle Z is emphasized by the image I2 of the dotted rectangle. In this way, when the display device 18 is used to notify the main reason why the vehicle V cannot pass through the intersection area, the driving assistance device 19 changes the color of the display portion of the main reason to emphasize it. Alternatively or in addition to this, the driving assistance device 19 surrounds the display portion of the main reason with a rectangular or circular image. Alternatively or in addition to this, the driving assistance device 19 outputs a voice "Stop because of the other vehicle Z on the left side ahead" from the speaker of the display device 18 to notify the occupant of the main reason for stopping. When changing the color of the display portion of the main reason, the driving assistance device 19 changes from the original color to a more noticeable color (for example, red).
[0085] When notifying the main reason why the vehicle V cannot pass through the intersection X, the driving assistance device 19 continues to notify the main reason until it is determined that the vehicle V can pass through the intersection. Figure 2C In the driving scene shown, until it is determined that the other vehicle Z has passed the intersection X and the vehicle V can enter the intersection X, the image I2 is used to increase the emphasis and display the other vehicle Z. In addition, when there are multiple main reasons why the vehicle V cannot pass through the intersection area, it is determined whether the vehicle V can pass through the intersection area for each main reason, and the notification of each main reason is continuously performed according to the determination result of each main reason. Figure 2C In the driving scenario shown, when the pedestrian Y1 and other vehicles Z are the main reasons why the vehicle V cannot pass through the intersection X, it is determined whether the pedestrian Y1 and other vehicles Z become obstacles when entering the intersection X. And, while it is determined that the pedestrian Y1 and other vehicles Z are the main reasons why the vehicle V cannot pass through the intersection X, they are respectively highlighted and displayed. Then, when it is determined that the pedestrian Y1 does not become an obstacle when entering the intersection X, and only the other vehicles Z are the main reasons why the vehicle V cannot pass through the intersection X, the display of the pedestrian Y1 is restored to the normal display, and only the other vehicles Z are continued to be highlighted and displayed.
[0086] In addition, when the driving assistance device 19 uses the display device 18 to notify the main reason why the vehicle V cannot pass through the intersection area through the notification function of the notification unit 24, the driving assistance device 19 reduces the contrast of the display portion of the driving path R in the portion further forward than the intersection area relative to the surrounding display portion of the driving path R. Alternatively or in addition to this, the driving assistance device 19 increases the contrast of the display portion of the intersection area relative to the display portion of the driving path R. Alternatively or in addition to this, the driving assistance device 19 increases the emphasis of the display portion of the intersection area. For example, Figure 2C In the driving scene shown, for the portion of the displayed portion of the driving path R that is ahead of the crosswalk C3, the contrast with respect to the displayed portion of the lane L3 is reduced. Alternatively or in addition to this, for the displayed portion of the crosswalks C1 and C3 and the intersection X, the contrast with respect to the driving path R is increased, and the emphasis degree of the rectangular image surrounding is increased.
[0087] More specifically, the driving assistance device 19 reduces the contrast of the display portion of the intersection area with respect to the display portion of the travel path R, and increases the emphasis of the display portion of the main reason why the vehicle V cannot pass through the intersection area. Figure 2CIn the driving scene shown, the image I2 emphasizes the other vehicle Z more, and the contrast of the displayed portion of the crosswalks C1 and C3 and the intersection X is reduced relative to the displayed portion of the driving path R. This can more emphatically display the main reason why the vehicle V cannot pass through the intersection area.
[0088] In order to prevent the occupants of the vehicle V from feeling uncomfortable due to excessive emphasis on the main reason, the driving assistance device 19 may also notify the main reason from the moment when the parking time of the vehicle V exceeds the prescribed time when it is determined that the vehicle V cannot pass through the intersection area. In addition, when the main reason is an obstacle such as another vehicle Z, the driving assistance device 19 classifies the obstacle into stationary obstacles and other obstacles through the driving environment recognition function of the recognition unit 22. Moreover, the stationary obstacles and other obstacles may also be notified in different ways. A stationary obstacle refers to an obstacle set in place, which is an object that does not move itself. When a stationary obstacle is the main reason for parking, the vehicle V cannot continue to travel along the driving path R unless it avoids the stationary obstacle. Therefore, by setting the display mode different from other obstacles, the occupants of the vehicle V are urged to perform operations to avoid the obstacle.
[0089] Figure 2D This is an example of an image displayed on the display device 18 when another vehicle Z starts and passes through the crosswalk C2, the intersection X, and the crosswalk C3. Figure 2D In the driving scenario shown, the other vehicle Z starts from position P5, goes straight at intersection X and drives to position P6. It is assumed that pedestrians Y1 and Y2 are walking outside the screen of the display device 18. In this case, the driving assistance device 19 recognizes that the other vehicle Z is driving at position P6 based on the detection results of the camera device 11 and the distance measuring device 12, and determines that the other vehicle Z has passed the intersection X. Next, obstacles at the intersection X and the crosswalks C1 and C3 on the driving path R are detected, and it is determined whether there are obstacles at the intersection X and the crosswalks C1 and C3. Figure 2D In the illustrated driving scene, no object that becomes an obstacle to the vehicle V is detected, so it is determined that the vehicle V can pass through the intersection X. Accordingly, the display of the image I1 that notifies the occupant that the vehicle V has stopped is stopped (is not displayed).
[0090] When the driving assistance device 19 determines that the vehicle V can pass through the intersection area, it changes the display portion of the intersection area on the display device 18. Alternatively or in addition to this, the driving assistance device 19 superimposes the display portion of the intersection area with the display portion of the intersection area to display that the vehicle V can pass through the intersection area. Figure 2DIn the driving scene shown, for example, the emphasis of the display portion of the intersection X is reduced, and an image indicating that the intersection X can be passed is superimposed and displayed on the display portion of the intersection X. Alternatively or in addition to this, the color of the display portion of the driving path R is changed. For example, Figure 2D The color of the displayed portion of the driving route R shown is changed from dark-shaded lines indicating a portion that cannot be driven to light-shaded lines indicating a portion that can be driven.
[0091] Figure 2E An example of a driving route R with the color of the displayed portion changed is shown. Figure 2E In the driving scenario shown, the vehicle V starts from a parking position in front of the crosswalk C1 and enters the intersection X. The driving assistance device 19 causes the vehicle V to travel along the driving path R through the driving assistance function of the assistance unit 20. The vehicle V passes through the intersection X and the crosswalks C1 and C3 through autonomous driving control by the control of the drive device and the steering device via the vehicle control device 17, and reaches the destination Px.
[0092] (Processing in driver assistance systems)
[0093] Reference Figure 3A~3D , the order in which the driving assistance device 19 processes information is described. Figures 3A to 3D This is an example of a flowchart showing information processing executed in the driving assistance system 10 of the present embodiment. The processing described below is executed at predetermined time intervals by the CPU 191 which is a processor of the driving assistance system 19 .
[0094] First, in Figure 3A In step S1, the driving path R is obtained from the navigation device 16 by the intersection area acquisition function, and in the following step S2, the area where other mobile bodies can move is obtained from the map information 14, and in the following step S3, the intersection area is obtained. Then, in step S4, the current position of the vehicle V is obtained from the position detection device 15 by the driving environment recognition function, and in the following step S5, the driving path R is displayed on the display device 18 by the notification function. Then, in step S6, it is determined whether the vehicle V can travel to the intersection area by autonomous driving control. In the case where there is an unavoidable obstacle in front of the vehicle V, or when it is determined that the vehicle V cannot travel to the intersection area by autonomous driving control, the execution of the program is terminated and the control is switched to manual driving by the driver. In contrast, in the case where it is determined that the vehicle V can travel to the intersection area by autonomous driving control, the program proceeds to step S7.
[0095] In step S7, the notification function is used to display information on the display device 18 that the vehicle can travel to the front of the intersection area. In the following step S8, the driving assistance function is used to make the vehicle V travel along the set driving path R. In step S9, it is determined whether the distance from the vehicle V to the intersection area is less than the prescribed distance. In the case where it is determined that the distance from the vehicle V to the intersection area is longer than the prescribed distance, the process proceeds to step S8, and the vehicle V continues to travel along the driving path R until the distance from the vehicle V to the intersection area becomes less than the prescribed distance. In contrast, in the case where it is determined that the distance from the vehicle V to the intersection area is less than the prescribed distance, the process proceeds to step S10.
[0096] In step S10, the through-judgment function is used to determine whether a traffic light is installed in the intersection area. If it is determined that a traffic light is installed in the intersection area, the Figure 3B On the other hand, if it is determined that there is no traffic light at the intersection, the Figure 3C In the following description, it is assumed that the intersection area determined to be provided with a traffic light is an intersection X provided with a crosswalk.
[0097] exist Figure 3A If it is determined in step S10 that a traffic light is provided at the intersection, Figure 3B Step S21. Figure 3B In step S21, the passing judgment function is used to determine whether the state of the traffic light indicates stopping. If it is determined that the state of the traffic light indicates stopping, the process proceeds to step S22, and the vehicle V is driven along the set driving path R. In the following step S23, it is determined whether the vehicle V has reached the crosswalk. If it is determined that the vehicle V has not reached the crosswalk, the process proceeds to step S21, and the vehicle continues to drive along the driving path R and detects the state of the traffic light. On the other hand, if it is determined that the vehicle V has reached the crosswalk, the process proceeds to step S24, and the vehicle V is stopped in front of the crosswalk. Then, the process proceeds to step S21, and the state of the traffic light is detected.
[0098] In step S21, if it is determined that the state of the traffic light is not an instruction to stop, the process proceeds to step S25. In step S25, it is determined whether the vehicle V is going straight at the intersection X. If it is determined that the vehicle V is going straight at the intersection X, the process proceeds to step S26 to detect obstacles existing at the intersection X, and in the following step S27, it is determined whether the vehicle V can pass through the intersection X. If it is determined that the vehicle V can pass through the intersection X, the process proceeds to step S40 to make the vehicle V travel along the driving path R and pass through the intersection X. In contrast, if it is determined that the vehicle V cannot pass through the intersection X, the process proceeds to step S26 to repeatedly detect obstacles. In addition, if the vehicle has arrived at the intersection X, the vehicle V is stopped in front of the intersection X.
[0099] On the other hand, if it is determined in step S25 that the vehicle V is not going straight at the intersection X, it is determined in step S28 whether the vehicle V is turning right at the intersection X. If it is determined that the vehicle V is turning right at the intersection X, the process proceeds to step S29. On the other hand, if it is determined that the vehicle V is not turning right (i.e., turning left) at the intersection X, the process proceeds to step S34.
[0100] In step S29, the notification function is used to display on the display device 18 that the vehicle can travel to the center of the intersection X. In the following step S30, the driving assistance function is used to drive the vehicle V to the center of the intersection X. In step S31, the driving environment recognition function is used to detect the oncoming vehicle based on the detection results of the camera device 11 and the distance measuring device 12. In the following step S32, it is determined whether the oncoming lane can be passed. In the case where it is determined that there is no oncoming vehicle and the oncoming lane can be passed, the process proceeds to step S34. In contrast, in the case where it is determined that there is an oncoming vehicle and the oncoming lane cannot be passed, the process proceeds to step S33 and the vehicle V is stopped in the center of the intersection X. Then, the process proceeds to step S31 to detect the oncoming vehicle again.
[0101] When it is determined that the vehicle can pass through the oncoming lane and the process proceeds to step S34, the notification function is used to display on the display device 18 the position in front of the crosswalk to which the vehicle can travel. In the following step S35, the vehicle V is driven to the position in front of the crosswalk. In the following step S36, pedestrians and bicycles crossing the crosswalk are detected, and in step S37, it is determined whether the crosswalk can be passed. When it is determined that the crosswalk can be passed without pedestrians and bicycles, the process proceeds to step S39, and after the display device 18 displays that the intersection X can be passed, the process proceeds to step S40. In contrast, when it is determined that the crosswalk cannot be passed due to the presence of pedestrians and bicycles, the process proceeds to step S38, and the vehicle V is stopped in front of the crosswalk. Then, the process proceeds to step S36, and pedestrians and bicycles are detected again.
[0102] On the other hand, Figure 3A If it is determined in step S10 that there is no traffic light at the intersection, Figure 3C Step S51. Figure 3C In step S51, the passing judgment function is used to judge whether there are multiple intersection areas in front of the vehicle V. If it is judged that there are multiple intersection areas in front of the vehicle V, the process proceeds to step S52. Figure 3D In contrast, if it is determined that there are no multiple intersection areas in front of the vehicle V, the process proceeds to step S52. In step S52, obstacles existing in the intersection area are detected by the driving environment recognition function, and in the following step S53, it is determined whether the intersection area can be passed by the passing determination function.
[0103] If it is determined that the vehicle can pass through the intersection area, the process proceeds to step S56, and the notification function is used to display information that the vehicle can pass through the intersection area on the display device 18. In the following step S57, the driving assistance function is used to make the vehicle V travel in a manner to pass through the intersection area. On the other hand, if it is determined that the vehicle cannot pass through the intersection area, the process proceeds to step S54, and it is determined whether it is necessary to stop in front of the intersection area. If it is determined that it is not necessary to stop, the process proceeds to step S52, and obstacle detection is performed again. On the other hand, if it is determined that it is necessary to stop, the process proceeds to step S55, and the vehicle V is stopped in front of the intersection area, and the process proceeds to step S52.
[0104] exist Figure 3C In step S51, if it is determined that there are multiple intersection areas in front of the vehicle V, the vehicle V is entered into the Figure 3D Step S61. Figure 3D In step S61, the obstacle existing in the intersection area is detected by the driving environment recognition function, and in the following step S62, it is determined whether the intersection area can be passed by the passing judgment function. If it is determined that the intersection area can be passed, the process proceeds to step S69, and the notification function is used to display on the display device 18 that the intersection area can be passed. In the following step S70, the driving assistance function is used to make the vehicle V travel in a manner to pass through the intersection area.
[0105] On the other hand, if it is determined that the vehicle cannot pass through the intersection area, the process proceeds to step S63 to determine whether it is necessary to stop the vehicle before the intersection area. If it is determined that it is not necessary to stop the vehicle, the process proceeds to step S61 to detect obstacles again. On the other hand, if it is determined that it is necessary to stop the vehicle, the process proceeds to step S64 to stop the vehicle V before the intersection area.
[0106] After the vehicle V is parked in front of the intersection area, in step S65, it is determined by the notification function whether the parking time of the vehicle V is longer than the prescribed time. If it is determined that the parking time of the vehicle V is longer than the prescribed time, the process proceeds to step S66, and the obstacles in the intersection area are classified into stationary obstacles and other obstacles. In the next step S67, the main reason for parking is identified, and in step S68, the main reason for parking is displayed on the display device 18. Then, the process proceeds to step S61, and obstacle detection is performed again. In contrast, if it is determined that the parking time of the vehicle V is less than the prescribed time, the process proceeds to step S61, and obstacle detection is performed again.
[0107] (Embodiment of the present invention)
[0108] As described above, the present embodiment provides an information providing device, comprising: an acquisition unit 21 that acquires an intersection area that intersects with an area where other mobile bodies can move on a driving route R set by autonomous driving control; an identification unit 22 that identifies the driving environment around a vehicle V; a determination unit 23 that determines whether the vehicle V can pass through the intersection area based on the driving environment; and a notification unit 24 that, when the determination unit 23 determines that the vehicle V cannot pass through the intersection area, notifies the vehicle-mounted terminal and / or electronic terminal in the vehicle V of the main reason why the vehicle V cannot pass through the intersection area when the vehicle V has been parked for longer than a predetermined time. Thus, the uneasiness felt by the occupants before the vehicle V starts can be suppressed.
[0109] In addition, according to the information providing device of the present embodiment, when notifying the main reason using the display device 18, the notification unit 24 reduces the contrast of the display portion of the intersection area with respect to the display portion of the driving route R, and increases the emphasis of the display portion of the main reason. Thus, the occupant of the vehicle V can intuitively grasp the main reason for the parking of the vehicle V.
[0110] In addition, according to the information providing device of the present embodiment, when the determining unit 23 determines that the vehicle V cannot pass through the intersection area, the notifying unit 24 starts notifying the main reason from the moment when the parking time exceeds the prescribed time. This can prevent the main reason for the parking of the vehicle V from being displayed with excessive emphasis, thereby preventing the occupants of the vehicle V from feeling uncomfortable.
[0111] In addition, according to the information providing device of the present embodiment, when the determination unit 23 determines that the vehicle V can pass through the intersection area, the notification unit 24 changes the display portion of the intersection area of the display device 18, or displays information indicating that the vehicle V can pass through the intersection area in a superimposed manner on the display portion of the intersection area. As a result, the occupant of the vehicle V can intuitively understand that the vehicle V can pass through the intersection area.
[0112] In addition, according to the information providing device of the present embodiment, when notifying the main reason using the display device 18, the notification unit 24 performs at least one of reducing the contrast of the display portion of the driving route R in the portion ahead of the intersection area, increasing the contrast of the display portion of the intersection area with respect to the display portion of the driving route R, and increasing the emphasis of the display portion of the intersection area, for the portion of the display portion of the driving route R that is ahead of the intersection area. As a result, the occupant of the vehicle V can intuitively grasp the main reason for the parking of the vehicle V.
[0113] In addition, according to the information providing device of the present embodiment, the notification unit 24 performs at least one of changing the color of the display portion of the main reason and surrounding the display portion of the main reason with a rectangle or a circle when notifying the main reason using the display device 18. Thus, the occupant of the vehicle V can intuitively grasp the main reason for the parking of the vehicle V.
[0114] In addition, according to the information providing device of the present embodiment, when the main cause is an obstacle, the recognition unit 22 classifies the obstacle into a stationary obstacle and other obstacles, and the notification unit 24 notifies the stationary obstacle and other obstacles in different ways. Therefore, it is possible to encourage the occupant of the vehicle V to perform a driving operation to avoid the stationary obstacle.
[0115] Furthermore, according to the information providing device of this embodiment, the notification unit 24 continues to notify the main reason until the determination unit 23 determines that the vehicle V can pass through the intersection area. Thus, the main reason for parking can be notified to the occupant of the vehicle V more reliably.
[0116] In addition, according to the information providing device of this embodiment, when there are a plurality of the main reasons, the determination unit 23 determines whether the vehicle V can pass through the intersection area for each of the main reasons, and the notification unit 24 continuously notifies each of the main reasons based on the determination result of the determination unit 23. Thus, notification can be made for each main reason for parking.
[0117] In addition, according to the information providing device of the present embodiment, the notification unit 24 displays the main reason on at least one of a display mounted on the vehicle V, a display provided in a terminal for monitoring the travel of the vehicle V, and a display of a terminal of an occupant of the vehicle. Thus, the main reason for parking can also be notified to a person supervising the travel of the vehicle.
[0118] In addition, the present embodiment provides an information providing method, in which the processor acquires an intersection area intersecting with an area where other mobile bodies can move on a driving route R set by autonomous driving control, identifies the driving environment around a vehicle V, determines whether the vehicle V can pass through the intersection area based on the driving environment, and if it is determined that the vehicle V cannot pass through the intersection area, when the vehicle V has been parked for longer than a prescribed time, notifies the main reason why the vehicle V cannot pass through the intersection area to an on-board terminal and / or an electronic terminal in the vehicle V. Thus, the uneasiness felt by the occupants before the vehicle V starts can be suppressed.
[0119] Explanation of symbols
[0120] 10: Driver assistance systems
[0121] 11: Camera device
[0122] 12: Distance measuring device
[0123] 13: Status detection device
[0124] 14: Map information
[0125] 15: Position detection device
[0126] 16: Navigation device
[0127] 17: Vehicle Control Device
[0128] 171: Vehicle speed control device
[0129] 172: Steering Controls
[0130] 18: Display device
[0131] 19: Driving assistance device (information providing device)
[0132] 191: CPU (processor)
[0133] 192: ROM
[0134] 193: RAM
[0135] 20: Auxiliary Department
[0136] 21: Get Department
[0137] 22: Identification Department
[0138] 23: Judgment Department
[0139] 24: Notification Department
[0140] C1, C2, C3: Pedestrian crossing
[0141] I1, I2: Image
[0142] L1, L2, L3, L4: Lanes
[0143] P1, P1a, P2, P3, P3a, P4, P5, P6: Location
[0144] Px: Destination
[0145] R: Driving path
[0146] V: Vehicle (this vehicle)
[0147] X: Intersection
[0148] Y1, Y2: Pedestrians
[0149] Z: Other vehicles
Claims
1. An information providing device, comprising: an acquisition unit that acquires an intersection area that intersects an area where other moving bodies can move on a driving path set by autonomous driving control; A recognition unit that recognizes a driving environment around the vehicle; a determination unit that determines whether the vehicle can pass through the intersection area based on the driving environment; A notification unit, which notifies the main reason why the vehicle cannot pass through the intersection area to the on-board terminal and / or electronic terminal in the vehicle when the determination unit determines that the vehicle cannot pass through the intersection area and the parking time of the vehicle is longer than a specified time.
2. The information providing device according to claim 1, wherein: When notifying the main cause using a display device, the notification unit reduces the contrast of a display portion of the intersection area with respect to a display portion of the travel route and increases the degree of emphasis of the display portion of the main cause.
3. The information providing device according to claim 1 or 2, wherein: When the determination unit determines that the vehicle cannot pass through the intersection area, the notification unit starts notification of the cause from the time when the parking time exceeds the predetermined time.
4. The information providing device according to any one of claims 1 to 3, wherein: When the determination unit determines that the vehicle can pass through the intersection area, the notification unit changes a display portion of the intersection area on a display device or displays information indicating that the vehicle can pass through the intersection area in a superimposed manner on the display portion of the intersection area.
5. The information providing device according to claim 1, wherein: When the notification unit notifies the main cause using the display device, the notification unit performs at least one of the following processes: For a portion of the displayed portion of the travel path that is further forward than the intersection area, reducing the contrast with respect to the surrounding displayed portion of the travel path; increasing the contrast of the displayed portion of the intersection region relative to the displayed portion of the travel path; The emphasis of the displayed portion of the intersection area is increased.
6. The information providing device according to any one of claims 1 to 5, wherein: When notifying the main cause using the display device, the notification unit performs at least one of changing the color of a display portion of the main cause and surrounding the display portion of the main cause with a rectangle or a circle.
7. The information providing device according to any one of claims 1 to 6, wherein: When the main cause is an obstacle, the recognition unit classifies the obstacle into a stationary obstacle and other obstacles. The notification unit notifies the stationary obstacle and other obstacles in different ways.
8. The information providing device according to any one of claims 1 to 7, wherein: The notification unit continues to notify the main cause until the determination unit determines that the vehicle can pass through the intersection area.
9. The information providing device according to claim 8, wherein: The determination unit determines whether the vehicle can pass through the intersection area for each of the main causes when there are a plurality of the main causes. The notification unit continuously performs notification of each main cause based on the determination result of the determination unit.
10. The information providing device according to any one of claims 1 to 9, wherein: The notification unit displays the main cause on at least one of a display mounted on the vehicle, a display provided in a terminal for monitoring travel of the vehicle, and a display of a terminal of an occupant of the vehicle.
11. A method for providing information, executed by a processor, wherein: The processor is caused to perform the following processing: Acquire an intersection area that intersects with an area where other moving objects can move on the driving path set by the autonomous driving control, Identify the vehicle's surrounding driving environment, Based on the driving environment, determining whether the vehicle can pass through the intersection area, When it is determined that the vehicle cannot pass through the intersection area, when the parking time of the vehicle is longer than a specified time, the main reason why the vehicle cannot pass through the intersection area is notified to the vehicle-mounted terminal and / or electronic terminal in the vehicle.
