Display device, display method, and display program for vehicle

By introducing a display device into the vehicle, generating trial travel routes and statistical information, displaying virtual vehicle control actions, solving the problem of difficult prediction of vehicle control actions in the prior art, and improving the driver's response ability and driving safety.

CN119068695APending Publication Date: 2024-12-03TOYOTA JIDOSHA KK
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410661809.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-05-27
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The prior art is difficult to effectively predict and respond to the actions of vehicle control when road conditions change, making it difficult for drivers to identify possible operational changes in the vehicle in advance, especially under autonomous driving and driving assistance control.

Method used

A vehicle display device is designed to generate trial travel routes and related statistical information, display possible vehicle control actions to the driver based on virtual reality technology, and use trial set values ​​and arousal attention information to help the driver identify the vehicle in advance. Possible operational changes.

Benefits of technology

Through the display device, the driver can pre-identify the actions controlled by the vehicle in a virtual environment, improves his ability to respond to changes in road conditions, and enhances driving safety and drivers' confidence in the autonomous driving system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119068695A_ABST
    Figure CN119068695A_ABST
Patent Text Reader

Abstract

The invention provides a vehicle display device, a display method, and a display program. A vehicle display device is provided in a vehicle capable of performing vehicle control including driving assistance control and automatic driving control. A vehicle display device is provided with: a trial travel route generation unit that generates a trial travel route for vehicle control on the basis of map information and a virtual destination of a vehicle; an information acquisition unit that acquires statistical information relating to past vehicle control operations in which past vehicle control operation information and a position on a map are stored in association with each other; a trial result calculation unit that, on the basis of a trial setting value relating to vehicle control and the trial travel route, calculates a trial result relating to an operation of vehicle control in accordance with the trial setting value when the vehicle is caused to travel in a virtual manner along the trial travel route; an image generation unit that generates, on the basis of the statistical information on the trial travel route and the trial result, a trial image for causing the occupant of the vehicle to recognize the attention-attracting information in the statistical information in advance; and a display control unit that causes a display unit of the vehicle to display the trial image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display device, a display method, and a display program for a vehicle.

[0002] This application claims the benefit of Japanese Patent Application No. 2023-090241, filed on May 31, 2023, which is hereby incorporated by reference herein in its entirety. Background Art

[0003] In the past, a system has been disclosed that creates a virtual reality image of a road on which the driver performs virtual reality driving of the vehicle based on detection results of the driver's vehicle operation amount and map information, and displays the virtual reality image to the driver, so that the driver uses virtual reality to practice driving to the destination (for example, Japanese Patent Gazette No. 2019-148677).

[0004] For example, when the vehicle is traveling in a place that the occupant is visiting for the first time, the vehicle control including the driving assistance control and the automatic driving control may perform actions that do not conform to the occupant's intentions depending on the road conditions. Summary of the invention

[0005] A technical solution of the present disclosure is a vehicle display device, which is provided in a vehicle capable of executing vehicle control, the vehicle control including driving assistance control and automatic driving control, and the vehicle display device comprises: a trial route generation unit, which generates a trial route for vehicle control based on map information and a virtual destination of the vehicle; an information acquisition unit, which acquires statistical information related to past vehicle control actions, which stores in association with past vehicle control action information and positions on a map; a trial result calculation unit, which calculates a trial result of the vehicle control action corresponding to the trial setting value when the vehicle is caused to travel along the trial route in a virtual manner, based on the trial setting value related to the vehicle control and the trial route; an image generation unit, which generates a trial image for allowing a vehicle occupant to recognize the attention-calling information in the statistical information in advance based on the statistical information on the trial route; and a display control unit, which causes a display unit of the vehicle to display the trial image.

[0006] According to a vehicle display device involved in a technical solution of the present disclosure, based on a trial route and a trial setting value, a trial result of a vehicle control action corresponding to the trial setting value when the vehicle is virtually driven along the trial route is calculated. A trial image generated based on statistical information on the trial route and the trial result is displayed on a display unit of the vehicle. As a result, the occupant can recognize in advance how the vehicle control will act according to the road conditions by using the attention-calling information on the trial route as a clue.

[0007] In one embodiment, a vehicle display device may also include a notification information storage unit, which stores notification information, the notification information including an attention-calling position and a trial setting value on a trial route corresponding to the attention-calling information, an image generation unit generating a notification image including the trial setting value based on the notification information when the vehicle travels the trial route as an actual vehicle-controlled route, and a display control unit causing the display unit to display the notification image when the vehicle position approaches a position on the map corresponding to the attention-calling position.

[0008] In one embodiment, the trial set value may be a set vehicle speed related to the automatic driving control in the vehicle control, and the attention-calling information may be information about a temporary interruption of the automatic driving control based on the vehicle speed when the vehicle is traveling on a curve during the execution of the automatic driving control.

[0009] Another technical solution disclosed in the present invention is a display method, which is a display method using a vehicle display device, wherein the vehicle display device is arranged in a vehicle capable of performing vehicle control, wherein the vehicle control includes driving assistance control and automatic driving control, and the display method includes: a step of generating a trial route for vehicle control based on map information and a hypothetical destination of the vehicle; a step of obtaining statistical information related to past vehicle control actions, which associates and stores past vehicle control action information and positions on a map; a step of calculating a trial result of the vehicle control action corresponding to the trial setting value when the vehicle is virtually driven along the trial route based on the trial setting value related to the vehicle control and the trial route; a step of generating a trial image for pre-recognizing attention-calling information in the statistical information to the occupants of the vehicle based on the statistical information and the trial result on the trial route; and a step of causing the vehicle's display unit to display the trial image.

[0010] According to another technical solution of the present disclosure, a display method is provided, based on a trial route and a trial setting value, to calculate a trial result of a vehicle control operation corresponding to the trial setting value when the vehicle is virtually driven along the trial route. A trial image generated based on statistical information on the trial route and the trial result is displayed on a display unit of the vehicle. Thus, the occupant can recognize in advance how the vehicle control will operate according to the road conditions by using the attention-calling information on the trial route as a clue.

[0011] Another technical solution of the present disclosure is a display program that causes a computer to function as a vehicle display device, the vehicle display device being provided in a vehicle capable of executing vehicle control, the vehicle control including driving assistance control and automatic driving control, the display program causing the computer to function as a trial route generation unit, an information acquisition unit, a trial result calculation unit, an image generation unit, and a display control unit, the trial route generation unit generating a trial route for vehicle control based on map information and a hypothetical destination of the vehicle, the information acquisition unit acquiring information stored in association with past vehicle trips, and the display control unit. The trial result calculation unit calculates, based on the trial setting values ​​related to the vehicle control and the trial route, the trial result of the vehicle control action corresponding to the trial setting values ​​when the vehicle is virtually driven along the trial route; the image generation unit generates, based on the statistical information on the trial route and the trial result, a trial image for allowing the occupants of the vehicle to recognize the attention-calling information in the statistical information in advance; and the display control unit causes the display unit of the vehicle to display the trial image.

[0012] According to a display program involved in another technical solution of the present disclosure, based on the trial route and the trial setting value, a trial result of the vehicle control action corresponding to the trial setting value when the vehicle is virtually driven along the trial route is calculated. The trial image generated based on the statistical information on the trial route and the trial result is displayed on the display unit of the vehicle. As a result, the occupant can use the attention-calling information on the trial route as a clue to recognize in advance how the vehicle control will act according to the road conditions.

[0013] According to some technical solutions of the present disclosure, the occupant can recognize in advance how the vehicle control will operate according to the road conditions. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a block diagram showing a vehicle including the vehicle display device according to the embodiment.

[0015] Figure 2 This is a diagram for explaining an example of attention-drawing information.

[0016] Figure 3 This is a diagram for explaining another example of attention-drawing information.

[0017] Figure 4 This is a diagram for explaining another example of attention-drawing information.

[0018] Figure 5 This is a flowchart showing an example of the display process of the trial image.

[0019] Figure 6 This is a flowchart showing an example of a display process of a notification image. DETAILED DESCRIPTION

[0020] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. In the following description, the same or corresponding elements are denoted by the same reference numerals, and duplicate descriptions are omitted.

[0021] Figure 1 is a block diagram showing a vehicle equipped with a vehicle display device according to an embodiment. Figure 1 As shown, a vehicle display device 100 is provided in a vehicle 1 capable of executing vehicle control including driving assistance control and automatic driving control. The vehicle 1 is, for example, a passenger car or the like.

[0022] [Vehicle control system configuration]

[0023] The vehicle 1 is equipped with a vehicle control system 2. The vehicle control system 2 is a system that performs vehicle control including driving assistance control and automatic driving control of the vehicle 1. Driving assistance control refers to vehicle control that automatically controls any one or both of the acceleration, deceleration and steering of the vehicle 1 to make the vehicle 1 travel. Driving assistance control includes, for example, at least one of lane tracking assistance, lane keeping control, adaptive cruise control, radar cruise control and road sign assistance. Automatic driving control refers to vehicle control that automatically makes the vehicle 1 travel along the road that the vehicle 1 is to travel without the driver performing driving operations. Automatic driving control may also include at least one of congestion assistance, lane change assistance and overtaking assistance.

[0024] The vehicle control system 2 includes a vehicle control ECU (Electronic Control Unit) 20 , an external sensor 21 , a map database 22 , an internal sensor 23 , a GPS (Global Positioning System) receiver 24 , and an actuator 25 .

[0025] The vehicle control ECU 20 is an electronic control unit having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a CAN (Controller Area Network) communication circuit, etc. The vehicle control ECU 20 controls the hardware based on the signal output by the CPU to realize the functions of the vehicle control ECU 20 described later. As an example of a more specific action, the vehicle control ECU 20 activates the CAN communication circuit to input and output data, stores the input data in the RAM, loads the program stored in the ROM into the RAM, and executes the program loaded into the RAM. The vehicle control ECU 20 may also be composed of multiple electronic units. Part of the functions of the vehicle control ECU 20 may also be executed by a server that can communicate with the vehicle 1.

[0026] The external sensor 21 includes at least one of a camera and a radar sensor. The camera is a photographing device that photographs the conditions around the vehicle 1. The camera is, for example, disposed on the inner side of the front glass window of the vehicle 1 to photograph the front of the vehicle. The radar sensor is a detection device that uses radio waves (such as millimeter waves) or light to detect objects around the vehicle 1. The radar sensor includes, for example, radar (millimeter wave radar) or laser radar (LiDAR: Light Detection and Ranging). The external sensor 21 sends the captured image and detection information about surrounding objects to the vehicle control ECU 20.

[0027] The map database 22 is a database for storing map information. The map database 22 is formed in a recording device such as a HDD (Hard Disk Drive) mounted on the vehicle 1. The map information stored in the map database 22 includes, for example, road location information, road shape information (such as curvature information), intersection and branch point location information, etc. The map information may also include so-called high-precision map information with higher accuracy than the map used for navigation regarding the location and shape of the road.

[0028] The internal sensor 23 is a vehicle-mounted sensor that detects the driving state of the vehicle 1. The internal sensor 23 may also include a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor. As the vehicle speed sensor, the acceleration sensor, and the yaw rate sensor, well-known sensors can be used. The internal sensor 23 sends detection information related to the driving state of the vehicle 1 to the vehicle control ECU 20.

[0029] The GPS receiver 24 receives signals from three or more GPS satellites to measure the position of the vehicle 1 (for example, the latitude and longitude of the vehicle 1 ). The GPS receiver 24 transmits the measured position information of the vehicle 1 to the vehicle control ECU 20 .

[0030] The actuator 25 is a device for driving control of the vehicle 1, and operates according to the control signal from the vehicle control ECU 20. The actuator 25 includes at least a driving actuator, a braking actuator, and a steering actuator. The driving actuator is, for example, provided in an engine or a motor as a power source, and controls the driving force of the vehicle 1. The braking actuator is, for example, provided in a hydraulic brake system, and controls the braking force provided to the wheels of the vehicle 1. The steering actuator is, for example, an auxiliary motor of an electric power steering system, and controls the steering torque of the vehicle 1.

[0031] The vehicle control ECU 20 is configured to be able to recognize the position of the vehicle 1 on the map, the external environment of the vehicle 1 , and the running state of the vehicle 1 .

[0032] The vehicle control ECU 20 recognizes the external environment around the vehicle 1 based on the detection information of the external sensor 21. The external environment includes the position of an object relative to the vehicle 1, the relative speed of an object relative to the vehicle 1, and the moving direction of an object relative to the vehicle 1. Objects include moving objects such as other vehicles around the vehicle 1 and stationary objects such as structures around the vehicle 1. The external environment includes the demarcation lines, road shapes, and passage shapes of toll booths recognized by demarcation line recognition processing based on the detection information of the external sensor 21.

[0033] The vehicle control ECU 20 is configured to be able to acquire map information used for vehicle control. The vehicle control ECU 20 acquires the map information from the map database 22. The vehicle control ECU 20 may acquire the map information from a server that can communicate with the vehicle 1 via a communication network.

[0034] The vehicle control ECU 20 recognizes the running state of the vehicle 1 based on the detection result of the internal sensor 23. The running state includes, for example, the vehicle speed of the vehicle 1, the acceleration of the vehicle 1, and the yaw rate of the vehicle 1.

[0035] The vehicle control ECU 20 obtains the position of the vehicle 1 on the map based on the position information and map information of the GPS receiver 24. The vehicle control ECU 20 may also recognize the position of the vehicle 1 on the map using SLAM (Simultaneous Localization and Mapping) technology.

[0036] The vehicle control ECU 20 generates a travel plan for the vehicle 1 based on the destination, map information, the position of the vehicle 1 on the map, the external environment, and the travel state (vehicle speed, yaw rate, etc.). The destination may be a destination set by the occupants including the driver, or a destination suggested by the vehicle control system 2.

[0037] The vehicle 1's route is the trajectory that the vehicle 1 is scheduled to travel in the future under automatic driving control. The vehicle control ECU 20 calculates a target route (a path in lanes) for the vehicle 1 to the destination based on the destination, the current position of the vehicle 1 on the map, and map information.

[0038] The vehicle control ECU 20 calculates a speed pattern (speed plan) for the vehicle 1 to travel along the route. The vehicle control ECU 20 calculates the speed pattern of the vehicle 1 based on the set speed of the automatic driving control set by the occupant, the speed limit (e.g., the legal maximum speed) included in the map information, the position information of the temporary stop line, the signal, etc. included in the map information, the external environment such as the preceding vehicle and pedestrians, etc. The vehicle control ECU 20 calculates the route and speed pattern of the vehicle 1 to generate a travel plan including the route and speed pattern of the vehicle 1.

[0039] The vehicle control ECU 20 executes automatic driving control of the vehicle 1 based on the generated travel plan. The vehicle control ECU 20 sends a control signal to the actuator 25 to control the vehicle speed and steering angle of the vehicle 1 to execute automatic driving control.

[0040] [Configuration of vehicle display device]

[0041] Next, the structure of the vehicle display device 100 involved in the present embodiment is described. The vehicle display device 100 is a device that displays images related to trial vehicle control. Trial vehicle control is a vehicle control in a virtual reality space that allows passengers to experience in advance how the vehicle control operates according to road conditions before actually executing vehicle control including driving assistance control and automatic driving control. The vehicle display device 100 is mainly composed of a display control ECU 10 mounted on the vehicle 1, a statistical information storage unit 17, a trial input unit 18, and a display (display unit) 19. The vehicle display device 100 may also include a map database 22 and a GPS receiver 24 for obtaining map information and the position of the vehicle 1 on the map (hereinafter simply recorded as the position of the vehicle 1).

[0042] The display control ECU 10 is an electronic control unit having a CPU, a ROM, a RAM, a CAN communication circuit, etc. The display control ECU 10 controls the display 19. The display control ECU 10 may also be an electronic control unit built into the display 19. The display control ECU 10 may also be a part of the vehicle control ECU 20. The display control ECU 10 may also be composed of a plurality of electronic units. The display control ECU 10 is connected to the vehicle control ECU 20 in a communicable manner, for example. A part of the functions of the display control ECU 10 may also be performed by a server that can communicate with the vehicle 1.

[0043] The statistical information storage unit 17 is a database for storing statistical information. Statistical information is information related to past vehicle control actions. In the statistical information storage unit 17, past vehicle control action information and positions on a map are stored as statistical information in association with each other. "Past vehicle control action information" refers to the storage of information on the results of vehicle control performed by vehicle 1 and other vehicles in the past. "Past vehicle control action information" may include, for example, how the vehicle speed or steering angle of vehicle 1 was controlled by vehicle control, whether the vehicle control was automatically canceled, and how the driving plan including the route and speed mode of the automatic driving control was corrected. The statistical information storage unit 17 is formed, for example, in a recording device such as an HDD (Hard Disk Drive) mounted on the vehicle 1. The statistical information storage unit 17 may also be formed in a recording device of a server that can communicate with the vehicle 1.

[0044] The trial input unit 18 is a device for accepting trial input from the occupants of the vehicle 1. The trial input means input of condition settings related to trial vehicle control. The trial input includes, for example, a virtual destination of the vehicle 1 and trial setting values ​​related to vehicle control. The virtual destination is a destination in a virtual reality space for the occupants to experience in advance how the vehicle control operates. The trial setting values ​​are various parameters that can be set by the occupants of the vehicle control used to allow the occupants to experience in advance how the vehicle control operates. Specific examples of the trial setting values ​​will be described later.

[0045] As the trial input unit 18, for example, an input unit of an HMI (Human Machine Interface) provided in the vehicle 1 (e.g., a touch panel display, buttons, etc. of a vehicle navigation device) can be used. The trial input unit 18 accepts an input operation of an occupant as a trial input. The trial input unit 18 transmits information of the accepted trial input of the occupant to the display control ECU 10.

[0046] The display 19 is a display mounted on the vehicle 1 and displays an image to the driver. The image is displayed in a predetermined display area of ​​the display 19. The display 19 is controlled by the display control ECU 10 and displays the image in the display area. As the display 19, a display capable of changing the size, shape, brightness, color, etc. of the image can be used.

[0047] As an example of the display 19, a head mounted display (HMD) provided in the vehicle 1 can be used. In addition, a head up display (HUD), a liquid crystal display of a navigation system, or a liquid crystal display provided in front of the driver of the instrument panel (so-called multi-information display (MID)) can also be used as the display 19. The head up display is a display device that projects an image from a projection unit provided in the instrument panel of the vehicle 1 onto the display surface of the windshield (the reflective surface on the inner side of the windshield).

[0048] Next, the functions of the display control ECU 10 will be described. Figure 1 As shown, the display control ECU 10 includes a trial travel route generating unit 11 , an information acquiring unit 12 , a trial result calculating unit 13 , a notification information storing unit 14 , an image generating unit 15 , and a display control unit 16 as functional configurations.

[0049] The display control ECU 10 may, for example, enable the trial vehicle control function when the passenger inputs the trial input unit 18 to enable the "trial mode". The display control ECU 10 may, for example, enable the trial mode on the condition that the vehicle 1 is located in the passenger's garage, the vehicle 1 is completely stopped, and the gear is in the P gear. The trial travel route generation unit 11 may, for example, enable the trial mode on the condition that the vehicle 1 is located in a parking area, the vehicle 1 is completely stopped, and the gear is in the P gear.

[0050] The trial route generation unit 11 obtains the position of the vehicle 1 as the trial start position. The trial start position is a position on the map that becomes the starting point of the trial vehicle control by the display control ECU 10. The trial route generation unit 11 obtains the trial start position, for example, when the vehicle 1 is in parking, rather than when the vehicle 1 is temporarily stopped such as waiting for a traffic light. The trial route generation unit 11 here can use the position of the vehicle 1 recognized by the vehicle control ECU 20.

[0051] The trial route generation unit 11 generates a trial route for vehicle control based on the map information and the imaginary destination of the vehicle 1. The trial route generation unit 11 obtains, for example, the imaginary destination of the vehicle 1 input by the occupant to the trial input unit 18. The trial route generation unit 11 generates a trial route of the vehicle 1 from the trial start position to the imaginary destination based on the trial start position, the imaginary destination, and the map information, for example, in the same manner as the calculation method in the vehicle control ECU 20. The trial route is equivalent to the imaginary target route (a path in units of lanes). The trial route generation unit 11 here can use the map information obtained by the vehicle control ECU 20.

[0052] The information acquisition unit 12 acquires statistical information about past vehicle control operations, which stores past vehicle control operation information and positions on a map in association with each other. The information acquisition unit 12 acquires statistical information along a trial travel route from a trial start position to a virtual destination, for example.

[0053] The test result calculation unit 13 calculates a test result based on the test setting values ​​related to vehicle control and the test route. The test result means an output of the vehicle control operation corresponding to the test setting values ​​when the vehicle 1 is virtually driven along the test route.

[0054] The trial result calculation unit 13 obtains, for example, the trial setting value input by the occupant in the trial input unit 18. The trial result calculation unit 13 causes the vehicle 1 to virtually travel on the trial route while executing the vehicle control corresponding to the trial setting value. For example, when there is a call for attention information on the trial route on which the vehicle 1 virtually travels, the trial result calculation unit 13 calculates the content of the call for attention information, the location on the trial route where the call for attention information exists, and the trial setting value used during the execution of the vehicle control as the trial result.

[0055] The attention-calling information may include an unexpected action in the vehicle control corresponding to the trial setting value. An "unexpected action" means that there is a possibility of performing an action that does not conform to the occupant's assumptions with a predetermined probability or more based on statistical information in the vehicle control corresponding to the trial setting value. Examples of the unexpected action include the automatic cancellation of the vehicle control that does not conform to the occupant's assumptions, the vehicle speed control of the vehicle 1 that does not conform to the occupant's assumptions, and the steering angle control of the vehicle 1 that does not conform to the occupant's assumptions.

[0056] The attention-calling information is likely to exist in a specific place on the trial travel route, such as a place where there is a possibility of misrecognition by the external sensor 21 due to external factors. Figure 2 to Figure 4The following describes the situation.

[0057] The attention calling information may be information on temporary suspension of the automatic driving control based on the vehicle speed of the vehicle 1 when the vehicle 1 travels on a curve while the automatic driving control is being executed. Figure 2 FIG. 1 is a diagram for explaining an example of attention-drawing information. Figure 2 , a vehicle 1 is described as traveling in its own lane 31 along a center line 32 during the execution of the automatic driving control. There is a curve 33 in front of the vehicle 1. Figure 2 In the example, the set vehicle speed of the automatic driving control being executed is lower than the maximum vehicle speed of the automatic driving control allowed in the straight part of the own lane 31, and higher than the maximum vehicle speed of the automatic driving control allowed in the curve 33. At the position P1 approaching the curve 33 from the straight part of the own lane 31, there is a possibility that the vehicle control is automatically canceled in a manner not in accordance with the occupant's assumption. In this case, the location on the trial route for which the attention-calling information is present is the position P1.

[0058] The attention calling information may be information on unintended operation of the automatic driving control based on the conditions of other vehicles ahead of the vehicle 1 when the vehicle 1 travels at a toll booth while the automatic driving control is being executed. Figure 3 FIG. 2 is a diagram for explaining another example of attention-drawing information. Figure 3 FIG. 1 shows a situation in which a vehicle 1 is traveling along a center line 32 in a lane 31 toward a toll booth 34 while the automatic driving control is being executed. In front of the vehicle 1, there are other vehicles 35 and 36 that are decelerating in order to pass through the gate of the toll booth 34. Figure 3 In the example of , the passenger assumes that the vehicle 1 is traveling as indicated by the solid arrow toward the door where no other vehicles 35, 36 exist. Here, based on the detection result of the external sensor 21 of the vehicle 1 on the structure of the toll booth 34 or other vehicles 36, there is a possibility that the automatic driving control operates unintentionally in a manner not in accordance with the passenger's assumption. If the automatic driving control operates unintentionally when the vehicle 1 is at position P2, the location on the trial route where the attention-calling information exists is position P2.

[0059] The attention-calling information may be information on the operation of the driving assistance control, such as when the vehicle 1 approaches a plurality of branching roads during the execution of the driving assistance control and thus causes misleading. Figure 4 FIG. 2 is a diagram for explaining another example of attention-drawing information. Figure 4 FIG. 4 shows a situation in which the vehicle 1 is traveling along the center line 32 in the own lane 31 and approaches a plurality of branch roads 37 and 38 during the execution of lane following assistance as driving assistance control. Figure 4In the example of FIG. 1 , the occupant assumes that the vehicle 1 is to travel toward the branch road 38 as indicated by the solid arrow toward the branch road 38. Here, there is a possibility that the lane tracking assistance does not work in accordance with the occupant's assumption. Lane tracking assistance that does not meet the occupant's assumption means, for example, that the steering wheel of the vehicle 1 is mis-assisted with the lane tracking assistance sensitivity and the yaw assistance amount such that the vehicle 1 is mis-guided to the branch road 37 on the front side of the branch road 38. In the case where the vehicle 1 is mis-guided at the position P3 in front of the branch road 37, the location on the trial route where the attention-calling information exists is the position P3.

[0060] Furthermore, for example, in a place where the dividing lines are deteriorated over time or repainted, the dividing lines are easily misrecognized, and attention-drawing information is likely to exist.

[0061] The notification information storage unit 14 stores notification information, which includes an attention-calling position on the trial route corresponding to the attention-calling information and a trial setting value. The notification information is stored for notifying the occupants when the vehicle 1 travels the trial route corresponding to the trial mode as the actual vehicle control route. The attention-calling position means a location where the attention-calling information is present on the trial route, where the occupants are called to attention when the vehicle 1 travels the trial route as the actual vehicle control route. For example, the above Figure 2 to Figure 4 The attention-calling position in the case of is a position among positions P1 to P3 at which the occupant's attention is called when the vehicle 1 travels along the trial route as the actual vehicle control route. For example, when there are a plurality of attention-calling information on the trial route, the notification information storage unit 14 may store notification information about the attention-calling information of the desired notification object selected by the occupant. The notification information storage unit 14 may also accept an operation of the occupant on the trial input unit 18 to select the desired notification object.

[0062] The image generation unit 15 generates a test image based on the statistical information on the test route and the test result. The test image is an image for allowing the occupants of the vehicle 1 to recognize the attention-calling information in the statistical information in advance. The image generation unit 15 generates, for example, a test image that shows a state in which the vehicle 1 virtually travels at a location on the test route where the attention-calling information exists. The test image includes at least one of the content of the attention-calling information, the location on the test route where the attention-calling information exists, and the test setting value used during the execution of the vehicle control.

[0063] The trial image may be a bird's-eye view image showing the vehicle 1 from behind. The trial image includes, for example, an image of the vehicle itself displayed corresponding to the position of the vehicle 1 in the lane where the vehicle 1 is currently traveling when the vehicle 1 is viewed from behind. The trial image may also include an object image displayed corresponding to the position of an object such as another vehicle around the vehicle 1. At least one of the content of the attention-calling information, a location on the trial route where the attention-calling information exists, and a trial setting value used during the execution of vehicle control may be superimposed on the bird's-eye view image.

[0064] The image generating unit 15 may display a trial image indicating a location where the attention call information is present on the trial travel route on a map, instead of the bird's-eye view image.

[0065] The image generation unit 15 may also generate a plurality of trial images corresponding to the plurality of attention-calling information when there are a plurality of attention-calling information. The image generation unit 15 may also add titles indicating what kind of attention-calling information is to the plurality of trial images and organize them into a list. For example, the titles may be cancellation of automatic driving, sudden deceleration, misguidance, etc. The image generation unit 15 may also organize the plurality of trial images by sorting them in order from the attention-calling information close to the trial start position along the trial route.

[0066] The image generation unit 15 may also generate a notification image including trial setting values ​​based on the notification information when the vehicle 1 travels along the trial route as the actual vehicle control route. The notification image is an image used to present notification information as a preview result in the trial mode to the occupant when the vehicle 1 travels along the trial route corresponding to the trial mode as the actual vehicle control route. The image generation unit 15 generates a notification image based on the stored notification information, for example, and the notification image includes an image representing the surrounding conditions of the attention-calling position included in the stored notification information, and an image representing the trial setting values ​​included in the stored notification information. The image generation unit 15 may also generate a notification image that pops up in a partial area of ​​the navigation screen, for example. The image generation unit 15 may also generate a notification image that is used as an interrupt notification to a multi-information display such as an instrument or a head-up display.

[0067] The display control unit 16 causes the display 19 of the vehicle 1 to display the trial image. The display control unit 16 causes the display 19 to display the trial image, thereby providing the occupants of the vehicle 1 with the attention-calling information during parking. By allowing the occupants of the vehicle 1 to recognize the attention-calling information in advance, when the vehicle 1 travels along the trial route as the actual route of vehicle control, the occupants of the vehicle 1 can make advance preparations for the attention-calling information. In addition, the occupants can try to adjust various parameters of the vehicle control that can be set by the occupants in advance by changing the trial setting values ​​so that the vehicle control does not perform unexpected actions.

[0068] exist Figure 2 In the example, as an unexpected action, there is a possibility that the vehicle control that does not conform to the occupant's assumption is automatically canceled. The occupant of the vehicle 1 recognizes the attention-calling information, and the occupant of the vehicle 1 can try to set the vehicle speed for the automatic driving control so that the vehicle control that does not conform to the occupant's assumption is not automatically canceled. In this way, the trial setting value can also be the set vehicle speed related to the automatic driving control in the vehicle control.

[0069] exist Figure 3 In the example, as an unexpected action, there is a possibility that the automatic driving control performs an unintended operation that does not conform to the occupant's assumption. By the occupant of the vehicle 1 recognizing the attention-calling information, the occupant of the vehicle 1 can also try to set the parameters of the automatic driving control (for example, setting the vehicle distance, etc.) so that the automatic driving control does not perform an unintended operation that does not conform to the occupant's assumption.

[0070] exist Figure 4 In the example, as an unexpected action, there is a possibility that the lane tracking assist may operate in a manner not in accordance with the occupant's expectations. By the occupant of vehicle 1 recognizing the attention-calling information, the occupant of vehicle 1 can try to adjust the sensitivity of the lane tracking assist and the amount of yaw assist so that the lane tracking assist does not operate in a manner not in accordance with the occupant's expectations. In this way, the trial setting value may also be a set sensitivity related to the driving assist control in the vehicle control. The trial setting value may also be a set assistance amount related to the driving assist control in the vehicle control. In this case, in the branch road 37, by suppressing the action of the driving assist control to an unexpected degree while setting the action of the driving assist control to a degree not in accordance with the occupant's expectations, the occupant's operational intervention can be smoothly assisted.

[0071] The display control unit 16 may also cause the display 19 of the vehicle 1 to display a notification image. The display control unit 16 causes the display 19 of the vehicle 1 to display the generated notification image. The display control unit 16 causes the display 19 to display the notification image, thereby providing notification information to the passengers in the vehicle 1 that is traveling along the trial route as the actual vehicle control route. The passengers (driver) of the traveling vehicle 1 can refer to the trial setting values ​​displayed on the notification image and adjust various parameters that can be set by the passengers in the actual vehicle control being executed.

[0072] The display control unit 16 may also cause the display 19 of the vehicle 1 to display a notification image when it is determined that the position of the vehicle 1 is close to the position on the map corresponding to the attention-calling position. The display control unit 16 determines that the position of the vehicle 1 is close to the position on the map corresponding to the attention-calling position, for example, when the distance between the position of the vehicle 1 on the map and the position on the map corresponding to the attention-calling position is less than a predetermined proximity threshold. The display control unit 16 determines that the position of the vehicle 1 is not close to the position on the map corresponding to the attention-calling position, for example, when the distance between the position of the vehicle 1 on the map and the position on the map corresponding to the attention-calling position is greater than a predetermined proximity threshold. The proximity threshold is a threshold of the distance between the position of the vehicle 1 on the map and the position on the map corresponding to the attention-calling position, which is used to switch whether to display the notification image.

[0073] [Processing of vehicle display device, display method, and display program]

[0074] Next, refer to Figure 5 and Figure 6 An example of processing by the vehicle display device 100 is described with reference to the flowchart of FIG. Figure 5 This is a flowchart showing a processing example of the display control ECU of the vehicle display device. Figure 5 The processing (steps) shown are repeatedly executed in each predetermined calculation cycle when the trial mode is enabled by input from a passenger of the vehicle 1 , for example.

[0075] like Figure 5 As shown, the display control ECU 10 of the vehicle display device 100 generates a trial route in S01 through the trial route generation unit 11. The trial route generation unit 11 obtains, for example, the position of the vehicle 1 (trial start position) and the virtual destination of the vehicle 1 input by the occupant to the trial input unit 18. The trial route generation unit 11 generates a trial route from the trial start position to the virtual destination.

[0076] In S02, the display control ECU 10 acquires statistical information through the information acquisition unit 12. The information acquisition unit 12 acquires statistical information related to past vehicle control actions, which stores past vehicle control action information and positions on a map in association. The information acquisition unit 12 acquires statistical information along a trial travel route from a trial start position to an imaginary destination, for example.

[0077] In S03, the display control ECU 10 calculates the trial result through the trial result calculation unit 13. The trial result calculation unit 13 obtains, for example, the trial setting value input by the occupant to the trial input unit 18. The trial result calculation unit 13 calculates the trial result of the action of the vehicle control corresponding to the trial setting value when the vehicle 1 is virtually driven along the trial route based on the trial setting value and the trial route. The trial result calculation unit 13 causes the vehicle 1 to virtually drive on the trial route while executing the vehicle control corresponding to the trial setting value. For example, when there is a call for attention information on the trial route on which the vehicle 1 virtually drives, the trial result calculation unit 13 calculates the content of the call for attention information, the location on the trial route on which the call for attention information exists, and the trial setting value used during the execution of the vehicle control as the trial result.

[0078] In S04, the display control ECU 10 generates a trial image through the image generation unit 15. The image generation unit 15 generates the trial image based on the statistical information on the trial route and the trial result. The image generation unit 15 generates, for example, a trial image showing a situation where the vehicle 1 is virtually traveling at a location where the attention-calling information exists on the trial route. The image generation unit 15 may also display a trial image showing a location where the attention-calling information exists on the trial route on a map. The trial image is an image used to allow the occupants of the vehicle 1 to recognize the attention-calling information in the statistical information in advance.

[0079] In S05, the display control ECU 10 displays a trial image through the display control unit 16. The display control unit 16 displays the generated trial image on the display 19 of the vehicle 1. The display control unit 16 displays the trial image on the display 19 to provide the occupant with attention-calling information in the vehicle 1 during parking. The display control unit 16 displays the trial image, which shows a situation in which the vehicle 1 traveling in a virtual manner approaches or passes through a location where the attention-calling information exists on the trial travel route.

[0080] In S06, the display control ECU 10 stores the notification information in the notification information storage unit 14. The notification information storage unit 14 stores the notification information including the attention-calling position and the trial setting value on the trial travel route corresponding to the attention-calling information. Then, the display control ECU 10 ends. Figure 5 processing.

[0081] Figure 6 FIG. 1 is a flowchart showing an example of a display process of a notification image. Figure 6 The processing (steps) shown, for example, when notification information is stored in a trial mode performed during parking of vehicle 1, when vehicle 1 travels the trial route corresponding to the trial mode as the actual vehicle controlled route, the processing (steps) are repeatedly executed according to predetermined calculation cycles.

[0082] In S11, the display control ECU 10 recognizes the position of the vehicle by the image generation unit 15. The image generation unit 15 recognizes the position of the vehicle 1 (the position of the vehicle 1 on the map on the route actually controlled by the vehicle).

[0083] In S12, the display control ECU 10 generates a notification image through the image generation unit 15. The image generation unit 15 generates a notification image based on, for example, Figure 5 The notification image is generated based on the notification information stored in S06, the notification image including an image showing the surrounding conditions of the attention-calling position included in the stored notification information and an image showing the trial setting value included in the stored notification information.

[0084] In S13, the display control ECU 10 determines whether the position of the vehicle 1 is close to the position on the map corresponding to the attention-calling position through the display control unit 16. For example, when the distance between the position of the vehicle 1 on the map and the position on the map corresponding to the attention-calling position is less than a predetermined proximity threshold, the display control unit 16 determines that the position of the vehicle 1 is close to the position on the map corresponding to the attention-calling position. For example, when the distance between the position of the vehicle 1 on the map and the position on the map corresponding to the attention-calling position is greater than a predetermined proximity threshold, the display control unit 16 determines that the position of the vehicle 1 is not close to the position on the map corresponding to the attention-calling position.

[0085] If it is determined that the position of the vehicle 1 is close to the position on the map corresponding to the attention-calling position (S13: Yes), the display control ECU 10 transfers the processing to S14. If it is determined that the position of the vehicle 1 is not close to the position on the map corresponding to the attention-calling position (S13: No), the display control ECU 10 ends the processing. Figure 6 processing.

[0086] In S14, the display control ECU 10 displays the notification image through the display control unit 16. The display control unit 16 causes the display 19 of the vehicle 1 to display the generated notification image. The display control unit 16 causes the display 19 to display the notification image, thereby providing notification information to the occupants of the vehicle 1 that is traveling along the trial route as the actual vehicle control route. Then, the display control ECU 10 ends. Figure 6 processing.

[0087] [Show Program]

[0088] The display program enables the display control ECU 10 (computer) to function (operate) as the above-mentioned trial route generation unit 11, information acquisition unit 12, trial result calculation unit 13, notification information storage unit 14, image generation unit 15, and display control unit 16. The display program is provided, for example, via a non-transient recording medium such as a ROM or a semiconductor memory. In addition, the display program can also be provided via communication such as a network.

[0089] According to the vehicle display device 100, the display method, and the display program described above, based on the trial route and the trial setting value, a trial result of the vehicle control operation corresponding to the trial setting value when the vehicle 1 is virtually driven along the trial route is calculated. The trial image generated based on the statistical information on the trial route and the trial result is displayed on the display 19 of the vehicle 1. Thus, the occupant can recognize in advance how the vehicle control will operate according to the road conditions based on the attention-calling information on the trial route.

[0090] In the vehicle display device 100, the display method, and the display program, notification information including the attention-calling position on the trial route corresponding to the attention-calling information and the trial setting value is stored. When the vehicle 1 travels along the trial route as the actual vehicle control route, a notification image including the trial setting value is generated based on the notification information. When the position of the vehicle 1 approaches the position on the map corresponding to the attention-calling position, the notification image is displayed on the display 19. As a result, the occupant can recognize that the vehicle 1 approaches the position on the map corresponding to the attention-calling position and the trial setting value.

[0091] In the vehicle display device 100, the display method, and the display program, the trial setting value is a set vehicle speed related to the automatic driving control in the vehicle control. The attention-calling information is information about the temporary suspension of the automatic driving control based on the vehicle speed of the vehicle 1 when the vehicle 1 is traveling on a curve during the execution of the automatic driving control. Thus, the occupant can recognize in advance whether the automatic driving control will be temporarily suspended in accordance with the set vehicle speed on the curve.

[0092] In addition, the vehicle display device 100 allows the occupants of the vehicle 1 to preview the advanced safety functions of the vehicle 1 before actually using them, by allowing the occupants of the vehicle 1 to experience in advance places where attention-calling information is statistically likely to exist. As a result, when the vehicle 1 travels along the trial route as the actual vehicle control route, it is expected that the vehicle control will be used more effectively than if no experience was performed in advance. The occupants can conduct a trial in a virtual reality space using the vehicle 1, and thus can try out various functions of the vehicle 1 in the same way as during actual driving. For example, regarding the acceleration, deceleration and steering override of the vehicle 1, the trial input unit 18 can also accept and reflect it in the trial results.

[0093] As mentioned above, although embodiment of this disclosure was described, this disclosure is not limited to the said embodiment.

[0094] In the above embodiment, the vehicle display device 100 includes the statistical information storage unit 17, but the statistical information storage unit 17 is not essential. The generation of the notification image by the image generation unit 15 is not essential. The display control unit 16 may not display the notification image.

[0095] The number of times the trial result is calculated in the above embodiment is not particularly limited. The number of times the trial result is calculated may be 1 time or 2 times or more. The number of times the trial setting value is adjusted is not particularly limited. The number of times the trial setting value is adjusted may be 1 time or 2 times or more.

[0096] In the above-described embodiment, the trial travel route generating unit 11 generates a trial travel route from the trial start position to the virtual destination, but may generate a trial travel route starting from a position other than the trial start position.

Claims

1. A vehicle display device, provided in a vehicle capable of executing vehicle control, wherein the vehicle control includes driving assistance control and automatic driving control, the vehicle display device comprising: a trial travel route generating unit for generating a trial travel route for controlling the vehicle based on map information and a hypothetical destination of the vehicle; an information acquisition unit that acquires statistical information related to past vehicle control operations, in which past vehicle control operation information and positions on a map are stored in association with each other; a trial result calculation unit that calculates a trial result regarding an operation of the vehicle control corresponding to the trial setting value when the vehicle is virtually driven along the trial travel route, based on the trial setting value related to the vehicle control and the trial travel route; an image generating unit for generating a trial image for allowing an occupant of the vehicle to recognize in advance the attention-calling information in the statistical information, based on the statistical information on the trial travel route and the trial result; as well as A display control unit causes a display unit of the vehicle to display the test image.

2. The vehicle display device according to claim 1, A notification information storage unit is provided, wherein the notification information storage unit stores notification information including an attention-calling position on the trial travel route corresponding to the attention-calling information and the trial setting value, The image generation unit generates a notification image including the trial setting value based on the notification information when the vehicle travels along the trial route as the actual route of the vehicle control. The display control unit causes the display unit to display the notification image when the position of the vehicle approaches a position corresponding to the attention calling position on a map.

3. The vehicle display device according to claim 1 or 2, The trial setting value is a set vehicle speed related to the automatic driving control in the vehicle control, The attention calling information is information regarding temporary suspension of the automatic driving control based on the vehicle speed of the vehicle when the vehicle travels on a curve during execution of the automatic driving control.

4. A display method using a vehicle display device, wherein the vehicle display device is provided in a vehicle capable of executing vehicle control, wherein the vehicle control includes driving assistance control and automatic driving control, and the display method comprises: A step of generating a trial travel route for controlling the vehicle based on map information and a hypothetical destination of the vehicle; A step of acquiring statistical information related to past vehicle control actions, in which past vehicle control action information and positions on a map are stored in association with each other; The step of calculating, based on trial setting values ​​related to the vehicle control and the trial travel route, a trial result regarding the operation of the vehicle control corresponding to the trial setting values ​​when the vehicle is virtually driven along the trial travel route; a step of generating a trial image for causing an occupant of the vehicle to recognize in advance the attention-calling information in the statistical information based on the statistical information and the trial result on the trial travel route; as well as The step of causing a display unit of the vehicle to display the test image.

5. A display program that causes a computer to function as a vehicle display device, the vehicle display device being provided in a vehicle capable of executing vehicle control, the vehicle control including driving assistance control and automatic driving control, the display program causing the computer to function as a trial route generation unit, an information acquisition unit, a trial result calculation unit, an image generation unit, and a display control unit, The trial route generation unit generates a trial route for controlling the vehicle based on map information and a virtual destination of the vehicle. The information acquisition unit acquires statistical information related to the past operation of the vehicle control, in which the operation information of the past vehicle control and the position on the map are stored in association with each other. The trial result calculation unit calculates a trial result regarding the operation of the vehicle control corresponding to the trial setting value when the vehicle is virtually driven along the trial travel route, based on the trial setting value related to the vehicle control and the trial travel route. The image generating unit generates a test image for allowing an occupant of the vehicle to recognize in advance the attention-calling information in the statistical information based on the statistical information on the test travel route and the test result. The display control unit causes a display unit of the vehicle to display the test image.