Vehicle display control device, system, control method and recording medium
By displaying vehicle peripheral information in autonomous driving mode and changing the display background, the notification problem of unconscious driving operations is solved, and the balance between driving safety and occupant comfort is achieved.
Patent Information
- Application Number
- CN202110818380.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-08-31
- Filing Date
- 2021-07-20
- Publication Date
- 2024-12-20
- Estimated Expiration
- 2041-07-20
AI Technical Summary
In the autonomous driving mode, the occupant may unconsciously perform driving operations, resulting in sudden changes in the driving mode, and it is difficult for the prior art to effectively notify the occupant and maintain driving comfort.
A display control device for vehicles is designed to detect driving mode, display vehicle peripheral information during autonomous driving, and change the display background information when driving operation participation is detected, and notify occupants visually to avoid frequent acoustic alarms. Reduce the comfort impact on other occupants.
Effectively notify the occupants to participate in driving operations in autonomous driving mode, ensure driving safety, reduce the impact on the comfort of other occupants, and do not affect the driving assistance functions.
Smart Images

Figure CN114103976B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a vehicle display control device, a vehicle display system, a vehicle display control method, and a non-transitory recording medium. Background Art
[0002] Japanese Patent Application Publication No. 2019-119262 discloses a display device that displays an image that foreshadows a change in a driving mode of the vehicle in a display area in front of a driver's seat in a vehicle that can travel in multiple driving modes.
[0003] In addition, in the case where the occupant performs a driving operation during automatic driving, a structure is considered in which the driving operation performed by the occupant is given priority. In such a structure, if the occupant unconsciously participates in the driving operation (override operation) during automatic driving, part of the driving operation may be transferred to the occupant without preparation. Summary of the invention
[0004] The present disclosure provides a vehicle display control device, a vehicle display system, a vehicle display control method, and a non-transitory recording medium capable of notifying an occupant of participation in a driving operation during automatic driving.
[0005] The vehicle display control device involved in the first embodiment of the present invention includes: a driving mode acquisition unit, which acquires information on whether the vehicle's driving mode is a manual driving mode in which the vehicle is driven by a driving operation of the occupant and an automatic driving mode in which the vehicle is driven without a driving operation of the occupant; an operation participation detection unit, which detects the participation of the driving operation performed by the occupant when the driving mode acquired by the driving mode acquisition unit is the automatic driving mode; and a display control unit, which displays the surrounding information of the vehicle on a display unit arranged in the vehicle cabin when the driving mode acquired by the driving mode acquisition unit is at least the automatic driving mode.
[0006] In the vehicle display control device involved in the first embodiment of the present disclosure, a driving mode acquisition unit acquires the driving mode of the vehicle. Here, the driving mode acquisition unit acquires information on whether the driving mode of the vehicle is a manual driving mode in which the vehicle is driven by a driving operation of an occupant and an automatic driving mode in which the vehicle is driven without a driving operation of the occupant. In addition, when the driving mode acquired by the driving mode acquisition unit is at least the automatic driving mode, the display control unit displays the surrounding information of the vehicle on a display unit provided in the vehicle cabin. Thus, in the automatic driving mode, the occupant can confirm the surrounding information of the vehicle by viewing the display unit.
[0007] In addition, the operation participation detection unit detects the participation of the driving operation performed by the occupant in the automatic driving mode. Moreover, when the operation participation detection unit detects the participation of the driving operation, the display control unit changes the background information of the surrounding information of the vehicle displayed on the display unit. As a result, when the occupant unconsciously performs the driving operation during driving in the automatic driving mode, the occupant can be visually notified of the participation in the driving operation because the background of the display unit changes. In addition, compared with a structure that frequently notifies the occupant by sound, it is possible to suppress the situation where the comfort of other occupants is damaged.
[0008] A vehicle display control device according to a second aspect of the present disclosure is configured such that, in the first aspect, the operation participation detection unit detects at least one of a steering operation and an accelerator operation performed by the occupant as participation in the driving operation.
[0009] In the vehicle display control device according to the second aspect of the present disclosure, when at least one of steering operation and accelerator operation performed by the passenger is detected, the background of the display unit is changed, so that the passenger can understand that at least one of the steering and accelerator is operated.
[0010] The vehicle display control device involved in the third aspect of the present disclosure is that in the second aspect, the display control unit displays the planned driving route of the vehicle on the display unit, and when the steering operation is detected by the operation participation detection unit, the planned driving route is set to be hidden.
[0011] In the vehicle display control device according to the third aspect of the present disclosure, since the display control unit displays the planned driving route on the display unit, the occupant can understand the operation status of the vehicle even in the automatic driving mode. In addition, since the display control unit sets the planned driving route to be hidden when the occupant performs the steering operation, the occupant can recognize that he / she has participated in the steering operation.
[0012] A vehicle display control device according to a fourth aspect of the present disclosure is configured such that, in the third aspect, the planned travel route is displayed superimposed on an image of a travel lane of the host vehicle.
[0013] The vehicle display control device involved in the fifth mode of the present disclosure is that in any one of the second mode to the fourth mode, the display control unit displays a leading vehicle on the display unit, and when an accelerator operation is detected by the operation participation detection unit, the color of the leading vehicle is lowered and displayed.
[0014] In the vehicle display control device according to the fifth aspect of the present disclosure, since the display control unit displays the preceding vehicle on the display unit, the occupant can grasp the existence of the preceding vehicle at a glance even in the automatic driving mode. In addition, since the display control unit displays the preceding vehicle in a lower tone when the accelerator is operated, the occupant can recognize that the accelerator is operated.
[0015] The vehicle display control device involved in the sixth embodiment of the present disclosure is that in any one of the second to fifth embodiments, the display control unit displays a speed mark whose intervals change according to the speed of the vehicle on the display unit, and when an accelerator operation is detected by the operation participation detection unit, the speed mark is set to not be displayed.
[0016] In the vehicle display control device according to the sixth aspect of the present disclosure, since the display control unit displays the speed mark on the display unit, the occupant can check the speed of the vehicle by simply checking the interval between the speed marks even in the automatic driving mode. In addition, since the display control unit sets the speed mark to be hidden when the accelerator is operated, the occupant can recognize that the accelerator operation has been performed.
[0017] The vehicle display control device involved in the seventh embodiment of the present invention is that in any one of the second to sixth embodiments, it also has an alarm display unit, and when the steering operation and the accelerator operation are detected by the operation participation detection unit, the alarm display unit displays an alarm image indicating participation in the driving operation on the display unit.
[0018] In the vehicle display control device according to the seventh aspect of the present disclosure, since the warning image is displayed on the display unit by the warning display unit, it is possible to effectively notify the occupant that he or she is involved in the driving operation.
[0019] The vehicle display control device involved in the eighth aspect of the present disclosure is that, in the seventh aspect, the warning display unit displays the warning image that is different when the steering operation is detected by the operation participation detection unit and when the accelerator operation is detected by the operation participation detection unit.
[0020] In the vehicle display control device according to the eighth aspect of the present disclosure, the occupant can understand the type of driving operation simply by viewing the warning image.
[0021] A vehicle display system according to a ninth aspect of the present disclosure includes: the vehicle display control device according to any one of the first to eighth aspects; and a display unit that is provided in a vehicle cabin and displays peripheral information of the vehicle.
[0022] In the vehicle display control method involved in the tenth embodiment of the present disclosure, information is obtained as to whether the driving mode of the vehicle is a manual driving mode in which the vehicle is driven by the driving operation of the occupant and an automatic driving mode in which the vehicle is driven without the driving operation of the occupant. When the driving mode acquired by the driving mode acquisition unit is the automatic driving mode, participation of the driving operation performed by the occupant is detected. When the acquired driving mode is at least the automatic driving mode, peripheral information of the vehicle is displayed on a display unit provided in the vehicle cabin, and when participation of the driving operation is detected, background information of the peripheral information is changed and displayed on the display unit.
[0023] The non-temporary recording medium involved in the eleventh embodiment of the present disclosure records a program that causes a computer to execute the following processing, wherein the processing is to obtain information on whether the vehicle's driving mode is a manual driving mode in which the vehicle is driven by a driving operation of the occupant and an automatic driving mode in which the vehicle is driven without a driving operation of the occupant; when the driving mode acquired by the driving mode acquisition unit is the automatic driving mode, the participation of the driving operation performed by the occupant is detected; when the acquired driving mode is at least the automatic driving mode, the surrounding information of the vehicle is displayed on a display unit provided in the vehicle cabin; and when the participation of the driving operation is detected, the background information of the surrounding information is changed and displayed on the display unit.
[0024] As described above, in the vehicle display control device, the vehicle display control method, and the non-transitory recording medium according to the present disclosure, it is possible to notify the occupant of the participation in the driving operation during automatic driving. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] Exemplary embodiments of the present disclosure will be described in detail based on the following drawings, in which:
[0026] Figure 1 This is a schematic diagram schematically showing a state where the front part of the vehicle cabin in the embodiment is viewed from the rear side of the vehicle.
[0027] Figure 2 It is a block diagram showing a hardware configuration of a vehicle display control device according to an embodiment.
[0028] Figure 3It is a block diagram showing a functional structure of a vehicle display control device according to an embodiment.
[0029] Figure 4 The figure shows an example of a display screen of the second display unit during automatic driving, and is a figure showing a state in which the participation of the steering operation and the participation of the accelerator operation are not implemented.
[0030] Figure 5 The figure shows an example of a display screen of the second display unit during automatic driving, and is a figure showing a state in which participation of accelerator operation is performed.
[0031] Figure 6 This is a diagram showing an example of a display screen of the second display unit during automatic driving, and is a diagram of a state in which participation in steering operation is implemented.
[0032] Figure 7 1 is a diagram showing an example of a display screen during automatic driving in a modification example, and is a diagram showing a state in which participation in accelerator operation is performed.
[0033] Figure 8 This is a flowchart showing an example of the flow of display processing in the embodiment. DETAILED DESCRIPTION
[0034] A vehicle 12 to which the vehicle display system 10 according to the embodiment is applied will be described with reference to the drawings. The vehicle 12 according to the present embodiment is configured as an example to be switchable between automatic driving and manual driving.
[0035] like Figure 1 As shown, a dashboard 14 is provided at the front portion of the vehicle cabin in the vehicle 12. The dashboard 14 extends in the vehicle width direction, and a steering wheel 16 is provided at the vehicle right side of the dashboard 14. That is, in the present embodiment, as an example, a right-hand drive vehicle is provided with a steering wheel 16 at the right side, and the driver's seat is provided at the vehicle right side.
[0036] A windshield 18 is provided at the front end portion of the instrument panel 14. The windshield 18 extends in the vehicle up-down direction and the vehicle width direction, and divides the vehicle cabin interior and the vehicle cabin exterior.
[0037] The right end of the windshield 18 is fixed to the front pillar 20 on the right side of the vehicle. The front pillar 20 extends in the vehicle up-down direction, and the windshield 18 is fixed to the inner end of the front pillar 20 in the vehicle width direction. In addition, the front end of the front side glass 22 is fixed to the outer end of the front pillar 20 in the vehicle width direction. In addition, the left end of the windshield 18 is fixed to the front pillar on the left side of the vehicle (not shown).
[0038] Here, a first display unit 24 is provided on the windshield 18. The first display unit 24 is provided by Figure 2 Specifically, the head up display 23 is provided on the vehicle front side relative to the instrument panel 14, and is configured to project an image from the head up display 23 toward a first display unit 24 of the windshield 18.
[0039] A second display unit 26 is provided at a lower position of the vehicle than the first display unit 24. The second display unit 26 is a display unit that is displayed on a meter 25 located in front of the vehicle of the driver's seat on the instrument panel 14. The first display unit 24 and the second display unit 26 are provided at positions where the driver can visually confirm, and correspond to the "display unit" of the present disclosure. In addition, the vehicle display control device 10, the first display unit 24, and the second display unit 26 constitute the "vehicle display system" of the present disclosure.
[0040] (Hardware Configuration of Vehicle Display Control Device 10)
[0041] like Figure 2 As shown, the vehicle display control device 10 according to the present embodiment is configured to include an ECU (Electronic Control Unit) 28 .
[0042] The ECU 28 includes a CPU (Central Processing Unit) 30 , a ROM (Read Only Memory) 32 , a RAM (Random Access Memory) 34 , a storage 36 , and an input / output interface 38 . Each component is connected via an internal bus 39 so as to be able to communicate with each other.
[0043] The CPU 30 is a central processing unit and executes various programs or controls various parts. That is, the CPU 30 reads the program from the ROM 32 or the storage 36 and executes the program using the RAM 34 as a work area. In addition, the CPU 30 implements the control of the above-mentioned structures and various calculation processes according to the program recorded in the ROM 32 or the storage 36.
[0044] ROM32 stores various programs and various data. RAM34 temporarily stores programs or data as a work area. Storage 36 is composed of HDD (Hard Disk Drive) or SSD (Solid State Drive), and is a non-temporary recording medium for storing various programs including an operating system and various data. In the present embodiment, a display program for implementing display processing is stored in ROM32 or storage 36. In addition, various input and output devices are connected to the input and output interface 38.
[0045] Here, the ECU 28 is electrically connected to the automatic driving ECU 40. Similar to the ECU 28, the automatic driving ECU 40 is configured to include a CPU, a ROM, a RAM, a memory, an input / output interface, and the like, which are not shown.
[0046] A sensor group 42 for detecting the current status of the vehicle and an actuator group 44 for controlling the driving of the vehicle are connected to the automatic driving ECU 40. The sensor group 42 includes a plurality of sensors from various sensors such as cameras, radars, LIDAR (Light Detection and Ranging), and GPS (global positioning system) sensors. The camera takes pictures of the surroundings of the vehicle. The radar detects the distance and direction of objects around the vehicle through radio waves. The LIDAR detects the distance and direction of objects around the vehicle through lasers. The GPS sensor detects the current position of the vehicle. In addition, the sensor group 42 is configured to include sensors for detecting the status of the occupants. For example, the sensor group 42 may also be configured to include a biosensor for detecting the heart rate and sobriety of the occupants.
[0047] The actuator group 44 includes an acceleration and deceleration actuator for adjusting the acceleration and deceleration of the vehicle, and a steering actuator for driving the steering device of the vehicle. In the automatic driving ECU 40, the operation of the actuator group 44 is controlled according to the current state of the vehicle detected by the sensor group 42, thereby implementing the automatic driving of the vehicle. In addition, a predetermined path indicating the path that the vehicle is scheduled to travel is stored in the storage unit of the automatic driving ECU 40, and the automatic driving ECU 40 causes the vehicle 12 to travel along the predetermined path stored in the storage unit.
[0048] An accelerator position sensor 46 and a steering sensor 48 are connected to the ECU 28. The accelerator position sensor 46 is a sensor that detects the position of an accelerator pedal (not shown) provided below the driver's seat. In addition, the steering sensor 48 is a sensor that detects the load applied to the steering wheel 16 by the passenger. That is, the steering sensor 48 of this embodiment is a structure that does not detect the load when the steering wheel 16 is operated by the automatic driving ECU 40 during automatic driving, but detects the load when the steering wheel 16 is operated by the passenger.
[0049] (Functional Structure of Vehicle Display Control Device 10)
[0050] The vehicle display control device 10 realizes various functions using the above-mentioned hardware resources. Figure 3 Next, the functional configuration realized by the vehicle display control device 10 will be described.
[0051] like Figure 3 As shown, the vehicle display control device 10 is configured to include a driving mode acquisition unit 52, a surrounding information display unit 54, an operation participation detection unit 56, a display change unit 58, and an alarm display unit 60 as functional structures. Each functional structure is realized by the CPU 30 of the ECU 28 reading and executing a program. In addition, the display control unit of the present disclosure is configured to include the functions of the surrounding information display unit 54 and the display change unit 58.
[0052] The driving mode acquisition unit 52 acquires whether the driving mode of the vehicle 12 is a manual driving mode or an automatic driving mode. Here, the manual driving mode in the present embodiment refers to a driving mode in which the vehicle 12 is driven by the driving operation of the occupant. In addition, the automatic driving mode in the present embodiment refers to a driving mode in which the vehicle 12 is driven without the operation of the steering wheel 16 and the accelerator by the occupant. The driving mode acquisition unit 52 may also acquire information related to the driving mode based on a signal from the automatic driving ECU 40, for example.
[0053] The surrounding information display unit 54 constituting the display control unit displays the surrounding information of the vehicle 12 on the first display unit 24 and the second display unit 26 provided in the vehicle cabin when the driving mode acquired by the driving mode acquisition unit 52 is at least the automatic driving mode. Specifically, the surrounding information display unit 54 acquires a signal from the sensor group 42, and displays the surrounding information of the vehicle 12 based on the acquired signal on the first display unit 24 and the second display unit 26.
[0054] exist Figure 4 , a portion of the display screen of the second display unit 26 in the automatic driving mode is shown. Figure 4 As shown, in the automatic driving mode, a vehicle image M1 simulating the vehicle 12 is displayed at the lower part of the second display unit 26. In addition, a preceding vehicle image M2 simulating the preceding vehicle traveling in front of the vehicle 12 is displayed. Moreover, a surrounding vehicle image M3 simulating the surrounding vehicles traveling in a lane adjacent to the lane in which the vehicle 12 is traveling is displayed. Here, the preceding vehicle image M2 and the surrounding vehicle image M3 are displayed on the second display unit 26 by the function of the surrounding information display unit 54. In addition, when the preceding vehicle and the surrounding vehicles are not traveling within a predetermined range relative to the vehicle 12, the preceding vehicle image M2 and the surrounding vehicle image M3 are not displayed on the second display unit 26.
[0055] Furthermore, an image M41 indicating the current speed of the vehicle 12 is displayed at the upper portion of the second display unit 26 , and an image M5 indicating the set speed is displayed below the image M41 .
[0056] Moreover, between the vehicle image M1 and the preceding vehicle image M2, a track image M6 indicating the planned travel path of the vehicle 12 and a speed mark M7 corresponding to the speed of the vehicle 12 are displayed. The track image M6 is displayed in a roughly strip shape, and when the vehicle 12 is moving straight ahead, it is displayed as a roughly straight line in the vertical direction. In addition, although not shown in the figure, when the vehicle 12 turns left or right and turns along a curve, the track image M6 is displayed in a curved state along the planned travel path of the vehicle 12. The track image M6 is displayed on the second display unit 26 by the function of the surrounding information display unit 54.
[0057] A plurality of speed marks M7 are displayed at intervals in a state of being superimposed on the trajectory image M6. Figure 4 Four speed marks M7 are displayed in FIG. The speed marks M7 are displayed in a manner that the intervals thereof vary according to the speed of the vehicle 12. For example, when the speed of the vehicle 12 is Figure 4 When the speed of the vehicle 12 is lower than that of the vehicle 12, the interval of the speed mark M7 is displayed in a narrower manner. Figure 4 When the speed is faster than the state of , the interval between the speed marks M7 is widened and displayed. The speed marks M7 are displayed on the second display unit 26 by the function of the surrounding information display unit 54.
[0058] In addition, the same image as that of the second display unit 26 is displayed on the first display unit 24. In the present embodiment, since the display area of the first display unit 24 is narrower than the display area of the second display unit 26, a part of the image of the second display unit 26 is displayed on the first display unit 24. For example, the preceding vehicle image M2, the track image M6, and the speed mark M7 are displayed on the first display unit 24.
[0059] Figure 3 The operation participation detection unit 56 shown detects the participation of the driving operation performed by the occupant when the driving mode acquired by the driving mode acquisition unit 52 is the automatic driving mode. That is, the operation participation detection unit 56 functions only when the driving mode is the automatic driving mode, and does not function when the driving mode is the manual driving mode. In addition, in the automatic driving mode, when the operation participation detection unit 56 detects that the accelerator pedal has moved from the initial position based on the signal from the accelerator position sensor 46, it is determined that the occupant has participated in the accelerator operation. Moreover, in the automatic driving mode, when the operation participation detection unit 56 detects that the occupant has applied a load to the steering wheel 16 based on the signal from the steering gear sensor 48, it is determined that the occupant has participated in the steering gear operation.
[0060] The display changing unit 58 constituting the display control unit changes the background color of the surrounding information of the vehicle 12 displayed on the first display unit 24 and the second display unit 26 when the operation participation detecting unit 56 detects the participation of the occupant in the driving operation.
[0061] In the present embodiment, as an example, when the operation participation detection unit 56 detects participation in the driving operation, the display change unit 58 changes the background color from Figure 4 The state changes shown are as follows Figure 5 The background color of the second display unit 26 is shown. In addition, the background color is not particularly specified, and the display changing unit 58 changes the background so as to attract the attention of the occupant.
[0062] For example, Figure 4 As shown in FIG. 1 , in a normal state where the participation in the driving operation is not detected, the background color of the second display unit 26 is in a colorless state. Figure 5 As shown, when the driving operation is detected, the display changing unit 58 lowers the background color of the second display unit 26 to gray. At this time, the vehicle image M1 and the lane are not lowered, but only the surrounding color is lowered.
[0063] Furthermore, the display changing unit 58 lowers the color of the preceding vehicle and displays it when the operation participation detecting unit 56 detects the accelerator operation. Furthermore, the display changing unit 58 hides the speed mark M7 when the operation participation detecting unit 56 detects the accelerator operation.
[0064] Figure 5 This is a display screen of the second display unit 26 in a state where the accelerator operation is performed during automatic driving. Figure 5 As shown, the preceding vehicle image M2 is displayed in a lower tone by the display changing unit 58. In this way, by displaying the preceding vehicle image M2 in a lower tone, it is displayed that the driving assist function for automatically adjusting the distance between the preceding vehicle and the preceding vehicle is disabled.
[0065] Furthermore, the speed mark M7 superimposed and displayed on the trajectory image M6 of the planned travel route by the display changing unit 58 is not displayed. That is, it is displayed that the speed of the vehicle 12 is not controlled because the occupant has stepped on the accelerator pedal.
[0066] Furthermore, when the accelerator operation is engaged during automatic driving, the display changing unit 58 displays the image M5 of the setting speed with a lower tone, thereby displaying that the function of setting the speed has become invalid.
[0067] When the operation participation detecting unit 56 detects participation in the steering operation, the display changing unit 58 makes the track image M6 not to be displayed. Figure 6 The second display unit 26 is a display screen of the second display unit 26 in a state where the steering operation is performed during automatic driving. Figure 6 As shown, the trajectory image M6 is hidden by the display changing unit 58. In addition, along with the hiding of the trajectory image M6, the speed mark M7 is also hidden.
[0068] In addition, Figure 6 In the figure, the preceding vehicle image M2 is not toned down, but is Figure 4 The same way is shown. That is, in Figure 6 In the embodiment, since the accelerator operation is not performed, the driving assistance function for adjusting the distance between the vehicle and the preceding vehicle is working. In addition, the function of traveling on the predetermined travel path is displayed as being invalid due to the operation of the steering wheel 16.
[0069] Figure 3The illustrated warning display unit 60 displays a warning indicating participation in driving operation on the first display unit 24 and the second display unit 26 when participation in steering operation and participation in accelerator operation are detected by the participation in operation detection unit 56 .
[0070] like Figure 5 as well as Figure 6 As shown in FIG. 1 , when at least one of the steering operation and the accelerator operation is performed, the warning image M8 is displayed on the left side of the image M4 showing the speed of the vehicle 12. Although the warning image M8 of this embodiment is an image showing the state of holding the steering wheel as an example, it is not limited to this. For example, it can also be set to Figure 7 Display of the variation shown.
[0071] (Change example)
[0072] exist Figure 7 , an example of a change in the display screen of the second display unit 26 in a state where the accelerator operation is performed during automatic driving is shown. Figure 7 As shown, the preceding vehicle image M2 and the image M5 of the set speed are displayed with the tones lowered by the display changing unit 58. In addition, the warning display unit 60 displays the warning image M9 on the left side of the image M4 showing the speed of the vehicle 12. The warning image M9 is an image showing that the accelerator pedal is being depressed. In this way, the warning display unit 60 may be configured to perform different displays when the steering operation is detected by the operation participation detection unit 56 and when the accelerator operation is detected by the operation participation detection unit 56.
[0073] (effect)
[0074] Next, the operation of this embodiment will be described.
[0075] (An example of display processing)
[0076] Figure 8 1 is a flowchart showing an example of the flow of the display process performed by the vehicle display control device 10. The display process is performed by the CPU 30 of the ECU 28 reading a program from the ROM 32 or the storage 36, and developing and executing the program in the RAM 34.
[0077] like Figure 8 As shown, the CPU 30 acquires the driving mode in step S102 . Specifically, the CPU 30 acquires whether the driving mode of the vehicle 12 is the manual driving mode or the automatic driving mode through the function of the driving mode acquisition unit 52 .
[0078] In step S104, the CPU 30 determines whether the driving mode of the vehicle 12 is the automatic driving mode. When the driving mode of the vehicle 12 acquired by the driving mode acquisition unit 52 is the automatic driving mode, the CPU 30 confirms the determination of step S104 and transfers the processing to step S106. On the other hand, when the driving mode of the vehicle 12 acquired by the driving mode acquisition unit 52 is the manual driving mode, the CPU 30 ends the display processing.
[0079] The CPU 30 displays the surrounding information in step S106. Specifically, the CPU 30 obtains the signal from the sensor group 42 through the function of the surrounding information display unit 54, and displays the surrounding information of the vehicle 12 obtained based on the obtained signal on the first display unit 24 and the second display unit 26. For example, the CPU 30 displays the surrounding information in step S106 as follows: Figure 4 As shown, the host vehicle image M1, the preceding vehicle image M2, the surrounding vehicle image M3, the track image M6, and the speed mark M7 are displayed on the second display unit 26. The CPU 30 also displays the same image as that on the second display unit 26 on the first display unit 24.
[0080] In step S108 , the CPU 30 determines whether the accelerator operation is performed. Specifically, when the CPU 30 detects the accelerator operation based on the signal from the accelerator position sensor 46 through the function of the operation detection unit 56 , the CPU 30 confirms the determination in step S108 and transfers the processing to step S110 .
[0081] On the other hand, when the CPU 30 does not detect the participation of the accelerator operation by the function of the operation participation detection unit 56 in step S108 , the CPU 30 denies the determination in step S108 and proceeds to the process of step S112 .
[0082] The CPU 30 implements the display when the accelerator operation is engaged in step S110. Specifically, the CPU 30 uses the function of the display change unit 58 to display the accelerator operation. Figure 5 The background color of the second display unit 26 is changed as shown in FIG. 2. In addition, the CPU 30 displays the preceding vehicle image M2 and the image M5 of the set speed in a low tone through the function of the display change unit 58, and sets the speed mark M7 to be non-displayed. Furthermore, the CPU 30 displays the warning image M8 through the function of the warning display unit 60 in step S110. Although not shown in the figure, the display change is also implemented in the first display unit 24 in the same manner.
[0083] In step S112, the CPU 30 determines whether the steering operation is performed. Specifically, when the CPU 30 detects the steering operation based on the signal from the steering sensor 48 through the function of the operation participation detection unit 56, the CPU 30 confirms the determination of step S112 and transfers to step S114.
[0084] On the other hand, when the CPU 30 does not detect the participation of the steering operation by the function of the operation participation detection unit 56 in step S112, the determination in step S112 is denied and the display process ends.
[0085] The CPU 30 implements the display when the steering gear operation is involved in step S114. Specifically, the CPU 30 displays the steering gear operation in a manner such as Figure 6 The background color of the second display unit 26 is changed as shown. In addition, the CPU 30 sets the track image M6 and the speed mark M7 representing the scheduled driving path to be non-displayed through the function of the display change unit 58. Moreover, the CPU 30 displays the alarm image M8 through the function of the alarm display unit 60 in step S114. Although not shown in the figure, the display change is also implemented for the first display unit 24. Then, the CPU 30 ends the display processing.
[0086] in addition, Figure 6 The state shown is the display when the judgment of step S108 is negative and the judgment of step S112 is positive. That is, Figure 6 The display example is shown in the case where the participation of the steering operation is implemented without the participation of the accelerator operation. On the other hand, when the judgment of step S108 is affirmative and the judgment of step S112 is affirmative, that is, when both the accelerator operation and the steering operation are implemented, Figure 5 Display and Figure 6 In this case, CPU 30 uses the function of display changing unit 58 to display the Figure 5 or Figure 6 The background color of the second display unit 26 is changed as shown. In addition, the CPU 30 displays the preceding vehicle image M2 and the image M5 of the set speed in a low tone through the function of the display change unit 58, and sets the track image M6 and the speed mark M7 indicating the planned travel path to be hidden. Furthermore, the CPU 30 displays the warning image M8 through the function of the warning display unit 60.
[0087] As described above, in the vehicle display control device 10 according to the present embodiment, when the driving mode acquired by the driving mode acquisition unit is at least the automatic driving mode, the surrounding information display unit 54 displays the surrounding information of the vehicle 12 on the first display unit 24 and the second display unit 26. Thus, in the automatic driving mode, the occupant can check the surrounding information of the vehicle 12 by viewing the first display unit 24 and the second display unit 26.
[0088] Furthermore, in the present embodiment, when participation in driving operation is detected by the operation participation detection unit 56, the display change unit 58 changes the background information of the surrounding information of the vehicle 12 displayed on the first display unit 24 and the second display unit 26. Thus, when the occupant unconsciously performs driving operation during driving in the automatic driving mode, the background of the first display unit 24 and the second display unit 26 changes, so that the occupant can be visually notified of the participation in driving operation. For example, when the occupant unconsciously steps on the accelerator pedal with the foot placed on the accelerator pedal, the occupant can be alerted to the fact that the accelerator operation is performed.
[0089] Here, in the present embodiment, compared with a configuration in which notification is frequently made by sound, it is possible to suppress impairment of the comfort of other passengers by visually drawing the attention of the passengers.
[0090] Moreover, in the present embodiment, since the surrounding information display unit 54 displays the planned driving route on the first display unit 24 and the second display unit 26, the occupant can grasp the planned driving route at a glance even in the automatic driving mode. In addition, when the steering wheel 16 is operated, the display changing unit 58 sets the image M6 of the planned driving route to be non-displayed, thereby enabling the occupant to recognize that the steering wheel 16 is operated.
[0091] Furthermore, in the present embodiment, since the surrounding information display unit 54 displays the preceding vehicle image M2 on the first display unit 24 and the second display unit 26, the occupant can grasp the existence of the preceding vehicle at a glance even in the automatic driving mode. Furthermore, when the accelerator operation is performed, the display changing unit 58 lowers the color of the preceding vehicle image M2 and displays it, thereby enabling the occupant to recognize that the accelerator operation is performed.
[0092] Furthermore, in the present embodiment, since the surrounding information display unit 54 displays the speed mark M7 on the first display unit 24 and the second display unit 26, even in the automatic driving mode, the occupant can confirm the speed of the vehicle 12 simply by confirming the interval of the speed mark M7. Furthermore, when the accelerator operation is performed, the display changing unit 58 sets the speed mark M7 to not be displayed, thereby enabling the occupant to recognize that the accelerator operation has been performed.
[0093] Furthermore, in the present embodiment, since the warning image M8 is displayed on the first display unit 24 and the second display unit 26 by the warning display unit 60, it is possible to effectively notify the occupant of the situation where the occupant is involved in the driving operation. Figure 7 As in the modified example shown, by changing the warning image when the accelerator operation is involved and when the steering operation is involved, the occupant can easily understand the type of driving operation.
[0094] Although the vehicle display control device 10 involved in the embodiment has been described above, it can of course be implemented in various ways within the scope of the main purpose of the present disclosure. For example, although in the above-mentioned embodiment, the display change unit 58 is configured to change the background information of the first display unit 24 and the second display unit 26 when the accelerator operation is involved and when the steering operation is involved, it is not limited to this. The background information of the first display unit 24 and the second display unit 26 can also be changed when other driving operations are involved. For example, the display change unit 58 can also change the background information of the first display unit 24 and the second display unit 26 when the direction indicator is operated. In addition, the display change unit 58 can also change the background of the first display unit 24 and the second display unit 26 when the brake pedal is stepped on.
[0095] In addition, although the participation of the accelerator operation is detected based on the signal of the accelerator position sensor 46 in the above embodiment, the present invention is not limited to this. For example, in a vehicle in which acceleration and deceleration are performed by operating an operating unit such as a button or a lever instead of an accelerator pedal, the participation of the accelerator operation may be detected based on the signal from the operating unit.
[0096] Furthermore, although the participation in the steering operation is detected based on the signal of the steering sensor 48 in the above embodiment, the present invention is not limited thereto. For example, in a vehicle in which steering is performed by operating an operating unit such as a button or a joystick instead of the steering wheel 16, the participation in the steering operation may be detected based on the signal from the operating unit.
[0097] In addition, although the vehicle surrounding information is displayed on both the first display unit 24 and the second display unit 26 in the above embodiment, the present invention is not limited thereto. For example, the surrounding information display unit 54 may be configured to display the vehicle surrounding information only on the first display unit 24.
[0098] In addition, although the display changing unit 58 changes the background color of the entire second display unit 26 in the above embodiment, the present invention is not limited to this. For example, even if the display changing unit 58 is configured to change the background color of a portion of the second display unit 26, the same effect as that of the above embodiment can be obtained as long as the occupant's attention to the participation in the driving operation can be drawn.
[0099] Furthermore, although the display changing unit 58 in the above embodiment is configured to change the background color of the first display unit 24 and the second display unit 26 when the driving operation is engaged, the present invention is not limited thereto. For example, the display changing unit 58 may change the background information by displaying a predetermined pattern on the background of the first display unit 24 and the second display unit 26 when the driving operation is engaged.
Claims
1. A vehicle display control device, comprising: a driving mode acquisition unit that acquires information on whether the driving mode of the vehicle is a manual driving mode in which the vehicle is driven by a driving operation of an occupant and an automatic driving mode in which the vehicle is driven without a driving operation of the occupant; an operation participation detection unit for detecting participation of a driving operation performed by an occupant when the driving mode acquired by the driving mode acquisition unit is the automatic driving mode; a display control unit for displaying the surrounding information of the vehicle on a display unit provided in the vehicle cabin when the driving mode acquired by the driving mode acquisition unit is at least the automatic driving mode; In the vehicle display control device, The display control unit changes the background information of the surrounding information and displays it on the display unit when the operation participation detection unit detects participation in the driving operation. The display changing unit constituting the display control unit changes the background color of the surrounding information of the vehicle displayed on the display unit when the operation participation detecting unit detects the participation of the driving operation performed by the occupant. The operation participation detection unit detects at least one of a steering operation and an accelerator operation performed by the occupant as participation in the driving operation. further comprising a warning display unit for displaying a warning image indicating participation in driving operation on the display unit when the steering operation and the accelerator operation are detected by the operation participation detection unit, The warning display unit displays the warning image that is different when the steering operation is detected by the operation participation detection unit and when the accelerator operation is detected by the operation participation detection unit.
2. The vehicle display control device according to claim 1, in, The display control unit displays a planned travel route of the vehicle on the display unit, and, when the operation participation detection unit detects a steering operation, hides the planned travel route.
3. The vehicle display control device according to claim 2, in, The planned travel path is displayed superimposed on the image of the travel lane of the host vehicle.
4. The vehicle display control device according to any one of claims 1 to 3, in, The display control unit displays the preceding vehicle on the display unit, and When the accelerator operation is detected by the operation participation detection unit, the color of the preceding vehicle is displayed with a lower tone.
5. The vehicle display control device according to any one of claims 1 to 3, in, The display control unit displays a speed mark whose interval varies according to the speed of the vehicle on the display unit, and hides the speed mark when the accelerator operation is detected by the operation participation detection unit.
6. A vehicle display system, comprising: The vehicle display control device according to any one of claims 1 to 5; and The display unit is provided in the vehicle compartment and displays the surrounding information of the vehicle.
7. A vehicle display control method, in, obtaining information on whether the driving mode of the vehicle is a manual driving mode in which the vehicle is driven by a driving operation of the occupant or an automatic driving mode in which the vehicle is driven without a driving operation of the occupant, When the driving mode acquired by the driving mode acquisition unit is the automatic driving mode, detecting the participation of the driving operation performed by the occupant, and When the driving mode obtained is at least the automatic driving mode, the surrounding information of the vehicle is displayed on a display unit provided in the vehicle cabin, and when the participation of the driving operation is detected, the background information of the surrounding information is changed and displayed on the display unit, When the participation of the driving operation performed by the occupant is detected, the background color of the surrounding information of the vehicle displayed on the display unit is changed. At least one of a steering operation and an accelerator operation performed by an occupant is detected as participation in the driving operation, When the steering operation and the accelerator operation are detected, a warning image indicating participation in the driving operation is displayed on the display unit, The warning image is displayed differently when the steering operation is detected and when the accelerator operation is detected.
8. A non-temporary recording medium having recorded thereon a program for causing a computer to execute the following processing, wherein: obtaining information on whether the driving mode of the vehicle is a manual driving mode in which the vehicle is driven by a driving operation of the occupant or an automatic driving mode in which the vehicle is driven without a driving operation of the occupant, When the driving mode acquired by the driving mode acquisition unit is the automatic driving mode, participation in the driving operation performed by the occupant is detected, and When the driving mode obtained is at least the automatic driving mode, the surrounding information of the vehicle is displayed on a display unit provided in the vehicle cabin, and when the participation of the driving operation is detected, the background information of the surrounding information is changed and displayed on the display unit, When the participation of the driving operation performed by the occupant is detected, the background color of the surrounding information of the vehicle displayed on the display unit is changed. At least one of a steering operation and an accelerator operation performed by an occupant is detected as participation in the driving operation, When the steering operation and the accelerator operation are detected, a warning image indicating participation in the driving operation is displayed on the display unit, The warning image is displayed differently when the steering operation is detected and when the accelerator operation is detected.
