Display system

The display system addresses the distraction issue by adjusting the update cycle and visibility of displayed information in response to changes in driving mode automation, enhancing driver attention on the surroundings.

JP2024165086AActive Publication Date: 2024-11-28TOYOTA JIDOSHA KK
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023080933
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-16
Publication Date
2024-11-28
Estimated Expiration
2043-05-16

AI Technical Summary

Technical Problem

As driving support becomes more sophisticated, the increased amount of information displayed on the display unit can distract the driver, reducing their attention to the surrounding environment when the degree of automation of driving tasks changes.

Method used

A display system that adjusts the update cycle and visibility of displayed information based on changes in driving mode automation, using a control unit to lengthen the update cycle and reduce visibility when the degree of automation decreases, and employs a driver monitoring sensor to adjust display settings based on driver attention.

Benefits of technology

The system effectively reduces the frequency of driver attention on the display by extending the update cycle and lowering visibility, ensuring the driver maintains focus on the surroundings during reduced automation modes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024165086000001_ABST
    Figure 2024165086000001_ABST
Patent Text Reader

Abstract

To provide technology to appropriately reduce the frequency with which a driver looks at the display when the degree of automation of driving tasks is reduced from before a mode change due to a change in the driving mode.SOLUTION: A display system includes: a display unit installed in a vehicle traveling in an operation mode selected from a plurality of operation modes with different degrees of automation of driving tasks and displaying information to a driver; and a control unit that performs, when the degree of automation is reduced by changing the driving mode from that before the mode change, at least one of processes for making an update cycle of predetermined information displayed on the display unit longer than that before the mode change, and making the predetermined information less visible than that before the mode change.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a display system. [Background technology]

[0002] Patent Document 1 discloses a display system for a vehicle. This system is mounted on a vehicle that runs in a driving mode selected from a manual driving mode, an autonomous driving mode that requires constant monitoring, and an autonomous driving mode that does not require constant monitoring. This system includes a display unit that displays the surrounding conditions of the vehicle, and a control unit that controls the display unit. The control unit switches the display range of the display unit in response to switching of the driving mode of the vehicle. The control unit sets the display range to a narrow range in the manual driving mode, sets the display range to a medium range in the autonomous driving mode that requires constant monitoring, and sets the display range to a wide range in the autonomous driving mode that does not require constant monitoring. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-206133 A Summary of the Invention [Problem to be solved by the invention]

[0004] As driving assistance functions become more sophisticated, the amount of information displayed on the display unit tends to increase. When the amount of information displayed on the display unit increases, in the display system described in Patent Document 1, the driver may look at the display unit more frequently or for a longer period of time. As a result, this may lead to a decrease in the driver's attention to the surrounding environment. The present disclosure provides a technology that appropriately reduces the frequency with which the driver looks at the display unit when the degree of automation of the driving task decreases due to a change in driving mode compared to before the mode change. [Means for solving the problem]

[0005] A display system according to one embodiment of the present disclosure is a system mounted on a vehicle that runs in a driving mode selected from a plurality of driving modes having different degrees of automation of driving tasks. The display system includes a display unit and a control unit. The display unit displays information to the driver. When a change in driving mode reduces the degree of automation compared to before the mode change, the control unit performs at least one of making the update cycle of predetermined information displayed on the display unit longer than before the mode change and reducing the visibility of the predetermined information compared to before the mode change.

[0006] According to this display system, when the degree of automation of the driving task is reduced by changing the driving mode compared to before the mode change, at least one of the following is executed: the update cycle of the predetermined information displayed on the display unit is made longer than before the mode change, and the visibility of the predetermined information is reduced compared to before the mode change. When the degree of automation of the driving task is reduced by changing the driving mode compared to before the mode change, the driver needs to pay more attention to the surroundings of the vehicle than before the mode change. On the display unit, information with a long update cycle and information with reduced visibility can be suppressed from attracting the driver's attention. Therefore, this display system can appropriately suppress the frequency with which the driver looks at the display unit when the degree of automation of the driving task is reduced by changing the driving mode compared to before the mode change.

[0007] In one embodiment, the control unit may determine at least one of the timing to make the update cycle longer than before the mode change and the timing to make the visibility lower than before the mode change, depending on the difference in the degree of automation before and after the mode change. In this case, the display system can change at least one of the update cycle and the visibility at a timing according to the difference in the degree of automation before and after the mode change.

[0008] In one embodiment, the display system further includes a driver monitoring sensor, and the multiple driving modes include a basic driving mode in which the driver performs all or part of the driving task, and the control unit determines whether the driver of the vehicle is gazing at the display unit based on the detection result of the driver monitoring sensor when the vehicle runs in the basic driving mode, and may perform at least one of lengthening the update cycle and reducing the visibility when it is determined that the driver is gazing at the display unit. When the vehicle runs in the basic driving mode, the driver needs to pay attention to the surroundings of the vehicle. In the display unit, information with a long update cycle and information with reduced visibility can be suppressed from attracting the driver's attention. Therefore, this display system can suppress the driver from gazing at the display unit when the vehicle runs in the basic driving mode.

[0009] In one embodiment, when the vehicle runs in the basic driving mode, the control unit determines whether the driver is attracted to the display unit based on the detection result of the driver monitoring sensor, and when it is determined that the driver is attracted to the display unit, at least one of lengthening the update period and reducing the visibility may be executed, and when it is determined that the driver is gazing at the display unit, at least one of lengthening the update period and reducing the visibility may be executed compared to when it is determined that the driver is attracted to the display unit. In this display system, in both cases where the driver is attracted to the display unit and where the driver is gazing at the display unit, the information displayed on the display unit is suppressed from attracting the driver's attention. Furthermore, when it is determined that the driver is gazing at the display unit, at least one of lengthening the update period and reducing the visibility is executed compared to when it is determined that the driver is attracted to the display unit. In this way, this display system can execute at least one of lengthening the update period in stages and reducing the visibility in stages according to the driver's state.

[0010] In one embodiment, when the vehicle runs in the basic driving mode, the control unit determines whether the driver is being attracted to the display unit based on the detection result of the driver monitoring sensor, and when it is determined that the driver is being attracted to the display unit, the control unit may reduce visibility, and when it is determined that the driver is gazing at the display unit, the control unit may reduce visibility in a manner different from when it is determined that the driver is being attracted to the display unit. The manner of reducing visibility may be, for example, reducing brightness, reducing saturation, reducing contrast, adding blur, etc. This display system can reduce visibility by distinguishing between when the driver is gazing at the display unit and when the driver is being attracted to the display unit.

[0011] In one embodiment, when it is determined that the driver who has been gazing at the display unit has stopped gazing at the display unit, the control unit may determine the timing to return at least one of the update cycle and the visibility based on the period during which the driver has been gazing. In this case, the display system can return at least one of the update cycle and the visibility at a timing according to the period during which the driver has been gazing. Effect of the Invention

[0012] According to the present disclosure, a technology is provided that appropriately reduces the frequency with which a driver looks at a display when a change in driving mode reduces the degree of automation of a driving task compared to before the mode change. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a vehicle equipped with a display system according to an embodiment. [Diagram 2] FIG. 2 is an example of a screen of the display unit. [Diagram 3] (A) and (B) of FIG. 3 are examples of layers on the screen of the display unit. [Figure 4] (A) and (B) of FIG. 4 are examples of layers on the screen of the display unit. [Diagram 5]FIG. 5 is a graph showing the relationship between the degree of automation of the driving task and the update period. [Figure 6] (A) and (B) of FIG. 6 are examples of layers in which the visibility of information is reduced. [Figure 7] (A) and (B) of FIG. 7 are examples of screens in which the visibility of information is reduced. [Figure 8] FIGS. 8A and 8B show other examples of screens in which the visibility of information is reduced. [Figure 9] FIG. 9 is a graph showing the relationship between the degree of automation of the driving task and the level of visibility. [Figure 10] FIG. 10 is a flowchart showing an example of the operation of the display system. [Figure 11] FIG. 11 is a flowchart showing an example of the correction process. [Figure 12] FIG. 12 is a flowchart showing an example of the reflection timing determination process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0015] [Vehicle configuration] Fig. 1 is a block diagram showing an example of a configuration of a vehicle equipped with a display system according to an embodiment. As shown in Fig. 1, the display system 1 is mounted on a vehicle 2 as an example. The vehicle 2 is a vehicle that runs in a driving mode selected from a plurality of driving modes having different degrees of automation of driving tasks, for example.

[0016] The degree of automation of a driving task is an index that defines the driving task that the vehicle system performs autonomously. As the degree of automation of a driving task increases, the number or types of driving tasks that the vehicle system performs autonomously increases. Alternatively, as the degree of automation of a driving task increases, the extent to which the vehicle system performs autonomously in a certain driving task increases. Examples of driving tasks include braking, accelerating, and steering, as well as lane keeping, vehicle distance control, starting, stopping, lane changing, turning right or left, collision prevention, parking, and the like, which are realized by these operations.

[0017] The degree of automation of the driving task may be a general level of automated driving. The level of automated driving may be defined by the Society of Automotive Engineers, Inc. (SAE). For example, when the degree of automation of the driving task is 0, it means that the vehicle system does not intervene in the driving, and the driving is manual (Level 0). When the degree of automation of the driving task is 1 or 2, it means that the driving operation including the brake operation, the accelerator operation, and the steering operation is partially automated (Level 1 or 2). When the degree of automation of the driving task is 3 or 4, it means that all of the driving tasks are automated on the condition that the preset driving conditions are satisfied (Level 3 or 4). When the degree of automation of the driving task is 5, it means that all of the driving tasks are automated without condition setting (Level 5). Hereinafter, the method of driving at the above-mentioned degree of automation of the driving task is referred to as a driving mode. The driving modes include, for example, a manual driving mode in which the degree of automation of the driving task is 0, a first driving mode in which the degree of automation of the driving task is 1, a second driving mode in which the degree of automation of the driving task is 2, a third driving mode in which the degree of automation of the driving task is 3, a fourth driving mode in which the degree of automation of the driving task is 4, and a fifth driving mode in which the degree of automation of the driving task is 5.

[0018] The vehicle 2 is a vehicle capable of running in at least two driving modes. The multiple driving modes are two or more driving modes arbitrarily selected from a driving task automation degree of 0 to 5. For example, the vehicle 2 may be a vehicle capable of running in two driving modes in which the driving task automation degree is 0 and 1. The number of driving modes is not particularly limited as long as it is two or more. For example, the vehicle 2 may be a vehicle capable of running in six driving modes in which the driving task automation degree is 0 to 5. The vehicle 2 does not necessarily need to be capable of running in a driving mode in which the driving task automation degree is 0. For example, the vehicle 2 may be an autonomous vehicle capable of running in two driving modes in which the driving task automation degree is 3 and 5.

[0019] The vehicle 2 includes a driving ECU 22 for executing a plurality of driving modes with different degrees of automation of the driving task. The ECU (Electronic Control Unit) is an electronic control unit having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a CAN (Controller Area Network) communication circuit, etc. A driving mode with a driving task automation degree of 1 or more is realized by the driving ECU operating an actuator 23 of the vehicle 2 based on at least the detection results of the sensor group 21.

[0020] The sensor group 21 includes, for example, a sensor that detects the driving operation by the driver, a sensor that detects the surrounding environment of the vehicle 2, and a sensor that detects the running state of the vehicle 2. The sensors that detect the driving operation by the driver include, for example, a brake pedal sensor, an accelerator pedal sensor, and a steering wheel operation sensor. The sensors that detect the surrounding environment of the vehicle 2 include, for example, at least one of a camera and a radar sensor. The sensors that detect the running state of the vehicle 2 include, for example, a GPS receiver, a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor. The sensor group 21 may include sensors that detect information on the surrounding environment of the vehicle 2 or information on the state of the vehicle 2, such as an air temperature sensor that detects the outside air temperature, a sensor that measures fuel, and a coolant temperature sensor.

[0021] The actuators 23 are devices used for driving control of the vehicle 2. The actuators 23 include at least a drive actuator, a brake actuator, and a steering actuator.

[0022] [Display system configuration] The display system 1 includes, for example, a driver monitoring sensor 3, a memory unit 4, a display ECU 5 (an example of a control unit), and a display unit 6. The driver monitoring sensor 3 is configured to detect the driver's reaction. For example, the driver monitoring sensor 3 is a camera that captures an image of the driver. The driver's line of sight is detected based on the detection result of the driver monitoring sensor 3. The memory unit 4 is a storage device that stores information necessary for controlling the display ECU 5. The display unit 6 is a device that displays information to the driver, and is, for example, a display.

[0023] The display ECU 5 is connected to the driver monitoring sensor 3, the storage unit 4, and the display unit 6. The display ECU 5 is an electronic control unit having a CPU, a ROM, a RAM, a CAN communication circuit, etc. The display ECU 5 may be an ECU formed by integrating a plurality of ECUs. The display ECU 5 displays information based on the detection results of the sensor group 21 on the display unit 6. The display ECU 5 is connected to the sensor group 21 and directly acquires the detection results of the sensor group 21 from the sensor group 21. The display ECU 5 may be connected to the driving ECU 22 and indirectly acquire the detection results of the sensor group 21 via the driving ECU 22.

[0024] FIG. 2 is an example of a screen of the display unit. As shown in FIG. 2, the display ECU 5 causes the display unit 6 to display information based on the detection results of the sensor group 21. A plurality of pieces of information are displayed on the screen G1 of the display unit 6. The display ECU 5 updates the information displayed on the screen G1 at a predetermined cycle. The display ECU 5 configures the screen G1, for example, by overlapping a plurality of layers. Each layer includes one or a plurality of displays. The display ECU 5 can easily update the information displayed on the screen G1 by updating the display for each layer.

[0025] (A) and (B) of Fig. 3 and (A) and (B) of Fig. 4 are examples of layers of the screen of the display unit. As an example, the screen G1 shown in Fig. 2 is composed of four layers: a first layer L1 shown in Fig. 3 (A), a second layer L2 shown in Fig. 3 (B), a third layer L3 shown in Fig. 4 (A), and a fourth layer L4 shown in Fig. 4 (B). The display and the number of layers included in each layer are examples and are not limited to these.

[0026] As shown in (A) of Fig. 3, the first layer L1 includes a speed display D1 and a set speed display D2. The speed display D1 indicates the current vehicle speed, which is the detection result of the sensor group 21. The speed display D1 may be required to be displayed by law. The set speed display D2 indicates the set speed for vehicle distance control performed by the driving ECU 22.

[0027] 3B, the second layer L2 includes a surroundings display D3. The surroundings display D3 is a schematic diagram generated based on the detection results of the sensor group 21, and shows vehicles existing around the vehicle 2.

[0028] As shown in (A) of FIG. 4, the third layer L3 includes a navigation information display D4, a vehicle-to-vehicle control ON display D5, a lane keeping control ON display D6, a shift position display D7, a water temperature display D8, and a remaining fuel display D9. The navigation information display D4 shows guidance information obtained from a navigation system (not shown). The vehicle-to-vehicle control ON display D5 shows that vehicle-to-vehicle control performed by the driving ECU 22 is ON. The lane keeping control ON display D6 shows that lane keeping control performed by the driving ECU 22 is ON. The shift position display D7 shows the current shift position. The water temperature display D8 shows the temperature of the engine coolant. The remaining fuel display D9 shows the remaining amount of fuel.

[0029] As shown in (B) of Fig. 4, the fourth layer L4 includes an outside temperature display D10, a fuel efficiency display D11, a mileage display D12, and a clock display D13. The outside temperature display D10 indicates the temperature of the outside air of the vehicle 2. The fuel efficiency display D11 indicates the fuel efficiency measured from when the ignition is turned on. The mileage display D12 indicates the total mileage of the vehicle 2. The clock display D13 indicates the current time.

[0030] The display ECU 5 acquires information from at least one of the sensor group 21 and the driving ECU 22, and updates the displays included in the first layer L1 to the fourth layer L4. The display ECU 5 can set the update period for each layer. For example, the update period for the first layer L1 and the second layer L2 can be set to 50 ms, the update period for the third layer L3 to 200 ms, and the update period for the fourth layer L4 to 800 ms. As a result, the speed display D1, the set speed display D2, and the surroundings display D3 displayed on the screen G1 of the display unit 6 are updated every 50 ms. Similarly, the navigation information display D4, the vehicle distance control ON display D5, the lane keeping control ON display D6, the shift position display D7, the water temperature display D8, and the remaining fuel display D9 displayed on the screen G1 of the display unit 6 are updated every 200 ms. In addition, the outside air temperature display D10, the fuel efficiency display D11, the mileage display D12, and the clock display D13 are updated every 800 ms.

[0031] When the degree of automation is reduced by changing the driving mode compared to before the mode change, the display ECU 5 executes at least one of making the update cycle of the predetermined information displayed on the display unit 6 longer than before the mode change and lowering the visibility of the predetermined information compared to before the mode change. The details of the operation will be described below.

[0032] The display ECU 5 determines that the change in the driving mode has reduced the degree of automation compared to before the mode change. For example, the display ECU 5 acquires information related to the driving mode being executed from the driving ECU 22 and stores the information in the storage unit 4. Next, the display ECU 5 further acquires information related to the driving mode being executed from the driving ECU 22 and compares the degree of automation related to the acquired driving mode (the current degree of automation) with the degree of automation related to the driving mode stored in the storage unit 4 (the degree of automation at the time of the previous acquisition).

[0033] When the current degree of automation is lower than the degree of automation previously acquired, the display ECU 5 determines that the change in driving mode has reduced the degree of automation compared to before the mode change. In this way, when the change in driving mode has reduced the degree of automation compared to before the mode change, it means that the driving mode has been changed to a driving mode with a lower degree of automation than the current driving mode. For example, this is the case when the degree of automation of the current driving mode is 2 and the degree of automation of the changed driving mode is 1. For example, this is the case when the degree of automation of the current driving mode is 3 and the degree of automation of the changed driving mode is 0.

[0034] The determination that the degree of automation has been reduced may be executed by the driving ECU 22. The display ECU 5 may acquire, from the driving ECU 22, information that the degree of automation has been reduced as a result of the change in the driving mode compared to before the mode change.

[0035] When the degree of automation is reduced, the display ECU 5 executes at least one of the following two operations. The first operation is to make the update cycle of the predetermined information displayed on the display unit 6 longer than that before the mode change. The predetermined information displayed on the display unit 6 is information selected from the information displayed on the display unit 6. The predetermined information may be, for example, information about the surrounding situation of the vehicle 2 (an example of information that moves and is likely to catch the eye). The predetermined information may be information that is not required by law to be displayed. The category of the predetermined information is stored, for example, in the memory unit 4.

[0036] The display ECU 5 makes the update period of the layer in which the predetermined information is displayed longer than that before the mode change. For example, the predetermined information is the peripheral display D3, and the update period of the second layer L2 including the peripheral display D3 before the mode change is 50 ms. When the degree of automation is reduced, the display ECU 5 changes the update period of the second layer L2 including the peripheral display D3 from 50 ms to, for example, 200 ms. As a result, the peripheral display D3, which was updated at intervals of 50 ms on the screen G1 of the display unit 6, is updated at intervals of 200 ms, so that continuous changes in the peripheral display D3 are suppressed while maintaining the display mode of other information, and visual stimulation to the driver is reduced. Therefore, it is possible to suppress the peripheral display D3 from attracting the driver's attention.

[0037] FIG. 5 is a graph showing the relationship between the degree of automation of the driving task and the update period. The horizontal axis is the degree of automation of the driving task, and the vertical axis is the update period of the information. The update period during manual driving (degree of automation 0) is set to T1. As shown by the data points of the white circles in FIG. 5, the smaller the degree of automation of the driving task, the longer the update period is set. Alternatively, as shown by the data points of the black circles in FIG. 5, the update period may be set to be longer in stages as the degree of automation of the driving task becomes smaller. The relationship shown in FIG. 5 is stored in advance in the storage unit 4. The display ECU 5 can refer to the storage unit 4 and determine the update period according to the degree of automation. The graph shown in FIG. 5 may be provided for each layer. In this case, the display ECU 5 can control the change in the update period for each layer.

[0038] The second operation is to reduce the visibility of the predetermined information displayed on the display unit 6 compared to before the mode change. Methods for reducing the visibility include, for example, reducing the brightness, reducing the saturation, reducing the contrast, and adding blurring. The display ECU 5 reduces the visibility of the layer in which the predetermined information is displayed compared to before the mode change. For example, it is assumed that the predetermined information is the peripheral display D3. When the degree of automation is reduced, the display ECU 5, for example, adds blurring to the second layer L2 including the peripheral display D3.

[0039] (A) and (B) of FIG. 6 are examples of layers with reduced visibility of information. As shown in (A) of FIG. 6, blurring (transparency 40%) is applied to the entire second layer L2, resulting in the second layer L21. In the second layer L21, the peripheral display D3 becomes difficult to see. If the degree of automation is further reduced, as shown in (B) of FIG. 6, an even stronger blurring (transparency 10%) is applied to the entire second layer L2, resulting in the second layer L22. In the second layer L22, the peripheral display D3 becomes even more difficult to see.

[0040] (A) and (B) of FIG. 7 are examples of screens in which the visibility of information is reduced. Screen G2 of FIG. 7 (A) is a screen configured using the second layer L21 of FIG. 6 (A). As shown in FIG. 7 (A), the peripheral display D3 is presented to the driver in a state in which it is difficult to see. Screen G3 of FIG. 7 (B) is a screen configured using the second layer L22 of FIG. 6 (B). As shown in FIG. 7 (B), the peripheral display D3 is presented to the driver in a state in which it is even more difficult to see. By changing the peripheral display D3 on the screen to a state in which it is difficult to see, it is possible to prevent the peripheral display D3 from attracting the driver's attention while maintaining the display mode of other information.

[0041] The display to be reduced in visibility is not limited to the peripheral display D3. For example, the visibility of the display related to the fourth layer L4 may be reduced. (A) and (B) of FIG. 8 are other examples of screens in which the visibility of information is reduced. The screen G4 of FIG. 8 (A) is a screen configured by adding blurring to the fourth layer L4 of FIG. 4 (B). As shown in FIG. 8 (A), the outside temperature display D10, the fuel consumption display D11, the mileage display D12, and the clock display D13 are presented to the driver in a state in which they are difficult to see. The screen G5 of FIG. 8 (B) is a screen configured by adding even stronger blurring to the fourth layer L4 of FIG. 4 (B). As shown in FIG. 8 (B), the outside temperature display D10, the fuel consumption display D11, the mileage display D12, and the clock display D13 are presented to the driver in a state in which they are even more difficult to see.

[0042] FIG. 9 is a graph showing the relationship between the degree of automation of the driving task and the level of visibility. The horizontal axis is the degree of automation of the driving task, and the vertical axis is the level of visibility. The level of visibility during manual driving (level of automation 0) is V1. As shown by the white circle data points in FIG. 9, the lower the level of automation of the driving task, the lower the visibility is set. Alternatively, as shown by the black circle data points in FIG. 9, the lower the visibility may be set in stages as the level of automation of the driving task becomes smaller. The relationship shown in FIG. 9 is stored in advance in the storage unit 4. The display ECU 5 can refer to the storage unit 4 and determine the visibility according to the level of automation. The graph shown in FIG. 9 may be provided for each layer. In this case, the display ECU 5 can control the change in visibility for each layer.

[0043] The display ECU 5 can change both the update period and the visibility, which can further reduce the driver's attention being drawn to certain information.

[0044] The display ECU 5 may determine at least one of the timing to make the update period longer than before the mode change (first reflection timing) and the timing to make the visibility lower than before the mode change (second reflection timing) according to the difference between the degree of automation before and after the mode change. For example, if the degree of automation before the mode change is 4 and the degree of automation after the mode change is 3, the difference between the degree of automation before and after the mode change is 1. For example, if the degree of automation before the mode change is 3 and the degree of automation after the mode change is 0, the difference between the degree of automation before and after the mode change is 3.

[0045] The initial values ​​of the first reflection timing and the second reflection timing are stored in advance in the storage unit 4. As an example, the display ECU 5 sets at least one of the first reflection timing and the second reflection timing to be shorter than the initial value as the difference in the degree of automation before and after the mode change increases. This allows the driver to immediately pay attention to the surroundings of the vehicle when the degree of automation drops significantly due to the mode change.

[0046] [Operation that takes into account the driver's line of sight] When the driving mode of the vehicle 2 is a driving mode in which the driver performs all or part of the driving task (an example of a basic driving mode), the driver needs to monitor the surroundings of the vehicle 2 more carefully and needs to avoid being attracted to or gazing at the display unit 6. Note that attracting eyes means a state in which the driver looks at the display unit 6 frequently in a predetermined period of time, and gazing at the display unit 6 means a state in which the driver looks at the display unit 6 for a predetermined period of time or more. The basic driving mode is, as an example, a driving mode corresponding to a degree of automation of 0 to 2.

[0047] When the vehicle 2 is traveling in the basic driving mode, the display ECU 5 determines whether or not the driver of the vehicle 2 is gazing at the display unit 6 based on the detection result of the driver monitoring sensor 3. The display ECU 5 detects the driver's line of sight from the detection result of the driver monitoring sensor 3, and determines whether or not the driver is gazing at the display unit 6 based on the detected line of sight, the position of the display unit 6, and the time when the position of the display unit 6 overlaps with the line of sight direction.

[0048] When it is determined that the driver is gazing at the display unit 6, the display ECU 5 executes at least one of lengthening the update period and decreasing the visibility. As in the above-mentioned method, the display ECU 5 lengthens the update period of predetermined information, decreases the visibility of predetermined information, or executes both. When it is determined that the driver is gazing at the display unit 6, it can be expected that the driver's attention to the surrounding environment of the vehicle 2 is decreasing. The display ECU 5 can urge the driver who is gazing at the display unit 6 to pay attention to the surrounding environment of the vehicle 2.

[0049] The display ECU 5 may change the display on the display unit 6 when there is not only a driver who is gazing at the vehicle but also a driver who is being attracted to the vehicle.

[0050] When the vehicle 2 runs in the basic driving mode, the display ECU 5 determines whether or not the driver of the vehicle 2 is attracted to the display unit 6 based on the detection result of the driver monitoring sensor 3. The display ECU 5 detects the driver's line of sight from the detection result of the driver monitoring sensor 3, and determines whether or not the driver is attracted to the display unit 6 based on the detected line of sight, the position of the display unit 6, and the time when the position of the display unit 6 overlaps with the line of sight direction.

[0051] When it is determined that the driver is attracted to the display unit 6, the display ECU 5 executes at least one of lengthening the update period and decreasing the visibility. As in the above-mentioned method, the display ECU 5 lengthens the update period of predetermined information, decreases the visibility of predetermined information, or executes both. When it is determined that the driver is attracted to the display unit 6, it can be expected that the driver's attention to the surrounding environment of the vehicle 2 is decreasing. The display ECU 5 can urge the driver who is attracted to the display unit 6 to pay attention to the surrounding environment of the vehicle 2.

[0052] When the driver is gazing at the display unit 6, it is more likely that the driver is immersed in the display unit 6 than when the driver is attracted to the display unit 6. For this reason, when it is determined that the driver is gazing at the display unit 6, the display ECU 5 may execute at least one of lengthening the update cycle and decreasing the visibility compared to when it is determined that the driver is attracted to the display unit 6. In this way, the display ECU 5 can lengthen the update cycle of predetermined information and decrease the visibility of predetermined information, or execute both, in stages according to the degree of immersion of the driver.

[0053] When it is determined that the driver is gazing at the display unit 6, the display ECU 5 may reduce the visibility in a manner different from that when it is determined that the driver is attracted to the display unit 6. The manner of reducing the visibility may be reducing the brightness, reducing the saturation, reducing the contrast, or adding blurring. For example, when it is determined that the driver is attracted to the display unit 6, the display ECU 5 may reduce the saturation of the predetermined information, and further, when it is determined that the driver is gazing at the display unit 6, the display ECU 5 may reduce the contrast of the predetermined information. In this way, the display ECU 5 can reduce the visibility of the predetermined information in stages according to the degree of immersion of the driver. In addition, by using different modes for attracting and gazing, it is possible to provide a range of display changes, and therefore it is possible to provide a mode that is easy for the driver to understand.

[0054] When it is determined that the driver who has been gazing at the display unit 6 has stopped gazing at the display unit 6, the display ECU 5 may determine the timing (return timing) to return at least one of the update cycle and the visibility based on the period during which the driver gazed. An initial value of the return timing is stored in the storage unit 4 in advance. It is expected that the longer the period during which the driver gazed, the greater the degree of immersion in the display unit 6. For this reason, the display ECU 5 sets the return timing to be longer than the initial value the longer the period during which the driver gazed. This allows the display ECU 5 to suppress the driver from starting to gaze at the display unit 6 immediately after directing his / her attention to the surroundings of the vehicle 2.

[0055] [Display System Behavior] Fig. 10 is a flowchart showing the operation of the display system 1. The flowchart shown in Fig. 10 starts when the display system 1 receives a system start instruction operation.

[0056] As shown in Fig. 10, first, the display ECU 5 of the display system 1 determines the update period and / or visibility according to the degree of automation of the driving mode (step S10). The display ECU 5 determines the update period and / or visibility corresponding to the degree of automation related to the current driving mode, for example, by using a graph showing the relationship between the degree of automation of the driving task and the update period shown in Fig. 5, or a graph showing the relationship between the degree of automation of the driving task and the visibility level shown in Fig. 9.

[0057] Next, the display ECU 5 corrects the update period and / or visibility in accordance with the state of the driver (step S12). Details of the correction process in step S12 are shown in Fig. 11. Fig. 11 is a flowchart showing an example of the correction process.

[0058] 11, the display ECU 5 first determines whether the vehicle is running in the basic driving mode (step S120). When the degree of automation related to the driving mode acquired from the driving ECU 22 is 0 to 2, the display ECU 5 determines that the vehicle is running in the basic driving mode.

[0059] When it is determined that the vehicle 2 is traveling in the basic driving mode (step S120: YES), the display ECU 5 determines whether or not the driver is gazing at the display unit 6 (step S122). Based on the detection result of the driver monitoring sensor 3, when the direction of the driver's line of sight and the position of the display unit 6 overlap for a threshold time or more, the display ECU 5 determines that the driver is gazing at the display unit 6.

[0060] When it is determined that the driver is gazing at the display unit 6 (step S122: YES), the display ECU 5 determines to lengthen the update period and / or to reduce the visibility (step S124). That is, the display ECU 5 determines to correct the update period determined in step S10 of Fig. 10 so as to lengthen it and / or to correct the visibility determined in step S10 of Fig. 10 so as to reduce it. The correction in step S124 (correction in the case of gazing) is set to a larger degree than the correction in step S128 (correction in the case of eye attraction) described later.

[0061] When it is determined that the driver is not gazing at the display unit 6 (step S122: NO), the display ECU 5 determines whether or not the driver is attracted to the display unit 6 (step S126). Based on the detection result of the driver monitoring sensor 3, when the number of times that the driver's line of sight direction and the position of the display unit 6 overlap per unit time is equal to or greater than a threshold value, the display ECU 5 determines that the driver is attracted to the display unit 6.

[0062] When it is determined that the driver is attracted to the display unit 6 (step S126: YES), the display ECU 5 determines to lengthen the update period and / or to reduce the visibility (step S128). That is, the display ECU 5 determines to correct the update period determined in step S10 of Fig. 10 so as to lengthen it and / or to correct the visibility determined in step S10 of Fig. 10 so as to reduce it. The correction in step S128 (correction in case of attraction) is set to a smaller degree than the correction in step S124 (correction in case of gaze).

[0063] When step S124 is completed, when step S128 is completed, when it is determined that the vehicle 2 is not traveling in the basic driving mode (step S120: NO), and when it is determined that the driver is not attracted to the display unit 6 (step S126: NO), the correction process shown in FIG. 11 is completed.

[0064] Returning to Fig. 10, the display ECU 5 determines the update period and / or the reflection timing of the visibility (step S14). Details of the reflection timing determination process in step S14 are shown in Fig. 12. Fig. 12 is a flowchart showing an example of the reflection timing determination process.

[0065] 12, the display ECU 5 first determines whether or not there is a change in the driving mode (step S140). When the driving mode acquired from the driving ECU 22 is different from the driving mode stored in the storage unit 4, the display ECU 5 determines that there is a change in the driving mode.

[0066] When it is determined that the driving mode has been changed (step S140: YES), the display ECU 5 calculates the difference in the degree of automation before and after the mode change. Then, the display ECU 5 determines the timing according to the calculated difference (step S142). For example, the display ECU 5 sets the timing to be shorter than the initial value as the difference in the degree of automation before and after the mode change becomes larger.

[0067] When step S142 is completed, or when it is determined that the driving mode has not been changed (step S140: NO), the display ECU 5 determines whether the gaze period and / or the attention period has ended (step S144). The display ECU 5 determines whether the gaze period and / or the attention period has ended based on the detection result of the driver monitoring sensor 3.

[0068] When it is determined that the gaze period and / or the attraction period has ended (step S144: YES), the display ECU 5 determines the timing to return the display (return timing) based on the gaze period and / or the attraction period (step S146). The longer the period during which the driver gazes, the longer the return timing is set by the display ECU 5 than the initial value.

[0069] When step S146 is completed, or when it is determined that the gaze period and / or the attraction period has not ended (step S144: NO), the reflection timing determination process shown in FIG. 12 is completed.

[0070] Returning to Fig. 10, the display ECU 5 displays information on the display unit 6 at the update period and / or visibility determined in steps S10 and S12 and at the timing (reflection timing or return timing) determined in step S14 (step S16). When step S16 ends, the flowchart shown in Fig. 10 ends. The display ECU 5 restarts the flowchart shown in Fig. 10 from the beginning until the end condition is satisfied.

[0071] [Summary of the embodiment] According to the display system 1, when the degree of automation of the driving task is reduced by changing the driving mode compared to before the mode change, at least one of the following is executed: the update cycle of the predetermined information displayed on the display unit 6 is made longer than before the mode change, and the visibility of the predetermined information is reduced compared to before the mode change. When the degree of automation of the driving task is reduced by changing the driving mode compared to before the mode change, the driver needs to pay more attention to the surroundings of the vehicle than before the mode change. On the display unit 6, information with a long update cycle and information with reduced visibility can be suppressed from attracting the driver's attention. Therefore, the display system 1 can appropriately suppress the frequency with which the driver looks at the display unit 6 when the degree of automation of the driving task is reduced by changing the driving mode compared to before the mode change.

[0072] Although exemplary embodiments have been described above, various omissions, substitutions, and modifications may be made without being limited to the above-described exemplary embodiments.

[0073] For example, the display system 1 may execute the above-mentioned control to suppress attracting the driver's attention on the condition that the current degree of automation is within a range of a predetermined degree of automation. The range of the predetermined degree of automation is set in advance to define the range in which the above-mentioned control to suppress attracting the driver's attention is executed. For example, the range of the predetermined degree of automation may be a range of 0 to 1, a range of 0 to 2, or a range of 0 to 3. When the degree of automation is reduced by changing the driving mode within the above-mentioned range of the predetermined degree of automation compared to before the mode change, the display system 1 executes at least one of making the update cycle of the predetermined information displayed on the display unit 6 longer than before the mode change and reducing the visibility of the predetermined information compared to before the mode change.

[0074] For example, in the case where the range of the above-mentioned predetermined degree of automation is 0 to 2, when the degree of automation of the driving task is reduced from 2 to 1, at least one of the following is executed: the update period of the predetermined information displayed on the display unit 6 is made longer than that before the mode change, and the visibility of the predetermined information is made lower than that before the mode change. Furthermore, when the degree of automation of the driving task is reduced from 1 to 0, at least one of the following may be executed: the update period of the predetermined information displayed on the display unit 6 is made longer than that before the mode change, and the visibility of the predetermined information is made lower than that before the mode change. That is, in the graph of FIG. 5, when the degree of automation of the task is in the range of 0 to 2, the update period may be monotonically decreased or gradually decreased. When the degree of automation of the task is in the range of 3 to 5, the update period may be set arbitrarily. For example, the update period may be monotonically decreased or gradually decreased as shown in the graph of FIG. 5, or, in contrast to the graph of FIG. 5, the update period may be monotonically increased or gradually increased, or the update period may be a constant value. Similarly, in the graph of Fig. 9, the visibility level may increase monotonically or gradually when the degree of task automation is in the range of 0 to 2. When the degree of task automation is in the range of 3 to 5, the visibility level may be set arbitrarily. For example, as shown in the graph of Fig. 9, the visibility level may increase monotonically or gradually, or, in contrast to the graph of Fig. 9, the visibility level may decrease monotonically or gradually, or the visibility level may be a constant value.

[0075] This disclosure also includes the following provisions: [Clause 1] A display system mounted on a vehicle traveling in a driving mode selected from a plurality of driving modes having different degrees of automation of a driving task, A display unit that displays information to a driver; a control unit that, when a degree of automation is reduced by the change of the driving mode compared to before the mode change, executes at least one of making an update cycle of predetermined information displayed on the display unit longer than before the mode change and making visibility of the predetermined information lower than before the mode change; and A display system comprising: [Clause 2] The display system described in clause 1, wherein the control unit determines at least one of the timing to make the update period longer than before the mode change and the timing to reduce the visibility compared to before the mode change depending on the difference in the degree of automation before and after the mode change. [Clause 3] Further comprising a driver monitoring sensor; The plurality of driving modes includes a basic driving mode in which a driver performs all or a part of a driving task; The control unit is When the vehicle is traveling in the basic driving mode, it is determined whether or not a driver of the vehicle is gazing at the display unit based on a detection result of the driver monitoring sensor; A display system as described in clause 1 or 2, which, when it is determined that the driver is gazing at the display unit, performs at least one of lengthening the update period and reducing the visibility. [Article 4] The control unit is When the vehicle is traveling in the basic driving mode, it is determined whether or not the driver is attracted to the display unit based on a detection result of the driver monitoring sensor; When it is determined that the driver is attracted to the display unit, at least one of lengthening the update period and reducing the visibility is executed; The display system described in clause 3, wherein when it is determined that the driver is gazing at the display unit, at least one of making the update period longer and reducing the visibility is performed compared to when it is determined that the driver is being attracted to the display unit. [Article 5] The control unit is When the vehicle is traveling in the basic driving mode, it is determined whether or not the driver is attracted to the display unit based on a detection result of the driver monitoring sensor; When it is determined that the driver is attracted to the display unit, the visibility is reduced, A display system as described in clause 3 or 4, wherein when it is determined that the driver is gazing at the display unit, the visibility is reduced in a manner different from when it is determined that the driver is being attracted to the display unit. [Article 6] The control unit is The display system according to any one of claims 3 to 5, wherein when it is determined that the driver, who had been gazing at the display unit, has stopped gazing at the display unit, the timing for restoring at least one of the update period and the visibility is determined based on the period during which the driver was gazing. [Explanation of symbols]

[0076] 1...display system, 2...vehicle, 3...driver monitoring sensor, 4...storage unit, 5...display ECU (an example of a control unit), 6...display unit.

Claims

1. A display system mounted on a vehicle traveling in a driving mode selected from a plurality of driving modes having different degrees of automation of a driving task, A display unit that displays information to a driver; a control unit that, when a degree of automation is reduced by the change of the driving mode compared to before the mode change, executes at least one of making an update cycle of predetermined information displayed on the display unit longer than before the mode change and making visibility of the predetermined information lower than before the mode change; and A display system comprising:

2. The display system of claim 1 , wherein the control unit determines at least one of the timing to make the update period longer than before the mode change and the timing to reduce the visibility compared to before the mode change depending on the difference in the degree of automation before and after the mode change.

3. Further comprising a driver monitoring sensor; The plurality of driving modes includes a basic driving mode in which a driver performs all or a part of a driving task; The control unit is When the vehicle is traveling in the basic driving mode, it is determined whether or not a driver of the vehicle is gazing at the display unit based on a detection result of the driver monitoring sensor; 3. The display system according to claim 1, further comprising: a display unit configured to display a display image of a vehicle according to claim 1, the display unit being configured to display a display image of a vehicle according to claim 2, the display unit being configured to display a display image of a vehicle according to claim 3, the display unit being configured to display a display image of a vehicle according to claim 1, the display unit being configured to display a display image of a vehicle according to claim 2, the display unit being configured to display a display image of a vehicle according to claim 1

4. The control unit is When the vehicle is traveling in the basic driving mode, it is determined whether or not the driver is looking at the display unit based on a detection result of the driver monitoring sensor; When it is determined that the driver is attracted to the display unit, at least one of lengthening the update period and reducing the visibility is executed; 4. The display system according to claim 3, wherein when it is determined that the driver is gazing at the display unit, at least one of making the update period longer and reducing the visibility is performed compared to when it is determined that the driver is being attracted to the display unit.

5. The control unit is When the vehicle is traveling in the basic driving mode, it is determined whether or not the driver is looking at the display unit based on a detection result of the driver monitoring sensor; When it is determined that the driver is attracted to the display unit, the visibility is reduced, The display system according to claim 3, wherein when it is determined that the driver is gazing at the display unit, the visibility is reduced in a manner different from when it is determined that the driver is being attracted to the display unit.

6. The control unit is The display system of claim 3, further comprising: a display unit configured to display a display image of a vehicle that is moving in a direction parallel to the display screen; a display unit configured to display a display image of the vehicle that is moving in a direction parallel to the display screen;

Citation Information

Patent Citations

  • Display device for vehicle

    JP2002274218A

  • Display device, method, and program

    JP2007249567A

  • On-vehicle information display control device

    JP2015217798A

  • Speedometer control system and speedometer control program

    JP2019203846A

  • Display device, display control method, and program

    JP2020024578A