Presentation system

Abstract

To provide technology to appropriately reduce the frequency with which a driver looks at the display when the degree of automation of driving tasks is reduced from before a mode change due to a change in the driving mode.SOLUTION: A display system includes: a display unit installed in a vehicle traveling in an operation mode selected from a plurality of operation modes with different degrees of automation of driving tasks and displaying information to a driver; and a control unit that performs, when the degree of automation is reduced by changing the driving mode from that before the mode change, at least one of processes for making an update cycle of predetermined information displayed on the display unit longer than that before the mode change, and making the predetermined information less visible than that before the mode change.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a display system.

Background Art

[0002] Patent Document 1 discloses a display system for a vehicle. This system is mounted on a vehicle that travels in a driving mode selected from a manual driving mode, an autonomous driving mode that requires constant monitoring, and an autonomous driving mode that does not require constant monitoring. This system includes a display unit that displays the surrounding situation of the vehicle and a control unit that controls the display unit. The control unit switches the display range of the display unit according to the switching of the driving mode of the vehicle. The control unit sets the display range to a narrow range during the manual driving mode, to a medium range during the autonomous driving mode that requires constant monitoring, and to a wide range during the autonomous driving mode that does not require constant monitoring.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] With the advancement of driving assistance functions, the information displayed on the display unit tends to increase. When the information displayed on the display unit increases, in the display system described in Patent Document 1, the frequency with which the driver looks at the display unit may increase, or the time for which the driver looks at the display unit may become longer. As a result, there is a risk of a decrease in the driver's attention to the surrounding environment. The present disclosure provides a technique for appropriately suppressing the frequency with which the driver looks at the display unit when the degree of automation of the driving task decreases due to a change in the driving mode as compared with before the mode change.

Means for Solving the Problems

[0005] A display system according to an aspect of the present disclosure is a system mounted on a vehicle that travels in a driving mode selected from a plurality of driving modes with different degrees of automation of driving tasks. The display system includes a display unit and a control unit. The display unit displays information to the driver. When the degree of automation decreases compared to before the mode change due to the change of the driving mode, the control unit increases the update cycle of predetermined information displayed on the display unit compared to before the mode change, and / or reduces the visibility of the predetermined information compared to before the mode change, and executes at least one of them.

[0006] According to this display system, when the degree of automation decreases compared to before the mode change due to the change of the driving mode, at least one of increasing the update cycle of predetermined information displayed on the display unit compared to before the mode change and reducing the visibility of the predetermined information compared to before the mode change is executed. When the degree of automation of the driving task decreases compared to before the mode change due to the change of the driving mode, the driver needs to pay more attention to the surroundings of the vehicle than before the mode change. On the display unit, information with a long update cycle and information with reduced visibility can suppress attracting the driver's attention. Therefore, this display system can appropriately suppress the frequency with which the driver looks at the display unit when the degree of automation of the driving task decreases compared to before the mode change due to the change of the driving mode.

[0007] In one embodiment, the control unit may determine at least one of the timing to increase the update cycle compared to before the mode change and the timing to reduce the visibility compared to before the mode change according to the difference in the degree of automation before and after the mode change. In this case, the display system can change at least one of the update cycle and the visibility at a timing according to the difference in the degree of automation before and after the mode change.

[0008] In one embodiment, the display system further includes a driver monitoring sensor. The plurality of driving modes include a basic driving mode in which the driver performs all or part of the driving tasks. When the vehicle is traveling in the basic driving mode, the control unit determines whether the driver of the vehicle is looking at the display unit based on the detection result of the driver monitoring sensor. When it is determined that the driver is looking at the display unit, at least one of increasing the update period and reducing the visibility may be performed. When the vehicle is traveling in the basic driving mode, the driver needs to pay attention to the surroundings of the vehicle. Information with a long update period and information with reduced visibility on the display unit can suppress attracting the driver's attention. Therefore, this display system can suppress the driver from looking at the display unit when the vehicle is traveling in the basic driving mode.

[0009] In one embodiment, when the vehicle is traveling in the basic driving mode, the control unit determines whether the driver is being attracted to the display unit based on the detection result of the driver monitoring sensor. When it is determined that the driver is being attracted to the display unit, at least one of increasing the update period and reducing the visibility is performed. When it is determined that the driver is looking at the display unit, at least one of increasing the update period and reducing the visibility may be performed more than when it is determined that the driver is being attracted to the display unit. In this display system, in both the case where the driver is being attracted to the display unit and the case where the driver is looking at the display unit, the information displayed on the display unit is suppressed from attracting the driver's attention. Further, when it is determined that the driver is looking at the display unit, at least one of increasing the update period and reducing the visibility is performed more than when it is determined that the driver is being attracted to the display unit. Thus, this display system can perform at least one of increasing the update period step by step and reducing the visibility step by step according to the driver's state.

[0010] In one embodiment, when the vehicle is traveling in the basic driving mode, the control unit determines whether the driver is being attracted to the display unit based on the detection result of the driver monitoring sensor. If it is determined that the driver is being attracted to the display unit, the visibility is reduced. If it is determined that the driver is gazing at the display unit, the visibility may be reduced in a manner different from the case where it is determined that the driver is being attracted to the display unit. Modes of reducing visibility include, for example, reducing brightness, reducing saturation, reducing contrast, adding blur, and the like. This display system can distinguish between the case where the driver is gazing at the display unit and the case where the driver is being attracted to the display unit and reduce the visibility accordingly.

[0011] In one embodiment, when it is determined that the driver who was gazing at the display unit has stopped gazing at the display unit, the control unit may determine the timing to restore at least one of the update cycle and visibility based on the period during which the driver was gazing. In this case, the display system can restore at least one of the update cycle and visibility at a timing corresponding to the period during which the driver was gazing.

Advantages of the Invention

[0012] According to the present disclosure, there is provided a technique for appropriately suppressing the frequency with which the driver looks at the display unit when the degree of automation of the driving task decreases due to a change in the driving mode compared to before the mode change.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0015] [Configuration of Vehicle] FIG. 1 is a block diagram showing an example of the configuration of a vehicle equipped with a display system according to an embodiment. As shown in FIG. 1, the display system 1 is mounted on the vehicle 2 as an example. The vehicle 2 is a vehicle that travels in a driving mode selected from a plurality of driving modes with different degrees of automation of driving tasks, for example.

[0016] The degree of automation of driving tasks is an indicator that defines the driving tasks autonomously performed by a vehicle system. As the degree of automation of driving tasks increases, the number or types of driving tasks autonomously performed by the vehicle system increase. Alternatively, as the degree of automation of driving tasks increases, the range autonomously performed by the vehicle system in a certain driving task increases. Driving tasks include, as an example, braking operations, accelerator operations, and steering operations, as well as lane keeping, inter-vehicle control, starting, stopping, lane changing, turning right or left, collision avoidance, parking, etc. realized by these operations.

[0017] The degree of automation of driving tasks may be a general level of autonomous driving. The level of autonomous driving may be defined by the Society of Automotive Engineers, Inc. (SAE). For example, when the degree of automation of driving tasks is 0, it means that the vehicle system does not intervene in driving, and it is a manual driving (level 0). When the degree of automation of driving tasks is 1 or 2, it means that driving operations including braking operations, accelerator operations, and steering operations are in a state of partial automation (level 1 or 2). When the degree of automation of driving tasks is 3 or 4, it means that all driving tasks are in a state of full automation on the condition that preset driving conditions are met (level 3 or 4). When the degree of automation of driving tasks is 5, it means that all driving tasks are in a state of full automation without condition setting (level 5). Hereinafter, the method of driving with the above-described degree of automation of driving tasks is referred to as a driving mode. The driving mode includes, for example, a manual driving mode in which the degree of automation of driving tasks is 0, a first driving mode in which the degree of automation of driving tasks is 1, a second driving mode in which the degree of automation of driving tasks is 2, a third driving mode in which the degree of automation of driving tasks is 3, a fourth driving mode in which the degree of automation of driving tasks is 4, and a fifth driving mode in which the degree of automation of driving tasks is 5.

[0018] Vehicle 2 is a vehicle that can travel in at least two driving modes. The plurality of driving modes are two or more driving modes arbitrarily selected from 0 to 5 in terms of the degree of automation of driving tasks. For example, vehicle 2 may be a vehicle that can travel in two driving modes with the degree of automation of driving tasks being 0 and 1. The number of driving modes is not particularly limited as long as it is 2 or more. For example, vehicle 2 may be a vehicle that can travel in six driving modes with the degree of automation of driving tasks being 0 to 5. Vehicle 2 does not necessarily need to be able to travel in a driving mode with the degree of automation of driving tasks being 0. For example, vehicle 2 may be an autonomous vehicle that can travel in two driving modes with the degree of automation of driving tasks being 3 and 5.

[0019] Vehicle 2 is provided with a driving ECU 22 for executing a plurality of driving modes with different degrees of automation of driving tasks. An ECU (Electronic Control Unit) is an electronic control unit having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), CAN (Controller Area Network) communication circuit, and the like. The driving modes with the degree of automation of driving tasks being 1 or more are realized by the driving ECU operating the actuator 23 of vehicle 2 based on at least the detection results of the sensor group 21.

[0020] The sensor group 21 includes, as an example, sensors that detect driving operations by the driver, sensors that detect the surrounding environment of the vehicle 2, and sensors that detect the driving state of the vehicle 2. The sensors that detect driving operations by the driver include, for example, a brake pedal sensor, an accelerator pedal sensor, and a steering wheel operation sensor. The sensors that detect the surrounding environment of the vehicle 2 include at least one of, for example, a camera and a radar sensor. The sensors that detect the driving state of the vehicle 2 include, as an example, a GPS receiver, a vehicle speed sensor, an acceleration sensor, and a yaw rate sensor. The sensor group 21 may include sensors that detect information on the surrounding environment of the vehicle 2 or information on the state of the vehicle 2, such as an air temperature sensor that detects the outside air temperature, a sensor that measures fuel, and a water temperature sensor for cooling water.

[0021] The actuator 23 is a device used for the driving control of the vehicle 2. The actuator 23 includes at least a drive actuator, a brake actuator, and a steering actuator.

[0022] [Configuration of the display system] The display system 1 includes, as an example, a driver monitoring sensor 3, a storage unit 4, a display ECU 5 (an example of a control unit), and a display unit 6. The driver monitoring sensor 3 is configured to detect the driver's reaction. The driver monitoring sensor 3 is, for example, a camera that images the driver. Based on the detection result of the driver monitoring sensor 3, the driver's line of sight is detected. The storage unit 4 is a storage device that stores information necessary for the control of the display ECU 5. The display unit 6 is a device that displays information to the driver and is, for example, a display.

[0023] It is shown that the display ECU 5 is connected to the driver monitoring sensor 3, the memory unit 4, and the display unit 6. The display ECU 5 is an electronic control unit having a CPU, a ROM, a RAM, a CAN communication circuit, etc. The display ECU 5 may be an ECU formed by integrating a plurality of ECUs. The display ECU 5 causes the display unit 6 to display information based on the detection results of the sensor group 21. The display ECU 5 is connected to the sensor group 21 and directly obtains the detection results of the sensor group 21 from the sensor group 21. The display ECU 5 may be connected to the driving ECU 22 and indirectly obtain the detection results of the sensor group 21 via the driving ECU 22.

[0024] Figure 2 is an example of the screen of the display unit. As shown in Figure 2, the display ECU 5 causes the display unit 6 to display information based on the detection results of the sensor group 21. A plurality of pieces of information are displayed on the screen G1 of the display unit 6. The display ECU 5 updates the information displayed on the screen G1 at a predetermined cycle. The display ECU 5 constitutes the screen G1, for example, by overlapping a plurality of layers. Each layer includes one or a plurality of displays. The display ECU 5 can easily update the information displayed on the screen G1 by updating the displays for each layer.

[0025] (A) and (B) of Figure 3, and (A) and (B) of Figure 4 are examples of the layers of the screen of the display unit. The screen G1 shown in Figure 2 is constituted by four layers, namely, the first layer L1 shown in (A) of Figure 3, the second layer L2 shown in (B) of Figure 3, the third layer L3 shown in (A) of Figure 4, and the fourth layer L4 shown in (B) of Figure 4, as an example. The displays included in each layer and the number of layers, etc. are examples and are not limited thereto.

[0026] As shown in (A) of Figure 3, the first layer L1 includes a speed display D1 and a set speed display D2. The speed display D1 indicates the current vehicle speed, which is the detection result of the sensor group 21. The speed display D1 may be required to be displayed by law. The set speed display D2 indicates the set speed of the inter-vehicle control performed by the driving ECU 22.

[0027] As shown in (B) of FIG. 3, the second layer L2 includes a peripheral display D3. The peripheral display D3 is a schematic diagram generated based on the detection results of the sensor group 21 and shows vehicles existing around the vehicle 2.

[0028] As shown in (A) of FIG. 4, the third layer L3 includes a navigation information display D4, an inter-vehicle control ON display D5, a lane keeping control ON display D6, a shift position display D7, a water temperature display D8, and a fuel remaining amount display D9. The navigation information display D4 shows guidance information obtained from a navigation system (not shown). The inter-vehicle control ON display D5 indicates that the inter-vehicle control performed by the driving ECU 22 is in the ON state. The lane keeping control ON display D6 indicates that the lane keeping control performed by the driving ECU 22 is in the ON state. The shift position display D7 shows the current shift position. The water temperature display D8 shows the temperature of the engine cooling water. The fuel remaining amount display D9 shows the remaining amount of fuel.

[0029] As shown in (B) of FIG. 4, the fourth layer L4 includes an outside air temperature display D10, a fuel consumption display D11, a travel distance display D12, and a clock display D13. The outside air temperature display D10 shows the temperature of the outside air of the vehicle 2. The fuel consumption display D11 shows the fuel consumption measured from when the ignition is turned ON. The travel distance display D12 shows the total travel distance of the vehicle 2. The clock display D13 shows the current time.

[0030] The display ECU 5 acquires information from at least one of the sensor group 21 and the driving ECU 22, and updates the displays included in the first layer L1 to the fourth layer L4. The display ECU 5 can set the update period for each layer. For example, the update periods of the first layer L1 and the second layer L2 can be set to 50 ms, the update period of the third layer L3 can be set to 200 ms, and the update period of the fourth layer L4 can be set to 800 ms. As a result, the speed display D1, the set speed display D2, and the surrounding display D3 displayed on the screen G1 of the display unit 6 are updated every 50 ms. Similarly, the navigation information display D4, the inter-vehicle control ON display D5, the lane keeping control ON display D6, the shift position display D7, the water temperature display D8, and the remaining fuel amount display D9 displayed on the screen G1 of the display unit 6 are updated every 200 ms. Also, the outside air temperature display D10, the fuel consumption display D11, the travel distance display D12, and the clock display D13 are updated every 800 ms.

[0031] When the degree of automation decreases compared to before the mode change due to a change in the driving mode, the display ECU 5 executes at least one of increasing the update period of the predetermined information displayed on the display unit 6 compared to before the mode change and decreasing the visibility of the predetermined information compared to before the mode change. The details of the operation will be described below.

[0032] The display ECU 5 determines that the degree of automation has decreased compared to before the mode change due to a change in the driving mode. For example, the display ECU 5 acquires information regarding the currently executing driving mode from the driving ECU 22 and stores it in the storage unit 4. Subsequently, the display ECU 5 further acquires information regarding the currently executing driving mode from the driving ECU 22, and compares the degree of automation related to the acquired driving mode (the current degree of automation) with the degree of automation related to the driving mode stored in the storage unit 4 (the degree of automation at the time of the previous acquisition).

[0033] The display ECU 5 determines that when the current degree of automation is lower than the degree of automation at the previous acquisition, the change in the driving mode results in a decrease in the degree of automation compared to before the mode change. Thus, when the change in the driving mode results in a decrease in the degree of automation compared to before the mode change, it means that the driving mode has been changed to a driving mode with a lower degree of automation than the current driving mode. For example, when the degree of automation of the current driving mode is 2 and the degree of automation of the driving mode after the change is 1. For example, when the degree of automation of the current driving mode is 3 and the degree of automation of the driving mode after the change is 0.

[0034] The determination that the degree of automation has decreased may be executed by the driving ECU 22. The display ECU 5 may obtain from the driving ECU 22 that the change in the driving mode has resulted in a decrease in the degree of automation compared to before the mode change.

[0035] When the display ECU 5 determines that the degree of automation has decreased, it executes at least one of the following two operations. The first operation is to increase the update period of the predetermined information displayed on the display unit 6 compared to before the mode change. The predetermined information displayed on the display unit 6 is the information selected from the information displayed on the display unit 6. The predetermined information may be, for example, information regarding the surrounding situation of the vehicle 2 (an example of information that is moving and eye-catching). The predetermined information may be information that is not obligatory to be displayed by law. The category of the predetermined information is stored, for example, in the storage unit 4.

[0036] The display ECU 5 increases the update period of the layer on which predetermined information is displayed to be longer than before the mode change. For example, assume that the predetermined information is the peripheral display D3, and the update period of the second layer L2 including the peripheral display D3 before the mode change is 50 ms. When the degree of automation decreases, the display ECU 5 changes the update period of the second layer L2 including the peripheral display D3 from 50 ms to, for example, 200 ms. As a result, on the screen G1 of the display unit 6, the peripheral display D3 that was updated at intervals of 50 ms will be updated at intervals of 200 ms. Therefore, while maintaining the display mode of other information, continuous changes in the peripheral display D3 are suppressed, and the visual stimulus to the driver is reduced. Thus, it is possible to prevent the peripheral display D3 from attracting the driver's attention.

[0037] Figure 5 is a graph showing the relationship between the degree of automation of the driving task and the update period. The horizontal axis represents the degree of automation of the driving task, and the vertical axis represents the update period of the information. Let the update period during manual driving (degree of automation 0) be T1. As shown by the white circle data points in Figure 5, the smaller the degree of automation of the driving task, the longer the update period is set. Alternatively, as shown by the black circle data points in Figure 5, the update period may be set longer step by step as the degree of automation of the driving task decreases. The relationship shown in Figure 5 is stored in the storage unit 4 in advance. The display ECU 5 can refer to the storage unit 4 and determine the update period according to the degree of automation. Note that the graph shown in Figure 5 may be provided for each layer. In this case, the display ECU 5 can control the change in the update period for each layer.

[0038] The second operation is to reduce the visibility of the predetermined information displayed on the display unit 6 compared to before the mode change. Methods for reducing visibility include, for example, reducing brightness, reducing saturation, reducing contrast, adding blur, etc. The display ECU 5 reduces the visibility of the layer on which the predetermined information is displayed compared to before the mode change. For example, assume that the predetermined information is the peripheral display D3. When the degree of automation decreases, the display ECU 5 adds blur to the second layer L2 including the peripheral display D3, for example.

[0039] (A) and (B) of FIG. 6 are examples of layers with reduced visibility of information. As shown in (A) of FIG. 6, blurring (transparency 40%) is applied to the entire second layer L2, resulting in the second layer L21. In the second layer L21, the peripheral display D3 is in a state where it is difficult to see. When the degree of automation further decreases, as shown in (B) of FIG. 6, stronger blurring (transparency 10%) is applied to the entire second layer L2, resulting in the second layer L22. In the second layer L22, the peripheral display D3 is in an even more difficult-to-see state.

[0040] (A) and (B) of FIG. 7 are examples of screens with reduced visibility of information. The screen G2 in (A) of FIG. 7 is a screen configured using the second layer L21 in (A) of FIG. 6. As shown in (A) of FIG. 7, the peripheral display D3 is presented to the driver in a state where it is difficult to see. The screen G3 in (B) of FIG. 7 is a screen configured using the second layer L22 in (B) of FIG. 6. As shown in (B) of FIG. 7, the peripheral display D3 is presented to the driver in an even more difficult-to-see state. By changing the state of the peripheral display D3 on the screen to be difficult to see, while maintaining the display mode of other information, it is possible to suppress the peripheral display D3 from attracting the driver's attention.

[0041] The display subject to reduced visibility is not limited to the peripheral display D3. For example, the visibility of the display related to the fourth layer L4 may be reduced. (A) and (B) of FIG. 8 are other examples of screens with reduced visibility of information. The screen G4 in (A) of FIG. 8 is a screen configured by adding blurring to the fourth layer L4 in (B) of FIG. 4. As shown in (A) of FIG. 8, the outside air temperature display D10, fuel consumption display D11, driving distance display D12, and clock display D13 are presented to the driver in a state where they are difficult to see. The screen G5 in (B) of FIG. 8 is a screen configured by adding even stronger blurring to the fourth layer L4 in (B) of FIG. 4. As shown in (B) of FIG. 8, the outside air temperature display D10, fuel consumption display D11, driving distance display D12, and clock display D13 are presented to the driver in an even more difficult-to-see state.

[0042] FIG. 9 is a graph showing the relationship between the degree of automation of a driving task and the level of visibility. The horizontal axis represents the degree of automation of the driving task, and the vertical axis represents the level of visibility. Let V1 be the level of visibility during manual driving (degree of automation 0). As shown by the white circle data points in FIG. 9, the lower the degree of automation of the driving task, the lower the visibility is set. Alternatively, as shown by the black circle data points in FIG. 9, the visibility may be set lower step by step as the degree of automation of the driving task decreases. The relationship shown in FIG. 9 is stored in the storage unit 4 in advance. The display ECU 5 can determine the visibility according to the degree of automation by referring to the storage unit 4. Note that the graph shown in FIG. 9 may be provided for each layer. In this case, the display ECU 5 can control the change in visibility for each layer.

[0043] The display ECU 5 can also change both the update cycle and the visibility. In this case, it is possible to further suppress a predetermined piece of information from attracting the driver's attention.

[0044] The display ECU 5 may determine at least one of the timing (first reflection timing) to make the update cycle longer than before the mode change and the timing (second reflection timing) to reduce the visibility lower than before the mode change according to the difference in the degree of automation before and after the mode change. For example, when the degree of automation before the mode change is 4 and the degree of automation after the mode change is 3, the difference in the degree of automation before and after the mode change is 1. For example, when the degree of automation before the mode change is 3 and the degree of automation after the mode change is 0, the difference in the degree of automation before and after the mode change is 3.

[0045] The initial values of the first reflection timing and the second reflection timing are stored in the storage unit 4 in advance. As an example, the display ECU 5 sets at least one of the first reflection timing and the second reflection timing shorter than the initial value as the difference in the degree of automation before and after the mode change is larger. Thereby, when the degree of automation drops significantly due to a mode change, the driver can be immediately made to pay attention to the surroundings of the vehicle.

[0046] [Operation Considering Driver's Line of Sight] When the driving mode of the vehicle 2 is a driving mode (an example of the basic driving mode) in which the driver executes all or part of the driving tasks, the driver needs to monitor the surroundings of the vehicle 2 more carefully and avoid being attracted to or gazing at the display unit 6. Note that being attracted means a state of high visual frequency within a predetermined period, and gazing means a state of visual fixation for a predetermined time or more. The basic driving mode is, as an example, a driving mode corresponding to an automation level of 0 to 2.

[0047] When the vehicle 2 is traveling in the basic driving mode, the display ECU 5 determines whether the driver of the vehicle 2 is gazing at the display unit 6 based on the detection result of the driver monitoring sensor 3. The display ECU 5 detects the line-of-sight direction of the driver from the detection result of the driver monitoring sensor 3, and determines whether the driver is gazing at the display unit 6 based on the detected line-of-sight direction, the position of the display unit 6, and the time during which the position of the display unit 6 overlaps with the line-of-sight direction.

[0048] When it is determined that the driver is gazing at the display unit 6, the display ECU 5 executes at least one of lengthening the update period and reducing the visibility. The display ECU 5 lengthens the update period of the predetermined information, reduces the visibility of the predetermined information, or executes both of these, in the same manner as the method described above. When it is determined that the driver is gazing at the display unit 6, it can be expected that the driver's attention to the surrounding environment of the vehicle 2 is reduced. The display ECU 5 can prompt the driver gazing at the display unit 6 to direct attention to the surrounding environment of the vehicle 2.

[0049] The display ECU 5 may change the display of the display unit 6 when there is not only a driver who is being gazed at but also a driver who is being attracted.

[0050] The display ECU 5 determines whether the driver of the vehicle 2 is attracted to the display unit 6 based on the detection result of the driver monitoring sensor 3 when the vehicle 2 is traveling in the basic driving mode. The display ECU 5 detects the line-of-sight direction of the driver from the detection result of the driver monitoring sensor 3, and determines whether the driver is attracted to the display unit 6 based on the detected line-of-sight direction, the position of the display unit 6, and the time during which the position of the display unit 6 overlaps with the line-of-sight direction.

[0051] When it is determined that the driver is attracted to the display unit 6, the display ECU 5 performs at least one of increasing the update period and reducing the visibility. Similar to the above-described method, the display ECU 5 increases the update period of the predetermined information, reduces the visibility of the predetermined information, or performs both of these. When it is determined that the driver is attracted to the display unit 6, it can be expected that the driver's attention to the surrounding environment of the vehicle 2 is reduced. The display ECU 5 can prompt the driver who is attracted to the display unit 6 to pay attention to the surrounding environment of the vehicle 2.

[0052] When the driver is gazing at the display unit 6, there is a higher possibility that the driver is more immersed in the display unit 6 than when the driver is attracted to the display unit 6. Therefore, when it is determined that the driver is gazing at the display unit 6, the display ECU 5 may perform at least one of increasing the update period and reducing the visibility more than when it is determined that the driver is attracted to the display unit 6. In this way, the display ECU 5 can increase the update period of the predetermined information, reduce the visibility of the predetermined information, or perform both of these stepwise according to the degree of the driver's immersion.

[0053] The display ECU 5 may reduce visibility in a manner different from the case where it is determined that the driver is being attracted to the display unit 6 when it is determined that the driver is gazing at the display unit 6. Modes of reducing visibility include reducing brightness, reducing saturation, reducing contrast, applying blurring, and the like. For example, when it is determined that the driver is being attracted to the display unit 6, the display ECU 5 may reduce the saturation of predetermined information, and further, when it is determined that the driver is gazing at the display unit 6, the display ECU 5 may reduce the contrast of the predetermined information. In this way, the display ECU 5 can gradually reduce the visibility of the predetermined information according to the degree of the driver's immersion. Also, by making the modes different between attraction and gazing, the change in the display can have a range, so that it can be made in a mode that is easy for the driver to understand.

[0054] When it is determined that the driver who was gazing at the display unit 6 has stopped gazing at the display unit 6, the display ECU 5 may determine the timing (return timing) for returning at least one of the update cycle and visibility based on the period during which the driver was gazing. The initial value of the return timing is stored in advance in the storage unit 4. It can be expected that the longer the period during which the driver was gazing, the greater the degree of immersion in the display unit 6. Therefore, the display ECU 5 sets the return timing to be longer than the initial value as the period during which the driver was gazing is longer. Thereby, the display ECU 5 can suppress the driver from immediately starting to gaze at the display unit 6 after turning attention to the surroundings of the vehicle 2.

[0055] [Operation of the Display System] FIG. 10 is a flowchart showing the operation of the display system. The flowchart shown in FIG. 10 starts when the display system 1 receives a system start instruction operation.

[0056] As shown in FIG. 10, first, the display ECU 5 of the display system 1 determines the update cycle and / or visibility according to the degree of automation of the driving mode (step S10). The display ECU 5 uses, for example, the graph showing the relationship between the degree of automation of the driving task and the update cycle shown in FIG. 5, or the graph showing the relationship between the degree of automation of the driving task and the height of visibility shown in FIG. 9, to determine the update cycle and / or visibility corresponding to the degree of automation related to the current driving mode.

[0057] Next, the display ECU 5 corrects the update cycle and / or visibility according to the driver's state (step S12). The details of the correction process in step S12 are shown in FIG. 11. FIG. 11 is a flowchart showing an example of the correction process.

[0058] As shown in FIG. 11, the display ECU 5 first determines whether the vehicle is running in the basic driving mode (step S120). The display ECU 5 determines that the vehicle is running in the basic driving mode when the degree of automation related to the driving mode obtained from the driving ECU 22 is between 0 and 2.

[0059] When it is determined that the vehicle 2 is running in the basic driving mode (step S120: YES), the display ECU 5 determines whether the driver is gazing at the display unit 6 (step S122). The display ECU 5 determines that the driver is gazing at the display unit 6 when the line-of-sight direction of the driver and the position of the display unit 6 overlap for a threshold time or more based on the detection result of the driver monitoring sensor 3.

[0060] When it is determined that the driver is gazing at the display unit 6 (step S122: YES), the display ECU 5 determines to increase the update period and / or reduce the visibility (step S124). That is, the display ECU 5 determines to modify so as to increase the update period determined in step S10 of FIG. 10 and / or to modify so as to reduce the visibility determined in step S10 of FIG. 10. The modification in step S124 (modification in the case of gazing) is set to be greater in degree than the modification in step S128 (modification in the case of being attracted) described later.

[0061] When it is determined that the driver is not gazing at the display unit 6 (step S122: NO), the display ECU 5 determines whether the driver is being attracted to the display unit 6 (step S126). Based on the detection result of the driver monitoring sensor 3, the display ECU 5 determines that the driver is being attracted to the display unit 6 when the number of times the driver's line-of-sight direction and the position of the display unit 6 overlap per unit time is equal to or greater than a threshold value.

[0062] When it is determined that the driver is being attracted to the display unit 6 (step S126: YES), the display ECU 5 determines to increase the update period and / or reduce the visibility (step S128). That is, the display ECU 5 determines to modify so as to increase the update period determined in step S10 of FIG. 10 and / or to modify so as to reduce the visibility determined in step S10 of FIG. 10. The modification in step S128 (modification in the case of being attracted) is set to be smaller in degree than the modification in step S124 (modification in the case of gazing).

[0063] When step S124 ends, when step S128 ends, when it is determined that the vehicle 2 is not running in the basic driving mode (step S120: NO), and when it is determined that the driver is not being attracted to the display unit 6 (step S126: NO), the modification process shown in FIG. 11 ends.

[0064] Returning to FIG. 10, the display ECU 5 determines the update cycle and / or the reflection timing of visibility (step S14). Details of the reflection timing determination process in step S14 are shown in FIG. 12. FIG. 12 is a flowchart showing an example of the reflection timing determination process.

[0065] As shown in FIG. 12, the display ECU 5 first determines whether there is a change in the driving mode (step S140). When the driving mode acquired from the driving ECU 22 is different from the driving mode stored in the storage unit 4, the display ECU 5 determines that there is a change in the driving mode.

[0066] When it is determined that there is a change in the driving mode (step S140: YES), the display ECU 5 calculates the difference in the degree of automation before and after the mode change. Then, the display ECU 5 determines the timing according to the calculated difference (step S142). For example, the display ECU 5 sets the timing to be shorter than the initial value as the difference in the degree of automation before and after the mode change is larger.

[0067] When step S142 ends, or when it is determined that there is no change in the driving mode (step S140: NO), the display ECU 5 determines whether the fixation period and / or the attention-grabbing period has ended (step S144). The display ECU 5 determines whether the fixation period and / or the attention-grabbing period has ended based on the detection result of the driver monitoring sensor 3.

[0068] When it is determined that the fixation period and / or the attention-grabbing period has ended (step S144: YES), the display ECU 5 determines the timing (return timing) to return the display based on the fixation period and / or the attention-grabbing period (step S146). The display ECU 5 sets the return timing to be longer than the initial value as the period during which the driver has been fixating is longer.

[0069] When step S146 ends, or when it is determined that the fixation period and / or the attention-grabbing period has not ended (step S144: NO), the reflection timing determination process shown in FIG. 12 ends.

[0070] Returning to FIG. 10, the display ECU 5 displays information on the display unit 6 at the update period and / or visibility determined in steps S10 and S12, and at the timing (reflection timing or return timing) determined in step S14 (step S16). When step S16 ends, the flowchart shown in FIG. 10 ends. The display ECU 5 starts the flowchart shown in FIG. 10 from the beginning until the end condition is satisfied.

[0071] [Summary of Embodiment] According to the display system 1, when the degree of automation decreases compared to before the mode change due to the change of the driving mode, at least one of the following is executed: increasing the update period of the predetermined information displayed on the display unit 6 compared to before the mode change, and decreasing the visibility of the predetermined information compared to before the mode change. When the degree of automation of the driving task decreases compared to before the mode change due to the change of the driving mode, the driver needs to pay more attention to the surroundings of the vehicle than before the mode change. Among the information on the display unit 6, the information with a long update period and the information with reduced visibility can suppress attracting the driver's attention. Therefore, the display system 1 can appropriately suppress the frequency with which the driver looks at the display unit 6 when the degree of automation of the driving task decreases compared to before the mode change due to the change of the driving mode.

[0072] As described above, the exemplary embodiments have been described. However, the present invention is not limited to the above-described exemplary embodiments, and various omissions, substitutions, and changes may be made.

[0073] For example, the display system 1 may execute the control for suppressing the above-described operation of attracting the driver's attention on the condition that the current degree of automation is within the range of a predetermined degree of automation. The range of the predetermined degree of automation is preset to define the range in which the above-described control for suppressing the operation of attracting the driver's attention is executed. For example, the range of the predetermined degree of automation may be a range of 0 to 1, or a range of 0 to 2, or a range of 0 to 3. When the degree of automation decreases due to a change in the driving mode within the above-described range of the predetermined degree of automation, the display system 1 increases the update cycle of the predetermined information displayed on the display unit 6 and / or decreases the visibility of the predetermined information compared to before the mode change.

[0074] For example, when the range of the predetermined degree of automation described above is 0 to 2, when the degree of automation of the driving task decreases from 2 to 1, at least one of increasing the update cycle of the predetermined information displayed on the display unit 6 compared to before the mode change and decreasing the visibility of the predetermined information compared to before the mode change is executed. Further, when the degree of automation of the driving task decreases from 1 to 0, at least one of increasing the update cycle of the predetermined information displayed on the display unit 6 compared to before the mode change and decreasing the visibility of the predetermined information compared to before the mode change may be executed. That is, in the graph of FIG. 5, the update cycle may monotonically decrease or gradually decrease in the range where the degree of automation of the task is 0 to 2. In the range where the degree of automation of the task is 3 to 5, the update cycle may be arbitrarily set. For example, as shown in the graph of FIG. 5, the update cycle may monotonically decrease or gradually decrease, or in contrast to the graph of FIG. 5, the update cycle may monotonically increase or gradually increase, or the update cycle may be a constant value. Similarly, in the graph of FIG. 9, the visibility may monotonically increase or gradually increase in the range where the degree of automation of the task is 0 to 2. In the range where the degree of automation of the task is 3 to 5, the height of the visibility may be arbitrarily set. For example, as shown in the graph of FIG. 9, the height of the visibility may monotonically increase or gradually increase, or in contrast to the graph of FIG. 9, the height of the visibility may monotonically decrease or gradually decrease, or the height of the visibility may be a constant value.

[0075] The present disclosure also includes the following clauses. [Clause 1] A display system mounted on a vehicle that travels in a driving mode selected from a plurality of driving modes with different degrees of automation of a driving task, a display unit that displays information to a driver, When the degree of automation decreases after the change of the driving mode compared to before the mode change, at least one of the following is executed: increasing the update cycle of the predetermined information displayed on the display unit to be longer than before the mode change, and decreasing the visibility of the predetermined information to be lower than before the mode change. A control unit; A display system comprising the same. [Article 2] The control unit according to Article 1, determines at least one of the timing to make the update cycle longer than before the mode change and the timing to make the visibility lower than before the mode change according to the difference in the degree of automation before and after the mode change. The display system described. [Article 3] Further comprising a driver monitoring sensor, The plurality of driving modes include a basic driving mode in which the driver executes all or part of the driving tasks, The control unit, When the vehicle is traveling in the basic driving mode, it is determined whether or not the driver of the vehicle is gazing at the display unit based on the detection result of the driver monitoring sensor. The display system according to Article 1 or 2, when it is determined that the driver is gazing at the display unit, executes at least one of increasing the update cycle and decreasing the visibility. [Article 4] The control unit, When the vehicle is traveling in the basic driving mode, it is determined whether or not the driver is being attracted to the display unit based on the detection result of the driver monitoring sensor. When it is determined that the driver is being attracted to the display unit, at least one of increasing the update cycle and decreasing the visibility is executed. The display system according to Article 3, when it is determined that the driver is gazing at the display unit, executes at least one of increasing the update cycle and decreasing the visibility more than when it is determined that the driver is being attracted to the display unit. [Article 5] The control unit when the vehicle is traveling in the basic driving mode, determines whether the driver is attracted to the display unit based on the detection result of the driver monitoring sensor, when it is determined that the driver is attracted to the display unit, reduces the visibility, when it is determined that the driver is gazing at the display unit, reduces the visibility in a manner different from when it is determined that the driver is attracted to the display unit, the display system according to clause 3 or 4. [Clause 6] The control unit when it is determined that the driver who was gazing at the display unit has stopped gazing at the display unit, determines the timing to restore at least one of the update cycle and the visibility based on the period during which the driver was gazing, the display system according to any one of claims 3 to 5.

Explanation of Signs

[0076] 1... display system, 2... vehicle, 3... driver monitoring sensor, 4... storage unit, 5... display ECU (an example of the control unit), 6... display unit.

Claims

1. A display system mounted on a vehicle that travels in a driving mode selected from a plurality of driving modes with different degrees of automation of driving tasks, a display unit that displays information to the driver, a control unit that, when the degree of automation decreases more after the mode change than before the mode change due to the change of the driving mode, executes at least one of making the update cycle of the predetermined information displayed on the display unit longer than before the mode change and making the visibility of the predetermined information lower than before the mode change, comprising, the control unit determines at least one of the timing to make the update cycle longer than before the mode change and the timing to make the visibility lower than before the mode change according to the difference in the degree of automation before and after the mode change, the display system.

2. further comprising a driver monitoring sensor, the plurality of driving modes include a basic driving mode in which the driver executes all or part of the driving tasks, the control unit, when the vehicle is traveling in the basic driving mode, determines whether the driver of the vehicle is gazing at the display unit based on the detection result of the driver monitoring sensor, when it is determined that the driver is gazing at the display unit, the display system according to claim 1, which executes at least one of making the update cycle longer and making the visibility lower.

3. the control unit, when the vehicle is traveling in the basic driving mode, determines whether the driver is being attracted to the display unit based on the detection result of the driver monitoring sensor, when it is determined that the driver is being attracted to the display unit, executes at least one of making the update cycle longer and making the visibility lower, when it is determined that the driver is gazing at the display unit, executes at least one of making the update cycle longer and making the visibility lower than when it is determined that the driver is being attracted to the display unit, the display system according to claim 2.

4. the control unit, when the vehicle is traveling in the basic driving mode, determines whether the driver is being attracted to the display unit based on the detection result of the driver monitoring sensor, when it is determined that the driver is being attracted to the display unit, makes the visibility lower, The display system according to claim 2, wherein when it is determined that the driver is gazing at the display unit, the visibility is reduced in a manner different from the case where it is determined that the driver is being attracted to the display unit.

5. A display system mounted on a vehicle that travels in a driving mode selected from a plurality of driving modes with different degrees of automation of driving tasks, a display unit that displays information to the driver; a control unit that, when the degree of automation decreases more than before the mode change due to the change of the driving mode, executes at least one of making the update period of predetermined information displayed on the display unit longer than before the mode change and reducing the visibility of the predetermined information more than before the mode change; a driver monitoring sensor; comprising: the plurality of driving modes including a basic driving mode in which the driver executes all or part of the driving tasks; the control unit: when the vehicle is traveling in the basic driving mode, determines whether or not the driver of the vehicle is gazing at the display unit based on the detection result of the driver monitoring sensor; when it is determined that the driver is gazing at the display unit, executes at least one of making the update period longer and reducing the visibility; a display system that, when it is determined that the driver who was gazing at the display unit has stopped gazing at the display unit, determines the timing to restore at least one of the update period and the visibility based on the period during which the driver was gazing.

Images