Display control device, vehicle display system, and display method

Abstract

The present invention provides a display control device, a vehicle display system, and a display method that enable drivers to drive comfortably. [Solution] The display control device controls a plurality of display devices 6 and 7 that each display images D1 and D2 that can be seen by the driver of the vehicle 100. The display control device comprises a margin acquisition unit that acquires the driver's margin and a control unit that controls the display of images D1 and D2 of each of the plurality of display devices 6 and 7. The central image D1 displayed by the central display device 6 of the plurality of display devices 6 and 7 is displayed closer to the driver's front in the left-right direction (X direction) as seen from the driver, compared to the outer image D2 displayed by the outer display device 7 of the plurality of display devices 6 and 7. The control unit displays the central image D1 when the margin acquired by the margin acquisition unit is less than a preset margin threshold, and hides the central image D1 when the margin acquired by the margin acquisition unit is equal to or greater than the margin threshold.

Description

Technical Field

[0001] The present disclosure relates to a display control device, a vehicle display system, and a display method.

Background Art

[0002] The display device described in Patent Document 1 includes a display that displays an image, a stress value acquisition unit that acquires a stress value, which is information regarding the level of stress of a viewer who visually recognizes the image, and a display control unit that reduces the number of images when the stress value is equal to or greater than a first value and increases the number of images when the stress value is equal to or less than a second value that is less than the first value.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the configuration described in Patent Document 1 above, since the number of images increases when the driver is driving with a margin, there is room for improvement from the perspective of the driver driving comfortably.

[0005] The present disclosure has been made in view of the above actual situation, and an object thereof is to provide a control device, a vehicle display system, and a display method that enable a driver to drive comfortably.

Means for Solving the Problems

[0006] To achieve the above object, a display control device according to a first aspect of the present disclosure is in a display control device that controls a plurality of display devices that respectively display images visible to a driver of a vehicle, a margin acquisition unit that acquires a driver's margin, The system comprises a control unit that controls the display of the image in each of the plurality of display devices, The central image, which is the image displayed by the central display device among the plurality of display devices, is displayed closer to the driver's direct front in the left-right direction from the driver's perspective than the outer image, which is the image displayed by an outer display device other than the central display device among the plurality of display devices. The control unit displays the center image when the margin obtained by the margin acquisition unit is less than a preset margin threshold, and hides the center image when the margin obtained by the margin acquisition unit is equal to or greater than the margin threshold.

[0007] To achieve the above objectives, the vehicle display system relating to the second aspect of this disclosure is: The display control device and, The system comprises the aforementioned plurality of display devices.

[0008] To achieve the above objectives, the method of representation relating to the third aspect of this disclosure is: A method for displaying images visible to the driver of a vehicle, which are displayed on each of multiple display devices, The margin acquisition unit acquires the driver's margin in a margin acquisition step, The control unit controls the display of the image on each of the plurality of display devices, and includes a display control step, The central image, which is the image displayed by the central display device among the plurality of display devices, is displayed closer to the driver's direct front in the left-right direction from the driver's perspective than the outer image, which is the image displayed by an outer display device other than the central display device among the plurality of display devices. In the display control step, the central image is displayed when the margin obtained in the margin acquisition step is less than a preset margin threshold, and the central image is hidden when the margin obtained in the margin acquisition step is equal to or greater than the margin threshold. [Effects of the Invention]

[0009] According to this disclosure, drivers can drive comfortably. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram of the interior of a vehicle as seen from the driver's seat according to one embodiment of the present disclosure. [Figure 2] This is a schematic diagram of the interior of a vehicle, showing an external view from the driver's seat according to one embodiment of the present disclosure. [Figure 3] This is a schematic diagram of the interior of a vehicle, showing a central image and an outer image as seen from the driver's seat, according to one embodiment of the present disclosure. [Figure 4] This is a schematic diagram of the interior of a vehicle, showing a central image and an outer image as seen from the driver's seat, according to one embodiment of the present disclosure. [Figure 5] This is a block diagram of a vehicle including a vehicle display system according to one embodiment of the present disclosure. [Figure 6] This is a flowchart of a display process according to one embodiment of the present disclosure. [Modes for carrying out the invention]

[0011] A display control device, a vehicle display system, and a display method according to one embodiment of this disclosure will be described with reference to the drawings. As shown in Figures 1 to 4, a central display device 6 and an outer display device 7 are mounted on the dashboard 202 inside the vehicle 100. The central display device 6 and the outer display device 7 are located at separate positions in the vehicle width direction (X direction). The central display device 6 and the outer display device 7 are head-up display devices, and by emitting display light L1 and L2 toward the windshield 201, which is an example of a projection target member, they display images D1 and D2 as virtual images at positions separated in the X direction. Since the windshield 201 is transparent, images D1 and D2 are displayed against a transparent background. The central image D1 can be displayed within the central display area A1 of the windshield 201, and the outer image D2 can be displayed within the outer display area A2 of the windshield 201.

[0012] The center-side image D1 and the center-side display area A1 are located within the effective visual field of the driver during driving, and the outer-side image D2 and the outer-side display area A2 are located outside the effective visual field of the driver during driving. The center-side image D1 and the center-side display area A1 are located at the center position (front position) as seen from the driver and are located on the front side (vehicle traveling side) with respect to the steering wheel 203. The outer-side image D2 and the outer-side display area A2 are located on the outer side in the X direction with respect to the center-side image D1 and the center-side display area A1. In this example, they are located on the inner side of the vehicle interior in the X direction (the left side in FIG. 1). The outer-side image D2 and the outer-side display area A2 are provided at the central position in the X direction of the dashboard 202.

[0013] Next, the electrical configuration of the vehicle 100 will be described. As shown in FIG. 5, the vehicle 100 includes a vehicle display system 1, a camera 5 and a sensor 4 which are an example of a driver state detection unit for detecting the state of the driver, and a car navigation system 9 which is an example of a driving situation detection unit.

[0014] The camera 5 photographs the face including the driver's viewpoint and outputs the photographed image data to the vehicle display system 1 (specifically, the margin estimation unit 2B described later). The sensor 4 detects vital data such as the driver's heartbeat, respiration and blood pressure, and outputs the detected vital data to the vehicle display system 1 (specifically, the margin estimation unit 2B described later). The car navigation system 9 outputs car navigation (navigation) information related to the position and route guidance of the vehicle 100 to the vehicle display system 1 (specifically, the margin estimation unit 2B described later).

[0015] The vehicle display system 1 includes a center-side display device 6, an outer-side display device 7, and a display control device 2. As described above, the center-side display device 6 and the outer-side display device 7 are head-up display devices, and display images D1 and D2 respectively.

[0016] The display control device 2 consists of a CPU (Central Processing Unit), a GDC (Graphics Display Controller), a ROM (Read Only Memory), and a RAM (Random Access Memory), among other components. The display control device 2 comprises, as functional blocks, a margin acquisition unit 2A, a margin estimation unit 2B, and a control unit 2C.

[0017] The margin estimation unit 2B estimates the driver's margin based on vital data from sensor 4, captured data from camera 5, and car navigation information from car navigation system 9. The estimated margin decreases as the heart rate, as a vital data point, increases. Furthermore, the estimated margin decreases as the driver's eye movements are frequent and at high speeds, and increases as the driver's eye movements are infrequent and at low speeds. Also, the estimated margin decreases as the task load, which is the workload of the driver based on the car navigation information, increases, and increases as the task load decreases. Here, task load increases as the driver has more tasks to perform while driving, or as the attention required for those tasks increases. For example, situations with a high task load include lane changes, right and left turns, and lane merging, while situations with a low task load include when vehicle 100 is driving straight on a straight road.

[0018] The margin estimation unit 2B estimates that the margin is high when the margin estimated based on heart rate, gaze movement, and task load is equal to or greater than a preset margin threshold Th, and estimates that the margin is low when it is less than the margin threshold Th. One example of a method for estimating the level of margin is to assign a score of "0" when the heart rate is outside the normal range and "1" when the heart rate is within the normal range; a score of "0" if the viewpoint movement is above a predetermined speed within a predetermined time and a score of "1" if the viewpoint movement is not above a predetermined speed within a predetermined time and a score of "0" if the task load is high and a score of "1" if the task load is low, according to the estimation method described later. The margin estimation unit 2B estimates that the margin is high if the sum of the scores for heart rate, viewpoint movement, and task load is equal to or greater than the margin threshold Th (1, 2, or 3 points), and estimates that the margin is low if the sum is less than the margin threshold Th. The scoring method described above can be changed as appropriate.

[0019] The margin estimation unit 2B also estimates the magnitude of the task load. The margin estimation unit 2B estimates the task load to be large when the task load is greater than or equal to a pre-set load threshold Ti, and estimates the task load to be small when the task load is less than the load threshold Ti. For example, the load threshold Ti is set to be smaller than the task load when the vehicle 100 is changing lanes, turning right or left, or merging into a lane, and larger than the task load when the vehicle is not changing lanes, turning right or left, or merging into a lane. As a result, the margin estimation unit 2B estimates that the task load is high when the vehicle is changing lanes, turning right or left, or merging into a lane, and that the task load is low when the vehicle is not changing lanes, turning right or left, or merging into a lane.

[0020] In this example, the margin estimation unit 2B estimated the margin based on heart rate, eye movement, and task load, but it may also estimate the margin based on one or two of the following: heart rate, eye movement, and task load. Furthermore, the margin estimation unit 2B may also estimate the margin based on factors other than heart rate, eye movement, and task load, such as blood pressure, skin potential, respiratory rate, sweating, and / or the driver's facial expression. Furthermore, when estimating the magnitude of the task load, factors other than those mentioned above may also be taken into consideration, such as road congestion, whether or not it is a road being driven on for the first time (frequency of driving on the road), whether or not the road structure is complex, whether or not the road is narrow, and whether or not the in-vehicle switch is being operated. In other words, the task load will be higher when there is traffic congestion on the road, when it is a road being driven on for the first time, when the road structure is complex, when the road is narrow, or when the in-vehicle switch is being operated. The estimation of margin and task load may be performed by formulating a calculation formula that weights each parameter that determines the margin and task load, respectively. In this case as well, the margin threshold Th and the load threshold Ti are determined by experiment or simulation.

[0021] The margin acquisition unit 2A acquires information related to the level of margin estimated by the margin estimation unit 2B and the magnitude of the task load.

[0022] The control unit 2C controls the display of images D1 and D2 on the display devices 6 and 7 according to the level of the margin acquired by the margin acquisition unit 2A and the magnitude of the task load.

[0023] The display processing performed by the display control device 2 will be explained according to the flowchart in Figure 6. This display processing is repeatedly performed while the vehicle 100 is in operation.

[0024] First, the margin acquisition unit 2A acquires information related to the level of margin estimated by the margin estimation unit 2B and the magnitude of the task load (step S101). Then, the control unit 2C determines whether the margin is high or not (step S102).

[0025] When the control unit 2C determines that there is a high margin (step S102; YES), it determines whether the task load is high or low (step S103). When the control unit 2C determines that the task load is low (step S103; NO), it displays the outer image D2 in the outer display area A2, as shown in Figure 2, and does not display the central image D1 in the central display area A1 (step S104), and terminates the display process. The outer image D2 displays the vehicle speed (in this example, "50 km / h") and a directional arrow in two dimensions. For example, when the driver's heart rate is low and there is little movement of the eyes, and the vehicle 100 is driving straight on a road far from an intersection, the central image D1 is not displayed, so the driver can continue driving comfortably.

[0026] On the other hand, when the control unit 2C determines that there is a high margin (step S102; YES), or when it determines that the task load is high (step S103; YES), it displays the outer image D2 in the outer display area A2 and displays a simplified image D1a as the central image D1 in the central display area A1 (step S105), as shown in Figure 3, and then terminates the display process. Simplified image D1a is displayed two-dimensionally, as shown enlarged at the bottom of Figure 3. Specifically, simplified image D1a includes arrows related to directions and the distance to the right or left turn (in this example, "200m" is displayed). The arrows related to directions are represented as two-dimensional arrows. By displaying the simplified image D1a in this way, the driver can grasp the upcoming actions without significantly shifting their gaze, allowing for more relaxed driving.

[0027] On the other hand, if the control unit 2C determines that the margin is low (step S102; NO), it determines whether the task load is high or not (step S107). If the control unit 2C determines that the task load is high (step S107; YES), it displays the outer image D2 in the outer display area A2 and the detailed image D1b as the central image D1 in the central display area A1, as shown in Figure 4 (step S106), and terminates the display process. Detailed image D1b contains more information than simplified image D1a. Detailed image D1b includes a three-dimensional display, as shown enlarged at the bottom of Figure 4. Specifically, detailed image D1b includes the road on which the vehicle is traveling and the arrows related to directions located on this road. In detailed image D1b, the road is displayed with three-dimensional depth, and the directional arrows are displayed on this road. If the control unit 2C determines that the task load is small (step S107; NO), it executes the process of step S105 (display processing of simplified image D1a and outer image D2) described above and terminates the display processing. In addition, if step S107 is omitted in the above display process and it is determined that the margin is low (step S102; NO), the process of step S106 described above (display process of detailed image D1b and outer image D2) may be executed. Furthermore, step S103, which determines whether the task load is high or not, may be omitted. In this case, if it is determined that there is a high margin (step S102; YES), the simplified image D1a may be displayed, or the central image D1 may be hidden.

[0028] (effect) According to the embodiment described above, the following effects are achieved. (1) The display control device 2 controls a plurality of display devices 6 and 7 that each display images D1 and D2 that can be seen by the driver of the vehicle 100. The display control device 2 includes a margin acquisition unit 2A that acquires the driver's margin, and a control unit 2C that controls the display of images D1 and D2 of each of the plurality of display devices 6 and 7. The central image D1 displayed by the central display device 6 of the plurality of display devices 6 and 7 is displayed closer to the driver's front in the left-right direction (X direction) as seen from the driver, than the outer image D2 displayed by the outer display device 7 which is different from the central display device 6 of the plurality of display devices 6 and 7. The control unit 2C displays the central image D1 when the margin acquired by the margin acquisition unit 2A is less than a preset margin threshold Th (when the margin is low), and hides the central image D1 when the margin acquired by the margin acquisition unit 2A is equal to or greater than the margin threshold Th (when the margin is high). With this configuration, when the driver has ample space, the central image D1 is hidden, thus not disrupting that space. This improves driver comfort.

[0029] (2) When the margin acquired by the margin acquisition unit 2A is equal to or greater than the margin threshold Th (when the margin is high), the control unit 2C hides the central image D1 and displays the outer image D2. With this configuration, when the driver has sufficient mental capacity, the external image D2 can be displayed, providing information without disrupting the driver's relaxed state.

[0030] (3) The display control device 2 includes a margin estimation unit 2B that estimates the margin from the driver's vital data and the driving status of the vehicle 100 (car navigation information), and estimates the level of the margin by comparing the estimated margin with a margin threshold Th. The margin acquisition unit 2A acquires the level of the margin estimated by the margin estimation unit 2B. This configuration allows for the estimation of the margin of safety with high accuracy.

[0031] (4) The display control device 2 includes a margin estimation unit 2B, which is an example of a task load estimation unit that estimates the task load, which is the workload of the driver's operation. The control unit 2C displays a simplified image D1a as the central image D1 when the margin acquired by the margin acquisition unit 2A is equal to or greater than a preset margin threshold Th, and the task load estimated by the margin estimation unit 2B is equal to or greater than a preset load threshold Ti. The control unit 2C displays a detailed image D1b, which contains more information than the simplified image D1a, when the margin acquired by the margin acquisition unit 2A is less than a preset margin threshold Th, and the task load estimated by the margin estimation unit 2B is equal to or greater than the load threshold Ti. With this configuration, when there is ample headroom and the task load is high, a simplified image D1a is displayed. This allows the driver to grasp future actions with ease without having to concentrate too much on the display or significantly change their gaze from the direction of travel. Furthermore, in situations where the margin of error is low and the task load is high, the detailed image D1b is displayed. This allows for reliable and detailed information to be provided to the driver, reducing anxiety about driving.

[0032] (5) The central display device 6 displays the central image D1 at a position that overlaps with the transparent range of the vehicle 100's windshield, as viewed from the driver's perspective. With this configuration, when the driver has sufficient space, the central image D1 can be hidden, allowing the driver to see the transparent background of the central image D1, thus providing the driver with a wider field of view.

[0033] (6) The vehicle display system 1 comprises a display control device 2, a center-side display device 6, and an outer display device 7. This configuration can improve driver comfort.

[0034] (7) The method for displaying images D1 and D2 visible to the driver of the vehicle 100, as displayed by each of the multiple display devices 6 and 7, includes a margin acquisition step (step S101) in which the margin acquisition unit 2A acquires the driver's margin, and a display control step (steps S104 to S106) in which the control unit 2C controls the display of images D1 and D2 on each of the multiple display devices 6 and 7. The central image D1 displayed by the central display device 6 of the multiple display devices 6 and 7 is displayed closer to the driver's front in the left-right direction (X direction) as seen from the driver, than the outer image D2 displayed by the outer display device 7. In the above display control step, the central image D1 is displayed when the margin acquired in the above margin acquisition step is less than a preset margin threshold Th, and the central image D1 is hidden when the margin acquired in the above margin acquisition step is equal to or greater than the margin threshold Th. This configuration can improve driver comfort.

[0035] This disclosure is not limited to the embodiments and drawings described above. Modifications (including the deletion of components) can be made as appropriate, provided they do not alter the essence of this disclosure. An example of such a modification is described below.

[0036] (modified version) In the above embodiment, the vehicle display system 1 was equipped with a margin estimation unit 2B, but the margin estimation unit 2B may be located outside the vehicle display system 1. In this case, the margin acquisition unit 2A acquires information related to the margin and task load estimated by the margin estimation unit 2B located outside the vehicle display system 1.

[0037] In the above embodiment, the detailed image D1b may be displayed along the road surface through the windshield 201 so as to be superimposed on the actual scenery. The simplified image D1a may be displayed upright on the road surface through the windshield 201.

[0038] In the above embodiment, the central display device 6 and the outer display device 7 displayed images D1 and D2 by emitting display light L1 and L2 to the transparent portion of the windshield 201. However, images D1 and D2 may also be displayed by emitting display light L1 and L2 to the opaque portion at the lower end of the windshield 201 that does not transmit light. This opaque portion is a light-blocking portion made of black or a similar material, such as black ceramics. Alternatively, this opaque portion may be a transparent film or a light-adjusting film with reflective properties. Furthermore, although at least one of the central display device 6 and the outer display device 7 emitted display light L1 and L2 toward the windshield 201 to display images D1 and D2, the display light L1 and L2 may be emitted toward a combiner instead of the windshield 201 to display images D1 and D2. This combiner is formed of a light-transmitting material. Furthermore, at least one of the central display device 6 and the outer display device 7 is not limited to a head-up display device, but may be a display device having a direct-view type display. This display is a transparent display and may be attached to the windshield 201. Alternatively, this display may be mounted on the dashboard 202. Furthermore, the central display device 6 may be mounted within the vehicle's instrument cluster. The outer display device 7 may be a center display.

[0039] In the above embodiment, the number of display devices was two, a central display device 6 and an outer display device 7, but there may be three or more. In the above embodiment, the control unit 2C may simplify the voice guidance or reduce the volume of the voice guidance (including no voice) when displaying a simplified image D1a, and make the voice guidance more detailed or increase the volume of the voice guidance when displaying a detailed image D1b. Furthermore, the control unit 2C may simplify the voice guidance or reduce the volume of the voice guidance (including no voice) when there is a high margin, and make the voice guidance more detailed or increase the volume of the voice guidance when there is a low margin.

[0040] In the above embodiment, the control unit 2C may determine whether the estimated margin is greater than or equal to the margin threshold Th, instead of the margin estimation unit 2B. Similarly, the control unit 2C may determine whether the estimated task load is greater than or equal to the load threshold Ti, instead of the margin estimation unit 2B. [Explanation of symbols]

[0041] 1…Vehicle display system 2...Display control device, 2A...Margin acquisition unit, 2B...Margin estimation unit, 2C...Control unit 4...Sensor, 5...Camera, 9...Car navigation system 6...Center side display device, 7...Outside display device 100...Vehicle, 201...Windshield, 202...Dashboard, 203...Steering wheel A1...center side display area, A2...outer display area, D1...center side image, D1a...simple image, D1b...detailed image, D2...outer image L1,L2…display light Th... margin threshold, Ti... load threshold

Claims

1. In a display control device that controls multiple display devices that show images visible to the driver of each vehicle, A margin acquisition unit that acquires the driver's margin, The system comprises a control unit that controls the display of the image in each of the plurality of display devices, The central image, which is the image displayed by the central display device among the plurality of display devices, is displayed closer to the driver's direct front in the left-right direction from the driver's perspective than the outer image, which is the image displayed by an outer display device other than the central display device among the plurality of display devices. The control unit displays the center-side image when the margin acquired by the margin acquisition unit is less than a preset margin threshold, and hides the center-side image when the margin acquired by the margin acquisition unit is equal to or greater than the margin threshold. Display control device.

2. The control unit, when the margin obtained by the margin acquisition unit is equal to or greater than the margin threshold, hides the central image and displays the outer image. The display control device according to claim 1.

3. The system includes a margin estimation unit that estimates the margin from at least one of the driver's vital data and the vehicle's driving conditions. The margin acquisition unit acquires the margin estimated by the margin estimation unit. The display control device according to claim 1 or 2.

4. The display control device includes a task load estimation unit that estimates the task load, which is the workload of the driver's operation. The control unit, When the margin acquired by the margin acquisition unit is equal to or greater than the margin threshold, and the task load estimated by the task load estimation unit is equal to or greater than a preset load threshold, a simplified image is displayed as the central image. When the margin obtained by the margin acquisition unit is less than the margin threshold, and the task load estimated by the task load estimation unit is equal to or greater than the load threshold, a detailed image with more information than the simplified image is displayed as the central image. The display control device according to claim 1 or 2.

5. The aforementioned central display device displays the central image at a position that, from the driver's perspective, overlaps with the transparent area of ​​the vehicle's windshield. The display control device according to claim 1 or 2.

6. A display control device according to claim 1 or 2, The plurality of display devices comprising, Vehicle display system.

7. A method for displaying images visible to the driver of a vehicle, which are displayed on each of multiple display devices, The margin acquisition unit acquires the driver's margin in a margin acquisition step, The control unit controls the display of the image on each of the plurality of display devices, and includes a display control step, The central image, which is the image displayed by the central display device among the plurality of display devices, is displayed closer to the driver's direct front in the left-right direction from the driver's perspective than the outer image, which is the image displayed by an outer display device other than the central display device among the plurality of display devices. In the display control step, if the margin obtained in the margin acquisition step is less than a preset margin threshold, the center image is displayed; if the margin obtained in the margin acquisition step is equal to or greater than the margin threshold, the center image is hidden. Display method.

Images