Display system and display control method

Abstract

To let a driver recognize the gripping of a steering wheel without providing the steering wheel with a light emission part, and to reduce the manufacturing costs of a vehicle.SOLUTION: The present invention relates to a display system 1 which displays states of a vehicle C1. The display system 1 comprises a display device 200 which is arranged on the back of the steering wheel 10 of the vehicle C1, and displays the states of the vehicle C1, and a display control device 100 which controls display states of the display device 200. The display control device 100 displays specific information 210 for urging a driver D1 sitting on the driver's seat of the vehicle C1 to grip the steering wheel 10 at a part of the display device 200 which circumferentially corresponds to the steering wheel 10.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a display system for displaying the state of a vehicle and a display control method. [Background technology]

[0002] BACKGROUND ART Conventionally, a technique has been proposed for notifying a driver that the steering wheel is being gripped by lighting or blinking a light emitting portion provided on the steering wheel of a vehicle (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-007478 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-described conventional technology, it is necessary to provide a light-emitting portion on the steering wheel to notify the driver that the steering wheel is being gripped, which increases the manufacturing costs of the vehicle.

[0005] The present invention aims to enable a driver to recognize that the steering wheel is being gripped without providing a light-emitting portion on the steering wheel, thereby reducing the manufacturing costs of a vehicle. [Means for solving the problem]

[0006] One aspect of the present invention is a display system for displaying the status of a vehicle. The display system includes a display unit disposed on the back of a steering wheel of the vehicle and displaying the status of the vehicle, a control unit for controlling the display state of the display unit, and a color temperature detection unit that detects a color temperature inside a vehicle cabin; and a control unit that displays specific information on a portion of the display unit that corresponds to the circumferential direction of the steering wheel, to encourage a driver seated in a driver's seat of the vehicle to grip the steering wheel. The higher the detected color temperature inside the vehicle, the lower the color temperature of the specific information is set, and the lower the detected color temperature inside the vehicle, the higher the color temperature of the specific information is set.do. [Effects of the Invention]

[0007] According to the present invention, the driver can be made aware of the grip of the steering wheel using the display unit that displays the vehicle state, thereby reducing the manufacturing costs of the vehicle. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of the interior of a vehicle. [Figure 2] FIG. 2 is a diagram showing an example of the configuration of the interior of a vehicle. [Figure 3] FIG. 3 is a block diagram illustrating an example of the functional configuration of the display system. [Figure 4] FIG. 4 is a diagram showing an example of transition of the display state of the display device when a hands-on command is received during autonomous driving. [Figure 5] FIG. 5 is a diagram showing a modified example of the specific information displayed on the display device. [Figure 6] FIG. 6 is a diagram showing a modified example of the specific information displayed on the display device. [Figure 7] FIG. 7 is a flowchart showing an example of a display control process in the display control device. [Figure 8] FIG. 8 is a diagram showing an example of transition of the display state of the display device. [Figure 9] FIG. 9 is a flowchart showing an example of a display control process in the display control device. [Figure 10] FIG. 10 is a diagram showing an example of the configuration of the interior of a vehicle. [Figure 11] FIG. 11 is a diagram showing an example of the configuration of the interior of a vehicle. [Figure 12] FIG. 12 is a diagram showing an example of transition of the display state of the display area when a hands-on command is received during autonomous driving. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0010] [Example of vehicle interior configuration] 1 and 2 are diagrams showing an example of the configuration of the interior of a vehicle C1. Note that Fig. 1 shows a simplified view of the interior of the vehicle C1 as viewed from the rear in the longitudinal direction of the vehicle C1, and omits illustrations of components other than a dashboard 2, a windshield 3, a rearview mirror 4, a steering wheel 10, an image acquisition device 40, a display device 200, and a car navigation device 300. Fig. 2 shows a simplified cross section of the interior of the vehicle C1 as viewed from the left in the lateral direction of the vehicle C1, and omits illustrations of components other than the dashboard 2, the windshield 3, the steering wheel 10, the image acquisition device 40, and the display device 200.

[0011] The display device 200 is a display panel that displays various vehicle information related to the vehicle C1 based on the control of the display control device 100 (see FIG. 3). The display device 200 is, for example, a meter display device installed behind the steering wheel 10, a wiper switch, a light switch, etc. The display device 200 is, for example, a display device whose entire display surface facing the driver D1 of the vehicle C1 is a display panel. Vehicle information displayed includes, for example, vehicle speed, remaining charge, remaining fuel, and gauges. FIG. 1 shows an example in which two meters 201 and 202 and a guide sign 203 that assists the driver D1 in driving are displayed. Note that these displays are merely examples, and the arrangement of the meters, etc., can be changed by user operation or automatically, and other information can be displayed. The display device 200 can be, for example, a TFT (Thin Film Transistor) liquid crystal panel, an organic EL (Electro Luminescence) panel, or other display panels.

[0012] Furthermore, the meters and the like displayed on the display device 200 are set in positions visible to the driver D1, taking into consideration the possibility of overlapping with the steering wheel 10 and the spoke portion 11. Furthermore, the meters and the like are often not displayed in corner portions 215, 216 (see FIG. 4(B)) of the display screen of the display device 200. Note that in FIG. 4 and subsequent figures, the spoke portion 11 is not shown to facilitate explanation.

[0013] Although FIG. 1 shows an example in which the display device 200 and the car navigation device 300 are separate devices, they may be configured as an integrated device.

[0014] The image acquisition device 40 is provided inside the vehicle C1 and captures an image of a subject to generate an image (image data). Information about the generated image is output to various components, such as an automatic driving control device 50 (see FIG. 3) and a display control device 100 (see FIG. 3). The image acquisition device 40 is configured, for example, with one or more camera devices or image sensors capable of capturing an image of a subject inside the vehicle C1. For example, in an automatic driving system, a camera that detects the line of sight of the driver D1 of the vehicle C1, such as a driver monitor or a driver eyepoint recognition device, can be used. For example, a camera device that captures an image of the face of the driver D1 of the vehicle C1 is mounted in front of the driver D1, such as on the top of the windshield 3, the steering wheel 10, or within the display surface of the display device 200. FIGS. 1 and 2 show an example in which the image acquisition device 40 is mounted on the top of the windshield 3. Note that these mounting positions are merely examples, and the image acquisition device 40 may be mounted in other positions. The position of the steering wheel 10 can be detected by including the steering wheel 10 in the imaging range of the image acquisition device 40.

[0015] [Example of display system configuration] FIG. 3 is a block diagram showing an example of the functional configuration of the display system 1. As shown in FIG.

[0016] The display system 1 includes sensors 20, a steering wheel adjustment device 30, an image acquisition device 40, an automatic driving control device 50, a display control device 100, and a display device 200. The display control device 100 controls the display state of the display device 200 based on signals from the sensors 20, the steering wheel adjustment device 30, the image acquisition device 40, the automatic driving control device 50, etc. Although Fig. 3 shows an example in which the display control device 100 and the display device 200 are separate devices, they may also be configured as an integrated device.

[0017] The sensors 20 are various sensors installed on the vehicle C1, and output their detection values ​​to the control unit 102. The sensors 20 are, for example, an image sensor, a millimeter wave radar, a LIDAR (Light Detection and Ranging), a sonar, an acceleration sensor, a wheel measurement sensor, a G sensor, and a vehicle speed sensor. Note that these are just examples, and other sensors may also be used.

[0018] The steering wheel adjustment device 30 is a device that adjusts the position of the steering wheel 10. In this embodiment, an example is shown in which the vehicle C1 is provided with both tilt and telescopic adjustment functions as functions for adjusting the position of the steering wheel 10. Note that the vehicle C1 may be provided with either tilt or telescopic adjustment functions, or may not have these adjustment functions. Specifically, the vertical position of the steering wheel 10 can be adjusted by tilting, and the front-rear position of the steering wheel 10 can be adjusted by telescopic operation. The steering wheel adjustment device 30 also includes a position detection device that detects the adjustment amount of the steering wheel 10 and detects the position of the steering wheel 10 after adjustment, and outputs the detected position of the steering wheel 10 after adjustment to the display control device 100. Furthermore, by implementing the steering wheel adjustment device 30 using an electric adjustment device equipped with a motor drive unit, at least one of tilt and telescopic adjustment can be performed electrically.

[0019] The automatic driving control device 50 is a control device that controls automatic driving of the vehicle C1. The automatic driving control device 50 is configured as an integrated computer including a storage means such as a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a combination thereof, and a CPU (Central Processing Unit). Note that known technology can be adopted as the automatic driving system.

[0020] For example, the automatic driving control device 50 is realized by a unit for automatic driving. The automatic driving control device 50 also outputs various signals related to automatic driving and manual driving to the display control device 100. The display control device 100 also controls the display state of the display device 200 by adjusting the position of drawing, etc., based on the signals from the automatic driving control device 50.

[0021] For example, when autonomous driving is being performed, the autonomous driving control device 50 automatically controls the driving of the vehicle C1 based on the driving state of the vehicle C1 and information external to the vehicle C1. The autonomous driving control device 50 also determines whether the environment is such that autonomous driving cannot be continued based on the driving environment around the vehicle C1. An example of an environment in which autonomous driving cannot be continued is when white lines cannot be detected on the road on which the vehicle C1 is traveling. If the autonomous driving control device 50 determines that the environment is such that autonomous driving cannot be continued, it terminates autonomous driving and switches to manual driving.

[0022] Furthermore, when the automatic driving control device 50 determines that the environment is such that continuation of automatic driving is impossible, it determines that the driver D1 needs to grip the steering wheel 10. In this case, the automatic driving control device 50 outputs a hands-on command to the display control device 100. Furthermore, when the automatic driving control device 50 detects that the steering wheel 10 is being gripped after outputting the hands-on command, it outputs that information to the display control device 100. Note that the automatic driving control device 50 not only displays specific information by the display control device 100 (see FIG. 4, etc.), but also executes processing to notify the driver D1 that the steering wheel 10 is being gripped, such as processing to generate an alarm. For this grip notification, known technology can be adopted.

[0023] The display control device 100 includes a position detection unit 101, a control unit 102, a storage unit 103, and a drawing processing unit 104. The display control device 100 is realized by, for example, a meter unit that draws meters such as vehicle speed. Note that the vehicle ECU (Electronic Control Unit) of the vehicle C1 may be used as the display control device 100, or another control device may be used as the display control device 100.

[0024] The position detection unit 101 detects the position of the eyes E1 of the driver D1 and the position of the steering wheel 10, and outputs the detection results to the control unit 102. For example, the position detection unit 101 detects the position of the steering wheel 10, such as the height H2 and distance L2 of the steering wheel 10 (see FIG. 2), based on position information of the steering wheel 10 output from the steering wheel adjustment device 30. The position detection unit 101 also detects the position of the eyes E1 of the driver D1, such as the height H1 and distance L1, based on a captured image output from the image acquisition device 40. These detection methods and the method of adjusting the specific information based on the detection results will be described in detail with reference to FIG. 4.

[0025] The control unit 102 controls each unit based on various programs stored in the storage unit 103. The control unit 102 is realized by, for example, a processing device such as a CPU. For example, the control unit 102 executes control for controlling the display state of the display device 200. For example, the control unit 102 causes the display device 200 to display various meters, etc. Furthermore, for example, when the control unit 102 receives a hands-on command from the automatic driving control device 50 during automatic driving, the control unit 102 causes the display device 200 to display specific information. Display examples of this specific information will be described in detail with reference to FIGS. 4 to 6.

[0026] The storage unit 103 is a storage medium that stores various types of information. For example, the storage unit 103 stores various types of information (for example, a control program, information for displaying specific information) that are necessary for the control unit 102 to perform various processes. Note that the storage unit 103 may be, for example, a read-only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), a solid state drive (SSD), or a combination thereof.

[0027] The drawing processing unit 104 executes drawing processing for drawing various images on the display screen of the display device 200 under the control of the control unit 102 .

[0028] [Example of controlling the display state of a display device] FIG. 4 is a diagram showing an example of transition of the display state of the display device 200 when a hands-on command is received during automatic driving.

[0029] 4A shows a display state of the display device 200 during autonomous driving. During autonomous driving, meters 201, 202, guide signs 203, etc. are displayed on the display device 200 in the same manner as in the example shown in FIG.

[0030] 4(A), of the display screen of the display device 200, an overlapping portion that exists on an extension line between the eye E1 of the driver D1 and the steering wheel 10 and overlaps with the steering wheel 10 is a portion that is not visible to the driver D1. On the other hand, of the display screen of the display device 200, a portion other than the overlapping portion is a portion that is visible to the driver D1.

[0031] In general, the meters and the like displayed on the display device 200 are often designed to be large in consideration of the possibility that they may overlap with the steering wheel 10. This allows both tall and short people to properly view the meters and the like. Furthermore, the meters and the like are often not displayed in the corners 215 and 216 of the display screen of the display device 200, which are likely to overlap with the steering wheel 10. Therefore, in this embodiment, an example is shown in which specific information 210 is displayed to prompt the driver D1 to grip the steering wheel 10, using the portions of the display screen of the display device 200 where the meters and the like are not displayed. This allows the specific information 210 to be properly displayed without moving the displayed meters and the like. Although this embodiment shows an example in which the specific information 210 and the meters and the like are not displayed overlapping each other, the specific information 210 and the meters and the like may be displayed overlapping each other.

[0032] FIG. 4(B) shows the display state of the display device 200 after a hands-on command is output from the automatic driving control device 50 during automatic driving.

[0033] Here, the timing at which a hands-on command is output from the automatic driving control device 50 will be described. In this embodiment, two types of automatic driving will be assumed. Specifically, an automatic driving type (first type) in which the steering wheel 10 must be held at all times, and an automatic driving type (second type) in which the hands can be taken off the steering wheel 10 when a predetermined condition is met will be described. In the case of the first type, the steering wheel 10 must be held at all times, so when the hands are taken off the steering wheel 10 while driving, a hands-on command is output from the automatic driving control device 50 and an attention-calling process is executed in the vehicle C1 to have the driver D1 hold the steering wheel 10. In this attention-calling process, the driver D1 is called to attention by voice or the like.

[0034] In the case of the second type, since it is possible to take your hands off the steering wheel 10 when a predetermined condition is met, a hands-off command is output from the automatic driving control device 50 when the predetermined condition is met. Also, when the predetermined condition is not met, for example, when the environment becomes such that it is impossible to continue automatic driving, a hands-on command is output from the automatic driving control device 50, and an attention-calling process is executed in the vehicle C1 to have the driver hold the steering wheel 10.

[0035] In this way, when a hands-on command is output from the automatic driving control device 50, specific information (specific display) 210 is displayed to make the driver D1 aware that he or she should grip the steering wheel 10. Here, the specific information 210 is a display for encouraging the driver D1 to grip the steering wheel 10, and is a display that highlights a portion of the display device 200 that corresponds to the circumferential direction of the steering wheel 10. In other words, the specific information 210 is a display that is displayed on a structure present in front of the display device 200, i.e., around the steering wheel 10, to highlight this structure. In other words, the specific information 210 is a display that highlights the portion where the steering wheel 10 should be gripped. This makes it possible to make the position where the steering wheel 10 is gripped appear to be luminous.

[0036] The portion corresponding to the circumferential direction of the steering wheel 10 is, for example, a portion along the contour of the steering wheel 10, and indicates the overlapping portion that overlaps with the steering wheel 10 and portions 211 to 214 that are close to the overlapping portion. In other words, it is a portion that follows the shape of the circumferential steering wheel 10, and indicates the portions 211 to 214 that are close to the steering wheel 10 on the display screen of the display device 200. In other words, the specific information 210 is a display that highlights the structure in front of the display device 200, i.e., the shape of the steering wheel 10.

[0037] As shown in FIG. 4(B), the specific information 210 can be displayed in a dark color in portions 211 to 214 that are close to the steering wheel 10, and the color can be changed to a lighter color as the distance from the steering wheel 10 increases. For example, the specific information 210 can be hidden in corner portions 215 and 216 of the display screen and in a central portion 217 at the bottom of the display screen. This allows the steering wheel 10 to be highlighted without the steering wheel 10 itself being illuminated. Also, it is possible to create a display mode that looks as if the back of the steering wheel 10 is illuminated, even without illuminating the back of the steering wheel 10. In other words, it is possible to create a display mode that looks as if a light source is located on the back of the steering wheel 10 and that the light is shining on the steering wheel 10 from the light source, i.e., a mode similar to indirect lighting. In other words, it is possible to create a display mode that looks as if a halo is shining on the steering wheel 10.

[0038] As described above, in this embodiment, an example is shown in which the specific information 210 is displayed in a vague manner along the outline of the steering wheel 10. Note that the specific information 210 may or may not be displayed in the overlapping portion that overlaps with the steering wheel 10 as seen by the driver D1. However, depending on the height of the driver D1's eyes E1 and the position of the steering wheel 10, the overlapping portion of the steering wheel 10 may be misaligned when seen by the driver D1. Therefore, by displaying the specific information 210 also in the overlapping portion that overlaps with the steering wheel 10 as seen by the driver D1, it is possible to reduce the sense of discomfort caused by the misalignment.

[0039] That is, on the display screen of the display device 200, the specific information 210 is displayed on a first portion that is located on an extension line between the driver D1's eye E1 and the steering wheel 10 and overlaps with the steering wheel 10, but is not visible to the driver D1, and second portions 211 to 214 that are not overlapping with the steering wheel 10 and are visible to the driver D1, but are close to the first portion.

[0040] The color of the identification information 210 is preferably a color that is easily recognized by the driver D1, such as yellow or red. In this embodiment, the identification information 210 is shown as yellow.

[0041] In addition, if the display device 200 is a device capable of emitting light forward, the light from the display device 200 may be emitted to the gripping position of the steering wheel 10 to achieve the above-mentioned highlighted display.

[0042] 4(C) shows the display state of the display device 200 after the automatic driving control device 50 outputs information indicating that the steering wheel 10 has been gripped, when the specific information 210 is displayed on the display device 200. In this way, when the automatic driving control device 50 outputs information indicating that the steering wheel 10 has been gripped, the specific information 210 is hidden. This allows the driver D1 to easily understand that the grip of the steering wheel 10 has been recognized. Furthermore, by hiding the specific information 210 and displaying only information required for driving, such as the meters 201 and 202, the driver D1 can concentrate on driving.

[0043] A known detection method can be used to detect gripping of the steering wheel 10. For example, it is possible to adopt a detection method that detects gripping of the steering wheel 10 when a load equal to or greater than a predetermined value is detected on the steering wheel 10. The automatic driving control device 50 also functions as a grip detection unit that detects gripping of the steering wheel 10 by the driver D1.

[0044] 4 shows an example in which the specific information 210 is displayed at the timing of switching from automatic driving to manual driving, but if the driver D1 is holding the steering wheel 10 at the timing of switching from automatic driving to manual driving, the specific information 210 does not have to be displayed. This reduces the amount of calculation related to the display processing of the specific information 210, and also reduces power consumption.

[0045] [Example of adjusting the position of specific information] Here, the relationship between the height of the eyes E1 of the driver D1, the height of the steering wheel 10, and the display screen of the display device 200 will be described.

[0046] For example, the eye height differs between a tall person and a short person, and therefore the relationship between the height of the steering wheel 10 and the display screen of the display device 200 will differ. That is, for a tall person, the eyes are in a high position, so the steering wheel 10 will appear to be in a low position when the display device 200 is used as the reference. On the other hand, for a short person, the eyes are in a low position, so the steering wheel 10 will appear to be in a high position when the display device 200 is used as the reference.

[0047] The position of the steering wheel 10 can be detected by a steering wheel adjustment device 30 (see FIG. 3) that performs tilt and telescopic operations. In addition, if an image of the steering wheel 10 can be acquired by an image acquisition device 40, the position of the steering wheel 10 can be acquired based on the image.

[0048] When the position of the steering wheel 10 is adjusted, the relationship between the height H2 of the steering wheel 10 and the display screen of the display device 200 changes. Therefore, in this embodiment, the position of the specific information 210 on the display device 200 is adjusted based on the position of the eye E1 of the driver D1 and the position of the steering wheel 10. The position of the eye E1 of the driver D1 can be acquired based on, for example, a captured image acquired by the image acquisition device 40. Note that known image recognition technology can be used as a method for detecting the eye E1 included in the face of the driver D1 and a method for calculating the distance of the eye E1 in the depth direction.

[0049] 2, it is possible to calculate a height H1 of the eye E1 of the driver D1 relative to the lower part of the display device 200, and a distance L1 from the display device 200 to the eye E1 of the driver D1. It is also possible to calculate a height H2 of the top of the steering wheel 10 relative to the lower part of the display device 200, and a distance L2 from the display device 200 to the top of the steering wheel 10. In this case, it is possible to calculate a height H3 of the top of the overlapping part of the display device 200 with the steering wheel 10 as seen by the driver D1, using a triangle similarity condition or an arithmetic expression that is set in advance based on experimental data or the like. This makes it possible to identify the overlapping part of the display device 200 with the steering wheel 10 as seen by the driver D1.

[0050] Note that the overlapping portion of the steering wheel 10 on the display device 200 may be obtained using only either the position of the eye E1 of the driver D1 or the position of the steering wheel 10. Furthermore, the overlapping portion of the steering wheel 10 on the display device 200 may be fixed and specific information may be displayed regardless of the position of the eye E1 of the driver D1 and the position of the steering wheel 10. Even in this case, it is possible to reduce the deviation to a certain extent, as described above.

[0051] [Variations of specific information] 5 and 6 are diagrams showing modified examples of specific information displayed on the display device 200. Note that the specific information 221, 222, and 230 shown in Fig. 5 and 6 are modified examples of the specific information 210 shown in Fig. 4, and have different display modes. Further, a description of parts common to the specific information 210 shown in Fig. 4 will be omitted.

[0052] 5 shows a display example in which signs showing hand shapes are displayed as the specific information 221, 222. The specific information 221, 222 is displayed so that the signs showing hand shapes are added to the positions where the driver D1 grips the steering wheel 10. The specific information 221, 222 is displayed to highlight the parts of the display device 200 that correspond to the circumferential direction of the steering wheel 10.

[0053] It is preferable that the colors of the identification information 221 and 222 be colors that are easy for the driver D1 to recognize, such as yellow or red. In this embodiment, an example is shown in which the information is highlighted in yellow.

[0054] 5 shows an example in which signs showing the shape of a stationary hand are displayed as the specific information 221, 222 to explain the operation of the forward structure, i.e., the steering wheel 10. However, a moving sign may be displayed as the specific information to explain the operation of the forward structure, i.e., the steering wheel 10. For example, the shape of a hand gripping the steering wheel 10 may be animated and displayed as a moving sign.

[0055] 6 shows other specific information 230 that highlights the portion of the display device 200 that corresponds to the circumferential direction of the steering wheel 10. That is, the specific information 230 is a display that highlights the portion of the steering wheel 10 that is gripped.

[0056] In FIG. 6, an example is shown in which the portion close to the steering wheel 10 is displayed with a thick dotted line, and as the distance from the steering wheel 10 increases, the line changes to a thin dotted line, which is used as the specific information 230.

[0057] The color of the identification information 230 is preferably a color that is easily recognizable by the driver D1. The color may also change as the driver moves away from the steering wheel 10. For example, the color may be yellow, red, or the like. In this embodiment, an example is shown in which the information is highlighted in yellow.

[0058] 4 to 6 are merely examples, and highlighting may be performed in other display modes. For example, multiple arrows may be displayed along the outline of the steering wheel 10, or specific information may be displayed only on the gripping portion of the steering wheel 10. In addition, the specific information may be displayed by flashing at a predetermined interval, or in a combination of different colors.

[0059] [Example of display control device operation] 7 is a flowchart showing an example of display control processing in the display control device 100. This display control processing is executed by the control unit 102 based on a program stored in the storage unit 103. This display control processing is constantly executed for each control cycle. This display control processing will be explained with appropriate reference to FIGS. 1 to 6.

[0060] In step S501, the control unit 102 determines whether the vehicle C1 is automatically driven based on a command from the automatic driving control device 50. If the vehicle C1 is automatically driven, the process proceeds to step S502. On the other hand, if the vehicle C1 is not automatically driven, the operation of the display control process ends.

[0061] In step S502, the control unit 102 determines whether or not a hands-on command has been received from the automatic driving control device 50. If a hands-on command has been received, the process proceeds to step S503. On the other hand, if a hands-on command has not been received, the operation of the display control process ends.

[0062] In step S503, the control unit 102 controls the drawing processing unit 104 to control the display state of the display device 200 so as to display the specific information in a portion corresponding to the circumferential direction of the steering wheel 10. For example, any one of the specific information 210 shown in Fig. 4(B), the specific information 221 and 222 shown in Fig. 5, and the specific information 230 shown in Fig. 6 is displayed on the display device 200.

[0063] In step S504, the control unit 102 determines whether or not gripping of the steering wheel 10 by the driver D1 has been detected. Note that if the automatic driving control device 50 outputs a signal indicating that gripping of the steering wheel 10 has been detected, the control unit 102 determines that gripping of the steering wheel 10 has been detected. If gripping of the steering wheel 10 has been detected, the process proceeds to step S505. On the other hand, if gripping of the steering wheel 10 has not been detected, the process proceeds to step S506.

[0064] In step S505, the control unit 102 controls the drawing processing unit 104 to control the display state of the display device 200 so as to hide the specific information displayed in the circumferential direction of the steering wheel 10. For example, as shown in FIG. 4(C), the specific information 210 is hidden.

[0065] In step S506, the control unit 102 determines whether a predetermined time has elapsed since the specific information was first displayed in step S503. If the predetermined time has elapsed since the specific information was displayed, the process proceeds to step S507. On the other hand, if the predetermined time has not elapsed since the specific information was displayed, the process returns to step S503. This predetermined time is a value that can be set appropriately based on experimental data, etc., and can be set to a value of, for example, several seconds.

[0066] In step S507, the control unit 102 executes an attention-calling process to prompt the driver D1 to grip the steering wheel 10. In this attention-calling process, for example, other information related to the attention call and sound related to the attention call are displayed. For example, the information related to the attention call can be displayed by changing the color or shape of the specific information. For example, the color of the specific information 210 can be changed from yellow to red to alert the driver D1. In addition, for example, the driver D1 can be alerted by sounding a buzzer.

[0067] In step S508, the control unit 102 determines whether or not gripping of the steering wheel 10 by the driver D1 has been detected. If gripping of the steering wheel 10 has been detected, the process proceeds to step S505. On the other hand, if gripping of the steering wheel 10 has not been detected, the process proceeds to step S509.

[0068] In step S509, the control unit 102 determines whether a predetermined time has elapsed since the initial start of the attention calling process in step S507. If the predetermined time has elapsed since the attention calling process, the process proceeds to step S510. On the other hand, if the predetermined time has not elapsed since the attention calling process, the process returns to step S507. This predetermined time is a value that can be set appropriately based on experimental data, etc., and can be set to a value of, for example, several seconds. It is also preferable to set this value to be shorter than the predetermined time indicated in step S506.

[0069] In step S510, the control unit 102 executes a process for stopping the vehicle C1. Specifically, based on an instruction from the automatic driving control device 50, the control unit 102 causes the display device 200 to display a message indicating that the vehicle C1 is to be stopped.

[0070] [Example of adjusting the brightness of specific information] The above describes an example in which the specific information is displayed at a preset brightness. The brightness inside the vehicle C1 can be detected based on the captured image acquired by the image acquisition device 40. Alternatively, the brightness inside the vehicle C1 can be detected using another sensor, such as a light sensor. Therefore, the control unit 102 may adjust the brightness of the specific information based on the detected brightness inside the vehicle C1. For example, when driving on a dark road at night, the vehicle interior becomes dark, so the brightness of the specific information is set low so that the driver D1 can easily see it. On the other hand, when driving during the day on a sunny day, the vehicle interior becomes bright, so the brightness of the specific information is set high so that the driver D1 can easily see it. In this way, the control unit 102 can adjust the brightness of the specific information higher as the detected brightness inside the vehicle interior increases. This makes it possible to display the specific information at an appropriate brightness according to the brightness inside the vehicle interior.

[0071] [Example of adjusting the color temperature of specific information] The above example illustrates the display of specific information at a preset color temperature. The color temperature of the interior of the vehicle C1 can be detected based on the captured image acquired by the image acquisition device 40. Alternatively, the color temperature of the interior of the vehicle C1 can be detected using another sensor, such as a color temperature sensor. Therefore, the control unit 102 may adjust the color temperature of the specific information based on the detected color temperature of the interior. For example, if the detected color temperature of the interior is close to red, the color temperature of the specific information is set to a color close to blue to make it easier for the driver D1 to see. In this way, the color temperature of the specific information can be adjusted so that the relationship between the detected color temperature of the interior and the color temperature of the specific information is a highly contrasting color scheme, i.e., a complementary color relationship. For example, a combination of yellow-green and purple, green and reddish-purple, or red and blue-green has a complementary color relationship. In this way, the control unit 102 lowers the color temperature of the specific information as the detected color temperature of the interior of the vehicle increases, and sets the color temperature of the specific information higher as the detected color temperature of the interior of the vehicle decreases. This enables the specific information to be displayed at an appropriate color temperature according to the color temperature of the interior of the vehicle.

[0072] In this way, the display device 200 that displays meters and the like to be provided to the driver D1 can be used to display specific information to encourage the driver D1 to grip the steering wheel 10. Therefore, the driver D1 can easily recognize that the steering wheel 10 is being gripped without providing a new light-emitting device (for example, an LED, a circuit board, a harness, etc.) to the steering wheel 10, and the manufacturing cost of the vehicle C1 can be reduced.

[0073] Specifically, when switching from automatic driving to manual driving, there is no need to illuminate the steering wheel 10 to encourage the driver to grip the steering wheel 10, and therefore there is no need to provide a light-emitting device for illuminating the steering wheel 10. This reduces the manufacturing cost of the vehicle C1. Furthermore, the same effect can be achieved with existing equipment, without having to install costly light sources such as LEDs on the steering wheel 10. Furthermore, the structure in front of the display device 200, i.e., the steering wheel 10 itself, can be highlighted without having to illuminate the structure. In other words, it is possible to realize a display that looks as if there is a light source on the back of the steering wheel 10, providing indirect lighting.

[0074] Furthermore, by adjusting the display position of the specific information 210, etc. based on the adjusted position of the steering wheel 10 and the position of the eye E1 of the driver D1, it is possible to more appropriately display the specific information 210, etc. Furthermore, by adjusting the brightness and color temperature of the specific information based on the brightness and color temperature in the cabin of the vehicle C1, it is possible to display the specific information appropriate to the cabin conditions.

[0075] [Example of displaying specific information on other aspects during automated driving] The above describes an example in which specific information is displayed on the display device 200 when a hands-on command is output during autonomous driving, but specific information is not displayed on the display device 200 during autonomous driving. Here, some information may be displayed on the display device 200 to notify the driver D1 that he or she does not need to grip the steering wheel 10 even during autonomous driving. Therefore, Figs. 8 and 9 show examples in which specific information in other modes is displayed during autonomous driving.

[0076] [Example of controlling the display state of a display device] Fig. 8 is a diagram showing an example of transition of the display state of the display device 200. Note that the examples shown on the left and right sides of the upper part of Fig. 8 correspond to Fig. 4(B) and (C), and therefore detailed description thereof will be omitted here.

[0077] As shown in the lower part of FIG. 8 , when a hands-off command is output during manual driving, specific information 240 indicating this is displayed on the display device 200. Here, the specific information 240 is specific information in a form different from the specific information 210. For example, the specific information 240 and the specific information 210 can be displayed in different colors. For example, the specific information 210 can be displayed in yellow, and the specific information 240 can be displayed in blue. Furthermore, the specific information 210 is displayed after a hands-on command is output during automated driving, and is hidden if the driver D1 is detected as holding the steering wheel 10 after this display. On the other hand, the specific information 240 is displayed after a hands-off command is output during manual driving, and continues to be displayed during automated driving. This allows the driver D1 to easily understand that automated driving is in progress and that he or she does not need to hold the steering wheel 10.

[0078] [Example of display control device operation] Fig. 9 is a flowchart showing an example of display control processing in the display control device 100. This display control processing is a modified example of the display control processing shown in Fig. 7, and differs in that the specific information 240 is displayed even during autonomous driving. For this reason, in Fig. 9, parts that are common to Fig. 7 are assigned the same reference numerals, and their description will be omitted.

[0079] In step S502, the control unit 102 determines whether or not a hands-on command has been received from the automatic driving control device 50, and if a hands-on command has not been received, the process proceeds to step S521.

[0080] In step S521, the control unit 102 controls the drawing processing unit 104 to control the display state of the display device 200 so as to display specific information in different modes in portions corresponding to the circumferential direction of the steering wheel 10. For example, the specific information 240 shown in FIG. 8 is displayed on the display device 200.

[0081] In this way, when a hands-on command is received, yellow specific information 210 is displayed on display device 200, and when a hands-off command is received, blue specific information 240 is displayed on display device 200. That is, the display mode of display device 200 is changed between when a hands-on command is received and when a hands-off command is received. This allows driver D1 to easily grasp the timing when the hands-on command is received and it becomes necessary to grip steering wheel 10, and the timing when the hands-off command is received and it becomes unnecessary to grip steering wheel 10.

[0082] [Example of application to HUD] The above has shown an example in which specific information is displayed on the display device 200, which is disposed on the back of the steering wheel 10 and displays the vehicle speed, instruments, etc. of the vehicle C1. Here, an example of application to a vehicle C1a equipped with a HUD (Head Up Display) will be described. Note that the modified examples shown below are modified examples of this embodiment, so parts that are common to this embodiment will be given the same reference numerals and their description will be omitted as appropriate. Furthermore, parts that correspond to this embodiment will be given the same reference numerals followed by a, etc. and their description will be omitted as appropriate. For example, the windshield 3a corresponds to the windshield 3 shown in FIG. 1, etc.

[0083] [Example of vehicle interior configuration] 10 and 11 are diagrams showing an example of the configuration of the interior of a vehicle C1a. Note that Fig. 11 shows a simplified view of the interior of the vehicle C1a as viewed from the rear side in the longitudinal direction of the vehicle C1a, and omits illustrations of components other than the dashboard 2, windshield 3a, rearview mirror 4, steering wheel 10, and image acquisition device 40. Fig. 11 also shows a simplified cross section of the interior of the vehicle C1a as viewed from the left side in the lateral direction of the vehicle C1a, and omits illustrations of components other than the dashboard 2, windshield 3a, steering wheel 10, image acquisition device 40, and display device 400.

[0084] As shown in FIG. 11, a display device 400 for realizing a HUD for a vehicle C1A is provided on the upper surface of the dashboard 2 near the boundary with the windshield 3a.

[0085] The display device 400 is a display device, such as a projector or optical system, that projects light onto the display area 200a of the windshield 3a and uses the reflected light to realize a HUD display that shows a virtual image to the driver D1. That is, the light projected from the display device 400 onto the display area 200a of the windshield 3a is reflected by the windshield 3a, and the reflected light heads toward the eyes of the driver D1. The reflected light projected onto the display area 200a and entering the eyes of the driver D1 is then displayed together with actual objects visible through the windshield 3a, superimposed on those objects. In this way, the display device 400 realizes a HUD display by displaying a virtual image using the windshield 3a.

[0086] For example, the display device 400 displays various vehicle information and specific information 250 (see FIG. 12) related to the vehicle C1a in the display area 200a based on the control of the display control device 100 (see FIG. 3).

[0087] The windshield 3a is a shield (for example, a windshield) provided at the front of the vehicle C1a, and functions as a display medium for the HUD of the vehicle C1a.

[0088] The windshield 3a may be formed using glass or other materials. For example, when a laminated glass consisting of a rear glass, a front glass, and an interlayer film is used as the windshield 3a, the refraction of light can be controlled by forming the cross section of the interlayer film into a wedge shape. In other words, the laminated glass is formed so that the rear glass and the front glass form a V-shaped cross section. This allows the windshield 3a to function as a display medium for the HUD.

[0089] [Example of controlling the display state of a display device] FIG. 12 is a diagram showing an example of transition of the display state of the display area 200a when a hands-on command is received during autonomous driving.

[0090] As shown in FIG. 12, during autonomous driving, meters 201, 202, guide signs 203, etc. are displayed in the display area 200a, similar to the example shown in FIG. 4, etc. Furthermore, when a hands-on command is output from the autonomous driving control device 50 during autonomous driving, specific information 250 is displayed in the display area 200a. Note that, similar to the examples shown in FIGS. 5 and 6, other specific information may be displayed. Furthermore, similar to the above-described example, the display position of the specific information 250 may be adjusted based on the position of the steering wheel 10 and the position of the eyes E1 of the driver D1, and the brightness and color temperature of the specific information may be adjusted based on the brightness and color temperature in the cabin of the vehicle C1. Furthermore, similar to the example shown in FIG. 8, specific information may be displayed in other ways during autonomous driving.

[0091] [Configuration and Effects of This Embodiment] The display system 1 according to this embodiment is a display system that displays the status of a vehicle C1 (or C1a, the same applies hereinafter). The display system 1 is arranged on the back of a steering wheel 10 of the vehicle C1 and includes a display device 200 (or a display area 200a, the same applies hereinafter) (an example of a display unit) that displays the status of the vehicle C1, and a display control device 100 (an example of a control unit) that controls the display state of the display device 200. The display control device 100 displays specific information 210 (or specific information 221, 222, 230, 250, the same applies hereinafter) on a portion of the display device 200 that corresponds to the circumferential direction of the steering wheel 10, to encourage a driver D1 seated in the driver's seat of the vehicle C1 to grip the steering wheel 10.

[0092] According to this configuration, the driver D1 can be made aware of the grip of the steering wheel 10 by using the display device 200 that displays the state of the vehicle C1, even without providing a light-emitting unit on the steering wheel 10. In this way, by utilizing the display device 200 that has conventionally displayed meters and the like to the driver D1, the manufacturing cost of the vehicle C1 can be reduced.

[0093] A vehicle C1 equipped with the display system 1 is a vehicle capable of both automatic driving and manual driving. Furthermore, the display control device 100 hides the specific information 210 when the vehicle C1 is being driven automatically, and displays the specific information 210 on the display device 200 when a command to grip the steering wheel 10 is received while the vehicle C1 is being driven automatically. For example, as shown in FIG. 4(B), when a command to grip the steering wheel 10 is received while the vehicle C1 is being driven automatically, the specific information 210 is displayed on the display device 200.

[0094] According to this configuration, when switching from automatic driving to manual driving, it is possible to display specific information 210 on display device 200 at an appropriate timing to prompt the driver to grip steering wheel 10.

[0095] The display system 1 further includes an automatic driving control device 50 (an example of a grip detection unit) that detects the driver D1 gripping the steering wheel 10. After the display control device 100 displays the specific information 210 on the display device 200 in response to a grip command from the automatic driving control device 50, if gripping of the steering wheel 10 is detected, the display control device 100 hides the specific information 210.

[0096] According to this configuration, when gripping of the steering wheel 10 is detected, the specific information 210 is hidden, so that the display state of the display device 200 becomes easy for the driver D1 who is manually driving to see.

[0097] In the display system 1, when autonomous driving is being performed in the vehicle C1, the display control device 100 causes the display device 200 to display specific information 240 (an example of second specific information) in a form different from the specific information 210, and when a command to grip the steering wheel 10 is received during autonomous driving, causes the display device 200 to hide the specific information 240 and display the specific information 210. For example, as shown in Fig. 8, the display of the specific information 210 and 240 is switched.

[0098] According to this configuration, when automatic driving is being performed in the vehicle C1, specific information 240 is displayed, so that the driver D1 can easily understand that automatic driving is being performed and that he or she does not need to hold the steering wheel 10.

[0099] In the display system 1, the display control device 100 displays the specific information 210 on the display screen of the display device 200 by highlighting the portion along the contour of the steering wheel 10 in the circumferential direction.

[0100] According to this configuration, it is possible to make the gripping position of the steering wheel 10 appear to emit light without making the steering wheel 10 itself glow. In other words, a display mode similar to indirect lighting can be achieved.

[0101] The display system 1 further includes a position detection unit 101 (an example of an eye detection unit) that detects the position of an eye E1 of a driver D1 seated in the driver's seat of the vehicle C1. The display control device 100 also moves a portion of the display device 200 that displays the specific information 210 in the vertical direction based on the detected position of the eye E1.

[0102] According to this configuration, it is possible to display the specific information 210 at an appropriate position according to the position of the eye E1 of the driver D1. This makes it easier for the driver D1 to see the specific information 210 on the display device 200.

[0103] The display system 1 further includes a position detection unit 101 (an example of a position detection unit) that detects the position of the steering wheel 10. Furthermore, the display control device 100 moves the portion of the display device 200 where the specific information 210 is displayed in the vertical direction based on the detected position of the steering wheel 10.

[0104] According to this configuration, it is possible to display the specific information 210 at an appropriate position according to the position of the steering wheel 10. This makes it easier for the driver D1 to view the specific information 210 on the display device 200.

[0105] In the display system 1, the display control device 100 displays signs as the specific information 221, 222 so that the signs indicate the shape of hands at the position where the steering wheel 10 is gripped. For example, the specific information 221, 222 is displayed as shown in FIG.

[0106] According to this configuration, by displaying the signs showing the shapes of the hands as the specific information 221, 222, it is possible to display specific information that is easier for the driver D1 to recognize.

[0107] The display system 1 further includes a control unit 102 (an example of a brightness detection unit) that detects the brightness inside the vehicle C1. The higher the level of brightness detected inside the vehicle C1, the higher the brightness of the identification information 210 is set by the display control device 100.

[0108] This configuration makes it possible to display specific information at an appropriate brightness according to the brightness inside the vehicle compartment.

[0109] The display system 1 further includes a control unit 102 (an example of a color temperature detection unit) that detects the color temperature inside the vehicle C1. The display control device 100 also sets the color temperature of the identification information 210 lower as the detected color temperature inside the vehicle C1 increases, and sets the color temperature of the identification information 210 higher as the detected color temperature inside the vehicle C1 decreases.

[0110] According to this configuration, it is possible to display specific information of an appropriate color temperature according to the color temperature inside the vehicle cabin.

[0111] The display control method according to this embodiment is a display control method for controlling the display state of a display device 200 disposed on the back of a steering wheel 10 of a vehicle C1 capable of both automatic and manual driving. This display control method includes a control process (steps S501 to S505) for displaying specific information 210 for encouraging a driver D1 seated in the driver's seat of the vehicle C1 to grip the steering wheel 10, in a portion of the display device 200 corresponding to the circumferential direction of the steering wheel 10. In this control process, when automatic driving is being performed in the vehicle C1, the specific information 210 is hidden, and when a command to grip the steering wheel 10 is received during automatic driving, the specific information 210 is displayed on the display device 200.

[0112] According to this configuration, even if the steering wheel 10 does not have a light-emitting unit, the driver D1 can be made aware of the grip of the steering wheel 10 by using the display device 200 that displays the state of the vehicle C1. In this way, by utilizing the display device 200 that has conventionally displayed meters and the like to the driver D1, the manufacturing cost of the vehicle C1 can be reduced. Furthermore, when switching from automatic driving to manual driving, it is possible to display specific information 210 on the display device 200 at an appropriate timing to encourage the driver D1 to grip the steering wheel 10.

[0113] Note that each processing procedure shown in this embodiment is an example for realizing this embodiment, and the order of some of the processing procedures may be changed within the scope that makes it possible to realize this embodiment, and some of the processing procedures may be omitted or other processing procedures may be added.

[0114] Each process described in this embodiment is executed based on a program that causes a computer to execute each processing procedure. Therefore, this embodiment can also be understood as an embodiment of a program that realizes the function of executing each process and a recording medium that stores the program. For example, an update process for adding a new function to a display control device can store the program in the storage device of the display control device. This makes it possible to cause the updated display control device to execute each process described in this embodiment.

[0115] Although the embodiments of the present invention have been described above, the above embodiments merely illustrate some of the application examples of the present invention, and it is not intended that the technical scope of the present invention be limited to the specific configurations of the above embodiments. [Explanation of symbols]

[0116] 1 display system, 2 dashboard, 3, 3a windshield, 10 steering wheel, 20 sensors, 30 steering wheel adjustment device, 40 image acquisition device, 50 automatic driving control device, 100 display control device, 101 position detection unit, 102 control unit, 103 memory unit, 104 drawing processing unit, 200, 400 display device, C1, C1a vehicle

Claims

1. A display system for displaying a vehicle status, a display unit disposed on a rear surface of a steering wheel of the vehicle and displaying a state of the vehicle; a control unit that controls a display state of the display unit; a color temperature detection unit that detects a color temperature in the interior of the vehicle, The control unit displaying specific information in a portion of the display unit corresponding to a circumferential direction of the steering wheel to prompt a driver seated in a driver's seat of the vehicle to grip the steering wheel; The higher the detected color temperature inside the vehicle interior, the lower the color temperature of the specific information is set, and the lower the detected color temperature inside the vehicle interior, the higher the color temperature of the specific information is set. Display system.

2. 10. The display system of claim 1, The vehicle is capable of both automatic driving and manual driving, The control unit hides the specific information when the automatic driving is being performed in the vehicle, and displays the specific information on the display unit when a command to grip the steering wheel is received while the automatic driving is being performed. Display system.

3. 3. The display system of claim 2, a grip detection unit that detects a grip of the steering wheel by the driver, the control unit, after the specific information is displayed on the display unit in response to receiving the grip command, does not display the specific information when gripping of the steering wheel is detected. Display system.

4. 3. The display system of claim 2, When the automatic driving is being performed in the vehicle, the control unit causes the display unit to display second identification information in a manner different from the identification information, and when a command to grip the steering wheel is received during the automatic driving, causes the display unit to hide the second identification information and display the identification information. Display system.

5. 5. A display system according to claim 1, the control unit displays the specific information by highlighting a portion along a circumferential outline of the steering wheel on the display screen of the display unit. Display system.

6. 5. A display system according to claim 1, an eye detection unit that detects the eye position of a driver seated in a driver's seat of the vehicle; The control unit moves a portion of the display unit that displays the specific information in a vertical direction based on the detected position of the eye. Display system.

7. 5. A display system according to claim 1, a position detection unit that detects the position of the steering wheel, the control unit moves a portion of the display unit that displays the specific information in a vertical direction based on the detected position of the steering wheel. Display system.

8. 5. A display system according to claim 1, the control unit displays a mark indicating a hand shape at a position where the steering wheel is gripped, as the specific information, so that the mark is added to the position where the steering wheel is gripped. Display system.

9. 5. A display system according to claim 1, a brightness detection unit that detects brightness inside the vehicle interior, The control unit sets the brightness of the specific information to be higher as the detected level of brightness in the vehicle interior is higher. Display system.

10. A display control method for controlling a display state of a display unit disposed on the back of a steering wheel of a vehicle, comprising: a control process for displaying specific information on a portion of the display unit corresponding to a circumferential direction of the steering wheel to prompt a driver seated in a driver's seat of the vehicle to grip the steering wheel; a color temperature detection process for detecting a color temperature in the interior of the vehicle, In the control process, the higher the detected color temperature inside the vehicle interior, the lower the color temperature of the specific information is set, and the lower the detected color temperature inside the vehicle interior, the higher the color temperature of the specific information is set. Display control method.

Images