Display device

Abstract

A display device according to the present invention is mounted on a vehicle and comprises a video display unit and a light-emitting unit. The video display unit projects video light. The light-emitting unit is disposed around a display area of the video display unit and lights up or flashes according to the content of information displayed by the video display unit.

Description

Display device

[0001] The present invention relates to a display device, a virtual image display device, and a vehicle equipped with the display device.

[0002] A display device or a virtual image display device that projects video light onto a windshield or a front glass of a vehicle such as an automobile to display a virtual image, and displays driving information such as vehicle speed and engine speed, traffic information from navigation, and vehicle information such as remaining fuel and coolant temperature is known.

[0003] Japanese Patent Laid-Open No. 3-169752

[0004] The display device is disposed, for example, on or inside a dashboard of a vehicle. When the display device is used, a driver can obtain information necessary for driving without moving his or her line of sight to an instrument panel incorporated in the dashboard, that is, a so-called instrument panel. On the other hand, sufficient consideration has not been given to the arrangement, brightness, influence from external light, information display, etc. of the display device.

[0005] An object of the present invention is to provide a more suitable display device or display technology.

[0006] According to an aspect of the present invention, there is provided the following display device. The display device is a device mounted on a vehicle. The display device includes a video display unit that projects video light, and a light emitting unit that is disposed around a display area of the video display unit and lights up or blinks according to the content of information displayed by the video display unit.

[0007] According to the present invention, a more suitable display device or display technology can be provided. Note that problems, configurations, and effects other than those described above will be clarified by the description of the following embodiments.

[0008] This figure shows an example of an in-vehicle system including a display device. This figure shows an example of a device used to acquire vehicle information. This is a block diagram showing an example of a display device. This figure shows an example of a configuration in which a display device is mounted on a vehicle. This figure shows an example of a configuration in which a display device is mounted on a vehicle. This figure shows an example of a light source structure of a display device. This is a diagram illustrating an example of the structure of a display device. This figure shows an example of a light emission control method. This figure shows an example of a light emission control method. This figure shows an example of a light emission control method. This figure shows an example of a light emission control method. This is a diagram illustrating an example of a light emission control method. This is a diagram illustrating an example of a light emission control method. This is a diagram illustrating an example of a light emission control method. This is a flowchart illustrating a control flow that suppresses interference with driving. This figure shows an example of a control method. This figure shows an example of a control method. This is a diagram illustrating an example of a control method. This is a diagram illustrating an example of a control method. This is a diagram illustrating an example of brightness control.

[0009] Embodiments of the present invention will be described below with reference to the drawings. The embodiments are illustrative examples for explaining the present invention, and have been omitted and simplified as appropriate for clarity of explanation. The present invention can also be implemented in various other forms. Unless otherwise specified, each component may be singular or plural. The position, size, shape, and range of each component shown in the drawings may not represent the actual position, size, shape, and range in order to facilitate understanding of the invention. Therefore, the present invention is not necessarily limited to the position, size, shape, and range disclosed in the drawings. When there are multiple components that have the same or similar function, they may be described using the same reference numeral with different subscripts. Also, when it is not necessary to distinguish between these multiple components, the subscripts may be omitted in the description.

[0010] In explanations, when describing program-based processing, the focus may sometimes be on the program, functions, or processing units. However, the main hardware component is the processor, or a controller, device, computer, or system composed of such a processor. The computer, using its processor, executes processing according to the program read into memory, utilizing resources such as memory and communication interfaces as appropriate. This realizes the specified functions and processing units. The processor is composed of semiconductor devices such as a CPU / MPU or GPU. Processing is not limited to software program processing; it can also be implemented using dedicated circuits. Applicable dedicated circuits include FPGAs, ASICs, CPLDs, etc.

[0011] The program may be pre-installed as data on the target computer, or it may be distributed as data to the target computer from the program source. The program source may be a program distribution server on a communication network, or a non-transient computer-readable storage medium, such as a memory card or disk. The program may consist of multiple modules. The computer system may consist of multiple devices. The computer system may consist of a client-server system, a cloud computing system, an IoT system, etc. Various types of data and information are composed of structures such as tables and lists, but are not limited to these. Representations such as identification information, identifiers, IDs, names, and numbers are interchangeable.

[0012] Figure 1 shows an example configuration of an in-vehicle system including a display device or virtual image display device 1. With respect to the vehicle or ride 2 and the driver, the horizontal direction X is the left-right direction, the lateral direction of the vehicle or ride 2, or the width direction of the vehicle or ride 2; the vertical direction Z is the up-down direction, or vertical direction of the vehicle; and the horizontal direction Y, which is perpendicular to the lateral direction of the vehicle or ride 2, is the front-rear direction of the vehicle or ride 2, or the direction of travel of the vehicle. In the example in Figure 1, the direction in which the vehicle travels is set to be the negative direction in the Y-axis direction. The display device 1 may also be called a virtual image display device. The following explanation will use the name "display device". The vehicle or ride 2 is typically an automobile or a truck, but is not limited to these, and may also be a railway vehicle or an aircraft. The following explanation will use the name "vehicle".

[0013] The display device 1 acquires vehicle information 4 from cameras and various sensors installed in various parts of the vehicle 2. The various sensors, for example, detect various events that occur in the vehicle 2 and periodically detect the values ​​of various parameters related to driving conditions. It can also acquire road information from the navigation device 6 (car navigation system), external devices 400, terminal devices 410 (e.g., mobile terminals), and GPS (Global Positioning System) information. The GPS may be installed in the vehicle 2, or it may be installed in the external devices 400 or terminal devices 410.

[0014] Vehicle information 4 includes, for example, vehicle 2's speed information, gear information, steering angle information, lamp illumination information, ambient light information, distance information, infrared information, engine ON / OFF information, camera image information, accelerometer / gyro information, GPS (Global Positioning System) information, navigation information, vehicle-to-vehicle communication information, and vehicle-to-infrastructure communication information. Camera image information includes in-vehicle camera image information and exterior camera image information. GPS information includes latitude and longitude as well as current time information. Vehicle information 4 also includes input information from the driver.

[0015] The display device 1 is connected to the controller 100 of the vehicle 2 via an information transmission path, and the display device 1 and the controller 100 are able to communicate with each other. The controller 100 of the vehicle 2 is an ECU (Electronic Control Unit). The display device 1 and the controller 100 of the vehicle 2 communicate via the information transmission path using, for example, a CAN (Controller Area Network) or LIN (Local Interconnect Network) interface. Alternatively, the display device 1 and the controller 100 of the vehicle 2 may communicate via the information transmission path using an in-vehicle Ethernet or the like. Other connection configurations may also be adopted. For example, when transmitting all information, including video information, through a single information transmission path, the connection between the controller 100 on the vehicle 2 side (source of video information, etc.) and the display device 1 (in other words, the connection configuration of the information transmission path) may be FPD-Link III, GMSL (Gigabit Multimedia Serial Link), etc.

[0016] The in-vehicle system is configured such that the controller 100 controls the vehicle 2 based on data input and output and is connected to the display device 1. The in-vehicle system can communicate with the outside of the vehicle 2 via a communication device or network. Examples of communication with the outside of the vehicle 2 include direct communication and indirect communication. Direct communication is used internationally as ITS (Intelligent Transport System) communication, while indirect communication is performed, for example, via a server to an external device 400 or terminal device 410. The in-vehicle system can send and receive data or information to, for example, a server 700 connected to the network 500 via a relay station 600 on the network 500. The in-vehicle system may also communicate with infrastructure such as external devices and terminals installed on the road on which the vehicle 2 travels.

[0017] Figure 2 shows an example of a device used to acquire vehicle information. As shown in Figure 2, vehicle information 4 is acquired using devices such as a camera and various sensors connected to the controller 100 or control device 100. Note that the various devices in Figure 2 can be deleted, other types of devices added, or replaced with other types of devices as appropriate. Also, as an example, the controller 100 of the vehicle 2 may also have the function of controlling the display device 1.

[0018] The vehicle speed sensor 901 detects the speed of the vehicle 2 and is used to generate speed information as a result of the detection. The shift position sensor 902 detects the current gear and is used to generate gear information as a result of the detection. The steering angle sensor 903 detects the current steering angle and is used to generate steering angle information as a result of the detection. The headlight sensor 904 detects whether the headlights are ON or OFF and is used to generate lamp illumination information as a result of the detection.

[0019] The illuminance sensor 905 and the chromaticity sensor 906 detect ambient light from the vehicle 2 and are used to generate ambient light information as detection results. The distance measuring sensor 907 detects the distance between the vehicle 2 and an external object, or the distance between external objects, and is used to generate distance information as detection results. The infrared sensor 908 detects the presence and distance of objects in the vicinity of the vehicle 2 and is used to generate infrared information as detection results. The engine start sensor 909 detects the ON / OFF status of the engine and is used to generate ON / OFF information as detection results. The acceleration sensor 912 and the gyro sensor 913 detect the acceleration and angular velocity of the vehicle 2 and are used to generate acceleration gyro information representing the attitude and behavior of the vehicle 2.

[0020] The temperature sensor 914 detects the temperature inside and outside the vehicle and is used to generate temperature information as the detection result. For example, if the display device 1 is located inside the dashboard of the vehicle 2, the temperature sensor 914 may be used to detect the temperature inside the dashboard. If a temperature that may affect the operation of the display device 1 is detected, the display device 1 may stop operating. The temperature sensor 914 may also be located in other places that may reach temperatures similar to those inside the dashboard.

[0021] Furthermore, if the display device 1 is installed on the dashboard or elsewhere, the temperature sensor 914 may be used to detect the temperature in the vicinity where the display device 1 is installed. If a temperature is detected that may affect the operation of the display device 1 due to direct sunlight or the like, the display device 1 may stop operating. Here, the temperature sensor 914 may be placed on the dashboard as an example. The temperature sensor 914 may also be placed outside the vehicle, assuming that the temperature near the display device 1 and the temperature outside the vehicle are similar.

[0022] The vehicle-to-infrastructure wireless transceiver 915 generates vehicle-to-infrastructure communication information through vehicle-to-infrastructure communication between the vehicle 2 and roads, signs, signals, etc. The vehicle-to-vehicle wireless transceiver 916 generates vehicle-to-vehicle communication information through vehicle-to-vehicle communication between the vehicle 2 and other surrounding vehicles. The wired wireless communication unit 917 for mobile terminal-to-vehicle communication is a device that acquires information via wired or wireless communication from devices connected to an LTE (Long Term Evolution) network (e.g., Wi-Fi devices). The controller 100 or control device can acquire information transmitted and received on the LTE network via the wired wireless communication unit 917 for mobile terminal-to-vehicle communication.

[0023] The in-vehicle camera 919 and the exterior camera 920 capture images of the interior and exterior of the vehicle and are used to generate in-vehicle and exterior camera image information. Specifically, the in-vehicle camera 919 is, for example, a camera for a Driver Monitoring System (DMS) that captures the driver's posture, eye position, and movement. In this case, by analyzing the captured images, the driver's fatigue level and gaze position can be determined.

[0024] On the other hand, the external camera 920 captures images of the surroundings, such as the front and rear of the vehicle 2. In this case, by analyzing the captured images, it becomes possible to determine the presence or absence of obstacles such as other vehicles or people in the vicinity, buildings and terrain, road surface conditions such as rain, snow, ice, and unevenness, and road signs. The external camera 920 may also include, for example, a drive recorder that records the situation while driving.

[0025] The GPS receiver 921 generates GPS information obtained by receiving GPS signals from GPS satellites. For example, the GPS receiver 921 can obtain the current time, latitude, and longitude. The VICS (Vehicle Information and Communication System, registered trademark) receiver 922 generates VICS information obtained by receiving VICS signals. The GPS receiver 921 and the VICS receiver 922 may be provided as part of a navigation system.

[0026] The voice input device 918 receives the driver's voice and is used to generate voice information. The driver can input operation details via the voice input device 918 by speaking. The vehicle operation switches 911 are used to generate driver operation information for steering wheel switches, etc.

[0027] Furthermore, the video generation unit 910 generates video information based on vehicle information 4 acquired by the controller 100 of the vehicle 2. It can also generate video information based on external information.

[0028] Figure 3 is a block diagram of the display device 1. It is mainly used to control the display of projected images (virtual images) on the display device 1.

[0029] In Figure 3, the display device 1 includes, for example, a control unit 1010, a non-volatile memory 1011, a volatile memory 1012, a storage unit 1013, a display driver 1021, and a light source drive unit 1022, all of which are mounted on a wiring board or the like. The display device 1 also includes a communication unit 1014, a wireless communication unit 1015, a video processing unit 1016, an operation input unit 1017, an external power input unit 1018, a speaker 1019, and a light-emitting indicator 1020.

[0030] The control unit 1010 is specifically a microcontroller unit (MCU), a CPU (Central Processing Unit), etc. Each block other than the control unit 1010 may be mounted within the control unit 1010 as appropriate. Furthermore, the display device 1 is not limited to implementation using the control unit 1010, but may also be implemented using an ECU (Electronic Control Unit) or other semiconductor devices. The configuration shown in Figure 3 may, for example, be a control unit mounted inside the housing of the display device 1, or a control unit mounted outside the housing. Also, the display device 1 can be controlled by a controller in the vehicle 2 or an external device without implementing the control unit 1010 in the display device 1.

[0031] The non-volatile memory 1011 primarily stores programs executed within the control unit 1010, setting parameters used in the processing of each part within the control unit 1010, and predefined audio and video data. The non-volatile memory 1011 may also store information other than programs, such as video, audio, and video.

[0032] The volatile memory 1012 operates by unpacking the program stored in the non-volatile memory 1011. The volatile memory 1012 primarily processes acquired information and various data used in the processing of each part within the control unit 1010 as appropriate.

[0033] The storage unit 1013 stores video data, video data, or audio data for output to the speaker 1019, etc. The video data, video data, or audio data to be stored in the storage unit 1013 may be stored in the storage unit 1013 in advance. Alternatively, the video data, video data, or audio data to be stored in the storage unit 1013 may be received from an external device via the communication unit 1014.

[0034] In Figure 3, the communication unit 1014 transmits and receives information such as vehicle information 4 to and from the controller 100 of the vehicle 2 or various devices such as sensors of the vehicle 2, using a mechanism such as CAN or an in-vehicle Ethernet. The communication unit 1014 may also receive video information using a mechanism such as FPD-Link III or GMSL. The hardware of the communication interface that receives vehicle information 4 and the hardware of the communication interface that receives video information in the communication unit 1014 may be separate or integrated. The communication unit 1014 may also function as the control unit of the display device 1.

[0035] The wireless communication unit 1015 may be configured with a Wi-Fi communication interface, a Bluetooth® communication interface, a mobile communication interface such as 4G or 5G, etc. As shown in Figure 1, the wireless communication unit 1015 may communicate with external devices via a network 500 connected through a router or relay station 600. An example of an external device is a server 700 connected via the network 500. Alternatively, the wireless communication unit 1015 may communicate directly with a terminal device 410, etc. An example of a terminal device 410 is a smartphone, tablet, wireless earphones, headphones, or beacon.

[0036] The video processing unit 1016 may perform distortion correction, conversion, and other processing on the received video information. The video processing unit 1016 may generate video data for the video display unit 200 using acquired vehicle information, external information, etc. Specifically, the distortion correction here corrects the distortion of the video caused by the curvature of the windshield 3 when the video from the display device 1 is projected onto the display area 5, as shown in Figure 1. The video processing unit 1016 may also be implemented by the control unit 1010 reading and executing a program stored in the non-volatile memory 1011 or the volatile memory 1012.

[0037] In other words, the video processing unit 1016 processes video data related to the display video projected onto the display area 5, such as in Figure 1, based on information acquired from an external source or from the vehicle 2. On the other hand, the video processing unit 1016 is not necessarily required, but in such a case, the control unit 1010 can process video information from the vehicle 2 or an external terminal via the communication unit 1014. Alternatively, the controller 100 of the vehicle 2 may process the video information.

[0038] The operation input unit 1017 is, for example, an operation button, a receiver for a remote controller, or an infrared light receiver, and is used to input user operations. The operation input unit 1017 may be used, for example, for the driver to operate the display device 1.

[0039] The external power input unit 1018 receives power from an external source and supplies the necessary power to each part of the display device 1 shown in Figure 3.

[0040] The speaker 1019 emits sound based on audio data stored in the volatile memory 1012, the non-volatile memory 1011, or the storage unit 1013.

[0041] The light-emitting indicator 1020 emits light using a light-emitting element or the like, and can notify the user of the status of the display device 1 by the timing of the light emission of the light-emitting element or the color of the emitted light.

[0042] The display driver 1021 drives each display element (pixel) included in the display panel 11 based on the video data. This allows the video display unit 200 to create and display an image for projection onto the display area 5 based on the video data. The display driver 1021 can be configured, for example, by a circuit mounted on a circuit board.

[0043] The light source drive unit 1022 drives the light source 20 to generate light. Based on the drive from the light source drive unit 1022, the light source 20 generates light and supplies it to the display panel 11. Based on vehicle information 4 received via the communication unit 1014, or information from a terminal device, the light source 20 is adjusted or controlled using the light source drive unit 1022, which is the driver used to drive the light source.

[0044] In addition, the display device 1 may protect the display panel 11 based on external light information from the illuminance sensor 905 or the like. That is, in order to prevent sunlight from hitting the display panel 11 and burning the display panel 11, the display device 1 may perform an operation of protecting the display panel 11 from sunlight according to the value of the illuminance sensor 905. More specifically, when the intensity of the external light or sunlight acquired by the illuminance sensor 905 is strong and there is a risk that the display panel 11 may be burned out, the luminance of the light source 20 is reduced, and the amount of light from the light source 20 incident on the display panel 11 is suppressed, thereby suppressing the temperature rise of the display panel 11.

[0045] Each part of FIG. 3 may be implemented by a dedicated circuit such as an FPGA (Field Programmable Gate Array) as appropriate. In the present embodiment, the configuration includes a non-volatile memory 1011, a volatile memory 1012, a storage unit 1013, and a video processing unit 1016, but the above processing may be made to function by one memory.

[0046] Next, the video display unit 200 will be specifically described. The video display unit 200 projects video light of a video formed on the display panel 11 using light emitted from the light source 20 (in other words, light source light) based on video data. The video display unit may be referred to as a projection-type video display device or a projector. The video display unit 200 includes a light source 20 and a display panel 11 such as a liquid crystal panel LCD (Liquid Crystal Display) having a video display element.

[0047] The light source 20 functions as a backlight source of the display panel 11. The light source 20 is configured using, for example, a semiconductor light source element, generates predetermined light source light, and supplies it to the display panel 11. Typically, an LED (Light Emitting Diode) element is used as the semiconductor light source element. The light source 20 may have a configuration in which a plurality of light sources are arranged. A light source unit (backlight unit) 12 described later may be configured using the light source 20 or the like.

[0048] The display panel 11 generates and emits video light obtained by modulating video based on the light from the light source. That is, the display panel 11 forms and displays video on the display screen based on video data, and generates and emits video light corresponding to the video based on the light from the light source 20. In this embodiment, the video data is described as the video data input from the video processing unit 1016. The display panel 11 forms a video for projection onto the display area 5 by modulating the light from the light source 20 for each pixel according to the video data, and projects it as video light (or projection light).

[0049] Further, the display panel 11 may be a screen plate having a diffusion function, not limited to a liquid crystal panel. As means for projecting video onto a screen plate having a diffusion function, means such as combining a DMD (Digital Micromirror Device) or an image of a liquid crystal panel with a projection lens for projection, or means using a microelectromechanical system (MEMS) may be used.

[0050] FIGS. 4 and 5 are diagrams showing a configuration example in which the display device 1 is mounted on the vehicle 2. FIG. 4 shows an example in which the display device 1 is mounted on a passenger car. The passenger car is a sports car, sedan, SUV (Sport Utility Vehicle), minivan, etc. in which the angle of the windshield 3 is 20° to 45° with respect to the Y-axis (the front-rear direction or the traveling direction of the vehicle 2). FIG. 5 shows an example in which the display device 1 is mounted on some passenger cars and commercial vehicles. In other words, the windshield or the front glass 3 in FIG. 5 is in a raised state. Specifically, it is a light super-high wagon, truck, or bus in which the angle of the front glass 3 is 45° to 90° with respect to the Y-axis (the front-rear direction or the traveling direction of the vehicle 2). As shown in FIGS. 4 and 5, the display device 1 is disposed on the dashboard 7 of the vehicle 2. The display device 1 may be mounted so as to be embedded in the dashboard 7. The dashboard 7 also includes, for example, an instrument panel including a meter cluster in front of the steering wheel.

[0051] As shown in Figures 4 and 5, the image light 13 in Figure 4 is emitted toward the driver, and the image light 13 in Figure 5 is emitted toward the windshield 3. The image light 13 emitted from the display device 1 is reflected when it is irradiated onto the windshield or windshield 3. The reflected image light 13 is incident on the driver's viewpoint 14. From the driver's viewpoint 14, a virtual image 10 corresponding to the image light 13 is formed and visible at a position visible through the display area 5 (Figure 1) of the display device 1 corresponding to the irradiation area of ​​the image light 13. In this embodiment, the projection of image light onto the display area 5 of the windshield 3 is described, but the projection unit that projects the image light may be a projection member other than the windshield 3.

[0052] Figure 6 shows the video display unit 200 of the display device 1. The light source unit 12 may also be called the backlight unit. The light source unit 12 includes a light source 20, a reflective mirror 21, a polarization conversion element 22, and a light guide unit 23, and may also include a diffuser plate 24. The reflective mirror 21 is used to reflect light from the light source 20 and adjust it to parallel light. The reflective surface of the reflective mirror 21 is a parabolic surface and may be asymmetrical with respect to the optical axis of the light emitted from the light source 20. The reflective mirror 21 may also be positioned eccentrically with respect to the light source 20. The reflective mirror 21 may also be called a reflector.

[0053] The polarization conversion element 22 is composed of a polarizing beam splitter (PBS) and a phase difference film (1 / 2λ). It separates incident light into S-polarized and P-polarized light, and then uses the phase difference film (1 / 2λ) to polarize either the separated S-polarized or P-polarized light, so that the randomly polarized light incident on the polarization conversion element 22 is emitted as linearly polarized light.

[0054] The light guide section 23 may also be called an optical transmission section. The light guide section 23 is configured to adjust the angle of incidence of light rays to the display panel 11, and in this example, it is configured using an optical reflecting section 23a having a prism shape (a jagged shape). The light guide section 23 may also be a prism sheet as an example. In this example, the light rays incident on the optical reflecting section 23a of the light guide section 23 are adjusted to a predetermined light distribution and reflected toward the display panel 11. The distribution of light incident on the display panel 11 can be adjusted by the shape of the reflective surface of the optical reflecting section 23a, the inclination of the reflective surface, the surface roughness, etc. In this structure, the optical axis of the light source 20 and the optical axis of the light incident on the display panel 11 are parallel or approximately parallel.

[0055] The light guide 23 is, for example, a resin member having a prism shape, and the prism-shaped portion that becomes the reflective surface is coated with an Al reflective film or the like. The light reflective portion 23a of the light guide 23 may be configured to have multiple inclinations on one surface in order to achieve more precise adjustment of reflected light. Furthermore, the reflective surface may be composed of multiple or multifaceted surfaces, or it may be composed of curved surfaces. When a large number of reflective surfaces and connecting surfaces are alternately formed in a sawtooth pattern on the light reflective portion 23a, the light incident on the light guide 23 is reflected on each reflective surface and directed toward the display panel 11, and further adjusted to a predetermined light distribution characteristic via the diffuser plate 24 before incident on the display panel 11. The diffuser plate 24 uniformly disperses the incident light from the light guide 23. The diffuser plate 24 has the effect of improving the brightness uniformity within the virtual image plane.

[0056] Furthermore, the video display unit 200 may have a configuration other than that shown in Figure 6, and may, for example, include a light source, an illumination optical system, a PBS or polarization separation element, and a reflective liquid crystal panel or LCOS.

[0057] Since the display device 1 does not enlarge the image using a concave mirror or the like, it has low sensitivity to distortion of the windshield 3's shape and can be retrofitted. However, because the image output by the display element is virtual, the display element must also be large in order to enlarge the virtual image. Furthermore, as an example, in commercial vehicles such as buses and trucks, the effective usage conditions are not for the driver to constantly look at the image, but rather there is a great need to display an alert in front of the driver's field of vision to make the driver aware of it, in order to prevent wrong turns, premature departures, speeding, etc.

[0058] Depending on the purpose, display device 1 displays images, but in order to make it easier for the driver to notice the warning alert, it is necessary to improve the display image itself, and also to display the display image in a larger size. However, as mentioned above, increasing the size of the display image leads to a larger display element, resulting in higher costs, a larger set volume due to the larger backlight, and increased power consumption.

[0059] Therefore, we will explain a technology that, compared to simply increasing the size of the display image itself, can suppress increases in set volume and power consumption, and can also assist the driver.

[0060] Figure 7 shows an example of the structure of the display device 1. As shown in the right-hand figure of Figure 7, the display device 1 is equipped with a light-emitting unit 201 around the portion of the video display unit 200 from which the video light is emitted or around the display area of ​​the video display unit 200, and the light-emitting unit 201 displays a virtual image by emitting light around the display image.

[0061] Here, the light-emitting unit 201 may, for example, include one or more LED chips. When the video display unit 200 displays an image at 1:1 magnification, the display device 1 can display a virtual image corresponding to the positional relationship between the display area of ​​the video display unit 200 and the LED chips, as shown in the left diagram of Figure 7. For example, when the video display unit 200 is viewed from the front as shown in the right diagram of Figure 7, and the arrows 220 are in the same direction, the LED chip 201a is positioned in the upper right of the display area of ​​the video display unit 200, the LED chip 201b is positioned in the lower right of the display area of ​​the video display unit 200, and the LED chip 201c is positioned in the upper left of the display area of ​​the video display unit 200. The arrows 220 point to the rear of the vehicle (from the windshield towards the driver) in the front-rear direction of the vehicle. In this case, the driver can see, from the driver's perspective, the virtual image 10 produced by the video display unit 200, the virtual image 10a produced by the LED chip 201a located to the upper right of the virtual image 10 produced by the video display unit 200, the virtual image 10b produced by the LED chip 201b located to the lower right of the virtual image 10 produced by the video display unit 200, and the virtual image 10c produced by the LED chip 201c located to the upper left of the virtual image 10 produced by the video display unit 200.

[0062] Furthermore, the light-emitting section 201 may, for example, include a bar of LEDs. Alternatively, the light-emitting section 201 may include a portion in which LED chips are arranged in one direction. The light-emitting section 201 can be constructed using LED chips, LED bars, etc., as light-emitting elements (LEs).

[0063] The light-emitting unit 201 is controlled by a processor, which may, for example, control the light-emitting unit 201 to emit light according to the content of the information displayed by the video display unit 200. Here, the processor may, for example, be configured to control the video display of the display device 1, such as the control unit 1010 of the display device 1, the controller 100 of the vehicle 2, or a control device provided by the external device 400. Furthermore, control may be performed by one or more of these configurations.

[0064] Furthermore, the processor may, for example, acquire brightness information of the video output by the video display unit 200 and cause the light-emitting unit 201 to emit light in accordance with the brightness of the video output by the video display unit 200.

[0065] Next, an example of a light emission control method will be described with reference to Figure 8. As shown in Figure 8, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 coincide with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LE of the light emission unit 201 is positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with.

[0066] The upper diagram of Figure 8 illustrates a situation where vehicle 2 is accelerating despite being supposed to turn left according to the route navigation and vehicle status, and the turn signal is not activated. The display device 1 displays this situation on the video display unit 200 and displays a virtual image representing the situation. For example, the video display unit 200 displays information related to the route navigation 801 and information related to warnings 802, and virtual images of this information are displayed. In this example, information about the left turn related to the route navigation, warning information indicating that vehicle 2 is not decelerating, and warning information indicating that the turn signal is not activated are displayed.

[0067] In conjunction with this display, the processor, for example, acquires information related to the route navigation, illuminates the light-emitting element LE corresponding to the direction of the turn, and displays a virtual image corresponding to the direction of the turn. In this example, the processor illuminates the light-emitting element LE, which is positioned along the left side of the display area of ​​the video display unit 200, in red, and displays a virtual image from the light-emitting element to the left of the virtual image from the video display unit 200. In this way, an auxiliary display is provided to make the driver aware of information regarding the direction of the turn.

[0068] In addition, along with this display, the processor illuminates the light-emitting element LE on the side where the warning information 802 is displayed. In this example, the processor illuminates the light-emitting element LE located along the bottom of the video display unit 200 in red, and displays a virtual image from the light-emitting element LE below the virtual image on the video display unit 200. In this way, an auxiliary display is provided to make the driver aware of the warning information.

[0069] If the driver notices the information and takes appropriate action, the display of the warning information 802 is stopped and the light-emitting unit 201 turns off. On the other hand, if the driver does not take action, the display device 1 displays the warning more clearly on the video display unit 200. The processor then performs an auxiliary display by making the light-emitting element LE around the entire circumference of the display area of ​​the video display unit 200 on the light-emitting unit 201 blink more brightly B, thereby controlling the driver to notice the information.

[0070] The processor may determine whether the driver has responded based on predetermined conditions and perform the control accordingly. For example, if the display device 1 displays information related to the route navigation, and then the processor obtains information regarding the driving of vehicle 2 which is not following the route navigation, it may determine that the driver has not responded and perform the control accordingly. The video display unit 200 may also display information that more clearly warns of a route error, i.e., that the vehicle is not driving according to the guidance of the route navigation. In addition, although an example in which the light-emitting unit 201 lights up / flashes in red has been described, the light-emitting unit 201 may light up / flashe in a different color.

[0071] The lower diagram of Figure 8 shows a situation where vehicle 2 is a bus and a bus passenger has pressed the bus stop button. The display device 1 displays this situation on the video display unit 200 and displays a virtual image representing this situation. For example, the video display unit 200 displays information 811 instructing the driver to stop at the next bus stop and displays a virtual image related to this information.

[0072] When the bus stop button is pressed, the processor lights up the light-emitting unit 201 and displays a virtual image using the light-emitting element LE. The processor may also light up any or more, or all, of the following in the vehicle width direction: the light-emitting element LE on the left side of the display area of ​​the video display unit 200, the light-emitting element LE on the right side of the display area of ​​the video display unit 200, the light-emitting element LE above the display area of ​​the video display unit 200, and the light-emitting element LE below the display area of ​​the video display unit 200. In this way, an auxiliary display is provided to make the driver aware of information regarding the stop instruction.

[0073] The display device 1 then displays information 812 regarding the distance to the bus stop on the video display unit 200. The display device 1 also displays a scale 813 related to the distance to the bus stop on the video display unit 200. In this example, the scale is displayed on the left and right sides of the display area of ​​the video display unit 200, aligned with the light-emitting element LE. The display device 1 may also display this information when the distance between the bus stop and the vehicle 2 approaches a predetermined distance. The unit of the scale 813 is, for example, 100m, but may be different.

[0074] Furthermore, the processor, for example, acquires route navigation information from a car navigation system 6 and controls the light-emitting unit 201 in conjunction with the route navigation information. Here, the processor lights up the light-emitting element LE on the scale 813 side that corresponds to the distance to the bus stop, providing an auxiliary display to make the driver aware of the distance to the bus stop.

[0075] For example, if the display device 1 displays a scale 813 in 100m increments, and the processor obtains information that the distance to the bus stop is 300m based on the route navigation information, the processor will light up the light-emitting elements LE at positions from 0m to 300m (i.e., the light-emitting elements LE at positions 0 to 3), as shown in the lower diagram of Figure 8. Then, as the vehicle 2 approaches the bus stop, the processor will light up the light-emitting elements LE in a sliding manner in accordance with the decreasing distance between the vehicle 2 and the bus stop. In this way, by displaying the distance to the bus stop in conjunction with the route navigation information as a slide bar, it is possible to provide driving assistance to the driver. The light-emitting elements LE on the scale 813 side can be composed of, for example, a bar of LEDs or LED chips arranged closely together in one direction. However, the light-emitting elements LE on the scale 813 side may also be LED chips arranged at intervals corresponding to the height of the scale. The processor may, for example, perform control to turn off the light-emitting element LE at the position of the scale indicating a distance longer than the current distance between the vehicle 2 and the bus stop, and to turn on the light-emitting element LE at the position of the scale indicating a distance shorter than the current distance between the vehicle 2 and the bus stop.

[0076] The above-described light emission control method, with reference to Figure 8, can be suitably used, for example, to assist drivers of commercial vehicles such as trucks and buses, and can effectively assist in raising awareness.

[0077] Next, an example of a light emission control method will be described with reference to Figure 9. As shown in Figure 9, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 coincide with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LE of the light emission unit 201 is positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with.

[0078] The upper diagram of Figure 9 shows a situation where vehicle 2 is a bus and the bus is stopped at a bus stop until departure. The display device 1 displays this situation on the video display unit 200 and displays a virtual image of the situation. For example, the video display unit 200 displays information 901i indicating that the bus is stopped and information 902i regarding the remaining time until departure, and displays virtual images of this information.

[0079] In conjunction with this display, the processor lights up the light-emitting unit 201 to display a virtual image using the light-emitting element LE. The processor may light up any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE above the display area of ​​the video display unit 200, and the light-emitting elements LE below the display area of ​​the video display unit 200. In this example, the processor lights up the light-emitting elements LE on the left, right, top, and bottom sides of the display area of ​​the video display unit 200. The processor may also light up the light-emitting elements LE in red, as an example. In this way, an auxiliary display is provided to make the driver aware of the information 901i indicating that the vehicle is stopped and the information 902i regarding the remaining time until departure. In this example, the processor lights up the light-emitting elements LE, but the light-emitting elements may also be made to blink.

[0080] Then, at the time when it is time for vehicle 2 to depart (i.e., when vehicle 2 is ready to depart), the display device 1 displays information indicating that departure is possible on the video display unit 200 and displays a virtual image of this information. In conjunction with this display, the processor lights up the light-emitting unit 201 and displays a virtual image using the light-emitting element LE. The processor may light up any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE on the upper side of the display area of ​​the video display unit 200, and the light-emitting elements LE on the lower side of the display area of ​​the video display unit 200. In this example, the processor lights up the light-emitting elements LE on the left, right, upper, and lower sides of the display area of ​​the video display unit 200. Also, as an example, the processor lights up the light-emitting elements LE in blue. In this way, an auxiliary display is made to make the driver aware of the information indicating that departure is possible. In this example, the processor lights up the light-emitting elements LE, but the light-emitting elements LE may also blink.

[0081] The lower diagram in Figure 9 shows a situation where vehicle 2 is a truck and the truck is traveling at a speed near the speed limit. The display device 1 displays this situation on the video display unit 200 and displays a virtual image representing the situation. For example, the video display unit 200 displays information 911i regarding the current speed and displays a virtual image of this information. In this example, the speed limit is set to 90 km / h.

[0082] When the speed of vehicle 2 approaches the speed limit, the processor, for example, lights up the light-emitting unit 201 and displays a virtual image using the light-emitting element LE based on the acquired vehicle information 4. More specifically, the processor lights up the light-emitting unit 201 when the current speed of vehicle 2 is within a range between a predetermined speed slower than the speed limit and the speed limit. The processor may also light up any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE on the upper side of the display area of ​​the video display unit 200, or the light-emitting elements LE on the lower side of the display area of ​​the video display unit 200. In this example, the processor lights up the light-emitting elements LE on the left, right, upper, and lower sides of the display area of ​​the video display unit 200. The processor may also light up the light-emitting elements LE in yellow as an example. In this way, an auxiliary display is provided to make the driver aware that the speed of vehicle 2 is approaching the speed limit.

[0083] In this example, a predetermined speed is set so that the processor displays an auxiliary indicator when the vehicle 2 is traveling at a speed 5 km / h slower than the speed limit. However, the speed at which the auxiliary indicator is displayed relative to the speed limit may be set as appropriate. The processor may also obtain speed limit information from a device such as a car navigation system 6, for example. Alternatively, the processor may obtain speed limit information through communication with an external device of the vehicle 2.

[0084] Furthermore, if the speed of vehicle 2 exceeds the speed limit, the processor, for example, flashes the light-emitting unit 201 based on the acquired vehicle information 4, and displays a virtual image using the light-emitting element LE. More specifically, the processor flashes the light-emitting unit 201 if the current speed of vehicle 2 is greater than or equal to the speed limit. The processor may flash any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE above the display area of ​​the video display unit 200, or the light-emitting elements LE below the display area of ​​the video display unit 200. In this example, the processor flashes the light-emitting elements LE on the left, right, top, and bottom sides of the display area of ​​the video display unit 200. The processor may also, for example, flash the light-emitting elements LE in red. In this way, an auxiliary display is provided to make the driver aware that the speed of vehicle 2 exceeds the speed limit.

[0085] The above-described light emission control method, with reference to Figure 9, can be suitably used, for example, to assist drivers of commercial vehicles such as trucks and buses, and can effectively assist in raising awareness.

[0086] Next, an example of a light emission control method will be described with reference to Figure 10. As shown in Figure 10, the light emission unit 201 may be configured such that, when viewed from the front side, the light-emitting element LEs of the light emission unit 201 are positioned on the left and right sides of the display area of ​​the light emission unit 200, aligned with the light emission unit 200, so that a virtual image can be displayed. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the light emission unit 200 are arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0087] If the video display unit 200 outputs the video 1001 and a predetermined set value (for example, the brightness value of the video displayed by the video display unit 200) together, the displayed content may become complex, making it difficult for the driver to grasp the content of the video 1001. Therefore, the video display unit 200 may not display the predetermined set value, and control may be performed to indicate the set value using the light-emitting element LE.

[0088] On the left and right sides of the video display unit 200, light-emitting elements (LEs) are arranged to form a scale of predetermined set values. The processor acquires information regarding the predetermined set values ​​and indicates these predetermined set values ​​by lighting up the light-emitting elements (LEs). In this example, five scales worth of light-emitting elements (LEs) are arranged on the left and right sides of the display area of ​​the video display unit 200. The processor acquires information regarding the brightness of the video 1001 on the video display unit 200 and indicates the brightness value of the video 1001. For example, when the brightness value of the video 1001 on the video display unit 200 has reached 20% but not yet reached 40%, the processor lights up one scale worth of light-emitting elements (LEs). For example, when the brightness value of the video 1001 on the video display unit 200 has reached 80% but not yet reached 100%, the processor lights up four scales worth of light-emitting elements (LEs).

[0089] In this example, the light-emitting elements (LEs) were arranged with spacing between them. However, the light-emitting elements (LEs) may also have a bar-like structure or a structure where they are closely spaced in one direction. The processor may also perform control to express a predetermined set value by the height of the illuminated light-emitting elements (LEs).

[0090] In the above-described light emission control method, with reference to Figure 10, when a button is pressed to operate a predetermined set value, the predetermined set value can be displayed independently of the image on the video display unit 200. Therefore, the complexity of the image displayed by the video display unit 200 is suppressed. In addition, the displayed image does not need to be changed when the predetermined set value is changed, thereby improving operability. Furthermore, this light emission control method can be suitably used to assist drivers of vehicles 2 other than commercial vehicles such as trucks and buses (for example, a passenger car), and can effectively assist in raising awareness.

[0091] Next, an example of a light emission control method will be described with reference to Figure 11. As shown in Figure 11, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 are aligned with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LEs of the light emission unit 201 are positioned on the left and right sides of the display area of ​​the video display unit 200, and aligned with the video display unit 200. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the video display unit 200 are arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0092] The upper diagram of Figure 11 shows a situation where instructions for the direction to turn at an intersection based on route navigation are output. The display device 1 displays this situation on the video display unit 200 and displays a virtual image of the situation. For example, the video display unit 200 displays information 1101 indicating the direction of travel at the intersection and information 1102 indicating the distance to the intersection, and displays a virtual image of this information. The display device 1 also displays a scale 1103 related to the distance to the intersection on the video display unit 200. In this example, the scale 1103 is displayed on the left and right sides of the display area of ​​the video display unit 200, along the light-emitting element LE. The display device 1 may also display this information when it approaches a predetermined distance from the intersection. The unit of the scale 1103 is, for example, 100m, but may be different.

[0093] In conjunction with this display, the processor, for example, acquires route navigation information from a car navigation system 6 and controls the light-emitting unit 201 in conjunction with the route navigation information. Here, the processor lights up the light-emitting element LE on the side the vehicle 2 is turning, at a position corresponding to the distance to the intersection, providing an auxiliary display to make the driver aware of the distance to the intersection.

[0094] For example, if the display device 1 displays a scale 1103 in units of 100m, and the processor obtains information about turning right at an intersection and information that the distance to the intersection is 300m based on the route navigation information, the processor will light up the light-emitting elements LE (i.e., the light-emitting elements LE at positions 0m to 300m) on the right side of the display area of ​​the video display unit 200 (i.e., the light-emitting elements LE at positions 0 to 3).

[0095] The processor may also illuminate the portion of the light-emitting element (LE) that indicates the current position (in this example, the 3rd mark) with greater emphasis compared to other parts. For example, the processor may control the brightness of the portion of the scale indicating the current position to be higher than that of other parts.

[0096] As vehicle 2 approaches the intersection, the processor illuminates the light-emitting element LE in a sliding motion as the distance between vehicle 2 and the intersection decreases. The processor also flashes the light-emitting element LE when the distance between vehicle 2 and the intersection is less than or equal to a predetermined distance. In this example, the predetermined distance corresponds to one division of the scale, and the processor flashes the light-emitting element LE corresponding to one division when the distance to the intersection is one division.

[0097] In this way, by displaying the distance to the intersection as a slider bar in conjunction with the route navigation information, driver assistance can be provided to the driver. Furthermore, by displaying the direction of travel of vehicle 2 in conjunction with the route navigation information, driver assistance can be provided to the driver. Additionally, when approaching an intersection, the system can alert the driver by using a flashing light (B) instead of a steady light.

[0098] The light-emitting element LE on the scale 1103 side may, for example, be composed of an LED bar or LED chips arranged closely together in one direction. The processor may, for example, control the light-emitting element LE at the scale position indicating a distance longer than the distance to the intersection and turn on the light-emitting element LE at the scale position indicating a distance shorter than the distance to the intersection. The processor may also make the light-emitting element LE in the portion of the scale less than or equal to one scale division blink when the distance to the intersection becomes one scale division or less.

[0099] The lower diagram in Figure 11 illustrates the situation when vehicle 2 is parked. The display device 1 displays information indicating the tilt of the tires on the video display unit 200 and displays a virtual image representing this information. For example, the video display unit 200 displays information 1111 regarding the level of the tilt of the vehicle 2's tires and video information 1112 showing the tilt of the vehicle 2's tires relative to a reference, and the display device 1 displays a virtual image of this information. The display device 1 also displays a scale 1113 related to the tilt of the vehicle 2's tires on the video display unit 200. In this example, the scale 1113 is displayed on the left and right sides of the display area of ​​the video display unit 200, aligned with the light-emitting element LE. The display device 1 may also perform this display when vehicle 2 is in reverse gear. For example, the unit of the scale 1113 is 1 level, and a higher level indicates a greater tilt of the tires.

[0100] For example, if the processor acquires information based on vehicle information 4 indicating that the tire is tilted to the left at level 5, the processor illuminates the light-emitting element LE at the level 5 position, as shown in the lower part of Figure 11. The processor may also illuminate the light-emitting elements LE at positions up to level 5 (i.e., light-emitting elements LE at positions 0 to 5). Similarly, if the tire of vehicle 2 is tilted to the right, and the processor acquires information based on vehicle information 4 indicating that the tire is tilted to the right at level 2, the processor illuminates the light-emitting elements LE at positions up to level 2 (i.e., light-emitting elements LE at positions 0 to 2), as shown in the lower part of Figure 11. The processor may also illuminate the light-emitting element LE at the level 2 position. In this way, the processor acquires information on the tire's tilt and illuminates the light-emitting elements LE at the position corresponding to the current tire's tilt.

[0101] The light-emitting element LE on the scale 1113 side may, for example, be composed of a bar of LEDs or LED chips arranged closely together in one direction. The distance between the light-emitting elements LE may be predetermined, increased, or decreased. The processor may, for example, turn off the light-emitting elements LE in the area where the tire tilt is greater than the current tilt, and turn on the light-emitting elements LE in the area where the tire tilt is less than the current tilt.

[0102] The above-described light emission control method, with reference to Figure 11, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0103] Next, an example of a light emission control method will be described with reference to Figure 12. As shown in Figure 12, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 are aligned with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LEs of the light emission unit 201 are positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the video display unit 200 are arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0104] Figure 12 illustrates a situation where a vehicle is traveling on a public road. In this example, vehicle 2 is traveling on the left side of the road. The display device 1, as an example, displays the current speed of vehicle 2 on the video display unit 200 and displays a virtual image.

[0105] When another vehicle approaches vehicle 2, the display device 1 displays information indicating the approach of the vehicle on the video display unit 200 and displays a virtual image of the information. The display device 1 may also display the direction of the approaching vehicle. In this example, the display device 1 displays information 1201 that an overtaking vehicle traveling on the right side of the lane is approaching vehicle 2.

[0106] In conjunction with this display, the processor acquires vehicle information 4 regarding the approach of other vehicles and controls the light-emitting unit 201. Here, the processor lights up the light-emitting element LE at the position corresponding to the direction of approach of the vehicle, providing an auxiliary display to alert the driver to the presence of other vehicles.

[0107] Furthermore, if the turn signal of the approaching vehicle is activated while another vehicle is approaching, the display device 1 displays warning information 1202 regarding the approaching vehicle on the video display unit 200 and displays a virtual image of the information. In this example, the warning information is displayed when the right turn signal is activated.

[0108] In conjunction with this display, the processor acquires vehicle information 4 regarding the approach of other vehicles and information regarding the status of the turn signals, and controls the light-emitting unit 201. Here, if the turn signals of the other vehicle are ON, the processor performs an auxiliary display by flashing the light-emitting element LE around the entire circumference of the display area of ​​the video display unit 200 in the light-emitting unit 201, thereby controlling the driver to notice the information. In this way, the auxiliary display is made more rigorous to help the driver notice the warning in the displayed video.

[0109] The above-described light emission control method, with reference to Figure 12, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0110] Next, an example of a light emission control method will be described with reference to Figure 13. As shown in Figure 13, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 coincide with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LEs of the light emission unit 201 are positioned along the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to enable the display of a virtual image. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the video display unit 200 are arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0111] Figure 13 relates to the display of the remaining amount of gasoline in a vehicle. For example, when the remaining amount of gasoline in the vehicle 2 decreases to a predetermined value (first predetermined value), the display device 1 displays the current amount of gasoline in the vehicle 2 on the video display unit 200 and displays a virtual image. In this example, information 1301 showing the current amount of gasoline in the vehicle 2 (in this example, a diagram showing the amount of gasoline) is displayed on the lower right side of the display area of ​​the video display unit 200. In this example, the first predetermined value is set to a value corresponding to 20% remaining, but the first predetermined value may be a different value.

[0112] In conjunction with this display, the processor acquires information regarding the current fuel level of the vehicle 2 based on the vehicle information 4 and controls the light-emitting unit 201. Here, the processor lights up the light-emitting element LE on the side where the information 1301 is displayed, which is located close to the display position of the information 1301, thereby providing an auxiliary display to alert the driver to the fuel level information.

[0113] Furthermore, when the amount of gasoline remaining in vehicle 2 decreases to a predetermined value (i.e., a second predetermined value indicating a lower amount than the first predetermined value), the display device 1, for example, highlights the current amount of gasoline remaining in vehicle 2 on the video display unit 200 and displays a virtual image. In this example, information 1302 indicating the highlighted amount of gasoline remaining in vehicle 2 (in this example, a diagram showing the amount of gasoline remaining) is displayed at the bottom center of the video display unit 200. The display device 1 also displays information 1303 (for example, a message) regarding a warning about the amount of gasoline remaining in vehicle 2. In this example, the second predetermined value is set to a value corresponding to 10% remaining, but the second predetermined value may be a different value.

[0114] In conjunction with this display, the processor controls the light-emitting unit 201 based on the remaining fuel level of the vehicle 2, which is determined by the acquired vehicle information 4. Here, if the current remaining fuel level of the vehicle 2 is below a second specified value, the processor performs an auxiliary display by flashing the light-emitting element LE around the entire circumference of the display area of ​​the video display unit 200 in the light-emitting unit 201, thereby alerting the driver to the information. In this way, the auxiliary display is made more rigorous to help the driver notice the warning in the displayed video.

[0115] The above-described light emission control method, with reference to Figure 13, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0116] Next, an example of a light emission control method will be described with reference to Figure 14. As shown in Figure 14, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 are aligned with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LEs of the light emission unit 201 are positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with the video display unit 200, so as to be able to display a virtual image. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the video display unit 200 are arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0117] Figure 14 relates to the display of the driver's seat belt wearing status in vehicle 2. As an example, if the driver is not wearing a seat belt, the display device 1 displays an indication on the video display unit 200 that the seat belt is not being worn, and displays a virtual image. In this example, information 1401 indicating that the seat belt is not being worn (in this example, a diagram indicating that the seat belt is not being worn) is displayed on the lower right side of the display area of ​​the video display unit 200.

[0118] In conjunction with this display, the processor acquires information regarding the driver's seatbelt wearing status in the vehicle 2 based on the vehicle information 4 and controls the light-emitting unit 201. Here, the processor lights up the light-emitting element LE on the side where the information 1401 is displayed, which is located closest to the information 1401, thereby providing an auxiliary display to alert the driver that the seatbelt is not being worn.

[0119] If the seat belt remains unfastened for a predetermined period of time, the display device 1, for example, highlights the information that the seat belt is unfastened on the video display unit 200 and displays a virtual image. In this example, the highlighted information 1402 indicating that the seat belt is unfastened (in this example, a diagram showing that the seat belt is unfastened) is displayed at the bottom center of the video display unit 200. The display device 1 also displays warning information 1403 (for example, a message) regarding the unfastened seat belt. In this example, the predetermined period is set to 1 minute, but it may be different.

[0120] In conjunction with this display, the processor controls the light-emitting unit 201 based on the seat belt usage status information obtained from the vehicle information 4. Here, if the seat belt remains unfastened for a predetermined period of time, the processor performs an auxiliary display by flashing the light-emitting element LE around the entire circumference of the display area of ​​the video display unit 200 in the light-emitting unit 201, thereby alerting the driver to the information. In this way, the auxiliary display is made more rigorous to help the driver notice the warning in the displayed video.

[0121] The above-described light emission control method, with reference to Figure 14, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0122] The image displayed by the image display unit 200 may, for example, be displayed using a backlight with a white LED as the light source. The processor may then adjust the brightness of the light-emitting element LE emitted by the light-emitting unit 201 based on the duty cycle of the white LED.

[0123] Furthermore, considering visibility, it is desirable to adjust the brightness of the display image from the video display unit 200 and the brightness of the light-emitting element LE emitted by the light-emitting unit 201 to be the same. However, for emphasis, the processor may make the light-emitting element LE light up so that it is brighter than the display image from the video display unit 200. Alternatively, the processor may make the light-emitting element LE light up so that it is dimmer than the display image from the video display unit 200.

[0124] In bright environments (for example, during the day), the iris is closed and less noticeable, so it is preferable for the processor to emit light from the light-emitting element LE of the light-emitting unit 201 at a brightness of 0.9 to 1.3 times the brightness of the image displayed by the image display unit 200. Also, in dark environments (for example, at night), the iris is open and more noticeable, so it is preferable for the processor to emit light from the light-emitting element LE of the light-emitting unit 201 at a brightness of 0.7 to 1.1 times the brightness of the image displayed by the image display unit 200.

[0125] For example, the processor may acquire brightness information of the display image shown by the video display unit 200 and adjust the brightness of the light-emitting element LE based on the acquired information. Alternatively, for example, the processor may acquire information about the brightness of the environment from the illuminance sensor 905, determine whether the environment is bright or dark, and then control the brightness of the light-emitting element LE of the light-emitting unit 201 based on the determination result.

[0126] Furthermore, the device may be equipped with a circuit that performs PWM (Pulse Width Modulation) control over the current flowing through the light-emitting unit 201. The processor may then control this circuit and adjust the brightness of the light-emitting element LE to match the brightness of the backlight based on the PWM control. In this case, the brightness can be adjusted effectively. The relationship between the backlight brightness and the brightness of the light-emitting element LE may be adjusted to create varying levels of alert intensity, so the brightness of the light-emitting element LE may be set to be brighter or dimmer than the backlight brightness.

[0127] The light-emitting element LE of the light-emitting section 201 may be an RGB integrated element that emits light corresponding to each of the following colors: R (red), G (green), and B (blue).

[0128] An auxiliary display is provided using the light-emitting unit 201, and if the driver notices the information, control may be implemented to prevent it from interfering with driving. An embodiment will be explained using Figures 15 to 22. Note that explanations that are the same as those already described may be omitted.

[0129] As shown in Figure 15, a sensor is used to detect the driver's gaze, and in this embodiment, a gaze detection sensor will be used for explanation. Examples of gaze detection sensors include a camera 221 mounted inside the vehicle 2, a sensor mounted inside the vehicle 2 (external sensor 223), and a sensor mounted on the display device 1 (mounted sensor 224). The camera 221 is positioned so that the driver's face is included within the camera's field of view 222. The external sensor 223 and the mounted sensor 224 are positioned so as to be able to capture the driver's gaze. The mounted sensor 224 may be incorporated into the housing of the display device 1 and built into the display device 1. Alternatively, the mounted sensor 224 may be mounted outside the housing of the display device 1.

[0130] Furthermore, the gaze detection sensor only needs to be able to detect the driver's gaze, and for example, it may be at least one of these configurations (221, 223, 224).

[0131] Figure 16 is a diagram illustrating the processing flow related to this control. As shown in Figure 16, the processor checks whether the auxiliary display is active (S1601). If the auxiliary display is active (S1601-YES), it acquires data from the gaze detection sensor to obtain the driver's gaze (S1602). Based on the acquired data, it then determines whether the driver's gaze is directed towards the display area 5 of the windshield 3 (S1603).

[0132] Here, in S1603, the processor may, for example, make a determination based on whether the driver's gaze, which has been captured, falls within the display area 5 of the windshield 3. If the driver's gaze falls within the display area 5 of the windshield 3, the processor determines that the driver's gaze was directed towards the display area 5.

[0133] If the processor determines that the driver's gaze is directed towards the display area 5 (S1603-YES), it controls the auxiliary display (S1604). If the processor determines that the driver's gaze is not directed towards the display area 5 (S1603-NO), it continues the auxiliary display as is (S1605). Then, the processor acquires the driver's gaze again (S1602) and makes a determination (S1603).

[0134] Next, an example of a control method will be explained with reference to Figures 17-21.

[0135] As shown in Figure 17, in a situation where the auxiliary display described using the upper diagram of Figure 8 is being displayed, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to reduce the auxiliary display. The processor may change the flashing / illumination of the light-emitting element LE of the light-emitting unit 201 to off, change the flashing of the light-emitting element LE of the light-emitting unit 201 to on, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to on and reduce the brightness of the light-emitting element LE. In this example, the processor turns off the light-emitting element LE of the light-emitting unit 201 on the left, right, top, and bottom sides.

[0136] As a result, when a driver notices warning information such as a route mistake, the system can allow the driver to recognize the information and then reduce the level of auxiliary signs that could potentially hinder driving.

[0137] As shown in Figure 18, in a situation where the auxiliary display described using the lower diagram of Figure 9 is being displayed, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to reduce the auxiliary display. The processor may change the flashing / illumination of the light-emitting element LE of the light-emitting unit 201 to off, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor changes the flashing of the light-emitting element LE of the left, right, top, and bottom light-emitting units 201 to illumination.

[0138] Furthermore, the processor may acquire information on the speed of vehicle 2 and, if the speed of vehicle 2 falls below the speed limit, remove the mark 950 displayed on the video display unit 200, thereby further relaxing the auxiliary display.

[0139] As a result, when a driver notices information indicating they are exceeding the speed limit, the system can make the driver aware of this information and then reduce the level of potentially distracting auxiliary displays. Furthermore, once the speed limit has been corrected, the system can further reduce the level of potentially distracting auxiliary displays.

[0140] As shown in Figure 19, when the auxiliary display described using Figure 12 is in operation, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to lessen the auxiliary display. The processor may turn off the flashing / illumination of the light-emitting element LE of the light-emitting unit 201, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, weaken the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and weaken the brightness of the light-emitting element LE. In this example, the processor changes the flashing of the light-emitting element LE of the left, right, top, and bottom light-emitting units 201 to illumination.

[0141] As a result, when a driver notices information about the approach of another vehicle, the system can make the driver aware of this information and then reduce the level of any auxiliary displays that could potentially interfere with driving.

[0142] As shown in Figure 20, when the auxiliary display described using Figure 13 is in operation, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to lessen the auxiliary display. The processor may turn off the flashing / illumination of the light-emitting element LE of the light-emitting unit 201, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor changes the flashing of the light-emitting element LE of the left, right, top, and bottom light-emitting units 201 to illumination.

[0143] As a result, when a driver notices information about the remaining fuel level, the system can make the driver aware of this information and then reduce the level of any auxiliary displays that might interfere with driving.

[0144] As shown in Figure 21, when the auxiliary display described using Figure 14 is in operation, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may soften the auxiliary display by controlling the illumination / flashing of the light-emitting element LE of the light-emitting unit 201. The processor may turn off the flashing / illumination of the light-emitting element LE of the light-emitting unit 201, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor turns off the flashing of the light-emitting element LE of the light-emitting unit 201 on the left, right, top, and bottom sides.

[0145] As a result, when the driver notices that the seatbelt is not being worn, the system can make the driver aware of this information and then loosen any potentially distracting auxiliary indicators.

[0146] Although an example was described in which control is performed based on whether the driver's gaze is directed toward the display area 5, it is sufficient to perform control based on whether the driver's gaze is directed toward the displayed information. For this reason, the processor may, for example, determine whether the driver's gaze is directed toward a projection member that projects image light other than the windshield 3. Alternatively, the processor may, for example, determine whether the driver's gaze is directed toward the virtual image 10 to be displayed.

[0147] Furthermore, while the display position of the mark 950 indicating that the driver has paid attention to the information is, for example, the corner of the video display unit 200, the mark 950 may be displayed in a position other than the corner, and the display position of the mark 950 is not particularly limited. Also, as long as the mark 950 can make the driver aware that they have paid attention to the information, the form of the mark 950 is not limited.

[0148] Next, an example of controlling the brightness of the video display unit 200 and the light-emitting unit 201 will be described with reference to Figure 22. When normal information such as speed and clock information is being displayed and the driver is not looking at this display, the processor may reduce the brightness of the video display unit 200 and the light-emitting unit 201.

[0149] The processor then acquires data from the gaze detection sensor to determine the driver's gaze. If the processor determines that the driver's gaze is within the first zone A, it controls the video display unit 200 and the light-emitting unit 201 at normal brightness. In other words, the processor controls the video display unit 200 and the light-emitting unit 201 without reducing brightness.

[0150] If the processor determines that the driver's gaze is in the second zone B, it controls the video display unit 200 and the light-emitting unit 201 by reducing their brightness. For example, if the brightness in the first zone A is set to 100%, the processor controls the video display unit 200 and the light-emitting unit 201 at 50% brightness.

[0151] If the processor determines that the driver's gaze is in the third zone C, it controls the video display unit 200 and the light-emitting unit 201 by reducing their brightness. For example, if the brightness in the first zone A is set to 100%, the processor controls the video display unit 200 and the light-emitting unit 201 at 10% brightness.

[0152] Zone 1A is the area corresponding to display area 5. Zone 2B is a predetermined area outside Zone 1A that extends up, down, left, and right from the driver's perspective. Zone 3C is a predetermined area outside Zone 2B that extends up, down, left, and right from the driver's perspective, or an area outside Zone 2B that extends up, down, left, and right from the driver's perspective.

[0153] By adjusting the brightness value when the viewer's gaze moves away from the display area 5, power consumption can be reduced.

[0154] However, when the processor displays alert information that should warn the driver, such as a wrong route or speeding, the processor controls the video display unit 200 and the light-emitting unit 201 without reducing the brightness, even if the driver's gaze is in the second zone B or the third zone C (in other words, even if they are not looking at the virtual image 10), in order to quickly make the driver aware of the alert information.

[0155] The virtual image 10 displayed by the display device 1 requires less eye movement than checking the meters, navigation system, and other instruments installed inside the vehicle. However, since the virtual image is not superimposed on the road conditions (vehicles, pedestrians, lanes, etc.) while driving, the driver tends to take their eyes off the virtual image 10 more often, resulting in a shorter time spent looking at the virtual image 10. Therefore, applying this brightness control to the display device enables significant power saving.

[0156] The technology described in this embodiment makes it possible to prevent traffic accidents by providing a display device that can display a good virtual image, reduces the driver's eye movement, and contributes to supporting safe driving. This contributes to the United Nations' Sustainable Development Goal (SDG), specifically "Goal 3: Ensure good health and well-being for all."

[0157] 1 Display device (virtual image display device) 11 Display panel 20 Light source

Claims

1. A display device mounted on a vehicle, comprising: an image display unit that projects image light; and a light-emitting unit arranged around the display area of ​​the image display unit, which lights up or flashes according to the content of the information displayed by the image display unit.

2. A display device according to claim 1, characterized in that it comprises a circuit that performs PWM control on the current flowing through the light-emitting part.

3. A display device according to claim 1, wherein the video display unit displays information on the direction of turns based on route navigation, and the light-emitting unit lights up in accordance with the display of the information.

4. A display device according to claim 1, wherein the video display unit displays information indicating that the vehicle is not traveling in accordance with the route navigation system's guidance, and the light-emitting unit flashes in accordance with the display of the information.

5. A display device according to claim 1, wherein the video display unit displays information instructing the vehicle to stop at the next stop, and the light-emitting unit lights up in accordance with the display of the information.

6. A display device according to claim 1, wherein the light-emitting elements of the light-emitting unit are arranged along the image display unit, the image display unit displays a scale relating to the distance to the stop along the light-emitting elements of the light-emitting unit, and the light-emitting elements at positions corresponding to the distance to the stop light up.

7. A display device according to claim 1, wherein when the video display unit displays information regarding the remaining time until departure, the light-emitting unit lights up or flashes in red, and when the video display unit displays information indicating that departure is possible, the light-emitting unit lights up or flashes in blue.

8. A display device according to claim 1, wherein the image display unit displays information relating to the current speed of the vehicle, and the light-emitting unit lights up when the current speed of the vehicle is within the range between a predetermined speed slower than the speed limit and the speed limit.

9. A display device according to claim 1, wherein the video display unit displays information relating to the current speed of the vehicle, and the light-emitting unit flashes when the current speed of the vehicle is greater than or equal to the speed limit.

10. A display device according to claim 1, comprising a processor for controlling the light-emitting unit, wherein the light-emitting unit includes light-emitting elements arranged to constitute a scale of predetermined set values, the processor acquires information relating to the predetermined set values ​​and lights up the light-emitting elements to indicate the predetermined set values, and the video display unit does not display information relating to the predetermined set values.

11. A display device according to claim 1, wherein the light-emitting elements of the light-emitting unit are arranged along the display area of ​​the video display unit, the video display unit displays a scale relating to the distance to an intersection along the light-emitting elements of the light-emitting unit, and the light-emitting elements at positions corresponding to the distance to the intersection light up.

12. A display device according to claim 1, wherein the light-emitting elements of the light-emitting unit are arranged along the display area of ​​the video display unit, the video display unit displays a scale relating to the distance to an intersection along the light-emitting elements of the light-emitting unit, and when the distance to the intersection is less than or equal to a predetermined distance, the light-emitting elements at the position corresponding to the distance to the intersection flash.

13. A display device according to claim 1, wherein the light-emitting elements of the light-emitting unit are arranged along the display area of ​​the video display unit, the video display unit displays a scale related to the tilt of the tire along the light-emitting elements of the light-emitting unit, and the light-emitting elements at the position corresponding to the current tilt of the tire light up.

14. A display device according to claim 1, wherein the light-emitting elements of the light-emitting unit are arranged along the display area of ​​the video display unit, the video display unit displays information indicating the approach of a vehicle, and the light-emitting elements at positions corresponding to the direction of approach of the vehicle light up.

15. A display device according to claim 1, wherein the video display unit displays information indicating the approach of a vehicle to the vehicle, and the light-emitting unit flashes when the turn signal of the vehicle is ON.

16. A display device according to claim 1, wherein the video display unit displays information indicating the current amount of gasoline remaining in the vehicle, and the light-emitting unit flashes when the current amount of gasoline remaining in the vehicle is below a predetermined value.

17. A display device according to claim 1, wherein the video display unit displays information indicating that the seat belt is not fastened, and the light-emitting unit flashes when the state of the seat belt being not fastened continues for a predetermined time.

18. A display device according to claim 1, wherein the light-emitting unit is arranged around the display area of ​​the image display unit, and when the driver of the vehicle directs their gaze towards the area from which the image light is projected, the light-emitting element of the light-emitting unit, which is blinking, turns off.

19. A display device according to claim 1, wherein the light-emitting unit is arranged around the display area of ​​the video display unit, and when the driver of the vehicle directs their gaze towards the area from which the video light is projected, the light-emitting element of the flashing light-emitting unit lights up, and the video display unit displays a mark in the display area indicating that the driver has paid attention to the information.

20. A display device according to claim 1, wherein the light-emitting unit is arranged around the display area of ​​the video display unit, and the video display unit displays a mark in the display area indicating that the driver has paid attention to the information.

21. A display device according to claim 1, wherein the light-emitting unit is arranged around the display area of ​​the video display unit, and the light-emitting element of the light-emitting unit turns off when the video display unit is displaying information indicating that the vehicle is not traveling in accordance with the route navigation guidance.

22. A display device according to claim 19, characterized in that when the video display unit displays information relating to the current speed of the vehicle which is above the speed limit, the light-emitting element of the light-emitting unit lights up and the video display unit displays the mark.

23. A display device according to claim 19, characterized in that when the video display unit displays information relating to the current speed of the vehicle within the range of a predetermined speed slower than the speed limit and the speed limit, the light-emitting element of the light-emitting unit lights up and the video display unit does not display the mark.

24. A display device according to claim 19, characterized in that when the video display unit displays information indicating the approach of a vehicle to the vehicle, the light-emitting element of the light-emitting unit lights up, and the video display unit displays a mark in the display area indicating that the driver has paid attention to the information.

25. A display device according to claim 1, wherein the light-emitting unit is arranged around the display area of ​​the image display unit, and the brightness of the light-emitting element of the light-emitting unit, which is lit or flashing, decreases when the driver of the vehicle directs their gaze towards the area from which the image light is projected.

26. A display device according to claim 1, wherein the light-emitting unit is arranged around the display area of ​​the video display unit, and the brightness of the display area of ​​the video display unit decreases when the driver of the vehicle takes their line of sight away from the area from which the video light is projected.

27. A display device according to claim 26, characterized in that, when the video display unit displays alert information that should warn the driver, the brightness of the display area of ​​the video display unit does not decrease even when the driver of the vehicle takes their line of sight away from the area from which the video light is projected.

28. A display device according to claim 1, further comprising a processor for controlling the light-emitting unit, wherein the processor controls the brightness of the light-emitting unit to match the brightness of the video light of the video display unit.

Images