Indication device

Abstract

To provide a more suitable display device or display technology. According to the present invention, it contributes to Sustainable Development Goal 3, "Good Health and Well-being for All." [Solution] The display device is a display device mounted on a vehicle and comprises an image display unit and a light-emitting unit. The image display unit projects image light. The light-emitting unit is arranged around the display area of ​​the image display unit and lights up or flashes according to the content of the information displayed by the image display unit.

Description

[[Technical Field]]

[0001] The present invention relates to a display device, a virtual image display device, and a vehicle equipped with the display device. [[Background Art]]

[0002] Display devices or virtual image display devices are known that project image light onto a windshield or front glass of a vehicle typically represented by automobiles such as cars to display a virtual image, and display driving information such as vehicle speed and engine speed, traffic information from navigation, and vehicle information such as remaining fuel amount and coolant temperature, for example. [[Prior Art Documents]] [[Patent Documents]]

[0003] [[Patent Document 1]] Japanese Unexamined Patent Publication No. Hei 3-169752 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]

[0004] The display device is disposed, for example, on or inside a dashboard of a vehicle. Use of the display device allows a driver to obtain information necessary for driving without shifting the driver's line of sight to an instrument panel incorporated in the dashboard, a so-called instrument panel. On the other hand, sufficient consideration has not been given to the arrangement, brightness, influence from external light, information display, and the like of the display device.

[0005] An object of the present invention is to provide a more suitable display device or display technology. [[Means for Solving the Problem]]

[0006] According to an aspect of the present invention, the following display device is provided. The display device is a device mounted on a vehicle. The display device includes an image display unit that projects image light, and a light-emitting unit disposed around a display area of the image display unit, the light-emitting unit being lit or blinking in accordance with content of information displayed by the image display unit. [Effects of the Invention]

[0007] According to the present invention, a more suitable display device or display technology can be provided. Other problems, configurations, and effects not mentioned above will be clarified by the following description of the embodiments. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of an in-vehicle system including a display device. [Figure 2] This figure shows an example of a device used to acquire vehicle information. [Figure 3] This is a block diagram showing an example of a display device. [Figure 4] This figure shows an example of a configuration in which a display device is installed in a vehicle. [Figure 5] This figure shows an example of a configuration in which a display device is installed in a vehicle. [Figure 6] This figure shows an example of a light source structure for a display device. [Figure 7] This is a diagram illustrating an example of the structure of a display device. [Figure 8] This figure shows an example of a light emission control method. [Figure 9] This figure shows an example of a light emission control method. [Figure 10] This figure shows an example of a light emission control method. [Figure 11] This figure shows an example of a light emission control method. [Figure 12] This figure shows an example of a light emission control method. [Figure 13] This figure shows an example of a light emission control method. [Figure 14] This figure shows an example of a light emission control method. [Figure 15] This figure shows an example of an eye-tracking sensor. [Figure 16] This is a flowchart illustrating the control flow that suppresses operational disruptions. [Figure 17] This figure shows an example of a control method. [Figure 18] It is a diagram illustrating an example of a control method. [Figure 19] It is a diagram illustrating an example of a control method. [Figure 20] It is a diagram illustrating an example of a control method. [Figure 21] It is a diagram illustrating an example of a control method. [Figure 22] It is a diagram for explaining an example of brightness control. MODE FOR CARRYING OUT THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiments are illustrative examples for explaining the present invention, and are appropriately omitted and simplified as appropriate for clarity of explanation. The present invention can also be implemented in various other forms. Unless particularly limited, each constituent element may be singular or plural. Positions, sizes, shapes, ranges, etc. of respective constituent elements shown in the drawings may not represent the actual positions, sizes, shapes, ranges, etc. in order to facilitate understanding of the invention. Therefore, the present invention is not necessarily limited to the positions, sizes, shapes, ranges, etc. disclosed in the drawings. When there are a plurality of constituent elements having the same or similar functions, description may be given by adding different suffixes to the same reference numeral. Further, when there is no need to distinguish between the plurality of constituent elements, description may be given by omitting the suffix.

[0010] For explanatory purposes, when describing processing executed by a program, the description may be provided with programs, functions, processing units, etc. as the subject. However, the subject in terms of hardware for these is a processor, or a controller, apparatus, computer, system, etc. configured by said processor. A computer executes processing in accordance with a program read onto memory by a processor, while appropriately using resources such as memory and communication interfaces. Thereby, predetermined functions, processing units, and the like are implemented. The processor is configured by, for example, a semiconductor device such as a CPU / MPU or a GPU. The processing is not limited to software program processing, and can also be implemented by a dedicated circuit. FPGA, ASIC, CPLD, and the like are applicable for the dedicated circuit.

[0011] The program may be pre-installed as data in a target computer, or may be distributed as data from a program source to the target computer. The program source may be a program distribution server on a communication network, or may be a non-transitory computer-readable storage medium such as a memory card or a disk. The program may be configured from a plurality of modules. A computer system may be configured from a plurality of devices. A computer system may be configured as a client-server system, a cloud computing system, an IoT system, or the like. Various types of data and information are configured in structures such as tables and lists, for example, but are not limited thereto. Expressions such as identification information, identifiers, IDs, names, and numbers are mutually replaceable.

[0012] Figure 1 shows an example configuration of an in-vehicle system including a display device or virtual image display device 1. With respect to the vehicle or ride 2 and the driver, the horizontal direction X is the left-right direction, the lateral direction of the vehicle or ride 2, or the width direction of the vehicle or ride 2; the vertical direction Z is the up-down direction, or vertical direction of the vehicle; and the horizontal direction Y, which is perpendicular to the lateral direction of the vehicle or ride 2, is the front-rear direction of the vehicle or ride 2, or the direction of travel of the vehicle. In the example in Figure 1, the direction in which the vehicle travels is set to be the negative direction in the Y-axis direction. The display device 1 may also be called a virtual image display device. The following explanation will use the name "display device". The vehicle or ride 2 is typically an automobile or a truck, but is not limited to these, and may also be a railway vehicle or an aircraft. The following explanation will use the name "vehicle".

[0013] The display device 1 acquires vehicle information 4 from cameras and various sensors installed in various parts of the vehicle 2. The various sensors, for example, detect various events that occur in the vehicle 2 and periodically detect the values ​​of various parameters related to driving conditions. It can also acquire road information and GPS (Global Positioning System) information from a navigation device 6 (car navigation system), external devices 400, terminal devices 410 (e.g., mobile terminals). The GPS may be installed in the vehicle 2, or it may be installed in the external devices 400 or terminal devices 410.

[0014] Vehicle information 4 includes, for example, vehicle 2's speed information, gear information, steering angle information, lamp illumination information, ambient light information, distance information, infrared information, engine ON / OFF information, camera image information, accelerometer / gyro information, GPS (Global Positioning System) information, navigation information, vehicle-to-vehicle communication information, and vehicle-to-infrastructure communication information. Camera image information includes in-vehicle camera images and exterior camera images. GPS information includes latitude and longitude as well as current time information. Vehicle information 4 also includes input information from the driver.

[0015] The display device 1 is connected to the controller 100 of the vehicle 2 via an information transmission path, and the display device 1 and the controller 100 are able to communicate. The controller 100 of the vehicle 2 is an ECU (Electronic Control Unit). The display device 1 and the controller 100 of the vehicle 2 communicate via the information transmission path using, for example, a CAN (Controller Area Network) or LIN (Local Interconnect Network) interface. Alternatively, the display device 1 and the controller 100 of the vehicle 2 may communicate via the information transmission path using an in-vehicle Ethernet or the like. Other connection configurations may also be adopted. For example, when transmitting all information, including video information, through a single information transmission path, the connection between the controller 100 on the vehicle 2 side (the source of video information, etc.) and the display device 1 (in other words, the connection configuration of the information transmission path) may be FPD-Link III, GMSL (Gigabit Multimedia Serial Link), etc.

[0016] The in-vehicle system is configured such that the controller 100 controls the vehicle 2 based on data input and output and is connected to the display device 1. The in-vehicle system can communicate with the outside of the vehicle 2 via a communication device or network. Examples of communication with the outside of the vehicle 2 include direct communication and indirect communication. Direct communication is used internationally as ITS (Intelligent Transport System) communication, while indirect communication is performed indirectly, for example, via a server to an external device 400 or terminal device 410. The in-vehicle system can send and receive data or information to, for example, a server 700 connected to the network 500 via a relay station 600 on the network 500. The in-vehicle system may also communicate with infrastructure such as external devices and terminals installed on the road on which the vehicle 2 travels.

[0017] Figure 2 shows an example of a device used to acquire vehicle information. As shown in Figure 2, vehicle information 4 is acquired using devices such as a camera and various sensors connected to the controller 100 or control device 100. Note that the various devices in Figure 2 can be deleted, other types of devices added, or replaced with other types of devices as appropriate. Also, as an example, the controller 100 of vehicle 2 may also have the function of controlling the display device 1.

[0018] The vehicle speed sensor 901 detects the speed of vehicle 2 and is used to generate speed information as a result of the detection. The shift position sensor 902 detects the current gear and is used to generate gear information as a result of the detection. The steering angle sensor 903 detects the current steering angle and is used to generate steering angle information as a result of the detection. The headlight sensor 904 detects whether the headlights are ON or OFF and is used to generate lamp illumination information as a result of the detection.

[0019] The illuminance sensor 905 and the chromaticity sensor 906 detect ambient light from the vehicle 2 and are used to generate ambient light information as detection results. The distance measuring sensor 907 detects the distance between the vehicle 2 and an external object, or the distance between external objects, and is used to generate distance information as detection results. The infrared sensor 908 detects the presence and distance of objects in the vicinity of the vehicle 2 and is used to generate infrared information as detection results. The engine start sensor 909 detects the ON / OFF status of the engine and is used to generate ON / OFF information as detection results. The acceleration sensor 912 and the gyro sensor 913 detect the acceleration and angular velocity of the vehicle 2 and are used to generate acceleration gyro information representing the attitude and behavior of the vehicle 2.

[0020] The temperature sensor 914 detects the temperature inside and outside the vehicle and is used to generate temperature information as the detection result. For example, if the display device 1 is located inside the dashboard of the vehicle 2, the temperature sensor 914 may be used to detect the temperature inside the dashboard. If a temperature that may affect the operation of the display device 1 is detected, the display device 1 may stop operating. The temperature sensor 914 may also be located in other places that may experience temperatures similar to those inside the dashboard.

[0021] Furthermore, if the display device 1 is installed on the dashboard or elsewhere, the temperature sensor 914 may be used to detect the temperature in the vicinity where the display device 1 is installed. If a temperature is detected that may affect the operation of the display device 1 due to direct sunlight or the like, the display device 1 may stop operating. Here, the temperature sensor 914 may be placed on the dashboard as an example. The temperature sensor 914 may also be placed outside the vehicle, assuming that the temperature near the display device 1 and the temperature outside the vehicle are similar.

[0022] The vehicle-to-infrastructure wireless transceiver 915 generates vehicle-to-infrastructure communication information through vehicle-to-infrastructure communication between vehicle 2 and roads, signs, signals, etc. The vehicle-to-vehicle wireless transceiver 916 generates vehicle-to-vehicle communication information through vehicle-to-vehicle communication between vehicle 2 and other surrounding vehicles. The wired wireless communication unit 917 for mobile terminal-to-vehicle communication is a device that acquires information from devices connected to the LTE (Long Term Evolution) network (e.g., WiFi devices) via wired or wireless communication. The controller 100 or control device can acquire information transmitted and received on the LTE network via the wired wireless communication unit 917 for mobile terminal-to-vehicle communication.

[0023] The in-vehicle camera 919 and the exterior camera 920 capture images of the interior and exterior of the vehicle and are used to generate in-vehicle and exterior camera image information. Specifically, the in-vehicle camera 919 is, for example, a camera for a Driver Monitoring System (DMS) that captures the driver's posture, eye position, and movement. In this case, by analyzing the captured images, the driver's fatigue level and gaze position can be determined.

[0024] On the other hand, the external camera 920 captures the surrounding environment, such as the front and rear of vehicle 2. In this case, by analyzing the captured images, it becomes possible to determine the presence or absence of obstacles such as other vehicles or people in the vicinity, buildings and terrain, road surface conditions such as rain, snow, ice, and unevenness, and road signs. The external camera 920 also includes, for example, a dashcam that records the driving situation in video.

[0025] The GPS receiver 921 generates GPS information obtained by receiving GPS signals from GPS satellites. For example, the GPS receiver 921 can obtain the current time, latitude, and longitude. The VICS (Vehicle Information and Communication System, registered trademark) receiver 922 generates VICS information obtained by receiving VICS signals. The GPS receiver 921 and the VICS receiver 922 may be provided as part of a navigation system.

[0026] The voice input device 918 receives the driver's voice and is used to generate voice information. The driver can input operation details via the voice input device 918 by speaking. The vehicle operation switch 911 is used to generate driver operation information for steering wheel switches, etc.

[0027] Furthermore, the video generation unit 910 generates video information based on the vehicle information 4 acquired by the controller 100 of the vehicle 2. It can also generate video information based on external information.

[0028] Figure 3 is a block diagram of the display device 1. It primarily controls the display of projected images (virtual images) on the display device 1.

[0029] In Figure 3, the display device 1 includes, for example, a control unit 1010, a non-volatile memory 1011, a volatile memory 1012, a storage unit 1013, a display driver 1021, and a light source drive unit 1022, all mounted on a wiring board or the like. The display device 1 also includes a communication unit 1014, a wireless communication unit 1015, a video processing unit 1016, an operation input unit 1017, an external power input unit 1018, a speaker 1019, and a light-emitting indicator 1020.

[0030] The control unit 1010 is specifically a microcontroller (MCU) or a CPU (Central Processing Unit). Each block other than the control unit 1010 may be mounted within the control unit 1010 as appropriate. Furthermore, the display device 1 is not limited to implementation using the control unit 1010; it may also be implemented using an ECU (Electronic Control Unit) or other semiconductor devices. The configuration shown in Figure 3 may, for example, involve a control unit mounted inside the housing of the display device 1, or a control unit mounted outside the housing. Additionally, the display device 1 can be controlled by a controller in the vehicle 2 or an external device without implementing the control unit 1010 within the display device 1.

[0031] The non-volatile memory 1011 primarily stores programs executed within the control unit 1010, setting parameters used in the processing of each part within the control unit 1010, and predefined audio and video data. The non-volatile memory 1011 may also store information other than programs, such as video, audio, and video.

[0032] The volatile memory 1012 operates by expanding the program stored in the non-volatile memory 1011. The volatile memory 1012 primarily processes acquired information and various data used in the processing of each part within the control unit 1010 as appropriate.

[0033] The storage unit 1013 stores video data, video data, or audio data for output to the speaker 1019, etc. The video data, video data, or audio data to be stored in the storage unit 1013 may be stored in the storage unit 1013 in advance. Alternatively, the video data, video data, or audio data to be stored in the storage unit 1013 may be received from an external device via the communication unit 1014.

[0034] In Figure 3, the communication unit 1014 transmits and receives information such as vehicle information 4 to and from the controller 100 of the vehicle 2 or various devices such as sensors in the vehicle 2, using a mechanism such as CAN or in-vehicle Ethernet. The communication unit 1014 may also receive video information using a mechanism such as FPD-Link III or GMSL. The hardware of the communication interface that receives vehicle information 4 and the hardware of the communication interface that receives video information in the communication unit 1014 may be separate or integrated. The communication unit 1014 may also function as the control unit of the display device 1.

[0035] The wireless communication unit 1015 may be configured with a Wi-Fi communication interface, a Bluetooth® communication interface, a mobile communication interface such as 4G or 5G, etc. As shown in Figure 1, the wireless communication unit 1015 may communicate with external devices via a network 500 connected through a router or relay station 600. An example of an external device is a server 700 connected via network 500. Alternatively, the wireless communication unit 1015 may communicate directly with a terminal device 410, etc. An example of a terminal device 410 is a smartphone, tablet, wireless earphones, headphones, or beacon.

[0036] The video processing unit 1016 may perform distortion correction, conversion, and other processing on the received video information. The video processing unit 1016 may generate video data for the video display unit 200 using acquired vehicle information, external information, etc. Specifically, the distortion correction here corrects the distortion of the video caused by the curvature of the windshield 3 when the video from the display device 1 is projected onto the display area 5, as shown in Figure 1. The video processing unit 1016 may also be implemented by the control unit 1010 reading and executing a program stored in the non-volatile memory 1011 or volatile memory 1012.

[0037] In other words, the video processing unit 1016 processes video data related to the display video projected onto the display area 5, such as in Figure 1, based on information acquired from an external source or from the vehicle 2. On the other hand, the video processing unit 1016 is not necessarily required, but in such a case, the control unit 1010 can process video information from the vehicle 2 or an external terminal via the communication unit 1014. Alternatively, the controller 100 of the vehicle 2 may process the video information.

[0038] The operation input unit 1017 is, for example, an operation button, a receiver for a remote controller, or an infrared light receiver, and is used to input user operations. The operation input unit 1017 may be used, for example, for the driver to operate the display device 1.

[0039] The external power input unit 1018 receives power from an external source and supplies the necessary power to each part of the display device 1 shown in Figure 3.

[0040] The speaker 1019 emits sound based on audio data stored in the volatile memory 1012, the non-volatile memory 1011, or the storage unit 1013.

[0041] The light-emitting indicator 1020 emits light using a light-emitting element or the like, and can notify the user of the status of the display device 1 by the timing of the light emission of the light-emitting element or the color of the emitted light.

[0042] The display driver 1021 drives each display element (pixel) included in the display panel 11 based on the video data. This allows the video display unit 200 to create and display an image for projection onto the display area 5 based on the video data. The display driver 1021 can be configured, for example, by a circuit mounted on a circuit board.

[0043] The light source drive unit 1022 drives the light source 20 to generate light. Based on the drive from the light source drive unit 1022, the light source 20 generates light and supplies it to the display panel 11. Based on vehicle information 4 received via the communication unit 1014, or information from a terminal device, the light source 20 is adjusted or controlled using the light source drive unit 1022, which is the driver used to drive the light source.

[0044] Furthermore, the display device 1 may protect the display panel 11 based on ambient light information from the illuminance sensor 905. That is, in order to prevent the display panel 11 from being burned out by sunlight, the display device 1 may perform an operation to protect the display panel 11 from sunlight according to the value of the illuminance sensor 905. More specifically, if the intensity of ambient light or sunlight acquired by the illuminance sensor 905 is strong and there is a risk of the display panel 11 being burned out, the brightness of the light source 20 is reduced, and the amount of light from the light source 20 that enters the display panel 11 is suppressed, thereby suppressing the temperature rise of the display panel 11.

[0045] Each component in Figure 3 may be implemented using a dedicated circuit such as an FPGA (Field Programmable Gate Array) as appropriate. In this embodiment, the system has a configuration that includes a non-volatile memory 1011, a volatile memory 1012, a storage unit 1013, and a video processing unit 1016, but the above processing may be performed using a single memory.

[0046] Next, the video display unit 200 will be described in detail. Based on video data, the video display unit 200 projects video light from the light source 20 (in other words, light source light) onto the display panel 11. The video display unit may also be called a projection-type video display device or a projector. The video display unit 200 comprises a light source 20 and a display panel 11 such as a liquid crystal display (LCD) having video display elements.

[0047] The light source 20 functions as a backlight source for the display panel 11. The light source 20 is configured, for example, using a semiconductor light source element, and generates a predetermined light source and supplies it to the display panel 11. Typically, an LED (Light Emitting Diode) element is used as the semiconductor light source element. The light source 20 may also be configured by arranging multiple light sources. The light source unit (backlight unit) 12, which will be described later, may be configured using the light source 20 or the like.

[0048] The display panel 11 generates and emits modulated video light based on the light source. In other words, the display panel 11 forms and displays an image on the display screen based on video data, and generates and emits video light corresponding to the image based on the light from the light source 20. The video data in this embodiment will be described as video data input from the video processing unit 1016. The display panel 11 forms an image to be projected onto the display area 5 by modulating the light from the light source 20 pixel by pixel according to the video data, and projects it as video light (in other words, projected light).

[0049] Furthermore, the display panel 11 is not limited to a liquid crystal panel; it may also be a screen plate with a diffusion function. As a means of projecting an image onto the screen plate with a diffusion function, a means of projecting an image from a DMD (Digital Micromirror Device) or a liquid crystal panel in combination with a projection lens, or a means of using a micro electro-mechanical system may be used.

[0050] Figures 4 and 5 show examples of configurations in which the display device 1 is mounted on a vehicle 2. Figure 4 shows an example of mounting the display device 1 on a passenger car. Passenger cars include sports cars, sedans, SUVs (Sport Utility Vehicles), and minivans, where the angle of the windshield 3 is 20° to 45° with respect to the Y-axis (the longitudinal direction or direction of travel of the vehicle 2). Figure 5 shows an example of mounting the display device 1 on some passenger cars and commercial vehicles, in other words, the windshield or windshield 3 in Figure 5 is in an upright position. Specifically, these include light super-height wagons, trucks, and buses, where the angle of the windshield 3 is 45° to 90° with respect to the Y-axis (the longitudinal direction or direction of travel of the vehicle 2). As shown in Figures 4 and 5, the display device 1 is located on the dashboard 7 of the vehicle 2. The display device 1 may also be implemented so as to be embedded within the dashboard 7. The dashboard 7 also includes an instrument panel, for example, a meter cluster in front of the steering wheel.

[0051] As shown in Figures 4 and 5, the image light 13 in Figure 4 is emitted toward the driver, and the image light 13 in Figure 5 is emitted toward the windshield 3. The image light 13 emitted from the display device 1 is reflected when it is irradiated onto the windshield or windshield 3. The reflected image light 13 is incident on the driver's viewpoint 14. From the driver's viewpoint 14, a virtual image 10 corresponding to the image light 13 is formed and visible at a position visible through the display area 5 (Figure 1) of the display device 1 corresponding to the irradiation area of ​​the image light 13. In this embodiment, the image light is described as being projected onto the display area 5 of the windshield 3, but the projection unit that projects the image light may be a projection member other than the windshield 3.

[0052] Figure 6 shows the video display unit 200 of the display device 1. The light source unit 12 may also be called the backlight unit. The light source unit 12 includes a light source 20, a reflective mirror 21, a polarization conversion element 22, and a light guide unit 23, and may also include a diffuser plate 24. The reflective mirror 21 is used to reflect light from the light source 20 and adjust it to parallel light. The reflective surface of the reflective mirror 21 is a parabolic surface and may be asymmetrical with respect to the optical axis of the light emitted from the light source 20. The reflective mirror 21 may also be positioned eccentrically with respect to the light source 20. The reflective mirror 21 may also be called a reflector.

[0053] The polarization conversion element 22 is composed of a polarizing beam splitter (PBS) and a phase difference film (1 / 2λ). It separates incident light into S-polarized and P-polarized light, and then uses the phase difference film (1 / 2λ) to polarize either the separated S-polarized or P-polarized light, so that the randomly polarized light incident on the polarization conversion element 22 is emitted as linearly polarized light.

[0054] The light guide section 23 may also be called an optical transmission section. The light guide section 23 is configured to adjust the angle of incidence of light rays to the display panel 11, and in this example, it is configured using an optical reflecting section 23a having a prism shape (a jagged shape). The light guide section 23 may also be a prism sheet as an example. In this example, the light rays incident on the optical reflecting section 23a of the light guide section 23 are adjusted to a predetermined light distribution and reflected toward the display panel 11. The distribution of light incident on the display panel 11 can be adjusted by the shape of the reflective surface of the optical reflecting section 23a, the inclination of the reflective surface, the surface roughness, etc. In this structure, the optical axis of the light source 20 and the optical axis of the light incident on the display panel 11 are parallel or approximately parallel.

[0055] The light guide 23 is, for example, a resin member having a prism shape, and the prism-shaped portion that becomes the reflective surface is coated with an Al reflective film or the like. The light reflective portion 23a of the light guide 23 may be configured to have multiple inclinations on one surface in order to achieve more precise adjustment of reflected light. Furthermore, the reflective surface may be composed of multiple or multifaceted surfaces, or it may be composed of curved surfaces. When a large number of reflective surfaces and connecting surfaces are alternately formed in a sawtooth pattern on the light reflective portion 23a, the light incident on the light guide 23 is reflected on each reflective surface and directed toward the display panel 11, and further adjusted to a predetermined light distribution characteristic via the diffuser plate 24 before incident on the display panel 11. The diffuser plate 24 uniformly disperses the incident light from the light guide 23. The diffuser plate 24 has the effect of improving the brightness uniformity within the virtual image plane.

[0056] Furthermore, the video display unit 200 may have a configuration other than that shown in Figure 6, and may, for example, include a light source, an illumination optical system, a PBS or polarization separation element, and a reflective liquid crystal panel or LCOS.

[0057] Since the display device 1 does not enlarge the image using a concave mirror or the like, it has low sensitivity to distortion of the windshield 3's shape and can be retrofitted. However, because the image output by the display element is virtual, the display element must also be large in order to enlarge the virtual image. Furthermore, as an example, in commercial vehicles such as buses and trucks, the effective usage conditions are not for the driver to constantly look at the image, but rather there is a great need to display an alert in the driver's field of vision to make the driver aware of it, in order to prevent wrong turns, premature departures, speeding, etc.

[0058] Depending on the purpose, the display device 1 displays images, but in order to make it easier for the driver to notice the warning alert, it is necessary to improve the display image itself, and also to display the display image in a larger size. However, as mentioned above, increasing the size of the display image leads to a larger display element, resulting in higher costs, a larger set volume due to the larger backlight, and increased power consumption.

[0059] Therefore, we will explain a technology that, compared to simply increasing the size of the display image itself, can suppress increases in set volume and power consumption, and can also assist the driver.

[0060] Figure 7 shows an example of the structure of the display device 1. As shown in the right-hand figure of Figure 7, the display device 1 is equipped with a light-emitting unit 201 around the part of the video display unit 200 from which the video light is emitted or around the display area of ​​the video display unit 200, and the light-emitting unit 201 displays a virtual image by emitting light around the display image.

[0061] Here, the light-emitting unit 201 may, for example, include one or more LED chips. When the video display unit 200 displays an image at 1:1 magnification, the display device 1 can display a virtual image in which the positional relationship between the display area of ​​the video display unit 200 and the LED chips corresponds, as shown in the left diagram of Figure 7. For example, when the video display unit 200 is viewed from the front as shown in the right diagram of Figure 7, and the arrows 220 are in the same direction, LED chip 201a is positioned in the upper right of the display area of ​​the video display unit 200, LED chip 201b is positioned in the lower right of the display area of ​​the video display unit 200, and LED chip 201c is positioned in the upper left of the display area of ​​the video display unit 200. The arrows 220 point to the rear of the vehicle (from the windshield towards the driver) in the front-to-rear direction of the vehicle. In this case, the driver can see, from the driver's perspective, the virtual image 10 produced by the video display unit 200, the virtual image 10a produced by the LED chip 201a located to the upper right of the virtual image 10 produced by the video display unit 200, the virtual image 10b produced by the LED chip 201b located to the lower right of the virtual image 10 produced by the video display unit 200, and the virtual image 10c produced by the LED chip 201c located to the upper left of the virtual image 10 produced by the video display unit 200.

[0062] Furthermore, the light-emitting section 201 may, for example, include a bar of LEDs. Alternatively, the light-emitting section 201 may include a section in which LED chips are arranged in one direction. The light-emitting section 201 can be constructed using LED chips, LED bars, etc., as light-emitting elements (LEs).

[0063] The light-emitting unit 201 is controlled by a processor, which may, for example, control the light-emitting unit 201 to emit light according to the content of the information displayed by the video display unit 200. Here, the processor may, for example, be configured to control the video display of the display device 1, such as the control unit 1010 of the display device 1, the controller 100 of the vehicle 2, or a control device provided in the external device 400. Furthermore, control may be performed by one or more of these configurations.

[0064] Furthermore, the processor may, for example, acquire brightness information of the video output by the video display unit 200 and cause the light-emitting unit 201 to emit light in accordance with the brightness of the video output by the video display unit 200.

[0065] Next, an example of a light emission control method will be described with reference to Figure 8. As shown in Figure 8, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 coincide with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LE of the light emission unit 201 is positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with.

[0066] The upper diagram of Figure 8 illustrates a situation where vehicle 2 is accelerating despite being expected to turn left according to the route navigation and vehicle status, and the turn signal is not activated. The display device 1 displays this situation on the video display unit 200 and displays a virtual image representing the situation. For example, the video display unit 200 displays information related to the route navigation 801 and information related to warnings 802, and virtual images of this information are displayed. In this example, information about the left turn related to the route navigation, warning information indicating that vehicle 2 is not decelerating, and warning information indicating that the turn signal is not activated are displayed.

[0067] In conjunction with this display, the processor, for example, acquires information related to the route navigation, illuminates the light-emitting element LE corresponding to the direction of the turn, and displays a virtual image corresponding to the direction of the turn. In this example, the processor illuminates the light-emitting element LE, which is positioned along the left side of the display area of ​​the video display unit 200, in red, and displays a virtual image from the light-emitting element to the left of the virtual image from the video display unit 200. In this way, an auxiliary display is provided to make the driver aware of information regarding the direction of the turn.

[0068] In addition, along with this display, the processor illuminates the light-emitting element LE on the side where the warning information 802 is displayed. In this example, the processor illuminates the light-emitting element LE located along the bottom of the video display unit 200 in red, and displays a virtual image from the light-emitting element LE below the virtual image on the video display unit 200. In this way, an auxiliary display is provided to make the driver aware of the warning information.

[0069] If the driver notices the information and takes appropriate action, the display of the warning information 802 is stopped and the light-emitting unit 201 turns off. On the other hand, if the driver does not take action, the display device 1 displays the warning more clearly on the video display unit 200. The processor then performs an auxiliary display by making the light-emitting element LE around the entire circumference of the display area of ​​the video display unit 200 on the light-emitting unit 201 flash more brightly B, thereby controlling the system to make the driver aware of the information.

[0070] The processor may determine whether the driver has responded based on predetermined conditions and perform the control accordingly. For example, if the display device 1 displays information related to the route navigation, and then the processor obtains information about the driving of vehicle 2 which is not following the route navigation, it may determine that the driver has not responded and perform the control accordingly. The video display unit 200 may also display information that more clearly warns of a route error, i.e., that the vehicle is not driving according to the route navigation instructions. In addition, although an example in which the light-emitting unit 201 lights up / flashes in red has been described, the light-emitting unit 201 may light up / flashe in a different color.

[0071] The lower diagram in Figure 8 shows a situation where vehicle 2 is a bus and a bus passenger has pressed the bus stop button. The display device 1 displays this situation on the video display unit 200 and displays a virtual image representing this situation. For example, the video display unit 200 displays information 811 instructing the driver to stop at the next bus stop and displays a virtual image related to this information.

[0072] When the bus stop button is pressed, the processor lights up the light-emitting unit 201 and displays a virtual image using the light-emitting element LE. The processor may also light up one or more, or all, of the following light-emitting elements LE in the width direction of the vehicle: the light-emitting element LE on the left side of the display area of ​​the video display unit 200, the light-emitting element LE on the right side of the display area of ​​the video display unit 200, the light-emitting element LE above the display area of ​​the video display unit 200, and the light-emitting element LE below the display area of ​​the video display unit 200. In this way, an auxiliary display is provided to make the driver aware of information regarding the stop instruction.

[0073] The display device 1 then displays information 812 regarding the distance to the bus stop on the video display unit 200. The display device 1 also displays a scale 813 related to the distance to the bus stop on the video display unit 200. In this example, the scale is displayed on the left and right sides of the display area of ​​the video display unit 200, aligned with the light-emitting element LE. The display device 1 may also display this information when the distance between the bus stop and the vehicle 2 approaches a predetermined distance. The unit of the scale 813 is, for example, 100m, but may be different.

[0074] Furthermore, the processor acquires route navigation information from, for example, a car navigation system 6, and controls the light-emitting unit 201 in conjunction with the route navigation information. Here, the processor lights up the light-emitting element LE on the scale 813 side that corresponds to the distance to the bus stop, providing an auxiliary display to make the driver aware of the distance to the bus stop.

[0075] For example, if the display device 1 displays a scale 813 in 100m increments, and the processor obtains information that the distance to the bus stop is 300m based on the route navigation information, the processor will light up the light-emitting elements LE at positions from 0m to 300m (i.e., the light-emitting elements LE at positions 0 to 3), as shown in the lower diagram of Figure 8. Then, as the vehicle 2 approaches the bus stop, the processor will light up the light-emitting elements LE in a sliding manner in accordance with the decreasing distance between the vehicle 2 and the bus stop. In this way, by displaying the distance to the bus stop in conjunction with the route navigation information as a slide bar, it is possible to provide driving assistance to the driver. The light-emitting elements LE on the scale 813 side can be composed of, for example, a bar of LEDs or LED chips arranged closely together in one direction. However, the light-emitting elements LE on the scale 813 side may also be LED chips arranged with spacing corresponding to the height of the scale. The processor may, for example, perform control to turn off the light-emitting element LE at the position of the scale indicating a distance longer than the current distance between vehicle 2 and the bus stop, and to turn on the light-emitting element LE at the position of the scale indicating a distance shorter than the current distance between vehicle 2 and the bus stop.

[0076] The above-described light emission control method, with reference to Figure 8, can be suitably used, for example, to assist drivers of commercial vehicles such as trucks and buses, and can effectively assist in raising awareness.

[0077] Next, an example of a light emission control method will be described with reference to Figure 9. As shown in Figure 9, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 coincide with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LE of the light emission unit 201 is positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with.

[0078] The upper diagram in Figure 9 shows a situation where vehicle 2 is a bus and the bus is stopped at a bus stop until departure. The display device 1 displays this situation on the video display unit 200 and displays a virtual image of the situation. For example, the video display unit 200 displays information 901i indicating that the bus is stopped and information 902i regarding the remaining time until departure, and displays virtual images of this information.

[0079] In conjunction with this display, the processor lights up the light-emitting unit 201 to display a virtual image using the light-emitting element LE. The processor may light up any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE above the display area of ​​the video display unit 200, and the light-emitting elements LE below the display area of ​​the video display unit 200. In this example, the processor lights up the light-emitting elements LE on the left, right, top, and bottom sides of the display area of ​​the video display unit 200. The processor may also light up the light-emitting elements LE in red, as an example. In this way, an auxiliary display is provided to make the driver aware of the information 901i indicating that the vehicle is stopped and the information 902i regarding the remaining time until departure. In this example, the processor lights up the light-emitting elements LE, but the light-emitting elements may also be made to blink.

[0080] Then, at the time when it is time for vehicle 2 to depart (i.e., when vehicle 2 is ready to depart), the display device 1 displays information indicating that departure is possible on the video display unit 200 and displays a virtual image of this information. In conjunction with this display, the processor lights up the light-emitting unit 201 and displays a virtual image using the light-emitting element LE. The processor may light up any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE above the display area of ​​the video display unit 200, and the light-emitting elements LE below the display area of ​​the video display unit 200. In this example, the processor lights up the light-emitting elements LE on the left, right, top, and bottom of the display area of ​​the video display unit 200. Also, as an example, the processor lights up the light-emitting elements LE in blue. In this way, an auxiliary display is made to make the driver aware of the information indicating that departure is possible. In this example, the processor lights up the light-emitting elements LE, but the light-emitting elements LE may also blink.

[0081] The lower diagram in Figure 9 shows a situation where vehicle 2 is a truck traveling at a speed near the speed limit. The display device 1 displays this situation on the video display unit 200 and displays a virtual image representing the situation. For example, the video display unit 200 displays information 911i regarding the current speed, and a virtual image of this information is displayed. In this example, the speed limit is assumed to be 90 km / h.

[0082] When the speed of vehicle 2 approaches the speed limit, the processor, for example, lights up the light-emitting unit 201 and displays a virtual image using the light-emitting element LE, based on the acquired vehicle information 4. More specifically, the processor lights up the light-emitting unit 201 when the current speed of vehicle 2 is within a range between a predetermined speed slower than the speed limit and the speed limit. The processor may also light up any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE above the display area of ​​the video display unit 200, or the light-emitting elements LE below the display area of ​​the video display unit 200. In this example, the processor lights up the light-emitting elements LE on the left, right, top, and bottom of the display area of ​​the video display unit 200. The processor may also light up the light-emitting elements LE in yellow, for example. In this way, an auxiliary display is provided to make the driver aware that the speed of vehicle 2 is approaching the speed limit.

[0083] In this example, a predetermined speed is set so that the processor displays an auxiliary indicator when vehicle 2 is traveling at a speed 5 km / h slower than the speed limit. However, the speed at which the auxiliary indicator is displayed relative to the speed limit may be set as appropriate. The processor may also obtain speed limit information from a device such as a car navigation system 6, for example. Alternatively, the processor may obtain speed limit information through communication with an external device of vehicle 2.

[0084] Furthermore, if the speed of vehicle 2 exceeds the speed limit, the processor, for example, flashes the light-emitting unit 201 based on the acquired vehicle information 4, and displays a virtual image using the light-emitting element LE. More specifically, the processor flashes the light-emitting unit 201 if the current speed of vehicle 2 is greater than or equal to the speed limit. The processor may flash any or more, or all, of the light-emitting elements LE on the left side of the display area of ​​the video display unit 200, the light-emitting elements LE on the right side of the display area of ​​the video display unit 200, the light-emitting elements LE above the display area of ​​the video display unit 200, or the light-emitting elements LE below the display area of ​​the video display unit 200. In this example, the processor flashes the light-emitting elements LE on the left, right, top, and bottom of the display area of ​​the video display unit 200. The processor may also flash the light-emitting elements LE in red, for example. In this way, an auxiliary display is provided to alert the driver that the speed of vehicle 2 exceeds the speed limit.

[0085] The above-described light emission control method, with reference to Figure 9, can be suitably used, for example, to assist drivers of commercial vehicles such as trucks and buses, and can effectively assist in raising awareness.

[0086] Next, an example of a light emission control method will be described with reference to Figure 10. As shown in Figure 10, the light emission unit 201 may be configured such that, when viewed from the front, the light-emitting element LE of the light emission unit 201 is positioned on the left and right sides of the display area of ​​the light emission unit 200, aligned with the light emission unit 200, so that a virtual image can be displayed. In this example, the light-emitting element LE on the left and right sides of the display area of ​​the light emission unit 200 is arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0087] If the video display unit 200 outputs the video 1001 and a predetermined set value (for example, the brightness value of the video displayed by the video display unit 200) together, the displayed content may become complex, making it difficult for the driver to grasp the content of the video 1001. Therefore, the video display unit 200 may not display the predetermined set value, and control may be performed to indicate the set value using the light-emitting element LE.

[0088] On the left and right sides of the video display unit 200, light-emitting elements (LEs) are arranged to form a scale of predetermined set values. The processor acquires information regarding the predetermined set values ​​and indicates these predetermined set values ​​by lighting up the light-emitting elements (LEs). In this example, five scales worth of light-emitting elements (LEs) are arranged on the left and right sides of the display area of ​​the video display unit 200. The processor acquires information regarding the brightness of the video 1001 on the video display unit 200 and indicates the brightness value of the video 1001. For example, when the brightness value of the video 1001 on the video display unit 200 has reached 20% but not yet reached 40%, the processor lights up one scale worth of light-emitting elements (LEs). For example, when the brightness value of the video 1001 on the video display unit 200 has reached 80% but not yet reached 100%, the processor lights up four scales worth of light-emitting elements (LEs).

[0089] In this example, the light-emitting elements (LEs) were arranged with spacing between them. However, the light-emitting elements (LEs) may also have a bar-like structure or a structure where they are closely spaced in one direction. The processor may also perform control to express a predetermined set value by the height of the illuminated light-emitting elements (LEs).

[0090] In the above-described light emission control method, with reference to Figure 10, when a button is pressed to operate a predetermined set value, the predetermined set value can be displayed independently of the image on the video display unit 200. Therefore, the complexity of the image displayed by the video display unit 200 is suppressed. In addition, the displayed image does not need to be changed when the predetermined set value is changed, thereby improving operability. Furthermore, this light emission control method can be suitably used for driving assistance for drivers of vehicles 2 other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0091] Next, an example of a light emission control method will be described with reference to Figure 11. As shown in Figure 11, the light emission unit 201 may be configured such that, when viewed from the front, the light-emitting element LE of the light emission unit 201 is positioned on the left and right sides of the display area of ​​the light emission unit 200, aligned with the light emission unit 200, so that a virtual image can be displayed. In this example, the light-emitting element LE on the left and right sides of the display area of ​​the light emission unit 200 is arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0092] The upper diagram in Figure 11 shows a situation where instructions for the direction to turn at an intersection based on route navigation are output. The display device 1 displays this situation on the video display unit 200 and displays a virtual image of the situation. For example, the video display unit 200 displays information 1101 indicating the direction of travel at the intersection and information 1102 indicating the distance to the intersection, and displays virtual images of this information. The display device 1 also displays a scale 1103 related to the distance to the intersection on the video display unit 200. In this example, the scale 1103 is displayed on the left and right sides of the display area of ​​the video display unit 200, along the light-emitting element LE. The display device 1 may also display this information when it approaches a predetermined distance from the intersection. The unit of the scale 1103 is, for example, 100m, but may be different.

[0093] In conjunction with this display, the processor, for example, acquires route navigation information from a car navigation system 6 and controls the light-emitting unit 201 in conjunction with the route navigation information. Here, the processor lights up the light-emitting element LE on the side the vehicle 2 is turning, at a position corresponding to the distance to the intersection, providing an auxiliary display to make the driver aware of the distance to the intersection.

[0094] For example, if the display device 1 displays a scale 1103 in units of 100m, and the processor obtains information about turning right at an intersection and that the distance to the intersection is 300m based on the route navigation information, the processor will light up the light-emitting elements LE (i.e., the light-emitting elements LE at positions 0m to 300m) on the right side of the display area of ​​the video display unit 200 (i.e., the light-emitting elements LE at positions 0 to 3).

[0095] The processor may also illuminate the portion of the light-emitting element (LE) that indicates the current position (in this example, the 3rd mark) with greater emphasis compared to other parts. For example, the processor may control the brightness of the portion of the scale indicating the current position to be higher than that of other parts.

[0096] Then, as vehicle 2 approaches the intersection, the processor illuminates the light-emitting element LE in a sliding motion as the distance between vehicle 2 and the intersection decreases. The processor also flashes the light-emitting element LE when the distance between vehicle 2 and the intersection is less than or equal to a predetermined distance. In this example, the predetermined distance corresponds to one division of the scale, and the processor flashes the light-emitting element LE corresponding to one division when the distance to the intersection is one division.

[0097] In this way, by displaying the distance to the intersection as a slider bar in conjunction with the route navigation information, driver assistance is possible. Furthermore, by displaying the direction of travel of vehicle 2 in conjunction with the route navigation information, driver assistance is also possible. Additionally, when approaching an intersection, the system can alert the driver by using a flashing light (B) instead of a steady light.

[0098] The light-emitting element LE on the scale 1103 side may, for example, be composed of a bar of LEDs or LED chips arranged closely together in one direction. The processor may, for example, turn off the light-emitting element LE at the scale position indicating a distance longer than the distance to the intersection, and turn on the light-emitting element LE at the scale position indicating a distance shorter than the distance to the intersection. The processor may also make the light-emitting element LE in the portion of the scale less than or equal to one scale unit blink when the distance to the intersection becomes one scale unit or less.

[0099] The lower diagram in Figure 11 illustrates the situation when vehicle 2 is parked. The display device 1 displays information indicating the tilt of the tires on the video display unit 200 and displays a virtual image representing this information. For example, the video display unit 200 displays information 1111 regarding the level of the tilt of vehicle 2's tires and video information 1112 showing the tilt of vehicle 2's tires relative to a reference, and the display device 1 displays a virtual image of this information. The display device 1 also displays a scale 1113 related to the tilt of vehicle 2's tires on the video display unit 200. In this example, the scale 1113 is displayed on the left and right sides of the display area of ​​the video display unit 200, aligned with the light-emitting element LE. The display device 1 may also perform this display when vehicle 2 is in reverse gear. For example, the unit of the scale 1113 is 1 level, with a higher level indicating a greater tire tilt.

[0100] For example, if the processor acquires information based on vehicle information 4 indicating that the tire is tilted to the left at level 5, the processor illuminates the light-emitting element LE at the level 5 position, as shown in the lower part of Figure 11. The processor may also illuminate the light-emitting elements LE at positions up to level 5 (i.e., light-emitting elements LE at positions 0 to 5). Similarly, if the tire of vehicle 2 is tilted to the right, and the processor acquires information based on vehicle information 4 indicating that the tire is tilted to the right at level 2, the processor illuminates the light-emitting elements LE at positions up to level 2 (i.e., light-emitting elements LE at positions 0 to 2), as shown in the lower part of Figure 11. The processor may also illuminate the light-emitting element LE at the level 2 position. In this way, the processor acquires information on the tire's tilt and illuminates the light-emitting elements LE at the position corresponding to the current tire tilt.

[0101] The light-emitting element LE on the scale 1113 side may, for example, be composed of a bar of LEDs or LED chips arranged closely together in one direction. The distance between the light-emitting elements LE may be fixed, increased, or decreased. The processor may, for example, turn off the light-emitting elements LE in the area where the tire tilt is greater than the current tilt, and turn on the light-emitting elements LE in the area where the tire tilt is less than the current tilt.

[0102] The above-described light emission control method, with reference to Figure 11, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0103] Next, an example of a light emission control method will be described with reference to Figure 12. As shown in Figure 12, the light emission unit 201 may be configured such that, when viewed from the front side such that the video display unit 200 and the light emission unit 201 are aligned with the direction indicated by the arrow 220 in the left diagram of Figure 7, the light-emitting element LEs of the light emission unit 201 are positioned on the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so as to be aligned with. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the video display unit 200 are arranged with a gap between them. The distance between the light-emitting element LEs may be predetermined, increased, or decreased.

[0104] Figure 12 illustrates a situation where a vehicle is traveling on a public road. In this example, vehicle 2 is traveling on the left side of the road. The display device 1, as an example, displays the current speed of vehicle 2 on the video display unit 200 and displays a virtual image.

[0105] When another vehicle approaches vehicle 2, the display device 1 displays information indicating the approach of the vehicle on the video display unit 200 and displays a virtual image of the information. The display device 1 may also display the direction of the approaching vehicle. In this example, the display device 1 displays information 1201 that an overtaking vehicle traveling on the right side of the lane is approaching vehicle 2.

[0106] In conjunction with this display, the processor acquires vehicle information 4 regarding the approach of other vehicles and controls the light-emitting unit 201. Here, the processor lights up the light-emitting element LE at the position corresponding to the direction of approach of the vehicle, providing an auxiliary display to alert the driver to the presence of other vehicles.

[0107] Furthermore, if the turn signal of the approaching vehicle is activated while another vehicle is approaching, the display device 1 displays warning information 1202 regarding the approaching vehicle on the video display unit 200 and displays a virtual image of the information. In this example, the warning information is displayed when the right turn signal is activated.

[0108] In conjunction with this display, the processor acquires vehicle information 4 regarding the approach of other vehicles and information regarding the status of the turn signals, and controls the light-emitting unit 201. Here, if the turn signals of the other vehicle are ON, the processor provides an auxiliary display by flashing the light-emitting elements LE around the entire circumference of the display area of ​​the video display unit 200 in the light-emitting unit 201, thereby controlling the system to make the driver aware of the information. In this way, the auxiliary display is made more rigorous to help the driver notice the warning in the displayed video.

[0109] The above-described light emission control method, with reference to Figure 12, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0110] Next, an example of a light emission control method will be described with reference to Figure 13. As shown in Figure 13, the light emission unit 201 may be configured such that, when viewed from the front side, the light-emitting elements LE of the light emission unit 201 are positioned along the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so that a virtual image can be displayed. In this example, the light-emitting elements LE on the left and right sides of the display area of ​​the video display unit 200 are spaced apart. The distance between the light-emitting elements LE may be fixed, increased, or decreased.

[0111] Figure 13 relates to the display of the remaining fuel level in a vehicle. For example, when the remaining fuel level in vehicle 2 decreases to a predetermined value (first predetermined value), the display device 1 displays the current remaining fuel level of vehicle 2 on the video display unit 200 and displays a virtual image. In this example, information 1301 showing the current remaining fuel level of vehicle 2 (in this example, a diagram showing the remaining fuel level) is displayed on the lower right side of the display area of ​​the video display unit 200. In this example, the first predetermined value is set to a value corresponding to 20% remaining fuel, but the first predetermined value may be a different value.

[0112] In conjunction with this display, the processor acquires information regarding the current fuel level of the vehicle 2 based on the vehicle information 4 and controls the light-emitting unit 201. Here, the processor lights up the light-emitting element LE on the side where the information 1301 is displayed, which is located close to the display position of the information 1301, thereby providing an auxiliary display to alert the driver to the fuel level information.

[0113] Furthermore, when the amount of gasoline remaining in vehicle 2 decreases to a predetermined value (i.e., a second predetermined value indicating a lower amount than the first predetermined value), the display device 1, for example, highlights the current amount of gasoline remaining in vehicle 2 on the video display unit 200 and displays a virtual image. In this example, information 1302 indicating the highlighted amount of gasoline remaining in vehicle 2 (in this example, a diagram showing the amount of gasoline remaining) is displayed at the bottom center of the video display unit 200. The display device 1 also displays information 1303 (for example, a message) regarding a warning about the amount of gasoline remaining in vehicle 2. In this example, the second predetermined value is set to a value corresponding to 10% remaining, but the second predetermined value may be a different value.

[0114] In conjunction with this display, the processor controls the light-emitting unit 201 based on the remaining fuel level of the vehicle 2, which is determined by the acquired vehicle information 4. Here, if the current remaining fuel level of the vehicle 2 is below a second specified value, the processor provides an auxiliary display by flashing the light-emitting elements LE around the entire circumference of the display area of ​​the video display unit 200 in the light-emitting unit 201, thereby alerting the driver to the information. In this way, the auxiliary display is made more rigorous to help the driver notice the warning in the displayed video.

[0115] The above-described light emission control method, with reference to Figure 13, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0116] Next, an example of a light emission control method will be described with reference to Figure 14. As shown in Figure 14, the light emission unit 201 may be configured such that, when viewed from the front side, the light-emitting element LEs of the light emission unit 201 are positioned along the left and right sides and the top and bottom sides of the display area of ​​the video display unit 200, so that a virtual image can be displayed. In this example, the light-emitting element LEs on the left and right sides of the display area of ​​the video display unit 200 are spaced apart. The distance between the light-emitting element LEs may be fixed, increased, or decreased.

[0117] Figure 14 relates to the display of the driver's seat belt wearing status in vehicle 2. As an example, if the driver is not wearing a seat belt, the display device 1 displays an indication on the video display unit 200 that the seat belt is not being worn, and displays a virtual image. In this example, information 1401 indicating that the seat belt is not being worn (in this example, a diagram indicating that the seat belt is not being worn) is displayed on the lower right side of the display area of ​​the video display unit 200.

[0118] In conjunction with this display, the processor acquires information regarding the driver's seatbelt wearing status in vehicle 2 based on vehicle information 4 and controls the light-emitting unit 201. Here, the processor lights up the light-emitting element LE closest to the information 1401 on the side where the information 1401 is displayed, providing an auxiliary display to alert the driver that the seatbelt is not being worn.

[0119] If the seat belt remains unfastened for a predetermined period of time, the display device 1, for example, highlights the information that the seat belt is unfastened on the video display unit 200 and displays a virtual image. In this example, the highlighted information 1402 indicating that the seat belt is unfastened (in this example, a diagram indicating that the seat belt is unfastened) is displayed at the bottom center of the video display unit 200. The display device 1 also displays warning information 1403 (for example, a message) regarding the unfastened seat belt. In this example, the predetermined period is set to 1 minute, but this period may be different.

[0120] In conjunction with this display, the processor controls the light-emitting unit 201 based on the seat belt usage status information obtained from the vehicle information 4. Here, if the seat belt remains unfastened for a predetermined period of time, the processor provides an auxiliary display by flashing the light-emitting elements LE around the entire circumference of the display area of ​​the video display unit 200 in the light-emitting unit 201, thereby alerting the driver to the information. In this way, the auxiliary display is made more rigorous to help the driver notice the warning in the displayed video.

[0121] The above-described light emission control method, with reference to Figure 14, can be suitably used to assist drivers of vehicles other than commercial vehicles such as trucks and buses (for example, a regular passenger car), and can effectively assist in raising awareness.

[0122] The image displayed by the image display unit 200 may, for example, be displayed using a backlight with a white LED as the light source. The processor may then adjust the brightness of the light-emitting element LE emitted by the light-emitting unit 201 based on the duty cycle of the white LED.

[0123] Furthermore, considering visibility, it is desirable to adjust the brightness of the display image from the video display unit 200 and the brightness of the light-emitting element LE emitted by the light-emitting unit 201 to be the same. However, for emphasis, the processor may make the light-emitting element LE light up brighter than the display image from the video display unit 200. Alternatively, the processor may make the light-emitting element LE light up dimmer than the display image from the video display unit 200.

[0124] In bright environments (for example, during the day), the iris is closed and less noticeable, so it is preferable for the processor to emit light from the light-emitting element LE of the light-emitting unit 201 at a brightness of 0.9 to 1.3 times that of the brightness of the image displayed by the image display unit 200. Also, in dark environments (for example, at night), the iris is open and more noticeable, so it is preferable for the processor to emit light from the light-emitting element LE of the light-emitting unit 201 at a brightness of 0.7 to 1.1 times that of the brightness of the image displayed by the image display unit 200.

[0125] For example, the processor may acquire brightness information of the display image shown by the video display unit 200 and adjust the brightness of the light-emitting element LE based on the acquired information. Alternatively, for example, the processor may acquire information about the brightness of the environment from the illuminance sensor 905, determine whether the environment is bright or dark, and then control the brightness of the light-emitting element LE of the light-emitting unit 201 based on the determination result.

[0126] Furthermore, the system may include a circuit that performs PWM (Pulse Width Modulation) control over the current flowing through the light-emitting unit 201. The processor may then control this circuit and adjust the brightness of the light-emitting element LE to match the brightness of the backlight based on the PWM control. In this case, the brightness can be adjusted effectively.

[0127] The light-emitting element LE of the light-emitting section 201 may be an RGB integrated element that emits light corresponding to each of the colors R (red), G (green), and B (blue).

[0128] An auxiliary display is provided using the light-emitting unit 201, and if the driver notices the information, control may be implemented to prevent it from interfering with driving. An embodiment will be explained using Figures 15 to 22. Note that explanations that are the same as those already described may be omitted.

[0129] As shown in Figure 15, a sensor is used to detect the driver's gaze, and in this embodiment, a gaze detection sensor will be used for explanation. Examples of gaze detection sensors include a camera 221 mounted inside the vehicle 2, a sensor mounted inside the vehicle 2 (external sensor 223), and a sensor mounted on the display device 1 (mounted sensor 224). The camera 221 is positioned so that the driver's face is included within the camera field of view 222. The external sensor 223 and the mounted sensor 224 are positioned so as to be able to capture the driver's gaze. The mounted sensor 224 may be incorporated into the housing of the display device 1 and built into the display device 1. Alternatively, the mounted sensor 224 may be mounted outside the housing of the display device 1.

[0130] Furthermore, the gaze detection sensor only needs to be able to detect the driver's gaze, and for example, it may be at least one of these configurations (221, 223, 224).

[0131] Figure 16 is a diagram illustrating the processing flow related to this control. As shown in Figure 16, the processor checks whether the auxiliary display is active (S1601). If the auxiliary display is active (S1601-YES), it acquires data from the gaze detection sensor to obtain the driver's gaze (S1602). Based on the acquired data, it then determines whether the driver's gaze is directed towards the display area 5 of the windshield 3 (S1603).

[0132] Here, in S1603, the processor may, for example, make a determination based on whether the driver's gaze, acquired within the display area 5 of the windshield 3, is within the display area 5 of the windshield 3. If the driver's gaze is within the display area 5 of the windshield 3, the processor determines that the driver's gaze was directed towards the display area 5.

[0133] If the processor determines that the driver's gaze is directed towards display area 5 (S1603-YES), it controls the auxiliary display (S1604). If the processor determines that the driver's gaze is not directed towards display area 5 (S1603-NO), it continues the auxiliary display as is (S1605). Then, the processor acquires the driver's gaze again (S1602) and makes a determination (S1603).

[0134] Next, an example of a control method will be explained with reference to Figures 17-21.

[0135] As shown in Figure 17, in a situation where the auxiliary display described using the upper diagram of Figure 8 is being displayed, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to reduce the auxiliary display. The processor may change the flashing / illumination of the light-emitting element LE of the light-emitting unit 201 to off, change the flashing of the light-emitting element LE of the light-emitting unit 201 to on, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to on and reduce the brightness of the light-emitting element LE. In this example, the processor turns off the light-emitting element LE of the left, right, top, and bottom light-emitting units 201.

[0136] As a result, when a driver notices warning information such as a route mistake, the system can allow the driver to recognize the information and then reduce the level of auxiliary signs that could potentially hinder driving.

[0137] As shown in Figure 18, in a situation where the auxiliary display described using the lower diagram of Figure 9 is being displayed, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to reduce the auxiliary display. The processor may change the flashing / illumination of the light-emitting element LE of the light-emitting unit 201 to off, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor changes the flashing of the light-emitting element LE of the left, right, top, and bottom light-emitting units 201 to illumination.

[0138] The processor may also acquire information on the speed of vehicle 2 and, if the speed of vehicle 2 falls below the speed limit, remove the mark 950 displayed on the video display unit 200, thereby further relaxing the auxiliary display.

[0139] As a result, when a driver notices information indicating they are exceeding the speed limit, the system can make the driver aware of this information and then reduce the level of potentially distracting auxiliary displays. Furthermore, once the speed limit has been corrected, the system can further reduce the level of potentially distracting auxiliary displays.

[0140] As shown in Figure 19, when the auxiliary display described using Figure 12 is in operation, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to lessen the auxiliary display. The processor may turn off the flashing / illumination of the light-emitting element LE of the light-emitting unit 201, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor changes the flashing of the light-emitting element LE of the left, right, top, and bottom light-emitting units 201 to illumination.

[0141] As a result, when a driver notices information about the approach of another vehicle, the system can make the driver aware of this information and then reduce the level of any auxiliary displays that could potentially interfere with driving.

[0142] As shown in Figure 20, when the auxiliary display described using Figure 13 is in operation, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may display a mark 950 on the video display unit 200 indicating that the driver is paying attention to the information, and also control the illumination / flashing of the light-emitting element LE of the light-emitting unit 201 to lessen the auxiliary display. The processor may turn off the flashing / illumination of the light-emitting element LE of the light-emitting unit 201, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor changes the flashing of the light-emitting element LE of the left, right, top, and bottom light-emitting units 201 to illumination.

[0143] As a result, when a driver notices information about the remaining fuel level, the system can make the driver aware of this information and then reduce the level of any auxiliary displays that might interfere with driving.

[0144] As shown in Figure 21, when the auxiliary display described using Figure 14 is in operation, if the processor determines that the driver's gaze is directed towards the display area 5, the processor may soften the auxiliary display by controlling the illumination / flashing of the light-emitting element LE of the light-emitting unit 201. The processor may turn off the flashing / illumination of the light-emitting element LE of the light-emitting unit 201, change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination, reduce the brightness of the light-emitting element LE of the light-emitting unit 201, or change the flashing of the light-emitting element LE of the light-emitting unit 201 to illumination and reduce the brightness of the light-emitting element LE. In this example, the processor turns off the flashing of the light-emitting element LE of the light-emitting unit 201 on the left, right, top, and bottom sides.

[0145] As a result, when the driver notices that the seatbelt is not being worn, the system can make the driver aware of this information and then loosen any potentially distracting auxiliary indicators.

[0146] Although an example was described in which control is performed based on whether the driver's gaze is directed toward the display area 5, it is sufficient to perform control based on whether the driver's gaze is directed toward the displayed information. For this reason, the processor may, for example, determine whether the driver's gaze is directed toward a projection member that projects image light other than the windshield 3. Alternatively, the processor may, for example, determine whether the driver's gaze is directed toward the virtual image 10 to be displayed.

[0147] Furthermore, while the display position of the mark 950 indicating that the driver has paid attention to the information is, for example, the corner of the video display unit 200, the mark 950 may be displayed in a position other than the corner, and the display position of the mark 950 is not particularly limited. Moreover, as long as the mark 950 can make the driver aware that they have paid attention to the information, the form of the mark 950 is not limited.

[0148] Next, an example of controlling the brightness of the video display unit 200 and the light-emitting unit 201 will be described with reference to Figure 22. When normal information such as speed and clock information is being displayed and the driver is not looking at this display, the processor may reduce the brightness of the video display unit 200 and the light-emitting unit 201.

[0149] The processor then acquires data from the gaze detection sensor to determine the driver's gaze. If the processor determines that the driver's gaze is within the first zone A, it controls the video display unit 200 and the light-emitting unit 201 at normal brightness. In other words, the processor controls the video display unit 200 and the light-emitting unit 201 without reducing brightness.

[0150] If the processor determines that the driver's gaze is in the second zone B, it controls the video display unit 200 and the light-emitting unit 201 by reducing their brightness. For example, if the brightness in the first zone A is set to 100%, the processor controls the video display unit 200 and the light-emitting unit 201 at 50% brightness.

[0151] If the processor determines that the driver's gaze is in the third zone C, it controls the video display unit 200 and the light-emitting unit 201 by reducing their brightness. For example, if the brightness in the first zone A is set to 100%, the processor controls the video display unit 200 and the light-emitting unit 201 at 10% brightness.

[0152] Zone 1A corresponds to the display area 5. Zone 2B is a predetermined area outside Zone 1A that extends up, down, left, and right from the driver's perspective. Zone 3C is a predetermined area outside Zone 2B that extends up, down, left, and right from the driver's perspective, or an area outside Zone 2B that extends up, down, left, and right from the driver's perspective.

[0153] By adjusting the brightness value when the viewer's gaze moves away from the display area 5, power consumption can be reduced.

[0154] However, when the processor displays alert information that should warn the driver, such as a wrong route or speeding, the processor controls the video display unit 200 and the light-emitting unit 201 without reducing the brightness, even if the driver's gaze is in the second zone B or the third zone C (in other words, even if they are not looking at the virtual image 10), in order to quickly make the driver aware of the alert information.

[0155] The virtual image 10 displayed by the display device 1 requires less eye movement than checking the meters, navigation system, and other instruments installed inside the vehicle. However, since the virtual image is not superimposed on the road conditions (vehicles, pedestrians, lanes, etc.) while driving, the driver tends to take their eyes off the virtual image 10 more often, resulting in a shorter time spent looking at the virtual image 10. Therefore, applying this brightness control to the display device enables significant power savings.

[0156] The technology described in this embodiment provides a display device that can display a good virtual image, reducing the driver's eye movement and contributing to safe driving, thereby preventing traffic accidents. This contributes to the United Nations' Sustainable Development Goal (SDG) 3, "Ensure healthy lives and promote well-being for all." [Explanation of symbols]

[0157] 1. Display device (virtual image display device) 11 Display Panel 20 light source

Claims

1. A display device installed in a vehicle, A video display unit that projects video light, A light-emitting unit is arranged around the display area of ​​the video display unit and lights up or flashes according to the content of the information displayed by the video display unit, A display device characterized by having the following features.

2. A display device according to claim 1, When the driver of the vehicle directs their gaze towards the area from which the aforementioned image light is projected, the light-emitting element of the flashing light-emitting part turns off. A display device characterized by the following features.

3. A display device according to claim 1, When the driver of the vehicle directs their gaze towards the area from which the image light is projected, the light-emitting element of the flashing light-emitting unit lights up, and the image display unit displays a mark in the display area indicating that the driver is paying attention to the information. A display device characterized by the following features.

4. A display device according to claim 2, The aforementioned video display unit displays a mark in the display area indicating that the driver has paid attention to the information. A display device characterized by the following features.

5. A display device according to claim 2, When the video display unit displays information indicating that the vehicle is not traveling according to the route navigation instructions, the light-emitting element of the light-emitting unit turns off. A display device characterized by the following features.

6. A display device according to claim 4, When the video display unit displays information indicating that the vehicle is not traveling according to the route navigation instructions, the light-emitting element of the light-emitting unit turns off. A display device characterized by the following features.

7. A display device according to claim 3, When the video display unit is displaying information regarding the current speed of the vehicle which is above the speed limit, the light-emitting element of the light-emitting unit lights up, and the video display unit displays the mark. A display device characterized by the following features.

8. A display device according to claim 3, When the video display unit is displaying information regarding the current speed of the vehicle within the range of a predetermined speed slower than the speed limit and the speed limit, the light-emitting element of the light-emitting unit lights up, and the video display unit does not display the mark. A display device characterized by the following features.

9. A display device according to claim 3, When the video display unit is displaying information indicating the approach of a vehicle to the vehicle, the light-emitting element of the light-emitting unit lights up, and the video display unit displays a mark in the display area indicating that the driver is paying attention to the information. A display device characterized by the following features.

10. A display device according to claim 3, When the video display unit is displaying information indicating the current fuel level of the vehicle that is below a predetermined value, the light-emitting element of the light-emitting unit lights up, and the video display unit displays a mark in the display area indicating that the driver is paying attention to the information. A display device characterized by the following features.

11. A display device according to claim 2, When the video display unit is showing information indicating that the seat belt is not fastened, the light-emitting element of the light-emitting unit turns off. A display device characterized by the following features.

12. A display device according to claim 1, When the driver of the vehicle directs their gaze towards the area on which the aforementioned image light is projected, the brightness of the light-emitting element of the illuminated or flashing light-emitting part decreases. A display device characterized by the following features.

13. A display device according to claim 1, When the driver of the vehicle takes their line of sight away from the area from which the aforementioned image light is projected, the brightness of the display area of ​​the image display unit decreases. A display device characterized by the following features.

14. A display device according to claim 13, When the video display unit displays alert information that should warn the driver, the brightness of the display area of ​​the video display unit does not decrease even when the driver's line of sight moves away from the area from which the video light is projected. A display device characterized by the following features.

Images