Video display system

By incorporating independently adjustable image display devices on vehicles, the system addresses visibility issues in multiple image projections, ensuring clear and effective display for drivers through optimized positioning and alignment.

JP2026007658APending Publication Date: 2026-01-16MAXELL LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024107688
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-03
Publication Date
2026-01-16

AI Technical Summary

Technical Problem

Existing image display systems, such as head-up displays (HUDs) in vehicles, struggle to provide clear and effective multiple image display when multiple image forming units are used, leading to visibility issues for drivers.

Method used

The system includes a first and a second image display device mounted on a vehicle, with independently adjustable display areas in the vertical direction, allowing for optimal positioning and visibility adjustments based on the driver's eye position and line of sight.

Benefits of technology

Enables improved visibility of multiple images by adjusting the display positions and angles to ensure clear viewing for the driver, enhancing the overall display quality and usability of multiple image projections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026007658000001_ABST
    Figure 2026007658000001_ABST
Patent Text Reader

Abstract

To provide a technology for enabling a driver to perform satisfactory display even when using a plurality of video display devices. The present invention contributes to the sustainable development goal of "health and well-being for all three people".SOLUTION: The image display system includes a first image display device and a second image display device mounted on a vehicle. The first image display device and the second image display device display a virtual image by projecting image light onto a windshield. The display area of the first image display device and the display area of the second image display device are individually adjustable in the vertical direction of the vehicle.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to a video display system. [Background technology]

[0002] A known example of an image display device is a head-up display (HUD) that is mounted on a vehicle and projects and displays various information onto the windshield, etc. Patent Document 1 discloses a HUD device that forms multiple display areas using multiple image forming units. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-007661 Summary of the Invention [Problem to be solved by the invention]

[0004] There is a need to provide a technology that allows a driver to see a good image even when multiple image display devices are used. [Means for solving the problem]

[0005] According to a first aspect of the present invention, there is provided the following image display system. This image display system includes a first image display device and a second image display device mounted on a vehicle. The first image display device and the second image display device display virtual images by projecting image light onto the windshield. The display areas of the first image display device and the second image display device are independently adjustable in the vertical direction of the vehicle. [Effects of the Invention]

[0006] According to the present invention, a technology is provided that enables a driver to see a good image even when multiple image display devices are used. Note that problems, configurations, and effects other than those described above will become clear from the following description of the preferred embodiment of the invention. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of an in-vehicle system. [Figure 2] FIG. 2 is a diagram illustrating an example of a configuration provided in a vehicle. [Figure 3] 1 is a diagram illustrating an example of the configuration of a virtual image display device A. FIG. [Figure 4] FIG. 2 is a diagram illustrating an example of the configuration of a virtual image display device B. [Figure 5] 1 is a diagram for explaining an example of the arrangement of a virtual image display device A and a virtual image display device B in a vehicle and the positional relationship between two virtual images displayed by each virtual image display device. [Figure 6] FIG. 10 is a diagram for explaining the visibility of an image. [Figure 7A] 10 is a diagram for explaining the position adjustment of the virtual image visible range in the virtual image display device A. FIG. [Figure 7B] 10 is a diagram for explaining the position adjustment of the virtual image visible range in the virtual image display device A. FIG. [Figure 8A] 10 is a diagram for explaining the position adjustment of the virtual image visible range regarding the virtual image display device B. FIG. [Figure 8B] 10 is a diagram for explaining the position adjustment of the virtual image visible range regarding the virtual image display device B. FIG. [Figure 9A] 1 is a diagram for explaining the display relationship between one virtual image display device A and one virtual image display device B. FIG. [Figure 9B] 1 is a diagram for explaining the display relationship between one virtual image display device A and one virtual image display device B. FIG. [Figure 10A] 10 is a diagram for explaining the display relationship between two virtual image display devices (A1, A2) and one virtual image display device B. FIG. [Figure 10B] 10 is a diagram for explaining the display relationship between two virtual image display devices (A1, A2) and one virtual image display device B. FIG. [Figure 11A] 10A and 10B are diagrams for explaining in detail the relationship between the virtual image visible range and the depth and height of the display position. [Figure 11B] 10A and 10B are diagrams for explaining in detail the relationship between the virtual image visible range and the depth and height of the display position. [Figure 12] 10A and 10B are diagrams for explaining an example of a usage situation of the virtual image display device A and the virtual image display device B, a virtual image visible range, and a display control method. [Figure 13A] 10 is a diagram for explaining an example of data used in controlling the virtual image display device A. FIG. [Figure 13B] 10 is a diagram for explaining an example of data used in controlling the virtual image display device B. FIG. [Figure 14A] 10 is a flowchart illustrating an example of a flow of adjusting a display position. [Figure 14B] 10 is a flowchart illustrating an example of a flow of adjusting a display position. [Figure 14C] 10 is a flowchart illustrating an example of a flow of adjusting a display position. [Figure 14D] 10 is a flowchart illustrating an example of a flow of adjusting a display position. [Figure 15A] 10A and 10B are diagrams for explaining an example of adjustment of the height setting of the display position. [Figure 15B] 10A and 10B are diagrams for explaining an example of adjustment of the height setting of the display position. [Figure 15C] 10A and 10B are diagrams for explaining an example of adjustment of the height setting of the display position. [Figure 16A] 10 is a diagram for explaining an example of adjustment when one virtual image display device A and one virtual image display device B are mounted. FIG. [Figure 16B] FIG. 10 is a diagram for explaining an example of adjustment when a plurality of virtual image display devices (A1, A2) and one virtual image display device B are mounted. [Figure 16C]FIG. 16B is a continuation of FIG. 16B. [Figure 17A] FIG. 10 is a diagram for explaining a specific example of a change in display. [Figure 17B] FIG. 10 is a diagram for explaining a specific example of a change in display. [Figure 17C] FIG. 10 is a diagram for explaining a specific example of a change in display. [Figure 17D] FIG. 10 is a diagram for explaining a specific example of a change in display. [Figure 18] FIG. 1 is a diagram showing an example of an outline of a vehicle in which a virtual image display device B and a virtual image display device C are mounted. [Figure 19] 10 is a diagram for explaining an example of a method for evaluating the display range of the virtual image display device C. FIG. [Figure 20A] 10 is a flowchart for explaining an example of processing when a virtual image display device C is used. [Figure 20B] 10 is a flowchart for explaining an example of processing when a virtual image display device C is used. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The embodiment is an example for explaining the present invention, and for clarity of explanation, appropriate omissions and simplifications have been made. The present invention can be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.

[0009] In order to facilitate understanding of the invention, the position, size, shape, range, etc. of each component shown in the drawings may not represent the actual position, size, shape, range, etc. Therefore, the present invention is not necessarily limited to the position, size, shape, range, etc. disclosed in the drawings.

[0010] Examples of various types of information may be described using expressions such as "table," "list," and "queue," but the various types of information may also be expressed using data structures other than these. For example, various types of information such as "XX table," "XX list," and "XX queue" may also be expressed as "XX information." When describing identification information, expressions such as "identification information," "identifier," "name," "ID," and "number" are used, but these are interchangeable.

[0011] When there are multiple components with the same or similar functions, they may be described using the same reference numeral with different subscripts. When there is no need to distinguish between these multiple components, the subscripts may be omitted.

[0012] In the embodiments, processing performed by executing a program may be described. Here, a computer executes the program using a processor (e.g., a CPU or a GPU) and performs processing defined by the program using storage resources (e.g., a memory) and interface devices (e.g., a communication port). Therefore, the entity performing the processing by executing the program may be the processor. Similarly, the entity performing the processing by executing the program may be a controller, device, system, computer, or node having a processor. The entity performing the processing by executing the program may be any computing unit, and may include a dedicated circuit that performs specific processing. Here, the dedicated circuit may be, for example, an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), or a CPLD (Complex Programmable Logic Device).

[0013] A program may be installed on a computer from a program source. The program source may be, for example, a program distribution server or a computer-readable storage medium. When the program source is a program distribution server, the program distribution server may include a processor and storage resources for storing the program to be distributed, and the processor of the program distribution server may distribute the program to be distributed to other computers. In addition, in an embodiment, two or more programs may be realized as one program, or one program may be realized as two or more programs.

[0014] In the embodiments, a technology that enables a good display for the driver even when multiple image display devices are used will be described. In the embodiments, with respect to the vehicle and the driver, the horizontal direction is the left-right direction, the lateral direction of the vehicle, or the width direction of the vehicle, the vertical direction is the up-down direction or longitudinal direction of the vehicle, and the vertical direction perpendicular to the lateral direction of the vehicle is the front-rear direction of the vehicle or the direction of travel of the vehicle. As shown in FIG. 1, the width direction of the vehicle may be referred to as the X direction, the front-rear direction of the vehicle as the Y direction, and the up-down direction of the vehicle as the Z direction.

[0015] FIG. 1 is a diagram showing an overview of an in-vehicle system. The present invention will be explained using a vehicle. As shown in FIG. 1, a virtual image display device A and a virtual image display device B are mounted on a vehicle 2. The vehicle 2 also includes an in-vehicle system 300 including these components. An in-vehicle network is implemented in this in-vehicle system 300, and the controller 100 can transmit and receive data or information to and from these components, as well as components described below. The in-vehicle system 300 is implemented with, for example, a CAN (Controller Area Network), an in-vehicle Ethernet, a LIN (Local Interconnect Network), and the like.

[0016] The in-vehicle system 300 can also communicate with the outside of the vehicle via a communication device. Examples of communication with the outside of the vehicle include direct communication and indirect communication. In the direct communication, the 760 MHz band, 5.9 GHz band, etc., are used as international ITS (Intelligent Transport System) communication bands for direct communication between vehicles, between roads and vehicles, and between pedestrians. In contrast, indirect communication uses a mobile phone band other than 5.9 GHz for indirect communication via a mobile carrier network. The in-vehicle system 300 can transmit and receive data or information to, for example, a server connected to a network via an access point or relay station on the network. The in-vehicle system 300 may communicate with information terminals carried by other vehicles or pedestrians, or with infrastructure such as terminals installed on the road where the vehicle is traveling. An example of road-to-vehicle communication is receiving traffic congestion information and weather information using radio beacons or optical beacons.

[0017] Vehicle information 4, which is an example of data or information acquired by the in-vehicle system 300, includes, for example, speed information, gear information, steering wheel angle information, lamp illumination information, external light information, distance information, infrared information, engine ON / OFF information, camera image information, acceleration gyro information, GPS information, navigation information, vehicle-to-vehicle communication information, road-to-vehicle communication information, pedestrian-to-vehicle communication information, in-vehicle sensor information such as Lidar (Light Detection and Ranging), and information acquired via communication with the outside of the vehicle. The camera image information includes in-vehicle camera image information and outside-vehicle camera image information. The GPS information includes current time information, latitude and longitude information. This vehicle information can be acquired, for example, from sensors described below.

[0018] The vehicle information 4 also includes information input by the driver. The driver can input the information using an appropriate device used for inputting information. This device may be a device that is pre-installed in the vehicle. Alternatively, this device may be an external device that can be connected to the in-vehicle system 300 via a wired or wireless connection, such as an input device, a tablet, a smartphone, a wearable device such as AR (Augmented Reality) glasses or an HMD (Head Mounted Display), or a personal computer.

[0019] The in-vehicle system 300 can execute various controls such as driving control and display control using the acquired data or information.

[0020] The virtual image display devices A and B generate image light for displaying information and project the image light toward predetermined display areas (5a, 5b) of the windshield 3. As a result, the virtual image display devices A and B superimpose a virtual image corresponding to the display image onto the scenery, for example, so that the driver of the vehicle (the driver's eyes) can view it. Note that in this example, the image light is projected onto the display area of ​​the windshield 3, but the projection unit that projects the image light may be a projection member such as a combiner.

[0021] The controller 100 is an electronic control unit (ECU) mounted in the vehicle 2, and includes, for example, a processing device (e.g., a central processing unit), a storage device, and an input / output device (I / O unit). The storage device can be configured using, for example, a main storage device and an auxiliary storage device. The main storage device is a work area for the processing device, and the processing device stores data in the main storage device and executes data processing. The main storage device is, for example, a RAM (Random Access Memory). The auxiliary storage device is a non-volatile storage device that stores data in a non-volatile manner. The auxiliary storage device is, for example, a ROM (Read Only Memory).

[0022] Data or information is input to the controller 100 via an input / output device and an in-vehicle network. The controller 100 can also control various devices connected to the in-vehicle network via the input / output device and the in-vehicle network.

[0023] For example, vehicle information 4 and information acquired from a server are input to the controller 100 via an input / output device. Then, the controller 100 may control the operation of the virtual image display device based on the acquired information.

[0024] Each virtual image display device (A, B) may be connected to various sensors mounted on the vehicle 2, devices mounted on the vehicle 2 (e.g., a car navigation system), communication devices used for communication with the outside of the vehicle, etc., and may acquire data or information. Then, each virtual image display device (A, B) may use the acquired data or information to generate image light for displaying information and project the image light.

[0025] It should be noted that each of the virtual image display devices (A, B) can omit communication with the controller 100. Here, each of the virtual image display devices (A, B) can acquire data or information from a configuration different from the controller 100 through communication based on, for example, CAN, in-vehicle Ethernet, or the like.

[0026] Alternatively, the controller 100 may generate video data using the acquired data or information, transmit the generated video data to the virtual image display device A and / or the virtual image display device B, and the virtual image display device that receives the video data may generate video light for displaying information based on the video data generated by the controller 100 and project the video light. Alternatively, the controller 100 may not generate video data, but an video generation unit may generate video data and transmit the generated video data to the virtual image display device A and / or the virtual image display device B. Here, the controller 100 and the virtual image display devices (A, B) may communicate based on, for example, FPD-Link III or GMSL (Gigabit Multimedia Serial Link), and the virtual image display devices (A, B) may acquire the video data from the controller 100.

[0027] Furthermore, the virtual image display devices (A, B) perform appropriate image processing on the acquired image data. The image processing includes, for example, image distortion correction, color correction, brightness correction, contrast correction, and conversion (e.g., decoding). The image data may be stored in advance in a storage device of the controller 100 or the virtual image display devices (A, B), or may be processed in real time without being stored in a storage device. When the image data is stored in advance in a storage device of the controller 100 or the virtual image display devices (A, B), the stored image data may be changed successively by a system update or a user operation, by wired or wireless methods, or the like.

[0028] As explained above, each virtual image display device (A, B) may be connected to various sensors mounted on the vehicle, devices mounted on the vehicle 2 (for example, a car navigation system), communication devices used for communication with the outside of the vehicle, etc., and may acquire data or information through communication based on CAN, in-vehicle Ethernet, etc. Then, each virtual image display device (A, B) may generate image light for displaying information based on the acquired information, and project the image light.

[0029] Furthermore, the controller 100 may control the virtual image display devices (A, B) in a coordinated manner. That is, the virtual image display devices (A, B) may operate in a coordinated manner via the controller 100. On the other hand, the virtual image display devices (A, B) may operate without the intervention of the controller 100. For example, the virtual image display devices (A, B) may be connected to each other, and the operation of one virtual image display device may be controlled by the other virtual image display device (more specifically, by a control unit of this virtual image display device).

[0030] Information such as the vehicle information 4 is acquired using devices such as cameras and various sensors, etc. Fig. 2 shows an example in which the controller 100 is connected to various devices.

[0031] The vehicle speed sensor 501 detects the speed of the vehicle 2 and is used to generate speed information as the detection result. The shift position sensor 502 detects the current gear and is used to generate gear information as the detection result. The steering wheel angle sensor 503 detects the current steering wheel angle and is used to generate steering wheel angle information as the detection result.

[0032] The headlight sensor 504 detects, for example, whether the headlights are on or off. The headlight sensor 504 may also detect the brightness of the headlights when they are on. The headlight sensor 504 is used to generate lamp lighting information, which is the detection result. The vehicle 2 may also be provided with a high / low sensor that detects the high beam or low beam state of the headlights, and the high / low sensor is used to generate information indicating the high beam or low beam. The vehicle 2 may also be provided with a tail lamp sensor (not shown). The tail lamp sensor detects, for example, whether the tail lamps are on or off. The tail lamp sensor may also detect the brightness of the tail lamps when they are on. The tail lamp sensor is used to generate lamp lighting information, which is the detection result. Similarly, although not shown, sensors that detect the on / off and lighting brightness of stop lamps, backup lamps, hazard lamps, and turn signals may also be provided.

[0033] The illuminance sensor 505 and the chromaticity sensor 506 detect external light from the vehicle 2 and are used to generate external light information, which is the detection result. The chromaticity sensor 506 may also be used to detect the background color of the projection surface and generate projection surface color information, which is the detection result. The distance measurement sensor 507 detects the distance between the vehicle 2 and an external object or the distance between external objects and is used to generate distance information, which is the detection result. The infrared sensor 508 detects the presence or absence of an object in the vicinity of the vehicle and the distance, etc., and is used to generate infrared information, which is the detection result. The engine start sensor 509 detects whether the engine is on or off and is used to generate ON / OFF information, which is the detection result.

[0034] The vehicle operation switches 511 are various switches operated by the driver or the like, and are used to generate operation information such as ON / OFF of these switches. The vehicle operation switches 511 relate to steering switches, switches on the dashboard, vehicle door switches, switches on the armrest, switches on the center console, etc.

[0035] The communication unit 520 is configured to implement a communication protocol and to be used for communication inside the vehicle, communication outside the vehicle, etc. Note that the communication unit 520 may be configured to include a communication line or the like.

[0036] The acceleration sensor 512 and the gyro sensor 513 detect the acceleration and angular velocity of the vehicle 2 and are used to generate acceleration gyro information that indicates the attitude and behavior of the vehicle 2. The temperature sensor 514 detects the temperature inside and outside the vehicle and is used to generate temperature information that is the detection result.

[0037] The wireless transceiver 515 for road-to-vehicle communication generates road-to-vehicle communication information through road-to-vehicle communication between the vehicle 2 and roads, signs, traffic lights, etc. The wireless transceiver 516 for vehicle-to-vehicle communication generates vehicle-to-vehicle communication information through vehicle-to-vehicle communication between the vehicle 2 and other surrounding vehicles. The wired and wireless communication unit 517 for mobile terminal-to-vehicle communication is a device that acquires information through wired communication or wireless communication from a device connected to the LTE network (e.g., a WiFi device). The controller 100 or the control unit can acquire information transmitted and received over the LTE network via the wired and wireless communication unit 517 for mobile terminal-to-vehicle communication.

[0038] The GPS receiver 518 generates GPS information by receiving GPS signals from GPS satellites. For example, the current time, latitude, and longitude can be acquired by the GPS receiver 518. The VICS receiver 519 generates VICS information by receiving VICS signals. The VICS signals here include traffic congestion information and weather information from radio beacons and optical beacons. The GPS receiver 518 and the VICS receiver 519 may be provided as part of a navigation system.

[0039] In-vehicle camera 531 and exterior camera 532 capture images of the interior and exterior of the vehicle, and are used to generate in-vehicle camera image information and exterior camera image information. Specifically, in-vehicle camera 531 is, for example, a camera for a DMS (Driver Monitoring System) that captures the driver's posture, eye position, movement, etc. In this case, the driver's fatigue level, eye position, etc. can be ascertained by analyzing the captured images.

[0040] The voice of the driver is input to the voice input device 541, and the voice input device 542 is used to generate voice information. By emitting voice, the driver can input operation details via the voice input device 541. The voice output device 542 is, for example, a device that outputs voice processed by the controller 100 or the control unit.

[0041] The image generating unit 510 may generate image information based on information acquired from each sensor, information from a mobile terminal, information from the Internet, or the like, or may generate image information based on information acquired by the controller 100. Information other than that related to the vehicle includes information from a mobile terminal, information from the Internet, and the like.

[0042] The controller 100 or the processor may, for example, transmit and receive data or information via wireless communication and acquire information necessary for driving. The controller 100 or the processor may also acquire information necessary for autonomous driving. The controller 100 or the processor may also, for example, transmit and receive data or information via wireless communication and perform update processing of the data or information. The controller 100 or the processor may, for example, update various data or information (map data, data used for video processing, software, etc.) as update processing. Such technology is sometimes called OTA (Over the Air) technology.

[0043] Controller 100 may be configured as a function for generating images, in which case image generation unit 510 may be omitted.

[0044] The video generation unit 510 may generate video data and transmit the generated video data. Here, the video generation unit 510 may perform processing using a control function. Alternatively, the video generation unit 510 may be controlled by the controller 100.

[0045] The controller 100 may acquire signals from various devices and transmit them to the virtual image display devices (A, B). The virtual image display devices (A, B) may then generate video data based on the received signals and display an image. On the other hand, the controller 100 may transmit video data to the virtual image display devices (A, B), and the virtual image display devices (A, B) may display an image based on the received video data.

[0046] 2, and can acquire information directly without going through the controller 100. The virtual image display devices (A, B) may then generate image data based on the acquired information and display an image.

[0047] The various devices in FIG. 2 can be deleted, or other types of devices can be added or replaced with other types of devices as appropriate.

[0048] An example of the configuration of the virtual image display device A will be described with reference to Fig. 3. In Fig. 3, the virtual image display device A includes, for example, a microcontroller (MCU) 1010, a nonvolatile memory 1011, a volatile memory 1012, a communication processing unit 1014, an image processing unit 1016, a light source driving unit 1021, a display driver 1022, and a mobile terminal communication unit 4001, all of which are mounted on a wiring board or the like. In the example of Fig. 3, the communication processing unit 1014 is a device equipped with a communication interface, is connected to a transmission path 202, and communicates main vehicle information 4, but may also function as a control unit of the virtual image display device A. In addition, various types of information (e.g., image information), control signals, and the like may be input to the communication processing unit 1014 from the controller 100 via the transmission path 202.

[0049] The image processing unit 1016 processes image data that determines the display content of the display image to be projected on the display area of ​​FIG. 1 or the like, based on the acquired information. Here, the image processing unit 1016 may generate an image based on various information acquired from the outside. Alternatively, the image processing unit 1016 may receive image information or image data generated by the controller 100 or the image generation unit 510 of the vehicle 2. In this case, the image processing unit 1016 does not generate an image, but processes the image received from the vehicle 2. The processing by the image processing unit 1016 includes processes such as image distortion correction and conversion (e.g., decoding).

[0050] The communication processing unit 1014 may be configured to have two types of interfaces. That is, the communication processing unit 1014 may be configured to have an interface dedicated to receiving video information and a communication interface used for communicating other information and data.

[0051] Furthermore, the virtual image display device A may be configured to omit the image processing unit 1016 and to be specialized in displaying an externally generated image. In this case, the communication processing unit 1014 may also be configured to include an interface dedicated to receiving image information and a communication interface used for communicating other information and data.

[0052] The mobile terminal communication unit 4001 includes a communication interface, and acquires information via the communication path 600 from the device 400 (for example, a WiFi device) connected to the LTE network by wired communication or wireless communication.

[0053] As is widely known, the MCU 1010 includes a processor such as a CPU (Central Processing Unit), a memory, and various peripheral functions. Therefore, each block except for the MCU 1010 may be appropriately mounted within the MCU 1010. Furthermore, the virtual image display device A is not limited to being implemented using the MCU 1010, but may be implemented using an ECU or other semiconductor devices. The control structure shown in FIG. 3 may be, for example, a control unit mounted within the housing of the virtual image display device A, or a control unit mounted outside the housing. On the other hand, the virtual image display device A may not have a control unit and may be controlled by a vehicle controller.

[0054] The non-volatile memory 1011 mainly stores in advance programs executed by the CPU in the MCU 1010, setting parameters used in the processing of each unit in the MCU 1010, specified audio data, video data, etc. The volatile memory 1012 mainly stores acquired information and various data used in the processing of each unit in the MCU 1010 as appropriate.

[0055] 3 may be implemented as a dedicated circuit such as a field programmable gate array (FPGA) etc. In this embodiment, the control device is configured to have a non-volatile memory 1011 and a volatile memory 1012, but the above processing may be performed by a single memory.

[0056] The display driver 1022 drives each display element (pixel) included in the display panel 12 based on the video data. As a result, the image forming unit 10 creates and displays an image to be projected onto the display area based on the video data. Specifically, the distortion correction corrects image distortion caused by the curvature of the windshield 3 when an image from the virtual image display device A is projected onto the display area 5a, as shown in FIG. 1. The display driver 1022 then drives each display element (pixel) included in the display panel 12 based on the corrected video data. As a result, the image forming unit 10 creates and displays an image to be projected onto the display area based on the corrected video data.

[0057] Furthermore, the light source driving unit 1021 can adjust the light source, and the light source driving unit 1021 adjusts the brightness of the light source device 11 in the image forming unit 10. For example, the light source device 11 is controlled using the vehicle information 4 received via the communication processing unit 1014 and the light source driving unit 1021, which is a driver used to drive the light source.

[0058] Furthermore, the virtual image display device A may protect the display panel 12 based on external light information from the illuminance sensor 505. That is, in order to prevent the display panel 12 from being burned due to exposure to sunlight, the virtual image display device A may perform an operation to protect the panel from sunlight according to the value of the illuminance sensor 505. More specifically, when the intensity of external light or sunlight acquired by the illuminance sensor 505 is strong and there is a risk of the display panel 12 being burned, the luminance of the light source device 11 in the image forming unit 10 is reduced, and the amount of light from the light source device 11 that is incident on the display panel 12 is suppressed, thereby suppressing a rise in temperature of the display panel 12.

[0059] 3, the virtual image display device A may be configured to display an image using the light source device 11 as a backlight for the display panel 12. However, the virtual image display device A may be configured to omit the light source device 11. In other words, the virtual image display device A may be configured to have mini LEDs, micro LEDs, or the like in the display panel 12, and the pixels themselves may emit light.

[0060] Next, a configuration example of the virtual image display device B will be described with reference to Fig. 4. In Fig. 4, the virtual image display device B includes, for example, a microcontroller (MCU) 1010, a nonvolatile memory 1011, a volatile memory 1012, a communication processing unit 1014, an image processing unit 1016, a light source driving unit 1021, a display driver 1022, and a mobile terminal communication unit 4001. The virtual image display device B also includes an image forming unit 10. Note that these configurations are the same as those described with reference to Fig. 3. Therefore, a detailed description thereof will be omitted.

[0061] 4, the virtual image display device B has an optical element 21 and a mirror 22 as an optical system for projecting image light onto the display region 5b. The optical element 21 is, for example, a lens, and corrects distortion aberration in accordance with the shape of the mirror 22 by adjusting the direction of light emission to the mirror 22. In this way, the optical element 21, which is optimally designed to improve aberration correction capability, may be provided between the mirror 22 and the image forming unit 10.

[0062] The virtual image display device B also includes a mirror driver 1020. The mirror driver 1020 is a device that adjusts the orientation of the mirror 22 based on control from the controller 100 or a control unit of the virtual image display device B. The orientation of the mirror 22 is adjustable so that the height of the display position can be changed in the vertical direction of the vehicle 2.

[0063] Next, an example of the arrangement of the virtual image display device A and the virtual image display device B in a vehicle will be described with reference to FIG. 5. The virtual image display device B is arranged inside a dashboard 2A of the vehicle 2, and an opening is formed in the upper part of the dashboard 2A through which the image light 1b emitted by the virtual image display device B passes. Note that a cover or the like that is capable of transmitting the image light 1b may be provided in this opening. On the other hand, the virtual image display device A is arranged on the dashboard 2A of the vehicle 2, and is arranged forward of the position where the image light 1b of the virtual image display device B is emitted from the dashboard 2A (i.e., the opening in the upper part of the dashboard 2A). Note that the figure shows a steering wheel 2B as a configuration related to the vehicle 2. Also shown is wiring 2C arranged on the steering wheel 2B side in the dashboard 2A.

[0064] With this arrangement of the virtual image display devices, the image light (1a, 1b) emitted by the virtual image display device A and the virtual image display device B is reflected by the windshield 3, forming virtual images (9A, 9B) by the virtual image display device A and the virtual image display device B. In the longitudinal direction of the vehicle, the display position of the virtual image in the depth direction depends on the length of the optical path; the longer the optical path, the further back (farther away) the virtual image is formed as viewed by the driver 6. In the example of FIG. 5, the optical path of the image light 1b from the virtual image display device B to the windshield 3 is longer than the optical path of the image light 1a from the virtual image display device A to the windshield 3. Therefore, in the longitudinal direction of the vehicle, the virtual image 9B from the virtual image display device B is formed further back than the virtual image 9A from the virtual image display device A as viewed by the driver 6.

[0065] Next, the visibility of the image will be described with reference to FIG. 6. The symbol R in the figure indicates an example of a virtual image visible range of one virtual image display device. This virtual image visible range is a range based on a predetermined setting value, and relates to the entire range in which display is possible. Note that this setting value relates to, for example, size and height position. Furthermore, the virtual image visible range is set for each virtual image display device.

[0066] (1) When the driver's eyes are at position A and their line of sight is in the direction indicated by the dotted line extending from eye position A, that is, when the driver looks downward ahead from eye position A, the driver can see the virtual image displayed in the range from the bottom of 3 to the top of 5, which is the lower part of the virtual image visible range R, and position 4 in particular is the optimal position for viewing the virtual image. Conversely, when the driver's eyes are at position A, it is difficult for the driver to see the virtual image displayed in the range from the bottom of 1 to the top of 3, which is the virtual image visible range R. From a similar perspective, (2) when the driver's eyes are at position C and their line of sight is in the direction indicated by the dotted line extending from eye position C, that is, when the driver looks upward ahead from eye position C, the driver can see the virtual image displayed in the range from the bottom of 1 to the top of 3, which is the upper part of the virtual image visible range R, and position 2 in particular is the optimal position for viewing the virtual image. Conversely, when the driver's eyes are at position C, it is difficult for the driver to view the virtual image displayed in the range from the bottom of 3 to the top of 5 in the virtual image visible range R. Also, (3) when the driver's eyes are at position B and the line of sight is in the direction indicated by the dotted line extending from eye position B, that is, when the driver looks in a substantially horizontal direction (substantially forward direction) from eye position B, the driver can view the virtual image displayed in the range from the bottom of 2 to the top of 4, which is the central part of the virtual image visible range R, and position 3 in particular is the optimal position for viewing the virtual image. Conversely, when the driver's eyes are at position B, it is difficult for the driver to view the virtual images displayed in the range from the bottom of 1 to the top of 2 and from the bottom of 4 to the top of 5 in the virtual image visible range R. In FIG. 6, the height levels of the virtual image visible range R are indicated by circled numbers.

[0067] Therefore, from the viewpoints of (1) to (3) above, the display position (height) of the virtual image is adjusted in the vertical direction of the vehicle according to the position of the driver's eyes or the direction of the line of sight from the eye position, thereby making it possible to display a virtual image that is easy for the driver to see.

[0068] 7A and 7B, a description will be given of the position adjustment of the virtual image visible range for the virtual image display device A. In this example, the virtual image display device A is provided on the dashboard 2A so that its position can be adjusted.

[0069] The virtual image display device A is configured so that its position can be adjusted on the dashboard 2 A. Furthermore, for example, the virtual image display device A may be provided in the vehicle 2 so that its position can be changed in a plurality of stages.

[0070] The driver or the like may, for example, hold the virtual image display device A and adjust its position, or may adjust its position manually. The vehicle 2 may also be provided with a mechanism for automatically controlling the movement of the virtual image display device A. Note that the driver or the like performs operation input related to the movement control of the virtual image display device A using an appropriate operation device. Here, examples of the operation device include a switch, a remote controller, and a device connected to the vehicle 2.

[0071] As shown in FIG. 7A, for example, by moving virtual image display device A in the forward direction of the vehicle (i.e., in the direction away from the driver's eye position 6), the reflection position of the image light on the windshield 3 moves downward. As a result, the position of the virtual image visible range RA for virtual image display device A moves downward. Such movement of virtual image display device A is necessary, for example, when the driver's eye position 6 is in a relatively high position and, when looking at the virtual image from that position, part of the virtual image is cut off or the virtual image cannot be seen, in which case the virtual image display device A is moved to adjust the position to make the virtual image more easily visible. In this case, the display position of the virtual image is adjusted downward in the vertical direction of the vehicle.

[0072] 7B, when virtual image display device B moves toward the rear of the vehicle (i.e., in the direction approaching from the driver's eye position 6), the reflection position of the image light on the windshield 3 moves upward. As a result, the position of the virtual image visible range RA for virtual image display device A moves upward. Such movement of virtual image display device A is necessary, for example, when the driver's eye position 6 is in a relatively low position and, when looking at the virtual image from that position, part of the virtual image is cut off or the virtual image cannot be seen, in which case virtual image display device A is moved to adjust the position to make the virtual image more easily visible. In this case, the display position of the virtual image is adjusted upward in the vertical direction of the vehicle.

[0073] Next, with reference to Figures 8A and 8B, a description will be given of the position adjustment of the virtual image visible range for the virtual image display device B. As shown in Figures 8A and 8B, in the virtual image display device B, the tilt angle of the mirror 22 can be changed by a mirror driver 1020. By changing the tilt angle of the mirror 22, the reflection position of the image light on the windshield 3 is adjusted, and as a result, the position of the virtual image visible range RB for the virtual image display device B can be adjusted in the vertical direction.

[0074] The installation orientation of the virtual image display device B may be determined according to the tilt angle of the windshield 3. For example, as shown in FIG. 8B , when the windshield 3 is installed substantially vertically (for example, when the vehicle 2 is a truck or a bus), the virtual image display device B is installed in an orientation such that image light is emitted from the image forming unit 10 toward the rear of the vehicle, and the emitted image light is reflected by the mirror 22 and then reflected by the windshield 3. This allows the virtual image to be displayed favorably at a position visible from the driver's eye position 6. Furthermore, a structure is realized that allows the position of the virtual image visible range RB to be easily adjusted by changing the tilt angle of the mirror 22.

[0075] On the other hand, as shown in Fig. 8A, when the windshield 3 is installed at an angle (for example, when the vehicle 2 is a sedan-type automobile), the virtual image display device B is installed in a direction in which image light is emitted from the image forming unit 10 toward the front of the vehicle. As in Fig. 8B, a virtual image is displayed using the emitted image light, and the position of the virtual image visible range RB can be adjusted by changing the tilt angle of the mirror 22. However, because the installation direction of the virtual image display device B is reversed from that in Fig. 8B, the tilt direction of the mirror 22 when adjusting the position of the virtual image visible range RB is also reversed (when the mirror 22 is tilted in the same direction, the movement direction of the virtual image visible range RB is reversed in Figs. 8A and 8B).

[0076] 9, the display relationship between the virtual image display device A and the virtual image display device B will be described. In this example, one virtual image display device A and one virtual image display device B are mounted on the vehicle 2.

[0077] As shown in FIG. 9A , a virtual image IA based on virtual image display device A is output. When the virtual image IA is displayed within a virtual image visible range RA related to virtual image display device A, the driver can view the virtual image IA. Similarly, when a virtual image IB based on virtual image display device B is output and the virtual image IB is displayed within a virtual image visible range RB related to virtual image display device B, the driver can view the virtual image IB. Note that in the example of FIG. 9A , the widths of the two virtual image visible ranges are shown as RA > RB, but this is not limiting and RA = RB or RB > RA may also be satisfied. Here, if the amount of displayed information is small as viewed from the driver, the respective virtual image visible ranges (RA, RB) may overlap. Alternatively, the respective virtual image displays (IA, IB) may not overlap as viewed from the driver. FIG. 9B is a diagram illustrating the positional relationship between a virtual image IA based on virtual image display device A and a virtual image IB based on virtual image display device B. As shown in FIG. 9B , the virtual images IA and IB are displayed at positions where they do not overlap as viewed from the driver. In addition, Figures 9A and 9B show an example in which the depth positions of virtual image IA and virtual image IB are different in the fore-and-aft direction of the vehicle, with virtual image IA being displayed closer to the driver and virtual image IB being displayed farther from the driver, but the depth positions of the two virtual images are not limited to this example, and virtual image IA may be displayed farther from the driver and virtual image IB may be displayed closer to the driver.

[0078] Next, the display relationship between the virtual image display devices (A1, A2) and the virtual image display device B will be described with reference to FIG. 10. In this example, two virtual image display devices (A1, A2) and one virtual image display device B are mounted on a vehicle 2. Here, each virtual image display device (A1, A2) has the same configuration as the virtual image display device A. Each virtual image display device (A1, A2) is arranged on a dashboard 2A so that images can be displayed at different positions in the left and right directions in the width direction of the vehicle.

[0079] 10A, when a virtual image IA1 based on the virtual image display device A1 is output and the virtual image IA1 is displayed within a virtual image visible range RA1 related to the virtual image display device A1, the driver can view the virtual image IA1. Similarly, when a virtual image IA2 based on the virtual image display device A2 is output and the virtual image IA2 is displayed within a virtual image visible range RA2 related to the virtual image display device A2, the driver can view the virtual image IA2. Furthermore, when a virtual image IB based on the virtual image display device B is output and the virtual image IB is displayed within a virtual image visible range RB related to the virtual image display device B, the driver can view the virtual image IB. As shown in the figure, when three virtual image visible ranges (RA1, RA2, RB) partially overlap or overlap, the driver may be able to view the three virtual images (IA1, IA2, IB) simultaneously. Here, as shown in the figure, for example, a virtual image IA (in this example, virtual image IA1) of one virtual image display device A (in this example, virtual image display device A1) may overlap with a virtual image IB of virtual image display device B. Therefore, as shown in FIG. 10B, by adjusting the virtual images (IA1, IA2, IB) output from the respective virtual image display devices (A1, A2, B) so that they do not overlap as viewed by the driver, a good display can be provided for the driver.

[0080] Next, with reference to FIG. 11, the relationship between the virtual image visible range and the depth and height of the display position will be described in detail. As shown in FIG. 11A, at the position of the driver's eye 6, a virtual image visible range RA, which is a range in which the virtual image IA output by the virtual image display device A can be viewed, and a virtual image visible range RB, which is a range in which the virtual image IB output by the virtual image display device B can be viewed, are formed. The driver can view the virtual image IA when his / her line of sight is within the virtual image visible range RA, and can view the virtual image IB when his / her line of sight is within the virtual image visible range RB. Furthermore, when the virtual image visible range RA and the virtual image visible range RB overlap and the driver's line of sight is within the overlapping range, the driver can simultaneously view the virtual image IA and the virtual image IB. Furthermore, the virtual image display device A can change the height of the virtual image visible range RA in steps indicated by 1 to 3, and the virtual image display device B can change the height of the virtual image visible range RB in steps indicated by 1 to 9. The height levels of the virtual image visible ranges of virtual image display device A and virtual image display device B are not limited and can be set manually or automatically. By changing the heights of the virtual image visible ranges RA and RB depending on the height of the driver's eyes 6, it is possible to make the virtual images IA and IB visible regardless of the height of the driver's eyes. In FIG. 11A, the height levels of the virtual image visible ranges (RA, RB) are indicated by circled numbers.

[0081] Here, as shown in FIG. 11B , for example, there is a case where the virtual image viewable range RA for virtual image display device A is at the height indicated by 1, the virtual image display IA for virtual image display device A is performed at the height indicated by (B), the virtual image viewable range RB for virtual image display device B is at the height indicated by 1, and the virtual image display IB for virtual image display device B is performed at the height indicated by (A). In this situation, the driver's line of sight is within the virtual image viewable ranges RA and RB, so the respective virtual image displays (IA, IB) can be viewed simultaneously. On the other hand, since the virtual image IA is at the center position (height indicated by (B)) in the virtual image viewable range RA and the virtual image IB is at a relatively low position (height indicated by (A)) in the virtual image viewable range RB, the display heights of the virtual images IA and IB overlap in the virtual image viewable range. Therefore, the two virtual images appear to overlap to the driver, resulting in reduced visibility of the virtual images. Note that in FIG. 11B , the display positions of the virtual images are indicated by capital letters in parentheses.

[0082] Therefore, by adjusting the virtual image display position so that the virtual image display IA related to virtual image display device A and the virtual image display IB related to virtual image display device B do not overlap, the visibility of the virtual images can be improved. For example, when the height of the virtual image display IA related to virtual image display device A is (B), changing the height of the virtual image display IB related to virtual image display device B from (A) to (E) eliminates the overlap of the virtual image displays (IA, IB) in the driver's line of sight, improving the visibility of the displays. Also, when the height of the virtual image display IB related to virtual image display device B is (A), changing the height of the virtual image display IA related to virtual image display device A to (C) prevents the overlap of the displays (IA, IB) in the driver's line of sight, improving the visibility of the virtual images. Of course, when the height of the virtual image display is changed, the height of the virtual image visible range is also adjusted so that the driver can view the virtual image displayed at the changed height.

[0083] Next, with reference to FIG. 12, an example of the usage status of the virtual image display device A and the virtual image display device B, the virtual image visible range, and a display control method will be described.

[0084] As shown in FIG. 12-1, for example, when virtual image display device A and virtual image display device B are used, first, the height of the virtual image viewable range (RA, RB) for each virtual image display device (A, B) is adjusted so that the driver can simultaneously view the displays (IA, IB) of virtual image display device A and virtual image display device B. Next, display control is performed so that the virtual image displays (IA, IB) do not overlap with each other from the driver's or operator's eyes. Alternatively, after adjusting the virtual image viewable ranges of virtual image display device A and virtual image display device B, the display height of the virtual image is adjusted. The order in which virtual image display device A and virtual image display device B are adjusted is not particularly limited, and virtual image display device A may be adjusted first, or virtual image display device B may be adjusted first.

[0085] 12-2, when virtual image display device A is used and virtual image display device B is not used, the driver adjusts the height of the virtual image visible range RA of virtual image display device A to the height of the driver's line of sight, and display control is performed for virtual image display device A. In this example, since virtual image display device B is not used (virtual image display IB does not exist), overlapping of the displays of IA and IB does not need to be taken into consideration when controlling the display of virtual image display IA.

[0086] 12-3, when virtual image display device B is used and virtual image display device A is not used, the driver adjusts the height of the virtual image visible range RB of virtual image display device B to the height of the driver's line of sight, and display control is performed for virtual image display device B. In this example, since virtual image display device A is not used (virtual image display IA does not exist), overlapping of the displays of IA and IB does not need to be taken into consideration when controlling the display of virtual image display IB.

[0087] 12 has described a display control method using a combination of one virtual image display device A and one virtual image display device B. Here, for example, when a plurality of virtual image display devices A (e.g., virtual image display device A1 and virtual image display device A2) and one virtual image display device B are installed in vehicle 2, the virtual image visible ranges (RA1, RA2, RB) of the respective virtual image display devices (A1, A2, B) used for video display may be adjusted, and then display control may be performed so that the respective displays (IA1, IA2, IB) do not overlap with each other from the driver's eyes. Also, for example, when a plurality of virtual image display devices A and a plurality of virtual image display devices B are installed in vehicle 2, the virtual image visible ranges of the respective virtual image display devices used for video display may be adjusted, and then display control may be performed so that the respective displays do not overlap with each other from the driver's eyes.

[0088] 13A, an example of data used in adjusting the virtual image displayed by the virtual image display device A will be described. In this example, the virtual image display device A is provided in the vehicle 2 so that its position can be changed in multiple steps in the front-to-rear direction (±Y direction) on the dashboard 2A.

[0089] A storage device referenced by the controller 100 or the control unit of the virtual image display device A stores data on the virtual image visible range RA or an adjustment range of the virtual image visible range RA, for example, a setting value related to height steps. Specifically, in this example, a setting value indicating that the virtual image visible range RA has a horizontal×vertical size of 5×7 (for example, in units of degrees) is stored. Also, in this example, the height step of the virtual image visible range RA is initially set to 1. However, the virtual image visible range RA can be changed in three height steps, and a setting value indicating the current height step of the virtual image visible range RA is stored.

[0090] The controller 100 or the control unit of the virtual image display device A refers to the set value and sets the virtual image visible range RA according to the set value. In this embodiment, the smaller the height step, the lower the virtual image visible range RA is located, and the larger the height step, the higher the virtual image visible range RA is located. On the other hand, the upper height step may be set to be larger and the lower height step to be smaller. In other words, the height step of the virtual image visible range RA is changed according to the position of the driver's eyes, and the virtual image visible range RA is adjusted so that it is positioned so that the driver can preferably view the virtual image.

[0091] Furthermore, a storage device referenced by the controller 100 or the control unit of the virtual image display device A stores data on the size of the display range and a setting value related to the range used for display (display range). Specifically, in this example, a setting value indicating that the display range is 4×1 (for example, in units of degrees) in horizontal×vertical dimensions is stored. Furthermore, in this example, when the height level of the virtual image visible range RA is 1 (level 1), a setting value that allows virtual image display in a height range of 0 to 1 is stored. When the height level of the virtual image visible range RA is 2 (level 2), a setting value that allows virtual image display in a height range of 1 to 2 is stored. When the height level of the virtual image visible range RA is 3 (level 3), a setting value that allows display in a height range of 2 to 3 is stored.

[0092] The controller 100 or the control unit of the virtual image display device A refers to the setting value and sets it within the setting value range. For example, after initially setting a default value within the setting value range, the setting may be adjusted within the setting value range according to the user's preferences, etc. The height of the virtual image visible range and the height of the virtual image display correspond to each other, and when the virtual image display is set to a high position, the virtual image visible range is also controlled to move to a high position, and when the height of the virtual image display is set to a low position, the virtual image visible range is also controlled to move to a low position. Then, the controller 100 or the control unit of the virtual image display device A displays information in the set display position or range. Note that the setting value of the display range shown in the figure is an example, and setting values ​​such as those described below may be stored.

[0093] Furthermore, data relating the position of the virtual image display device A to the display position at that time is stored in a storage device referenced by the controller 100 or the control unit of the virtual image display device A. In this example, when the virtual image display device A is installed at position 1, data is stored that allows display corresponding to height step 1 of the virtual image visible range RA. When the virtual image display device A is installed at position 2, data is stored that allows display corresponding to height step 2 of the virtual image visible range RA. When the virtual image display device A is installed at position 3, data is stored that allows display corresponding to height step 3 of the virtual image visible range RA. In other words, the three height levels of the virtual image visible range are determined by the three positions of the virtual image display device A on the dashboard.

[0094] The controller 100 or the control unit of the virtual image display device A acquires the installation position of the virtual image display device A. Then, the controller 100 or the control unit of the virtual image display device A refers to the data and performs a display corresponding to the installation position.

[0095] Next, an example of data used in controlling the virtual image display device B will be described with reference to FIG. 13B.

[0096] Data on the virtual image visible range RB and setting values ​​relating to the height levels of the virtual image visible range RB are stored in a storage device referenced by the controller 100 or the control unit of the virtual image display device B. Specifically, in this example, a setting value indicating that the virtual image visible range RB has a horizontal×vertical size of 4×2 is stored. Also, in this example, the height level of the virtual image visible range RB is initially set to 4. However, the virtual image visible range RB can be changed in nine height levels, and a setting value indicating the current height level of the virtual image visible range RB is stored.

[0097] The controller 100 or the control unit of the virtual image display device B refers to the setting value and sets the virtual image visible range RB according to the setting value. For example, after initially setting a default value (initial setting value) within the setting value range, the setting may be adjusted within the setting value range according to the user's preference, etc. The height of the virtual image visible range and the height of the virtual image display correspond to each other, and the virtual image visible range is controlled to move to a higher position when the virtual image display is set to a higher position, and vice versa when the height of the virtual image display is set to a lower position. Note that the smaller the height step, the lower the virtual image visible range RB is located, and the larger the height step, the higher the virtual image visible range RB is located.

[0098] Furthermore, a storage device referenced by the controller 100 or the control unit of the virtual image display device B stores data on the size of the display range and a setting value related to the range used for display (display range). Specifically, in this example, a setting value indicating that the display range is 4×2 in horizontal×vertical dimensions is stored. Furthermore, in this example, when the height level of the virtual image visible range RB is 1 (level 1), a setting value that allows display in a height range of 0 to 2 is stored. When the height level of the virtual image visible range RB is 2 (level 2), a setting value that allows display in a height range of 1 to 3 is stored. When the height level of the virtual image visible range RB is 3 (level 3), a setting value that allows display in a height range of 2 to 4 is stored. When the height level of the virtual image visible range RB is 4 (level 4), a setting value that allows display in a height range of 3 to 5 is stored. When the height level of the virtual image visible range RB is 5 (level 5), a setting value that allows display in a height range of 4 to 6 is stored. When the height level of the virtual image visible range RB is 6 (level 6), a set value that allows display in a height range of 5 to 7 is stored. When the height level of the virtual image visible range RB is 7 (level 7), a set value that allows display in a height range of 6 to 8 is stored. When the height level of the virtual image visible range RB is 8 (level 8), a set value that allows display in a height range of 7 to 9 is stored. When the height level of the virtual image visible range RB is 9 (level 9), a set value that allows display in a height range of 8 to 10 is stored.

[0099] Furthermore, a storage device referenced by the controller 100 or the control unit of the virtual image display device B stores data relating to information on the rotation of the mirror 22 used to adjust the virtual image visible range RB and the virtual image display position of the virtual image display device B, and the display position at that time. In this example, when a display is performed at a height level of 1 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 100 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 2 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 200 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 3 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 300 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 4 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 400 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 5 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 500 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 6 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 600 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 7 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 700 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 8 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 800 rotations in the forward direction from the reference rotation position is stored. In this example, when a display is performed at a height level of 9 in the virtual image visible range RB, data indicating an orientation in which the mirror 22 is rotated 900 rotations in the forward direction from the reference rotation position is stored.

[0100] The reference rotation position (reference rotation position) of mirror 22 is an orientation in which mirror 22 does not reflect image light from image forming unit 10, and when mirror 22 rotates in the forward direction from this reference rotation position, image light is incident on the reflective surface of mirror 22 and is reflected. Furthermore, the magnitude of the number of rotations per one rotation (i.e., the rotation angle per one rotation) can be determined appropriately depending on, for example, the configuration of virtual image display device B (such as the arrangement of image forming unit 10 and the size of mirror 22).

[0101] When the virtual image display device B is not in use, the virtual image display device B may be in a protected state to protect the display panel 12 from sunlight. In the protected state, the mirror 22 is oriented so that sunlight does not penetrate the reflective surface. In this example, data is stored indicating that in the protected state, the mirror 22 is oriented in a direction rotated 150 rotations in the negative direction from the reference rotation position.

[0102] The controller 100 or the control unit of the virtual image display device B acquires the current setting value of the virtual image visibility range RB. Then, the controller 100 or the control unit of the virtual image display device B controls the rotation of the mirror 22 to display the virtual image so that the virtual image can be displayed at a position corresponding to the acquired virtual image visibility range RB. When the virtual image display device B is set to the protection state, the controller 100 or the control unit of the virtual image display device B controls the rotation of the mirror 22 to transition to the protection state.

[0103] Note that, when the size of the virtual image visible range is larger than the display range (for example, as shown in FIG. 13A, when the reference size of the virtual image visible range is 5×7 and the reference size of the display range is 4×1), a plurality of display use ranges may be stored for the same height stage of the virtual image visible range. For example, in the setting value of the display range for the virtual image display device A, when the height stage of the virtual image visible range RA is 1, setting values ​​in the ranges of 1 to 2, 2 to 3, 4 to 5, and 6 to 7 may be stored. For example, when the height stage of the virtual image visible range RA is 2, setting values ​​in the ranges of 2 to 3, 4 to 5, 5 to 6, and 6 to 7 may be stored.

[0104] 14A illustrates a basic flow of adjusting the display position of a virtual image. The controller 100 may adjust the virtual image viewable ranges of virtual image display device A and virtual image display device B. The control unit or processor of virtual image display device A may adjust the virtual image viewable range of virtual image display device A, and the control unit or processor of virtual image display device B may adjust the virtual image viewable range of virtual image display device B. Alternatively, the controller 100 may adjust the virtual image viewable range of virtual image display device A, and the control unit or processor of virtual image display device B may adjust the virtual image viewable range of virtual image display device B. The controller 100 may adjust the virtual image viewable range of virtual image display device B, and the control unit or processor of virtual image display device A may adjust the virtual image viewable range of virtual image display device A. In the present invention, control may be performed by a controller on the vehicle side or on the virtual image display device side, and is not limited thereto. 14A, in step S1401a, information on the virtual image visible range RA of the virtual image display device A and information on the virtual image visible range RB of the virtual image display device B are acquired. In this embodiment, the information on the virtual image visible ranges RA and RB includes data on the reference size and height level.

[0105] In step S1402a, it is confirmed whether the virtual image visible range RA of virtual image display device A and the virtual image visible range RB of virtual image display device B, which were acquired in step S1401a, overlap. For example, the user (driver) may confirm whether the displays overlap by visually checking each display. Alternatively, the user's eye position may be detected and the confirmation may be performed automatically based on the detected user's eye position, or the confirmation may be performed automatically by the system. If the displays do not overlap (NO), the process proceeds to step S1404a, where normal display is performed by virtual image display device A and virtual image display device B. On the other hand, if the user confirms that the displays overlap (YES), the process proceeds to step S1403a, where the virtual image visible ranges of virtual image display device A and virtual image display device B are adjusted to change the display positions.

[0106] In this embodiment, the user will be described as making an adjustment. The user determines whether to change the height of the virtual image visible range of each virtual image display device in the vertical direction of the vehicle, and may change the height of the virtual image visible range of only the virtual image display device whose height of the virtual image visible range is to be changed, or may change the height of the virtual image visible range of each virtual image display device. Adjustment is made according to the virtual image visible ranges of the multiple virtual image display devices.

[0107] When the user decides to change the height of the virtual image visible range RA of the virtual image display device A, a setting value related to the content input by the user is acquired, and a process of changing the height level of the virtual image visible range RA is performed. The virtual image display device A may be provided with an operation device used for user operation input. The user may also input operation content using an appropriate operation device and acquire the user operation content via communication. Here, examples of the appropriate operation device include an operation device provided on the steering wheel or console of the vehicle 2, and a device such as a smartphone connected to the vehicle 2. Furthermore, the controller or the control unit of the virtual image display device A can change the height of the virtual image visible range based on the position of the user's eyes.

[0108] When the user decides to change the height of the virtual image visible range RB for the virtual image display device B, a setting value related to the content input by the user is acquired, and a process of changing the height level of the virtual image visible range RB is performed. The user may input the operation content using an appropriate operation device and acquire the user's operation content via communication. Here, examples of the operation device include an operation device provided on the steering wheel or console of the vehicle 2, and a device such as a smartphone connected to the vehicle 2. In addition, the controller or the control unit of the virtual image display device B can change the height of the virtual image visible range based on the position of the user's eyes.

[0109] The virtual image visible range may be adjusted by adjusting the installation position of the virtual image display device or the movement of a component related to virtual image display (for example, rotation of a mirror), or the virtual image visible range may be adjusted by a controller or control unit. For example, if the adjustment range of the height of the virtual image visible range in the vertical direction of the vehicle is high, the installation position or the movement of the component may be adjusted and then the adjustment may be made by the control unit, and all height adjustments may also be made by the control unit.

[0110] Then, normal display is performed by virtual image display device A and virtual image display device B in a state where each virtual image display is visible from the virtual image visible range and is set to be displayed in a position where the virtual image displays do not overlap.

[0111] Next, an example of adjusting the virtual image display position will be described with reference to Fig. 14B. Virtual image display device A and virtual image display device B transition from a standby state to a display state (S1401b). Then, initial settings of the reference size and height level of the virtual image visible range RA of virtual image display device A and the reference size and height level of the virtual image visible range RB of virtual image display device B are acquired (S1402b).

[0112] Then, it is confirmed whether the acquired virtual image display areas of virtual image display device A and virtual image display device B overlap (S1403b). If the virtual image display areas of virtual image display device A and virtual image display device B overlap, the virtual image viewable range RA of virtual image display device A is adjusted (S1404b). If the virtual image display areas of virtual image display device A and virtual image display device B do not overlap, normal display of virtual image display device A and virtual image display device B is started. On the other hand, if the virtual image display areas of virtual image display device A and virtual image display device B do not overlap, adjustment may be necessary. For example, if the distance between the display areas of virtual image display device A and virtual image display device B is too long, making it difficult for the user to see, and adjustment is necessary. In such a case, adjustment of the display areas of virtual image display device A and virtual image display device B is the same as adjustment for overlapping display areas.

[0113] After adjusting the virtual image visible range RA or the display position of virtual image display device A, it is checked again whether the virtual image display areas of virtual image display device A and virtual image display device B overlap (S1405b). If the virtual image display areas do not overlap, normal display operation (if there is an update to the display information, the display content is updated) is performed in a state where the virtual images displayed by virtual image display device A and virtual image display device B do not overlap, in order to eliminate the overlap in the display areas. On the other hand, if the virtual image display areas overlap, the virtual image visible range of virtual image display device A or virtual image display device B is adjusted. The adjustment of virtual image display device A or virtual image display device B is determined based on which is easiest for the user to view.

[0114] After adjusting the height of the virtual image visible range RB of virtual image display device B (S1406b), it is checked again whether the virtual image display areas of virtual image display device A and virtual image display device B overlap (S1407b). If the virtual image display areas do not overlap, the overlap of the display areas is eliminated, and normal display operation (the display content is updated if there is an update to the display information) is performed (S1408b). On the other hand, if the overlap of the virtual image display areas is not eliminated, the above operation is repeated. Here, adjustment of the virtual image visible range of virtual image display device B has been described, but virtual image display device A may be readjusted before adjusting virtual image display device B. The above description is an example of adjusting the virtual image visible range when multiple virtual image display devices are arranged. For example, after adjusting the display areas of virtual image display device A and virtual image display device B, it may be checked whether the two virtual image display areas overlap. Furthermore, when multiple virtual image display devices are arranged, adjustment is made easier by first adjusting the virtual image display device that displays a virtual image display area that is easily visible to the user (driver) and then adjusting the display areas of the remaining virtual image display devices.

[0115] Next, an example of a detailed flow of adjusting the display position will be described with reference to FIG. 14C. In this example, the controller 100 controls the virtual image display device A and the virtual image display device B, which operate in cooperation with each other. As shown in FIG. 14C, the controller 100 transmits to each of the virtual image display device A and the virtual image display device B an instruction signal to cancel the protected state that implements a sunlight protection measure for the display panel 12 (S1401cC). Then, the virtual image display device A and the virtual image display device B receive the instruction signal (S1401cA, S1401cB) and cancel the protected state. Then, the virtual image display device A and the virtual image display device B notify the controller 100 that the protected state has been canceled (S1402cA, S1402cB), and the controller 100 receives the notification (S1402cC).

[0116] Note that it is sufficient to be able to start up virtual image display device A and virtual image display device B, and if the virtual image display devices are not in the protected state, controller 100 may, for example, send a startup preparation processing instruction instead of sending a protection state cancellation instruction. Then, virtual image display device A receives the startup preparation processing instruction signal and, for example, lights up the panel as the startup processing. Also, virtual image display device B receives the startup preparation processing instruction signal and, for example, performs startup processing including driving mirror 22. Then, virtual image display device A and virtual image display device B issue a notification indicating that the startup processing has been completed.

[0117] Next, the controller 100 transmits an instruction to transition to the display state and an initial setting value of the virtual image visible range to each of the virtual image display devices A and B (S1403cC). The virtual image display devices A and B transition to the display state and perform initial setting of the virtual image visible range (S1403cA, S1403cB). Then, the virtual image display devices A and B notify the controller 100 that the processing has been completed (S1404cA, S1404cB), and the controller 100 receives the notification (S1404cC).

[0118] Next, the controller 100 notifies the user whether to change the height of the virtual image visible range from the initial setting (S1405cC). The controller 100 notifies the user by, for example, displaying a message on the virtual image display device A and / or the virtual image display device B.

[0119] If the user selects not to change the height of the virtual image visible range (S1405cC-NO), the user inputs that fact using the operation device, and the controller 100 performs processing described below. On the other hand, if the user selects to change the height of the virtual image visible range (S1405cC-YES), the user inputs a change in the height of the virtual image visible range for virtual image display device A and virtual image display device B using the operation device.

[0120] When the height of the virtual image visible range is changed, the controller 100 transmits to each of the virtual image display devices A and B an instruction to change the height of the virtual image visible range in accordance with the user's input, and a set value of the height of the virtual image visible range. Then, each of the virtual image display devices A and B receives the content transmitted by the controller 100 (S1405cA, S1405cB) and changes the height of the virtual image visible range so that the height of the virtual image visible range becomes the received set value. Then, each of the virtual image display devices A and B notifies the controller 100 that the change of the height of the virtual image visible range has been completed (S1406cA, S1406cB), and the controller 100 receives the notification (S1406cC).

[0121] Next, the controller 100 transmits display content to each of the virtual image display devices A and B (S1407cC). Each of the virtual image display devices A and B receives the display content (S1407cA, S1407cB) and displays the content (S1408cA, S1408cB).

[0122] Here, the controller 100 notifies the user whether to change the height of the display position (S1409cC). The controller 100 notifies the user by, for example, causing the virtual image display device A and / or the virtual image display device B to display a message.

[0123] If the user selects not to change the height of the display position (S1409cC-NO), the user inputs that fact using the operation device, and the controller 100 continues to display the content on each of the virtual image display device A and the virtual image display device B while updating the content. On the other hand, if the user selects to change the height of the display position (S1409cC-YES), the user inputs a change in the display height for the virtual image display device A and the virtual image display device B using the operation device.

[0124] When the display height is changed, the controller 100 transmits an instruction to change the display height according to the user's input, and a set value of the display height, to each of the virtual image display devices A and B. Then, each of the virtual image display devices A and B receives the content transmitted by the controller 100 (S1409cA, S1409cB) and changes the display height so that the display height becomes the received set value. Then, each of the virtual image display devices A and B notifies the controller 100 that the change of the display height has been completed (S1410cA, S1410cB), and the controller 100 receives the notification (S1410cC).

[0125] Then, the controller 100 causes each of the virtual image display devices A and B to continue displaying the content while updating the content details.

[0126] Next, an example of a flow of adjusting the display position will be described with reference to Fig. 14D. In this example, after normal display, the user can change the display position. That is, in a state where virtual image display device A and virtual image display device B are displaying virtual images so that the respective displays do not overlap (S1401d), the user can change the display position.

[0127] 14D, first, it is determined whether or not to change the height of the virtual image visible range RA of the virtual image display device A (S1402d). If the height of the virtual image visible range RA is to be changed (S1402d-YES), the height of the virtual image visible range RA is changed (S1403d). If the height of the virtual image visible range is not to be changed (S1402d-NO), S1403d is omitted.

[0128] Also, it is determined whether to change the display position of the virtual image display device A (S1404d). If the user changes the display height (S1404d-YES), the display height is changed (S1405d). If the display height is not changed (S1404d-NO), S1405d is omitted.

[0129] The user then visually checks each display and confirms whether or not the displays overlap (S1406d). If the displays do not overlap (S1406d-NO), normal display is performed by virtual image display device A and virtual image display device B, with the displays not overlapping (S1410d). On the other hand, if the user confirms that the displays overlap (S1406d-YES), the user determines whether or not to change the height of the virtual image visible range RB of virtual image display device B, and then changes the display position of virtual image display device B (S1407d-S1409d). As a result, normal display without overlap is performed (S1410d).

[0130] Then, virtual image display device A and virtual image display device B continue normal display and end the display when a request to end the display is received (S1411d). Also, while Fig. 14D describes adjusting virtual image display device A and then adjusting virtual image display device B, this is not limited to this. When adjusting the display areas of multiple virtual image display devices currently displaying, the display area of ​​each virtual image display device is adjusted based on the virtual image display device that displays a virtual image display area that is easily visible to the user (driver).

[0131] Next, an example of setting the height of the display position will be described with reference to Fig. 15. As will be described in this example, the controller 100 or the control unit of the virtual image display device B may perform control to limit the setting of a predetermined display height based on the display position of the virtual image display device A.

[0132] As shown in FIG. 15A, the vertical axis represents heights 0 to 10 of the virtual image visible range. In this embodiment, as shown in the height levels of the virtual image visible range of virtual image display device B in FIG. 15A, the height levels of the virtual image visible range of virtual image display device A can be set to three levels, 1 to 3, with height level 1 corresponding to the range (0 to 7) indicated by 1 (circled number 1) in the figure, height level 2 corresponding to the range (1 to 8) indicated by 2 (circled number 2) in the figure, and height level 3 corresponding to the range (2 to 9) indicated by 3 (circled number 3) in the figure. The virtual image visible range is the range in the vertical or up-down direction of the vehicle where the driver can view a virtual image. If a virtual image is displayed within this range, the driver can view the virtual image. An appropriate height level can be selected according to the height of the driver's eyes, and the range can be adjusted to display the virtual image at an appropriate height.

[0133] 15A, the display range of virtual image display device A can be adjusted in three stages, (A) to (C), and the display unit is one graduation, so for example, the display range (A) uses a range of 0 to 1 for virtual image display. On the other hand, as shown in the height levels of the virtual image visible range of virtual image display device B in FIG. 15A, the height levels of the virtual image visible range of virtual image display device B can be set in nine stages, from 1 to 9, and for example, height level 5 corresponds to the range (4 to 6) indicated by 5 (circled number 5) in the figure, height level 7 corresponds to the range indicated by 7 (circled number 7) in the figure, and (6 to 8). Height level 9 corresponds to the range (8 to 10) indicated by 9 (circled number 9) in the figure. As shown in FIG. 15A , the display range of virtual image display device B can be adjusted in nine steps (A) to (I), with a display unit of two graduations. For example, the display range (A) uses a range of 0 to 2, the display range (E) uses a range of 4 to 6, and the display range (I) uses a range of 8 to 10 for virtual image display. The adjustable height range is not limited and can be freely set based on the visible range or the installation of the virtual image display device. The reference position of the virtual image visible range does not have to be 0; that is, it may differ depending on the arrangement of multiple virtual image display devices. For example, if the reference position is a display range height of 0 during initial use, after adjustment by a user, the reference position may become a display range height of 1 when used by another user. Furthermore, virtual image display device A may use a display range of (A) to (C), and virtual image display device B may use a display range of (A) to (I). In the range (A) to (C) that can be commonly used by both devices, overlapping displays may occur.

[0134] 15B and 15C, an example will be shown in which the virtual images displayed by virtual image display device A and virtual image display device B are set so as not to overlap. Driver A sets the height level of the virtual image displayable range of virtual image display device A to 2 in accordance with the height of his / her own line of sight, and at this time, virtual image IA output by virtual image display device A is displayed by one scale (in the range of 1 to 2) at the position (B) of FIG. 15B. Driver A also adjusts the virtual image display position of virtual image display device B in accordance with the height of his / her own line of sight so that it does not overlap with the virtual image display IA of virtual image display device A when viewed from the position of driver A's line of sight, sets the height level of the virtual image displayable range to 6, and sets virtual image IB to be displayed by two scales (in the range of 5 to 7) at the position (F) of FIG. 15B.

[0135] Similarly, driver B displays virtual image IA at position (A) of FIG. 15B (range 0 to 1) to match the height of his / her line of sight, and displays virtual image IB at position (E) of FIG. 15B (range 4 to 6) at a height where virtual image IA and virtual image IB do not overlap, so that virtual image IA and virtual image IB can be viewed simultaneously without overlapping. Driver C displays virtual image IA at position (C) of FIG. 15B (range 2 to 3) to match the height of his / her line of sight, and displays virtual image IB at position (I) of FIG. 15B (range 8 to 10) at a height where virtual image IA and virtual image IB do not overlap, so that virtual image IA and virtual image IB can be viewed simultaneously without overlapping. These settings are merely examples, and adjustments can be made so that virtual image IA and virtual image IB are displayed at any position as long as the driver can view virtual image IA and virtual image IB simultaneously without overlapping. For example, driver C may adjust and set virtual image IB to be displayed at any position of FIG. 15B (D) to (H) instead of position (I).

[0136] In this way, when the display area of ​​the virtual image display device that displays the lowest virtual image in the vertical direction of the vehicle is used as a reference, the display areas of the other virtual image display devices can be adjusted to a higher position than the display area of ​​the virtual image display device that displays the lowest virtual image, making the images more visible. Also, when the display area of ​​the virtual image display device that displays the highest virtual image in the vertical direction of the vehicle is used as a reference, the display areas of the other virtual image display devices can be adjusted to a lower position than the display area of ​​the virtual image display device that displays the highest virtual image, making the images more visible. Alternatively, when the display area of ​​the virtual image display device that is most easily visible to the driver is used as a reference, the display areas of the other virtual image display devices can be adjusted to a higher or lower position than the display area of ​​the virtual image display device that displays the most easily visible virtual image.

[0137] Next, an example of display area adjustment in the case where one virtual image display device A and one virtual image display device B are mounted on a vehicle will be described with reference to FIGS. 15A and 16A.

[0138] (1) The virtual image display device A can set the height of the virtual image visible range in three steps from 1 to 3, and since one scale is used as the display range, it is possible to use scales from 0 to 3 (0 to 1, 1 to 2, 2 to 3). Furthermore, the virtual image display device B, as shown in FIG. 15A, can set the height of the virtual image visible range in nine steps from 1 to 9, and the display range is in units of two scales, so it is possible to use scales from 0 to 10. However, in order to prevent overlapping of displays when used in conjunction with the virtual image display device A, the virtual image IB of the virtual image display device B avoids the range from 0 to 3 in which the virtual image IA of the virtual image display device A may be displayed, and displays the virtual image IB of the virtual image display device B in any two scales from 3 to 10 that do not overlap with the virtual image display device A.

[0139] (2) The display range of virtual image display device A may be determined first, and the display range of virtual image display device B may be adjusted so that the displays do not overlap. In example (2), the virtual image visible range RB and display range of virtual image display device B depend on the setting values ​​of virtual image display device A. For example, when the display position of virtual image IA of virtual image display device A is set to the range of 1 to 2, virtual image display device B displays the height of the virtual image visible range RB at 3 to 9 and the virtual image IB at any two-gradation scale between 2 and 10 to avoid overlap with the display range IA of virtual image display device A that was determined earlier. In (1), for example, even when virtual image IA is set to the range of 1 to 2, virtual image IB is only displayed at 3 to 10, leaving the range of 2 to 3 empty. However, in (2), when virtual image IA is set to the range of 1 to 2, virtual image IB can be set to be displayed at 2 to 3.

[0140] (3) The display range of virtual image display device B may be determined first, and then the display range of virtual image display device A may be adjusted so that the displays do not overlap. In example (3), the virtual image visible range RA and the display range of virtual image display device A depend on the setting values ​​of virtual image display device B. For example, when the virtual image IB of virtual image display device B is set to a range of 1 to 3 (two graduations), the virtual image IA of virtual image display device A is set to be displayed in a range of 0 to 1 (one graduation) to avoid overlapping with the virtual image IB. Of course, if the display position of virtual image IB is set to a higher position, the display position of virtual image IA has a higher degree of freedom.

[0141] (4) After the display ranges of each virtual image display device (A, B) are set, if the setting value of virtual image display device A is changed and, as a result, overlapping of the display ranges occurs, virtual image display device B may be adjusted so that the virtual image visible range RB and display range of virtual image display device B are changed to positions where they do not overlap. For example, when the display position of virtual image IA is set to the range 1 to 2, virtual image IB is set to be displayed in the range 2 to 4, where it does not overlap with virtual image IA. Thereafter, for reasons such as the user finding it difficult to view virtual image IA, the position of virtual image IA is changed to the range 2 to 3. As a result, virtual image IA and virtual image IB overlap, so the display position of virtual image IB is changed from the original set position of 2 to 4 to a position where no overlap occurs, for example, 3 to 5 (two graduations).

[0142] (5) After the display ranges of each virtual image display device (A, B) are set, if the setting value of virtual image display device A is changed and, as a result, overlapping of the display ranges occurs, processing may be performed to reduce the size of the display range of virtual image display device B to a size that does not cause overlapping. For example, when the display position of virtual image IA is set to the range 1 to 2, virtual image IB is set to be displayed in the range 2 to 4, which is a position that does not overlap with virtual image IA. Thereafter, for reasons such as the user finding it difficult to view virtual image IA, the position of virtual image IA is changed to the range 2 to 3. As a result, since virtual image IA and virtual image IB overlap, of the display area of ​​two graduations of the display position of virtual image IB, the range 2 to 3 that overlaps with virtual image IA is not displayed, and the display is limited to the range 3 to 4 where there is no overlap.

[0143] In example (5), adjustment may be performed to reduce the size of the display range and eliminate overlap without reducing the size of the virtual image visible range RB. Alternatively, for example, control may be performed to reduce the size of the display range by reducing the content of the information to be displayed. Adjustment may also be performed to reduce the size of the display range by changing the ratio of the overall display size.

[0144] Alternatively, for example, the controller 100 or the control unit of the virtual image display device B may reduce a portion of the information displayed by the virtual image display device B, and the controller 100 or the control unit of the virtual image display device A may cause the virtual image display device A to display the reduced information instead of the virtual image display device B, thereby reducing the size of the display range of the virtual image display device B. On the other hand, even if the overlap can be avoided by reducing the size of the display range, it cannot be denied that the visibility of the information will be reduced. Therefore, for example, it is also possible to simply adjust the display position to eliminate the overlap without reducing the size of the display range of the virtual image display device B (in this example, it remains at two graduations). Of course, in this case, the position must be adjusted so that the driver can simultaneously view the virtual image IA of the virtual image display device A and the virtual image IB of the virtual image display device B after the display position adjustment.

[0145] (6) After the display ranges of each virtual image display device (A, B) are set, if the setting value of virtual image display device A is changed, resulting in overlapping of the display ranges, an adjustment may be made to stop the display of virtual image display device B.

[0146] When the display of the virtual image display device B is stopped, adjustment may be made so that the virtual image display device A displays information having the same meaning as part or all of the information that the virtual image display device B had displayed.

[0147] Furthermore, an adjustment may be made to stop the display of the virtual image display device B only when there is little information being displayed. Furthermore, when the display of the virtual image display device B is stopped, the set value of the virtual image visible range RB may be maintained. Furthermore, when the display of the virtual image display device B is stopped, the controller 100 or the control unit of the virtual image display device B may make an adjustment to transition the virtual image display device B to a protection state.

[0148] (7) After the display ranges of each virtual image display device (A, B) are set, if the setting value of virtual image display device B is changed, resulting in overlap of the display ranges, the user may change the virtual image visible range RA and display range of virtual image display device A, and the display area of ​​virtual image display device A may be adjusted using the setting value based on the changed content. In example (7), the virtual image visible range RA and display range of virtual image display device A depend on the setting value of virtual image display device B.

[0149] (8) After the display ranges of each virtual image display device (A, B) are set, if the setting value of virtual image display device B is changed, resulting in overlapping of the display ranges, an adjustment may be made to stop the display of virtual image display device A.

[0150] When the display of the virtual image display device A is stopped, the virtual image display device B may be caused to display information having the same meaning as part or all of the information that the virtual image display device A had been displaying.

[0151] Furthermore, the controller 100 or the control unit of the virtual image display device A may stop displaying the virtual image display device A only when the amount of displayed information is small.

[0152] (9) When virtual image display device B is not in use, virtual image display device A does not need to consider overlapping displays. In other words, the display position can be freely set according to the height of the user's eyes within the adjustable range of virtual image display device A.

[0153] (10) When virtual image display device A is not in use, there is no need to consider overlapping displays on virtual image display device B. In other words, the display position can be freely set according to the height of the user's eyes within the adjustable range of virtual image display device B.

[0154] Next, with reference to Figures 15A, 16B, and 16C, an example of adjustment when a vehicle is equipped with multiple virtual image display devices (in this example, virtual image display devices A1 and A2) having the same configuration as virtual image display device A, and one virtual image display device B will be described. The virtual image display devices A1 and A2 are capable of changing the display range in the vertical direction. The virtual image display devices A1 and A2 are placed on the dashboard 2A so that the display ranges do not overlap in the horizontal direction.

[0155] (1) The virtual image display devices (A1, A2) can set the virtual image visible range height in three steps from 1 to 3, and each device (A1, A2) uses one scale as the display range, so it is possible to use a scale of 0 to 3 (0 to 1, 1 to 2, 2 to 3). Furthermore, the virtual image display device B has nine steps from 1 to 9 as the virtual image visible range height, and the display range is in units of two scales, so it is possible to use a scale of 0 to 10. However, in order to prevent overlapping of displays when two virtual image display devices (A1, A2) are used in combination, the range of 0 to 3 in which the virtual images IA1 and IA2 of the virtual image display devices A1 and A2 may be displayed is avoided, and the virtual image IB of the virtual image display device B is displayed in any two scales from 3 to 10 that do not overlap with the virtual image display device A.

[0156] (2) The display ranges of the virtual image display devices A1 and A2 may be determined first, and the display area of ​​the virtual image display device B may be adjusted so that the display ranges do not overlap. For example, when the display positions of the virtual images IA1 and IA2 of the virtual image display devices (A1, A2) are set to the range of 1 to 2, the virtual image display device B displays the height of the virtual image visible range RB at 3 to 9 and the virtual image IB at any two-gradation range between 2 and 10 to avoid overlap with the previously determined display ranges IA1 and IA2 of the virtual image display devices (A1, A2). For example, if the display position of the virtual image IA1 is set to the range of 2 to 3 and the display range of IA2 is set to the range of 1 to 2, the display range of the virtual image IB of the virtual image display device B is set to a position higher than the display of IA1, which is set to the higher of the display positions of the virtual images IA1 and IA2 (for example, 3 to 5), thereby preventing overlap with either the virtual image IA1 or the virtual image IA2. When the virtual image IA2 is set to a higher position than IA1, the virtual image IB is set according to the height of IA2.

[0157] (3) The display range of virtual image display device B may be determined first, and the controller 100 or the control unit of virtual image display device A1 may adjust the display positions of virtual image display devices A1 and A2 so that the respective display ranges do not overlap. For example, when the virtual image IB of virtual image display device B is set to a range of 2 to 4 (two graduations), the virtual images IA1 and IA2 of the virtual image display devices (A1, A2) are set to be displayed in a range of 0 to 1 or a range of 1 to 2 (one graduation for each) to avoid overlapping with the virtual image IB. In this case, the display positions of virtual images IA1 and IA2 may be the same height, or may be different heights, such as virtual image IA1 being 0 to 1 and virtual image IA2 being 1 to 2.

[0158] (4) After the display ranges of the respective virtual image display devices (A1, A2, B) are set, if the setting values ​​of the virtual image display devices A1 and / or A2 are changed, resulting in overlap of the display ranges, the virtual image viewable range RB and display position of the virtual image display device B may be adjusted so as to change the settings to positions where there is no overlap. For example, when the display positions of the virtual images IA1 and IA2 are set to the range 1 to 2, the virtual image IB is set to be displayed in the range 2 to 4, where there is no overlap with the virtual image IA. Thereafter, for reasons such as the user finding it difficult to view the virtual image IA1, the position of the virtual image IA1 is changed to the range 2 to 3. As a result, the virtual image IA1 and the virtual image IB overlap, so the display position of the virtual image IB is changed from the original set position of 2 to 4 to a position where there is no overlap, for example, 3 to 5 (two graduations).

[0159] When the setting values ​​of one of the virtual image display devices A1 and A2 are changed, the setting values ​​of the other virtual image display device may be changed to match the height of the virtual image visible range and the height of the display position of the virtual image display device whose setting values ​​have been changed, and the other virtual image display device may be adjusted based on the setting values. That is, in the above example, as the virtual image IA1 moves, the virtual image IA2 may move to the same position (2-3) as IA1, or may remain in its original position (1-2).

[0160] (5) After the display ranges of the respective virtual image display devices (A1, A2, B) are set, if the setting values ​​of virtual image display devices A1 and / or A2 are changed, resulting in overlapping of the display ranges, the controller 100 or the control unit of virtual image display device B may control virtual image display device B to perform processing to reduce the size of the display range of virtual image display device B to a size that does not cause overlap. For example, when the display positions of virtual images IA1 and IA2 are set to the range 1 to 2, virtual image IB is set to be displayed in the range 2 to 4, where it does not overlap with virtual images IA1 and IA2. Thereafter, for reasons such as the user finding it difficult to view virtual image IA1, the position of virtual image IA1 is changed to the range 2 to 3. As a result, virtual image IA1 and virtual image IB overlap, so of the display area of ​​two graduations of the display position of virtual image IB, the range 2 to 3 that overlaps with virtual image IA1 is not displayed, and the display is limited to the range 3 to 4 where there is no overlap. At this time, along with the movement of the virtual image IA1, the virtual image IA2 may be moved to the same position (2-3) as IA1, or may remain at the original position (1-2).

[0161] In example (5), control may be performed to reduce the size of the display range and eliminate overlap without reducing the size of the virtual image visible range RB. Also, for example, adjustment may be performed to reduce the size of the display range by reducing the content of the information to be displayed. Also, adjustment may be performed to reduce the size of the display range by changing the ratio of the overall display size.

[0162] Furthermore, for example, the controller 100 or the control unit of the virtual image display device B may reduce a portion of the information displayed by the virtual image display device B, and the controller 100 or the control unit of the virtual image display device A1 may display the reduced information on the virtual image display device A1 instead of the virtual image display device B, thereby performing an adjustment to reduce the size of the display range of the virtual image display device B. Furthermore, the controller 100 or the control unit of the virtual image display device A2 may display the reduced information on the virtual image display device A2 instead of the virtual image display device B, thereby performing control to reduce the size of the display range of the virtual image display device B. Here, a virtual image display device with a display range set close to the original display position may be selected, and the virtual image display device may display the reduced information.

[0163] When the setting values ​​of one of the virtual image display devices A1 and A2 are changed, the setting values ​​of the other virtual image display device may be changed to match the height of the virtual image visible range and the height of the display position of the virtual image display device whose setting values ​​have been changed, and the other virtual image display device may be controlled based on the changed setting values. Even if overlapping of displays can be avoided by reducing the size of the display range, it is undeniable that the visibility of information will be reduced. Therefore, for example, it is possible to simply adjust the display position to eliminate overlapping without reducing the size of the display range of virtual image display device B (in this example, it remains at two graduations). Of course, in this case, the positions must be adjusted so that the driver can simultaneously view the virtual images IA1 and IA2 of virtual image display devices A1 and A2 and the virtual image IB of virtual image display device B after the display position adjustment.

[0164] (6) After the display range of each virtual image display device (A1, A2, B) is set, if the setting value of virtual image display device A1 and / or A2 is changed, resulting in an overlap of the display ranges, the controller 100 or the control unit of virtual image display device B may stop the display of virtual image display device B.

[0165] When the display of the virtual image display device B is stopped, the controller 100 or the control unit of the virtual image display device A1 may cause the virtual image display device A1 to display information having the same meaning as part or all of the information that was displayed by the virtual image display device B. When the display of the virtual image display device B is stopped, the controller 100 or the control unit of the virtual image display device A2 may cause the virtual image display device A2 to display information having the same meaning as part or all of the information that was displayed by the virtual image display device B.

[0166] Furthermore, only when the amount of displayed information is small, the controller 100 or the control unit of the virtual image display device B may stop the display of the virtual image display device B. Furthermore, when the display of the virtual image display device B is stopped, the set value of the virtual image visible range RB may be maintained. Furthermore, when the display of the virtual image display device B is stopped, the controller 100 or the control unit of the virtual image display device B may transition the virtual image display device B to a protection state.

[0167] (7) After the display ranges of each virtual image display device (A1, A2, B) are set, if the setting value of the virtual image display device B is changed, resulting in overlapping of the display ranges, the user may change the virtual image visible range RA1 and display range of the virtual image display device A1, and the controller 100 or the control unit of the virtual image display device A1 may adjust the display range of the virtual image display device A1 using setting values ​​based on the changed content. Also, the user may change the virtual image visible range RA2 and display range of the virtual image display device A2, and the controller 100 or the control unit of the virtual image display device A2 may adjust the display range of the virtual image display device A2 using setting values ​​based on the changed content. In example (7), the virtual image visible range RA1 and display range of the virtual image display device A1 depend on the setting values ​​of the virtual image display device B that may overlap with the display of the virtual image display device A1. In example (7), the virtual image visible range RA2 and display range of the virtual image display device A2 depend on the setting values ​​of the virtual image display device B that may overlap with the display of the virtual image display device A2.

[0168] (8) After the display ranges of the respective virtual image display devices (A1, A2, B) are set, if the setting value of virtual image display device B is changed, resulting in overlap of the display ranges, the controller 100 or the control unit of virtual image display device A1 may stop the display of virtual image display device A1. Also, the controller 100 or the control unit of virtual image display device A2 may stop the display of virtual image display device A2.

[0169] In addition, when the display of virtual image display devices A1 and / or A2 is stopped, the controller 100 or the control unit of virtual image display device B may cause virtual image display device B to display information having the same meaning as some or all of the information that was displayed before the stoppage.

[0170] Furthermore, the controller 100 or the control unit of the virtual image display device A1 may stop the display of the virtual image display device A1 only when the amount of displayed information is small. Furthermore, the controller 100 or the control unit of the virtual image display device A2 may stop the display of the virtual image display device A2 only when the amount of displayed information is small. Furthermore, when the display of one of the virtual image display devices A1 and A2 is stopped, the display of the other virtual image display device may also be stopped.

[0171] Next, a specific example of display adjustment will be described with reference to FIG.

[0172] 17A, virtual image display devices A and B perform display so that their display areas do not overlap. Then, for each virtual image display device (A1, A2), a user performs an operation to change the display position by the same height or by a different height, thereby changing the display position so that their display ranges do not overlap.

[0173] 17B, ​​virtual image display devices A and B perform display so that their displays do not overlap. Then, the user performs an operation to change the display range of virtual image display device A so that it overlaps with the display range of virtual image display device B.

[0174] In this case, the setting value of the virtual image display device A is changed, resulting in overlapping of the display ranges. Therefore, as an example, a process is performed to reduce the size of the display range of the upper virtual image display device B. Specifically, the controller 100 or the control unit of the virtual image display device B limits the usable range of the display panel 12 of the virtual image display device B. For example, the controller 100 or the control unit of the virtual image display device B controls the display panel 12 to be divided into two, with the upper half of the display panel not being used and only the lower half being used. Since the size of the display area is reduced by half, the display information is also adjusted appropriately. In the example of FIG. 17B , the group of arrows indicating the direction of travel continues to be displayed in the display area of ​​the virtual image display device B after adjusting the display size (here, reducing the size). However, the display of information indicating a right turn 100 meters ahead is discontinued due to the reduction in the display area of ​​the virtual image display device B, and is instead displayed on the virtual image display device A. The control unit or controller 100 of the virtual image display device A, which now needs to display new information indicating that the vehicle will turn right 100 meters ahead, adjusts (here, reduces) the display size of the vehicle speed information that was originally displayed to create space to display the new information, and displays the information indicating that the vehicle will turn right 100 meters ahead in that space.

[0175] 17C, virtual image display devices A and B perform display so that their displays do not overlap. Then, the user performs an operation to change the display range of virtual image display device A so that it overlaps with the display range of virtual image display device B.

[0176] In this case, the setting value of virtual image display device A is changed, resulting in overlap of the display ranges. As an example, as described above, the display on virtual image display device B is stopped or the virtual image on virtual image display device B is not displayed. Furthermore, controller 100 or the control unit of virtual image display device A acquires data of information similar to the information for stopping the display on virtual image display device B, and causes virtual image display device A to display information having the same meaning as the information displayed on virtual image display device B. In this example, virtual image display device A displays information indicating that a right turn will be made 100 meters ahead after the display on virtual image display device B is stopped, and information indicating that the vehicle is traveling straight ahead.

[0177] 17D, two virtual image display devices (A1, A2) are used, and one virtual image display device A1 and one virtual image display device B perform displaying so that their displays do not overlap. Then, a user performs an operation to change the display position of the virtual image display device A1 so that it overlaps with the display range of the virtual image display device B. Note that in this example, as the display position of the virtual image display device A1 is changed, the display position of the virtual image display device A2 is changed by the same height.

[0178] FIG. 17D shows an example in which the driver requests that the height of the display area of ​​the virtual image display devices (A1, A2) be moved upward. When this request is accommodated, overlapping with the display of the virtual image display device B occurs as the height of the display area of ​​the virtual image display devices (A1, A2) is changed. Therefore, as an example, the display position of the virtual image display device B is also moved upward within a range in which the driver can simultaneously view the virtual images IA1, IA2, and the virtual image IB, thereby avoiding overlapping of the displays. While this is sufficient in terms of avoiding overlapping of the display area and the displays, FIG. 17D also improves the visibility of the information by displaying the information that was displayed on the virtual image display device B on the virtual image display device A2 instead.

[0179] Specifically, the controller 100 or the control unit of the virtual image display device A2 acquires data relating to information to be moved from the information displayed on the virtual image display device B to the virtual image display device A2, stops displaying this information on the virtual image display device B, and instead displays it on the virtual image display device A2. In this example, the virtual image display device B stops displaying the information indicating a right turn 100 meters ahead, and newly displays the same information on the virtual image display device A2. Here, the virtual image display device A2 is selected as the new display destination, but it is also possible to select the virtual image display device A1, or to continue displaying the information on the virtual image display device B. Conversely, it is also possible to move the information displayed on the virtual image display devices (A1, A2) to the virtual image display device B, or to move the display content between the virtual image display devices A1 and A2. Here, since no information was originally displayed on virtual image display device A2 and the information indicating a right turn 100 meters ahead was displayed near the bottom left of the display area of ​​virtual image display device B, A2, which is located close to that display position (the bottom left of image display device B is used as the display area), is selected as the new display destination. As a result, the information indicating a right turn 100 meters ahead is displayed at a height and position that remains almost unchanged before and after the height of the display area is changed (even though the device displaying the information is different), which has the effect of making it easier for the driver to view the information.

[0180] Next, with reference to FIGS. 18 and 19, a case where the virtual image display device B and the virtual image display device C are mounted on a vehicle will be described.

[0181] 18, a virtual image display device C is disposed in the vehicle 2. Here, similar to the virtual image display device A, the virtual image display device C is disposed on the dashboard 2A and projects information toward the display area 5c of the windshield 3. However, the virtual image display device C is, for example, a device that is retrofitted to the vehicle 2, and may not be able to communicate with the controller 100, the virtual image display device B, etc.

[0182] Also, an in-vehicle camera 1801 is arranged inside the vehicle to capture an image of the windshield 3. The in-vehicle camera 1801 is installed, for example, on the ceiling of the vehicle interior so that it is not blocked by the driver.

[0183] The controller 100 is capable of communicating with the in-vehicle camera 1801 and acquires a camera image of the windshield 3 from the in-vehicle camera 1801. The controller 100 then converts the display range and / or display height of the virtual image display device C into parameters from the camera image. In detail, the controller 100 determines the levels of the display range and display height of the virtual image display device C so that processing can be performed in the same manner as in the case of the virtual image display device A.

[0184] FIG. 19 is a diagram illustrating an example of a method for evaluating the display range of the virtual image display device C. Data on height level evaluation lines L corresponding to the respective height levels of the display range of the virtual image display device A may be stored in advance in a storage device referenced by the controller 100. The controller 100 may then determine the display range and / or display height of the virtual image display device C based on the position of the display by the virtual image display device C in the camera image acquired from the in-vehicle camera 1801 and the height level evaluation line L. This makes it possible to acquire parameters related to the display range and / or display height of the virtual image display device C for processing in the same manner as in the case of the virtual image display device A. Note that the height level evaluation line L in FIG. 19 is illustrated for ease of explanation and is not actually visible to the user.

[0185] The storage device referenced by the controller 100 may store, for example, image data in which a height level evaluation line L is superimposed on the windshield 3. The controller 100 may then determine the display range and display height of the virtual image display device C based on the stored image data and image data acquired from the in-vehicle camera 1801 capturing images of the windshield 3 and the display by the virtual image display device C.

[0186] Next, an example of processing when the virtual image display device C is used will be described with reference to FIG. 20A.

[0187] In step S2001a, if the virtual image display device C has been installed in the vehicle 2 by the user (YES), the process proceeds to step S2002a. If the virtual image display device C has not been installed in the vehicle 2 by the user (NO), the process proceeds to the flow of FIG. 14A. The control unit of the virtual image display device C acquires data of content to be displayed on the virtual image display device C (S2002a). The control unit of the controller 100 or the virtual image display device B acquires data of content to be displayed on the virtual image display device B (S2003a). Steps S2002a and S2003a may be processed simultaneously.

[0188] Then, the control unit of virtual image display device C controls the virtual image display device C, and the controller 100 or the control unit of virtual image display device B controls the virtual image display device B, so that virtual image display device B and virtual image display device C perform normal display so that their respective displays do not overlap (S2004a).

[0189] Here, the user may adjust the display position so that the displays do not overlap by changing the installation position of the virtual image display device C. Alternatively, the user may input an operation related to changing the display position using the operation device, and the controller 100 or the control unit of the virtual image display device B may acquire data related to the user's operation and control the display of the virtual image display device B.

[0190] In addition, the controller 100 or the control unit of the virtual image display device B may control the display range of the virtual image display device B so that it does not overlap with the display range of the virtual image display device C determined using an image acquired from the in-vehicle camera 1801.

[0191] If the virtual image display device C can communicate with the controller 100, the controller 100 may transmit data related to the content to be displayed to the virtual image display device C. The controller 100 may also control the display of the virtual image display device C. The controller 100 may acquire, for example, information on the installation position, ON / OFF information, display range, display height, etc. of the virtual image display device C via communication, and control the virtual image display devices B and C.

[0192] When the virtual image display device C is not installed and the virtual image display device A is installed, the processing flow described above may be executed.

[0193] Next, an example of processing when the virtual image display device C is used will be described with reference to FIG. 20B.

[0194] When the virtual image display device C is installed in the vehicle 2 by the user (S2001b), the controller 100 checks whether information can be acquired from the virtual image display device C (S2002b). That is, the controller 100 checks whether communication with the virtual image display device C is possible. In S2001b, the controller 100 may determine whether the virtual image display device C is installed by using, for example, a camera image acquired by the in-vehicle camera 1801. When the virtual image display device C is not installed and the virtual image display device A is installed, the processing flow described above may be executed.

[0195] When it is confirmed that the controller 100 can acquire information from the virtual image display device C (S2002b-YES), the controller 100 acquires information on the display range and setting information on the display height from the virtual image display device C through communication with the virtual image display device C (S2003b). Then, the controller 100 determines an initial setting position for the display height of the virtual image display device B (S2004b). For example, the controller 100 determines the display height of the virtual image display device B so that the display of the virtual image display device C and the display of the virtual image display device B do not overlap.

[0196] If the controller 100 determines that it cannot acquire information from the virtual image display device C (S2002b-NO), the in-vehicle camera 1801 captures a camera image including the display of the virtual image display device C, and the controller 100 acquires the camera image from the in-vehicle camera 1801 (S2005b). Then, as described above, the controller 100 makes a determination using the camera image acquired by the in-vehicle camera 1801 and acquires parameters of the display range and display height of the virtual image display device C (S2006b). Then, the controller 100 determines an initial setting position for the display height of the virtual image display device B (S2004b). For example, the controller 100 determines the display height of the virtual image display device B such that the display of the virtual image display device C and the display of the virtual image display device B do not overlap.

[0197] The user determines whether to change the display position of the virtual image display device B (S2007b). If the display position of the virtual image display device B is not changed (S2007b-NO), the controller 100 starts the display operation of the virtual image display device B based on the setting determined in S2004b (S2009b).

[0198] On the other hand, if the display position of the virtual image display device B is to be changed (S2007b-YES), the user inputs operation details related to the change of the display position using the operation device. Examples of the operation device include an operation device provided on the steering wheel or console of the vehicle 2, and a device such as a smartphone connected to the vehicle 2. Then, the controller 100 acquires the operation details of the user and updates the display position information according to the operation details of the user (S2008b). Furthermore, the controller 100 starts the display operation of the virtual image display device B based on the setting updated in S2008b (S2009b).

[0199] Although the embodiments have been described above, the present invention is not limited to the above-described embodiments and includes various modifications and equivalent configurations within the spirit of the appended claims. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present invention is not necessarily limited to those including all of the described configurations. Furthermore, for example, other configurations may be added, deleted, or replaced with part of the configuration of the embodiment.

[0200] 14B and 14D illustrate an example in which the setting of the virtual image display device A is changed and, as a result, overlapping of displays occurs, and the setting of the virtual image display device B is changed. However, it is sufficient that each display is performed so that the displays do not overlap, and the setting of the virtual image display device A may be changed when the setting of the virtual image display device B is changed and overlapping of displays occurs.

[0201] An example has been described in which the virtual image visible range and display position of the virtual image display device are adjusted by moving the virtual image display device on the dashboard 2A. However, a virtual image display device that is placed on the dashboard 2A and whose virtual image visible range and display position can be adjusted by rotating the main body to change the inclination may also be used. In this case, data in which the installation position is converted into a rotation angle may be used in display control.

[0202] It is only necessary that the displays of the virtual image display devices are performed so as not to overlap each other, and the change in the height of the virtual image visible range may be omitted in adjusting the display position.

[0203] The first image display device is, for example, a device placed on the dashboard 2A, and the second image display device is, for example, a HUD placed inside the dashboard 2A.

[0204] By using the technology according to the above-described embodiment, when multiple virtual image display devices 1 are installed, necessary information can be viewed as an image through the windshield. This makes it possible to provide a HUD device 1 that reduces the user's eye movement and contributes to supporting safe driving. As a result, it becomes possible to prevent traffic accidents. Furthermore, it becomes possible to contribute to "Good health and well-being" of the Sustainable Development Goals (SDGs) advocated by the United Nations. [Explanation of symbols]

[0205] 2 vehicles 3 Windshield 4. Vehicle Information 5a Display area 5b Display area 100 Controllers 300 In-Vehicle Systems A. Virtual image display device B. Virtual image display device

Claims

1. In a video display system in which a plurality of video display devices are mounted on a vehicle, a first image display device that displays a virtual image by projecting image light onto a windshield of the vehicle; a second image display device that displays a virtual image by projecting image light onto a windshield of the vehicle; a display area of ​​the first image display device and a display area of ​​the second image display device are individually adjustable in the up-down direction of the vehicle; A video display system comprising:

2. 2. The video display system according to claim 1, When the display area of ​​the first image display device and the display area of ​​the second image display device overlap, the display area of ​​the first image display device or the display area of ​​the second image display device is adjusted so that the display area of ​​the first image display device and the display area of ​​the second image display device do not overlap. A video display system comprising:

3. 2. The video display system according to claim 1, The first image display device and the second image display device are each capable of individually adjusting a virtual image visible range in the vertical direction with respect to the entire displayable range. A video display system comprising:

4. 2. The video display system according to claim 1, one of the first image display device and the second image display device sets a range to be used for display; The other of the first video display device and the second video display device sets a range to be used for display based on the set display range of the first video display device or the second video display device. A video display system comprising:

5. 2. The video display system according to claim 1, After the ranges to be used for display on the first video display device and the second video display device are set, if the range to be used for display on one of the first video display device or the second video display device is changed and an overlap of the ranges to be used for display occurs, the other of the first and second video display devices changes the range used for display to a position that does not overlap with the range used for display of the other device; A video display system comprising:

6. 2. The video display system according to claim 1, After the ranges to be used for display on the first video display device and the second video display device are set, if the range to be used for display on one of the first video display device or the second video display device is changed and an overlap of the ranges to be used for display occurs, the other of the first image display device and the second image display device stops displaying; A video display system comprising:

7. 2. The video display system according to claim 1, The first image display device comprises: Located on the dashboard of the vehicle, The second image display device comprises: Located within the dashboard of the vehicle, When the ranges to be used for displaying the first image display device and the second image display device are set, if the range to be used for displaying the first image display device is changed and an overlap occurs between the ranges to be used for displaying, the second image display device reduces the size of the area used for display so as not to overlap with the area used for display of the first image display device; A video display system comprising:

8. 8. The video display system according to claim 7, The second image display device comprises: Reduce the amount of information displayed and the size of the area used for displaying it, A video display system comprising:

9. 8. The video display system according to claim 7, The second image display device comprises: Reduce some of the information to be displayed, reduce the size of the area used for display, The first image display device comprises: displaying the reduced information; A video display system comprising:

Citation Information

Patent Citations

  • Head-up display device

    JP2024007661A