Display control device, head-up display device, and display control method

Abstract

To reduce a sense of discomfort in visual recognition of a virtual image.SOLUTION: A processor displays a first virtual image V1 which includes a plurality of first image elements G10 having a gap D10 therebetween and represents the perspective. The plurality of first image elements G10 represent the same kind of information and have higher visibility than prescribed visibility. In a case where it is detected, estimated or predicted that the attitude variation of a movable body satisfies a prescribed condition, the processor executes first display control processing of reducing the number of gaps D10 between the first image elements G10 included in the first virtual image V1 and higher than the prescribed visibility, or shortening the gap D10.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The present disclosure relates to a display control device, a head-up display device, a display control method, etc. that are used in a moving body such as a vehicle and visually recognize an image superimposed on the foreground of the moving body (the actual scene in the forward direction of the moving body as seen by the vehicle occupant).

[0002] A head-up display (HUD) device expresses augmented reality (AR) in which information or the like is added to and emphasized on an actual scene or an actual object existing in the actual scene by superimposing an image (virtual object) on the scenery in front of the host vehicle, and contributes to safe and comfortable vehicle operation by accurately providing desired information while suppressing the line-of-sight movement of the user driving the vehicle as much as possible.

[0003] In particular, the head-up display device described in Patent Document 1 suppresses the deviation of the positional relationship between an image (virtual object) and an actual object in an actual scene or an actual object existing in the actual scene by correcting the display position of the image (virtual object) based on the vibration information of the vehicle, thereby harmonizing the image (virtual object) with the actual scene.

[0004] Further, the head-up display device described in Patent Document 2 displays a plurality of image elements (virtual objects) arranged along the road surface and expressed with different sense of distance by perspective projection, thereby making the image (virtual object) and the actual scene more harmonious.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, if it is not possible to properly correct the images individually for multiple image elements (virtual objects) with different senses of distance based on changes in the vehicle's posture, the image (virtual object) and the actual scene (real object) will not harmonize, which is expected to cause discomfort to the observer.

[0007] Furthermore, even if it were possible to individually and effectively correct the images of multiple image elements (virtual objects) with different senses of distance based on the vehicle's attitude changes, it is still conceivable that the difference between real objects and virtual objects would cause discomfort to the observer.

[0008] Furthermore, even if image correction based on changes in the vehicle's posture is not performed, multiple image elements (virtual objects) with different senses of distance will be directly shifted from the actual scene (real objects) based on changes in the vehicle's posture, which could impair the sense of virtual reality and still cause discomfort to the observer.

[0009] A summary of specific embodiments disclosed herein is provided below. It should be understood that these embodiments are presented solely to provide the reader with an overview of these specific embodiments and do not limit the scope of this disclosure. In fact, this disclosure may encompass combinations of the embodiments described below and various embodiments not described below.

[0010] This disclosure outlines the provision of a display control device, a head-up display device, and a display control method for displaying highly visible images. More specifically, it also relates to reducing the discomfort experienced when viewing virtual images.

[0011] Accordingly, the display control device, head-up display device, and display control method described herein employ the following means to solve the aforementioned problems. The gist of this embodiment is to display a first virtual image that represents perspective, which includes a plurality of first image elements having gaps between them, and to perform a first display control process that reduces the number of gaps between the first image elements that have a higher visibility than predetermined, or shortens the gaps.

[0012] Accordingly, the display control device in the first embodiment described herein is a display control device for controlling a head-up display device that superimposes an image onto the foreground in front of a moving object, and has one or more processors, the processors display a first virtual image that represents perspective, which includes a plurality of first image elements with gaps between them, and the plurality of first image elements represent the same kind of information and have a higher visibility than predetermined, and when it is detected, estimated, or predicted that a change in the attitude of the moving object satisfies predetermined conditions, the number of gaps between the first image elements with a higher visibility than predetermined included in the first virtual image is reduced. In this case, it is partially difficult to see that each of the plurality of image elements (virtual objects) is shifted from the actual scene (real objects) based on the change in the attitude of the vehicle, which has the advantage of reducing the sense of discomfort given to the observer.

[0013] In any of the display control devices in a preferred alternative embodiment, the processor lowers the visibility of some of a plurality of first image elements before the first display control processing to below a predetermined level. In this embodiment, for example, a first virtual image representing perspective is displayed, which includes a plurality (e.g., three) of first image elements that are above the predetermined level of visibility. In this case, there are two gaps between the three first image elements that are above the predetermined level of visibility. When the attitude change of the moving body satisfies a predetermined condition, some (e.g., one) of the first image elements are lowered to below the predetermined level of visibility. As a result, the number of first image elements that are above the predetermined level of visibility becomes two, and the gap between the two first image elements that are above the predetermined level of visibility becomes one. In other words, the number of gaps between the first image elements that are above the predetermined level of visibility included in the first virtual image is reduced. When an attitude change of the moving body occurs, the number of first image elements that are above the predetermined level of visibility decreases, which has the advantage that it becomes more difficult to see that each of the plurality of image elements (virtual objects) is shifted from the actual scene (real objects) based on the change in the vehicle's attitude, thereby reducing the sense of discomfort given to the observer. In any of the display control devices in this embodiment, the processor performs a first display control process such that at least one of the first image elements with a higher visibility level than predetermined after the first display control process is larger than all of the multiple first image elements included in the first virtual image before the first display control process. For example, a first virtual image is displayed that includes multiple (e.g., three) first image elements with a higher visibility level than predetermined, and represents perspective. If the attitude change of a moving object satisfies predetermined conditions, some (e.g., one) of the first image elements are made lower than predetermined visibility, and at least one of the remaining first image elements with a higher visibility level is made larger. This has the advantage of making it difficult to see some of the multiple image elements (virtual objects) that are misaligned with the real scene (real objects), while making it easier to convey the information shown by the first virtual image. In addition, by making the first image elements larger, it is possible to reduce the misalignment between the first image elements and the real scene (real objects).

[0014] In one of the display control devices in another preferred embodiment, the processor hides some of a plurality of first image elements before the first display control processing. In this embodiment, a first virtual image representing perspective is displayed, which includes a plurality (e.g., three) of first image elements that have a predetermined level of visibility. In this case, there are two gaps between the three first image elements that have a predetermined level of visibility. When the attitude change of the moving body satisfies a predetermined condition, some (e.g., one) of the first image elements are hidden. As a result, the number of first image elements that have a predetermined level of visibility becomes two, and the gap between the two first image elements that have a predetermined level of visibility becomes one. In other words, the number of gaps between the first image elements that have a predetermined level of visibility included in the first virtual image is reduced. When an attitude change of the moving body occurs, the number of first image elements that have a predetermined level of visibility is reduced, which has the advantage that it becomes partially invisible that each of the plurality of image elements (virtual objects) is shifted from the real scene (real objects) based on the change in the vehicle's attitude, thereby reducing the sense of discomfort given to the observer. In any of the display control devices in this embodiment, the processor performs a first display control process to enlarge at least one of the first image elements having a higher visibility level than predetermined after the first display control process so that it extends across the entire first virtual image before the first display control process. For example, a first virtual image is displayed that includes multiple (e.g., three) first image elements having a higher visibility level than predetermined, and represents perspective. When the attitude change of a moving object satisfies predetermined conditions, some (e.g., one) of the first image elements are hidden, and the first display control process is performed to enlarge at least one of the remaining first image elements having a higher visibility level so that it extends across the entire first virtual image before the first display control process. This has the advantage of making some of the multiple image elements (virtual objects) that are misaligned with the real scene (real objects) invisible, while making it easier to convey the information shown by the first virtual image. In addition, by enlarging the first image elements, it is possible to reduce the misalignment between the first image elements and the real scene (real objects).

[0015] Furthermore, in another embodiment, the display control device controls a head-up display device that overlays an image onto the foreground in front of a moving object, and has one or more processors, which display a first virtual image that represents perspective, including a plurality of first image elements with gaps between them, and the plurality of first image elements represent the same kind of information, have a higher visibility than predetermined, and when it is detected, estimated, or predicted that the attitude change of the moving object meets predetermined conditions, it executes a first display control process to shorten the gaps included in the first virtual image. In this case, even if individual vibration correction is not performed between the plurality of image elements (virtual objects) or individual vibration correction is not successful (the difference in sense of distance in perspective cannot be properly expressed), shortening the gaps between the plurality of image elements (virtual objects) reduces the difference in sense of distance in perspective between the plurality of image elements (virtual objects), which has the advantage of reducing the sense of incongruity caused by each of the plurality of image elements (virtual objects) being deviated from the actual scene (real object) based on the change in the attitude of the vehicle.

[0016] In any of the display control devices in this embodiment, the processor performs a first display control process such that at least one of the first image elements with a higher visibility level after the first display control process is larger than all of the multiple first image elements included in the first virtual image before the first display control process. For example, a first virtual image is displayed that includes multiple (e.g., three) first image elements with a higher visibility level than predetermined, and represents perspective. If the attitude change of the moving body satisfies predetermined conditions, the processor performs a first display control process to enlarge some (e.g., one) of the first image elements so that the gaps between the image elements become smaller. In this case, even if individual vibration correction is not performed between the multiple image elements (virtual objects) or if individual vibration correction is unsuccessful (the difference in sense of distance in perspective cannot be properly represented), the gaps between the multiple image elements (virtual objects) become shorter, which reduces the difference in sense of distance in perspective between the multiple image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the multiple image elements (virtual objects) shifting from the actual scene (real object) based on the change in the vehicle's attitude. Furthermore, by enlarging the first image element, it becomes less likely for discrepancies to occur between the first image element and the actual scene (actual object).

[0017] In any of the display control devices in another preferred embodiment, the processor further performs a second display control process to shorten the display distance of the first virtual image when it detects, estimates, or predicts that a change in the attitude of the moving object satisfies predetermined conditions. This has the advantage that the amount of change in the image (virtual object) due to changes in the vehicle's attitude can be kept to a minimum, and consequently, the discrepancy between the image (virtual object) and the actual scene (real object) can be suppressed.

[0018] In any of the display control devices in another preferred embodiment, the processor, in a second display control process, continuously or gradually reduces the display distance of the first virtual image over time. This has the advantage of reducing the inconvenience caused by instantaneous changes in the display distance.

[0019] In any of the display control devices in another preferred embodiment, the processor performs a first display control process that shortens the gaps in the first virtual image by bringing a plurality of image elements closer together so that the gaps between the plurality of first image elements before the first display control process are shortened. In this case, even if individual vibration correction is not performed between the plurality of image elements (virtual objects) or if individual vibration correction is unsuccessful (the difference in sense of distance in perspective cannot be properly represented), shortening the gaps between the plurality of image elements (virtual objects) reduces the difference in sense of distance in perspective between the plurality of image elements (virtual objects), which has the advantage of reducing the sense of incongruity caused by each of the plurality of image elements (virtual objects) being deviated from the actual scene (real object) based on the change in the vehicle's posture.

[0020] In any of the display control devices in another preferred embodiment, the processor performs a first display control process that glues together a plurality of image elements such that there are no gaps between them before the first display control process. In this case, even if individual vibration correction is not performed between the plurality of image elements (virtual objects) or if individual vibration correction is unsuccessful (i.e., the difference in sense of distance in perspective cannot be properly represented), the gaps between the plurality of image elements (virtual objects) are shortened, which reduces the difference in sense of distance in perspective between the plurality of image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the plurality of image elements (virtual objects) shifting from the actual scene (real object) based on the change in the vehicle's posture.

[0021] In any of the display control devices in a preferred alternative embodiment, the processor performs a first display control process that causes a second image element to be displayed, which is positioned to fill the gaps between a plurality of first image elements prior to the first display control process. In this case, even if individual vibration correction is not performed between the plurality of image elements (virtual objects) or if individual vibration correction is unsuccessful (i.e., differences in perspective distance cannot be properly represented), the gaps between the plurality of image elements (virtual objects) are filled by the second image element, making it less likely for the observer to perceive differences in perspective distance between the plurality of image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the plurality of image elements (virtual objects) being misaligned with the actual scene (real object) based on changes in the vehicle's posture.

[0022] In any of the display control devices in this embodiment, the first image element has higher visibility than the second image element. This reduces the sense of incongruity caused by the shift of each of the multiple image elements (virtual objects) from the actual scene (real objects) based on the change in the vehicle's posture, while making it easier to direct visual attention to the first image element that presents information.

[0023] The head-up display device in the embodiments described herein comprises a display control device in any of several embodiments, an optical modulation element that emits display light, and a relay optical system that directs the display light from the optical modulation element towards the projection area. In this case as well, the same advantages as described above are expected.

[0024] A display control method in an embodiment described herein includes displaying a first virtual image that represents perspective, comprising a plurality of first image elements having gaps between them, and performing a first display control process to reduce the number of gaps between the first image elements in the first virtual image that are higher than the predetermined visibility, or shorten the gaps, when the plurality of first image elements represent the same kind of information, are higher than a predetermined visibility level, and it is detected, estimated, or predicted that a change in the attitude of a moving object satisfies predetermined conditions.

Brief Description of Drawings

[0025] [Figure 1] FIG. 1 is a diagram showing an application example of a vehicle display system to a vehicle. [Figure 2] FIG. 2 is a diagram showing the configuration of a head-up display device. [Figure 3] FIG. 3 is a block diagram of a vehicle display system according to some embodiments. [Figure 4] FIG. 4 is a flowchart showing a method of executing a first display control process according to some embodiments. [Figure 5] FIG. 5 is a diagram showing an example of a foreground visually recognized by an observer and an image (virtual image) displayed superimposed on the foreground during the running of the host vehicle. [Figure 6] FIG. 6 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 7] FIG. 7 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 8] FIG. 8 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 9] FIG. 9 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 10] FIG. 10 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 11] FIG. 11 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 12] FIG. 12 shows a virtual image before the first display process in the left figure and a virtual image after the first display process in the right figure. [Figure 13] FIG. 13 shows the horizontal axis representing time and the vertical axis representing display distance, and is a diagram for explaining a second display control process.

Embodiments for Carrying Out the Invention

[0026] Figures 1 to 13 below provide an explanation of the configuration and operation of an exemplary vehicle display system. However, the present invention is not limited to the following embodiments (including those shown in the drawings). Modifications (including the deletion of components) can be made to the embodiments described below. Furthermore, in order to facilitate understanding of the present invention, explanations of known technical matters will be omitted as appropriate.

[0027] Refer to Figure 1. Figure 1 shows an example of the configuration of a virtual image display system for vehicles. In Figure 1, the left-right direction of the vehicle (an example of a moving object) 1 (in other words, the width direction of the vehicle 1) is defined as the X-axis (the positive direction of the X-axis is to the left when the vehicle 1 is facing forward), the up-down direction (in other words, the height direction of the vehicle 1) along a line segment perpendicular to the left-right direction and perpendicular to the ground or a surface equivalent to the ground (in this case, the road surface 6) is defined as the Y-axis (the positive direction of the Y-axis is upward), and the front-rear direction along a line segment perpendicular to each of the left-right and up-rear directions is defined as the Z-axis (the positive direction of the Z-axis is the straight-ahead direction of the vehicle 1). This is the same in other drawings as well.

[0028] As shown in the figure, the vehicle display system 10 installed in the vehicle (own vehicle) 1 includes an eye position detection unit (gaze detection unit) 409 for pupil (or face) detection that detects the position and gaze direction of the left eye 700L and right eye 700R of the observer (typically a driver seated in the driver's seat of vehicle 1), an external sensor 411 consisting of a camera (e.g., a stereo camera) that captures images of the area in front of (or broadly speaking, the surroundings of) vehicle 1, a head-up display device (hereinafter also referred to as a HUD device) 20, and a display control device 30 that controls the HUD device 20. Note that the eye position detection unit (gaze detection unit) 409 and the external sensor 411 may be omitted.

[0029] Figure 2 shows one configuration of a head-up display device. The HUD device 20 is installed, for example, in the dashboard (reference numeral 5 in Figure 1). The HUD device 20 comprises a stereoscopic image display device (image display device) 40, a relay optical system 80, and a housing 22 that houses the image display device 40 and the relay optical system 80 and has a light emission window 21 that allows display light K from the image display device 40 to be emitted from the inside to the outside. Note that the image display device 40 is not limited to a stereoscopic image display device that displays 3D images, but may also display 2D images.

[0030] The image display device 40 is, in this case, a parallax-type 3D display device. This stereoscopic display device (parallax-type 3D display device) 40 consists of a display unit 50, which is a glasses-free stereoscopic display device that uses a multi-view image display method capable of controlling depth representation by allowing the user to view a left-view image and a right-view image, and a light source unit 60 that functions as a backlight.

[0031] The display unit 50 includes an optical modulation element 51 that generates an image by optically modulating illumination light from the light source unit 60, and an optical layer (an example of a light ray separation unit) 52 that separates the light emitted from the optical modulation element 51 into left-eye display light (reference numeral K10 in Figure 1), such as left-eye rays K11, K12, and K13, and right-eye display light (reference numeral K20 in Figure 1), such as right-eye rays K21, K22, and K23. The optical layer 52 includes optical filters such as lenticular lenses, parallax barriers, lens arrays, and microlens arrays. In this embodiment, the optical layer 52 is not limited to the optical filters described above, but includes all forms of optical layers arranged on the front or rear surface of the optical modulation element 51. However, this is just an example and not a limitation.

[0032] Furthermore, the image display device 40 may emit left-eye display light (reference numeral K10 in Figure 1), such as left-eye rays K11, K12, and K13, and right-eye display light (reference numeral K20 in Figure 1), such as right-eye rays K21, K22, and K23, by configuring the light source unit 60 with a directional backlight unit (reference numeral K10 in Figure 1) instead of or in addition to the optical layer (example of a light ray separator) 52. Specifically, for example, the display control device 30, described later, directs the left-eye display light K10, such as the left-eye rays K11, K12, and K13, towards the observer's left eye 700L when the directional backlight unit emits illumination light directed towards the left eye 700R, by displaying a left-viewpoint image on the light modulation element 51, thereby directing the right-eye display light K20, such as the right-eye rays K21, K22, and K23, towards the observer's left eye 700L. However, this is just one example and is not limited to this.

[0033] The display control device 30, described later, can control the appearance of the perceptual image FU displayed by the HUD device 20 (as perceived by the observer) by performing, for example, image rendering processing (graphics processing) and display drive processing, directing the left-eye display light K10 of the left-viewpoint image V10 to the observer's left eye 700L and the right-eye display light K20 of the right-viewpoint image V20 to the right eye 700R, and adjusting the left-viewpoint image V10 and the right-viewpoint image V20. The display control device 30, described later, may also control the display (display 50) to reproduce a light field that reproduces (approximately) the light rays emitted in various directions from a point in a certain space.

[0034] The relay optical system 80 has curved mirrors (concave mirrors, etc.) 81 and 82 that reflect light from the image display device 40 and project the image display light K10 and K20 onto the windshield (projection member) 2. However, it may further include other optical members (which may include refractive optical members such as lenses, diffractive optical members such as holograms, reflective optical members, or combinations thereof).

[0035] In Figure 1, the image display device 40 of the HUD device 20 displays parallax images for each of the left and right eyes. Each parallax image is displayed as V10 and V20, which are imaged onto the virtual image display surface (virtual image forming surface) VS, as shown in Figure 1. The focus of each of the observer's (person's) eyes is adjusted to match the position of the virtual image display area VS. The position of the virtual image display area VS is referred to as the "adjustment position (or image forming position)," and the distance from a predetermined reference position (for example, the center 205 of the eye box 200 of the HUD device 20, the observer's viewpoint position, or a specific position on the vehicle 1) to the virtual image display area VS is referred to as the adjustment distance (image forming distance).

[0036] However, in reality, because the human brain fuses each image (virtual image), people perceive the perceived image (in this case, the arrowhead shape for navigation) FU as being displayed at a position further back than the accommodation position (for example, a position determined by the convergence angle between the left viewpoint image V10 and the right viewpoint image V20, where the smaller the convergence angle, the further away the perceived image is from the observer). The perceived image FU is sometimes called a "three-dimensional virtual image," and if "image" is taken in a broad sense to include virtual images, it can also be called a "three-dimensional image." It may also be called a "three-dimensional image" or "3D display."

[0037] Figure 3 is a block diagram of a virtual image display system for a vehicle according to several embodiments. The display control device 30 comprises one or more I / O interfaces 31, one or more processors 33, one or more display control processing circuits 35, and one or more memories 37. Figure 3 is only one embodiment, and the illustrated components may be combined with fewer components, or additional components may be included. For example, the display control processing circuit 35 (e.g., a graphics processing unit) may be included in one or more processors 33.

[0038] As shown in the figure, the processor 33 and the display control processing circuit 35 are operably connected to the memory 37. More specifically, the processor 33 and the display control processing circuit 35 can control the vehicle display system 10 (image display device 40), for example, by executing a program stored in the memory 37, such as generating and / or transmitting image data. The processor 33 and / or the display control processing circuit 35 may include at least one general-purpose microprocessor (e.g., a central processing unit (CPU)), at least one application-specific integrated circuit (ASIC), at least one field-programmable gate array (FPGA), or any combination thereof. The memory 37 includes any type of magnetic medium such as a hard disk, any type of optical medium such as CDs and DVDs, any type of semiconductor memory such as volatile memory, and non-volatile memory. The volatile memory may include DRAM and SRAM, and the non-volatile memory may include ROM and NVRAM.

[0039] As shown in the figure, the processor 33 is operably connected to the I / O interface 31. The I / O interface 31 communicates (also referred to as CAN communication) with, for example, the vehicle ECU 401 and / or other electronic devices (reference numerals 403 to 419 described later) installed in the vehicle, in accordance with the CAN (Controller Area Network) standard. The communication standard adopted by the I / O interface 31 is not limited to CAN, and includes, for example, wired communication interfaces such as CANFD (CAN with Flexible Data Rate), LIN (Local Interconnect Network), Ethernet (registered trademark), MOST (Media Oriented Systems Transport: MOST is a registered trademark), UART, or USB, or in-vehicle communication (internal communication) interfaces, which are short-range wireless communication interfaces within tens of meters, such as personal area networks (PANs) such as Bluetooth (registered trademark) networks, and local area networks (LANs) such as 802.11x Wi-Fi (registered trademark) networks. Furthermore, the I / O interface 31 may also include an external communication interface for outside vehicles, such as a wide-area communication network (e.g., an internet communication network) using cellular communication standards such as wireless wide-area network (WWAN0, IEEE802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e-based (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, and 5G.

[0040] As shown in the figure, the processor 33 is interconnected with the I / O interface 31 so as to be able to exchange information with various other electronic devices connected to the vehicle display system 10 (I / O interface 31). For example, the vehicle ECU 401, road information database 403, vehicle position detection unit 405, operation detection unit 407, eye position detection unit 409, external sensor 411, brightness detection unit 413, attitude detection unit 415, portable information terminal 417, and external communication device 419 are interconnected to the I / O interface 31 so as to be able to operate. The I / O interface 31 may also include a function to process (convert, calculate, analyze) information received from other electronic devices connected to the vehicle display system 10.

[0041] The image display device 40 is operably connected to the processor 33 and the display control processing circuit 35. Therefore, the image displayed by the optical modulation element 51 may be based on image data received from the processor 33 and / or the display control processing circuit 35. The processor 33 and the display control processing circuit 35 control the image displayed by the optical modulation element 51 based on information obtained from the I / O interface 31.

[0042] The software components stored in memory 37 include a posture change detection module 502, a posture change estimation module 504, a posture change prediction module 506, a display parameter setting module 512, a graphics module 514, a displacement amount calculation module 522, and a correction amount calculation module 524.

[0043] Figure 4 is a flowchart showing a method S100 for performing a first display control process according to several embodiments. Method S100 is performed in an image display device 40 (optical modulation element 51) and a display control device 30 that controls the image display device 40 (optical modulation element 51). Some operations within method S100 are arbitrarily combined, the procedures of some operations are arbitrarily modified, and some operations are arbitrarily omitted.

[0044] The display control device 30 (processor 33) generates image data based on information acquired from the I / O interface 31 and outputs it to the image display device 40 (optical modulation element 51) to display the first virtual image V1 (virtual image) V1 superimposed on the observer's foreground (step S110).

[0045] In step S130, the display control device 30 (processor 33) acquires information regarding the attitude changes of the moving body via the I / O interface 31. The display control device 30 (processor 33) acquires information indicating the attitude changes of the moving body (attitude change information) from the attitude detection unit 415 (S132). The attitude detection unit 415 includes, for example, one or more sensors such as a gyro sensor, an acceleration sensor, and a height sensor. That is, the attitude change information includes the angular velocity, acceleration, height, vehicle attitude (pitch angle, roll angle, etc.) of the moving body, and the frequency of the change in the vehicle attitude (vibration frequency).

[0046] The display control device 30 (processor 33) executes the attitude change detection module 502 to determine, based on the attitude change information, whether the attitude change of the moving body satisfies predetermined conditions (S150). The attitude change detection module 502 includes various software components for performing various operations related to detecting, based on the attitude change information, whether there is an attitude change, whether there is an attitude change of a predetermined magnitude, whether there is an attitude change of a predetermined speed, whether there is an attitude change of a predetermined frequency, etc. That is, the attitude change detection module 502 may include a determination threshold, table data, calculation formula, etc., for determining whether the attitude change of the moving body satisfies predetermined conditions from various information acquired from the I / O interface 31.

[0047] In some embodiments, the display control device 30 (processor 33) acquires information (attitude change estimation information) that allows estimation of attitude changes of a moving object from the vehicle ECU 401, external sensors 411, etc. (but not limited to these) via the I / O interface 31 (S134).

[0048] The display control device 30 (processor 33) executes the attitude change estimation module 504 to determine, based on the attitude change estimation information, whether the attitude change of the moving body is estimated to satisfy predetermined conditions (S150). The attitude change estimation module 504 includes various software components for performing various operations related to estimating, based on the attitude change estimation information, whether there is an attitude change, whether there is an attitude change of a predetermined magnitude, whether there is an attitude change of a predetermined speed, whether there is an attitude change of a predetermined frequency, etc. That is, the attitude change estimation module 504 may include determination thresholds, table data, calculation formulas, etc., for estimating whether the attitude change of the moving body satisfies predetermined conditions from various information acquired from the I / O interface 31. The attitude change estimation module 504 determines whether the attitude change of the moving body is estimated to satisfy predetermined conditions according to the rate of change of speed (acceleration) acquired from the vehicle ECU 401. The attitude change estimation module 504 also determines whether the attitude change of the moving body is estimated to satisfy predetermined conditions according to the change in the position (coordinates) of real objects outside the vehicle acquired from the external sensor 411. Furthermore, the methods for estimating the attitude changes of a moving object are not limited to these, and various known methods can be applied.

[0049] In some embodiments, the display control device 30 (processor 33) acquires information that can predict the attitude changes of a moving object (attitude change prediction information) from a road information database 403, an external communication device 419, etc. (but not limited to these) via an I / O interface 31 (S136).

[0050] The display control device 30 (processor 33) executes the attitude change prediction module 506 to determine, based on the attitude change prediction information, whether the attitude change of the moving body is predicted to satisfy predetermined conditions (S150). The attitude change prediction module 506 includes various software components for performing various operations related to predicting that there is an attitude change, that there is an attitude change of a predetermined magnitude, that there is an attitude change of a predetermined speed, that there is an attitude change of a predetermined frequency, etc., based on the attitude change prediction information. The attitude change prediction module 506 determines, based on the position information of the road surface obtained from the road information database 403 where the attitude change is predicted to satisfy predetermined conditions, whether the attitude change of the moving body is predicted to satisfy predetermined conditions. The attitude change estimation module 504 also determines, based on the position information of the preceding vehicle where the attitude change occurred, obtained from the external communication device 419 through vehicle-to-vehicle communication with the preceding vehicle traveling in front of the moving body, whether the attitude change of the moving body is predicted to satisfy predetermined conditions. Note that the method for predicting the attitude change of the moving body is not limited to these, and various known methods can be applied.

[0051] In step S150, the display control device 30 (processor 33) determines, based on the attitude change information (attitude change estimation information, attitude change prediction information) acquired via the I / O interface 31, whether it has detected, estimated, or predicted that the attitude change of the moving body meets predetermined conditions. If it is determined that the attitude change of the moving body meets predetermined conditions, the process proceeds to step S170. Note that the display control device 30 does not have the function to perform these determinations, and the determination results may be acquired from an external source (a device other than the display control device 30). Therefore, the attitude change detection module 502, the attitude change estimation module 504, and the attitude change prediction module 506 may be omitted.

[0052] In step S170, the display control device 30 (processor 33) may perform at least a first display control process (step S180) using the display parameter setting module 512, and may also perform a second display control process (step S190).

[0053] The display parameter setting module 512 includes various software components for performing various operations related to setting the display parameters of the virtual image to be displayed, based on various information and commands obtained from the I / O interface 31. In other words, the display parameter setting module 512 may include table data, calculation formulas, etc., for identifying the display parameters from various information obtained from the I / O interface 31.

[0054] The display parameters include parameters for changing the type, placement (position coordinates, angle), size, display distance (in the case of 3D), and visual effects (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed image. Specifically, for example, the display parameters include: (1) parameters for positioning the image so that it has a predetermined positional relationship with a real object located outside the vehicle 1 as viewed from the eye position 700 (parameters for controlling the display unit 50 to control the image placement, and / or parameters for controlling actuators 28, 29); (2) parameters for changing the size and placement of the image (parameters for controlling the display unit 50 to control the size and placement of the image); (3) parameters for switching the display or hiding of the image (parameters for controlling the display unit 50); and (4) parameters for reducing image distortion that may occur due to the virtual image optical system 90 as viewed from the eye position 700. (5) Parameters for pre-distorting the image (parameters that control the display unit 50 to pre-distort the image displayed on the display unit 50, also called warping parameters), (6) Parameters for controlling the visibility of the image, such as transmittance, brightness, and lightness (parameters that control the display unit 50 to control the transmittance, brightness, and lightness of the image, and / or parameters that control the light source unit 60 to control the transmittance, brightness, and lightness of the image), (7) Parameters for expressing a desired sense of depth as seen from the eye position (parameters that control the display unit 50, parameters that control the actuator), etc. However, the display parameters set (selected) by the display parameter setting module 512 are not limited to these.

[0055] In this embodiment, when the display control device 30 (processor 33) detects, estimates, or predicts that a change in the attitude of a moving object satisfies predetermined conditions, the display parameter setting module 512 executes a first display control process (step S180) to reduce the number of gaps between image elements in the image that have a predetermined level of visibility, or to shorten the gaps.

[0056] Figure 5 shows the foreground of the vehicle as seen by an observer facing forward, and the first image displayed by the head-up display device 20 before the first display control processing. The first virtual image V1 before the first display control processing expresses perspective by arranging and displaying a plurality of (three in the example of Figure 5) first image elements G10 (G11, G12, G13 in the example of Figure 5) with gaps D10 (D11, D12 in the example of Figure 5) between them, with their size gradually changing in the vertical direction (Y-axis direction) as seen from the observer. In the example of Figure 5, the first image elements G10 are arranged in the order G11, G12, G13 from bottom to top (positive Y-axis direction) as seen from the observer, and have two gaps D10 consisting of a gap D11 between G11 and G12, and a gap D12 between G12 and G13. Here, the first image elements G11, G12, and G13 all have higher visibility than the first visibility. Here, visibility is, for example, luminance or transmittance. That is, the first image elements G11, G12, and G13 all have higher luminance than the first luminance and / or lower transmittance than the first transmittance. The first image elements G11, G12, and G13 are all guiding figures and represent the same type of information.

[0057] Figures 6 through 12 show the virtual image before the first display processing (left figure) and the virtual image after the first display processing (right figure). Figure 13 is a diagram illustrating the second display control processing, with the horizontal axis representing time and the vertical axis representing display distance.

[0058] (First embodiment) In some embodiments of the display control device 30, the processor 33 reduces the number of gaps D10 between first image elements in the first virtual image V1 that have a higher visibility level than predetermined by performing a first display control process (step S182). In any display control device, the processor 33 lowers some of the multiple first image elements G10 before the first display control process to a level below predetermined visibility, as shown in Figure 6. In the example in Figure 6, a first virtual image V1 is displayed that represents perspective and includes multiple (e.g., three) first image elements G11, G12, and G13 that have a higher visibility level than predetermined (left panel of Figure 6). In this case, there are two gaps D11 and D12 between the three first image elements G10 that have a higher visibility level than predetermined. When the attitude change of the moving object satisfies predetermined conditions, some (e.g., two) of the first image elements G11 and G13 are lowered to a level below first visibility, as shown in the right panel of Figure 6. As a result, the number of first image elements with higher visibility than the first is reduced to one, and since there is only one first image element (G12) with higher visibility than the first, the gap between first image elements with higher visibility than the first becomes zero (it could be one instead of zero). In other words, the number of gaps between first image elements G10 with higher visibility than the first is included in the first virtual image V1 decreases. When the attitude of the moving object changes, the number of first image elements G10 with higher visibility than the first decreases, so it becomes more difficult to see that each of the multiple image elements (virtual objects) G10 is shifted from the real scene (real object) based on the change in the vehicle's attitude, which has the advantage of reducing the sense of discomfort given to the observer.

[0059] (Second embodiment) In any of the display control devices in another preferred embodiment, the processor 33 hides some of the multiple first image elements G10 before the first display control processing. In this embodiment, the processor 33 hides some (for example, two) of the first image elements G11 and G13 by performing the first display control processing (step S182). As a result, the number of first image elements G10 with higher visibility than the first becomes one (G12), and the gap D10 between first image elements with higher visibility than the first becomes zero. In other words, the number of gaps D10 between first image elements G10 with higher visibility than the first included in the first virtual image V1 is reduced. When the attitude of the moving object changes, the number of first image elements with higher visibility than the first decreases, so that the shift of each of the multiple image elements (virtual objects) from the actual scene (real objects) based on the change in the attitude of the vehicle becomes partially invisible, which has the advantage of reducing the sense of discomfort given to the observer.

[0060] (Third embodiment) In either the first or second embodiment of the display control device 30, the processor 33, in the first display control process (step S182), enlarges at least one of the first image elements G12 that have a higher visibility level after the first display control process. In the example shown in Figure 7, the processor 33, by executing the first display control process (step S182), lowers the visibility level of some (for example, two) of the first image elements G11 and G13 to below the first visibility level, and enlarges at least one of the remaining first image elements G12 that have a higher visibility level. This has the advantage of making it difficult to see some of the multiple image elements (virtual objects) that are misaligned with the real scene (real objects), while making it easier to transmit the information shown by the first virtual image V1. In addition, by enlarging the first image elements, it is possible to reduce the misalignment between the first image elements and the real scene (real objects).

[0061] (Fourth embodiment) In either the first or second embodiment of the display control device 30, the processor 33 performs a first display control process to enlarge at least one of the first image elements that have higher visibility after the first display control process so that it covers the entire first virtual image V1 before the first display control process. In the example shown in Figure 8, the processor 33 performs the first display control process (step S182) to hide some (for example, one) of the first image elements and to enlarge at least one of the remaining first image elements that have higher visibility so that it covers the entire first virtual image V1 before the first display control process. This has the advantage of making some of the multiple image elements (virtual objects) that are misaligned with the real scene (real objects) invisible, while making it easier to transmit the information shown by the first virtual image V1. In addition, by enlarging the first image elements, it is possible to reduce the misalignment between the first image elements and the real scene (real objects).

[0062] (Fifth embodiment) In another embodiment of the display control device 30, the processor 33 shortens the gaps included in the first virtual image V1 by executing a first display control process (step S184). In this case, even if individual vibration correction is not performed between multiple image elements (virtual objects) or if individual vibration correction is unsuccessful (the difference in sense of distance in perspective cannot be properly expressed), shortening the gaps between multiple image elements (virtual objects) reduces the difference in sense of distance in perspective between multiple image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the multiple image elements (virtual objects) shifting from the actual scene (real object) based on the change in the vehicle's posture.

[0063] (Sixth embodiment) In any of the display control devices 30 in the fifth embodiment, the processor 33 performs a first display control process that shortens the gaps included in the first virtual image V1 by bringing a plurality of image elements closer together so that the gaps between the plurality of first image elements before the first display control process are shortened. In any of the display control devices 30, when the attitude change of the moving body satisfies predetermined conditions, the processor 33 brings the first image elements G11 and G13 closer together with the first image element G12, as shown in the right figure of Figure 9, thereby shortening the gap D11 between the first image elements G11 and G12, and the gap D12 between the first image elements G12 and G13. According to this, even if individual vibration correction is not performed between multiple image elements (virtual objects), or if individual vibration correction is unsuccessful (i.e., differences in perspective cannot be properly represented), the gap between multiple image elements (virtual objects) is shortened, which reduces the differences in perspective between multiple image elements (virtual objects). This reduces the sense of incongruity caused by each of the multiple image elements (virtual objects) shifting from the real scene (real objects) based on the change in the vehicle's posture.

[0064] (Seventh Embodiment) In any of the display control devices 30 in the fifth embodiment, the processor 33 performs a first display control process that adheres a plurality of image elements together so that there are no gaps between the plurality of first image elements before the first display control process. In any of the display control devices 30, if the attitude change of the moving body satisfies predetermined conditions, the processor 33 adheres the first image elements G11 and G13 to the first image element G12, as shown in the right figure of Figure 10, thereby eliminating (or largely eliminating) the gap D11 between the first image elements G11 and G12, and the gap D12 between the first image elements G12 and G13. In this case, even if individual vibration correction is not performed between multiple image elements (virtual objects), or if individual vibration correction is unsuccessful (i.e., the difference in distance in perspective cannot be properly represented), the gap between multiple image elements (virtual objects) is shortened, which reduces the difference in distance in perspective between multiple image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the multiple image elements (virtual objects) shifting from the actual scenery (real objects) based on the change in the vehicle's posture.

[0065] (Eighth embodiment) In any of the display control devices 30 in the fifth embodiment, the processor 33 performs a first display control process to display a second image element that is positioned to fill the gaps between a plurality of first image elements before the first display control process. In any of the display control devices 30, if the attitude change of the moving body satisfies predetermined conditions, the processor 33 adds a second image element G20 so as shown in the right figure of Figure 11, that the gap D11 between the first image elements G11 and G12, and the gap D12 between the first image elements G12 and G13 are eliminated. In this case, even if individual vibration correction is not performed between the plurality of image elements (virtual objects) or if individual vibration correction is not successful (the difference in the sense of distance in perspective cannot be properly expressed), the gaps between the plurality of image elements (virtual objects) are filled with the second image element, making it difficult for the observer to perceive the difference in the sense of distance in perspective between the plurality of image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the plurality of image elements (virtual objects) being deviated from the actual scene (real object) based on the change in the vehicle's attitude. Furthermore, the second image element G20 does not necessarily have to be positioned so as to eliminate the gap between the first image elements; it may be positioned so as to fill a portion of the gap between the first image elements.

[0066] (Ninth embodiment) In any of the display control devices 30 in the eighth embodiment, the first image element G10 has higher visibility than the second image element G20. This reduces the sense of incongruity caused by the shift of each of the multiple image elements (virtual objects) from the actual scene (real objects) based on the change in the vehicle's posture, while making it easier to direct visual attention to the first image element that presents information.

[0067] (Tenth embodiment) In any of the display control devices 30 in the fifth embodiment, the processor 33 performs a first display control process such that at least one of the first image elements with higher visibility after the first display control process is larger than the first image element before the first display control process. In the example shown in Figure 12, a first virtual image V1 is displayed that includes multiple (e.g., three) first image elements with higher visibility than the first, and represents perspective. When the attitude change of the moving object satisfies predetermined conditions, the first display control process is performed to enlarge at least some (e.g., all three) of the first image elements so that the gaps between the image elements become smaller. In this case, even if individual vibration correction is not performed between multiple image elements (virtual objects), or if individual vibration correction is unsuccessful (i.e., the difference in distance in perspective cannot be properly represented), the gap between multiple image elements (virtual objects) is shortened, which reduces the difference in distance in perspective between multiple image elements (virtual objects). This has the advantage of reducing the sense of incongruity caused by each of the multiple image elements (virtual objects) shifting from the real scene (real object) based on the change in the vehicle's posture. Furthermore, by making the first image element larger, it is possible to reduce the likelihood of discrepancies between the first image element and the real scene (real object).

[0068] (11th embodiment) In any of the display control devices 30 in the first to eleventh embodiments, the processor 33 further executes a second display control process (step S190) to shorten the display distance of the first virtual image V1 when it detects, estimates, or predicts that a change in the attitude of the moving body satisfies predetermined conditions. This has the advantage that the amount of change in the image (virtual object) due to the change in the attitude of the vehicle can be kept small, and consequently, the discrepancy between the image (virtual object) and the actual scene (real object) can be suppressed.

[0069] (12th embodiment) In any of the display control devices 30 in the eleventh embodiment, the processor 33, in the second display control process (step S190), continuously or gradually shortens the display distance of the first virtual image V1 as time progresses. In the example shown in Figure 13, the processor 33 starts the second display control process (step S190) from time t1 and continuously shortens the display distance of the first virtual image V1 as time progresses (however, it may be a gradual change as time progresses). This has the advantage of reducing the inconvenience caused by instantaneous changes in the display distance.

[0070] The head-up display device 20 described herein includes a display control device 30 in any of several embodiments, an optical modulation element 51 that emits display light, and a relay optical system 80 that directs the display light from the optical modulation element 51 towards the projection unit 2. In this case as well, the same advantages as described above are expected.

[0071] The display control method described herein includes displaying a first virtual image V1 that represents perspective, which includes a plurality of first image elements having gaps between them, and performing a first display control process to reduce the number of gaps D10 between the first image elements G10 that have higher visibility than the first, or to shorten the gaps D10, when the plurality of first image elements G10 represent the same kind of information, have higher visibility than the first, and it is detected, estimated, or predicted that a change in the attitude of a moving object satisfies predetermined conditions.

[0072] Refer again to Figure 3. The graphics module 514 includes various known software components for generating image data by performing display control processing such as rendering based on the display parameters set by the display parameter setting module 512, and for driving the image display device 40. That is, the graphics module 514 may include various known software components for changing the type, arrangement (position coordinates, angle), size, display distance (in the case of 3D), and visual effects (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed image based on the display parameters set by the display parameter setting module 512. The graphics module 514 can generate image data that can be viewed by an observer based on the image type (one example of a display parameter), the image position coordinates (one example of a display parameter), the image angle (such as the pitching angle around the X direction, the yaw rate angle around the Y direction, and the rolling angle around the Z direction, and is one example of a display parameter), the image size (one example of a display parameter), and the image color (one example of a display parameter set by hue, saturation, brightness, etc.), and drive the display unit 50.

[0073] The light source drive module (not shown) includes various known software components for performing the operation of driving the light source unit 24. The light source drive module 516 can drive the light source unit 24 based on set display parameters.

[0074] An actuator drive module (not shown) includes various known software components for performing the driving of a first actuator 28 and / or a second actuator 29. The actuator drive module can drive the first actuator 28 and the second actuator 29 based on set display parameters.

[0075] The displacement calculation module 522 calculates the attitude (angle of displacement) of the vehicle 1 based on attitude change information obtained from the attitude detection unit 415. For example, the displacement calculation module 522 calculates the angle around the pitch axis of the vehicle 1 (pitch angle) by integrating the angular velocity detected by the attitude detection unit 415. This makes it possible to calculate the displacement (angle) of the vehicle 1 in the rotational direction around the Y axis (pitch axis) as shown in Figure 1. In this embodiment, the pitch angle is calculated, but the yaw angle or roll angle may also be calculated. For example, angles around the X axis, Y axis and Z axis may all be calculated.

[0076] The correction amount calculation module 524 calculates a correction amount for the display position of the first virtual image V1 (multiple first image elements G10) according to the attitude (angle deviation) of the vehicle 1. Specifically, the correction amount calculation module 524 converts the angle (pitch angle) deviation calculated by the deviation amount calculation module 522 into the number of pixels and determines a correction amount that restores the number of pixels to their original state. For example, the correction amount calculation module 524 determines a correction amount that restores the pitch angle deviation to its original state. The correction amount calculation module 524 outputs the calculated correction amount to the graphics module 514. In this embodiment, the correction amount in the pitch axis direction is calculated, but correction amounts in the yaw axis direction and roll direction may also be calculated. For the roll angle, the correction amount is determined to restore the roll angle deviation to its original state, while keeping the angle as is.

[0077] The operation of the processing steps described above can be carried out by having one or more functional modules of an information processing device, such as a general-purpose processor or an application-specific chip, execute. All of these modules, combinations of these modules, and / or combinations with known hardware that can substitute for their functions are all within the scope of protection of the present invention.

[0078] The functional blocks of the vehicle display system 10 are optionally implemented by hardware, software, or a combination of hardware and software to carry out the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 7 may be optionally combined, or one functional block may be separated into two or more subblocks, to carry out the principles of the embodiments described. Therefore, the description herein optionally supports any possible combination or division of the functional blocks described herein. [Explanation of symbols]

[0079] 1: Vehicle 2:Projected area 10: Vehicle display system 20: Head-Up Display Device (HUD) 21: Light-emitting window 22: Cabinet 24: Light source unit 28: First Actuator 29: Second actuator 30: Display control device 31: I / O Interface 33: Processor 35: Display control processing circuit 37: Memory 40: Image display device 50:Display unit 51: Optical Modulator 52: Optical Layer 60: Light source unit 80: Relay Optics 90: Virtual Image Optical System 200: ibox 205: Center 401: Vehicle ECU 403: Road Information Database 405: Vehicle position detection unit 407: Operation detection unit 409: Eye position detection unit 411: External vehicle sensor 413: Brightness detection unit 415: Attitude detection unit 417: Mobile Information Terminal 419: External communication devices 502: Posture change detection module 504: Posture Change Estimation Module 506: Posture Change Prediction Module 512: Display parameter setting module 514: Graphics module 516: Light source driving module 522: Module for calculating displacement 524: Correction Amount Calculation Module 700: Eye position 700L: Left eye 700R: Right eye D10: Gap FU: Perceptual Image G10: First image element G20: Second image element K:Display light K10: Display light (display light for left eye) K20: Display light (display light for right eye) V1: The first illusion V10: Left-view image V20: Right-view image VS: Virtual image display area

Claims

1. In a display control device that controls a head-up display device that overlays an image onto the foreground in front of a moving object, Having one or more processors, The aforementioned processor, It includes a plurality of first image elements with gaps between them, and displays a first virtual image that represents perspective. The aforementioned plurality of first image elements represent the same type of information and have a higher visibility than predetermined, When a change in the attitude of a moving object is detected, estimated, or predicted to satisfy predetermined conditions, a first display control process is executed to bring the first image elements closer together so that the gap between the first image elements included in the first virtual image, which have a predetermined level of visibility, is shortened. A display control device characterized by the following:

2. In a display control device that controls a head-up display device that overlays an image onto the foreground in front of a moving object, Having one or more processors, The aforementioned processor, It includes a plurality of first image elements with gaps between them, and displays a first virtual image that represents perspective. The aforementioned plurality of first image elements represent the same type of information and have a higher visibility than predetermined, When it is detected, estimated, or predicted that a change in the attitude of a moving object satisfies predetermined conditions, a first display control process is executed to reduce the number of gaps between the first image elements included in the first virtual image that have a predetermined level of visibility, or to shorten the gaps. A display control device that performs the first display control process so that at least one of the first image elements having a predetermined level of visibility after the first display control process is enlarged so that it extends across the entire first virtual image before the first display control process.

3. The aforementioned processor, If it is detected, estimated, or predicted that the attitude fluctuation of the moving body satisfies the predetermined conditions, a second display control process is further executed to shorten the display distance of the first virtual image. The display control device according to claim 1 or 2.

4. In the second display control process, the processor As time progresses, the display distance of the first virtual image is continuously or gradually reduced. The display control device according to claim 3.

5. In a display control device that controls a head-up display device that overlays an image onto the foreground in front of a moving object, Having one or more processors, The aforementioned processor, It includes a plurality of first image elements with gaps between them, and displays a first virtual image that represents perspective. The aforementioned plurality of first image elements represent the same type of information and have a higher visibility than predetermined, When it is detected, estimated, or predicted that a change in the attitude of a moving object satisfies predetermined conditions, a first display control process is executed to reduce the number of gaps between the first image elements included in the first virtual image that have a predetermined level of visibility, or to shorten the gaps. A display control device that performs the first display control process, which involves bonding the plurality of image elements together so that the gaps between the plurality of first image elements before the first display control process are eliminated.

6. In a display control device that controls a head-up display device that overlays an image onto the foreground in front of a moving object, Having one or more processors, The aforementioned processor, It includes a plurality of first image elements with gaps between them, and displays a first virtual image that represents perspective. The aforementioned plurality of first image elements represent the same type of information and have a higher visibility than predetermined, When it is detected, estimated, or predicted that a change in the attitude of a moving object satisfies predetermined conditions, a first display control process is executed to reduce the number of gaps between the first image elements included in the first virtual image that have a predetermined level of visibility, or to shorten the gaps. A display control device that performs the first display control process to display a second image element that is arranged to fill the gap between the plurality of first image elements before the first display control process.

7. The second image element has lower visibility than the first image element. The display control device according to claim 6.

8. In a display control device that controls a head-up display device that overlays an image onto the foreground in front of a moving object, Having one or more processors, The aforementioned processor, It includes a plurality of first image elements with gaps between them, and displays a first virtual image that represents perspective. The aforementioned plurality of first image elements represent the same type of information and have a higher visibility than predetermined, When a change in the attitude of a moving object is detected, estimated, or predicted to meet predetermined conditions, A display control device that performs a first display control process, which reduces the number of gaps between first image elements that are higher than the predetermined visibility and included in the first virtual image to zero by making all but one of the plurality of first image elements lower than the predetermined visibility or making them invisible before the first display control process.

9. A display control device according to any one of claims 1 to 8, A light modulation element that emits display light, It comprises a relay optical system that directs display light from an optical modulation element towards the projection area, A head-up display device characterized by the following features.

10. In a display control method for controlling a head-up display device that overlays an image onto the foreground in front of a moving object, The first virtual image, which includes multiple first image elements with gaps between them, displays a first virtual image that represents perspective. The aforementioned plurality of first image elements represent the same type of information and have a higher visibility than predetermined, If a change in the attitude of a moving object is detected, estimated, or predicted to satisfy predetermined conditions, the first display control process is performed to reduce the number of gaps between the first image elements that are higher than the predetermined visibility and included in the first virtual image to zero, by making all but one of the plurality of first image elements before the first display control process lower than the predetermined visibility or making them invisible. A display control method characterized by the following:

Images