Display control device and display system
By estimating and reducing the brightness of counter-image formation areas on side windows based on driver eye position data, the display control device addresses the issue of reflected images, enhancing the driver's viewing experience at side mirrors.
Patent Information
- Application Number
- JP2021212276
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-27
- Publication Date
- 2026-02-17
- Estimated Expiration
- 2041-12-27
AI Technical Summary
Existing display control devices do not account for images being reflected on side windows, causing visual annoyance for drivers when looking at side mirrors.
Estimate the position of the counter-image formation area on the side window based on driver eye position data and reduce the brightness of this area to minimize reflection, using a display control device with an acquisition unit, estimation unit, and brightness reduction unit.
Reduces visual inconvenience for drivers by minimizing the reflection of images on side windows, thereby improving the viewing experience when looking at side mirrors.
Smart Images

Figure 0007814663000001 
Figure 0007814663000002 
Figure 0007814663000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a display control device and a display system, and more particularly to a display control device and a display system that can reduce the visual inconvenience when a driver looks at a side mirror or the like, for example. [Background technology]
[0002] A display control device has been proposed that allows a driver to view displayed information even when the display device is located behind a steering wheel and is partially obstructed (see Patent Document 1). This display control device estimates the obstructed area of the display device that is obstructed by the steering wheel based on information acquired from an acquisition unit that acquires information about the setting position of the vehicle's steering wheel and information about the driver's line of sight, and adjusts the obstructed display information so that it is displayed in an unobstructed area according to the obstructed area. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-79879 Summary of the Invention [Problem to be solved by the invention]
[0004] However, the display control device described in Patent Document 1 does not take into consideration the possibility that the image displayed on the display device may be reflected on the side window, and there is still a problem that the driver may find it visually annoying when looking at the side mirror, etc.
[0005] The present invention has been made in consideration of the problems associated with the conventional technology, and aims to provide a display control device and a display system that can reduce the visual inconvenience experienced when a driver looks at a side mirror, etc. [Means for solving the problem]
[0006] As a result of extensive research into achieving the above-mentioned objective, the inventor discovered that the above-mentioned objective can be achieved by estimating the position of the counter-image formation area in the displayed image that forms a counter-image on the side window based on data such as the driver's eye position, and reducing the brightness of the counter-image formation area, thereby completing the present invention.
[0007] That is, the display control device of the present invention is a display control device that suppresses an image reflected on a side window by controlling the display image on the display device of this reflection image. This display control device includes a display device that displays the driving status of a vehicle, an acquisition unit that acquires position data of the driver's eyes, and a display device that acquires the position data of the driver's eyes, the display image displayed by the display device, and Side windows The image forming apparatus further includes an estimation unit that estimates the position of an anti-image forming area in the displayed image that is reflected on the side window and forms an anti-image based on the position data, and a brightness reduction unit that reduces the brightness of the anti-image forming area.
[0008] A display system of the present invention is a display system including a display device, an imaging device, and a display control device, the display control device being the display control device described above. [Effects of the Invention]
[0009] According to the present invention, the position of the counter-image formation area in the displayed image that forms a counter-image on the side window is estimated based on data such as the driver's eye position, and the brightness of the counter-image formation area is reduced, thereby providing a display control device and display system that can reduce the visual inconvenience when the driver looks at the side mirror, etc. [Brief explanation of the drawings]
[0010] [Figure 1] 1 is a perspective view schematically showing a part of a vehicle in which an embodiment of a display system of the present invention can be installed. [Figure 2] 1 is a block diagram showing a configuration of an embodiment of a display system of the present invention. [Figure 3]3A and 3B are explanatory diagrams showing in schematic form some examples of the left and right ranges of the opposite image formation area in the display system shown in FIG. 2. [Figure 4] 3 is an explanatory diagram schematically showing some examples of the upper and lower ranges of the image formation area in the display system shown in FIG. 2. FIG. [Figure 5] 3 is an explanatory diagram schematically showing a reflected image at a position overlapping with a side mirror through a side window in the display system shown in FIG. 2.
[0023] FIG. [Figure 6] 3A and 3B are explanatory diagrams showing in schematic form some examples of the upper and lower ranges of the reflection image forming area that forms a reflection image reflected on the front window in the display system shown in FIG. 2. DETAILED DESCRIPTION OF THE INVENTION
[0011] The display control device and display system of the present invention will be described in detail below with reference to the drawings. Note that the dimensional ratios of the drawings cited below are exaggerated for the convenience of explanation and may differ from the actual ratios.
[0012] 1 and 2, a display system 1 of this embodiment includes a display device 10, an imaging device 20, and a display control device 30. The display control device 30 suppresses an image reflected on a side window 40 by controlling the image displayed on the display device that causes the reflected image. Such a reflected image may be bothersome or unpleasant for the driver D, for example.
[0013] The display control device 30 in this embodiment includes an acquisition unit 31, an estimation unit 32, and a brightness reduction unit 33. The acquisition unit 31 includes an eye position data acquisition unit 31A that acquires eye position data 32A of the driver D. The estimation unit 32 estimates the position of an anti-image formation area 10A in the display image that is reflected on the side window 40 to form an anti-image, based on the acquired eye position data 32A of the driver D, position data 32B of the display image, and position data 32C of the side window 40. The brightness reduction unit 33 reduces the brightness of the anti-image formation area 10A. When reducing the brightness, the brightness reduction unit 33 displays, for example, an image that is only black in the anti-image formation area 10A. When reducing the brightness in this manner, for example, an engine control module (ECM) that controls the display of the meter panel (described later) may measure the illuminance in the vehicle cabin and automatically adjust the illuminance to a threshold value determined based on the illuminance.
[0014] Moreover, this display control device 30 may further include a display adjustment unit 34 (see FIG. 2). This display adjustment unit 34 adjusts the display image so that it does not include the reverse image formation area 10A. When making the above adjustment, this display adjustment unit 34, for example, prepares in advance a plurality of display image patterns with different sizes and arrangements that do not include the reverse image formation area 10A according to the eye position data 32A of the driver D, and switches to an appropriate display image pattern according to the eye position data 32A of the driver D.
[0015] Furthermore, a typical example of the above-mentioned reflected image is one that is located in the driver's line of sight and overlaps with the side mirror 50 through the side window 40. Such a reflected image can be further estimated based on the position data 32D of the side mirror 50. Here, "within the line of sight" may be interpreted as being within the range of peripheral vision that can be perceived without moving the eyes, that is, within the field of vision.
[0016] In addition, the above-mentioned estimation unit 32 may be configured to further estimate the position of the reflection image formation area 10B in the displayed image that is reflected on the front window 60 and forms a reflection image, based on the position data 32E of the front window 60.
[0017] Furthermore, in this display control device 30, the above-mentioned acquisition unit 31 may have a gaze data acquisition unit 31B that acquires gaze data 32F of the driver D (see FIG. 2). Then, when this gaze data acquisition unit 31B determines that the gaze has moved toward the side window, the above-mentioned brightness reduction unit 33 reduces the brightness of the counter-image formation area 10A.
[0018] Next, the specifications of the components in the above-described embodiment will be described in detail.
[0019] (display device) An example of the display device 10 is a meter panel that uses a thin film transistor liquid crystal display to display the driving status of the vehicle.
[0020] (imaging device) An example of the imaging device 20 is a ToF (Time-of-Flight) camera that can acquire eye position data 32A of the driver D in three-dimensional coordinates. Furthermore, it is preferable that the imaging device 20 can acquire line-of-sight data 32F of the driver D, and an example of such an imaging device is a driving monitor camera. The imaging device described above is disposed in front of the driver, and is typically disposed on the central upper surface of the dashboard or on the column cover of the steering wheel (see FIG. 2).
[0021] (Display control device) The display control device 30 includes a computer (not shown) that controls the display image of the display device 10 in response to input from the imaging device 20. The computer also includes, for example, a CPU (Central Processing Unit), an HDD (Hard Disk Drive), a RAM (Random Access Memory), and a ROM (Read Only Memory), all of which are not shown.
[0022] The CPU is a computing device that loads programs and data from storage devices such as HDD and ROM onto RAM and executes the processing, thereby controlling and implementing the functions of the entire computer. The CPU, ROM, RAM, etc. may be integrated into the same package. Furthermore, the display control device 30 may be configured to use other logical operation processors, such as a DSP (Digital Signal Processor), logic circuits, etc., instead of the CPU.
[0023] The HDD is a non-volatile storage device that stores programs (e.g., a program for estimating the position of the inverse image formation area) and data (e.g., display images in a vehicle, position data for side windows, side mirrors, and the front window). The stored programs and data include, for example, the OS (Operating System), which is the basic software that controls the entire computer, and application software that provides various functions on the OS. The HDD manages the stored programs and data using a predetermined file system or DB (database). Note that the computer may be equipped with an SSD (Solid State Drive) or the like instead of or in addition to the HDD.
[0024] RAM is a volatile semiconductor memory (storage device) that temporarily stores programs and data (for example, data on the driver's eye position and gaze data). ROM is a non-volatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off.
[0025] Next, the above-mentioned counter image and counter image forming area will be described in detail. 3 shows the display device 10, the side window 40, and the side mirror 50 in this embodiment as viewed from above the display device 10, etc., and shows the front-to-rear range of the reflected image reflected on the side window 40 at the driver's eye position A (EPA) and eye position B (EPB) and the left-to-right range of the reflected image formation area 10A. Note that the position of the driver's eyes may be based on, for example, the position of the eye closer to the side window 40, but is not particularly limited to this. As shown in FIG. 3, the left-to-right range of the reflected image formation area 10A changes as the driver's eye position changes depending on the driver's physique and the driver's sitting posture in the driver's seat.
[0026] 4 shows the display device 10, the side window 40, and the side mirror 50 in this embodiment as viewed from the back side of the display device 10, and shows the vertical range of the reflected image reflected on the side window 40 at the driver's eye position A (EPA) and eye position B (EPB) and the vertical range of the reflected image formation area 10A. As shown in FIG. 4, the vertical range of the reflected image formation area 10A changes as the driver's eye position changes as described above.
[0027] Furthermore, as shown in FIG. 5, the lower side of the displayed image on the side window 40 side is likely to become a reverse image forming area 10A where a reverse image is formed at a position overlapping with the side mirror 50.
[0028] 6 shows the display device 10 and the windshield 60 in this embodiment as viewed from the side of the display device 10, and shows the vertical range of the reflected image reflected on the windshield 60 at the driver's eye position A (EPA) and eye position B (EPB) and the vertical range of the reflected image formation area 10B. As shown in FIG. 6, the vertical range of the reflected image formation area 10B changes as the driver's eye position changes as described above.
[0029] Next, the advantages of this embodiment will be described. According to this embodiment, the position of the counter-image forming area 10A of the display image that forms a counter-image on the side window 40 is estimated based on the eye position data 32A of the driver D acquired by the imaging device 20, the position data 32B of the display image that has been prepared in advance, and the position data 32C of the side window 40, and the brightness of the counter-image forming area 10A is reduced, thereby reducing the visual inconvenience when the driver D looks to the side of the vehicle on the driver's side, including the side mirror 50.
[0030] Furthermore, according to this embodiment, the display adjustment unit 34 that adjusts the display image so that it does not include the reverse image formation area 10A is further provided, so that the display image can be displayed appropriately.
[0031] Furthermore, according to this embodiment, since the acquisition unit 31 acquires the eye position data 32A of the driver D in three-dimensional coordinates, the position of the counter image formation area 10A (10B) can be estimated more accurately.
[0032] Furthermore, according to this embodiment, if the reflected image is positioned so as to overlap with the side mirror 50 through the side window 40 in the driver's line of sight, the visual annoyance experienced by the driver D when looking at the side mirror 50 can be particularly reduced.
[0033] Furthermore, according to this embodiment, the estimation unit 32 also estimates the position of the reflection image formation area 10B of the displayed image that is reflected on the windshield 60 to form a reflection image, based on the position data 32E of the windshield 60, thereby reducing the visual inconvenience to the driver when looking ahead.
[0034] Furthermore, according to this embodiment, the acquisition unit 31 acquires the driver's line of sight data 32F, and when it is determined that the line of sight data 32F has moved toward the side window, the brightness reduction unit 33 reduces the brightness of the opposite image formation area 10A (10B). This allows the display image to be displayed larger on the display device 10 when the driver D's line of sight is not directed toward the side window 40. Furthermore, the above-mentioned adjustment of the display image may be performed when the driver D's line of sight is directed toward the side window 40. Furthermore, the above-mentioned brightness reduction and adjustment of the display image may be canceled when the driver D's line of sight is not directed toward the side window 40. [Explanation of symbols]
[0035] 1 Display System 10 Display device 10A,10B Reflection image forming area 20 Imaging device 30 Display control device 31 Acquisition Department 31A Eye position data acquisition unit 31B Gaze data acquisition unit 32 Estimation part 32A Eye position data 32B Display image position data 32C Side window position data 32D side mirror position data 32E Front window position data 32F Gaze Data 33 Brightness reduction section 34 Display adjustment section 40 Side window 50 Side mirror 60 Front window D. Driver EPA Eye Position A EPB Eye position B
Claims
1. a display device that displays the driving status of the vehicle; an acquisition unit that acquires driver's eye position data; an estimation unit that estimates a position of an anti-image forming area of the display image that is reflected on the side window and forms an anti-image, based on position data of the driver's eyes, the display image displayed by the display device, and the side window; a brightness reduction unit that reduces the brightness of the anti-image forming area; A display control device comprising:
2. The display control device according to claim 1 , further comprising a display adjustment unit that adjusts the display image so that the display image does not include the inverted image formation area.
3. 3. The display control device according to claim 1, wherein the acquisition unit acquires the eye position data of the driver in three-dimensional coordinates.
4. 4. The display control device according to claim 1, wherein the reflected image is positioned in the driver's line of sight so as to overlap with the side mirror seen through the side window.
5. The display device control device according to any one of claims 1 to 4, characterized in that the estimation unit also estimates the position of an anti-image formation area in the displayed image that is reflected on the front window and forms an anti-image, based on position data of the front window.
6. When the acquisition unit acquires the line of sight data of the driver and determines that the line of sight has moved toward the side window, The brightness reducing unit reduces the brightness of the anti-image forming area.
6. The display device control device according to claim 1, wherein the display device control device is a display device control unit.
7. A display system including a display device, an imaging device, and a display control device, The display control device is a display control device according to any one of claims 1 to 6. A display system comprising:
Citation Information
Patent Citations
Display control device, on-vehicle display device, display control method and control program
JP2007230401A
Display controller
JP2020079879A
Motor Vehicle Having a Display and A Camera
US20100302019A1
Display control device, display device, in-vehicle display system, and display control method
WO2017212610A1