Display unit
The display device addresses the issue of power consumption and user discomfort by estimating solar radiation areas and adjusting pixel brightness based on user positions and viewing angles, ensuring consistent contrast ratios for multiple users.
Patent Information
- Application Number
- JP2023071016
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-24
- Publication Date
- 2024-11-06
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing display devices adjust the brightness of the entire screen based on environmental conditions, leading to unnecessary power consumption and discomfort due to varying brightness perception based on viewing angle and light reflection characteristics, especially when multiple users are involved.
A display device that estimates solar radiation areas and non-solar radiation areas, adjusts pixel group brightness based on user position and viewing angles, and controls contrast ratios to ensure comfortable viewing for multiple users.
Reduces power consumption by selectively adjusting pixel brightness and maintains consistent contrast ratios across different viewing angles and light reflection conditions, providing a comfortable viewing experience for all users.
Smart Images

Figure 2024156502000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a display device capable of controlling the luminance of a display on a pixel-by-pixel basis or on a pixel-group basis up to a predetermined number of pixels. [Background technology]
[0002] Conventionally, display devices have been proposed that improve the visibility of the screen by controlling the brightness of the display when the display surface is exposed to sunlight (for example, Patent Document 1). The device described in Patent Document 1 is a vehicle display device mounted on a moving object such as an automobile, and is configured to automatically control the brightness level of the entire display screen based on conditions such as the time of use and the vehicle's traveling position. As a result, the brightness corresponds to the brightness of the surrounding environment in which the display device is mounted, even without providing a sensor for detecting brightness, improving the visibility of the display screen. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-184446 Summary of the Invention [Problem to be solved by the invention]
[0004] However, since this display device automatically controls the brightness level of the entire display screen in response to a predetermined condition, it is not possible to adjust the brightness level of only a part of the screen. For example, even in a situation where only a part of the display screen is exposed to sunlight, this display device increases the brightness level of the entire screen, resulting in an unnecessary increase in power consumption.
[0005] Therefore, it is conceivable to arrange multiple illuminance sensors around the display, estimate the solar radiation area of the display that is the area that receives solar radiation according to the illuminance signal from the illuminance sensor, and execute brightness control to make the estimated solar radiation area relatively brighter than other areas. This makes it possible to perform partial brightness control on the pixel group located in the solar radiation area among the constituent pixels of the display, i.e., the solar radiation pixel group, and improves the visibility of the solar radiation area of the displayed image while suppressing increases in power consumption.
[0006] However, the above brightness control does not take into account the change in brightness based on the viewing angle characteristics of the display itself and the influence of the reflection characteristics of light on the display screen. Specifically, due to the viewing angle characteristics of the display itself, the brightness perceived by the user changes depending on the user's position relative to the display screen even if the same set brightness is used. In addition, due to the reflection characteristics of light on the display screen, even if a certain amount of external light is reflected, the brightness of the reflected light perceived by the user changes depending on the user's position relative to the display screen. For this reason, a display image after brightness control based only on illuminance information obtained by multiple illuminance sensors may cause the user to feel uncomfortable. Furthermore, when there are multiple users, the viewing angle characteristics and reflection characteristics of the display change depending on the position of each user, making it difficult to make the image easy to view for each user.
[0007] In view of the above, an object of the present invention is to provide a display device that can perform brightness control that takes into account the viewing angle characteristics and light reflection characteristics of the display while suppressing increases in power consumption, and is capable of displaying images that do not cause discomfort to multiple users. [Means for solving the problem]
[0008] In order to achieve the above object, the display device according to claim 1 is a display device for controlling image display on a display (20) having a plurality of pixels, and includes a solar radiation estimation unit (12c) for estimating a solar irradiated region, which is a region of a display surface (20a) of the display that is irradiated by sunlight, and a non-sun irradiated region, which is the remainder of the display surface, based on position information of the sun and the display, an illuminance acquisition unit (12d) for acquiring illuminance information of the environment in which the display is installed, a position information acquisition unit (12e) for acquiring position information of a user relative to the display from an imaging device (34) that images a user of the display, and a position information acquisition unit (12f) for acquiring, based on the estimation result of the solar radiation estimation unit, the luminance of a solar irradiated pixel group, which is a pixel group located in the solar irradiated region among the plurality of pixels, and a non-sun irradiated region, which is the remainder of the display surface. and a luminance control unit (12f) that executes a first luminance control to make the luminance higher than that of a non-sunlight pixel group, which is a pixel group, wherein the position information acquisition unit acquires position information of at least two users, and the luminance control unit executes a second luminance control to make the difference in contrast ratio as seen by the two users for at least a portion of the area (R3, R4, R5) located between the two users on the display surface less than a predetermined value based on the user's position information relative to the display, the viewing angle characteristics of the display, and the light reflection characteristics on the display surface, wherein a portion of the display image including at least one of characters, figures, and symbols is defined as an information portion, and the remainder is defined as a background portion, and the contrast ratio is the ratio of the luminance of the information portion to the luminance of the background portion.
[0009] According to this, the solar radiation estimation unit estimates solar radiation areas and non-sun radiation areas on the display surface of the display, the position information acquisition unit acquires position information of multiple users relative to the display surface, and the luminance control unit performs a first luminance control to make the luminance of the solar radiation pixel group higher than the luminance of the non-sun radiation pixel group. The luminance control unit performs a second luminance control to make the difference in contrast ratio of at least a part of the area located between the two users on the display surface equal to or less than a predetermined value based on the position information of at least two users, the viewing angle characteristics of the display, and the light reflection characteristics of the display surface. This allows the display device to perform luminance control that takes into account the viewing angle characteristics and light reflection characteristics of the display without increasing the luminance of the entire pixel group more than necessary, and to display images that do not cause discomfort to multiple users.
[0010] Note that the reference symbols in parentheses attached to each component indicate an example of the correspondence between the component and specific components described in the embodiments described below. [Brief description of the drawings]
[0011] [Figure 1] 1 is a block diagram showing a display system according to an embodiment; [Diagram 2] 1 is an explanatory diagram of the line of sight angle and its distribution on the display surface of a display. [Diagram 3] FIG. 11 is a diagram illustrating an example of solar radiation region data. [Figure 4] 4 is a flowchart showing brightness control in the display system. [Diagram 5] FIG. 13 is a diagram illustrating an example of determining a luminance control coefficient based on an estimation result of a solar radiation area. [Figure 6] 1 is a diagram illustrating an example of a relationship between a user's line of sight angle with respect to a display surface of a display and a surface luminance ratio. [Figure 7] 1 is a diagram illustrating an example of a relationship between a user's line of sight angle with respect to a display surface of a display and a surface reflectance ratio. [Figure 8] 13 is an explanatory diagram of correction of a luminance control coefficient in the second luminance control executed when there is only one user. FIG. [Figure 9] 11 is an explanatory diagram of the distribution of gaze angles when there are two users; FIG. [Figure 10] FIG. 13 is an explanatory diagram of a comparative example of adjustment of a luminance control coefficient in the second luminance control calculated when there are two users. [Figure 11] 13 is an explanatory diagram of a first adjustment example of a luminance control coefficient in the second luminance control calculated when there are two users. FIG. [Figure 12] FIG. 13 is an explanatory diagram of a second adjustment example of the luminance control coefficient in the second luminance control calculated when there are two users. [Figure 13] FIG. 13 is an explanatory diagram of a third adjustment example of the luminance control coefficient in the second luminance control calculated when there are two users. [Figure 14] FIG. 11 is an explanatory diagram of a second brightness control when there are three or more users. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiments, parts that are the same or equivalent to each other will be denoted by the same reference numerals.
[0013] (Embodiment) An OLED display system to which a display device according to an embodiment is applied will be described. In this embodiment, a case where the OLED display system is an in-vehicle display system for use in a vehicle such as an automobile will be described as a representative example, but the OLED display system may of course be applied to other uses. The OLED display system may also be called an "organic EL display system" or an "EL display system." OLED and EL are abbreviations for Organic Light Emitting Diode and Electro-Luminescence, respectively.
[0014] [Basic configuration] The OLED display system of this embodiment includes a drawing controller 10, a display 20, and an in-vehicle device 30, as shown in FIG.
[0015] The drawing controller 10 corresponds to a display control device that controls image display by the display 20, and controls image display on the display 20 based on various signals transmitted from the in-vehicle device 30. For example, the drawing controller 10 is directly connected to the display 20 via a connection wire, and is connected to the in-vehicle device 30 via an in-vehicle LAN 40 that is an in-vehicle communication bus. LAN is an abbreviation for Local Area Network. Therefore, various signals from the in-vehicle device 30 are input to the drawing controller 10 directly or via the in-vehicle LAN 40. The detailed configuration of the drawing controller 10 will be described later.
[0016] The display 20 is a self-luminous display having a plurality of pixels constituted by self-luminous elements such as OLED. The display 20 displays an image corresponding to a video output signal from the drawing controller 10. The display 20 is configured to be capable of adjusting the luminance level by applying a variable driving voltage to each of the self-luminous elements constituting the display area for displaying an image, i.e., each of the pixels. As shown in FIG. 2, the display 20 has a horizontally long rectangular shape when the display surface 20a is viewed from the front, but is not limited thereto, and may have other shapes such as a square, a vertically long rectangular shape, or a curved shape.
[0017] In this specification, the display 20 will be described as an OLED display as a representative example, but since self-luminous displays such as OLED displays are well known, detailed description of the display itself will be omitted. In addition, although OLED will be described as a representative example of the self-luminous element, the self-luminous element is not limited to this, and other self-luminous elements such as inorganic EL and micro LED may be used.
[0018] Furthermore, the display 20 may be, for example, a liquid crystal display that uses a plurality of micrometer-sized micro LEDs as a backlight and can control the brightness for each minute area by local dimming, i.e., partial driving. In other words, the display 20 may be a display body that can control the brightness for each individual pixel or for each pixel group occupying an area of a predetermined size or less. An example of an area of a predetermined size or less is, but is not limited to, a 1 mm square size. When the above-mentioned liquid crystal display is used as the display 20, the first and second brightness controls described below are performed for each pixel group to which one of the multiple backlights is assigned.
[0019] The in-vehicle device 30 is composed of, for example, various devices for inputting video signals and vehicle information to the drawing controller 10, and various sensors for outputting detection signals corresponding to physical quantities such as illuminance and angular velocity to the drawing controller 10. Here, the in-vehicle device 30 is composed of a navigation device 31, a gyro sensor 32, an illuminance sensor 33, an occupant imaging device 34, a communication device 35, and a vehicle ECU 36. However, the above-mentioned configuration of the in-vehicle device 30 is merely an example, and in addition to the above-mentioned devices and sensors, the in-vehicle device 30 may have various devices such as multimedia and an air conditioning device, and may be modified as appropriate.
[0020] The navigation device 31 inputs video signals showing the current position of the vehicle and a map image, etc., to the drawing controller 10 based on map information stored in a map database. The navigation device 31 also inputs video signals showing, for example, an image for setting a destination, or an image related to facility and store information around the vehicle or the destination, to the drawing controller 10 based on a user's operation. Furthermore, the navigation device 31 obtains information related to the latitude, longitude, current time, and direction in which the vehicle is facing, for example, by a known GPS, and inputs this information to the drawing controller 10. GPS is an abbreviation for Global Positioning System.
[0021] The gyro sensor 32 is a sensor that detects an angular velocity corresponding to a change in the attitude of the vehicle as a voltage value. The gyro sensor 32 is fixed to the vehicle and measures the angular velocity occurring around each of three mutually orthogonal axes that are predefined for the vehicle. For example, the gyro sensor 32 measures the angular velocity associated with the yawing, pitching, and rolling of the vehicle, and sequentially outputs the measurement data to the drawing controller 10 or the like. For example, the measurement data of the angular velocity corresponding to the yawing of the vehicle output by the gyro sensor 32 is used to estimate the direction in which the vehicle travels, that is, the orientation in which the vehicle faces when viewed from above.
[0022] The illuminance sensor 33 is arranged, for example, near the display 20, and outputs a signal corresponding to the amount of sunlight on the display 20, that is, the environmental illuminance. For example, one or more illuminance sensors 33 are arranged near the display 20, and detect the environmental illuminance of the entire display surface of the display 20 or each of the divided regions obtained by dividing the display surface into a plurality of regions. For example, when the number of illuminance sensors 33 is three, the display region in which an image is displayed on the display 20 is set as the display region, and the display region is divided into three regions, and each of the three illuminance sensors 33 is associated with one of the first region to the third region. When there are multiple illuminance sensors 33, their arrangement and corresponding regions of the display region are arbitrary and are not limited to the above-mentioned example, and may be changed as appropriate. In this way, the illuminance sensor 33 detects the illuminance of the associated region, and outputs a detection signal corresponding to the illuminance to the drawing controller 10.
[0023] The occupant imaging device 34 is, for example, any imaging device that captures an image of a user of the display 20 among the occupants of the vehicle. The user to be imaged is, for example, a driver sitting in the driver's seat of the vehicle or an occupant sitting in the passenger seat. The occupant imaging device 34 is, for example, a Driver Status Monitor (registered trademark) manufactured by Denso Corporation, but is not limited to this. The occupant imaging device 34 estimates the position coordinates of the user's eyes in the vehicle from image data including the captured user's eyes based on, for example, a known image recognition technology. For example, a plurality of occupant imaging devices 34 are arranged in the cabin of the vehicle, and each captures an image of a different user's face.
[0024] For convenience of explanation, the user who is the subject of the image capture by the occupant image capture device 34 will be referred to as the “target user.” Also, as shown in FIG. 2, a point on the display surface of the display 20 that is located in the line of sight of the target user and the eye position P E The direction along the virtual straight line VL connecting these points and directed from the target user side to the display surface side is referred to as the "gaze direction."
[0025] Hereinafter, an example will be described in which an image of one target user is captured and a distribution of gaze angles as seen from the target user is calculated, which will be described later. Note that, for example, when there are multiple users, a calculation process is performed to calculate the distribution of gaze angles as seen from each user based on the image capture results of each user.
[0026] The passenger image capture device 34 outputs, for example, the estimated eye position coordinates of the target user to the drawing controller 10 as eye position information. The above-mentioned eye position information, together with, for example, preset position information of the display 20 in the vehicle, is used to calculate the angular distribution of the gaze direction of the target user on the display surface of the display 20, which is the surface on which various images are displayed. The "angle of the gaze direction" means, for example, as shown in FIG. 2, the gaze direction of the target user, that is, the angle θ between the virtual straight line VL and the normal direction D1 to the display surface of the display 20, and is 0° at a point P1 on the display surface 20a located in front of the target user. Hereinafter, the angle θ of the gaze direction is referred to as the "gaze angle θ". The distribution of the gaze angle θ is calculated, for example, for a plurality of divided areas obtained by dividing the display surface 20a of the display 20 by a predetermined area, but is not limited thereto. For example, as shown in FIG. 2, the user's eye positions P2, P3, P4, etc. on the display surface 20a are calculated in this order. E The farther away from the display 20, the larger the line-of-sight angle θ becomes. In other words, the display surface 20a has a distribution of line-of-sight angles θ. This distribution of line-of-sight angles θ may be calculated by the drawing controller 10 or may be calculated by the occupant imaging device 34. Note that the occupant imaging device 34 may be mounted at a position where it can capture an image of the eye of the user using the display 20, and may be disposed at any position within the cabin of the vehicle.
[0027] Note that the user's eye position P E may be estimated as separate position coordinates for the right eye and the left eye, or may be estimated as position coordinates corresponding to the center position of both eyes. In the former case, for example, the position P E Then, the gaze angle corresponding to the position of the right eye and the gaze angle corresponding to the position of the left eye are calculated, and the luminance control coefficient (described later) is calculated for each of the two eyes. In the latter case, for example, the center position of the two eyes is set to position P E The central position is used as a representative value to calculate the line of sight angle and a luminance control coefficient, which will be described later.
[0028] The communication device 35 acquires various types of information such as weather information via the Internet, for example, by wireless LAN, and outputs the weather information to the drawing controller 10 via the in-vehicle LAN 40. The weather information acquired by the communication device 35 may be input to an illuminance acquisition unit 12d, which will be described later, and used to estimate the environmental illuminance of the display 20. Note that the communication device 35 may also be used to acquire various types of information other than weather information, exchange data with the outside, and the like.
[0029] The vehicle ECU 36 is connected to, for example, the above-mentioned navigation device 31 to the communication device 35 via an in-vehicle LAN 40, and outputs signals and information from these various devices to the drawing controller 10. ECU is an abbreviation for Electronic Control Unit.
[0030] 1, the navigation device 31 is configured to directly input a video signal to the drawing controller 10. Similarly to the navigation device 31, the gyro sensor 32, the illuminance sensor 33, the passenger image capture device 34, and the communication device 35 may be configured to input various signals to the drawing controller 10 via the in-vehicle LAN 40 without going through the vehicle ECU 36.
[0031] The above is the basic configuration of an OLED display system.
[0032] [Drawing Controller] Next, the detailed configuration of the drawing controller 10 will be described.
[0033] As described above, the drawing controller 10 is an electronic control unit that controls the image display by the display 20, and is configured to have, as functional parts for realizing this, for example, a communication part 11, a control part 12, and an external memory device 13.
[0034] The communication unit 11 is a part that acquires information from the in-vehicle device 30 through the in-vehicle LAN 40. Signals and information transmitted from the in-vehicle device 30 to the in-vehicle LAN 40 are acquired by the communication unit 11. In FIG. 1, for example, for the navigation device 31, an acquisition path through which information and video signals can be directly input to the drawing controller 10 and an acquisition path through which they can be input via the communication unit 11 are shown. In this way, the acquisition path of the information and video signals from the in-vehicle device 30 is arbitrary, and the information and video signals may be directly input to the drawing controller 10 or may be input from the in-vehicle LAN 40 through the communication unit 11.
[0035] The control unit 12 is configured by, for example, a microcomputer equipped with a CPU, a ROM, a RAM, an I / O, and the like. The CPU, ROM, RAM, and I / O are abbreviations for Central Processing Unit, Read Only Memory, Random Access Memory, and Input / Output, respectively. The control unit 12 reads and executes various programs stored in the external storage device 13, thereby outputting a display image on the display 20 based on a video signal and information transmitted from the in-vehicle device 30. In addition, the control unit 12 receives, for example, a detection signal from an illuminance sensor 33, and adjusts the luminance level of the display 20 based on the detection signal. Specifically, the control unit 12 is configured to include a video input / combination unit 12a, a drawing unit 12b, a solar radiation estimation unit 12c, an illuminance acquisition unit 12d, a position information acquisition unit 12e, a luminance control unit 12f, and a video output unit 12g.
[0036] The video input / combining unit 12a receives a video signal directly from the in-vehicle device 30 or via the in-vehicle LAN 40, and outputs image data indicated by the video signal to the brightness control unit 12f. In addition, when there is image data rendered by the rendering unit 12b, the video input / combining unit 12a inputs the image data and combines it with the image data indicated by the video signal, and outputs the combined image data to the brightness control unit 12f.
[0037] The drawing unit 12 b receives various types of vehicle-related information acquired by the communication unit 11 and transmitted from the in-vehicle device 30 , and generates image data for drawing the information on the display 20 .
[0038] The solar radiation estimator 12c estimates the solar radiation area of the display 20, which is the area exposed to sunlight, based on the position information of the sun, the installation state of the display 20, and the attitude information of the vehicle, and outputs the estimation result to the brightness controller 12f. Specifically, the solar radiation estimator 12c acquires, for example, from the navigation device 31, angle information of the altitude and azimuth of the sun with respect to the vehicle, that is, solar information. In addition, for example, the external storage device 13 stores information on the panel mounting angle, which is the direction in which the normal direction to the display surface 20a of the display 20 on the vehicle points and corresponds to the angle of the altitude and azimuth of the sun. The solar radiation estimator 12c estimates the panel incidence angle, which is the angle of the altitude and azimuth of the sunlight with respect to the display surface 20a of the display 20, based on the solar information, the panel mounting angle, and the traveling direction of the vehicle acquired from the gyro sensor 32. Furthermore, for example, three-dimensional shape data of the vehicle and a plurality of solar radiation area data, which are distribution data of solar radiation areas and non-sun radiation areas occurring on the display surface of the display 20 according to the panel incidence angle of sunlight, are stored in advance in the external storage device 13. Then, the solar radiation estimation unit 12c estimates the solar radiation areas and non-sun radiation areas on the display surface 20a of the display 20 based on one or more solar radiation area data corresponding to the estimated panel incidence angle among the plurality of solar radiation area data.
[0039] The non-sunlight-irradiated area means the remaining area of the display surface 20a of the display 20 that is different from the sunlight-irradiated area, that is, the area where the sunlight does not directly enter. The sunlight-irradiated area data is, for example, as shown in Fig. 3, binarized image format data in which white corresponds to the sunlight-irradiated area and black corresponds to the non-sunlight-irradiated area, and is associated with coordinates on the display surface 20a of the display 20. The sunlight-irradiated area data is created in advance one by one corresponding to different panel incidence angles by appropriately setting the panel incidence angle based on the three-dimensional shape data of the vehicle and the arrangement of the display 20 using optical simulation software, for example.
[0040] The solar radiation estimator 12c may be configured to calculate an optical flow (OF), which is a vector indicating the direction and amount of change in the solar radiation area relative to the amount of change in the panel incidence angle, and estimate the solar radiation area using the OF, as described in, for example, JP 2022-187806 A. The solar radiation estimator 12c may be configured to estimate the solar radiation area based on output signals from a plurality of illuminance sensors 33 arranged near the display surface of the display 20, as described in JP 2021-92626 A. In this way, the solar radiation estimator 12c may be configured to estimate the solar radiation area and the non-sun radiation area by other known methods.
[0041] The illuminance acquisition unit 12d, for example, receives a detection signal from the illuminance sensor 33 and acquires the environmental illuminance in which the display 20 is installed. The illuminance acquisition unit 12d outputs, for example, an electrical signal corresponding to the environmental illuminance as illuminance information to the brightness control unit 12f. The illuminance acquisition unit 12d may also be configured to estimate the environmental illuminance based on, for example, weather information input from the communication device 35, time information, and data on the reference illuminance corresponding to the time stored in the external storage device 13 or the like. For example, a ratio to the reference illuminance corresponding to the weather information is set in advance, such as 100% when the weather information is sunny, 70% when it is cloudy, and 30% when it is rainy, and the ratio is stored in the external storage device 13 or the like. Then, for example, the illuminance acquisition unit 12d estimates a value obtained by multiplying the ratio corresponding to the acquired weather information by the reference illuminance as the environmental illuminance. In this manner, the illuminance acquiring unit 12d is configured to acquire illuminance information from the illuminance sensor 33, or estimate the illuminance based on time information and weather information from the communication device 35, for example.
[0042] The display system may be configured such that the in-vehicle device 30 has at least one of the illuminance sensor 33 and the communication device 35 for acquiring meteorological information, and the illuminance acquisition unit 12d can acquire or estimate the environmental illuminance of the display 20.
[0043] The position information acquisition unit 12e acquires eye position information of the user of the display 20 from, for example, the passenger imaging device 34. The user's eye position information is, for example, the eye position coordinates of the target user in the vehicle, and is calculated by a known image authentication technology using an image of the user captured by the passenger imaging device 34. For example, when there are multiple users, the position information acquisition unit 12e acquires or calculates eye position information for the multiple users individually. For example, the position information acquisition unit 12e estimates the distribution of the line of sight angle θ on the display surface 20a of the display 20 based on the position information of the display 20 and the eye position information of the target user. This will be described in detail later.
[0044] For ease of explanation, in the following, the pixel groups that make up the display 20 and are located in the sunlight-irradiated area will be referred to as the "sunlight-irradiated pixel group," and the pixel groups that are located in the non-sunlight-irradiated area, which is an area not exposed to sunlight, will be referred to as the "non-sunlight-irradiated pixel group."
[0045] The luminance control unit 12f adjusts the luminance of each of the sun-irradiated pixel group and the non-sun-irradiated pixel group of the display 20 for the image data input from the image input / combining unit 12a, and outputs the data to the image output unit 12g. The luminance control unit 12f determines the sun-irradiated pixel group and the non-sun-irradiated pixel group, for example, based on the sun-irradiated area estimated by the sun-irradiation estimation unit 12c. The luminance control unit 12f sets the luminance of the sun-irradiated pixel group and the non-sun-irradiated pixel group, for example, based on the environmental illuminance from the illuminance acquisition unit 12d and the estimation result of the sun-irradiated area / non-sun-irradiated area from the sun-irradiation estimation unit 12c. The luminance control unit 12f acquires, for example, angular distribution data of the line-of-sight angle θ on the display surface 20a of the display 20 from the position information acquisition unit 12e, and reads the viewing angle characteristic data of the display 20 and the light reflection characteristic data on the display surface 20a from the external storage device 13. Then, brightness control unit 12f corrects the set brightness of the sunlight pixel group and the non-sunlight pixel group based on, for example, the angle distribution data of the line of sight angle θ, the viewing angle characteristic data, and the reflection characteristic data. Brightness control unit 12f generates image data corresponding to the corrected set brightness for each of the sunlight pixel group and the non-sunlight pixel group. Brightness control unit 12f then outputs, for example, the image data with the adjusted set brightness to video output unit 12g. Details of this brightness control will be described later.
[0046] The video output unit 12g outputs a video output signal so that the image data after the luminance adjustment transmitted from the luminance control unit 12f is displayed on the display 20.
[0047] The external storage device 13 stores various programs executed by the control unit 12 and various data transmitted from the control unit 12, and allows the control unit 12 to read programs and write data. Note that, although the external storage device 13 is given here as a non-transitory tangible recording medium and is configured separately from the control unit 12, it may be a ROM or RAM within the control unit 12.
[0048] The above is the basic configuration of the drawing controller 10. Note that the drawing controller 10 is, for example, an electronic control unit independent of the in-vehicle device 30, but is not limited to this and may be configured as a part of the vehicle ECU 36.
[0049] [Brightness control overview] Next, brightness control in an OLED display system will be described.
[0050] For ease of explanation, hereinafter, the luminance due to energization of the image display of the pixel group of the display 20 is referred to as "set luminance", the light of sunlight or other light reflected by the display surface 20a of the display 20 is simply referred to as "reflected light", and the luminance due to the reflected light is referred to as "reflected luminance". Reflected luminance means the luminance due only to the reflected light, assuming that sunlight or other light is reflected by the display surface 20a in a black display or non-display state. In addition, the luminance perceived by a user who sees the light of a display image of the display 20 displayed at a predetermined set luminance superimposed with the reflected light of sunlight or other light on the display surface 20a is referred to as "visible luminance".
[0051] 2, when the display surface 20a of the display 20 is substantially rectangular in front view, the longitudinal direction, i.e., the direction along the width direction, is referred to as the "X direction," and the lateral direction, i.e., the direction perpendicular to the X direction, is referred to as the "Y direction." For example, in the case of an in-vehicle application, the display 20 is mounted on the vehicle so that the X direction is along the vehicle width direction.
[0052] The OLED display system executes the control flow shown in FIG. 4 when a predetermined start condition is met, for example, when the display 20 is turned on.
[0053] In step S100, for example, the control unit 12 acquires position information and date and time information of the vehicle from the in-vehicle device 30, specifies the latitude of the vehicle, and calculates the altitude angle and azimuth angle of the sun relative to the vehicle by a known method such as spherical trigonometry using the declination and hour angle of the sun.
[0054] In step S110, for example, the control unit 12 acquires the traveling direction of the vehicle from the gyro sensor 32, and calculates the panel incidence angle based on the traveling direction, the panel mounting angle, and the altitude angle and azimuth angle of the sun. This allows the incidence direction of sunlight on the display surface 20a of the display 20, i.e., the solar radiation direction, to be estimated.
[0055] In step S120, for example, the sunlight estimator 12c estimates the sunlight irradiated area and the non-sun irradiated area on the display 20 based on one or more sunlight irradiated area data corresponding to the sunlight direction estimated in step S110 from among the above-mentioned plurality of sunlight irradiated area data. Data on the estimation result of the estimated sunlight irradiated area and the non-sun irradiated area is output to, for example, the brightness controller 12f.
[0056] In step S130, for example, the position information acquisition unit 12e acquires eye position coordinates of the target user from the occupant image capture device 34. For example, when the occupant image capture device 34 detects one user, the position information acquisition unit 12e acquires the eye position coordinates of the one user, and when the occupant image capture device 34 detects two users, the position information acquisition unit 12e acquires the eye position coordinates of the two users.
[0057] In the next step S140, for example, the position information acquisition unit 12e acquires the position P E Based on this information and the position coordinates of display surface 20a of display 20, the distribution of gaze angles θ as shown in Fig. 2 is calculated by geometric calculation. Here, a case where only the distribution of gaze angles θ in the X direction of display surface 20a is calculated will be described as a representative example, but the distribution of gaze angles in the Y direction may also be calculated. The calculated gaze angle distribution data is output to, for example, brightness control unit 12f.
[0058] In step S150, the luminance control unit 12f executes a first luminance control to make the luminance of the sunlight irradiated pixel group higher than that of the non-sun irradiated pixel group based on the estimation result of the sunlight irradiated region / non-sun irradiated region and the ambient illuminance. As a result, the luminance of the sunlight irradiated pixel group is higher than that of the non-sun irradiated pixel group, and the set luminance is set according to the illuminance value of the sunlight irradiated region, so that the display 20 displays an image with a set luminance that is easy to see for both the sunlight irradiated region and the non-sun irradiated region. In addition, since the luminance of the non-sun irradiated region does not need to be higher than necessary, an increase in power consumption can be suppressed.
[0059] Here, when viewed from the front, display 20 has a viewing angle characteristic in which, even if the set luminance is constant, the visible luminance is highest in an area where the line of sight angle θ is 0°, while the visible luminance decreases toward an area where the line of sight angle θ is large. For this reason, even if an image with a uniform set luminance is displayed on display 20, the visible luminance changes for each area according to the line of sight angle θ on display surface 20a.
[0060] Furthermore, the display 20 has a reflection characteristic in which the reflected luminance increases in proportion to the reflectance of the display surface 20a, where the display surface 20a reflects external light such as sunlight and other light. The reflectance of the display surface 20a increases, for example, as the line-of-sight angle θ increases. For this reason, the reflected luminance of the display surface 20a is smallest in the frontal region located directly in front of the user's eyes, and a luminance distribution occurs in which the reflected luminance increases toward the region away from the frontal region.
[0061] The first brightness control described above does not take into account the change in the perceived brightness due to the viewing angle characteristics and the change in the reflected brightness due to the reflection characteristics. Therefore, the display image after only the first brightness control is performed may have a deviation between the set brightness and the perceived brightness, resulting in an unintended contrast ratio, which may cause the user to feel uncomfortable. The "contrast ratio" here means the ratio of the brightness of the information part of an image to the brightness of the background part of the image. For example, the information part is a part that displays information for the user, which is a part of the image that includes at least one of characters, figures, and symbols, and the background part is the remaining part other than the information part.
[0062] Therefore, in step S150, the luminance control unit 12f executes a second luminance control to correct a luminance control coefficient, which will be described later, based on the viewing angle characteristics and reflection characteristics of the display 20 and the distribution of the line-of-sight angle θ of the display surface 20a in accordance with the first luminance control. As a result, the set luminance is corrected to a luminance value that takes into account the distribution of the reflection luminance and the change in the visible luminance based on the viewing angle characteristics, and the difference in the contrast ratio between the regions in the displayed image is equal to or smaller than a predetermined value, thereby enabling image display that does not cause the user to feel uncomfortable. Finally, the video output unit 12g outputs the video signal after the second luminance control to the display 20 based on the output signal from the luminance control unit 12f. After that, the control unit 12 returns the process to step S100.
[0063] [Second Brightness Control: Single User] Next, the second brightness control when there is only one user will be described in detail.
[0064] 5 and 8 do not show cross sections, but in order to make the sunlight irradiated region R1 and the non-sun irradiated region R2 on the display surface 20a of the display 20 easier to understand, the non-sun irradiated region R2 is hatched.
[0065] First, the first luminance control will be described.
[0066] The luminance control unit 12f determines a luminance control coefficient α for each predetermined divided region of the display surface 20a based on the estimation results of the irradiated region R1 and the non-irradiated region R2 by the solar radiation estimation unit 12c and the information on the ambient illuminance from the illuminance acquisition unit 12d, for example as shown in FIG. 5.
[0067] 5 shows an example in which one brightness control coefficient α is set for each divided region obtained by equally dividing the display surface 20a, but the present invention is not limited to this. For example, for a divided region in which both a solar irradiated region R1 and a non-sun irradiated region R2 exist, the brightness control unit 12f may set different brightness control coefficients α for the regions R1 and R2.
[0068] The brightness control coefficient α is determined, for example, by the following equation (1).
[0069] α = (C × L R ) / L max (1) In equation (1), C is the target contrast value, L R is the reflected brightness, L max is the maximum value of the set luminance. The target contrast value is the value of the contrast ratio at which the image is perceived as easy to see according to the human visual characteristics, and is set appropriately within a predetermined range. In addition, the reflected luminance L R varies depending on the amount of light on the display surface 20a of the display 20, and is calculated, for example, by the following formula (2).
[0070] L R = a × E (2) In formula (2), a is a conversion coefficient for converting an illuminance value to luminance, and E is an illuminance value. The conversion coefficient a is calculated in advance, for example, by illuminating the display surface 20a of the display 20 in a black display or non-emitting state with an arbitrary light source to obtain a predetermined illuminance value, and measuring the luminance of the display surface 20a. When the display surface 20a of the display 20 is used covered with another transparent cover glass or the like, it is preferable to calculate the conversion coefficient a with the display 20 covered with the cover glass or the like. The illuminance value E is the environmental illuminance, and is determined based on an output signal from the illuminance sensor 33, for example.
[0071] The set luminance is a luminance value that is uniquely determined by, for example, a relational expression based on the gradation value in the video signal of the display image and the gamma characteristic of the display 20. For example, when a display 20 capable of adjusting the gamma characteristic is used, the set luminance is adjusted to a value corresponding to the environmental luminance by correcting the gamma characteristic according to the illuminance value. For example, when a self-luminous display 20 such as an OLED is used, the maximum value of the set luminance is determined, and the set luminance is adjusted to be lowered according to the illuminance value, thereby performing a relative luminance adjustment on the display surface. For example, a data table of correction values of the gamma characteristic corresponding to the illuminance value division is created in advance, and the data table is stored in the external storage device 13 or a recording medium (not shown) of the control unit 12. Then, for example, the above data table is read as necessary, and the gamma characteristic is adjusted, so that a set luminance that is easy to see according to the environmental illuminance can be determined. Note that the gradation value of the display image is set so that the information part and the background part have different set luminances, so that the contrast ratio is easy to see for the human visual characteristics.
[0072] For example, in the first brightness control, the brightness control unit 12f determines a brightness control coefficient α for each divided region based on the estimation result of the sunlight region R1 / non-sunlight region R2, the data table of the environmental illuminance and the set brightness, and the above formulas (1) and (2), as shown in Fig. 5. As a result, an easy-to-view set brightness is set for each of the sunlight region R1 / non-sunlight region R2, and the display 20 displays an image according to the environmental illuminance.
[0073] However, in the first brightness control, the set brightness is determined on the assumption that the entire display surface 20a of the display 20 is viewed from the front. In addition, when an image with a predetermined set brightness is displayed on the display surface 20a with a certain illuminance, the perceived brightness is the sum of the set brightness and the reflected brightness. Therefore, when the user views the display surface 20a from an oblique angle, a deviation may occur between the brightness assumed in the set brightness and the perceived brightness due to a change in the perceived brightness caused by the viewing angle characteristics of the display 20 and a change in the reflected brightness caused by the reflection characteristics. In this case, the contrast ratio in the image becomes an unintended value, and the contrast ratio of the image perceived by the user is outside the range that is easy to see with the human visual characteristics, which may cause the user to feel uncomfortable. In order to prevent such a situation, the display system of this embodiment executes the second brightness control.
[0074] Next, the second luminance control will be described.
[0075] In the second luminance control, the luminance control unit 12f corrects the luminance control coefficient α based on the angular distribution of the line-of-sight angle θ on the display surface 20a, the viewing angle characteristic data of the display 20, and the reflection characteristic data.
[0076] The viewing angle characteristic data is defined, for example, as a luminance maintenance rate when an image with a predetermined luminance value is viewed by changing the line of sight angle θ, and is prepared in advance as a data table consisting of the line of sight angle θ and the corresponding surface luminance ratio as shown in Fig. 6. The surface luminance ratio is, for example, the above-mentioned luminance maintenance rate, and is a value obtained by dividing the luminance when the line of sight angle θ is changed by the reference value (=1) where the line of sight angle θ=0°, i.e., the luminance in frontal view, is set as the reference value. For example, as shown in Fig. 6, the surface luminance ratios are 1.00, 0.95, 0.85, 0.70, and 0.50 at the portions where the line of sight angles θ=0°, 15°, 30°, 45°, and 60°, respectively, but are not limited thereto, and vary depending on the configuration of the display 20, etc.
[0077] The reflection characteristic data is defined as a reflection luminance ratio before and after changing the line of sight angle θ when viewing the display surface 20a with a predetermined illuminance value, and is prepared in advance as a data table consisting of the line of sight angle θ and the corresponding surface reflection ratio as shown in Fig. 7. The surface reflection ratio is, for example, a value obtained by dividing the reflection luminance when the line of sight angle θ=0°, i.e., the front view, by the reference value (=1) by the reference value. For example, the surface reflection ratios are 1.00, 1.00, 1.00, 1.20, and 2.50 at the portions where the line of sight angles θ=0°, 15°, 30°, 45°, and 60°, respectively, as shown in Fig. 7, but are not limited thereto, and vary depending on the configuration of the display surface 20a and the transparent cover covering it.
[0078] The viewing angle characteristic data and the reflection characteristic data are stored, for example, in the external storage device 13 or a recording medium (not shown) of the control unit 12, and are read in the second brightness control. The viewing angle characteristic data and the reflection characteristic data can be created, for example, by using the display 20 and an arbitrary light source and performing brightness measurement while changing the line of sight angle θ.
[0079] When the display 20 is viewed from the front, the maximum luminance of the information part of the image is 500 cd / m 2 , the maximum luminance of the background is 0cd / m 2 (=black display), reflected luminance is 6cd / m 2 Let us consider the contrast ratio when the contrast target value C=3.
[0080] In this case, the brightness control coefficient α is 3×6 / 500=0.036 according to formula (1). The contrast ratio is the value obtained by dividing the visible luminance of the information part by the visible luminance of the background part. If the visible luminance of the information part is "information luminance L1," the visible luminance of the background part is "background luminance L2," and the contrast ratio is C1, then information luminance L1, background luminance L2, and contrast ratio C1 are expressed by the following formulas (3), (4), and (5).
[0081] L1=L 01 ×α×β+L R1 ×γ (3) L2=L 02 ×α×β+L R2 ×γ (4) C1 = L1 / L2 (5) L in Equation (3) 01 The information section brightness setting, L R1 is the reflected luminance of the information part. 02 is the brightness setting for the background, L R2 is the reflected luminance of the background. In equations (3) and (4), β is the surface luminance ratio, and γ is the surface reflectance ratio.
[0082] 6 and 7, the surface luminance ratio is 1 and the surface reflectance ratio is 1, so the contrast ratio C1 is (500×0.036×1+6×1) / (0×0.036×1+6×1)=4. In the portion where the line of sight angle θ=0°, the contrast ratio C1 exceeds the contrast target value C=3, making it easy to see.
[0083] On the other hand, in the portion where the line of sight angle θ=60°, for example, the surface luminance ratio is 0.5 and the surface reflection ratio is 2.5, so the luminance of the information portion is 0.5 times and the reflection luminance is 2.5 times. Therefore, the contrast ratio C1 in the portion where the line of sight angle θ=60° is (500×0.5×0.036+6×2.5) / (0×0.5×0.036+6×2.5)=1.6. In the portion where the line of sight angle θ=60°, the contrast ratio C1 does not satisfy the contrast target value C=3, and the portion is not easy to see.
[0084] In the above example, the contrast ratio C1 of the part where the line of sight angle θ=15° is (500×0.95×0.036+6×1) / (0×0.95×0.036+6×1)=3.85. The contrast ratio C1 of the part where the line of sight angle θ=30° is (500×0.85×0.036+6×1) / (0×0.85×0.036+6×1)=3.55. The contrast ratio C1 of the part where the line of sight angle θ=45° is (500×0.7×0.036+6×1.2) / (0×0.7×0.036+6×1.2)=2.75. In this case, the contrast ratio C1 of the parts where the line of sight angle θ=15° and 30° exceeds the target value of 3, and is easy to see. In contrast, in the portion where the line of sight angle θ=45°, the contrast ratio C1 does not satisfy the target value of 3, and the image is not easy to see.
[0085] As described above, with only the first brightness control, the image may have a mixture of easily viewable contrast ratio C1 parts and unviewable contrast ratio C1 parts, which may cause the user to feel uncomfortable. In particular, for the non-sunlight region R2, the set brightness of the non-sunlight pixels is lower than that of the sunlight pixels, so depending on the line of sight angle θ, a region may appear very dark to the user.
[0086] Therefore, the luminance control unit 12f performs the second luminance control to correct the luminance control coefficient α based on the viewing angle characteristic data and the reflection characteristic data.
[0087] For example, in the above example, for the part where the line of sight angle θ=60°, the reflected luminance L in formula (1) is R The maximum brightness setting L is calculated by correcting the reflection characteristic data. max is corrected based on the viewing angle characteristic data, and the luminance control coefficient is calculated using the corrected luminance control coefficient in the second luminance control. C1 As a result, α C1 is calculated using the following equation (6).
[0088] α C1 =(C×L R_C ) / L max_C (6) L in Equation (6) R_C is the reflected luminance after correction based on the reflection characteristic data, and L max_C is the maximum value of the set luminance after correction based on the viewing angle characteristic data. Specifically, the corrected reflected luminance L R_C is the value obtained by multiplying the luminance converted by the ambient illuminance by the surface reflectance ratio, i.e. 6 × 2.5 = 15 cd / m 2 In addition, the maximum brightness setting L max is the value obtained by multiplying the set luminance by the surface luminance ratio, i.e. 500 × 0.5 = 250 cd / m 2 In addition, the corrected luminance control coefficient α C According to formula (3), it becomes (3×15) / 250=0.18. And, by the second luminance control, the contrast ratio C1 in the part where the line of sight angle θ=60° becomes (500×0.5×0.18+6×2.5) / (0×0.5×0.18+6×2.5)=4, which exceeds the contrast target value C=3 and results in an easy-to-view state.
[0089] In addition, in the portion where the line of sight angle θ=0°, the surface luminance ratio is 1 and the surface reflection ratio is 1, and there is no change in the maximum value of the reflected luminance and the set luminance. Therefore, the luminance control coefficient α C1 =α, and the contrast ratio C1 remains at 4 as above. For example, the portion where the line of sight angle θ is 15°, 30°, and 45° has a corrected brightness control coefficient α C is approximately 0.038, approximately 0.042, and approximately 0.062, and the contrast ratio C1 is 4 in all cases.
[0090] As described above, in the second luminance control, the luminance control unit 12f corrects each of the luminance control coefficients α calculated for each divided region based on the angular distribution of the line of sight angle θ, the viewing angle characteristic data, and the reflection characteristic data, and calculates the corrected luminance control coefficients α C1For example, as shown in Fig. 8, it is assumed that the brightness control coefficient α of the divided region corresponding to the sunlit region R1 is set to 1 and the brightness control coefficient α of the divided region corresponding to the non-sunlit region R2 is set to 0.4 by the first brightness control based on the estimation result of the sunlit region. In this case, for example, the brightness control unit 12f calculates the corrected brightness control coefficient α of each divided region based on the angular distribution of the line of sight angle θ and the surface brightness ratio (i.e., viewing angle characteristics) and surface reflection ratio (i.e., reflection characteristics) corresponding to the line of sight angle θ. C1 Calculate α and set it to α C1 As a result, brightness control is performed taking into consideration the viewing angle characteristics and reflection characteristics of display 20, and the contrast ratio C1 perceived by the user is a value that is easy to view, and the difference in contrast ratio C1 within the image is within a predetermined range, so that an image is displayed that does not give the user any sense of discomfort.
[0091] 5 to 8 show examples in which various values of the line of sight angle θ are set in increments of 15°, but the present invention is not limited to this and may be changed as appropriate to, for example, in increments of 5° or 10° depending on fluctuations in the surface luminance ratio and the surface reflectance ratio. The luminance control coefficients, surface luminance ratios, and surface reflectance ratios shown in Figs. 5 to 8 are merely examples and may be changed as appropriate depending on the configuration of display 20, surface treatment of display surface 20a or the transparent member covering it, and the like.
[0092] In the above, an example has been described in which the brightness control coefficient α is corrected in the second brightness control so that the difference in contrast ratio within the screen becomes 0, but the present invention is not limited to this and it is acceptable for a difference in contrast ratio to occur that is not unnatural to the human eye. Furthermore, in the above, an example has been described in which the second brightness control is performed on the non-sunlight pixel group, but of course the second brightness control may also be performed on the sunlight pixel group.
[0093] In addition, in the above, the case where the contrast target value C is a constant has been described as a representative example, but the present invention is not limited to this. For example, when the set luminance required for a display that is easy to see for a certain reflected luminance can be expressed by a predetermined relational expression such as the following expression (7), the contrast target value C may be calculated as a value according to the reflected luminance as in expression (8) and set as needed. Note that x and y in expression (7) are arbitrary constants determined by the relationship between the set luminance and the reflected luminance.
[0094] Set luminance = x × reflected luminance + y (7) C = (x + 1) + y / reflected luminance (8) [Second Brightness Control: Issues for Two Users] Next, a second problem with brightness control when there are two users will be described.
[0095] For example, when the two occupant imaging devices 34 detect the faces of different users, the position information acquisition unit 12e calculates the distribution of the two gaze angles θ based on the eye position information of each user. Note that the detection of multiple users may be performed based on an in-vehicle device 30 other than the occupant imaging device 34, for example, an occupant sensor (not shown) mounted on each seat or seat belt, or may be performed by any other known method.
[0096] For convenience of explanation, the line-of-sight angle θ based on the viewpoint of the first user is referred to as the “line-of-sight angle θ1” and the line-of-sight angle θ based on the viewpoint of the second user is referred to as the “line-of-sight angle θ2” as shown in FIG. E1 The line of sight angle θ2 is the angle between a virtual line VL1 connecting the eye position P of the second user and a point on the display surface 20a in the line of sight of the first user, and a normal direction D1 of the display surface 20a. E2 and a point on the display surface 20a in the line of sight of the second user, and the angle formed by the normal direction D1 of the display surface 20a.
[0097] The position information acquisition unit 12e, for example, calculates the distribution of the line-of-sight angles θ1 and θ2 in the same manner as described above, and outputs the angle distribution data of the line-of-sight angles θ1 and θ2 to the luminance control unit 12f. Then, the luminance control unit 12f, for example, calculates the luminance control coefficient α corresponding to each user for each divided area of the display 20, as shown in FIG. 10, based on the angle distribution data of the line-of-sight angles θ1 and θ2, the viewing angle characteristic data, and the reflection characteristic data in the same manner as described above. C1 Calculate.
[0098] 10, some of the continuous regions among the multiple divided regions will be referred to as the "first region Z1", "second region Z2", "third region Z3", "fourth region Z4", and "fifth region Z5" from the left in the X direction for the sake of distinction. Also, in FIG. 10, for the sake of clarity, the brightness control coefficient α C1 13, although it is not a cross-sectional view, areas with a higher contrast ratio are indicated with white hatching, and areas with a lower contrast ratio are indicated with black hatching.
[0099] Here, as shown in Fig. 10, one position in the Y direction among the divided regions of the display 20, and one row along the X direction will be described as a representative example, but the same processing as described below is performed for other rows. For convenience, the following will be used to calculate the brightness control coefficient α C1 Let us use the "brightness control coefficient α C1-1 ". Also, a luminance control coefficient α calculated based on the distribution of the line-of-sight angle θ2 of the second user, the viewing angle characteristic data, and the reflection characteristic data is called C1 Let us use the "brightness control coefficient α C1-2 " It is called.
[0100] Brightness control coefficient α C1-1 , α C1-2 If only one of the two users is reflected, the displayed image may be easy to view for one of the two users, but may not be easy to view for the other user. C1-1 and the brightness control coefficient α corresponding to the second userC1-2 Based on the above, a new brightness control coefficient α corresponding to both users is calculated for a part of the multiple divided regions. C2 Calculate.
[0101] Hereinafter, the new brightness control coefficient α C2 The area where is calculated is called the "adjustment area R3". The adjustment area R3 is a part or all of an area located between at least two users on the display 20, or an area gazed upon by both of the two users. For example, in a case where the positions of the two users and the arrangement of the display 20 are determined in advance, such as in an in-vehicle application, the adjustment area R3 may be set as an area located between an area located in front of the driver's seat and an area located in front of the passenger seat on the display 20. The adjustment area R3 may be calculated as an area located between an area in front of the first user and an area in front of the second user on the display 20, based on the position information of the display 20 and the position information of the eyes or heads of the two users from the passenger imaging device 34. Also, for example, the gaze areas located in the central visual field and the effective visual field of each of the two users on the display 20 may be calculated based on the line-of-sight directions of the two users from the passenger imaging device 34, and the overlapping areas of these gaze fields may be set as the adjustment area R3. The gaze area is calculated, for example, by calculating the coordinates of the intersection between a virtual line formed by the gaze directions of the two users and the display surface 20a of the display 20, and is calculated as an area located within a predetermined range of viewing angles (for example, within 10 degrees) centered on the intersection. In this way, the adjustment area R3 is determined by any method.
[0102] Brightness control coefficient α C2 As a method of calculating the brightness control coefficient α C1-1 , α C1-2 It is conceivable to compare these values and select a larger value from the viewpoint of safety. However, if the brightness control coefficient is determined by such a simple combination, a part of the contrast ratio C1 in the first to fifth regions Z1 to Z5 will have an area where the contrast ratio C1 changes suddenly from the viewpoint of either of the two users, resulting in a display that feels unnatural.
[0103] Specifically, for example, the line-of-sight angle θ1 is 60° in the second region Z2, 45° in the third region Z3, 30° in the fourth region Z4, and 15° in the fifth region Z5. The line-of-sight angle θ2 is 15° in the first region, 30° in the second region Z2, 45° in the third region Z3, and 60° in the fourth region Z4. When the display 20 is viewed from the front, the maximum luminance of the information portion of the image is 500 cd / m 2 , the maximum luminance of the background is 0cd / m 2 (=black display), reflected luminance is 6cd / m 2 In this case, the contrast target value C is 3. In this case, the luminance control coefficients α C1-1 According to the formula (6), the luminance control coefficients α C1-2 According to equation (6), these are approximately 0.037, approximately 0.042, approximately 0.062, and 0.18, respectively. If the second region Z2, the third region Z3, and the fourth region Z4 are adjustment region R3 and a larger brightness control coefficient is selected by a simple combination, the brightness control coefficients of the second to fourth regions Z2 to Z4 are 0.18, 0.062, and 0.18, respectively.
[0104] In FIG. 10, due to space limitations, the brightness control coefficient α C1-1 , α C1-2 Among these, where there are four decimal places or less, the numerical values are expressed by rounding off the fourth decimal place. Specifically, in Fig. 10, 0.037 is 0.037895..., 0.042 is 0.042353..., and 0.062 is 0.061714..., which are numerical values obtained by rounding off the fourth decimal place. The same applies to the brightness control coefficients written to the third decimal place in Figs. 11 to 13.
[0105] Here, the contrast ratios of the second to fourth regions Z2 to Z4 as viewed by the first user are calculated. The second region Z2 has a surface luminance ratio of 0.5, a surface reflection ratio of 2.5, and a corrected reflection luminance L R-C 6×2.5=15cd / m2 The contrast ratio C1 is (500×0.5×0.18+6×2.5) / (0×0.5×0.18+6×2.5)=4. The third region Z3 has a surface luminance ratio of 0.7, a surface reflection ratio of 1.2, and a corrected reflection luminance L R-C 6×1.2=7.2cd / m 2 The contrast ratio C1 is (500×0.7×approximately 0.062+6×1.2) / (0×0.7×approximately 0.062+6×1.2)≒4. The fourth region Z4 has a surface luminance ratio of 0.85, a surface reflection ratio of 1, and a corrected reflection luminance L R-C is 6×1=6cd / m 2 and the contrast ratio C1 is (500×0.85×0.18+6×1) / (0×0.85×0.18+6×1)=13.75. In other words, the display image seen by the first user has a contrast ratio of 3 or more in the third region Z3 and the fourth region Z4, and the difference between these is three times or more, resulting in a rapid change in contrast ratio.
[0106] In addition, the contrast ratios of the second to fourth regions Z2 to Z4 as viewed by the second user are calculated. The second region Z2 has a surface luminance ratio of 0.85, a surface reflection ratio of 1, and a corrected reflection luminance L R-C is 6×1=6cd / m 2 The contrast ratio C1 is (500×0.85×0.18+6×1) / (0×0.85×0.18+6×1)=13.75. The third region Z3 has a surface luminance ratio of 0.7, a surface reflection ratio of 1.2, and a corrected reflection luminance L R-C 6×1.2=7.2cd / m 2 The contrast ratio C1 is (500×0.7×approximately 0.062+6×1.2) / (0×0.7×approximately 0.062+6×1.2)≒4. The fourth region Z4 has a surface luminance ratio of 0.5, a surface reflection ratio of 2.5, and a corrected reflection luminance L R-C 6×2.5=15cd / m 2and the contrast ratio C1 is (500×0.5×0.18+6×2.5) / (0×0.5×0.18+6×2.5)=4. In other words, the display image seen by the second user has a contrast ratio of 3 or more in the second region Z2 and the third region Z3, and the difference between these is three times or more, resulting in a sudden change in contrast ratio.
[0107] As described above, the brightness control coefficient α C1-1 , α C1-2 If the larger value of these is set as the brightness control coefficient, the contrast ratio in the adjustment region R3 will change suddenly from the viewpoint of either of the two users, resulting in an image that gives a sense of incongruity. In order to prevent such a sudden change in the contrast ratio, the brightness control unit 12f performs the adjustment of the brightness control coefficient, which will be described next.
[0108] [Second Brightness Control: First Adjustment for Two Users] For example, as shown in FIG. 11, the luminance control unit 12f sets a luminance control coefficient α C1-1 , α C1-2 The average of these is calculated as a new brightness control coefficient α C2 The brightness control coefficient α C1-1 , α C1-2 are calculated under the same conditions as those for the distribution of the line-of-sight angles θ1 and θ2, the maximum luminance of the information portion and the background portion, the reflected luminance, the surface luminance ratio, the surface reflectance ratio, and the contrast target value described in FIG.
[0109] For example, the luminance control unit 12f sets α C1-1 , α C1-2 These values are adjusted to the average values of about 0.111, about 0.062, and about 0.111, and the new brightness control coefficient α C2 It should be noted that the brightness control coefficient 0.111 in Fig. 11 is a value obtained by rounding off 0.11117··· to three decimal places.
[0110] In this case, the second to fourth regions Z2 to Z4 seen by the first user have a reduced change in contrast ratio between adjacent regions. Specifically, the second region Z2 has a surface luminance ratio of 0.5, a surface reflection ratio of 2.5, and a corrected reflection luminance L R-C 6×2.5=15cd / m 2 Therefore, the contrast ratio C1 of the second area Z2 as seen by the first user is (500×0.5×approximately 0.111+6×2.5) / (0×0.5×approximately 0.111+6×2.5)≒2.85. C2 Since the surface brightness ratio is the same as above, the result is approximately 4. The fourth area Z4 has a surface brightness ratio of 0.85, a surface reflection ratio of 1, and a corrected reflection brightness L R-C is 6×1=6cd / m 2 and the contrast ratio C1 is (500×0.85×approximately 0.111+6×1) / (0×0.85×approximately 0.111+6×1)≈8.88. The display image seen by the first user has contrast ratios of approximately 2.85, approximately 4, and approximately 8.88 in the second to fourth regions Z2 to Z4, and the change in contrast ratio in the adjustment region R3 is suppressed, reducing the sense of incongruity compared to when the images are simply combined.
[0111] The contrast ratios in the second to fourth regions Z2 to Z4 as viewed by the second user are as follows: The second region Z2 has a surface luminance ratio of 0.85, a surface reflection ratio of 1, and a corrected reflection luminance L R-C is 6×1=6cd / m 2 The contrast ratio C1 is (500×0.85×approximately 0.111+6×1) / (0×0.85×approximately 0.111+6×1)≒8.88. The third region Z3 has a new luminance control coefficient α C2 Since the surface luminance ratio is the same as above, the result is approximately 4. The fourth area Z4 has a surface luminance ratio of 0.5, a surface reflectance ratio of 2.5, and a corrected reflected luminance L R-C 6×2.5=15cd / m 2and the contrast ratio C1 is (500×0.5×approximately 0.111+6×2.5) / (0×0.5×approximately 0.111+6×2.5)≈2.85. That is, the display image seen by the second user has contrast ratios of about 8.88, about 4, and about 2.85 in the second to fourth regions Z2 to Z4, and similarly to the case seen by the first user, the change in contrast ratio is reduced compared to before adjustment.
[0112] As a result, even when there are two users, the displayed image reflects the viewing angle characteristics and reflection characteristics as seen by each user, while reducing the change in contrast ratio for each user, thereby reducing the sense of discomfort.
[0113] In addition, for the divided regions other than the adjustment region R3, the brightness control coefficient α C1-1 In the second user side region, the brightness control coefficient α C1-2 For example, the region on the first user side is the region closer to the eye position P of the first user than the adjustment region R3. E1 The region on the second user side is a region closer to the eye position P of the second user than the adjustment region R3. E2 This is because it is assumed that the first user mainly views the area on the first user side, and the second user mainly views the area on the second user side. As a result, the difference in contrast ratio between the areas mainly viewed by each user is reduced for the display image displayed on the display 20, even for areas other than the adjustment area R3.
[0114] [Second Brightness Control: Second Adjustment for Two Users] For example, as shown in FIG. 12, when there is an area in the adjustment area R3 where the change in contrast ratio is large, the luminance control unit 12f increases the number of areas and assigns a new luminance control coefficient α C2 An adjustment may be performed to set
[0115] Specifically, the luminance control unit 12f first calculates the luminance control coefficient αC1-1 , α C1-2 The luminance control unit 12f selects the larger value. Then, for example, for the regions Z2 to Z4 that are the adjustment region R3, the luminance control unit 12f calculates the contrast ratios as seen by the first user and the contrast ratios as seen by the second user, and compares the contrast ratios for the two adjacent regions. At this time, if a predetermined condition is satisfied, for example, "the contrast ratio of at least one of the adjacent regions is 3 or more, and the contrast ratio of one region is twice or more the contrast ratio of the other region," the luminance control unit 12f sets a new region in the adjacent region.
[0116] The above-mentioned predetermined condition for determining whether to add an area is a condition that the user recognizes as a sudden change in contrast ratio between areas, and may be changed as appropriate according to the user's attributes such as age, eyesight, etc. In addition, the above-mentioned predetermined condition may be set by the user himself / herself, since the recognition of the difference in contrast ratio differs from user to user.
[0117] For example, the luminance control unit 12f sets a new region by setting a part of each of the second region Z2 and the third region Z3 as a sixth region Z6, and a part of each of the third region Z3 and the fourth region Z4 as a seventh region Z7. For example, the luminance control unit 12f sets the average value of the two luminance control coefficients in the original adjacent regions as a new luminance control coefficient α C2 Specifically, since the sixth region Z6 is located between the second region Z2 with a luminance control coefficient of 0.18 and the third region Z3 with a luminance control coefficient of approximately 0.062, the luminance control coefficient α C2 is set to approximately 0.12, which is the average value of these. Since the seventh region Z7 is located between the third region Z3 with the luminance control coefficient of 0.062 and the fourth region Z4 with the luminance control coefficient of 0.18, the luminance control coefficient α C2 is set to approximately 0.12, which is the average value of these. Note that the brightness control coefficient of approximately 0.12 here is the value obtained by rounding off 0.120857··· to two decimal places.
[0118] The surface luminance ratio and surface reflection ratio in the sixth region Z6 and the seventh region Z7 are determined according to the positions of the two users, but for convenience, the surface luminance ratio and the surface reflection ratio are assumed to be the intermediate value of the surface reflection ratios of the regions located on both sides. For example, the sixth region Z6 is between the second region Z2 with a surface luminance ratio of 0.5 and a surface reflection ratio of 2.5 and the third region Z3 with a surface luminance ratio of 0.7 and a surface reflection ratio of 1.2 from the first user's viewpoint, so the surface luminance ratio is 0.6 and the surface reflection ratio is about 1.8. The sixth region Z6 is between the second region Z2 with a surface luminance ratio of 0.85 and a surface reflection ratio of 1 and the third region Z3 with a surface luminance ratio of 0.7 and a surface reflection ratio of 1.2 from the second user's viewpoint, so the surface luminance ratio is about 0.8 and the surface reflection ratio is about 1.1. Similarly, the seventh region Z7 has a surface luminance ratio of approximately 0.8 and a surface reflectance ratio of 1.1 from the first user's viewpoint, and has a surface luminance ratio of 0.6 and a surface reflectance ratio of approximately 1.8 from the second user's viewpoint.
[0119] That is, the luminance control unit 12f resets at least one new region by combining a part of each of the adjacent regions whose contrast ratio difference satisfies a predetermined condition. Then, for the reset new region, i.e., the added region, the luminance control unit 12f sets a value between the luminance control coefficients set in the two regions on both sides of the added region, for example, an average value, as a new luminance control coefficient α C2 As a result, the difference in contrast ratio is reduced compared to before adjustment, making it possible to provide a display image that is less likely to cause discomfort when viewed by either of the two users.
[0120] In the second to fourth regions Z2 to Z4 as viewed by the first user, the contrast ratios are 4, 4, and 13.75, respectively, since the brightness control coefficients do not change before and after the adjustment. In the sixth region Z6, the surface brightness ratio is 0.6, the surface reflection ratio is about 1.8, and the corrected reflection brightness L R-C 6×1.8 ≒ 10.8 cd / m 2 Therefore, the contrast ratio C1 of the sixth region Z6 is (500×0.6×approximately 0.12+6×1.8) / (0×0.6×approximately 0.12+6×1.8)≒4.3. The seventh region Z7 has a surface luminance ratio of approximately 0.8, a surface reflection ratio of 1.1, and a corrected reflection luminance LR-C 6×1.1=6.6cd / m 2 Therefore, in the seventh region Z7, the contrast ratio C1 is (500×approximately 0.8×approximately 0.12+6×1.1) / (0×approximately 0.8×approximately 0.12+6×1.1)≈8.27. Therefore, in the adjustment region R3, the contrast ratios as seen by the first user are 4, approximately 4.3, 4, approximately 8.27, and 13.75, respectively, from the second region Z2 side to the right in the X direction, and the change in the contrast ratio is suppressed, reducing the sense of discomfort.
[0121] In the second to fourth regions Z2 to Z4 as viewed by the second user, the contrast ratios are 13.75, 4, and 4, respectively, since the brightness control coefficients do not change before and after the adjustment. In the sixth region Z6, the surface brightness ratio is about 0.8, the surface reflection ratio is 1.1, and the corrected reflection brightness L R-C 6×1.1=6.6cd / m 2 Therefore, in the sixth region Z6, the contrast ratio C1 as seen by the second user is (500×approximately 0.8×approximately 0.12+6×1.1) / (0×approximately 0.8×approximately 0.12+6×1.1)≒8.27. In the seventh region Z7, the surface luminance ratio is 0.6, the surface reflection ratio is approximately 1.8, and the corrected reflection luminance L R-C 6 x 1.8 ≒ 10.8 cd / m 2 Therefore, the contrast ratio C1 is about 8.27 as seen by the first user. Therefore, in the adjustment region R3, the contrast ratios as seen by the second user are 13.75, about 8.27, 4, about 4.3, and 4, respectively, from the second region Z2 side to the right in the X direction, so that the change in the contrast ratio is suppressed and the sense of discomfort is reduced.
[0122] The above-mentioned second adjustment also provides the same effect as the first adjustment.
[0123] In the above, an example was described in which one new region was added between the second region Z2 and the third region Z3, and one new region was added between the third region Z3 and the fourth region Z4, but the number of regions to be added may be two or more, and may be changed appropriately according to the difference in contrast ratio. For example, when adding two or more regions, new brightness control coefficients may be set so that the adjusted brightness control coefficients approach each other in stages, that is, so as to form a gradation, from one of the two original adjacent divided regions to the other.
[0124] [Second Brightness Control: Third Adjustment for Two Users] For example, as shown in FIG. 13, the luminance control unit 12f applies a luminance control coefficient α C1-1 and for the front region of the second user, a brightness control coefficient α C1-2 and select a new brightness control coefficient α C2 An adjustment may be performed to set
[0125] For ease of explanation, the area of the display surface 20a of the display 20 located in front of the first user will be referred to as the "first front area R4," and the area located in front of the second user will be referred to as the "second front area R5." In Fig. 13, a case will be described as a representative example in which the first front area R4 is an area to the right of the fourth area Z4 in the X direction and an area to the left of the second area Z2 in the X direction, but this is not limiting, and the areas R4 and R5 may be appropriately changed depending on the positions of the first and second users.
[0126] In the third adjustment, the luminance control unit 12f sets, for example, a luminance control coefficient α C1-1 Let us use the new brightness control coefficient α C2 This is because, for example, in the case of in-vehicle use, the first front region R4 is an area where images for the driver, such as meters and a navigation screen, are mainly displayed, and it is preferable to prioritize visibility for the first user.
[0127] In addition, the luminance control unit 12f may set, for example, a luminance control coefficient α C1-1Let us use the new brightness control coefficient α C2 This is because, for example, in the case of in-vehicle use, the second front area R5 is an area where images for passengers, such as audio and multimedia compatible screens, are mainly displayed, and it is preferable to prioritize visibility for the second user.
[0128] In addition, for the area other than the front areas R4 and R5, such as the third area Z3, a new brightness control coefficient α C2 is the brightness control coefficient α C1-1 , α C1-2 For example, if the other area mainly displays content for the first user, the brightness control coefficient α C1-1 However, when the content for the second user is mainly displayed, the brightness control coefficient α C1-2 is the new brightness control coefficient α C2 In the case where the other area displays the content for the first and second users, a new brightness control coefficient α C2 In this way, a new brightness control coefficient α C2 can be set appropriately.
[0129] According to the third adjustment, an area of the display 20 displaying content for a first user can display an image that is easy for the first user to see, and an area of the display 20 displaying content for a second user can display an image that is easy for the second user to see. In other words, according to the third adjustment, the change in contrast ratio seen by each user is reduced between a portion of an image displayed in an area viewed by one user and a portion displayed in an area viewed by the other user, so that neither user feels uncomfortable.
[0130] [Second Brightness Control: When there are three or more users] For example, as shown in FIG. 14(a), when three users, a first user U1, a second user U2, and a third user U3, are detected in that order from the left side in the X direction of the display 20, the luminance control unit 12f adjusts the luminance control coefficient as follows.
[0131] For example, the brightness control unit 12f groups the first user U1 and the second user U2 into a first group G1, and groups the second user U2 and the third user U3 into a second group G2, and performs one of the first to third adjustments described above for each of the two groups G1 and G2.
[0132] For example, the luminance control unit 12f determines an adjustment region R3 located between the first user U1 and the second user U2 on the display surface 20a of the display 20, that is, the adjustment region R3 of the first group G1. Also, for example, the luminance control unit 12f determines a luminance control coefficient α c1-1 , the brightness control coefficient α corresponding to the second user U2 c1-2 Then, the luminance control unit 12f calculates the luminance control coefficient α c1-1 , α c1-2 Based on this, the brightness control coefficient α of the first group G1 is adjusted by the first or second adjustment described above. c2-1 Alternatively, for example, the luminance control unit 12f calculates a luminance control coefficient α c1-1 , and for the region located in front of the second user U2, the brightness control coefficient α c1-2 , respectively.
[0133] For example, the luminance control unit 12f determines an adjustment region R3 located between the second user U2 and the third user U3 on the display surface 20a of the display 20, that is, the adjustment region R3 of the second group G2. For example, the luminance control unit 12f determines a luminance control coefficient α c1-2 , the brightness control coefficient α corresponding to the third user U3 c1-3Then, the luminance control unit 12f calculates the luminance control coefficient α c1-2 , α c1-3 Based on this, the brightness control coefficient α of the second group G2 is adjusted by the first or second adjustment described above. c2-2 Alternatively, for example, the luminance control unit 12f calculates a luminance control coefficient α c1-2 , and for the area located in front of the third user U3, the brightness control coefficient α c1-3 , respectively.
[0134] As a result, the gap area between adjacent users is determined to have an appropriate brightness control coefficient, or the front area of each user is determined to have the brightness control coefficient of the corresponding user, making it possible to display an image with reduced discomfort for each user even when there are three users.
[0135] In addition, the luminance control unit 12f also performs basically the same adjustment as above when four users, a first user U1, a second user U2, a third user U3, and a fourth user U4, are detected in order from the left side in the X direction of the display 20, as shown in FIG. 14(b), for example.
[0136] For example, the luminance control unit 12f may group the first user U1 and the second user U2 into a first group G1, the second user U2 and the third user U3 into a second group G2, and the third user U3 and the fourth user U4 into a third group G3. The luminance control unit 12f may then determine a luminance control coefficient for each of the groups G1, G2, and G3 by performing any one of the first to third adjustments in the same manner as described above.
[0137] As a result, even when there are four users, the area between adjacent users is determined to have an appropriate brightness control coefficient, or the front area of each user is determined to have the brightness control coefficient of the corresponding user, resulting in an image with reduced discomfort for each user. Although not shown, when there are five or more users, the first to third adjustments can be performed on the area between adjacent users for four groups, each group consisting of two adjacent users. In other words, when the number of users is n (n: an integer of 3 or more), the first to third adjustments can be performed on (n-1) groups, each group consisting of two adjacent users.
[0138] Also, as shown in FIG. 14(c), when three users are detected and the distance between some adjacent users is equal to or less than a predetermined distance, the luminance control unit 12f regards the adjacent users whose distance is equal to or less than a predetermined distance as one user and performs the adjustment of the luminance control coefficient. The term "equal to or less than a predetermined distance" here means, for example, but not limited to, a case where the distance between the eyes of the two detected users is equal to or less than 50 cm. For example, suppose that a first user U1, a second user U2, and a third user U3 are present in order from the left side in the X direction of the display 20, the distance between the users U1 and U2 is equal to or less than a predetermined distance, and the second user U2 and the third user U3 are far apart. In this case, for example, the luminance control unit 12f regards a first group G1 consisting of the users U1 and U2 who are close to each other as one user, and performs the first to third adjustments based on the luminance control coefficient corresponding to the first group G1 and the luminance control coefficient corresponding to the third user U3.
[0139] As a result, the area between the first group G1 and the third user U3 is determined to have an appropriate brightness control coefficient, or the front area of each user is determined to have the brightness control coefficient of the corresponding user, resulting in an image with reduced discomfort for each user. Note that, for example, the brightness control coefficient corresponding to either the first user U1 or the second user U2 is adopted as the brightness control coefficient corresponding to the first group G1. Although the above description is given of a case in which there are three users, the brightness control coefficient may be adjusted in a similar manner in a case in which there are four or more users and the distance between some of the users is equal to or less than a predetermined distance.
[0140] According to this embodiment, the luminance control unit 12f performs a first luminance control to make the luminance of the irradiated pixel group higher than that of the non-irradiated pixel group based on the estimation result of the irradiated region R1 / non-irradiated region R2 on the display surface 20a by the irradiance estimation unit 12c and the environmental illuminance acquired by the illuminance acquisition unit 12d. In addition, the luminance control unit 12f performs a second luminance control to make the difference in contrast ratio of at least the non-irradiated region R2 less than a predetermined value based on the distribution of the line-of-sight angle θ of the display surface 20a based on the user's position information, the viewing angle characteristic data and the reflection characteristic data of the display 20. As a result, the display system is capable of displaying images that do not cause a user to feel uncomfortable by performing luminance control that takes into account the viewing angle characteristics and light reflection characteristics of the display 20 without increasing the luminance of the entire pixel group more than necessary.
[0141] In addition, when there are two users, the line of sight angles θ1, θ2 and the brightness control coefficient α c1-1 , α c1-2 and calculates a new brightness control coefficient α for the adjustment region R3 located in the region between users, i.e., the gap region, of the display 20. c2 Set the brightness control coefficient α c2 is, for example, the brightness control coefficient α c1-1 , α c1-2 Alternatively, a new region is added to the adjacent region in which the difference in contrast ratio satisfies a predetermined condition, and the new region is assigned a luminance control coefficient α c1-1 , α c1-2As a result, the difference in contrast ratio in the gap area is reduced compared to before the adjustment, and the display system is capable of displaying an image in which the sense of incongruity caused by the difference in contrast ratio is reduced when viewed from any angle by each user.
[0142] Furthermore, in the case of two users, the brightness control coefficient α c1-1 , and for the front region of the second user, the brightness control coefficient α c1-2 , the new brightness control coefficient α c2 As a result, the difference in contrast ratio as seen by the first user is reduced in the area mainly gazed upon by the first user, and the difference in contrast ratio as seen by the second user is reduced in the area mainly gazed upon by the second user, resulting in a display in which the sense of incongruity is reduced for both users.
[0143] Also, when there are three or more users, two adjacent users are regarded as one group, and a new brightness control coefficient is determined for each group by one of the first to third adjustments described above. As a result, an appropriate brightness control coefficient is determined for the area between adjacent users, or the brightness control coefficient of the corresponding user is determined for the front area of each user, resulting in a display with reduced contrast ratio differences for each user. Also, when there are three or more users, when the distance between some adjacent users is equal to or less than a predetermined value, the adjacent users are regarded as one user, and one of the first to third adjustments described above is performed for adjacent users who are far away from each other. This also results in a display with reduced contrast ratio differences for each user.
[0144] (Other embodiments) Although the present disclosure has been described based on the embodiment, it is understood that the present disclosure is not limited to the embodiment or structure. The present disclosure also includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, and other combinations and forms including only one element, more than one, or less than one, are also within the scope and concept of the present disclosure.
[0145] The control unit 12 and the method described in the present disclosure may be implemented by a special-purpose computer provided by configuring a processor and a memory programmed to perform one or more functions embodied in a computer program. Alternatively, the control unit 12 and the method described in the present disclosure may be implemented by a special-purpose computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control unit 12 and the method described in the present disclosure may be implemented by one or more special-purpose computers configured by a combination of a processor and a memory programmed to perform one or more functions and a processor configured with one or more hardware logic circuits. Also, the computer program may be stored in a computer-readable non-transitory tangible recording medium as instructions executed by the computer.
[0146] In each of the above embodiments, it goes without saying that the elements constituting the embodiment are not necessarily essential, except when it is specifically stated that they are essential or when it is clearly considered essential in principle. In addition, in each of the above embodiments, when the numbers, values, amounts, ranges, etc. of the components of the embodiment are mentioned, they are not limited to the specific numbers, except when it is specifically stated that they are essential or when it is clearly limited to a specific number in principle. In addition, in each of the above embodiments, when the shapes, positional relationships, etc. of the components are mentioned, they are not limited to the shapes, positional relationships, etc., except when it is specifically stated that they are essential or when it is clearly limited to a specific shape, positional relationship, etc. in principle. [Explanation of symbols]
[0147] 12c Solar radiation estimation section 12d Illuminance acquisition section 12e Location information acquisition section 12f Brightness control section 20 Display 20a Display surface 34 Imaging device
Claims
1. A display device for controlling image display on a display (20) having a plurality of pixels, comprising: a solar radiation estimation unit (12c) that estimates a solar irradiated area, which is an area of a display surface (20a) of the display that is irradiated by the sun, and a non-sun irradiated area, which is the remaining part of the display surface, based on position information of the sun and the display; an illuminance acquisition unit (12d) for acquiring illuminance information of an environment in which the display is installed; a position information acquisition unit (12e) that acquires position information of the user relative to the display from an imaging device (34) that images the user of the display; a luminance control unit (12f) that executes a first luminance control to make a luminance of a solar radiation pixel group, which is a pixel group located in the solar radiation region among the plurality of pixels, higher than a luminance of a non-sun radiation pixel group, which is a pixel group located in the non-sun radiation region, based on an estimation result of the solar radiation estimating unit; The location information acquisition unit acquires location information of at least two of the users, the luminance control unit executes a second luminance control for making a difference in contrast ratio as seen by the two users equal to or less than a predetermined value for at least a part of an area (R3, R4, R5) located between the two users on the display surface based on position information of the user with respect to the display, a viewing angle characteristic of the display, and a light reflection characteristic on the display surface; A display device in which a portion of a display image on the display that includes at least one of characters, figures, and symbols is defined as an information portion, and the remaining portion is defined as a background portion, and the contrast ratio is the ratio of the luminance of the information portion to the luminance of the background portion.
2. In the second luminance control, the luminance control unit sets an area of the display surface located between the two users as an adjustment area (R3), and sets two luminance control coefficients (α c1-1 , α c1-2 ) is calculated, and the average value of the two brightness control coefficients is set as a new brightness control coefficient (α c2 2. The display device according to claim 1, wherein the display is set as follows:
3. The luminance control unit is In the second brightness control, A region of the display surface located between the two users and composed of a plurality of regions (Z2 to Z4) is defined as an adjustment region (R3), and two brightness control coefficients (α c1-1 , α c1-2 ) and selecting the larger of the two brightness control coefficients for the plurality of regions in the adjustment region as a brightness control coefficient; If the difference in the contrast ratio between two adjacent regions among the plurality of regions after the luminance control coefficients are selected is equal to or greater than a predetermined value, at least one new region (Z6, Z7) is added between the two regions, and a new luminance control coefficient (α c2 2. The display device according to claim 1, wherein the display is set as follows:
4. The luminance control unit is In the second brightness control, Two brightness control coefficients (α c1-1 , α c1-2 ) is calculated, For a first front region (R4) located in front of one of the users on the display surface, the brightness control coefficient corresponding to the one of the users is set as a new brightness control coefficient (α c2 ) and For a second front region (R5) of the display surface located in front of the other user, the brightness control coefficient corresponding to the other user is set as a new brightness control coefficient (α c2 2. The display device according to claim 1, wherein the display is set as follows:
Citation Information
Patent Citations
On-vehicle display device
JP1999184446A
