Display device and control method of display device
By dynamically adjusting brightness based on viewer type and estimated line of sight, the display device optimizes power usage and visibility for multiple users with different viewing needs.
Patent Information
- Application Number
- JP2023086385
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-25
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2043-05-25
AI Technical Summary
Existing display devices struggle to efficiently manage power consumption when multiple users with different viewing needs are present, such as a driver and passenger in a vehicle, leading to increased power usage due to expanded viewing areas.
The display device employs a system that acquires viewer facial images to estimate line of sight, sets predetermined brightness for visible areas, and reduces or sets to zero the brightness of non-visible areas, particularly for images unnecessary for specific viewers, such as a passenger, thereby controlling brightness based on viewer type.
This approach effectively reduces power consumption by minimizing unnecessary image brightness for non-drivers, ensuring clear visibility for drivers while conserving energy.
Smart Images

Figure 2024169156000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a display device and a method for controlling the display device. [Background technology]
[0002] As a display device, for example, the one described in Patent Document 1 is known. In the display device of Patent Document 1, a light-emitting section is provided on the back of a display panel (display section) that is divided. In addition, a gaze detection sensor detects the gaze position of the user relative to the display panel, and a distance detection sensor detects the distance between the display panel and the user. In the control section, a visual recognition area relative to the gaze position is set using the detected distance, and a non-visual recognition area other than the visual recognition area on the display panel is set as a control area. Then, the control section controls the amount of light emitted (brightness) of the light-emitting section, thereby decreasing the brightness of the control area as it becomes farther from the visual recognition area. This allows the light-emitting section to save power without impairing the user's visibility. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 6652251 Summary of the Invention [Problem to be solved by the invention]
[0004] The above Patent Document 1 states that the number of users may be multiple, but does not describe specific control procedures. For example, if a display device is mounted on a vehicle and the users are the driver and the passenger in the front seat, the visual target (area to be viewed) of each user will be different, and the overall visual area will expand, making it difficult to achieve power saving effects. Patent Document 1 does not describe any control that takes such a situation into account.
[0005] In view of the above problems, an object of the present disclosure is to provide a display device and a control method for the display device that can reduce power consumption of the display unit even when there are multiple users. [Means for solving the problem]
[0006] In order to achieve the above object, the present disclosure employs the following technical means.
[0007] In the first disclosure, a display unit (110) that forms a plurality of types of images on a display surface (110a) and displays the images to a viewer; An acquisition unit (120) for acquiring a face image of a viewer; a display control unit (132) that sets the luminance of an image in a visible region (116) on a display surface corresponding to a line of sight of a viewer estimated from a face image to a predetermined luminance to perform normal display, and executes luminance control that reduces the luminance of an image in a non-visual region (117) other than the visible region to below the predetermined luminance, The observers were the driver of the vehicle (D) and the passenger in the front seat (P), The display control unit executes brightness reduction control to relatively lower or set to zero the brightness of a specified image or a portion of a specified image that is predetermined as unnecessary or inappropriate for viewing among multiple types of images for at least one of the driver and passengers, even if it is within the viewing area.
[0008] According to the first disclosure, even when there are multiple viewers, such as the driver of a vehicle and a passenger in the front seat, for a specified image or a portion of a specified image that is unnecessary or inappropriate for the viewers to view, even if it is within the visible area, the brightness of the specified image or the portion of the specified image is relatively reduced or set to zero, thereby suppressing the expansion of the displayed image area and achieving power saving for the display unit.
[0009] In addition, in the second disclosure, a display unit (110) that forms a plurality of types of images on a display surface (110a) and displays the images to a viewer; An acquisition unit (120) that acquires a face image of a viewer, A method for controlling a display device, which performs brightness control to set the brightness of an image in a visible region (116) on a display surface corresponding to a gaze direction of a viewer estimated from a face image to a predetermined brightness for normal display, and to reduce the brightness of an image in a non-visual region (117) other than the visible region below the predetermined brightness, The observers were the driver of the vehicle and the passenger in the front seat. For at least one of the driver and the passenger, among a plurality of types of images, a predetermined image or a part of the predetermined image that is predetermined as unnecessary or inappropriate for viewing is subjected to brightness reduction control to relatively lower or set to zero the brightness of the predetermined image or the part of the predetermined image, even if the predetermined image or the part of the predetermined image is within the viewing area.
[0010] The second disclosure relates to a method for controlling the display device of the first disclosure above, and the technical significance thereof is essentially the same as that of the first disclosure, and the same effects can be obtained.
[0011] The reference characters in parentheses for each of the above means indicate the corresponding relationship with the specific means described in the embodiments below. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is an explanatory diagram showing an overall configuration of a display device. [Diagram 2] FIG. 2 is an explanatory diagram showing a display unit. [Diagram 3] FIG. 2 is an explanatory diagram showing a visual region and a non-visual region of a viewer. [Figure 4] FIG. 2 is an explanatory diagram showing targets of luminance control for passengers in the first embodiment. [Diagram 5] 13 is an explanatory diagram showing a case where the passenger visual recognition area is the second display portion (display). FIG. [Figure 6] 13 is an explanatory diagram showing a case where the passenger visual recognition area is the third display portion (display). FIG. [Figure 7] 13 is an explanatory diagram showing a case where the passenger visual recognition area is the fourth display portion (not shown). FIG. [Figure 8] FIG. 13 is an explanatory diagram showing a case where the fellow passenger visual recognition area is the first display portion (not displayed). [Figure 9] FIG. 11 is an explanatory diagram of a case in which A / C information is displayed to a passenger in the first modification of the first embodiment. [Figure 10] FIG. 13 is an explanatory diagram of a case in which back guide information is not displayed to a passenger in the first modification of the first embodiment. [Figure 11] FIG. 13 is an explanatory diagram showing a case where the driver visual recognition area is a fourth display portion (display) in the third modified example of the first embodiment. [Figure 12] FIG. 13 is an explanatory diagram showing a case where the driver visual recognition area is the second display portion (not displayed) in the third modified example of the first embodiment. [Figure 13] FIG. 11 is an explanatory diagram showing a display state accompanying a movement of a driver visual recognition area in the second embodiment. [Figure 14] FIG. 11 is an explanatory diagram showing a display state accompanying a movement of a fellow passenger visual recognition area in the second embodiment. [Figure 15] FIG. 13 is an explanatory diagram showing a display state (change in luminance) in a fellow passenger visual recognition area in the first modified example of the second embodiment. [Figure 16] FIG. 13 is an explanatory diagram showing the size of a display area for a driver and a passenger in a second modified example of the second embodiment. [Figure 17] FIG. 11 is an explanatory diagram showing a case in which streaks appear at the boundary between the display images of the driver and the passenger in the third embodiment. [Figure 18] 11 is an explanatory diagram showing a method for correcting the luminance distribution to suppress the occurrence of streaks. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, a number of embodiments for carrying out the present disclosure will be described with reference to the drawings. In each embodiment, the same reference numerals may be used to designate parts corresponding to matters described in the preceding embodiment, and duplicated descriptions may be omitted. In each embodiment, when only a part of the configuration is described, other embodiments described previously may be applied to other parts of the configuration. In addition to combinations of parts that are specifically indicated as being possible in each embodiment, it is also possible to partially combine embodiments even if not indicated, as long as there is no particular problem with the combination.
[0014] (First embodiment) A display device 100 according to a first embodiment is shown in Figs. 1 to 8. The display device 100 is mounted on a vehicle. The vehicle is, for example, a right-hand drive vehicle. In Figs. 5 to 8, the steering wheel 5 indicates that the vehicle is a right-hand drive vehicle. As shown in Fig. 1, the display device 100 forms an image to be displayed based on various information obtained from, for example, a vehicle ECU 10, a navigation system 20, a multimedia device 30, an air conditioner 40, and a communication device 50 via an in-vehicle LAN 60, and displays the formed image on a display unit 110. A viewer can view the image on the display unit 110. The viewer is a driver D and a passenger P in the passenger seat, and multiple people are targeted. The display device 100 controls the brightness of an image in a viewing area 116 based on the line of sight of the viewer and in a non-viewing area 117 other than the viewing area 116.
[0015] The vehicle ECU 10 is a part that controls various functional parts of the vehicle (functional parts for running, turning, stopping, etc.), and outputs vehicle information such as vehicle speed, engine RPM, remaining fuel, coolant temperature, shift lever position (P, R, N, D, etc.) obtained by various sensors to the drawing controller 130 (communication unit 131).
[0016] The navigation system 20 outputs navigation information such as date, time, current position (latitude, longitude), vehicle travel direction, and high-precision map based on the Global Navigation Satellite System (GNSS) to the drawing controller 130 (communication unit 131).
[0017] The multimedia 30 is a device that combines various types and formats of information, such as text, images, videos, and audio, and provides the information to the viewer. The multimedia 30 outputs an operation signal by the viewer to the communication unit 131 of the drawing controller 130, and also outputs a video signal to the video input / combination unit 1322 of the display control unit 132.
[0018] The air conditioner 40 is a device that performs air conditioning (cooling, heating, dehumidification, etc.) in the vehicle cabin, and outputs air conditioner information such as air conditioning setting conditions and operating status (mode, temperature, air volume) to the drawing controller 130 (communication unit 131).
[0019] The communication device 50 outputs various communication information obtained, for example, via the Internet, VICS (registered trademark), vehicle-to-vehicle communication, etc., to the drawing controller 130 (communication unit 131).
[0020] The display device 100 includes a display unit 110, an occupant camera 120, a drawing controller 130 (display control unit 132), and the like.
[0021] The display unit 110 is a section that displays predetermined information to a viewer, and for example, a self-luminous organic EL (Electro Luminescence) display made of a layered structure using organic compounds is used. The organic EL display is capable of forming an image by controlling the light emission of each pixel. The organic EL display is also referred to as an OLED (Organic Light Emitting Diode).
[0022] Since the display unit 110 is self-luminous, it does not require a backlight, such as a liquid crystal panel, and therefore the thickness dimension of the display unit 110 can be set to be extremely thin (thinned), and it is flexible.
[0023] The display unit 110 may be another type of display, such as a TFT (Thin Film Transistor) liquid crystal display using thin-film transistors, with a backlight as a light source.
[0024] The display unit 110 is set on the dashboard of the vehicle and is formed so as to extend in the left-right direction of the vehicle as shown in Fig. 2, that is, a so-called pillar-to-pillar type. The display area (display surface 110a) of the display unit 110 faces the viewer in an upright position and has a plurality of divided display areas, i.e., a plurality of display units 111 to 115, so as to display a plurality of different information (a plurality of types of images). The plurality of display units 111 to 115 are arranged in the horizontal direction seamlessly and are formed so as to appear as if they were a single horizontally long display unit 110 (for example, about 1300 mm wide).
[0025] The multiple display units 111 to 115 are, for example, a first display unit 111, a second display unit 112, a third display unit 113, a fourth display unit 114, and a fifth display unit 115 from the left side of the vehicle.
[0026] The first display unit 111 is a left mirror display, and displays an image of the left rear of the vehicle captured by a left rear camera.
[0027] The second display unit 112 is a display for the passenger seat and is positioned opposite the passenger P (passenger seat occupant) and displays entertainment information such as movies, music, television, radio, leisure, sports, and games obtained through the multimedia 30.
[0028] The third display unit 113 is a center display, and displays, for example, navigation information such as the current position and destination guide from the navigation system 20 and the communication device 50, A / C information from the air conditioner 40, or back guide information from a backup camera. The navigation information and A / C information are switched and displayed according to a setting operation by the viewer. In addition, the back guide information is automatically switched and displayed when the vehicle is backing up.
[0029] The fourth display unit 114 is a meter display and is disposed in a position facing the driver D, and displays vehicle information such as the vehicle speed, engine speed, remaining fuel, coolant temperature, and shift lever position obtained from the vehicle ECU 10.
[0030] The fifth display unit 115 is a right mirror display, and displays an image of the right rear of the vehicle captured by the right rear camera.
[0031] Incidentally, the display unit 110 is not limited to the five display units 111 to 115 as described above, and may be one display unit 110, or a combination of two or more display units 110. The layout of these display units 110 on the dashboard can also be set arbitrarily. In addition, the display unit 110 is not limited to being formed by a combination of the five display units 111 to 115, and may be formed as a single unit with the display surface 110a divided into five display areas.
[0032] The occupant camera 120 is an acquisition unit that acquires an image of mainly the upper body including the face of the viewer, and is provided, for example, in the rearview mirror portion inside the vehicle cabin, or in the upper center in the left-right direction of the vehicle of the display unit 110. As the occupant camera 120, for example, a CMOS camera is used, and data of the image (face image) captured by the occupant camera 120 is output to the visual recognition area estimation unit 1324 of the display control unit 132.
[0033] In addition, the occupant camera 120 is not limited to a dedicated front camera as described above, but may also be a camera set up for a DMS (driver monitoring system) that detects when the driver D is looking away or falling asleep and provides driving assistance, or an ADAS (advanced driving assistance system) that has a collision prevention function, lane departure detection function, etc., if the vehicle is equipped with such a system.
[0034] As shown in FIG. 1, the drawing controller 130 includes a communication unit 131, a display control unit 132, and the like.
[0035] The communication unit 131 is a component that receives various types of information data from the vehicle ECU 10, the navigation system 20, the multimedia system 30, the air conditioner 40, the communication device 50, and the like via the in-vehicle LAN 60.
[0036] The display control unit 132 is a unit that outputs video signals, brightness control signals, etc. to the display unit 110, and has a drawing unit 1321, a video input / combination unit 1322, a video output unit 1323, a visual recognition area estimation unit 1324, and a brightness control unit 1325, etc.
[0037] The drawing unit 1321 is a part that forms (draws) an image to be displayed on the display unit 110 based on various information data received by the communication unit 131.
[0038] The video input / combining unit 1322 is a unit that combines the video signal rendered by the rendering unit 1321 with the video signal obtained from the multimedia 30 .
[0039] The video output unit 1323 is a part that outputs a video signal for display to the display unit 110.
[0040] The visual recognition area estimation unit 1324 calculates (estimates) the visual recognition area 116 that is estimated to be actually viewed by the viewer out of the entire area of the display surface 110a of the display unit 110, as shown in Figure 3, based on the gaze direction estimated from the viewer's facial image obtained from the occupant camera 120.
[0041] The visual recognition area estimation unit 1324 calculates (estimates) the gaze direction (broken arrow) from the position of the pupil (black eye) relative to the position of the eye (white of the eye) during the viewer's eyeball movement. The visual recognition area estimation unit 1324 then calculates (estimates) as the visual recognition area 116 an area corresponding to a predetermined left-right width and up-down width, centered on a point (viewpoint) that reaches the display surface 110a in the gaze direction. The visual recognition area 116 is a horizontally long rectangle here. The visual recognition area estimation unit 1324 then calculates (estimates) as the non-visual recognition area 117 an area of the entire display surface 110a excluding the visual recognition area 116.
[0042] Among the viewers, the visible region 116 corresponding to the line of sight of the driver D is defined as the driver visible region 116a. In FIG. 3, an area roughly corresponding to the fourth display unit 114 is illustrated as the driver visible region 116a. The non-visible region 117 of the driver D is an area other than the driver visible region 116a. In this case, the non-visible region 117 is an area roughly corresponding to the first display unit 111, the second display unit 112, the third display unit 113, and the fifth display unit 115.
[0043] Similarly, the visual recognition area 116 corresponding to the line of sight of the passenger P among the viewers is defined as the passenger visual recognition area 116b. In FIG. 3, the area roughly corresponding to the second display unit 112 is illustrated as the passenger visual recognition area 116b. The non-visual recognition area 117 of the passenger P is an area other than the passenger visual recognition area 116b. In this case, the non-visual recognition area 117 is an area roughly corresponding to the first display unit 111, the third display unit 113, the fourth display unit 114, and the fifth display unit 115.
[0044] If the viewer is wearing sunglasses, for example, it is impossible to detect the eyes from the face image, and therefore it is impossible to calculate the gaze direction as described above. Therefore, the visual recognition area estimation unit 1324 calculates (estimates) the face direction from the viewer's facial outline, nose, mouth, ears, etc., and calculates (estimates) the gaze direction based on the face direction.
[0045] The luminance control unit 1325 is a unit that adjusts the luminance of the image displayed on the display unit 110. Basically, the luminance control unit 1325 sets the luminance of the image in the visible region 116 to a predetermined specified luminance (predetermined luminance), and reduces the luminance of the image in the non-visual region 117 below the specified luminance in the visible region 116 (hereinafter, luminance control).
[0046] Hereinafter, setting the brightness of the image in the visible region 116 to a predetermined specified brightness (predetermined brightness) may be referred to as "displaying".
[0047] In addition, for at least one of the driver D and passenger P, the brightness control unit 1325 is configured to relatively lower or set to zero the brightness of a predetermined image (predetermined display unit) or a portion of a predetermined image that is predetermined as unnecessary or inappropriate for viewing among the multiple types of images on each display unit 111 to 115, even if the predetermined image or a portion of the predetermined image falls within the visible area 116 (hereinafter referred to as brightness reduction control).
[0048] Hereinafter, with regard to a specified image (specified display section) or part of a specified image that has been predetermined as not requiring viewing or being inappropriate for viewing, even if it is within the visible area 116, the term "making hidden" may be used to mean relatively lowering the brightness of the specified image or part of the specified image or setting it to zero.
[0049] In this embodiment, the predetermined images that are unnecessary or inappropriate for the passenger P to view are, for example, images corresponding to the first display unit 111, the fourth display unit 114, and the fifth display unit 115. In other words, since the passenger P does not drive the vehicle, the passenger P does not need to view (does not need to view) the images of the above-mentioned display units 111, 114, and 115 (images required for driving).
[0050] Therefore, as shown in FIG. 4, when the passenger visual area 116b corresponds to the display images of the second display unit 112 and the third display unit 113, the brightness control unit 1325 executes normal brightness control for the passenger P, and when the passenger visual area 116b corresponds to the display images of the first display unit 111, the fourth display unit 114, and the fifth display unit 115, the brightness reduction control is executed.
[0051] The display device 100 is configured as described above, and the operation (including the control method) and effects of the display device 100 will be described below with reference to Figs.
[0052] The display control unit 132 forms images to be displayed on each of the display units 111 to 115 based on various information from the vehicle ECU 10, the navigation system 20, the multimedia 30, the air conditioner 40, the communication device 50, etc., and displays the formed images on each of the display units 111 to 115 (displays them to the viewer).
[0053] Furthermore, the display control unit 132 calculates (estimates) a visual recognition area 116 on the display surface 110a corresponding to the line of sight direction calculated (estimated) from the face image of the viewer acquired by the passenger camera 120. Then, the display control unit 132 sets the brightness of the image in the visual recognition area 116 to a specified brightness. This allows the viewer to clearly view the image in the visual recognition area 116 corresponding to the line of sight direction.
[0054] Then, the display control unit 132 reduces the luminance of the image in the non-visual area 117 to less than the specified luminance. The degree of reduction in the luminance in the non-visual area 117 can be less than the specified luminance or zero. By reducing the luminance in the non-visual area 117 to less than the specified luminance, the image in the non-visual area 117 is displayed faintly compared to the image in the visible area 116. Alternatively, by setting the luminance in the non-visual area 117 to zero, the image in the non-visual area 117 is not displayed. This can reduce power consumption related to the display of the image.
[0055] Here, in the present embodiment, when there are multiple viewers, such as a driver D and a passenger P, for passenger P, the following brightness reduction control is executed instead of the above-mentioned brightness control for a predetermined image (images corresponding to the first display unit 111, the fourth display unit 114, and the fifth display unit 115) or a part of the predetermined image.
[0056] 5 to 8 show a situation where the driver D is driving while gazing ahead of the vehicle. On the other hand, a passenger P is changing the direction of his / her line of sight with respect to the display unit 110. The display control unit 132 displays images corresponding to the second display unit 112 and the third display unit 113 at a specified luminance for the passenger P when the images are in the passenger visual recognition area 116b. However, the display control unit 132 reduces or sets to zero the luminance of the images corresponding to the first display unit 111, the fourth display unit 114, and the fifth display unit 115 to make them invisible even when the images are in the passenger visual recognition area 116b.
[0057] That is, the display form for the passenger P is as follows: The entertainment information on the second display unit 112 and the navigation information and air conditioning information on the third display unit 113 can be seen (displayed) when the passenger P directs his / her gaze thereto (white areas in Figs. 5 and 6). On the other hand, the brightness of the vehicle information on the fourth display unit 114 and the left rear image on the first display unit 111 (similar to the right rear image on the fifth display unit 115) is reduced or set to zero even when the passenger P directs his / her gaze thereto, so that the information is essentially not visible (not displayed) (dotted areas in Figs. 7 and 8). This is because there is no problem with the information (images) required for driving being not displayed to the passenger P who is not driving.
[0058] As described above, according to this embodiment, even when there are multiple viewers, such as the driver D of the vehicle and the passenger P in the passenger seat, the display control unit 132 hides the predetermined image or a part of the predetermined image that is unnecessary or inappropriate for the viewer (here, the passenger P) to view, even if the predetermined image or a part of the predetermined image is in the visual recognition area 116 (the passenger visual recognition area 116b). That is, the display control unit 132 relatively lowers the luminance of the predetermined image or sets it to zero. Therefore, the expansion of the display image area by the driver D and the passenger P can be suppressed, and power saving of the display unit 110 can be achieved.
[0059] (Modification 1 of the first embodiment) The control procedure of the first modification of the first embodiment is shown in Figures 9 and 10. In the first modification of the first embodiment, even if the passenger visual recognition area 116b is in the same position (for example, the third display unit 113), whether brightness control or brightness reduction control is performed is determined according to the information (content) to be displayed.
[0060] As described in the first embodiment, the third display unit 113 is described as displaying information (images) that can be switched between navigation information, A / C information, and back guide information. Of these pieces of information, the back guide information is information (images) that the passenger P does not need to see.
[0061] Therefore, even if the passenger visual area 116b is the same (third display unit 113), as shown in FIG. 9, A / C information (or navigation information) is displayed at a predetermined brightness, and as shown in FIG. 10, rear guide information is not displayed.
[0062] This makes it possible to perform brightness control or brightness reduction control depending on the type of image to be displayed.
[0063] (Modification 2 of the first embodiment) In the second variant of the first embodiment, when the display control unit 132 performs brightness reduction control on a specified image or a part of a specified image that is not required to be viewed by the passenger P, the brightness of the specified image or the part of the specified image is maintained for a specified period of time, and then the brightness is relatively reduced or set to zero (not displayed).
[0064] There are cases where the passenger P wants to check whether the driver D is driving safely, even if the predetermined image is not required to be viewed (for example, vehicle information such as the vehicle speed on the fourth display unit 114). Taking this into consideration, the predetermined image or even a part of the predetermined image that is subject to brightness reduction control is made invisible (gradually dimmed) after maintaining the brightness for a predetermined period of time, thereby making it possible to save power while providing the passenger P with the information he or she wants to know.
[0065] Furthermore, since the passenger P can continue to gaze at the image, the eyes can become accustomed to the gradually reduced light (dark adaptation), making it possible to save power while ensuring visibility.
[0066] (Third Modification of the First Embodiment) A control procedure of the third modification of the first embodiment is shown in Fig. 11 and Fig. 12. In the third modification of the first embodiment, brightness reduction control is executed for the driver D. Fig. 11 and Fig. 12 show a case where the passenger P is looking at a brought-in device 110s such as a smartphone.
[0067] An example of a predetermined image that is inappropriate for the driver D to view is entertainment information on the second display unit 112. This is because entertainment information leads to reduced attention while driving. Therefore, while driving (while the vehicle is traveling), as shown in FIG. 11, when the driver visual recognition area 116a is directed toward an image corresponding to the fourth display unit 114, the display control unit 132 sets (displays) the brightness of an image of vehicle information such as vehicle speed to a specified brightness. On the other hand, as shown in FIG. 12, when the driver visual recognition area 116a is directed toward the second display unit 112, the display control unit 132 executes brightness reduction control to hide the image of entertainment information.
[0068] Moreover, while the vehicle is stopped, the display control section 132 cancels the brightness reduction control on the second display section 112.
[0069] This enables brightness reduction control for the driver D, and in particular makes it possible to prevent the driver D from losing focus while driving. Also, when the vehicle is stopped, the driver D and the passenger P can view the entertainment information.
[0070] The luminance reduction control for the driver D in this embodiment may be combined with the luminance reduction control for the passenger P in the first embodiment and the first and second modifications of the first embodiment.
[0071] Second embodiment The control procedure of the second embodiment is shown in Fig. 13 and Fig. 14. In the second embodiment, when the image in the visual recognition area 116 is subjected to brightness control (normal display) at a specified brightness, the display control unit 132 delays the movement of the image displayed at a predetermined brightness in the case of the passenger P compared to the case of the driver D with respect to the movement of the visual recognition area 116.
[0072] As shown in Fig. 13, when the viewer is a driver D, the driver D drives while instantly viewing the image in order to keep an eye on the vehicle ahead, so the display control unit 132 displays the image in accordance with the movement of the line of sight, that is, the movement of the driver visual recognition area 116a (high response). Fig. 13 shows that the display image is moved in accordance with the movement of the line of sight of the driver D, for example, from the fourth display unit 114 to the third display unit 113.
[0073] On the other hand, as shown in Fig. 14, when the viewer is a passenger P, the passenger P can continue to watch the image since he / she does not drive, and if the image is displayed in a moving manner in accordance with the movement of the passenger visual recognition area 116b, the image moves even in response to a slight movement of the line of sight, causing flickering that is bothersome. Therefore, the display control unit 132 delays the movement of the display image relative to the movement of the line of sight, that is, the movement of the passenger visual recognition area 116b, more than in the case of the driver D. Fig. 14 shows that when the line of sight of the passenger P moves, for example, from the second display unit 112 to the third display unit 113, the display image moves smoothly (delayed) and finally catches up.
[0074] Methods for smoothly moving the display image include, with respect to movement of the passenger visual area 116b, (1) waiting a certain period of time before moving, (2) making the movement speed of the display image slower relative to the movement speed of the passenger visual area 116b, (3) combining (1) and (2) above, and (4) providing a dead zone for movement of the passenger visual area 116b, and ignoring movement in the passenger visual area 116b below a certain level.
[0075] This enables brightness control (normal display) according to the difference in visibility between the driver D and the passenger P.
[0076] (Modification 1 of the second embodiment) A control procedure of the first modification of the second embodiment is shown in Fig. 15. In the first modification of the second embodiment, when the image in the visual recognition area 116 is normally displayed at a predetermined brightness, the display control unit 132 gradually increases the brightness of the image in the visual recognition area 116 to the predetermined brightness, and in the case of the passenger P, the speed at which the brightness is increased is slower than in the case of the driver D.
[0077] 15, when the line of sight of the passenger P faces forward of the vehicle and, for example, moves downward toward the second display unit 112 and enters the passenger visual recognition area 116b, the display control unit 132 gradually increases the brightness of the image (entertainment information) on the second display unit 112 while displaying it normally. The display control unit 132 sets the speed at which the brightness is gradually increased to be slower than the speed assumed for the driver D.
[0078] This makes it possible for the driver D to be less likely to notice a change in luminance of the displayed image (light and dark flicker) caused by the passenger P.
[0079] (Modification 2 of the second embodiment) A control procedure of the second modification of the second embodiment is shown in Fig. 16. In the second modification of the second embodiment, when an image in the visual recognition area 116 is normally displayed at a predetermined luminance, the display control unit 132 sets the display area of the image for the passenger P in the visual recognition area 116 to be smaller than the display area of the image for the driver D.
[0080] This makes it possible for the driver D to be able to display an image with sufficient brightness even if the line of sight direction changes quickly, and for the passenger P, power can be saved by reducing the image display area.
[0081] Third embodiment A control procedure of the third embodiment is shown in Fig. 17 and Fig. 18. In the third embodiment, when the image of the visual recognition area 116 is normally displayed at a predetermined luminance, if the driver visual recognition area 116a and the passenger visual recognition area 116b are adjacent to each other, the display control unit 132 corrects the luminance of the boundary between the driver visual recognition area 116a and the passenger visual recognition area 116b so that the luminance changes smoothly and becomes continuous.
[0082] As shown in Fig. 17, when the driver visual recognition area 116a and the passenger visual recognition area 116b are close to each other and adjacent to each other, a phenomenon (called lateral inhibition) may occur in which a line is seen at the boundary of the image normally displayed in each visual recognition area 116a, 116b. In such a case, a problem occurs in which the driver D and the passenger P are bothered by the appearance of the image. This is likely to occur when the change in luminance distribution at the boundary area of the displayed image is so abrupt as to form an acute angle, as shown in Fig. 18(a).
[0083] Therefore, in such a case, the display control unit 132 can suppress the occurrence of streaks by correcting the luminance distribution of the boundary portion so that it becomes smooth and continuous, as indicated by the circles in FIG. 18(b).
[0084] (Other embodiments) The disclosure in this specification and drawings, etc. is not limited to the exemplified embodiments. The disclosure includes the exemplified embodiments and modifications by those skilled in the art based thereon. For example, the disclosure is not limited to the combination of parts and / or elements shown in the embodiments. The disclosure can be implemented by various combinations. The disclosure can have additional parts that can be added to the embodiments. The disclosure includes the omission of parts and / or elements of the embodiments. The disclosure includes the substitution or combination of parts and / or elements between one embodiment and another embodiment. The disclosed technical scope is not limited to the description of the embodiments. Some disclosed technical scopes are indicated by the description of the claims, and should be interpreted as including all modifications within the meaning and scope equivalent to the description of the claims.
[0085] When the image in the visible region 116 is normally displayed at a predetermined brightness, it is preferable not to set the brightness to zero (100% reduction) when lowering the brightness of the image in the non-visible region 117 below the specified brightness. Setting the brightness to zero may cause the viewer to mistakenly assume that the display device 100 is broken, and this can prevent such a mistake.
[0086] Also, a setting unit may be provided that allows the viewer to set the luminance level of the image in the non-visible region 117 when the image in the visible region 116 is normally displayed at a predetermined luminance. The setting unit may be, for example, a unit that inputs and sets the luminance by touching a luminance switch image displayed on the display surface 110a of the display unit 110. This allows the display device 100 to be adapted to the viewer's preferences.
[0087] In addition, the visual recognition area 116 is a horizontally long rectangle, but is not limited to this, and may be, for example, an ellipse with a long axis in the left-right direction and a short axis in the up-down direction. This makes it possible to approximate the area that is originally visually recognized by humans.
[0088] Furthermore, in each of the above embodiments, the visual direction (visual area 116) moves left and right or up and down (FIG. 15), but the visual direction can also be oblique. [Explanation of symbols]
[0089] 100 display device 110 Display section 110a Display surface 116 Visibility Zone 117 Blind Zone 120 Acquisition unit (passenger camera) 132 Display control section D Driver (visitor) P Passenger (visitor)
Claims
1. A display unit (110) that forms a plurality of types of images on a display surface (110a) and displays the images to a viewer; An acquisition unit (120) for acquiring a face image of the viewer; a display control unit (132) that performs brightness control to set a brightness of the image in a visible region (116) on the display surface corresponding to a gaze direction of the viewer estimated from the face image to a predetermined brightness to perform normal display, and to reduce a brightness of the image in a non-visual region (117) other than the visible region to a value lower than the predetermined brightness, The viewers are the driver (D) of the vehicle and the passenger (P) in the front passenger seat, The display control unit is a display device that performs brightness reduction control for a predetermined image or a portion of a predetermined image that is predetermined as unnecessary or inappropriate for viewing, among multiple types of images, for at least one of the driver and the passenger, to relatively lower or set to zero the brightness of the predetermined image or a portion of the predetermined image, even if the predetermined image or a portion of the predetermined image is within the viewing area.
2. The display device according to claim 1 , wherein the display control unit executes the brightness reduction control after maintaining the brightness of the predetermined image for the passenger for a predetermined time.
3. The display control unit, for the driver, The luminance reduction control is executed while the vehicle is traveling, The display device according to claim 1 , wherein the luminance reduction control is cancelled while the vehicle is stopped.
4. The display control unit is When the image in the visible region is displayed in the normal display mode at the predetermined luminance, The display device according to claim 1 , wherein, with respect to the movement of the visual recognition area, the movement of the image displayed at the predetermined luminance is delayed in the case of the passenger compared to that in the case of the driver.
5. The display control unit is When the image in the visible region is displayed in the normal display mode at the predetermined luminance, The brightness of the image in the visual recognition area is gradually increased to the predetermined brightness, The display device according to claim 1 , wherein the speed at which the luminance is increased is slower for the passenger than for the driver.
6. The display control unit is When the image in the visible region is displayed in the normal display mode at the predetermined luminance, The display device according to claim 1 , wherein, in the visible region, the display region of the image for the passenger is set smaller than the display region of the image for the driver.
7. The display control unit is When the image in the visible region is displayed in the normal display mode at the predetermined luminance, The display device according to claim 1 , wherein when the visible region of the driver and the visible region of the passenger are adjacent to each other, the luminance of the boundary between the adjacent regions is corrected so as to change smoothly and become continuous.
8. The display device according to claim 1 , further comprising a setting unit that enables the viewer to set a luminance level of the image in the non-visible area when the image in the visible area is normally displayed at the predetermined luminance.
9. A display unit (110) that forms a plurality of types of images on a display surface (110a) and displays the images to a viewer; An acquisition unit (120) that acquires a face image of the viewer, A method for controlling a display device, the method comprising: setting a luminance of the image in a visible region (116) on the display surface corresponding to a line of sight of the viewer estimated from the face image to a predetermined luminance to perform normal display; and performing luminance control to reduce the luminance of the image in a non-visual region (117) other than the visible region to less than the predetermined luminance, The viewers are the driver (D) of the vehicle and the passenger (P) in the front passenger seat, A control method for a display device that executes brightness reduction control to relatively lower or set to zero the brightness of a predetermined image or a portion of a predetermined image that is predetermined as unnecessary or inappropriate for viewing among multiple types of images for at least one of the driver and the passenger, even if the predetermined image or a portion of the predetermined image is within the viewing area.
Citation Information
Patent Citations
Display control device for vehicle and display system for vehicle
JP2021024402A
On-vehicle display device
JP2021138342A
Fusion of electronic mirror systems and driver monitoring for increased convenience and added safety
US10810966B1
Display control device, display device, in-vehicle display system, and display control method
WO2017212610A1
Vehicle display system, vehicle display method, and vehicle display program
WO2022244618A1
