Imaging device with display function

Abstract

To provide an imaging apparatus with a display function.SOLUTION: The imaging apparatus with the display function includes a liquid crystal panel 50, an infrared camera 60 which has a condensing lens and an imaging element, and a backlight 70 which is arranged on the back of the liquid crystal panel. The liquid crystal panel has a display area including a first area DR1 and a second area DR2 located so as to surround the first area in a plan view. At least the imaging element 61 of the infrared camera 60 is arranged on an optical path of light transmitted through the first area and the condensing lens. The liquid crystal panel does not have a black matrix at least in the first area and has a color filter in the first area and the second area.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an imaging device with a display function. [Background technology]

[0002] To assist safe driving of vehicles such as automobiles and trains, it is being considered to film the driver and analyze the driver's condition from the filmed video.To film the driver, it is preferable to place an imaging device on the instrument panel facing the driver's face.

[0003] In recent years, information necessary for driving, such as a speedometer, placed on an instrument panel, is displayed on a flat display such as a liquid crystal display device. For this reason, for example, Patent Document 1 discloses a display device in which a liquid crystal panel is placed on the instrument panel and a camera is placed behind the liquid crystal panel. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-031140 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present disclosure is to provide an imaging device with a display function that is capable of acquiring a clear subject image. [Means for solving the problem]

[0006] An imaging device with a display function according to one embodiment of the present disclosure is an imaging device with a display function comprising a liquid crystal panel, an infrared camera having a focusing lens and an imaging element, and a backlight arranged on the back of the liquid crystal panel, wherein the liquid crystal panel has a display area including, in a planar view, a first area and a second area positioned to surround the first area, at least the imaging element of the infrared camera is arranged on the optical path of light that has passed through the first area and the focusing lens, and the liquid crystal panel does not have a black matrix in at least the first area and has color filters in the first area and the second area. [Effects of the Invention]

[0007] According to one embodiment of the present disclosure, there is provided an imaging device with a display function that is capable of acquiring a clear image of a subject using an infrared camera disposed on the rear side of a liquid crystal panel. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 shows the wavelength dependence of the light transmittance of a color filter and a black matrix used in a typical liquid crystal panel. [Figure 2] FIG. 2 shows an example in which an image of a subject is captured using infrared light as illumination light and transmitted through a liquid crystal panel. [Figure 3] FIG. 3 shows a schematic plan view of the color filters and black matrix of a liquid crystal panel, and the transmittance of red light, green light, blue light, and infrared light at the AA line. [Figure 4] FIG. 4 is a schematic diagram showing the generation of diffraction images by red light, green light, blue light, and infrared light. [Figure 5] FIG. 5 is an exploded perspective view showing a schematic configuration of the imaging device with a display function according to the first embodiment. [Figure 6] FIG. 6 is a schematic cross-sectional view of the main part of the image pickup device with a display function shown in FIG. [Figure 7] FIG. 7 is a schematic cross-sectional view of the first region of the liquid crystal panel in the x-axis direction. [Figure 8] FIG. 8 is a schematic cross-sectional view of the second region of the liquid crystal panel 50 in the x-axis direction. [Figure 9] FIG. 9 is a schematic cross-sectional view of the second region in the y-axis direction. [Figure 10] FIG. 10 is a schematic exploded perspective view of the main components of a liquid crystal panel. [Figure 11] FIG. 11 is a plan view of the color filters and the black matrix. [Figure 12] FIG. 12 is a schematic cross-sectional view of the first region of the imaging device with a display function according to the second embodiment, taken along the x-axis direction. [Figure 13] FIG. 13 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a red filter is arranged on an opposing substrate in the second embodiment. [Figure 14] FIG. 14 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a green filter is arranged on an opposing substrate in the second embodiment. [Figure 15] FIG. 15 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a blue filter is arranged on an opposing substrate in the second embodiment. [Figure 16] FIG. 16 is a schematic cross-sectional view of the first region in the x-axis direction of another image pickup device with a display function according to the second embodiment. [Figure 17] 17 is a schematic cross-sectional view of the first region of the pixel in which the red filter is arranged, taken along the y-axis direction, of the counter substrate shown in FIG. [Figure 18] 18 is a schematic cross-sectional view of the first region of the pixel in which the green filter is arranged, taken along the y-axis direction, of the counter substrate shown in FIG. [Figure 19] 19 is a schematic cross-sectional view of the first region of the pixel in which the blue filter is arranged, taken along the y-axis direction, of the counter substrate shown in FIG. [Figure 20] FIG. 20 is a schematic cross-sectional view of an imaging device with a display function according to the third embodiment. [Figure 21] FIG. 21 is a schematic cross-sectional view of another image pickup device with a display function according to the third embodiment. [Figure 22] FIG. 22 is an exploded perspective view of the main components of the liquid crystal panel of the image pickup device with a display function according to the fourth embodiment. [Figure 23] FIG. 23 is a schematic cross-sectional view of an imaging device with a display function according to the fifth embodiment. [Figure 24] FIG. 24 is a schematic plan view of the main part of an imaging device with a display function according to the fifth embodiment. [Figure 25] FIG. 25 is a schematic cross-sectional view of another image pickup device with a display function according to the fifth embodiment. [Figure 26] FIG. 26 is a schematic plan view showing an example of the arrangement of a plurality of illumination light-emitting elements and a plurality of infrared light-emitting elements of a backlight in another image pickup device with a display function according to the fifth embodiment. [Figure 27] FIG. 27 is a schematic cross-sectional view of an imaging device with a display function according to the sixth embodiment. [Figure 28] FIG. 28 is a timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Figure 29] FIG. 29 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Figure 30] FIG. 30 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Figure 31] FIG. 31 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Figure 32] FIG. 32 is a schematic cross-sectional view of an imaging device with a display function according to the eighth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] A configuration in which an imaging device is placed near a display device is realized in smartphones, tablet terminals, laptop computers, etc. However, in these devices, the position of the lens and lens window indicating the imaging device can be clearly recognized. For this reason, if a similar structure were adopted to configure an automobile instrument panel, it is conceivable that the driver would be aware of the presence of the imaging device every time they looked at the display on the liquid crystal panel, for example.

[0010] To make the position of the imaging device less noticeable, a notch is provided on one side of the display device and the imaging device is placed in the area within the notch, which is also used in smartphones and other devices. When an automobile instrument panel is constructed using such a structure, the display area is not rectangular, but the notch portion is missing. This can impair the aesthetic appeal of the instrument panel when it is in a display state, and if the imaging device is placed in the notch portion where no image is displayed, it may be noticeable to the driver. Similarly, the driver may be aware of the presence of the imaging device every time they look at the display on the liquid crystal panel.

[0011] In view of these problems, the inventors of the present application have considered placing an imaging device in a display area where an image can be displayed. For example, they have considered whether it is possible to place an imaging device that captures an infrared image in the center of a liquid crystal panel and capture an infrared image through the liquid crystal panel.

[0012] Figure 1 shows the wavelength dependence of the light transmittance of color filters used in typical LCD panels. As shown in Figure 1, blue (B), green (G), and red (R) filters (monochromatic filters) have the optical property of selectively transmitting light in the blue, green, and red wavelength bands, respectively, in the visible range. On the other hand, the blue, green, and red filters transmit light with wavelengths longer than the visible range without absorbing it. For example, the transmittance of all filters for infrared light with a wavelength of 950 nm is approximately 90%. On the other hand, the black matrix (BM) located in the boundary region of the color filters has a transmittance of approximately 0.1% for both visible light and infrared light.

[0013] It is known that polarizing plates and liquid crystal layers have almost no optical effect on infrared light. Therefore, when infrared light is used as illumination and an image is captured by an imaging device through a liquid crystal panel equipped with color filters, it is thought that the image can be captured with almost no difference in transmittance between the blue, green, and red filter regions.

[0014] Figure 2 shows an example of an image of a subject captured using infrared light as illumination and transmitted through an LCD panel. As shown in Figure 2, an image is captured, but it is not a clear image, and multiple images are captured. In particular, the image blur in the horizontal direction is greater than in the vertical direction. This is thought to be due to the influence of the black matrix of the LCD panel.

[0015] Figure 3 is a schematic plan view of the color filters and black matrix of an LCD panel. The transmittance of red light, green light, blue light, and infrared light along the AA line is shown below. The filter regions of each color, RGB, selectively transmit light in their respective wavelength bands. For example, red light selectively transmits only through the red filter region, and is mostly absorbed by the green and blue filter regions. The same is true for green light and blue light. For this reason, the transmission regions in the direction of the AA line are repeated at the same intervals for red light, green light, and blue light.

[0016] On the other hand, as mentioned above, infrared light is transmitted to the same extent regardless of the filter color, but the transmittance of the black matrix for infrared light with a wavelength of 950 nm is only about 0.1%, so most of the infrared light is blocked.

[0017] The areas through which red, green, blue, and infrared light pass correspond to the slits in the diffraction grating, and the color filter and black matrix act as a diffraction grating for red, green, blue, and infrared light. The slit spacing for red, green, and blue light is three times the pixel pitch in the AA line direction, and for infrared light it is the pixel pitch. If the slit spacing is d and the wavelength of light is λ, the spacing D between positions where diffraction images are formed by the reinforcement of light in the diffraction grating is roughly expressed as D∝λ / d.

[0018] Furthermore, the brightness of the generated diffraction image depends on the ratio A=Amax / Amin of the maximum transmittance Amax to the minimum transmittance Amin.

[0019] Figure 4 is a schematic diagram showing the generation of diffraction images by red, green, blue, and infrared light. Images of the subject generated by red, green, blue, and infrared light contain ±1st-order, ±2nd-order, ±3rd-order, and other diffraction images. As mentioned above, the spacing D between the diffraction images is proportional to the wavelength λ and inversely proportional to the slit spacing d. Therefore, for the diffraction images generated by red, green, and blue light, the slit spacing is the same, but the wavelengths are different, so the spacing between the blue diffraction images is the shortest. On the other hand, for infrared light, the slit spacing d is three times that of red light, etc., and the wavelength is also longer, so the spacing between the diffraction images generated by infrared light is more than three times that of the diffraction images generated by red, green, and blue light. As a result, when infrared light is used for photography, the diffraction images are likely to be perceived as overlapping images.

[0020] Each pixel is longer in the y-axis direction than in the x-axis direction, along which the blue, green, and red filters are arranged. In other words, the pixel pitch is shorter in the x-axis direction. For this reason, as shown in Figure 2, it is thought that the image blurring in the x-axis direction is greater than that in the y-axis direction.

[0021] Based on the results of such investigations, the inventors of the present application have conceived an imaging device with a display function. The imaging device with a display function of the present disclosure is capable of capturing an image of a subject facing the front side of the display device, i.e., the display area. The imaging device with a display function may be called an electronic device equipped with an imaging device and a display device, or may be called a display device with an imaging device.

[0022] Such an imaging device with a display function can be mounted on the instrument panel of an automobile and suitably used to capture images of the driver's upper body, particularly the face. It can also be suitably used to capture images of people driving or operating vehicles, such as trains and airplanes, in addition to automobiles. As will be described later, the imaging device with a display function of the present disclosure can capture images from within the display area. Therefore, for example, when the imaging device with a display function of the present disclosure is used as the display of a laptop computer, tablet device, or smartphone, it can capture images from near the eyes of the face displayed on the display. Therefore, when conducting a web conference, compared to conventional cases where a camera is placed in the frame area, participants can view images from a more natural angle, i.e., a line of sight that makes it appear as if they are looking at each other's faces and eyes during the conference.

[0023] The imaging device with a display function of the present disclosure will be described below with reference to the drawings. The present disclosure is not limited to the following embodiments, and appropriate design modifications may be made within the scope of the configuration of the present disclosure. In the following description, the same reference numerals are used in different drawings for identical parts or parts having similar functions, and repeated description of such parts may be omitted. The configurations described in the embodiments and modifications may be combined or modified as appropriate without departing from the spirit of the present disclosure. For ease of understanding, the drawings referenced below may show simplified or schematic configurations, or may omit some components. Furthermore, the dimensional ratios between components shown in the drawings do not necessarily represent actual dimensional ratios.

[0024] (First embodiment) FIG. 5 is an exploded perspective view showing a schematic configuration of an image pickup device with a display function of this embodiment, and FIG. 6 is a schematic cross-sectional view of the main part of the image pickup device with a display function of this embodiment.

[0025] The image capturing device 101 with a display function includes a liquid crystal panel 50, an infrared camera 60, and a backlight 70. The image capturing device 101 with a display function further includes a cover glass 90, a first polarizing plate 91, a second polarizing plate 92, and an optical structure 80. The liquid crystal panel 50, the backlight 70, the first polarizing plate 91, the second polarizing plate 92, and the optical structure 80 form a display device.

[0026] The liquid crystal panel 50 has a front surface 50a and a back surface 50b. The front surface 50a includes a display area DR and a non-display area NR that surrounds and is located around the display area DR. The display area DR is an area where an image is displayed, while the non-display area NR is an area where no image is displayed because a driving circuit, wiring, etc. are provided.

[0027] The display region DR includes a first region DR1 and a second region DR2. The first region DR1 is surrounded by the second region DR2. The first region DR1 is preferably disposed toward the center of the display region DR, and is preferably disposed toward the center and away from the outer edge of the display region DR. The second region DR2 is the region of the display region DR other than the first region DR1, and the outer edge of the first region DR1 is in contact with the inner edge of the second region DR2. The first region DR1 and the second region DR2 are regions defined on the front surface 50a and are defined continuously in the thickness direction of the liquid crystal panel 50. In other words, the first region DR1 and the second region DR2 are also defined on the back surface 50b, and in a plan view, the first region DR1 and the second region DR2 on the front surface 50a overlap with the first region DR1 and the second region DR2 on the back surface 50b, respectively.

[0028] The first region DR1 has a circular shape with a diameter of, for example, about 5 mm to about 2 cm The shape of the first region DR1 is not limited to a circle, but may be an ellipse, an oval, a rectangle, or a polygon.

[0029] As will be described in detail below, the liquid crystal panel 50 is configured to be able to display an image in the entire display region DR. That is, color images can be displayed in the first region DR1 and the second region DR2. More specifically, pixels are configured in the first region DR1 and the second region DR2 of the liquid crystal panel 50, and color filters are arranged therein. The liquid crystal panel 50 does not have a black matrix in the first region DR1. In other words, the black matrix is ​​arranged only in the second region DR2, and not in the first region DR1.

[0030] The first polarizing plate 91 and the second polarizing plate 92 are disposed on the front surface 50a and the back surface 50b of the liquid crystal panel 50, respectively. The first polarizing plate 91 and the second polarizing plate 92 cover the first region DR1 and the second region DR2, respectively, and overlap each other. By disposing the first polarizing plate 91 and the second polarizing plate 92 also in the first region DR1, it is possible to display an image similar to that in the second region DR2 in the first region DR1. Furthermore, since there is no need to process the first polarizing plate 91 and the second polarizing plate 92, manufacturing costs can be reduced. The first polarizing plate 91 and the second polarizing plate 92 are disposed in a crossed Nicol relationship.

[0031] A cover glass 90 is disposed on the first polarizing plate 91 to protect the liquid crystal panel 50. A backlight 70 is disposed outside the second polarizing plate 92 via an optical structure 80.

[0032] The optical structure 80 improves the uniformity of light emitted from the backlight 70 and enhances brightness by adjusting the direction of travel of the light so that it is perpendicular to the liquid crystal panel 50. For example, the optical structure 80 includes a brightness enhancement film 81 such as a BEF (Brightness Enhancement Film) and a diffuser plate 82. While FIG. 5 shows only these two components of the optical structure 80, the optical structure 80 may further include other plate-like or film-like optical elements. The optical structure 80 has an optical structure through-hole 80h in a region overlapping with the first region DR1. In this embodiment, through-holes 81h and 82h are provided in the brightness enhancement film 81 and the diffuser plate 82, respectively, in regions overlapping with the first region DR1.

[0033] Next, the structure of the liquid crystal panel 50 will be described in detail. The liquid crystal panel 50 may be a liquid crystal panel of various driving methods and is characterized by not having a black matrix in the first region DR1. FIGS. 7 and 8 are schematic cross-sectional views of the first and second regions of the liquid crystal panel 50 in the x-axis direction, and FIG. 9 is a schematic cross-sectional view of the second region in the y-axis direction. FIG. 10 is a schematic exploded perspective view of the main components of the liquid crystal panel 50. FIG. 11 is a plan view of the color filters and black matrix.

[0034] The liquid crystal panel 50 includes a TFT substrate 10, a counter substrate 40, and a liquid crystal layer 30 disposed between the TFT substrate 10 and the counter substrate 40.

[0035] The TFT substrate 10 has the same structure in the first region DR1 and the second region DR2. That is, the liquid crystal panel 50 has the same driving structure in the first region DR1 and the second region DR2. Specifically, the TFT substrate 10 includes a substrate 11, a plurality of scanning lines 12, an insulating layer 13, a plurality of data lines 14, a plurality of pixel electrodes 15, a plurality of TFTs, an insulating layer 16, and a counter electrode 19. Each TFT has a gate electrode 12b, a semiconductor layer 17, a source electrode 14s, and a drain electrode 18. The scanning lines 12, the data lines 14, the gate electrode 12b, the source electrode 14s, and the drain electrode 18 are made of, for example, a metal that is substantially opaque to visible light and infrared light. The pixel electrode 15 and the counter electrode 19 are made of a transparent conductor such as ITO that is transparent to visible light and infrared light.

[0036] The substrate 11 is made of glass or the like that transmits visible light and infrared light. An undercoat layer or the like may be provided on the surface of the substrate 11. The plurality of scanning lines 12 extend in the x-axis direction on the substrate 11 and are arranged in the y-axis direction. The gate electrode 12b of each TFT is connected to the scanning line 12.

[0037] A gate insulating film that constitutes part of the insulating layer 13 is formed on the substrate 11 to cover the scanning lines 12 and the gate electrode 12b. The semiconductor layer 17 is located on the gate insulating film so as to overlap the gate electrode 12b in a plan view.

[0038] The multiple data lines 14 extend in the y-axis direction on the gate insulating film and are arranged in the x-axis direction. One end of the source electrode 14s of each TFT is connected to the data line 14. The other end of the source electrode 14s is connected to the semiconductor layer 17.

[0039] A drain electrode 18 is disposed apart from the source electrode 14s in the x-axis direction with the gate electrode 12b interposed therebetween, and one end of the drain electrode 18 is connected to the semiconductor layer 17.

[0040] An insulating film that constitutes part of the insulating layer 13 is formed on the gate insulating film, covering the data line 14, the semiconductor layer 17, and the drain electrode 18.

[0041] A plurality of pixel electrodes 15 are arranged two-dimensionally in the x and y directions on the insulating film. Each pixel electrode is connected to the other end of the drain electrode via a contact hole provided in the insulating film.

[0042] An insulating layer 16 is formed on the insulating layer 13 to cover the pixel electrodes 15. A counter electrode 19 is formed on the insulating layer 16. The counter electrode has a plurality of slits 19s formed therein, for example, extending in the y-axis direction.

[0043] An area surrounded by a pair of scanning lines 12 and a pair of data lines 14 constitutes a pixel, and each pixel includes a TFT, which is a switching element, and a pixel electrode 15 .

[0044] As described above, the TFT substrate 10 has the same structure in the first region DR1 and the second region DR2. That is, the plurality of scanning lines 12, the plurality of data lines 14, the plurality of TFTs, and the plurality of pixel electrodes 15 are located in the first region DR1 and the second region DR2 of the liquid crystal panel 50, respectively. To ensure a sufficient amount of light incident on the imaging element, the first region DR1 is preferably sized to accommodate eight or more of each of the plurality of scanning lines 12, the plurality of data lines 14, the plurality of TFTs, and the plurality of pixel electrodes 15.

[0045] The arrangement pitch of these components is preferably approximately the same in the first region DR1 and the second region DR2. Specifically, the interval between adjacent scanning lines 12 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent scanning lines 12 in the second region DR2. The interval between adjacent data lines 14 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent data lines 14 in the second region DR2. The interval between adjacent TFTs in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent TFTs in the second region DR2. The interval between adjacent pixel electrodes 15 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent pixel electrodes 15 in the second region DR2. Moreover, the area of ​​the pixel electrode 15 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the area of ​​the pixel electrode 15 in the second region DR2.

[0046] By satisfying such a relationship, it is possible to display a single integrated still image or moving image in the first area DR1 and the second area DR2 without performing special image processing in the first area DR1 and the second area DR2.

[0047] The counter substrate 40 includes a substrate 41, a black matrix 42, and a color filter 43, and has a different structure in a first region DR1 from that in a second region DR2. Specifically, the counter substrate 40 does not have a black matrix 42 in the first region, but has a black matrix in the second region. The counter substrate 40 further includes an overcoat layer 44 that covers the color filter 43.

[0048] The substrate 41 is a substrate made of glass or the like that transmits visible light and infrared light. A black matrix 42 is formed in the second region DR2 of the substrate 41. The black matrix 42 is made of, for example, a material whose transmittance for visible light and infrared light is 30% or less, preferably 1% or less. The black matrix 42 is located at the boundary between each pixel and has a portion 42x extending in the x-axis direction and a portion 42y extending in the y-axis direction. As described above, the black matrix 42 is not formed in the first region DR1 of the substrate 41.

[0049] The color filter 43 includes a red filter 43R, a green filter 43G, and a blue filter 43B, and is arranged on the substrate 41. More specifically, one of the red filter 43R, the blue filter 43B, and the green filter 43G is arranged for each pixel. As shown in Fig. 11, the red filter 43R, the green filter 43G, and the blue filter 43B are repeatedly arranged in the x-axis direction.

[0050] On the other hand, filters of the same color are arranged in the y-axis direction, so that red filter 43R, green filter 43G, and blue filter 43B may be continuous in the y-direction, as shown in FIG.

[0051] As described above, in the second region DR2, the black matrix 42 is arranged, and therefore the boundary between the color filter 43 of each pixel and the color filter of an adjacent pixel is located at the black matrix 42. Therefore, the black matrix 42 prevents color mixing of two colors selected from red, blue, and green between adjacent pixels. In the second region DR2, the color filters 43 between a pair of adjacent pixels may be in contact with each other or may be spaced apart by a distance smaller than the width of the black matrix.

[0052] In contrast, in the first region DR1, it is preferable that the color filter of each pixel be in contact with the color filter of an adjacent pixel, which prevents light from being emitted without passing through the color filter at the boundary between pixels in the first region DR1 where the black matrix 42 is not formed, even without the black matrix, thereby enabling accurate color image display.

[0053] Furthermore, when the imaging device with a display function of this embodiment is used in an instrument panel of an automobile, the driver gazes directly at the liquid crystal panel 50. Therefore, color mixing between pixels is less likely to occur than when the liquid crystal panel is viewed from an oblique direction, and even if a black matrix is ​​not provided in the first region DR1, a large difference in display quality between images displayed in the first region DR1 and the second region DR2 is less likely to occur.

[0054] In this embodiment, the color filter of each pixel does not overlap with a portion of the color filter of an adjacent pixel. However, due to manufacturing errors or other reasons, the color filter of some pixels in the first region DR1 may overlap with a portion of the color filter of an adjacent pixel. A structure that actively utilizes the overlapping of color filters will be described in the next embodiment.

[0055] The backlight 70 is fixed at a predetermined position relative to the liquid crystal panel 50 by a housing 85. In this embodiment, the backlight 70 is a direct-type backlight, and emits white light onto the liquid crystal panel 50 via an optical structure 80. The backlight 70 includes a chassis 71 having a bottom 71a facing the liquid crystal panel, and a plurality of display light-emitting elements 72 arranged on the bottom 71a. The display light-emitting elements 72 are mounted on a mounting substrate 74 arranged inside the bottom 71a. The display light-emitting elements 72 may be driven element by element or area by area using local dimming. The display light-emitting elements 72 emit white light, for example. Alternatively, the display light-emitting elements 72 may emit blue light or ultraviolet light. In this case, the backlight 70 may further include a wavelength conversion member covering the display light-emitting elements 72, or a wavelength conversion sheet provided above the plurality of display light-emitting elements 72, and may be configured to convert the light emitted from the display light-emitting elements 72 into yellow light or white light, which is then emitted from the backlight 70 and enters the optical structure 80 as white light.

[0056] The backlight 70 further includes at least one infrared light emitting element 73 mounted on a mounting substrate 74 on the bottom 71a. The infrared light emitting element 73 emits infrared light, which passes through the liquid crystal panel 50 and illuminates the subject (driver).

[0057] The backlight 70 may further include a partition structure 75 disposed on the mounting substrate 74. The partition structure 75 has a plurality of reflective surfaces 75r and divides the bottom 71a into regions each including, for example, one or more display light emitting elements 72. The reflective surfaces 75r prevent the light emitted from the display light emitting elements 72 from spreading laterally, thereby increasing the brightness of the light emitted from the backlight 70. Furthermore, when the backlight 70 is driven by local dimming, the contrast near the boundary between the lit and unlit sections is increased.

[0058] At least one of the reflecting surfaces 75r is preferably located between a condenser lens 63 of the infrared camera 60 (described later) and the infrared light emitting element 73. This makes it possible to prevent the infrared light emitted from the infrared light emitting element 73 from directly entering the infrared camera 60.

[0059] The infrared camera 60 includes an imaging element 61, and is disposed relative to the liquid crystal panel 50 so that the imaging element 61 is located on an optical path LP of light that has passed from the outside through the first region DR1 of the liquid crystal panel 50. In this embodiment, the optical path LP is configured to be linear without being bent by a reflector or the like. Therefore, the infrared camera 60 is disposed on the rear side of the liquid crystal panel 50.

[0060] Specifically, the infrared camera 60 has a circuit board 62 equipped with a drive circuit for the image sensor 61, and the image sensor 61 is mounted on the circuit board 62. The chassis 71 of the backlight 70 has a chassis through-hole 71h in a region of the bottom 71a that overlaps with the first region DR1, and the circuit board 62 is arranged outside the chassis 71 so that the image sensor 61 is located within the chassis through-hole 71h. By arranging the circuit board 62 outside the chassis 71, an increase in the height of the chassis 71 can be suppressed, and a decrease in the in-plane uniformity of the backlight can be suppressed.

[0061] The infrared camera 60 preferably further includes a condensing lens 63, an infrared transmission filter 64, and a lens barrel 65. The lens barrel 65 surrounds the image sensor 61 and is attached to the circuit board 62, and is inserted into the chassis through-hole 71h. The condensing lens is supported at one end of the lens barrel 65, and the infrared transmission filter 64 is supported by the lens barrel 65 between the condensing lens 63 and the image sensor 61. The condensing lens 63 condenses external light that passes through the optical path PL onto the image sensor 61.

[0062] By inserting lens barrel 65 into chassis through-hole 71h, condenser lens 63 is disposed between bottom 71a of chassis 71 and liquid crystal panel 50. With this configuration, condenser lens 63 can be brought closer to liquid crystal panel 50, and first region DR1 can be made smaller.

[0063] The area of ​​the first region DR1 is preferably equal to or larger than the opening area of ​​the condenser lens 63. Furthermore, the opening area of ​​the optical structure through hole 80h is preferably equal to or larger than the opening area of ​​the condenser lens 63. This can prevent the field of view of the infrared camera 60 from being reduced.

[0064] Furthermore, it is preferable that the opening area of ​​the optical structure through hole 80h is equal to or smaller than the area of ​​the first region DR1. Furthermore, it is more preferable that the opening area of ​​the optical structure through hole 80h is equal to or larger than the opening area of ​​the condenser lens 63, and that the opening area of ​​the optical structure through hole 80h is equal to or smaller than the area of ​​the first region DR1. By satisfying such a relationship, it is possible to further prevent the field of view of the infrared camera 60 from being reduced.

[0065] The infrared transmission filter 64 absorbs visible light and selectively transmits infrared light. For example, the infrared transmission filter 64 has spectral characteristics in which the transmittance at a wavelength of 920 nm is higher than the transmittance at a wavelength of 550 nm. By disposing the infrared transmission filter 64 having the above-described spectral characteristics between the condenser lens 63 and the image sensor 61, stray visible light can be efficiently suppressed, and the image of the driver obtained by illumination with infrared light can be acquired more clearly.

[0066] The backlight 70 is disposed on the chassis 71 so as to surround the optical path LP, and may further include a cylindrical light shielding body 76 that blocks infrared rays. When the infrared camera 60 includes the lens barrel 65, it is preferable that the light shielding body 76 surrounds the lens barrel 65.

[0067] The light shielding body 76 preferably transmits visible light and absorbs infrared light. For example, the light shielding body 76 preferably has spectral characteristics in which the transmittance at a wavelength of 920 nm is equal to or smaller than the transmittance at a wavelength of 550 nm. The inclusion of the light shielding body 76 prevents infrared light emitted from the infrared light-emitting element 73 of the backlight 70 from directly entering the infrared camera 60, thereby suppressing overexposure and enabling a clearer image of the driver to be captured. Furthermore, the inclusion of the light shielding body 76 allows light emitted from the display light-emitting element 72 to enter the optical path LP, even when the inclusion of the light shielding body 76 is present. This allows light from the backlight 70 to also enter the first region of the liquid crystal panel 50, thereby preventing a decrease in the brightness of the liquid crystal panel 50 in the first region. In other words, when an image on the display device is viewed from the outside, the difference in display quality between the first region DR1 and the second region DR2 can be reduced.

[0068] In the image pickup device with a display function of this embodiment, the liquid crystal panel is driven by the FFS method, so that the liquid crystal panel 50 operates in normally black mode.

[0069] According to the imaging device with display function of this embodiment, since the first region does not have a black matrix, the influence of diffraction images on the image is suppressed, making it possible to acquire a clear infrared image. Furthermore, the second region is positioned so as to surround the first region, and images can be displayed in both the first and second regions. In other words, since the infrared camera can be placed on the back of the LCD panel, the area where the camera is located, i.e., the camera hole, is less likely to be visible to the driver. Therefore, the driver is less likely to be aware of the camera hole while driving and feel a psychological burden, making it possible to monitor the driver's condition while providing a comfortable driving environment.

[0070] Furthermore, in the imaging device with display function of this embodiment, the liquid crystal panel is driven by the FFS method. Therefore, the liquid crystal panel operates in normally black mode. That is, areas where no voltage is applied to drive the liquid crystal, such as between pixels, display black. Therefore, even if a black matrix is ​​not formed in the first region, the effect of light leakage during black display is reduced.

[0071] In this embodiment, the image pickup device with a display function has a black matrix in the second region DR2, but the second region DR2 does not have to have a black matrix either. In this case, the counter substrate of the image pickup device with a display function also has the cross-sectional structure shown in Fig. 7 in the second region. In other words, the counter substrate has the same structure in the first region DR1 and the second region DR2.

[0072] In this case, as shown in FIG. 6, the first region DR1' is defined as a region overlapping with the condenser lens 63 of the infrared camera 60 in a plan view. The first region DR1' is surrounded by the second region DR2'. The second region DR2' is the region of the display region DR other than the first region DR1', and the outer edge of the first region DR1' is in contact with the inner edge of the second region DR2'. The first region DR1' and the second region DR2' are regions defined on the front surface 50a and are defined continuously in the thickness direction of the liquid crystal panel 50. Furthermore, to ensure a sufficient amount of light entering the imaging element, the first region DR1' is preferably sized to accommodate at least eight of each of the plurality of scanning lines 12, the plurality of data lines 14, the plurality of TFTs, and the plurality of pixel electrodes 15.

[0073] In this case, the area of ​​the first region DR1' is equal to the area of ​​the opening of the condenser lens 63. Preferably, the area of ​​the opening of the optical structure through hole 80h is equal to or larger than the area of ​​the opening of the condenser lens 63. This makes it possible to prevent the field of view of the infrared camera 60 from being reduced. Preferably, the area of ​​the opening of the optical structure through hole 80h is equal to or larger than the area of ​​the first region DR1'.

[0074] Even if the second region DR2' does not have a black matrix, as described above, the influence of diffraction on the image is suppressed, making it possible to acquire a clear infrared image. Furthermore, the camera hole is less visible. In particular, according to this embodiment, since there is no difference in the structure of the liquid crystal panel 50 between the first region DR1' and the second region DR2', the camera hole is less visible.

[0075] Furthermore, because the liquid crystal panel does not have a black matrix across the entire display area DR, the first area DR1' can be set at any position. In other words, no matter which position in the display area DR the image sensor detects, a clear image can be obtained. Therefore, the number and positions of infrared cameras can be changed as desired using the same liquid crystal panel.

[0076] It is preferable that the color filter of each pixel be in contact with the color filter of an adjacent pixel over 90% or more of the display region DR, which includes the entire first region DR1 and at least a part of the second region DR2. Since no black matrix is ​​formed in the first region DR1 or the second region DR2, this characteristic suppresses light leakage that does not pass through the color filter, enabling the image capture device with display function to display high-quality color images.

[0077] (Second embodiment) Figure 12 is a schematic cross-sectional view of the first region DR1 of an imaging device with display function in the x-axis direction, and Figures 13 to 15 are each schematic cross-sectional views of the first region of a pixel in which a red filter, a green filter, and a blue filter are arranged on the opposing substrate of a liquid crystal panel in the y-axis direction.

[0078] The image pickup device with a display function of this embodiment differs from the first embodiment in that two or more different color filters overlap in the region of each pixel in the first region DR1 that contacts the boundary with an adjacent pixel.

[0079] For example, consider a case where three color filters are formed by first forming a green filter 43G, then forming a red filter 43R, and finally forming a blue filter 43B. The boundary extending in the y-axis direction between a pair of adjacent pixels can be a combination of red-green, green-blue, and blue-red color filters.

[0080] At the boundary between the red and green filters, the end of green filter 43G and the end of red filter 43R are in contact with each other, with blue filter 43B overlapping them. At the boundary between the green and blue filters, the end of blue filter 43B overlaps the end of green filter 43G. At the boundary between the blue and red filters, the end of blue filter 43B overlaps the end of red filter 43R.

[0081] On the other hand, color filters of the same color are arranged in pixels adjacent in the y-axis direction. Therefore, color filters of different colors are arranged overlapping. As shown in Figure 13, at the boundary extending in the x-axis direction between pixels adjacent to red filter 43R in the y-axis direction, striped blue filter 43B extending in the x-axis direction is positioned on red filter 43R, so that two or more different color filters overlap.

[0082] 14, at the boundary extending in the x-axis direction between pixels adjacent to a green filter 43G in the y-axis direction, a striped blue filter 43B extending in the x-axis direction is positioned above the green filter 43G, thereby overlapping two or more different color filters. As shown in FIG. 15, at the boundary extending in the x-axis direction between pixels adjacent to a blue filter 43B in the y-axis direction, a striped red filter 43R extending in the x-axis direction is positioned below the blue filter 43B, thereby overlapping two different color filters.

[0083] The overlap width of two different color filters in the x-axis direction is Wx, and the overlap width in the y-axis direction is Wy. Let px be the pixel pitch in the x-axis direction and py be the pixel pitch in the y-axis direction. 0.01×px≦Wx≦0.2px 0.01×py≦Wy≦0.2py It is preferable that the following relationship is satisfied.

[0084] This configuration allows the color filters of adjacent pixels to contact each other more reliably. This reduces the possibility of gaps occurring due to manufacturing errors during color filter formation, resulting in the color filters not contacting each other. Furthermore, two or more color filters overlap at the pixel boundaries, forming an area at the boundary between adjacent pixels where neither of the colors of light from the color filters formed in each pixel is transmitted. This suppresses light mixing between adjacent pixels, enabling a clearer image to be displayed. In particular, a significant effect of suppressing light mixing between adjacent pixels can be achieved when viewed obliquely in the x-axis direction.

[0085] It is preferable that one of the two color filters overlapped between adjacent pixels is a blue filter, because blue filters have low transmittance and low reflectance, and relatively blue-based reflected colors tend to be preferred.

[0086] The number of color filters overlapping at the boundary between adjacent pixels in the first region DR1 is not limited to 2 and may be 3 or more. In other words, the imaging device with display function of this embodiment may differ from the first embodiment in that three or more different color filters overlap in the region of each pixel in the first region DR1 that contacts the boundary with the adjacent pixel.

[0087] Figure 16 is a schematic cross-sectional view in the x-axis direction of the first region DR1 of an imaging device with display function, and Figures 17 to 19 are schematic cross-sectional views in the y-axis direction of the first region of a pixel in which a red filter, a green filter, and a blue filter are arranged on the opposing substrate of a liquid crystal panel.

[0088] In the pixels arranged in the x-axis direction, at the boundary between the red and green filters, an end of red filter 43R overlaps an end of green filter 43G. Furthermore, a striped blue filter 43B extending in the y-axis direction is disposed on top of that. At the boundary between the green and blue filters, red filter 43R extending in the y-axis direction is disposed on top of an end of green filter 43G, and blue filter 43B is disposed on top of that. At the boundary between the blue and red filters, an end of red filter 43R overlaps green filter 43G extending in the y-axis direction, and an end of blue filter 43B overlaps that.

[0089] On the other hand, color filters of the same color are arranged in adjacent pixels in the y-axis direction. Therefore, color filters of different colors extending in the x-axis direction are arranged in an overlapping manner. As shown in Figure 17, at the boundary extending in the x-axis direction between pixels adjacent to red filter 43R in the y-axis direction, red filter 43R is arranged on top of striped green filter 43G extending in the x-axis direction, and blue filter 43B extending in the x-axis direction is arranged on top of red filter 43R.

[0090] 18, at the boundary extending in the x-axis direction between pixels adjacent to a green filter 43G in the y-axis direction, a striped red filter 43R extending in the x-axis direction is superimposed on the green filter 43G, and a striped blue filter 43B extending in the x-axis direction is further superimposed on that. As shown in FIG. 19, at the boundary extending in the x-axis direction between pixels adjacent to a blue filter 43B in the y-axis direction, a striped red filter 43R extending in the x-axis direction is superimposed on a striped green filter 43G extending in the x-axis direction, and a blue filter 43B is further superimposed on that. The preferred value of the overlapping width of three different color filters is as described above.

[0091] In this way, three or more different color filters overlap at the boundary between adjacent pixels, forming an area at the boundary between adjacent pixels where light of any color does not pass. This suppresses light mixing between adjacent pixels, enabling a clearer image to be displayed. In particular, when observed obliquely in the x-axis direction, a significant effect of suppressing light mixing between adjacent pixels can be achieved.

[0092] In this embodiment, two or more different color filters overlap in the region of the first region DR1 that contacts the boundary with adjacent pixels, and a black matrix 42 is formed in the second region DR2, as in the first embodiment. However, as described in the first embodiment, the opposing substrate in the second region may also not have a black matrix, and two or more different color filters may overlap in the region of the second region that contacts the boundary with adjacent pixels. This makes the structure of each pixel the same in the first region DR1 and the second region DR2, and allows images to be displayed with inconspicuous difference in display quality between the first region DR1 and the second region DR2.

[0093] Furthermore, the order in which the color filters are stacked depends on the order in which they are formed, and the image pickup device with a display function of the present disclosure is not limited to the specific structure described in this embodiment. For example, if the color filters are formed on the opposing substrate in the order of red filter 43R, blue filter 43B, and green filter 43G, in the structure described above, the green filter 43G can be replaced with the red filter 43R, the red filter 43R with the blue filter 43B, and the blue filter 43B with the green filter 43G.

[0094] (Third embodiment) 20 is a schematic cross-sectional view of an image pickup device with a display function of this embodiment. The image pickup device with a display function differs from the first embodiment in that it includes an edge-type backlight 70'.

[0095] The backlight 70' includes a chassis 71, a light guide plate 77, a display light emitting element, and an infrared light emitting element. The light guide plate 77 is disposed on a bottom 71a of the chassis 71. The backlight 70' may further include a reflective sheet 78 between the bottom 71a of the chassis 71 and the light guide plate 77.

[0096] The display light emitting element 72 and the infrared light emitting element 73 are mounted on a mounting substrate 74' and are arranged in the chassis 71 so that the display light emitting element 72 and the infrared light emitting element 73 face the side surface 77c of the light guide plate 77. In the drawing, one display light emitting element 72 and one infrared light emitting element 73 are shown, but the display light emitting element 72 and the infrared light emitting element 73 can be arranged on the side surface 77c of the light guide plate 77 depending on the required brightness.

[0097] The light guide plate 77 has a through hole 77h at a position overlapping with the first region DR1 in a plan view, and the lens barrel 65 of the infrared camera 60 is inserted into the through hole 77h. A light blocking body 76 is also disposed in the through hole 77h.

[0098] In the backlight 70′, similar to the display light-emitting elements 72, infrared light-emitting elements 73 are arranged on a side surface 77c of the light guide plate 77. Therefore, the infrared light-emitting elements 73 can emit light from the display region DR and can be used as illumination light when capturing an image.

[0099] Therefore, even if the backlight 70' is an edge type, as described in the first embodiment, since it does not have a black matrix in the first region, the influence of diffraction images on the image is suppressed, and a clear infrared image can be obtained.

[0100] The infrared light emitting elements 73 are not limited to being positioned corresponding to the side surfaces 77c of the light guide plate, and may be disposed so as to face the main surface. For example, as shown in Fig. 21 , the infrared light emitting elements 73 are mounted on the circuit board 62 of the infrared camera 60. Through holes 78h' and 71h' are formed in the reflecting sheet 78 and the bottom 71a of the chassis 71, respectively, at positions overlapping the infrared light emitting elements 73 in a plan view. The through holes 78h' and 71h' are provided at positions overlapping the infrared light emitting elements 73 and the second region DR2 of the liquid crystal panel 50 in a plan view.

[0101] With this configuration, the infrared light emitting elements 73 are arranged to face the main surface of the light guide plate 77, and infrared light can be emitted to the outside from the back surface of the liquid crystal panel 50. Illumination light for photographing the driver can be emitted from the vicinity of the periphery of the first region DR1. Therefore, even if the backlight is an edge type, by arranging the infrared light emitting elements 73 in a direct type position, the number of infrared light emitting elements 73 used for illumination can be reduced.

[0102] (Fourth embodiment) 22 is an exploded perspective view of the main components of the liquid crystal panel of the image capture device with a display function of this embodiment. The liquid crystal panel of the image capture device with a display function of this embodiment has a different structure from the liquid crystal panel of the first embodiment.

[0103] Specifically, as shown in FIG. 22, the plurality of pixel electrodes 15 includes a plurality of first pixel electrodes 15A and a plurality of second pixel electrodes 15B. The first pixel electrodes 15A and the second pixel electrodes 15B are arranged alternately in the x-axis direction. That is, one of the plurality of first pixel electrodes 15A One of the plurality of second pixel electrodes 15B is adjacent to another in the x-axis direction. Adjacent first pixel electrode 15'A and second pixel electrode 15'B share one data line 14. From another perspective, the pixel electrodes 15 are arranged two-dimensionally in the x and y directions, so that an adjacent pair of first pixel electrode 15A and second pixel electrode 15B is arranged between a pair of data lines 14 adjacent to another in the x-axis direction.

[0104] The multiple scanning lines 12 include multiple first scanning lines 12A and multiple second scanning lines 12B. Each of the multiple scanning lines 12 is associated with a pixel electrode 15 arranged in the x-axis direction, with the first scanning line 12A associated with a first pixel electrode 15A and the second scanning line 12B associated with a second pixel electrode 15B. Of the multiple scanning lines 12, the first scanning line 12A is located at the top end of the pixel electrodes 15 arranged in the x-axis direction, and the multiple second scanning lines 12B are located at the bottom end. From another perspective, the pixel electrodes 15 are arranged two-dimensionally in the x and y directions, so one of the multiple first scanning lines 12A and one of the multiple second scanning lines 12B is located between a pair of pixel electrodes 15 adjacent to each other in the y-axis direction.

[0105] The first pixel electrode 15'A and the second pixel electrode 15'B, which are arranged on either side of one data line 14, are scanned by different scanning lines. Specifically, the first pixel electrode 15'A is scanned by the first scanning line 12A via TFT-A, and the second pixel electrode 15'B is scanned by the second scanning line 12B via TFT-B.

[0106] Each data line 14 is located between a pair of first and second pixel electrodes (first pixel electrode 15'A and second pixel electrode 15'B) arranged in the x-axis direction and drives both of these pixel electrodes. In other words, one data line 14 is shared by the two pixels (pixel electrodes 15'A and 15'B) that sandwich it. Because the two pixels are different pixels, different data signals must be supplied at different times. This doubles the total number of scan lines. In other words, two scan lines 12A and 12B are required to operate adjacent pixels (pixel electrodes 15'A and 15'B) in the x-axis direction. Furthermore, because one data line is shared by two pixels, the writing time is also reduced by approximately half. However, the total number of data lines is also reduced by half compared to a conventional LCD panel. In other words, the data lines 14 are arranged at a pitch twice the pixel pitch in the x-axis direction.

[0107] As mentioned above, when capturing an image using infrared light through a black matrix, overlapping images are significantly detected in the x-axis direction depending on the pixel shape. This is because the spacing between diffraction images is inversely proportional to the slit spacing d, and the smaller the spacing of the black matrix, the larger the spacing between diffraction images.

[0108] In the imaging device with display function disclosed herein, a black matrix is ​​not formed in the first region of the liquid crystal panel, thereby reducing the influence of diffraction images caused by the black matrix. However, as liquid crystal panels become higher resolution and pixel pitches become smaller, the metal data lines, in addition to the black matrix, can also cause diffraction images. In this case, by adopting the structure of this embodiment and making the data line pitch twice the pixel pitch, the slit spacing can be doubled, thereby preventing the spacing between diffraction images from becoming larger.

[0109] That is, according to this embodiment, even when a high-definition liquid crystal panel is used, it is possible to prevent the intervals between diffraction images from widening and the image from becoming unclear.

[0110] (Fifth embodiment) 23 and 24 are, respectively, a schematic cross-sectional view and a schematic plan view of a main part of a liquid crystal panel of an image capture device with a display function of this embodiment. The image capture device with a display function of this embodiment includes an optical structure 180 having a different shape from that of the first embodiment. Furthermore, the image capture device with a display function of this embodiment does not include a light shielding body, and the liquid crystal panel does not have a black matrix throughout the entire display region DR. As described in the first embodiment, the first region DR1′ is defined as the region overlapping with the condenser lens 63 of the infrared camera 60 in a plan view, and the liquid crystal panel has a color filter and no black matrix in the first region DR1′. The first region DR1′ is located on the optical path of light incident on the image capture element 61 of the infrared camera 60.

[0111] Specifically, the imaging device with display function of this embodiment comprises a liquid crystal panel 50 having a display area DR, an infrared camera 60 having a focusing lens 63, an imaging element 61, and a lens barrel 65 that supports the focusing lens 63 at a predetermined gap relative to the imaging element 61, a backlight 70 arranged on the back of the liquid crystal panel 50, and an optical structure 180 arranged between the liquid crystal panel 50 and the backlight 70.

[0112] As described above, the optical structure 180 includes at least one optical sheet having an optical function. In this embodiment, as shown in FIG. 23 , the optical structure 180 includes a brightness enhancement film 81 and a diffuser 182. The diffuser 182 has a first major surface 182a and a second major surface 182b. The first major surface 182a is located on the side of the bottom 71a of the backlight 70, and the second major surface 182b is located on the side of the liquid crystal panel 50.

[0113] The diffuser 182 has a recess 182d disposed in the first main surface 182a, and a through-hole 182h located between the bottom surface of the recess 182d and the second main surface 182b. The opening area Sh of the through-hole 182h is smaller than the area Sd of the bottom surface of the recess 182d. Furthermore, it is preferable that the depth Dh of the through-hole 182h is smaller (shallower) than the depth Dd of the recess 182d. In plan view, the through-hole 182h of the diffuser 182 overlaps with the lens barrel 65. Furthermore, in plan view, the area of ​​the through-hole 182h is smaller than the area of ​​the lens barrel 65. In other words, it is preferable that the entire through-hole 182h overlaps with the lens barrel 65 in plan view. Such a structure of the diffuser 182, in particular, the depth Dh of the through-hole 182h and the depth Dd of the recess 182d satisfying the above-mentioned relationship, prevents the diffuser 182 from blocking infrared rays that enter the focusing lens 63 from an oblique direction at the through-hole 182h, and prevents the angle of view of the infrared camera from becoming narrow.

[0114] At least a portion of the diffuser 182 is disposed within the chassis 71 of the backlight 70. In this embodiment, the entire diffuser 182 is disposed within the chassis 71. That is, the diffuser 182 is close to the bottom 71a of the chassis 71. Furthermore, at least a portion of the lens barrel 65 is located within a recess 182d of the diffuser 182. In particular, it is preferable that the condenser lens 63 supported by the lens barrel 65 is located within the recess 182d.

[0115] Light incident on the diffuser 182 from the display light-emitting elements 72 of the backlight 70 is repeatedly diffused within the diffuser 182 and then emitted from the second main surface 182b while being diffused as indicated by the arrows. As described above, in a plan view, the through-holes 182h of the diffuser 182 overlap with the lens barrel 65, and the area of ​​the through-holes 182h is smaller than the area of ​​the lens barrel 65. Therefore, even in the area where the lens barrel 65 and the diffuser 182 overlap in a plan view, light is emitted perpendicularly from the second main surface 182b of the diffuser 182. Furthermore, the light emitted from the second main surface 182b also travels in an oblique direction and spreads above the through-holes 182h. That is, within the diffuser 182, the light is guided to the boundary with the through-holes 182h, and the light that is diffused near the boundary and emitted in an oblique direction passes through the liquid crystal panel 50 to reach the viewer. Therefore, in a plan view, a decrease in brightness in the area overlapping with the lens barrel 65 in the display region DR is suppressed, and the uniformity of the light emitted from the backlight 70 in the display region DR can be improved.

[0116] In particular, according to this embodiment, the area of ​​through-hole 182h can be made smaller than the area of ​​barrel 65, and the area from which light can be emitted perpendicularly from second main surface 182b can be increased within barrel 65 in plan view. Therefore, according to this embodiment, regardless of the cross-sectional area of ​​barrel 65 or the diameter of the condenser lens, the opening of through-hole 182h can be made smaller, and the area in display region DR where brightness decreases can be reduced.

[0117] Furthermore, since the recess 182d is formed in the diffuser 182, it is easy to align the diffuser 182 with the lens barrel 65 that holds the condenser lens 63, and misalignment can be suppressed even if the opening area of ​​the through-hole 182h is small. In particular, if the alignment accuracy between the through-hole 182h and the lens barrel 65 is poor, it is necessary to enlarge the opening of the through-hole 182h to ensure the amount of light required for imaging. However, according to this embodiment, such a design is not necessary. Therefore, it is possible to further reduce the opening area of ​​the through-hole 182h and improve the uniformity of brightness within the display region DR.

[0118] Furthermore, when the diffuser 182 having the recesses 182d and the through-holes 182h is constructed, for example, from two members, an air layer interface occurs between the two members within the diffuser 182. Because light is reflected at the air layer interface, the light transmittance from the first major surface 182a to the second major surface 182b may decrease, and the light distribution near the through-holes 182h and the recesses 182d may become non-uniform. In contrast, by constructing the diffuser 182 from a single member, it is possible to suppress such a decrease in light transmittance and non-uniform light distribution, thereby improving the uniformity of brightness within the display region DR. Furthermore, since the diffuser 182 is constructed from a single member, assembly is easy.

[0119] In this embodiment, the infrared light emitting elements 73 irradiate the subject directly with infrared light without transmitting through the liquid crystal panel 50. For this reason, the image capture device with display function of this embodiment is equipped with a housing 185. The housing 185 has a holder 185d in the non-display area NR located outside the display area DR, and multiple infrared light emitting elements 73 are arranged in the holder 185d. Also, as in the first embodiment, the housing 185 holds the backlight 70 at a predetermined position relative to the liquid crystal panel 50.

[0120] With this configuration, the infrared light emitting elements 73 are disposed in the non-display region NR, and the infrared light emitted from the infrared light emitting elements 73 for photographing reaches the subject directly without passing through the liquid crystal panel 50. Therefore, compared to when the infrared light emitting elements 73 are disposed on the rear side of the liquid crystal panel 50 within the display region DR, infrared light is prevented from becoming stray light within the backlight 70 and entering the imaging element 61 of the infrared camera 60. This makes it possible to capture a clear image. In particular, this effect can be achieved even without the light shielding body 76.

[0121] 25 is a schematic cross-sectional view of the main parts of another example of an imaging device with a display function according to this embodiment. The diffuser 182 of the optical structure 180 includes a first diffuser plate 182A and a second diffuser plate 182B. The first diffuser plate 182A and the second diffuser plate 182B have first through-holes 182Ah and second through-holes 182Bh, respectively. The first through-holes 182Ah and the second through-holes 182Bh each have, for example, a simple cylindrical shape, and the opening area of ​​the second through-holes 182Bh is larger than the opening area of ​​the first through-holes 182Ah.

[0122] The first diffusion plate 182A and the second diffusion plate 182B are stacked such that the axes of the first through-holes 182Ah and the second through-holes 182Bh are aligned with each other. The second diffusion plate 182B is closer to the bottom 71a of the backlight 70 than the first diffusion plate 182A.

[0123] By constructing the diffuser from two plate-like members in this way, it is possible to more easily form the recesses and through-holes in diffuser 182, thereby reducing the manufacturing cost of diffuser 182. Furthermore, because diffuser 182 is constructed from two members, it is possible to differentiate the optical properties of first diffuser plate 182A and second diffuser plate 182B and adjust the optical function of the entire diffuser. For example, material costs can be reduced by reducing the haze value of second diffuser plate 182B.

[0124] In this embodiment, the infrared light emitting elements 73 are arranged in the non-display region NR, but similar to the first embodiment, the infrared light emitting elements 73 may be arranged in the backlight 70. Fig. 26 is a schematic plan view showing an example of the arrangement of a plurality of display light emitting elements 72 and a plurality of infrared light emitting elements 73 in the backlight 70.

[0125] A plurality of display light-emitting elements 72 and a plurality of infrared light-emitting elements 73 are arranged on the bottom 71a of the chassis 71. Specifically, for example, the plurality of display light-emitting elements 72 are arranged at equal intervals in the x-axis direction and the y-axis direction. Each of the plurality of infrared light-emitting elements 73 is arranged, for example, between four adjacent display light-emitting elements 72. In this embodiment, the plurality of infrared light-emitting elements 73 are arranged at equal intervals in the x-axis direction and the y-axis direction. The arrangement pitch of the infrared light-emitting elements 73 is larger than the arrangement pitch of the display light-emitting elements 72. For example, in this embodiment, the arrangement pitch of the infrared light-emitting elements 73 is four times the arrangement pitch of the display light-emitting elements 72. In addition, in this embodiment, the infrared light-emitting element 73 is arranged in the center of four adjacent infrared light-emitting elements 73. In addition, the lens barrel 65 is arranged between the display light-emitting elements 72 arranged at equal intervals and between the four adjacent display light-emitting elements 72.

[0126] With this configuration, since the infrared light emitting elements 72 are arranged in the backlight, the frame area can be narrowed. Furthermore, by arranging the multiple infrared light emitting elements 73 at equal intervals, infrared light for photography can be emitted uniformly. Furthermore, by making the arrangement pitch of the infrared light emitting elements larger than the arrangement pitch of the display light emitting elements, the infrared light emitting elements can be arranged at a greater distance from the condenser lens 63 of the infrared camera 60. This prevents infrared light emitted from the infrared light emitting elements 73 from directly entering the infrared camera 60 as stray light. Furthermore, since the arrangement pitch of the display light emitting elements 72 is kept constant even around the lens barrel 65, a uniform display with little reduction in brightness can be obtained even around the lens barrel 65.

[0127] (Sixth embodiment) 27 is a schematic cross-sectional view of the main parts of the image pickup device with a display function of this embodiment. The image pickup device with a display function of this embodiment differs from the fifth embodiment in that the optical structure 280 further includes a second diffuser 84.

[0128] The second diffuser 84 is disposed, for example, between the liquid crystal panel and the brightness enhancement film 81 or the diffuser 182 of the optical structure 280. The gap Sp1 between the second diffuser 84 and the liquid crystal panel 50 is preferably smaller than the gap Sp2 between the second diffuser 84 and the diffuser 182. In a plan view, the second diffuser 84 overlaps the entire first region DR1' and the entire second region DR2'.

[0129] In the second diffuser 84, the haze value for visible light is greater than the haze value for infrared light. In addition, in the second diffuser 84, the rectilinear transmittance for visible light is less than the rectilinear transmittance for infrared light. In other words, the second diffuser 84 diffuses visible light more than infrared light. The second diffuser 84 having such optical properties can be formed by a film, substrate, or the like sandwiching a polymer dispersed liquid crystal (PDLC) therebetween.

[0130] This embodiment differs from the fifth embodiment in that visible light from the backlight diffused by the diffuser 182 is diffused again by the second diffuser 84 immediately before entering the liquid crystal panel 50. In the fifth embodiment, the visible light spreading above the through-hole 182h is light traveling in an oblique direction, and the area other than the through-hole 182h includes light traveling in both an oblique direction and a vertical direction. In this embodiment, the light traveling in an oblique direction above the through-hole 182h enters the second diffuser 84 and is diffused again, and is emitted from the second diffuser 84 in both vertical and oblique directions. Of course, in areas other than above the through-hole 182h, the light that enters the second diffuser 84 is diffused again and is emitted from the second diffuser 84 in both vertical and oblique directions. In this way, by providing the second diffuser 84, the diffusion state of the light exiting the second diffuser 84 is no longer different between above the through-hole 182h and other areas.

[0131] This structure effectively scatters visible light from the backlight, making the boundary between the first region DR1' and the second region DR2' less noticeable. In particular, when the liquid crystal panel 50 displays white or a high-brightness image, the decrease in brightness in the first region DR1' is suppressed, making the first region DR1' less noticeable. Meanwhile, the small haze value for infrared light allows infrared images to be captured with good resolution.

[0132] Furthermore, because the gap Sp2 is larger than the gap Sp1, as explained with reference to Figure 23, more light reaches above the through hole 182h, thereby suppressing the decrease in brightness and differences in the diffusion state of light in the first region DR1', and improving the uniformity of the light emitted from the backlight 70 within the display region DR.

[0133] (Seventh embodiment) In the imaging devices with display function according to the first to sixth embodiments, the backlight 70 is controlled to be constantly lit as the backlight of a typical liquid crystal panel, or to be periodically turned off to insert a black image display by pseudo-impulse driving. There are no particular limitations on the timing of operation of the infrared camera 60 and the infrared light emitting element 73 for imaging. For example, the infrared light emitting element 73 may be constantly lit, and imaging by the infrared camera 60 may be performed constantly, or the infrared light emitting element 73 may be constantly lit, and imaging by the infrared camera 60 may be performed only for a predetermined period within one frame period.

[0134] In contrast, in the imaging device with display function of this embodiment, the timing of lighting the backlight 70 and the timing of lighting the infrared light-emitting element 73 are correlated. FIG. 28 is a timing chart showing the operation timing of each part of the imaging device with display function of this embodiment. In FIG. 28, (a) shows the timing of scanning the liquid crystal panel 50, (b) shows the transmittance of the liquid crystal panel, and (c) shows the timing of lighting the backlight 70. Also, (d) shows the timing of lighting the infrared light-emitting element 73, and (e) shows the timing of imaging by the infrared camera 60. (a) shows the position where the scanning line (gate line) is turned on during one scanning period of the liquid crystal panel 50, and (b) shows the transmittance of the liquid crystal panel at the timing indicated by the circle in (a) when the entire liquid crystal panel 50 is displayed in a uniform neutral color. In the figure, the shades of black and white indicate differences in transmittance, with white indicating high transmittance and black indicating low transmittance. (c) and (d) show the timing when the backlight 70 and the infrared light emitting element 73 are turned on and illuminated at a high level. (e) shows the timing when the infrared camera 60 is capturing an image at a high level. In each chart, the horizontal axis indicates the passage of time.

[0135] In general, in a liquid crystal panel, scanning lines arranged in the column direction (vertical direction) are selected sequentially from top to bottom during one scanning period, and a voltage is applied to the selected scanning line. This turns on the switching element of the pixel connected to the selected scanning line, and an electric charge is accumulated between the pixel electrode and the opposing electrode. A voltage corresponding to the amount of electric charge is generated in the pixel electrode, and the liquid crystal in the liquid crystal layer is oriented in accordance with the voltage. As a result, light passes through that pixel with a predetermined transmittance.

[0136] The switching element is then turned off, but ideally the accumulated charge would be maintained, so the voltage would not change and the light transmittance would remain constant. However, in reality, when the switching element is turned off, the charge accumulated in the pixel gradually leaks out, causing the voltage on the pixel electrode to decrease. This gradually reduces the light transmittance.

[0137] For this reason, as shown in (b), at timing S1 when the bottom edge is scanned in one scanning period, the pixels connected to the top scanning line are charged at the very beginning of the scanning period, causing a large amount of charge leakage and resulting in the smallest transmittance.On the other hand, the pixels connected to the bottom edge have been charged just before, causing a small amount of charge leakage and resulting in the largest transmittance.

[0138] In contrast, at times S2 to S4 when the scanning position of the scanning line is between the upper and lower ends, the previously scanned scanning line and the next scanned scanning line are adjacent to each other, so that the pixel with the highest transmittance and the pixel with the lowest transmittance are adjacent to each other. The higher the transmittance of the liquid crystal panel 50, the higher the luminance of the liquid crystal panel 50 due to the backlight 70. For this reason, at times S2 to S4, the display area of ​​the liquid crystal panel 50 exhibits streaky luminance unevenness (streaky unevenness) where the brightest and darkest areas are adjacent to each other across the scanning position.

[0139] When the backlight 70 is always on, the scanning position of the scanning line moves sequentially from the top to the bottom during one scanning period, so the brightness unevenness described above is averaged out and not noticeable. However, when the backlight 70 is periodically turned off in synchronization with one scanning period and the infrared light-emitting element is turned on during that period, streak-like unevenness occurs at specific positions. Furthermore, when the turning-off of the backlight 70 is not synchronized with one scanning period, the brightness distribution of the liquid crystal panel 50 changes from moment to moment. In particular, when there is a slight mismatch between the scanning period of the liquid crystal panel 50 and the blinking period of the backlight, beat noise occurs in which the position of the streak-like unevenness moves (flows) at a constant speed at a frequency corresponding to the mismatch.

[0140] In the imaging device with display function of this embodiment, the backlight 70 is generally turned off when scanning of the liquid crystal panel 50 ends, and the infrared light emitting elements 73 are turned on, and imaging is performed by the infrared camera 60. For example, as shown in FIG. 28 , the infrared camera 60 captures images in a period before and after the end of one scanning period of the liquid crystal panel 50. The infrared light emitting elements 73 are turned on slightly earlier than the imaging period, and are turned off slightly after the end of the imaging period of the infrared camera 60. The backlight 70 is turned on during the period when the infrared light emitting elements 73 are turned off. In other words, the backlight 70 is turned off during the period when the infrared light emitting elements 73 are turned on.

[0141] The cycle of turning off the backlight 70 and the cycle of turning on the infrared light emitting elements 73 coincide with the scanning cycle of the liquid crystal panel 50. As described above, the timing of turning off the backlight 70 and the timing of turning on the infrared light emitting elements 73, and the timing of capturing images by the infrared camera 60 generally coincide with the end of one scanning period of the liquid crystal panel 50, that is, the timing when the bottom scanning line is scanned.

[0142] 29 to 31. In the example shown in FIG. 29, the backlight 70 is turned off, the infrared light emitting element 73 is turned on, and the infrared camera 60 captures an image when the bottom end of a scanning line and the bottom portion of the multiple scanning lines immediately preceding it are scanned. In the example shown in FIG. 30, the backlight 70 is turned off, the infrared light emitting element 73 is turned on, and the infrared camera 60 captures an image when the top end of a scanning line and the top portion of the multiple scanning lines immediately following it are scanned. In the example shown in FIG. 31, a scanning line rest period is provided between scanning periods, and in the period after scanning of the liquid crystal panel 50 is completed and before the start of the next scanning, the backlight 70 is turned off, the infrared light emitting element 73 is turned on, and the infrared camera 60 captures an image.

[0143] By performing such control, the backlight 70 is turned off when capturing an image with the infrared camera 60. Therefore, the influence of visible light from the backlight 70 is suppressed during capturing, and it becomes possible to capture a clear image with the infrared camera 60. Specifically, even if the visible light blocking performance of the infrared transmission filter 64 of the infrared camera 60 is insufficient, visible light does not reach the image sensor 61, so a clear image can be captured without an increase in the black level of the captured image or a decrease in the S / N ratio.

[0144] Also, by fixing the scanning position of the panel when the backlight is turned off, it is possible to suppress beat noise and the like that may be caused by changes in brightness due to the turning off of the backlight 70. Furthermore, by turning off the backlight 70 approximately when scanning of the liquid crystal panel 50 ends, when scanning of the liquid crystal panel ends and before the next scan starts, or when scanning the upper or lower edge of the display area, it is possible to suppress the occurrence of streaks and the like and to suppress the impact on the image display.

[0145] (Eighth embodiment) 32 is a schematic cross-sectional view of the main part of the image pickup device with a display function of this embodiment. The image pickup device with a display function of this embodiment differs from the sixth embodiment in that it further includes a half mirror 98.

[0146] The half mirror 98 is disposed in front of the liquid crystal panel 50. In this embodiment, the half mirror 98 is located between the cover glass 90 and the liquid crystal panel 50. The half mirror 98 covers the entire display region DR, and in plan view, the half mirror overlaps the entire through-hole 182h of the diffuser 182.

[0147] The half mirror 98 preferably has a higher transmittance for infrared light than for visible light. For example, the transmittance of the half mirror 98 at a wavelength of 940 nm is preferably higher than the transmittance at a wavelength of 550 nm. The half mirror 98 having such optical properties can be made of a dielectric multilayer film.

[0148] With this configuration, the image capture device with a display function of this embodiment also functions as a mirror. Therefore, it can be suitably used, for example, as a rearview mirror of a vehicle. Specifically, it can be used as an electronic mirror by displaying an image from a camera capturing an image of the area behind the vehicle on the liquid crystal panel 50. It can also be used as a normal mirror at the driver's discretion or when the power source for driving the image capture device with a display function is lost.

[0149] Furthermore, since the driver needs to look at the rearview mirror, it is unlikely that any obstacles will be placed between the driver and the rearview mirror. Therefore, the image capturing device with a display function of this embodiment, which is placed at the rearview mirror position, can reliably capture an image of the driver using the infrared camera 60, making it possible to appropriately monitor the driver's condition.

[0150] Furthermore, the half mirror 98 has a high transmittance for infrared rays, so that a good infrared image can be obtained.

[0151] (Other forms) The imaging device with a display function of the present disclosure can be modified in various ways. First, the driving method of the liquid crystal panel is not limited to FFS, and the liquid crystal panel may be driven by IPS or other driving methods. Furthermore, in this embodiment, the optical path of light that passes through the first regions DR1 and DR1′ and enters the imaging element 61 of the infrared camera 60 is straight, but the optical path may be bent in a direction parallel to the rear surface 50b of the liquid crystal panel 50 by a mirror or the like. In this case, the infrared camera can be disposed on the side of the liquid crystal panel 50, thereby reducing the overall thickness of the imaging device with a display function. Furthermore, two or more of the first to eighth embodiments can be combined as long as there is no contradiction.

[0152] Furthermore, in the first to eighth embodiments, the imaging device with a display function includes an optical structure having a diffuser plate. However, if the display light-emitting elements and infrared light-emitting elements in the backlight are covered with a diffuser member or the like and uniform light is emitted from the backlight, the optical structure does not need to include a diffuser plate. In this case, the optical structure does not need to have a through-hole, and light that has passed through the first region may further pass through the optical structure and enter the imaging element. Furthermore, since the optical function of the optical structure is provided in the backlight, the imaging device with a display function does not need to include an optical structure.

[0153] Furthermore, by including the backlight, optical structure, and infrared camera described above, the image capture device with display function of the fifth embodiment can suppress a decrease in brightness in the area of ​​the liquid crystal panel where the infrared camera is located, even if the infrared camera is placed on the backlight side, making it difficult to notice the presence of the infrared camera. Such a configuration including a backlight, optical structure, and infrared camera can be called an image capture device with a light source for a liquid crystal panel, and achieves the effects described above.

[0154] Specifically, the imaging device with a light source for a liquid crystal panel disclosed in the fifth embodiment comprises a backlight having a display light-emitting element, an optical structure including a diffuser arranged at a position where light emitted from the display light-emitting element passes through, an infrared camera having a barrel that supports a condensing lens, an imaging element, and the condensing lens at a predetermined gap relative to the imaging element, with at least a portion of the barrel located closer to the backlight than the diffuser, and the diffuser has a through-hole, and in a planar view, the through-hole of the diffuser overlaps with the barrel, and the area of ​​the through-hole in a planar view is smaller than the area of ​​the barrel.

[0155] This type of imaging device with a light source for a liquid crystal panel can be used not only as a display device for an instrument panel, but also as an imaging device with a display function that can display images without making the presence of the imaging device noticeable. Furthermore, depending on the purpose of the image acquired by the imaging device, or as long as the acquired image can be subjected to appropriate image processing according to the purpose, the image acquired by the infrared camera does not necessarily need to be clear. Therefore, the imaging device with a light source for a liquid crystal panel of the fifth embodiment can be combined with a liquid crystal panel having a black matrix disposed in front of it. Such a combination also makes it possible to realize an imaging device with a display function that makes the presence of the infrared camera less noticeable.

[0156] The imaging device with a display function according to the present disclosure can also be described as follows.

[0157] An imaging device with a display function according to a first configuration of the present disclosure includes: An LCD panel, an infrared camera having a condenser lens and an image sensor; The backlight located on the back, An imaging device with a display function, the liquid crystal panel has a display area including a first area and a second area positioned so as to surround the first area in a plan view; At least the imaging element of the infrared camera is disposed on an optical path of the light transmitted through the first region and the condenser lens; The liquid crystal panel does not have a black matrix in at least the first region, and has color filters in the first region and the second region.

[0158] According to the first configuration, the first region does not have a black matrix, which suppresses the influence of diffraction images on the image, making it possible to acquire a clear infrared image. Furthermore, the second region is positioned so as to surround the first region, and images can be displayed in both the first and second regions. In other words, the infrared camera can be placed on the back of the LCD panel, rather than at the edge. Therefore, for example, when this imaging device with a display function is used to photograph a driver, it is possible to monitor the driver's condition while providing a comfortable driving environment without the driver being aware of the presence of the camera (without feeling pressured).

[0159] An imaging device with a display function according to another first configuration of the present disclosure includes: a liquid crystal panel having a display area; an infrared camera having a condenser lens and an image sensor; a backlight disposed on the rear surface; An imaging device with a display function, at least an imaging element of the infrared camera is disposed on a display area of ​​the liquid crystal panel and on an optical path of light transmitted through the condenser lens; The liquid crystal panel does not have a black matrix in the display area, but has a color filter.

[0160] The image pickup device with display function according to the second configuration may be configured such that, in the first configuration, the color filter of each pixel is in contact with the color filter of an adjacent pixel in the first region. By having the color filters of each pixel in contact with each other in the first region, leakage of light that does not pass through the filter is suppressed even without a black matrix, and a correct color display image can be displayed.

[0161] In the image pickup device with a display function according to the third configuration, in the first configuration, the liquid crystal panel may have a black matrix arranged in the second region so as to overlap at least with the boundary between adjacent pixels. By having the black matrix in the second region, light leakage can be suppressed.

[0162] In the image pickup device with display function according to the fourth configuration, in the first configuration, the color filter of each pixel may be in contact with the color filter of an adjacent pixel in 90% or more of the display area including the entire first area and at least a part of the second area. Since the first area and the second area do not have a black matrix, the difference in visibility between the first area and the second area when viewing the screen can be reduced.

[0163] In a fifth configuration of the image capture device with a display function, in the first configuration, the color filter may have at least three or more different monochrome filters, and two or more different monochrome filters may overlap in a region of each pixel in the first region where the pixel borders the boundary with an adjacent pixel. By overlapping two or more monochrome filters at the pixel boundary, the transmittance of visible light is reduced and light mixing between adjacent pixels is suppressed.

[0164] In the sixth configuration of the imaging device with display function, in the first configuration, the color filter may have at least three or more different monochrome filters, and two or more different monochrome filters may overlap in the area of ​​each pixel in the entire first region and at least a part of the second region that borders the boundary with adjacent pixels.

[0165] In a seventh aspect of the present invention, the image pickup device with a display function is configured as follows: in the first aspect, the color filter may have at least three or more different monochromatic filters, and the three or more different monochromatic filters may overlap in a region of each pixel in the first region where the pixel borders the boundary with an adjacent pixel. By overlapping the three or more monochromatic filters at the pixel boundary, the transmittance of visible light is further reduced, and light mixing between adjacent pixels is suppressed.

[0166] An imaging device with a display function according to an eighth configuration may be configured such that, in the fourth configuration, the color filter has at least three or more different monochrome filters, and the three or more different monochrome filters may overlap in the area of ​​each pixel in the entire first region and at least a part of the second region that borders the boundary with adjacent pixels.

[0167] In a ninth configuration of an imaging device with a display function, in the first configuration, the infrared camera further includes a focusing lens positioned on the optical path between the liquid crystal panel and the imaging element, and the area of ​​the first region may be equal to or larger than the opening area of ​​the focusing lens.

[0168] The imaging device with display function according to a tenth aspect is the first aspect, further comprising a first polarizing plate disposed in front of the liquid crystal panel and a second polarizing plate disposed between the liquid crystal panel and the backlight, and the first polarizing plate and the second polarizing plate may overlap the first region and the second region. Since the polarizing plate does not need to be processed, costs can be reduced. An image can be displayed in the first region in the same way as in the second region.

[0169] According to an eleventh aspect, the image pickup device with a display function of the first aspect further includes an optical structure including at least one optical sheet disposed between the second polarizing plate and the backlight, the optical structure having an optical structure through-hole in an area overlapping with the first area, and the optical structure is not positioned in the optical path of the infrared camera, so that a clear image can be acquired.

[0170] In a twelfth aspect of the present invention, in the eleventh aspect of the present invention, the opening area of ​​the optical structure through-hole may be equal to or larger than the opening area of ​​the condenser lens, thereby preventing the camera field of view from being cut off.

[0171] An imaging device with a display function according to a thirteenth configuration is the eleventh configuration, wherein the opening area of ​​the optical structure through-hole may be equal to or smaller than the area of ​​the first region.

[0172] The imaging device with display function of the 14th configuration may be such that, in the 11th configuration, the opening area of ​​the optical structure through hole is equal to or larger than the opening area of ​​the lens, and the opening area of ​​the optical structure through hole is equal to or smaller than the area of ​​the first region.

[0173] The imaging device with display function according to the fifteenth configuration may be the ninth configuration, wherein the backlight includes a chassis having a bottom facing the display area and a plurality of display light-emitting elements arranged on the bottom, and the focusing lens is located between the bottom of the chassis and the liquid crystal panel.

[0174] In a sixteenth aspect of the present invention, in the fifteenth aspect of the present invention, the backlight may further include at least one infrared light emitting element disposed on the bottom. This allows infrared light for imaging to be emitted from in front of the driver. Furthermore, by disposing the element on the bottom, stray light can be prevented from entering the condenser lens.

[0175] The imaging device with display function according to the seventeenth configuration is the fifteenth configuration, wherein the backlight has a plurality of reflective surfaces each positioned between a plurality of display light-emitting elements, and further includes a partition structure arranged at the bottom of the chassis, and one of the plurality of reflective surfaces may be positioned between at least one infrared light-emitting element and the focusing lens.

[0176] An imaging device with display function according to an 18th configuration may be the 9th configuration, wherein the backlight includes a chassis having a bottom facing the display area, a light guide plate arranged on the bottom, and a display light-emitting element arranged on a side of the light guide plate, and the focusing lens is located between the bottom of the chassis and the liquid crystal panel.

[0177] An imaging device with a display function according to a nineteenth configuration is the eighteenth configuration, wherein the backlight further includes an infrared light emitting element disposed on a side surface of the light guide plate.

[0178] An imaging device with a display function according to a twentieth configuration is based on the eighteenth configuration, and the backlight may further include at least one infrared light emitting element disposed opposite to the main surface of the light guide plate.

[0179] The imaging device with display function according to a 21st configuration is the 14th or 18th configuration, wherein the infrared camera further includes a circuit board including a drive circuit for driving the imaging element, the imaging element being mounted on the circuit board, the chassis having a chassis through-hole provided at a position overlapping with the first region in a plan view, and the circuit board being disposed outside the chassis so that the imaging element is located within the chassis through-hole. With this configuration, the thickness of the backlight can be reduced, and deterioration of the in-plane uniformity of the backlight can be suppressed.

[0180] In a twenty-second aspect of the present invention, in the ninth aspect, the infrared camera may further include an infrared transmission filter disposed on the optical path and having a higher transmittance at a wavelength of 920 nm than at a wavelength of 550 nm, thereby suppressing stray visible light.

[0181] In a twenty-third aspect of the present invention, in the twenty-second aspect of the present invention, the infrared transmission filter may be located between the condenser lens and the image sensor, thereby making it possible to efficiently suppress stray light.

[0182] In a twenty-fourth aspect of the present invention, in the ninth aspect of the present invention, the backlight may further include a cylindrical light shielding body that is disposed within the chassis so as to surround the optical path and that blocks infrared rays, thereby suppressing stray infrared light.

[0183] In a twenty-fifth configuration, in the twenty-fourth configuration, the transmittance of the light blocking body at a wavelength of 920 nm may be equal to or smaller than the transmittance at a wavelength of 550 nm, thereby suppressing stray infrared light.

[0184] In the imaging device with a display function according to a 26th configuration, in the 25th configuration, the light shielding body may transmit visible light. By transmitting visible light through the light shielding body, light emitted from the backlight can also reach the first region, and it is possible to prevent the first region from becoming dark.

[0185] An imaging device with a display function according to a 27th configuration is the first configuration, The liquid crystal panel includes a TFT substrate, a counter substrate, and a liquid crystal layer disposed between the TFT substrate and the counter substrate, The TFT substrate is a plurality of scanning lines disposed in a display area, extending in a first direction and arranged in a second direction different from the first direction; a plurality of data lines extending in a second direction and arranged in a first direction; a plurality of switching elements respectively connected to one of the plurality of scan lines and one of the plurality of data lines; a plurality of pixel electrodes respectively connected to a plurality of switching elements and arranged two-dimensionally in a first direction and a second direction; The device may also include:

[0186] The imaging device with display function according to the 28th configuration may be the 27th configuration, wherein eight or more of each of the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located within the first region of the liquid crystal panel.

[0187] The imaging device with a display function according to a 29th configuration is the 27th configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are each a liquid crystal panel. The pixel electrodes may be located in the first region and the second region, and the area of ​​the pixel electrode in the first region may be in the range of 0.5 to 1.5 times the area of ​​the pixel electrode in the second region.

[0188] The imaging device with display function according to the 30th configuration is the 27th configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the spacing between adjacent scanning lines in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent scanning lines in the second region.

[0189] The imaging device with display function of the 31st configuration is the 27th configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the spacing between adjacent data lines in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent data lines in the second region.

[0190] The imaging device with display function according to the 32nd configuration is the 27th configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the spacing between adjacent switching elements in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent switching elements in the second region.

[0191] The imaging device with display function of a thirty-third configuration is the twenty-seventh configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the area of ​​the pixel electrodes in the first region is between 0.5 and 1.5 times the area of ​​the pixel electrodes in the second region, the spacing between adjacent scanning lines in the first region is between 0.5 and 1.5 times the spacing between adjacent scanning lines in the second region, and the spacing between adjacent data lines in the first region is between 0.5 and 1.5 times the spacing between adjacent data lines in the second region. According to the twenty-eighth to thirty-first configurations, an integrated image or video can be displayed in the first and second regions without any special image processing.

[0192] An imaging device with a display function according to a thirty-fourth configuration is the twenty-seventh configuration, wherein the plurality of pixel electrodes includes a plurality of first pixel electrodes and a plurality of second pixel electrodes, and one of the plurality of first pixel electrodes and one of the plurality of second pixel electrodes are adjacent in a first direction and may be disposed between a pair of data lines adjacent in the first direction. Even if the pixel pitch is reduced by reducing the number of data lines, the spacing between the data lines forming the diffraction grating is widened, thereby preventing the spacing between the diffraction images from widening and the image from becoming unclear.

[0193] In a thirty-fifth configuration, in the thirty-fourth configuration, the plurality of scanning lines may include a plurality of first scanning lines and a plurality of second scanning lines, one of the plurality of first scanning lines and one of the plurality of second scanning lines may be disposed between pixel electrodes adjacent to each other in the second direction, and the first pixel electrode and the second pixel electrode disposed between a pair of adjacent data lines may be connected to the first scanning line and the second scanning line via switching elements, respectively, thereby reducing the number of data lines.

[0194] In the image pickup device with a display function according to a thirty-sixth configuration, in the first configuration, the liquid crystal panel may operate in normally black mode, thereby making it possible to suppress light leakage during black display.

[0195] An imaging device with a display function according to a thirty-seventh configuration of the present disclosure includes: a liquid crystal panel having a display area; an infrared camera having a condenser lens, an image sensor, and a lens barrel that supports the condenser lens at a predetermined gap relative to the image sensor; a backlight disposed on the rear surface of the liquid crystal panel; an optical structure disposed between the liquid crystal panel and the backlight and including a diffuser; Equipped with The diffuser has through holes, In a plan view, the through hole of the diffuser overlaps with the lens barrel, The area of ​​the through hole in the plan view is smaller than the area of ​​the lens barrel.

[0196] This configuration allows light from the diffuser to enter the lens barrel area and also reduces the opening area of ​​the through-hole. This reduces the area of ​​the infrared camera, where brightness is likely to decrease, making the infrared camera less noticeable. It also improves the uniformity of the light emitted from the backlight within the display area.

[0197] The imaging device with display function of the 38th configuration is the 37th configuration, wherein the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recess arranged in the first main surface, the through hole is located between the bottom surface of the recess and the second main surface, and a part of the lens barrel is located within the recess of the diffuser.

[0198] This configuration makes it easy to align the diffuser with the lens barrel or the like that holds the condenser lens, and since the diffuser is a single member, assembly is also easy.

[0199] The imaging device with display function according to a thirty-ninth configuration may be the thirty-seventh configuration, further comprising at least one infrared light-emitting element disposed in a non-display area located outside the display area. This configuration prevents infrared light emitted from the infrared light-emitting element for imaging from becoming stray light in the backlight and entering the infrared camera. This makes it possible to capture clear images.

[0200] An imaging device with display function according to a fortieth configuration may be configured as the thirty-seventh configuration, wherein the backlight comprises a chassis having a bottom facing the display area, and a plurality of display light-emitting elements and a plurality of infrared light-emitting elements arranged on the bottom.

[0201] According to this configuration, since the infrared light emitting elements are arranged in the backlight, the frame area can be narrowed. Furthermore, by arranging the plurality of display light emitting elements and the plurality of infrared light emitting elements at equal intervals, infrared light for photography can be emitted uniformly. Furthermore, by making the arrangement pitch of the infrared light emitting elements larger than the arrangement pitch of the display light emitting elements, the infrared light emitting elements can be arranged at a distance from the infrared camera, and infrared light emitted from the infrared light emitting elements can be prevented from directly entering the infrared camera as stray light.

[0202] An imaging device with display function of the 41st configuration may be configured as the 37th configuration, wherein the diffuser includes a first diffuser plate and a second diffuser plate, the first diffuser plate and the second diffuser plate have a first through hole and a second through hole, respectively, the opening area of ​​the second through hole is larger than the opening area of ​​the first through hole, and the first diffuser plate and the second diffuser plate are stacked so that the axis of the first through hole and the axis of the second through hole coincide with each other.

[0203] This configuration allows the diffuser to be formed more easily by using two plate-like members. Furthermore, by differentiating the optical properties of the first and second diffusers, the optical function of the entire diffuser can be adjusted. For example, reducing the haze value of the second diffuser can reduce material costs.

[0204] The imaging device with display function of the 42nd configuration is the 37th configuration, wherein the optical structure further has a second diffuser positioned between the liquid crystal panel and the diffuser, and the haze value of the second diffuser for visible light may be greater than the haze value for infrared light.

[0205] According to this configuration, the through-holes in the diffuser eliminate vertically diffused visible light from the backlight in the region above the through-holes, and only diffused light exiting obliquely from the area surrounding the through-holes in the diffuser is present. The second diffuser diffuses the light emitted from the diffuser in both vertical and oblique directions, allowing visible light from the backlight to exit vertically in the region above the through-holes. Therefore, the light emitted from the second diffuser exits vertically and obliquely in the region above the through-holes, just like in the region other than above the through-holes, eliminating any difference in the diffusion state of light between the through-holes and other regions. In other words, this structure effectively scatters visible light from the backlight, making the boundary between the first and second regions less noticeable. Furthermore, the haze value of the second diffuser for infrared light is smaller than the haze value for visible light, enabling infrared images to be captured with good resolution. In the imaging device with display function according to a 43rd configuration, in the 1st or 37th configuration, the infrared camera may capture images during at least a part of a period when the backlight is off. With this configuration, imaging with the infrared camera is performed when the backlight is off, so that the influence of visible light from the backlight on imaging can be suppressed, and clear images can be obtained by the infrared camera.

[0206] The imaging device with display function of the 44th configuration may be the 43rd configuration, further comprising an infrared light-emitting element, and the backlight may be turned off when scanning of the liquid crystal panel is completed, after scanning of the liquid crystal panel is completed and before the next scan is started, or when scanning the upper or lower end of the display area. This makes it possible to suppress beat noise and the like that may be caused by a change in brightness due to the backlight being turned off, and to suppress the influence on image display.

[0207] The imaging device with display function of the 45th configuration may be the 37th configuration, further comprising a half mirror arranged in front of the liquid crystal panel, and in a planar view, the entire through hole of the diffuser may overlap with the half mirror.

[0208] With this configuration, the imaging device with a display function can also function as a mirror. Furthermore, by applying it to an in-vehicle rearview mirror, the driver can be monitored without getting caught in the mirror.

[0209] In a 46th aspect of the present invention, in the 45th aspect of the present invention, the transmittance of the half mirror at a wavelength of 940 nm may be greater than the transmittance at a wavelength of 550 nm. With this configuration, a better infrared image can be acquired.

[0210] The imaging device with a light source for a liquid crystal panel according to the 47th configuration of the present disclosure is any of the 36th to 46th configurations, in which the liquid crystal panel has a color filter on the optical path of light that passes through the through hole of the diffuser and the focusing lens to reach the imaging element, and may not have a black matrix.

[0211] An imaging device with a light source for a liquid crystal panel according to a forty-eighth configuration of the present disclosure includes: a backlight having a display light-emitting element; an optical structure including a diffuser disposed at a position where light emitted from the display light emitting element passes through; an infrared camera having a condenser lens, an image sensor, and a lens barrel that supports the condenser lens with a predetermined gap relative to the image sensor, with at least a portion of the lens barrel being located closer to the backlight than the diffuser; Equipped with The diffuser has through holes, In a plan view, the through hole of the diffuser overlaps with the lens barrel, The area of ​​the through hole in the plan view is smaller than the area of ​​the lens barrel.

[0212] This configuration makes it possible to reduce the area of ​​the infrared camera where brightness is likely to decrease, thereby providing an imaging device with a light source for a liquid crystal panel that makes the presence of the infrared camera less noticeable.

[0213] The imaging device with a light source for a liquid crystal panel according to the 49th configuration may be configured such that, in the 48th configuration, the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recess disposed in the first main surface, the through hole is located between the bottom surface of the recess and the second main surface, and another part of the lens barrel is located within the recess of the diffuser. [Explanation of symbols]

[0214] 10...TFT substrate, 11...substrate, 12...scanning line, 12A...first scanning line, 12B...second scanning line, 12b...gate electrode, 13...insulating layer, 14...data line, 14'...data line, 14s...source electrode, 15...pixel electrode, 15A...first pixel electrode, 15B...second pixel electrode, 16...insulating layer, 17...semiconductor layer, 18...drain electrode, 19...counter electrode, 19s...slit, 30...liquid crystal layer, 40...counter substrate, 41...substrate, 42...black matrix, 42x, 42y...portion of black matrix, 43...color filter, 43B...blue filter, 43G...green filter, 43R...red filter, 50...liquid crystal panel, 50a...front surface, 50b...rear surface, 60...infrared camera, 61...imaging element, 62...circuit board, 63...condenser lens, 64...infrared transmitting filter 65...lens barrel, 70, 70'...backlight, 71...chassis, 71a...bottom, 71h...chassis through-hole, 71h'...through-hole, 72...display light-emitting element, 73...infrared light-emitting element, 74, 74'...mounting substrate, 75...partition structure, 75r...reflective surface, 76...light-shielding body, 77...light guide plate, 77c...side, 77h...through-hole, 78...reflective sheet, 78h...through-hole, 80, 180, 28 0...optical structure, 80h...optical structure through-hole, 81...brightness enhancement film, 81h...through-hole, 82...diffuser plate, 82h...through-hole, 85, 185...housing, 90...cover glass, 91...first polarizer plate, 92...second polarizer plate, 98...half mirror, 101...image capture device with display function, 182 diffuser, 182A...first diffuser plate, 182B...second diffuser plate, 182d...recess, 182h...through-hole

Claims

1. An LCD panel, an infrared camera having a condenser lens and an image sensor; a backlight disposed on the rear surface of the liquid crystal panel; An imaging device with a display function, the liquid crystal panel has a display area including a first area and a second area positioned so as to surround the first area in a plan view; at least an imaging element of the infrared camera is disposed on an optical path of light transmitted through the first region and the condenser lens, the liquid crystal panel does not have a black matrix in at least the first region, and has color filters in the first region and the second region; An imaging device with a display function capable of displaying color images in the first area and the second area.

2. 2. The image pickup device with display function according to claim 1, wherein in the first region, the color filter of each pixel is in contact with the color filter of an adjacent pixel.

3. 3. The image pickup device with a display function according to claim 2, wherein the liquid crystal panel has a black matrix arranged so as to overlap at least a boundary between adjacent pixels in the second region.

4. 3. The imaging device with display function according to claim 2, wherein the color filter has at least three or more different monochrome filters, and two or more different monochrome filters overlap in an area of ​​each pixel in the first region that borders the boundary with an adjacent pixel.

5. 2. The image pickup device with a display function according to claim 1, wherein the area of ​​the first region is equal to or larger than the area of ​​the aperture of the condenser lens.

6. The backlight is a chassis having a bottom facing the display area; a plurality of display light-emitting elements arranged on the bottom; Equipped with 2. The image pickup device with a display function according to claim 1, wherein the condenser lens is located between the bottom of the chassis and the liquid crystal panel.

7. the infrared camera further includes a circuit board having a drive circuit for driving the image sensor; the imaging element is mounted on the circuit board, the chassis has a chassis through-hole provided at a position overlapping with the first region in a plan view, The image pickup device with a display function according to claim 6 , wherein the circuit board is disposed outside the chassis so that the image pickup element is located inside the chassis through-hole.

8. 2. The image capturing device with a display function according to claim 1, wherein the infrared camera further comprises an infrared transmission filter disposed on the optical path and having a higher transmittance at a wavelength of 920 nm than at a wavelength of 550 nm.

9. 7. The image pickup device with a display function according to claim 6, wherein the backlight further comprises a cylindrical light shielding body that is arranged in the chassis so as to surround the optical path and that blocks infrared rays.

10. the liquid crystal panel includes a TFT substrate, a counter substrate, and a liquid crystal layer disposed between the TFT substrate and the counter substrate; The TFT substrate is a plurality of scanning lines disposed in the display area, extending in a first direction and arranged in a second direction different from the first direction; a plurality of data lines extending in the second direction and arranged in the first direction; a plurality of switching elements respectively connected to one of the plurality of scanning lines and one of the plurality of data lines; a plurality of pixel electrodes respectively connected to the plurality of switching elements and arranged two-dimensionally in the first direction and the second direction; Equipped with the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in the first region and the second region of the liquid crystal panel, respectively; 2. The image pickup device with a display function according to claim 1, wherein the interval between adjacent scanning lines in the first region is in the range of 0.5 to 1.5 times the interval between adjacent scanning lines in the second region.

11. a liquid crystal panel having a display area; an infrared camera having a condenser lens, an imaging element, and a lens barrel that supports the condenser lens with a predetermined gap relative to the imaging element; a backlight disposed on the rear surface of the liquid crystal panel; an optical structure disposed between the liquid crystal panel and the backlight and including a diffuser; An imaging device with a display function, The diffuser is a first main surface located on the backlight side; a second main surface located on the liquid crystal panel side; a recess disposed in the first major surface; a through hole located between a bottom surface of the recess and the second main surface; and the condenser lens is supported at a tip end side of the lens barrel, and a part of the tip end side of the lens barrel is located within the recess of the diffuser, In a plan view, the through hole of the diffuser overlaps with the lens barrel, an area of ​​the through hole in the plan view is smaller than an area of ​​the lens barrel; An imaging device with a display function.

12. the diffuser includes a first diffusion plate and a second diffusion plate, the first diffusion plate and the second diffusion plate have a first through hole and a second through hole, respectively, an opening area of ​​the second through hole is larger than an opening area of ​​the first through hole, and the first diffusion plate and the second diffusion plate are stacked so that an axis of the first through hole and an axis of the second through hole coincide with each other, whereby the first through hole and the second through hole respectively constitute the through hole and the recess. The imaging device with a display function according to claim 11.

13. 12. The imaging device with a display function according to claim 11, wherein the backlight comprises a chassis having a bottom facing the display area, and a plurality of display light-emitting elements and a plurality of infrared light-emitting elements arranged on the bottom.

14. 12. The imaging device with display function of claim 11, wherein the optical structure further includes a second diffuser positioned between the liquid crystal panel and the diffuser, and the second diffuser has a larger haze value for visible light than for infrared light.

15. The image capturing device with a display function according to claim 11 , wherein the infrared camera captures images during at least a part of a period in which the backlight is turned off.

16. 16. The imaging device with display function according to claim 15, further comprising an infrared light-emitting element, wherein the backlight is turned off when scanning of the liquid crystal panel ends, when scanning of the liquid crystal panel ends and before starting a next scan, or when scanning an upper end portion or a lower end portion of the display area.

17. a half mirror disposed in front of the liquid crystal panel; In a plan view, the through-hole of the diffuser entirely overlaps with the half mirror. The imaging device with a display function according to claim 11.

18. The transmittance of the half mirror at a wavelength of 940 nm is greater than the transmittance at a wavelength of 550 nm.

18. The imaging device with a display function according to claim 17.

19. 19. The imaging device with display function described in any one of claims 11 to 18, wherein the liquid crystal panel has a color filter and does not have a black matrix on the optical path of light that passes through the through hole of the diffuser and the focusing lens and reaches the imaging element.

Images