Imaging apparatus with display function

Abstract

To provide an imaging apparatus with a display function.SOLUTION: The imaging apparatus with the display function includes a liquid crystal panel 50, an infrared camera 60 which has a condensing lens and an imaging element, and a backlight 70 which is arranged on the back of the liquid crystal panel. The liquid crystal panel has a display area including a first area DR1 and a second area DR2 located so as to surround the first area in a plan view. At least the imaging element 61 of the infrared camera 60 is arranged on an optical path of light transmitted through the first area and the condensing lens. The liquid crystal panel does not have a black matrix at least in the first area and has a color filter in the first area and the second area.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to an imaging device with a display function. [Background technology]

[0002] In order to assist safe driving of vehicles such as automobiles and trains, it is being considered to film the driver and analyze the driver's condition from the filmed video. In order to film the driver, it is preferable to place an imaging device on the instrument panel that faces the driver's face.

[0003] In recent years, information necessary for driving, such as a speedometer arranged on an instrument panel, is displayed on a flat display such as a liquid crystal display device. For this reason, for example, Patent Document 1 discloses a display device in which a liquid crystal panel is arranged on the instrument panel and a camera is arranged on the back of the liquid crystal panel. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-031140 A Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present disclosure is to provide an imaging device with a display function capable of acquiring a clear subject image. [Means for solving the problem]

[0006] An imaging device with a display function according to one embodiment of the present disclosure is an imaging device with a display function comprising a liquid crystal panel, an infrared camera having a focusing lens and an imaging element, and a backlight arranged on the rear surface of the liquid crystal panel, wherein the liquid crystal panel has a display area including a first area and a second area positioned to surround the first area in a planar view, at least the imaging element of the infrared camera is arranged on the optical path of light transmitted through the first area and the focusing lens, and the liquid crystal panel does not have a black matrix in at least the first area, and has color filters in the first area and the second area. Effect of the Invention

[0007] According to an embodiment of the present disclosure, there is provided an imaging device with a display function capable of acquiring a clear subject image using an infrared camera disposed on the rear side of a liquid crystal panel. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 shows the wavelength dependence of the light transmittance of a color filter and a black matrix used in a typical liquid crystal panel. [Diagram 2] FIG. 2 shows an example in which an image of a subject is captured by using infrared light as illumination light and passing through a liquid crystal panel. [Diagram 3] FIG. 3 shows a schematic plan view of the color filters and black matrix of a liquid crystal panel, and the transmittance of red light, green light, blue light and infrared light at the AA line. [Figure 4] FIG. 4 is a schematic diagram showing the generation of diffraction images by red light, green light, blue light and infrared light. [Diagram 5] FIG. 5 is an exploded perspective view showing a schematic configuration of the image pickup device with a display function according to the first embodiment. [Figure 6] FIG. 6 is a schematic cross-sectional view of a main part of the image pickup device with a display function shown in FIG. [Figure 7] FIG. 7 is a schematic cross-sectional view of the first region of the liquid crystal panel in the x-axis direction. [Figure 8] FIG. 8 is a schematic cross-sectional view of the second region of the liquid crystal panel 50 in the x-axis direction. [Figure 9] FIG. 9 is a schematic cross-sectional view of the second region in the y-axis direction. [Figure 10] FIG. 10 is a schematic exploded perspective view of the main components of a liquid crystal panel. [Figure 11] FIG. 11 is a plan view of the color filters and the black matrix. [Figure 12] FIG. 12 is a schematic cross-sectional view of a first region of an imaging device with a display function according to the second embodiment, taken along the x-axis direction. [Figure 13] FIG. 13 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a red filter is arranged, of the counter substrate in the second embodiment. [Figure 14] FIG. 14 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a green filter is arranged, of a counter substrate in the second embodiment. [Figure 15] FIG. 15 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a blue filter is arranged, of the counter substrate in the second embodiment. [Figure 16] FIG. 16 is a schematic cross-sectional view of the first region in the x-axis direction of another image pickup device with a display function according to the second embodiment. [Figure 17] FIG. 17 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a red filter is arranged, of the counter substrate shown in FIG. [Figure 18] FIG. 18 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a green filter is arranged, of the counter substrate shown in FIG. [Figure 19] FIG. 19 is a schematic cross-sectional view in the y-axis direction of a first region of a pixel in which a blue filter is arranged, of the counter substrate shown in FIG. [Figure 20] FIG. 20 is a schematic cross-sectional view of an imaging device with a display function according to the third embodiment. [Figure 21] FIG. 21 is a schematic cross-sectional view of another image pickup device with a display function according to the third embodiment. [Figure 22] FIG. 22 is an exploded perspective view of main components of a liquid crystal panel of an imaging device with a display function according to the fourth embodiment. [Figure 23] FIG. 23 is a schematic cross-sectional view of an imaging device with a display function according to the fifth embodiment. [Figure 24] FIG. 24 is a schematic plan view of a main part of an imaging device with a display function according to the fifth embodiment. [Diagram 25] FIG. 25 is a schematic cross-sectional view of another image pickup device with a display function according to the fifth embodiment. [Figure 26] FIG. 26 is a schematic plan view showing an example of the arrangement of a plurality of illumination light-emitting elements and a plurality of infrared light-emitting elements of a backlight in another image pickup device with a display function according to the fifth embodiment. [Figure 27] FIG. 27 is a schematic cross-sectional view of an imaging device with a display function according to the sixth embodiment. [Figure 28] FIG. 28 is a timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Figure 29] FIG. 29 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Diagram 30] FIG. 30 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Diagram 31] FIG. 31 is another timing chart showing the operation timing of each unit in the image pickup device with a display function according to the seventh embodiment. [Diagram 32] FIG. 32 is a schematic cross-sectional view of an imaging device with a display function according to the eighth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] A configuration in which an imaging device is disposed near a display device is realized in smartphones, tablet terminals, notebook computers, etc. However, in these devices, the position of the lens and lens window indicating the imaging device can be clearly recognized. For this reason, if a similar structure is adopted to configure an instrument panel of an automobile, it is conceivable that the driver will be aware of the presence of the imaging device every time he or she looks at the display of the liquid crystal panel, for example.

[0010] In order to make the position of the imaging device less noticeable, a notch is provided on one side of the display device and the imaging device is placed in the area inside the notch, which is also adopted in smartphones and the like. When such a structure is adopted to configure an instrument panel for an automobile, the display area is not rectangular but the notch portion is missing. This may impair the aesthetic appearance of the instrument panel in the display state, or if the imaging device is placed in the notch portion where no image is displayed, it may be recognized by the driver, and similarly, the driver may be aware of the presence of the imaging device every time he or she looks at the display on the liquid crystal panel.

[0011] In view of these problems, the inventors of the present application have considered arranging an imaging device in a display area where an image can be displayed. For example, they have considered whether it is possible to arrange an imaging device that captures an image using infrared rays at the center of a liquid crystal panel and capture an infrared image through the liquid crystal panel.

[0012] Figure 1 shows the wavelength dependency of the light transmittance of color filters used in general liquid crystal panels. As shown in Figure 1, blue (B), green (G), and red (R) filters (monochrome filters) have optical properties that selectively transmit light in the blue, green, and red wavelength bands, respectively, in the visible range. On the other hand, the blue, green, and red filters transmit light with wavelengths longer than the visible range without absorbing it. For example, the transmittance of all filters for infrared light with a wavelength of 950 nm is about 90%. On the other hand, the black matrix (BM) placed in the boundary region of the color filters has a transmittance of about 0.1% for both visible light and infrared light.

[0013] It is known that polarizing plates and liquid crystal layers have almost no optical effect on infrared rays, so when infrared rays are used as illumination light and an image is captured by an imaging device through a liquid crystal panel equipped with color filters, it is believed that the image can be captured with almost no difference in transmittance between the blue, green, and red filter regions.

[0014] Figure 2 shows an example of capturing an image of a subject that was illuminated by infrared light and passed through a liquid crystal panel. As shown in Figure 2, an image was captured, but it was not a clear image, and multiple images were captured. In particular, the image blur in the horizontal direction was greater than in the vertical direction. This is thought to be due to the influence of the black matrix of the liquid crystal panel.

[0015] Figure 3 is a schematic plan view of the color filters and black matrix of a liquid crystal panel. The transmittance of red light, green light, blue light, and infrared light along the AA line is shown below. The filter regions of each of the RGB colors selectively transmit light of the respective wavelength bands. For example, red light selectively transmits only through the red filter region, and is almost entirely absorbed by the green and blue filter regions. The same is true for green light and blue light. For this reason, the transmission regions in the direction of the AA line are repeated in the same cycle for red light, green light, and blue light.

[0016] On the other hand, as mentioned above, infrared light is transmitted to the same extent regardless of the filter color, but the transmittance of the black matrix for infrared light with a wavelength of 950 nm is only about 0.1%, meaning that most of the infrared light is blocked.

[0017] The areas through which red, green, blue and infrared light pass correspond to the slits of the diffraction grating, and the color filter and black matrix act as a diffraction grating for red, green, blue and infrared light. For red, green and blue light, the slit spacing is three times the pixel pitch in the direction of the AA line, and for infrared light, the slit spacing is the pixel pitch. If the slit spacing is d and the wavelength of light is λ, then the spacing D between the positions where a diffraction image is formed by the reinforcement of light in the diffraction grating is roughly expressed as D∝λ / d.

[0018] In addition, the brightness of the generated diffraction image depends on the ratio A=Amax / Amin of the maximum transmittance Amax to the minimum transmittance Amin.

[0019] FIG. 4 is a schematic diagram showing the generation of diffraction images by red light, green light, blue light, and infrared light. The images by red light, green light, blue light, and infrared light contain ±1st-order, ±2nd-order, ±3rd-order, etc. diffraction images with respect to the image of the subject. As described above, the interval D of the diffraction images is proportional to the wavelength λ and inversely proportional to the slit interval d. Therefore, for the diffraction images by red light, green light, and blue light, the slit interval is the same, but the wavelength is different, so the interval of the blue diffraction image is the shortest. On the other hand, for infrared light, the slit interval d is three times that of red light, etc., and the wavelength is also long, so the interval of the diffraction images by infrared light is more than three times the interval of the diffraction images by red light, green light, and blue light. As a result, when infrared light is used for shooting, it is considered that the diffraction images are recognized as multiple images.

[0020] Each pixel is longer in the y-axis direction than in the x-axis direction along which the blue, green, and red filters are arranged. In other words, the pixel pitch is shorter in the x-axis direction. This is why the image blur in the x-axis direction is greater than that in the y-axis direction, as shown in Figure 2.

[0021] Based on the results of such investigations, the inventors of the present application have come up with an imaging device with a display function. The imaging device with a display function of the present disclosure is capable of capturing an image of a subject facing the front side of the display device, i.e., the display area. The imaging device with a display function may be called an electronic device equipped with an imaging device and a display device, or may be called a display device with an imaging device.

[0022] Such an imaging device with a display function is mounted on the instrument panel of an automobile and can be suitably used to capture the upper body, particularly the face, of a driver. In addition, it can be suitably used to capture images of people who drive or operate vehicles such as trains and airplanes, not limited to automobiles. In addition, as described below, the imaging device with a display function of the present disclosure can capture images from an area within the display area. For this reason, for example, when the imaging device with a display function of the present disclosure is used as a display for a notebook computer, tablet terminal, or smartphone, it can capture images from near the position of the eyes of the face displayed on the display. Therefore, when a web conference is held, compared to the case where a camera is placed in the conventional frame area, it is possible to obtain an image at a more natural angle to the other person in the conference through the display, that is, a direction of gaze as if the other person is looking at the other person's face and eyes during the conference.

[0023] The imaging device with display function of the present disclosure will be described below based on the drawings. The present disclosure is not limited to the following embodiments, and appropriate design changes can be made within the scope of the configuration of the present disclosure. In the following description, the same reference numerals are used in common between different drawings for the same parts or parts having similar functions, and repeated description thereof may be omitted. In addition, each configuration described in the embodiment and the modified example may be appropriately combined or modified within the scope of the gist of the present disclosure. In order to make the description easier to understand, in the drawings referred to below, the configuration may be shown in a simplified or schematic manner, or some of the components may be omitted. In addition, the dimensional ratio between the components shown in each drawing does not necessarily indicate the actual dimensional ratio.

[0024] (First embodiment) FIG. 5 is an exploded perspective view showing a schematic configuration of an image capture device with a display function of this embodiment, and FIG. 6 is a schematic cross-sectional view of a main part of the image capture device with a display function of this embodiment.

[0025] The image capturing device 101 with a display function includes a liquid crystal panel 50, an infrared camera 60, and a backlight 70. The image capturing device 101 with a display function further includes a cover glass 90, a first polarizing plate 91, a second polarizing plate 92, and an optical structure 80. The liquid crystal panel 50, the backlight 70, the first polarizing plate 91, the second polarizing plate 92, and the optical structure 80 form a display device.

[0026] The liquid crystal panel 50 has a front surface 50a and a rear surface 50b. The front surface 50a includes a display area DR and a non-display area NR that surrounds the display area DR and is located around the display area DR. The display area DR is an area where an image is displayed, while the non-display area NR is an area where an image is not displayed because a driving circuit, wiring, etc. are provided.

[0027] The display region DR includes a first region DR1 and a second region DR2. The first region DR1 is surrounded by the second region DR2. The first region DR1 is preferably disposed toward the center of the display region DR, and is preferably disposed toward the center away from the outer edge of the display region DR. The second region DR2 is a region in the display region DR other than the first region DR1, and the outer edge of the first region DR1 is in contact with the inner edge of the second region DR2. The first region DR1 and the second region DR2 are regions defined on the front surface 50a, and are defined continuously in the thickness direction of the liquid crystal panel 50. That is, the first region DR1 and the second region DR2 are also defined on the rear surface 50b, and in a plan view, the first region DR1 and the second region DR2 of the front surface 50a overlap with the first region DR1 and the second region DR2 of the rear surface 50b, respectively.

[0028] The first region DR1 has a circular shape with a diameter of, for example, about 5 mm to about 2 cm The shape of the first region DR1 is not limited to a circle, and may be an ellipse or an oval, or may be a rectangle or a polygon.

[0029] As described in detail below, the liquid crystal panel 50 is configured to be able to display an image in the entire display region DR. That is, a color image can be displayed in the first region DR1 and the second region DR2. More specifically, pixels are configured in the first region DR1 and the second region DR2 of the liquid crystal panel 50, and color filters are arranged therein. The liquid crystal panel 50 does not have a black matrix in the first region DR1. In other words, the black matrix is ​​arranged only in the second region DR2, and not in the first region DR1.

[0030] The first polarizing plate 91 and the second polarizing plate 92 are disposed on the front surface 50a and the back surface 50b of the liquid crystal panel 50, respectively. The first polarizing plate 91 and the second polarizing plate 92 cover the first region DR1 and the second region DR2, respectively, and overlap each other. By disposing the first polarizing plate 91 and the second polarizing plate 92 also in the first region DR1, it is possible to display an image similar to that in the second region DR2 also in the first region DR1. In addition, since it is not necessary to process the first polarizing plate 91 and the second polarizing plate 92, it is possible to reduce manufacturing costs. The first polarizing plate 91 and the second polarizing plate 92 are disposed in a crossed Nicol relationship.

[0031] The cover glass 90 is disposed on the first polarizing plate 91, and protects the liquid crystal panel 50. The backlight 70 is disposed on the outer side of the second polarizing plate 92, with the optical structure 80 interposed therebetween.

[0032] The optical structure 80 enhances the uniformity of the light emitted from the backlight 70 and enhances the brightness by adjusting the traveling direction of the light so that the light is incident perpendicularly to the liquid crystal panel 50. For example, the optical structure 80 includes a brightness enhancement film 81 such as a BEF (Brightness Enhancement Film) and a diffusion plate 82. In FIG. 5, the optical structure 80 shows only these two components, but the optical structure 80 may further include other plate-shaped or film-shaped optical elements. The optical structure 80 has an optical structure through-hole 80h in a region overlapping with the first region DR1. In this embodiment, a through-hole 81h and a through-hole 82h are provided in the brightness enhancement film 81 and the diffusion plate 82 in regions overlapping with the first region DR1, respectively.

[0033] Next, the structure of the liquid crystal panel 50 will be described in detail. The liquid crystal panel 50 may be a liquid crystal panel of various driving methods, and is characterized in that it does not have a black matrix in the first region DR1. Figures 7 and 8 are schematic cross-sectional views of the first and second regions of the liquid crystal panel 50 in the x-axis direction, and Figure 9 shows a schematic cross-sectional view of the second region in the y-axis direction. Also, Figure 10 shows a schematic exploded perspective view of the main components of the liquid crystal panel 50. Figure 11 is a plan view of the color filters and the black matrix.

[0034] The liquid crystal panel 50 includes a TFT substrate 10, a counter substrate 40, and a liquid crystal layer 30 disposed between the TFT substrate 10 and the counter substrate 40.

[0035] The TFT substrate 10 has the same structure in the first region DR1 and the second region DR2. That is, the liquid crystal panel 50 has the same driving structure in the first region DR1 and the second region DR2. Specifically, the TFT substrate 10 includes a substrate 11, a plurality of scanning lines 12, an insulating layer 13, a plurality of data lines 14, a plurality of pixel electrodes 15, a plurality of TFTs, an insulating layer 16, and a counter electrode 19. Each TFT has a gate electrode 12b, a semiconductor layer 17, a source electrode 14s, and a drain electrode 18. The scanning lines 12, the data lines 14, the gate electrodes 12b, the source electrodes 14s, and the drain electrodes 18 are made of, for example, a metal that is substantially opaque to visible light and infrared rays. The pixel electrodes 15 and the counter electrode 19 are made of a transparent conductor such as ITO that transmits visible light and infrared rays.

[0036] The substrate 11 is a substrate made of glass or the like that transmits visible light and infrared light. An undercoat layer or the like may be provided on the surface of the substrate 11. The multiple scanning lines 12 extend in the x-axis direction on the substrate 11 and are arranged in the y-axis direction. The gate electrode 12b of each TFT is connected to the scanning line 12.

[0037] A gate insulating film constituting a part of the insulating layer 13 is formed covering the multiple scanning lines 12 and the gate electrode 12b on the substrate 11. The semiconductor layer 17 is located on the gate insulating film so as to overlap with the gate electrode 12b in a plan view.

[0038] The data lines 14 extend in the y-axis direction on the gate insulating film and are arranged in the x-axis direction. One end of the source electrode 14s of each TFT is connected to the data line 14. The other end of the source electrode 12s is connected to the semiconductor layer 17.

[0039] The drain electrode 18 is disposed spaced apart from the source electrode 14s in the x-axis direction with the gate electrode 12b interposed therebetween.

[0040] An insulating film constituting a part of the insulating layer 13 is formed on the gate insulating film, covering the data line 14, the semiconductor layer 17 and the drain electrode 18.

[0041] A plurality of pixel electrodes 15 are arranged two-dimensionally in the x and y directions on the insulating film. Each pixel electrode is connected to the other end of the drain electrode via a contact hole provided in the insulating film.

[0042] An insulating layer 16 is formed on the insulating layer 13 to cover the pixel electrodes 15. A counter electrode 19 is formed on the insulating layer 16. The counter electrode has a plurality of slits 19s formed therein, for example, extending in the y-axis direction.

[0043] An area surrounded by a pair of scanning lines 12 and a pair of data lines 14 constitutes a pixel, and each pixel includes a TFT, which is a switching element, and a pixel electrode 15 .

[0044] As described above, the TFT substrate 10 has the same structure in the first region DR1 and the second region DR2. That is, the plurality of scanning lines 12, the plurality of data lines 14, the plurality of TFTs, and the plurality of pixel electrodes 15 are located in the first region DR1 and the second region DR2 of the liquid crystal panel 50, respectively. In order to ensure a sufficient amount of light incident on the imaging element, the first region DR1 is preferably large enough to accommodate eight or more of each of the plurality of scanning lines 12, the plurality of data lines 14, the plurality of TFTs, and the plurality of pixel electrodes 15.

[0045] The arrangement pitch of these components is preferably substantially the same in the first region DR1 and the second region DR2. Specifically, the interval between adjacent scanning lines 12 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent scanning lines 12 in the second region DR2. The interval between adjacent data lines 14 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent data lines 14 in the second region DR2. The interval between adjacent TFTs in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent TFTs in the second region DR2. The interval between adjacent pixel electrodes 15 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the interval between adjacent pixel electrodes 15 in the second region DR2. Moreover, the area of ​​the pixel electrode 15 in the first region DR1 is preferably in the range of 0.5 to 1.5 times the area of ​​the pixel electrode 15 in the second region DR2.

[0046] By satisfying such a relationship, it is possible to display a single integrated still image or moving image in the first area DR1 and the second area DR2 without performing special image processing in the first area DR1 and the second area DR2.

[0047] The counter substrate 40 includes a substrate 41, a black matrix 42, and a color filter 43, and has a structure in a first region DR1 different from that in a second region DR2. Specifically, the counter substrate 40 does not have a black matrix 42 in the first region, but has a black matrix in the second region. The counter substrate 40 further includes an overcoat layer 44 that covers the color filter 43.

[0048] The substrate 41 is a substrate made of glass or the like that transmits visible light and infrared light. A black matrix 42 is formed in the second region DR2 of the substrate 41. The black matrix 42 is made of a material having a visible light and infrared light transmittance of 30% or less, preferably 1% or less, for example. The black matrix 42 is located at the boundary between the pixels, and has a portion 42x extending in the x-axis direction and a portion 42y extending in the y-axis direction. As described above, the black matrix 42 is not formed in the first region DR1 of the substrate 41.

[0049] The color filter 43 includes a red filter 43R, a green filter 43G, and a blue filter 43B, and is disposed on the substrate 41. More specifically, any one of the red filter 43R, the blue filter 43B, and the green filter 43G is disposed for each pixel. As shown in Fig. 11, the red filter 43R, the green filter 43G, and the blue filter 43B are repeatedly arranged in the x-axis direction.

[0050] On the other hand, filters of the same color are arranged in the y-axis direction. Therefore, red filters 43R, green filters 43G, and blue filters 43B may be continuous with each other in the y-direction, as shown in FIG.

[0051] As described above, in the second region DR2, since the black matrix 42 is arranged, the boundary between the color filter 43 of each pixel and the color filter of the adjacent pixel is located at the black matrix 42. Therefore, the black matrix 42 suppresses the occurrence of color mixing of two colors selected from red, blue, and green between adjacent pixels. In the second region DR2, the color filters 43 between a pair of adjacent pixels may be in contact with each other or may be spaced apart by a value smaller than the width of the black matrix.

[0052] On the other hand, in the first region DR1, it is preferable that the color filter of each pixel be in contact with the color filter of the adjacent pixel. This makes it possible to suppress the occurrence of light that does not pass through the color filter and is emitted at the boundary between each pixel in the first region DR1 where the black matrix 42 is not formed, even if there is no black matrix, and thus makes it possible to display a correct color image.

[0053] Furthermore, when the imaging device with a display function of this embodiment is used in an instrument panel of an automobile, the driver looks directly at the liquid crystal panel 50. Therefore, compared to when the liquid crystal panel is viewed from an oblique direction, color mixing between pixels is less likely to occur, and even if a black matrix is ​​not provided in the first region DR1, a large difference in display quality between images displayed in the first region DR1 and the second region DR2 is less likely to occur.

[0054] In this embodiment, the color filter of each pixel does not overlap with a part of the color filter of an adjacent pixel. However, due to manufacturing errors or other reasons, the color filter of some pixels may overlap with a part of the color filter of an adjacent pixel in the first region DR1. A structure that actively utilizes the overlapping of color filters will be described in the next embodiment.

[0055] The backlight 70 is fixed at a predetermined position relative to the liquid crystal panel 50 by a housing 85. In this embodiment, the backlight 70 is a direct type, and white light is incident on the liquid crystal panel 50 via the optical structure 80. The backlight 70 includes a chassis 71 having a bottom 71a facing the liquid crystal panel, and a plurality of display light-emitting elements 72 arranged on the bottom 71a. The plurality of display light-emitting elements 72 are mounted on a mounting board 74 arranged inside the bottom 71a. The plurality of display light-emitting elements 72 may be driven by local dimming for each element or for each area. The display light-emitting elements 72 emit, for example, white light. Alternatively, the display light-emitting elements 72 may emit blue light or ultraviolet light. In this case, the backlight 70 may further include a wavelength conversion member covering the display light-emitting elements 72, or a wavelength conversion sheet provided above the multiple display light-emitting elements 72, and may be configured to convert the light emitted from the display light-emitting elements 72 into yellow light or white light, so that the light is emitted from the backlight 70 and the white light is incident on the optical structure 80.

[0056] The backlight 70 further includes at least one infrared light emitting element 73 mounted on a mounting board 74 on the bottom 71a. The infrared light emitting element 73 emits infrared light, which passes through the liquid crystal panel 50 and illuminates the subject (the driver).

[0057] The backlight 70 may further include a partition structure 75 arranged on the mounting substrate 74. The partition structure 75 has a plurality of reflective surfaces 75r, and divides the bottom 71a into regions each including, for example, one or a plurality of display light-emitting elements 72. The reflective surfaces 75r suppress the light emitted from the display light-emitting elements 72 from spreading laterally, thereby increasing the brightness of the light emitted from the backlight 70. In addition, when the backlight 70 is driven by local dimming, the contrast near the boundary between the lit and unlit sections is increased.

[0058] At least one of the reflecting surfaces 75r is preferably located between a collecting lens 63 of the infrared camera 60 (described later) and the infrared light emitting element 73. This makes it possible to prevent the infrared light emitted from the infrared light emitting element 73 from being directly incident on the infrared camera 60.

[0059] The infrared camera 60 includes an imaging element 61, and is disposed with respect to the liquid crystal panel 50 such that the imaging element 61 is located on an optical path LP of light that has passed through the first region DR1 of the liquid crystal panel 50 from the outside. In this embodiment, the optical path LP is configured in a straight line without being bent by a reflector or the like. Therefore, the infrared camera 60 is disposed on the rear side of the liquid crystal panel 50.

[0060] Specifically, the infrared camera 60 has a circuit board 62 equipped with a drive circuit for the imaging element 61, and the imaging element 61 is mounted on the circuit board 62. The chassis 71 of the backlight 70 has a chassis through-hole 71h in a region overlapping with the first region DR1 of the bottom 71a, and the circuit board 62 is arranged outside the chassis 71 so that the imaging element 61 is located within the chassis through-hole 71h. By arranging the circuit board 62 outside the chassis 71, an increase in the height of the chassis 71 can be suppressed, and a decrease in the in-plane uniformity of the backlight can be suppressed.

[0061] The infrared camera 60 preferably further includes a condensing lens 63, an infrared transmission filter 64, and a lens barrel 65. The lens barrel 65 surrounds the imaging element 61 and is attached to the circuit board 62, and is inserted into the chassis through-hole 71h. The condensing lens is supported at one end of the lens barrel 65, and the infrared transmission filter 64 is supported by the lens barrel 65 between the condensing lens 63 and the imaging element 61. The condensing lens 63 condenses external light that transmits through the optical path PL onto the imaging element 61.

[0062] With the lens barrel 65 inserted into the chassis through-hole 71h, the condenser lens 63 is disposed between the bottom 71a of the chassis 71 and the liquid crystal panel 50. With this configuration, the condenser lens 63 can be brought closer to the liquid crystal panel 50, and the first region DR1 can be made smaller.

[0063] The area of ​​the first region DR1 is preferably equal to or larger than the opening area of ​​the condenser lens 63. In addition, the opening area of ​​the optical structure through hole 80h is preferably equal to or larger than the opening area of ​​the condenser lens 63. This makes it possible to prevent the field of view of the infrared camera 60 from being lost.

[0064] Also, it is preferable that the opening area of ​​the optical structure through hole 80h is equal to or smaller than the area of ​​the first region DR1. Furthermore, it is more preferable that the opening area of ​​the optical structure through hole 80h is equal to or larger than the opening area of ​​the condenser lens 63, and that the opening area of ​​the optical structure through hole 80h is equal to or smaller than the area of ​​the first region DR1. By satisfying such a relationship, it is possible to further suppress the field of view of the infrared camera 60 from being lost.

[0065] The infrared transmission filter 64 absorbs visible light and selectively transmits infrared light. For example, the infrared transmission filter 64 has a spectral characteristic in which the transmittance at a wavelength of 920 nm is higher than the transmittance at a wavelength of 550 nm. By disposing the infrared transmission filter 64 having the above-mentioned spectral characteristic between the condenser lens 63 and the image sensor 61, it is possible to efficiently suppress stray light of visible light and to obtain a clearer image of the driver obtained by illumination with infrared light.

[0066] The backlight 70 is disposed on the chassis 71 so as to surround the optical path LP, and may further include a cylindrical light shielding body 76 that blocks infrared rays. When the infrared camera 60 includes the lens barrel 65, it is preferable that the light shielding body 76 surrounds the lens barrel 65.

[0067] The light shielding body 76 preferably transmits visible light and absorbs infrared light. For example, the light shielding body 76 preferably has a spectral characteristic in which the transmittance at a wavelength of 920 nm is equal to or smaller than the transmittance at a wavelength of 550 nm. By providing the light shielding body 76, it is possible to prevent the infrared light emitted from the infrared light emitting element 73 of the backlight 70 from directly entering the infrared camera 60, and whiteout can be suppressed, so that the image of the driver can be acquired more clearly. In addition, by transmitting visible light, even if the light shielding body 76 is provided, it is possible to allow the light emitted from the display light emitting element 72 to enter the optical path LP. Therefore, the light of the backlight 70 can also be made to enter the first region of the liquid crystal panel 50, and it is possible to suppress a decrease in the brightness of the liquid crystal panel 50 in the first region. In other words, when an image of the display device is viewed from the outside, it is possible to suppress the difference in display quality between the first region DR1 and the second region DR2.

[0068] In the image pickup device with a display function of this embodiment, the liquid crystal panel is driven by the FFS method, so that the liquid crystal panel 50 operates in normally black mode.

[0069] According to the imaging device with display function of this embodiment, since the first region does not have a black matrix, the influence of the diffraction image of the image is suppressed, and it is possible to obtain a clear infrared image. In addition, the second region is located so as to surround the first region, and images can be displayed in the first region and the second region. In other words, since the infrared camera can be arranged on the back of the liquid crystal panel, the region where the camera is arranged, that is, the camera hole, is difficult for the driver to see. Therefore, the driver is prevented from being aware of the camera hole while driving and feeling a psychological burden, and it is possible to monitor the driver's condition while providing the driver with a comfortable driving environment.

[0070] In addition, in the imaging device with a display function of this embodiment, the liquid crystal panel is driven by the FFS method. Therefore, the liquid crystal panel operates in normally black. That is, the part where no voltage is applied to drive the liquid crystal, such as between pixels, displays black. Therefore, even if a black matrix is ​​not formed in the first region, the effect of light leakage in black display is reduced.

[0071] In this embodiment, the imaging device with a display function has a black matrix in the second region DR2, but the second region DR2 does not have to have a black matrix. In this case, the counter substrate of the imaging device with a display function has the cross-sectional structure shown in Fig. 7 in the second region as well. In other words, the counter substrate has the same structure in the first region DR1 and the second region DR2.

[0072] In this case, as shown in FIG. 6, the first region DR1' is defined as a region overlapping with the condenser lens 63 of the infrared camera 60 in a plan view. The first region DR1' is surrounded by the second region DR2'. The second region DR2' is a region in the display region DR other than the first region DR1', and the outer edge of the first region DR1' is in contact with the inner edge of the second region DR2'. The first region DR1' and the second region DR2' are regions defined on the front surface 50a, and are defined continuously in the thickness direction of the liquid crystal panel 50. In order to ensure a sufficient amount of light entering the imaging element, the first region DR1' is preferably a size in which eight or more of each of the multiple scanning lines 12, the multiple data lines 14, the multiple TFTs, and the multiple pixel electrodes 15 are arranged.

[0073] In this case, the area of ​​the first region DR1' is equal to the opening area of ​​the condenser lens 63. The opening area of ​​the optical structure through hole 80h is preferably equal to or larger than the opening area of ​​the condenser lens 63. This can prevent the field of view of the infrared camera 60 from being lost. The opening area of ​​the optical structure through hole 80h is preferably equal to or larger than the opening area of ​​the first region DR1'.

[0074] Even if the second region DR2' does not have a black matrix, as described above, the influence of the diffraction image on the image is suppressed, and a clear infrared image can be obtained. Also, the camera hole is less likely to be visible. In particular, according to this embodiment, since there is no difference in the structure of the liquid crystal panel 50 between the first region DR1' and the second region DR2', the camera hole is less likely to be visible.

[0075] In addition, since the liquid crystal panel does not have a black matrix over the entire display area DR, the first area DR1' can be set at any position. In other words, no matter which position in the display area DR the image sensor detects the light that has passed through, a clear image can be obtained. Therefore, the number and positions of the infrared cameras can be changed as desired using the same liquid crystal panel.

[0076] It is preferable that the color filter of each pixel contacts the color filter of the adjacent pixel in 90% or more of the display region DR including the entire first region DR1 and at least a part of the second region DR2. Since no black matrix is ​​formed in the first region DR1 and the second region DR2, by satisfying such a characteristic, light leakage that does not pass through the color filter is suppressed, and the imaging device with display function can display a high-quality color image.

[0077] Second embodiment Figure 12 is a schematic cross-sectional view in the x-axis direction of a first region DR1 of an imaging device with display function, and Figures 13 to 15 are each schematic cross-sectional views in the y-axis direction of a first region of a pixel in which a red filter, a green filter, and a blue filter are arranged on the opposing substrate of a liquid crystal panel.

[0078] The image pickup device with a display function of this embodiment differs from the first embodiment in that two or more different color filters are overlapped in an area of ​​each pixel in the first region DR1 that contacts the boundary with an adjacent pixel.

[0079] For example, consider a case where three color filters are formed by first forming a green filter 43G, then forming a red filter 43R, and finally forming a blue filter 43B. The boundary between a pair of adjacent pixels extending in the y-axis direction may be a combination of red-green, green-blue, and blue-red color filters.

[0080] At the boundary between the red and green filters, an end of green filter 43G and an end of red filter 43R come into contact with each other, and blue filter 43B overlaps on top of them. At the boundary between the green and blue filters, an end of blue filter 43B overlaps on top of an end of green filter 43G. At the boundary between the blue and red filters, an end of blue filter 43B overlaps on top of an end of red filter 43R.

[0081] On the other hand, color filters of the same color are arranged in adjacent pixels in the y-axis direction. Therefore, color filters of different colors are arranged to overlap. As shown in Fig. 13, at the boundary extending in the x-axis direction between pixels adjacent to red filter 43R in the y-axis direction, striped blue filter 43B extending in the x-axis direction is positioned on red filter 43R, so that two or more different color filters overlap.

[0082] 14, at the boundary extending in the x-axis direction between pixels adjacent to green filter 43G in the y-axis direction, striped blue filter 43B extending in the x-axis direction is positioned above green filter 43G, so that two or more different color filters overlap. As shown in Fig. 15, at the boundary extending in the x-axis direction between pixels adjacent to blue filter 43B in the y-axis direction, striped red filter 43R extending in the x-axis direction is positioned below blue filter 43B, so that two different color filters overlap.

[0083] The overlap width of two different color filters in the x-axis direction is Wx, and the overlap width in the y-axis direction is Wy. Let the pixel pitch in the x-axis direction be px and the pixel pitch in the y-axis direction be py. 0.01×px≦Wx≦0.2px 0.01×py≦Wy≦0.2py It is preferable that the following relationship is satisfied.

[0084] With such a configuration, the color filters of adjacent pixels can be more reliably in contact with each other. This reduces the possibility that the color filters do not contact each other and gaps are generated due to manufacturing errors during the formation of the color filters. In addition, since two or more color filters overlap at the boundary between pixels, an area is formed at the boundary between adjacent pixels through which neither color of light of the color filters formed at each pixel passes. Therefore, light mixing between adjacent pixels is suppressed, and a clearer image can be displayed. In particular, a high effect of suppressing light mixing between adjacent pixels can be obtained when observed obliquely in the x-axis direction.

[0085] It is preferable that one of the two color filters overlapped between adjacent pixels is a blue filter, because blue filters have low transmittance and low reflectance, and there is a tendency for relatively blue colors to be preferred for reflected colors.

[0086] The number of color filters overlapped at the boundary between adjacent pixels in the first region DR1 is not limited to 2 and may be 3 or more. In other words, the imaging device with display function of this embodiment may differ from the first embodiment in that three or more different color filters are overlapped in the region of each pixel in the first region DR1 that contacts the boundary with the adjacent pixel.

[0087] Figure 16 is a schematic cross-sectional view in the x-axis direction of the first region DR1 of an imaging device with display function, and Figures 17 to 19 are each schematic cross-sectional views in the y-axis direction of the first region of a pixel in which a red filter, a green filter, and a blue filter are arranged on the opposing substrate of a liquid crystal panel.

[0088] In the pixels arranged in the x-axis direction, at the boundary between the red and green filters, an end of the red filter 43R overlaps an end of the green filter 43G. A striped blue filter 43B extending in the y-axis direction is further arranged on top of the red filter 43R. At the boundary between the green and blue filters, the red filter 43R extending in the y-axis direction is arranged on top of the end of the green filter 43G, and the blue filter 43B is arranged on top of the red filter 43R. At the boundary between the blue and red filters, the end of the red filter 43R overlaps the green filter 43G extending in the y-axis direction, and the end of the blue filter 43B overlaps the red filter 43R.

[0089] On the other hand, color filters of the same color are arranged in adjacent pixels in the y-axis direction. For this reason, color filters of different colors extending in the x-axis direction are arranged to overlap each other. As shown in Fig. 17, at the boundary extending in the x-axis direction between pixels adjacent to red filter 43R in the y-axis direction, red filter 43R is arranged on striped green filter 43G extending in the x-axis direction, and blue filter 43B extending in the x-axis direction is arranged to overlap on top of red filter 43R.

[0090] As shown in Fig. 18, at the boundary extending in the x-axis direction between pixels adjacent to green filter 43G in the y-axis direction, striped red filter 43R extending in the x-axis direction is superimposed on green filter 43G, and striped blue filter 43B extending in the x-axis direction is further superimposed on top of red filter 43R. As shown in Fig. 19, at the boundary extending in the x-axis direction between pixels adjacent to blue filter 43B in the y-axis direction, striped red filter 43R extending in the x-axis direction is superimposed on striped green filter 43G extending in the x-axis direction, and blue filter 43B is further superimposed on top of red filter 43R. The preferred value of the width at which three different color filters overlap is as described above.

[0091] In this way, three or more different color filters overlap at the boundary between adjacent pixels, forming an area at the boundary between adjacent pixels through which no light of any color passes. This suppresses light mixing between adjacent pixels, making it possible to display a clearer image. In particular, when observed obliquely in the x-axis direction, a high effect of suppressing light mixing between adjacent pixels can be obtained.

[0092] In this embodiment, two or more different color filters overlap in the region in contact with the boundary between adjacent pixels in the first region DR1, and a black matrix 42 is formed in the second region DR2 as in the first embodiment. However, as described in the first embodiment, the opposing substrate may not have a black matrix in the second region as well, and two or more different color filters may overlap in the region in contact with the boundary between adjacent pixels. This makes the structure of each pixel the same in the first region DR1 and the second region DR2, and allows images to be displayed with an inconspicuous difference in display quality between the first region DR1 and the second region DR2.

[0093] In addition, the order in which the color filters are stacked depends on the order in which the color filters are formed, and the imaging device with a display function of the present disclosure is not limited to the specific structure described in this embodiment. For example, when the color filters are formed on the opposing substrate in the order of red filter 43R, blue filter 43B, and green filter 43G, the green filter 43G can be replaced with the red filter 43R, the red filter 43R with the blue filter 43B, and the blue filter 43B with the green filter 43G in the above-described structure.

[0094] Third embodiment 20 is a schematic cross-sectional view of an image pickup device with a display function of this embodiment. The image pickup device with a display function differs from the first embodiment in that it includes an edge-type backlight 70'.

[0095] The backlight 70' includes a chassis 71, a light guide plate 77, a display light emitting element, and an infrared light emitting element. The light guide plate 77 is disposed on a bottom portion 71a of the chassis 71. The backlight 70' may further include a reflective sheet 78 between the bottom portion 71a of the chassis 71 and the light guide plate 77.

[0096] The display light emitting element 72 and the infrared light emitting element 73 are mounted on a mounting board 74', and are disposed in the chassis 71 so that the display light emitting element 72 and the infrared light emitting element 73 face the side surface 77c of the light guide plate 77. In the drawing, one display light emitting element 72 and one infrared light emitting element 73 are shown, but the display light emitting element 72 and the infrared light emitting element 73 are disposed on the side surface 77c of the light guide plate 77 according to the required brightness.

[0097] The light guide plate 77 has a through hole 77h at a position overlapping with the first region DR1 in a plan view, and the lens barrel 65 of the infrared camera 60 is inserted into the through hole 77h. The light blocking body 76 is also disposed in the through hole 77h.

[0098] In the backlight 70', similar to the display light emitting elements 72, the infrared light emitting elements 73 are arranged on the side surface 77c of the light guide plate 77. Therefore, the infrared light emitting elements 73 can emit light from the display region DR and can be used as illumination light during imaging.

[0099] Therefore, even if the backlight 70' is an edge type, as described in the first embodiment, since it does not have a black matrix in the first region, the influence of diffraction images on the image is suppressed, and a clear infrared image can be obtained.

[0100] The infrared light emitting element 73 is not limited to being positioned at a position corresponding to the side surface 77c of the light guide plate, and may be disposed so as to face the main surface. For example, as shown in Fig. 21, the infrared light emitting element 73 is mounted on the circuit board 62 of the infrared camera 60. A through hole 78h' and a through hole 71h' are formed in the reflection sheet 78 and the bottom 71a of the chassis 71 at positions overlapping the infrared light emitting element 73 in a plan view. The through hole 78h' and the through hole 71h' are provided at positions overlapping the infrared light emitting element 73 and the second region DR2 of the liquid crystal panel 50 in a plan view.

[0101] With this configuration, the infrared light emitting elements 73 are arranged to face the main surface of the light guide plate 77, and infrared light can be emitted from the back surface of the liquid crystal panel 50 toward the outside. Illumination light for photographing the driver can be emitted from the vicinity of the periphery of the first region DR1. Therefore, even if the backlight is an edge type, the number of infrared light emitting elements 73 used for illumination can be reduced by arranging the infrared light emitting elements 73 in a direct type position.

[0102] (Fourth embodiment) 22 is an exploded perspective view of the main components of the liquid crystal panel of the image capture device with a display function of this embodiment. The liquid crystal panel of the image capture device with a display function of this embodiment has a different structure from the liquid crystal panel of the first embodiment.

[0103] Specifically, as shown in FIG. 22, the plurality of pixel electrodes 15 includes a plurality of first pixel electrodes 15A and a plurality of second pixel electrodes 15B. The first pixel electrodes 15A and the second pixel electrodes 15B are arranged alternately in the x-axis direction. That is, one of the plurality of first pixel electrodes 15A One of the plurality of second pixel electrodes 15B is adjacent to another in the x-axis direction. Also, adjacent first pixel electrode 15'A and second pixel electrode 15'B share one data line 14. From another perspective, the pixel electrodes 15 are arranged two-dimensionally in the x and y directions, so that an adjacent pair of first pixel electrode 15A and second pixel electrode 15B is arranged between a pair of adjacent data lines 14 in the x-axis direction.

[0104] The multiple scanning lines 12 include multiple first scanning lines 12A and multiple second scanning lines 12B. Each of the multiple scanning lines 12 is associated with a pixel electrode 15 arranged in the x-axis direction, with the first scanning line 12A associated with the first pixel electrode 15A and the second scanning line 12B associated with the second pixel electrode 15B. The first scanning line 12A of one of the multiple scanning lines 12 is disposed at the upper end of the pixel electrodes 15 arranged in the x-axis direction, and the multiple second scanning lines 12B are disposed at the lower end. From another perspective, the pixel electrodes 15 are two-dimensionally arranged in the x-axis direction and the y-axis direction, so that one of the multiple first scanning lines 12A and one of the multiple second scanning lines 12B are disposed between a pair of pixel electrodes 15 adjacent to each other in the y-axis direction among the multiple pixel electrodes 15.

[0105] The first pixel electrode 15'A and the second pixel electrode 15'B arranged on either side of one data line 14 are scanned by different scanning lines. Specifically, the first pixel electrode 15'A is scanned by the first scanning line 12A via the TFT-A, and the second pixel electrode 15'B is scanned by the second scanning line 12B via the TFT-B.

[0106] Each data line 14 is located between a pair of a first pixel electrode and a second pixel electrode (a first pixel electrode 15'A and a second pixel electrode 15'B) arranged in the x-axis direction, and drives both of these pixel electrodes. In other words, one data line 14 is shared by two pixels (pixel electrodes 15'A and 15'B) that sandwich it. Since the two pixels are different pixels, different data signals need to be supplied at different timings. This doubles the total number of scanning lines. In other words, two scanning lines 12A and 12B are required to operate pixels (pixel electrodes 15'A and 15'B) adjacent in the x-axis direction. In addition, since one data line is shared by two pixels, the writing time is also about half. However, the total number of data lines is half that of a normal liquid crystal panel. In other words, the data lines 14 are arranged at a pitch twice the pixel pitch in the x-axis direction.

[0107] As mentioned above, when capturing an image with infrared light through a black matrix, overlapping images in the x-axis direction are significantly detected depending on the shape of the pixel. This is because the interval between the diffraction images is inversely proportional to the slit interval d, and the smaller the interval of the black matrix, the larger the interval between the diffraction images.

[0108] According to the imaging device with display function of the present disclosure, since a black matrix is ​​not formed in the first region of the liquid crystal panel, the influence of the diffraction image caused by the black matrix is ​​reduced. However, when the liquid crystal panel becomes higher resolution and the pixel pitch becomes smaller, the data line made of metal, in addition to the black matrix, may also cause the diffraction image. In this case, by adopting the structure of this embodiment and making the data line pitch twice the pixel pitch, the slit interval can be doubled and the increase in the interval of the diffraction image can be suppressed.

[0109] That is, according to this embodiment, even when a high-definition liquid crystal panel is used, it is possible to prevent the intervals between the diffraction images from widening and the image from becoming unclear.

[0110] Fifth embodiment 23 and 24 are respectively a schematic cross-sectional view and a schematic plan view of a main part of a liquid crystal panel of an image pickup device with a display function of this embodiment. The image pickup device with a display function of this embodiment includes an optical structure 180 having a shape different from that of the first embodiment. The image pickup device with a display function of this embodiment does not include a light shielding body, and the liquid crystal panel does not have a black matrix in the entire display region DR. As described in the first embodiment, the first region DR1' is defined as a region overlapping with the condenser lens 63 of the infrared camera 60 in a plan view, and the liquid crystal panel has a color filter and does not have a black matrix in the first region DR1'. The first region DR1' is located on the optical path of light incident on the image pickup element 61 of the infrared camera 60.

[0111] Specifically, the imaging device with display function of this embodiment comprises a liquid crystal panel 50 having a display area DR, an infrared camera 60 having a focusing lens 63, an imaging element 61 and a lens barrel 65 that supports the focusing lens 63 at a predetermined gap relative to the imaging element 61, a backlight 70 arranged on the rear side of the liquid crystal panel 50, and an optical structure 180 arranged between the liquid crystal panel 50 and the backlight 70.

[0112] As described above, the optical structure 180 includes at least one optical sheet having an optical function. In this embodiment, as shown in Fig. 23, the optical structure 180 includes a brightness enhancement film 81 and a diffuser 182. The diffuser 182 has a first main surface 182a and a second main surface 182b. The first main surface 182a is located on the bottom 71a side of the backlight 70, and the second main surface 182b is located on the liquid crystal panel 50 side.

[0113] The diffuser 182 has a recess 182d disposed on the first main surface 182a, and a through hole 182h located between the bottom surface of the recess 182d and the second main surface 182b. The opening area Sh of the through hole 182h is smaller than the area Sd of the bottom surface of the recess 182d. In addition, it is preferable that the depth Dh of the through hole 182h is smaller (shallower) than the depth Dd of the recess 182d. In plan view, the through hole 182h of the diffuser 182 overlaps with the lens barrel 65. In addition, the area of ​​the through hole 182h in plan view is smaller than the area of ​​the lens barrel 65. In other words, it is preferable that the entire through hole 182h overlaps with the lens barrel 65 in plan view. Such a structure of the diffuser 182, in particular, the depth Dh of the through hole 182h and the depth Dd of the recess 182d satisfying the above-mentioned relationship, prevents infrared rays entering the focusing lens 63 from an oblique direction at the through hole 182h from being blocked by the diffuser 182, and prevents the angle of view of the infrared camera from becoming narrow.

[0114] At least a portion of the diffuser 182 is disposed within the chassis 71 of the backlight 70. In this embodiment, the entire diffuser 182 is disposed within the chassis 71. That is, the diffuser 182 is adjacent to the bottom 71a of the chassis 71. Also, at least a portion of the lens barrel 65 is located within the recess 182d of the diffuser 182. In particular, it is preferable that the condenser lens 63 supported by the lens barrel 65 is located within the recess 182d.

[0115] The light incident on the diffuser 182 from the display light emitting element 72 of the backlight 70 is repeatedly diffused in the diffuser 182, and is emitted from the second main surface 182b while being diffused as shown by the arrow. As described above, in a plan view, the through hole 182h of the diffuser 182 overlaps with the lens barrel 65, and the area of ​​the through hole 182h is smaller than the area of ​​the lens barrel 65. Therefore, in a plan view, even in the region where the lens barrel 65 and the diffuser 182 overlap, the light is emitted vertically from the second main surface 182b of the diffuser 182. In addition, the light emitted from the second main surface 182b also travels in an oblique direction and spreads above the through hole 182h. That is, in the diffuser 182, the light is guided to the boundary with the through hole 182h, and the light diffused near the boundary and emitted in an oblique direction passes through the liquid crystal panel 50 to reach the observer. Therefore, in a plan view, a decrease in luminance in the area overlapping with the lens barrel 65 in the display region DR is suppressed, and the uniformity of the light emitted from the backlight 70 in the display region DR can be improved.

[0116] In particular, according to this embodiment, the area of ​​the through-hole 182h can be made smaller than the area of ​​the lens barrel 65, and the area in the lens barrel 65 from which light can be emitted perpendicularly from the second main surface 182b in a plan view can be increased. Therefore, according to this embodiment, regardless of the cross-sectional area of ​​the lens barrel 65 or the diameter of the condenser lens, the opening of the through-hole 182h can be made smaller, and the area in the display region DR where the luminance decreases can be reduced.

[0117] Furthermore, since the recess 182d is formed in the diffuser 182, it is easy to align the diffuser 182 with the lens barrel 65 that holds the condenser lens 63, and misalignment can be suppressed even if the opening area of ​​the through-hole 182h is small. In particular, when the alignment accuracy between the through-hole 182h and the lens barrel 65 is poor, it is necessary to enlarge the opening of the through-hole 182h to ensure the amount of light required for shooting, but according to this embodiment, such a design is not necessary. Therefore, it is possible to further reduce the opening area of ​​the through-hole 182h and improve the uniformity of the luminance within the display region DR.

[0118] Furthermore, when the diffuser 182 having the recess 182d and the through-hole 182h is formed, for example, from two members, an air layer interface occurs between the two members within the diffuser 182. Since light is reflected at the air layer interface, the transmittance of light from the first main surface 182a to the second main surface 182b may decrease, and the distribution of light may become non-uniform near the through-hole 182h and the recess 182d. In contrast, by forming the diffuser 182 from one member, it is possible to suppress such a decrease in the transmittance of light and non-uniformity in the light distribution, and to increase the uniformity of the luminance within the display region DR. Furthermore, since the diffuser 182 is formed from one member, assembly is easy.

[0119] In this embodiment, the infrared light emitting element 73 irradiates the subject directly with infrared light without transmitting through the liquid crystal panel 50. For this reason, the imaging device with a display function of this embodiment is equipped with a housing 185. The housing 185 has a holding portion 185d in a non-display area NR located outside the display area DR, and a plurality of infrared light emitting elements 73 are arranged in the holding portion 185d. Also, similar to the first embodiment, the housing 185 holds the backlight 70 at a predetermined position relative to the liquid crystal panel 50.

[0120] With such a configuration, the infrared light emitting elements 73 are disposed in the non-display region NR, and infrared light emitted from the infrared light emitting elements 73 for photographing reaches the subject directly without passing through the liquid crystal panel 50. Therefore, compared to a case where the infrared light emitting elements 73 are disposed on the rear side of the liquid crystal panel 50 and within the display region DR, infrared light is prevented from becoming stray light within the backlight 70 and entering the imaging element 61 of the infrared camera 60. This makes it possible to obtain a clear image. In particular, this effect can be achieved even without the light shielding body 76.

[0121] 25 is a schematic cross-sectional view of a main part showing another example of an imaging device with a display function according to the present embodiment. The diffuser 182 of the optical structure 180 includes a first diffuser plate 182A and a second diffuser plate 182B. The first diffuser plate 182A and the second diffuser plate 182B have a first through hole 182Ah and a second through hole 182Bh, respectively. The first through hole 182Ah and the second through hole 182Bh each have, for example, a simple cylindrical shape, and the opening area of ​​the second through hole 182Bh is larger than the opening area of ​​the first through hole 182Ah.

[0122] The first diffusion plate 182A and the second diffusion plate 182B are laminated such that the axis of the first through hole 182Ah and the axis of the second through hole 182Bh coincide with each other. In addition, the second diffusion plate 182B is closer to the bottom 71a of the backlight 70 than the first diffusion plate 182A.

[0123] By constructing the diffuser from two plate-like members in this way, the recesses and through-holes of the diffuser 182 can be formed more easily, and the manufacturing cost of the diffuser 182 can be reduced. In addition, since the diffuser 182 is constructed from two members, the optical properties of the first diffuser plate 182A and the second diffuser plate 182B can be made different from each other, and the optical function of the entire diffuser can be adjusted. For example, the material cost can be reduced by reducing the haze value of the second diffuser plate 182B.

[0124] In this embodiment, the infrared light emitting elements 73 are arranged in the non-display area NR, but similar to the first embodiment, the infrared light emitting elements 73 may be arranged in the backlight 70. Fig. 26 is a schematic plan view showing an example of the arrangement of a plurality of display light emitting elements 72 and a plurality of infrared light emitting elements 73 in the backlight 70.

[0125] A plurality of display light-emitting elements 72 and a plurality of infrared light-emitting elements 73 are arranged on the bottom 71a of the chassis 71. Specifically, for example, the plurality of display light-emitting elements 72 are arranged at equal pitches in the x-axis direction and the y-axis direction. Each of the plurality of infrared light-emitting elements 73 is arranged, for example, between four display light-emitting elements 72 adjacent to each other. In this embodiment, the plurality of infrared light-emitting elements 73 are arranged at equal pitches in the x-axis direction and the y-axis direction. The arrangement pitch of the infrared light-emitting elements 73 is larger than the arrangement pitch of the display light-emitting elements 72. For example, in this embodiment, the arrangement pitch of the infrared light-emitting elements 73 is four times the arrangement pitch of the display light-emitting elements 72. In addition, in this embodiment, the infrared light-emitting element 73 is arranged in the center of the four adjacent infrared light-emitting elements 73. In addition, the lens barrel 65 is arranged between the display light-emitting elements 72 that are arranged at equal pitches and are adjacent to each other.

[0126] According to this configuration, the infrared light emitting elements are arranged in the backlight, so that the frame area can be narrowed. In addition, by arranging the infrared light emitting elements 73 at equal pitches, infrared light for shooting can be emitted uniformly. In addition, by making the arrangement pitch of the infrared light emitting elements larger than the arrangement pitch of the display light emitting elements, it is possible to arrange the infrared light emitting elements at a distance from the condenser lens 63 of the infrared camera 60. Therefore, it is possible to prevent infrared light emitted from the infrared light emitting elements 73 from directly entering the infrared camera 60 as stray light. In addition, since the arrangement pitch of the display light emitting elements 72 is kept constant even around the lens barrel 65 without change, a uniform display with little decrease in brightness can be obtained even around the lens barrel 65.

[0127] Sixth embodiment 27 is a schematic cross-sectional view of a main part of an imaging device with a display function of this embodiment. The imaging device with a display function of this embodiment differs from the fifth embodiment in that the optical structure 280 further includes a second diffuser 84.

[0128] The second diffuser 84 is disposed, for example, between the liquid crystal panel and the brightness enhancement film 81 or the diffuser 182 of the optical structure 280. The gap Sp1 between the second diffuser 84 and the liquid crystal panel 50 is preferably smaller than the gap Sp2 between the second diffuser 84 and the diffuser 182. The second diffuser 84 overlaps with the entire first region DR1' and the entire second region DR2' in a plan view.

[0129] In the second diffuser 84, the haze value for visible light is larger than the haze value for infrared light. In addition, in the second diffuser 84, the rectilinear transmittance for visible light is smaller than the rectilinear transmittance for infrared light. In other words, the second diffuser 84 diffuses visible light more than infrared light. The second diffuser 84 having such optical properties can be formed by a film, a substrate, or the like, sandwiching a polymer dispersed liquid crystal (PDLC).

[0130] This embodiment differs from the fifth embodiment in that the visible light from the backlight diffused by the diffuser 182 is diffused again by the second diffuser 84 just before entering the liquid crystal panel 50. In the fifth embodiment, the visible light spreading above the through-hole 182h is light traveling in an oblique direction, and in the area other than the through-hole 182h, in addition to the light traveling in an oblique direction, light traveling in a vertical direction is also included. In this embodiment, the light traveling in an oblique direction above the through-hole 182h enters the second diffuser 84 and is diffused again, and is emitted from the second diffuser 84 in both vertical and oblique directions. Of course, in the area other than the area above the through-hole 182h, the light that enters the second diffuser 84 is diffused again, and is emitted from the second diffuser 84 in both vertical and oblique directions. In this way, by arranging the second diffuser 84, the diffusion state of the light emitted from the second diffuser 84 does not differ between the area above the through-hole 182h and the other areas.

[0131] This structure allows the visible light from the backlight to be more scattered, making the boundary between the first region DR1' and the second region DR2' less noticeable. In particular, when the liquid crystal panel 50 displays white or a high brightness image, the decrease in brightness in the first region DR1' is suppressed, making the first region DR1' less noticeable. Meanwhile, the haze value for infrared light is small, making it possible to capture an infrared image with good resolution.

[0132] Furthermore, because gap Sp2 is larger than gap Sp1, as described with reference to FIG. 23, more light reaches above through hole 182h, suppressing the decrease in brightness and differences in the diffusion state of light in first region DR1', and improving the uniformity of the light emitted from the backlight 70 within display region DR.

[0133] Seventh embodiment In the imaging devices with a display function according to the first to sixth embodiments, the backlight 70 is controlled to be constantly lit as a backlight for a general liquid crystal panel, or to be periodically turned off to insert a black image display by pseudo-impulse driving. There is no particular restriction on the timing of operation of the infrared camera 60 and the infrared light emitting element 73 for imaging. For example, the infrared light emitting element 73 may be constantly lit and imaging by the infrared camera 60 may be constantly performed, or the infrared light emitting element 73 may be constantly lit and imaging by the infrared camera 60 may be constantly performed only during a predetermined period within one frame period.

[0134] In contrast, in the imaging device with a display function of this embodiment, the timing of lighting the backlight 70 is associated with the timing of lighting the infrared light emitting element 73. FIG. 28 is a timing chart showing the operation timing of each part in the imaging device with a display function of this embodiment. In FIG. 28, (a) shows the timing of scanning the liquid crystal panel 50, (b) shows the transmittance of the liquid crystal panel, and (c) shows the timing of lighting the backlight 70. Also, (d) shows the timing of lighting the infrared light emitting element 73, and (e) shows the timing of imaging by the infrared camera 60. (a) shows the position where the scanning line (gate line) is turned ON in one scanning period of the liquid crystal panel 50, and (b) shows the transmittance of the liquid crystal panel at the timing shown by the circle in (a) when the entire liquid crystal panel 50 is displayed in a uniform intermediate color. In the figure, the black and white shading shows the difference in transmittance, with white indicating high transmittance and black indicating low transmittance. (c) and (d) show the high level when the backlight 70 and the infrared light emitting element 73 are turned on and illuminated. (e) shows the high level when the infrared camera 60 is capturing an image. In each chart, the horizontal axis shows the passage of time.

[0135] In general, in a liquid crystal panel, during one scanning period, the scanning lines arranged in the column direction (vertical direction) are selected in sequence from the top to the bottom, and a voltage is applied to the selected scanning line. This turns on the switching element of the pixel connected to the selected scanning line, and an electric charge is accumulated between the pixel electrode and the opposing electrode. A voltage according to the amount of electric charge is generated in the pixel electrode, and the liquid crystal in the liquid crystal layer is oriented according to the voltage. As a result, light passes through that pixel with a specified transmittance.

[0136] After that, the switching element turns off, but ideally the accumulated charge is maintained, so the voltage does not change and the light transmittance remains constant. However, in reality, when the switching element turns off, the charge accumulated in the pixel gradually leaks out and the voltage of the pixel electrode also drops. This causes the light transmittance to gradually decrease.

[0137] For this reason, as shown in (b), at timing S1 when the bottom end is scanned in one scanning period, the pixels connected to the top scanning line are charged at the very beginning of one scanning period, and have the smallest transmittance due to the large amount of charge leakage. On the other hand, the pixels connected to the bottom end are charged immediately before, and therefore have the smallest charge leakage and the largest transmittance.

[0138] In contrast, at timings S2 to S4 when the scanning position of the scanning line is between the upper end and the lower end, the previously scanned scanning line and the next scanned scanning line are adjacent to each other, so that the pixel with the highest transmittance and the pixel with the lowest transmittance are adjacent to each other. The higher the transmittance of the liquid crystal panel 50, the higher the luminance of the liquid crystal panel 50 due to the backlight 70. For this reason, at timings S2 to S4, the display area of ​​the liquid crystal panel 50 has streaky luminance unevenness (streaky unevenness) where the brightest area and the darkest area are adjacent to each other across the scanning position.

[0139] When the backlight 70 is always on, the position where the scanning line is scanned moves sequentially from the upper end to the lower end during one scanning period, so that the brightness unevenness described above is averaged and not noticeable. However, when the backlight 70 is periodically turned off at a timing synchronized with one scanning period and the infrared light emitting element is turned on during that period, streaky unevenness occurs at a specific position. Furthermore, when the turning off of the backlight 70 is not synchronized with one scanning period, the brightness distribution of the liquid crystal panel 50 changes from moment to moment. In particular, when there is a slight misalignment between the scanning period of the liquid crystal panel 50 and the blinking period of the backlight, beat noise occurs in which the position of the streaky unevenness moves (flows) at a constant speed at a frequency corresponding to the misalignment.

[0140] In the imaging device with display function of this embodiment, the backlight 70 is generally turned off when scanning of the liquid crystal panel 50 ends, and the infrared light emitting elements 73 are turned on to capture an image using the infrared camera 60. For example, as shown in FIG. 28, the infrared camera 60 captures an image in a period before and after the end of one scanning period of the liquid crystal panel 50. The infrared light emitting elements 73 are turned on slightly earlier than the imaging period, and are turned off slightly after the imaging period of the infrared camera 60 ends. The backlight 70 is turned on during the period when the infrared light emitting elements 73 are turned off. In other words, the backlight 70 is turned off during the period when the infrared light emitting elements 73 are turned on.

[0141] The period during which the backlight 70 is turned off and the period during which the infrared light emitting elements 73 are turned on coincide with the period during which the liquid crystal panel 50 is scanned. As described above, the timing at which the backlight 70 is turned off and the timing at which the infrared light emitting elements 73 are turned on, and the timing at which the infrared camera 60 captures an image generally coincide with the end of one scanning period of the liquid crystal panel 50, that is, the timing at which the bottom scanning line is scanned.

[0142] 29 to 31. In the example shown in FIG. 29, the backlight 70 is turned off, the infrared light emitting element 73 is turned on, and the infrared camera 60 captures an image when the lower end of the scanning line and the lower end portion of the multiple scanning lines immediately before it are scanned. In the example shown in FIG. 30, the backlight 70 is turned off, the infrared light emitting element 73 is turned on, and the infrared camera 60 captures an image when the upper end of the scanning line and the upper end portion of the multiple scanning lines immediately after it are scanned. In the example shown in FIG. 31, a scanning line pause period is provided between scanning periods, and in the period after the scanning of the liquid crystal panel 50 is completed and before the next scanning is started, the backlight 70 is turned off, the infrared light emitting element 73 is turned on, and the infrared camera 60 captures an image.

[0143] By performing such control, the backlight 70 is turned off when the infrared camera 60 captures an image. Therefore, the influence of visible light from the backlight 70 is suppressed during image capture, and a clear image can be obtained by the infrared camera 60. Specifically, even if the visible light blocking performance of the infrared transmission filter 64 of the infrared camera 60 is insufficient, visible light does not reach the imaging element 61, so a clear image can be captured without an increase in the black level of the captured image or a decrease in the S / N ratio.

[0144] Also, by fixing the scanning position of the panel when the backlight is turned off, it is possible to suppress beat noise and the like that may be caused by a change in luminance due to turning off the backlight 70. Furthermore, by turning off the backlight 70 approximately when scanning of the liquid crystal panel 50 ends, when scanning of the liquid crystal panel ends and before the next scan starts, or when the upper or lower end part of the display area is being scanned, it is possible to suppress the occurrence of streaks and the like and to suppress the effects on image display.

[0145] Eighth embodiment 32 is a schematic cross-sectional view of the main part of the image pickup device with a display function of this embodiment. The image pickup device with a display function of this embodiment differs from the sixth embodiment in that it further includes a half mirror 98.

[0146] The half mirror 98 is disposed in front of the liquid crystal panel 50. In this embodiment, the half mirror 98 is located between the cover glass 90 and the liquid crystal panel 50. The half mirror 98 covers the entire display region DR, and overlaps with the entire through-hole 182h of the diffuser 182 in plan view.

[0147] The half mirror 98 preferably has a higher transmittance for infrared light than for visible light. For example, the transmittance of the half mirror 98 at a wavelength of 940 nm is preferably higher than the transmittance at a wavelength of 550 nm. The half mirror 98 having such optical properties can be made of a dielectric multilayer film.

[0148] According to such a configuration, the imaging device with a display function of this embodiment also functions as a mirror. Therefore, for example, it can be suitably used as a rearview mirror of a vehicle. Specifically, it can be used as an electronic mirror by displaying an image from a camera that captures the rear of the vehicle on the liquid crystal panel 50. In addition, it can be used as a normal mirror depending on the driver's selection or when the power source for driving the imaging device with a display function is lost.

[0149] In addition, since the driver needs to look at the rearview mirror, it is difficult for an obstacle to be placed between the driver and the rearview mirror. Therefore, the imaging device with a display function of this embodiment, which is placed at the position of the rearview mirror, can reliably capture an image of the driver using the infrared camera 60, making it possible to appropriately monitor the driver's condition.

[0150] Furthermore, the half mirror 98 has a high infrared transmittance, so that a good infrared image can be obtained.

[0151] (Other forms) Various modifications are possible for the imaging device with a display function disclosed herein. First, the driving method of the liquid crystal panel is not limited to FFS, and the liquid crystal panel may be driven by IPS or other driving methods. In addition, in this embodiment, the optical path of the light that passes through the first regions DR1 and DR1' and enters the imaging element 61 of the infrared camera 60 is a straight line, but the optical path may be bent in a direction parallel to the back surface 50b of the liquid crystal panel 50 by a mirror or the like. In this case, the infrared camera can be disposed on the side of the liquid crystal panel 50, so that the overall thickness of the imaging device with a display function can be reduced. In addition, two or more of the first to eighth embodiments can be combined as long as there is no contradiction.

[0152] In the first to eighth embodiments, the imaging device with a display function includes an optical structure having a diffusion plate. However, in the backlight, when the display light-emitting elements and the infrared light-emitting elements are covered with a diffusion member or the like and uniform light is emitted from the backlight, the optical structure does not need to include a diffusion plate. In this case, the optical structure does not need to have a through-hole, and the light transmitted through the first region may further transmit through the optical structure and enter the imaging element. In addition, since the optical function of the optical structure is provided in the backlight, the imaging device with a display function does not need to include the optical structure.

[0153] Furthermore, by including the above-mentioned backlight, optical structure, and infrared camera, the imaging device with display function of the fifth embodiment can suppress a decrease in brightness in the area of ​​the liquid crystal panel where the infrared camera is located, making it difficult to recognize the presence of the infrared camera, even if the infrared camera is placed on the backlight side. Such a configuration including a backlight, optical structure, and infrared camera can be called an imaging device with a light source for a liquid crystal panel, and achieves the above-mentioned effects.

[0154] Specifically, the imaging device with a light source for a liquid crystal panel disclosed in the fifth embodiment comprises a backlight having a display-use light-emitting element, an optical structure including a diffuser arranged at a position where light emitted from the display-use light-emitting element passes through, and an infrared camera having a lens barrel that supports the imaging element and the focusing lens at a predetermined gap from the imaging element, with at least a part of the lens barrel being located on the backlight side rather than the diffuser, the diffuser having a through hole, the through hole of the diffuser overlapping with the lens barrel in a planar view, and the area of ​​the through hole in a planar view being smaller than the area of ​​the lens barrel.

[0155] Such an imaging device with a light source for a liquid crystal panel is not limited to a display device for an instrument panel, but can be suitably used as an imaging device with a display function that can display an image without making the user aware of the presence of the imaging device. In addition, depending on the use of the image acquired by the imaging device, or as long as the acquired image can be subjected to appropriate image processing according to the use, the image acquired by the infrared camera does not need to be always clear. For this reason, the imaging device with a light source for a liquid crystal panel of the fifth embodiment can be combined with a liquid crystal panel having a black matrix arranged in front, and such a combination can also realize an imaging device with a display function that makes it difficult to recognize the presence of the infrared camera.

[0156] The imaging device with a display function according to the present disclosure can also be described as follows.

[0157] An imaging device with a display function according to a first configuration of the present disclosure includes: A liquid crystal panel; an infrared camera having a condenser lens and an image sensor; The backlight located on the back, An imaging device with a display function, the liquid crystal panel has a display area including a first area and a second area positioned so as to surround the first area in a plan view; At least the imaging element of the infrared camera is disposed on an optical path of the light transmitted through the first region and the condenser lens; The liquid crystal panel does not have a black matrix at least in the first region, and has color filters in the first region and the second region.

[0158] According to the first configuration, since the first region does not have a black matrix, the influence of the diffraction image of the image is suppressed, and it is possible to obtain a clear infrared image. In addition, the second region is positioned so as to surround the first region, and images can be displayed in the first region and the second region. In other words, the infrared camera can be placed on the back of the liquid crystal panel, not on the edge. Therefore, for example, when this imaging device with display function is used to photograph a driver, it is possible to monitor the driver's condition while providing a comfortable driving environment without making the driver aware of the presence of the camera (without putting pressure on the driver).

[0159] According to another first configuration of the present disclosure, an imaging device with a display function includes: A liquid crystal panel having a display area; an infrared camera having a condenser lens and an image sensor; A backlight disposed on the rear surface; An imaging device with a display function, At least an imaging element of the infrared camera is disposed on a display area of ​​the liquid crystal panel and on an optical path of light transmitted through the condenser lens, The liquid crystal panel does not have a black matrix in the display area, and has a color filter.

[0160] The imaging device with display function according to the second configuration may be configured such that in the first configuration, the color filter of each pixel is in contact with the color filter of an adjacent pixel in the first region. By having the color filters of each pixel in contact with each other in the first region, leakage of light that does not pass through the filter is suppressed even without a black matrix, and a correct color display image can be displayed.

[0161] In the image pickup device with a display function according to the third configuration, in the first configuration, the liquid crystal panel may have a black matrix arranged so as to overlap at least the boundary between adjacent pixels in the second region. By having the black matrix in the second region, light leakage can be suppressed.

[0162] The image pickup device with a display function according to the fourth configuration may be configured such that the color filter of each pixel is in contact with the color filter of an adjacent pixel in 90% or more of the display area including the entire first area and at least a part of the second area. Since the first area and the second area do not have a black matrix, the difference in visibility between the first area and the second area when the screen is viewed can be reduced.

[0163] In a fifth aspect of the present invention, in the first aspect of the present invention, the color filter may have at least three or more different monochrome filters, and two or more different monochrome filters may overlap each other in a region of each pixel in the first region that contacts the boundary with an adjacent pixel. By overlapping two or more monochrome filters at the pixel boundary, the transmittance of visible light is reduced, and mixing of light between adjacent pixels is suppressed.

[0164] In a sixth configuration of the imaging device with display function, in the first configuration, the color filter may have at least three or more different monochrome filters, and two or more different monochrome filters may be overlapped in an area of ​​each pixel in the entire first region and at least a part of the second region that borders the boundary with adjacent pixels.

[0165] In a seventh aspect of the present invention, in the first aspect of the present invention, the color filter may have at least three or more different monochrome filters, and the three or more different monochrome filters may overlap in a region of each pixel in the first region that contacts the boundary with an adjacent pixel. By overlapping three or more monochrome filters at the pixel boundary, the transmittance of visible light is further reduced, and mixing of light between adjacent pixels is suppressed.

[0166] An imaging device with a display function according to an eighth configuration is such that, in the fourth configuration, the color filter has at least three or more different monochrome filters, and three or more different monochrome filters may be overlapped in an area of ​​each pixel in the entire first region and at least a part of the second region that borders the boundary with adjacent pixels.

[0167] A ninth configuration of an imaging device with a display function is such that, in the first configuration, the infrared camera further includes a focusing lens located on the optical path between the liquid crystal panel and the imaging element, and the area of ​​the first region may be equal to or larger than the aperture area of ​​the focusing lens.

[0168] The imaging device with display function according to the tenth configuration is the first configuration, further comprising a first polarizing plate arranged in front of the liquid crystal panel and a second polarizing plate arranged between the liquid crystal panel and the backlight, and the first polarizing plate and the second polarizing plate may overlap the first region and the second region. Since the polarizing plate is not processed, costs can be reduced. An image can be displayed in the first region in the same way as in the second region.

[0169] The image pickup device with a display function according to an eleventh aspect is the first aspect, further comprising an optical structure including at least one optical sheet disposed between the second polarizing plate and the backlight, the optical structure having an optical structure through hole in an area overlapping with the first area. Since the optical structure is not positioned on the optical path of the infrared camera, a clear image can be obtained.

[0170] In the image capturing device with a display function according to a twelfth aspect, in the eleventh aspect, the opening area of ​​the optical structure through hole may be equal to or larger than the opening area of ​​the condenser lens, thereby preventing the camera field of view from being lost.

[0171] An imaging device with a display function according to a thirteenth configuration is the eleventh configuration, wherein an opening area of ​​the optical structure through hole may be equal to or smaller than an area of ​​the first region.

[0172] The imaging device with display function of the 14th configuration may be such that, in the 11th configuration, the opening area of ​​the optical structure through hole is equal to or larger than the opening area of ​​the lens, and the opening area of ​​the optical structure through hole is equal to or smaller than the area of ​​the first region.

[0173] An imaging device with display function in accordance with a fifteenth configuration may be the ninth configuration, in which the backlight includes a chassis having a bottom facing the display area and a plurality of display light-emitting elements arranged on the bottom, and the focusing lens is located between the bottom of the chassis and the liquid crystal panel.

[0174] The imaging device with display function according to a sixteenth aspect of the present invention is the fifteenth aspect, and the backlight may further include at least one infrared light emitting element arranged at the bottom. With this arrangement, infrared light for imaging can be irradiated from the front of the driver. Also, by arranging the element at the bottom, stray light can be prevented from entering the condenser lens.

[0175] The imaging device with display function of the 17th configuration is the 15th configuration, wherein the backlight has a plurality of reflective surfaces each located between a plurality of display light-emitting elements, and further includes a partition structure arranged at the bottom of the chassis, and one of the plurality of reflective surfaces may be located between at least one infrared light-emitting element and the focusing lens.

[0176] An imaging device with a display function in accordance with an 18th configuration may be the 9th configuration, in which the backlight includes a chassis having a bottom facing the display area, a light guide plate arranged on the bottom, and a display light emitting element arranged on a side of the light guide plate, and the focusing lens is located between the bottom of the chassis and the liquid crystal panel.

[0177] The imaging device with a display function according to a nineteenth configuration is the eighteenth configuration, wherein the backlight further includes an infrared light emitting element disposed on a side surface of the light guide plate.

[0178] The image pickup device with a display function according to a twentieth configuration is based on the eighteenth configuration, and the backlight may further include at least one infrared light emitting element disposed opposite to the main surface of the light guide plate.

[0179] The imaging device with display function according to a twenty-first configuration is the fourteenth or eighteenth configuration, wherein the infrared camera further includes a circuit board having a drive circuit for driving the imaging element, the imaging element is mounted on the circuit board, the chassis has a chassis through-hole provided at a position overlapping with the first region in a plan view, and the circuit board is disposed outside the chassis such that the imaging element is located within the chassis through-hole. With this configuration, the thickness of the backlight can be reduced to prevent deterioration of the in-plane uniformity of the backlight.

[0180] A twenty-second aspect of the present invention provides an image capture device with a display function according to the ninth aspect, wherein the infrared camera further includes an infrared transmission filter arranged on the optical path and having a higher transmittance at a wavelength of 920 nm than at a wavelength of 550 nm, thereby suppressing stray visible light.

[0181] A display-equipped imaging device according to a twenty-third aspect of the present invention is the twenty-second aspect, wherein the infrared transmission filter is disposed between the condenser lens and the imaging element, thereby making it possible to efficiently suppress stray light.

[0182] The imaging device with a display function according to a twenty-fourth configuration is the ninth configuration, and the backlight may further include a cylindrical light shielding body that is disposed in the chassis so as to surround the optical path and that blocks infrared rays, thereby making it possible to suppress stray infrared rays.

[0183] A twenty-fifth configuration of the image pickup device with a display function is the twenty-fourth configuration, and the light blocking body may have a transmittance at a wavelength of 920 nm equal to or smaller than a transmittance at a wavelength of 550 nm. This makes it possible to suppress stray infrared light.

[0184] The imaging device with a display function according to a twenty-sixth configuration is the twenty-fifth configuration, and the light shielding body may transmit visible light. By transmitting visible light through the light shielding body, light emitted from the backlight can reach the first region as well, and the first region can be prevented from becoming dark.

[0185] The imaging device with a display function according to a twenty-seventh configuration includes, in the first configuration, The liquid crystal panel includes a TFT substrate, a counter substrate, and a liquid crystal layer disposed between the TFT substrate and the counter substrate. The TFT substrate is a plurality of scanning lines disposed in a display region, extending in a first direction and arranged in a second direction different from the first direction; a plurality of data lines extending in a second direction and arranged in a first direction; a plurality of switching elements respectively connected to one of the plurality of scan lines and one of the plurality of data lines; a plurality of pixel electrodes respectively connected to a plurality of switching elements and arranged two-dimensionally in a first direction and a second direction; The device may include:

[0186] An imaging device with a display function in accordance with a 28th configuration may be configured such that, in the 27th configuration, eight or more of each of the multiple scanning lines, the multiple data lines, the multiple switching elements, and the multiple pixel electrodes are located within a first region of the liquid crystal panel.

[0187] The imaging device with a display function according to a 29th configuration is the 27th configuration, wherein the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are each a liquid crystal panel. The pixel electrode may be located in a first region and a second region, and the area of ​​the pixel electrode in the first region may be in the range of 0.5 to 1.5 times the area of ​​the pixel electrode in the second region.

[0188] The imaging device with display function of the 30th configuration is the 27th configuration, wherein the multiple scanning lines, the multiple data lines, the multiple switching elements, and the multiple pixel electrodes are respectively located in a first region and a second region of the liquid crystal panel, and the spacing between adjacent scanning lines in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent scanning lines in the second region.

[0189] The imaging device with display function of the 31st configuration is the 27th configuration, in which the multiple scanning lines, the multiple data lines, the multiple switching elements, and the multiple pixel electrodes are respectively located in a first region and a second region of the liquid crystal panel, and the spacing between adjacent data lines in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent data lines in the second region.

[0190] The imaging device with display function of the 32nd configuration is the 27th configuration, wherein the multiple scanning lines, the multiple data lines, the multiple switching elements, and the multiple pixel electrodes are respectively located in a first region and a second region of the liquid crystal panel, and the spacing between adjacent switching elements in the first region may be in the range of 0.5 to 1.5 times the spacing between adjacent switching elements in the second region.

[0191] The imaging device with display function according to the 33rd configuration may be the 27th configuration, wherein the scanning lines, the data lines, the switching elements, and the pixel electrodes are located in a first region and a second region of the liquid crystal panel, respectively, and the area of ​​the pixel electrodes in the first region is in a range of 0.5 to 1.5 times the area of ​​the pixel electrodes in the second region, the interval between adjacent scanning lines in the first region is in a range of 0.5 to 1.5 times the interval between adjacent scanning lines in the second region, and the interval between adjacent data lines in the first region is in a range of 0.5 to 1.5 times the interval between adjacent data lines in the second region. According to the 28th to 31st configurations, an integrated image or video can be displayed in the first and second regions without performing special image processing.

[0192] The imaging device with display function according to a thirty-fourth configuration is the twenty-seventh configuration, wherein the plurality of pixel electrodes includes a plurality of first pixel electrodes and a plurality of second pixel electrodes, and one of the plurality of first pixel electrodes and one of the plurality of second pixel electrodes are adjacent in a first direction and may be disposed between a pair of data lines adjacent in the first direction. By reducing the number of data wirings, even if the pixel pitch is reduced, the spacing between the data lines forming the diffraction grating is widened, thereby preventing the image from becoming unclear due to the widening of the spacing between the diffraction images.

[0193] The imaging device with display function according to a thirty-fifth configuration is the thirty-fourth configuration, wherein the plurality of scanning lines includes a plurality of first scanning lines and a plurality of second scanning lines, one of the plurality of first scanning lines and one of the plurality of second scanning lines are disposed between pixel electrodes adjacent in the second direction among the plurality of pixel electrodes, and the first pixel electrode and the second pixel electrode disposed between a pair of adjacent data lines may be connected to the first scanning line and the second scanning line via switching elements, respectively, thereby making it possible to reduce the number of data lines.

[0194] In a thirty-sixth aspect of the present invention, in the first aspect of the present invention, the liquid crystal panel may operate in a normally black mode, thereby making it possible to suppress light leakage when displaying black.

[0195] An imaging device with a display function according to a thirty-seventh configuration of the present disclosure includes: A liquid crystal panel having a display area; an infrared camera having a condenser lens, an image sensor, and a lens barrel that supports the condenser lens at a predetermined gap relative to the image sensor; A backlight disposed on the rear surface of the liquid crystal panel; an optical structure including a diffuser, the optical structure being disposed between the liquid crystal panel and the backlight; Equipped with The diffuser has a through hole, In a plan view, the through hole of the diffuser overlaps with the lens barrel, The area of ​​the through hole in the plan view is smaller than the area of ​​the lens barrel.

[0196] This configuration allows light to enter the lens barrel area from the diffuser, and also allows the opening area of ​​the through hole to be reduced. This makes it possible to reduce the area of ​​the infrared camera where brightness is likely to decrease, making the presence of the infrared camera less noticeable. Also, it is possible to increase the uniformity of the light emitted from the backlight within the display area.

[0197] The imaging device with display function of the 38th configuration is, in the 37th configuration, the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recess arranged in the first main surface, the through hole is located between a bottom surface of the recess and the second main surface, and a part of the lens barrel is located within the recess of the diffuser.

[0198] This configuration makes it easy to align the diffuser with the lens barrel or the like that holds the condenser lens, and because the diffuser is a single member, assembly is also easy.

[0199] The imaging device with display function according to a thirty-ninth aspect may further include at least one infrared light emitting element arranged in a non-display area located outside the display area in the thirty-seventh aspect. With this configuration, infrared light emitted from the infrared light emitting element for imaging is prevented from becoming stray light in the backlight and entering the infrared camera. This makes it possible to obtain a clear image.

[0200] An imaging device with a display function in accordance with a 40th configuration may be configured as in the 37th configuration, wherein the backlight includes a chassis having a bottom facing the display area, and a plurality of display light-emitting elements and a plurality of infrared light-emitting elements arranged on the bottom.

[0201] According to this configuration, since the infrared light emitting elements are arranged in the backlight, the frame area can be narrowed. In addition, by arranging the plurality of display light emitting elements and the plurality of infrared light emitting elements at equal pitches, infrared light for shooting can be emitted uniformly. In addition, by making the arrangement pitch of the infrared light emitting elements larger than the arrangement pitch of the display light emitting elements, it is possible to arrange the infrared light emitting elements at a distance from the infrared camera, and it is possible to prevent infrared light emitted from the infrared light emitting elements from directly entering the infrared camera as stray light.

[0202] An imaging device with display function of the 41st configuration may be configured such that, in the 37th configuration, the diffuser includes a first diffuser plate and a second diffuser plate, the first diffuser plate and the second diffuser plate have a first through hole and a second through hole, respectively, the opening area of ​​the second through hole is larger than the opening area of ​​the first through hole, and the first diffuser plate and the second diffuser plate are stacked so that the axis of the first through hole and the axis of the second through hole coincide with each other.

[0203] According to this configuration, the diffuser can be formed more easily by constructing it from two plate-like members. Also, by making the optical properties of the first diffuser plate and the second diffuser plate different, the optical function of the entire diffuser can be adjusted. For example, the material cost can be reduced by reducing the haze value of the second diffuser plate.

[0204] The imaging device with display function of the 42nd configuration is the 37th configuration, wherein the optical structure further has a second diffuser located between the liquid crystal panel and the diffuser, and the second diffuser may have a haze value for visible light that is greater than the haze value for infrared light.

[0205] According to this configuration, since the diffuser is provided with a through hole, in the region above the through hole, there is no vertical diffusion of visible light from the backlight, and only the diffused light that is diagonally emitted from the periphery of the through hole of the diffuser to the region above the through hole is included. The second diffuser diffuses the light emitted from the diffuser in vertical and diagonal directions, so that the visible light from the backlight is also emitted in the vertical direction in the region above the through hole due to the diffusion by the second diffuser. Therefore, the light emitted from the second diffuser is emitted in the vertical and diagonal directions in the region above the through hole of the diffuser, as in the region other than the region above the through hole, and there is no difference in the diffusion state of the light between the through hole and the other region. In other words, this structure causes the visible light from the backlight to be more scattered, making the boundary between the first region and the second region less noticeable. In addition, since the haze value for infrared rays in the second diffuser is smaller than the haze value for visible light, an infrared image can be captured with good resolution. In the imaging device with a display function according to a 43rd configuration, in the 1st or 37th configuration, the infrared camera may capture images during at least a part of a period in which the backlight is turned off. With this configuration, imaging is performed with the infrared camera when the backlight is turned off, so that the effect of visible light from the backlight on imaging can be suppressed, and a clear image can be obtained with the infrared camera.

[0206] An imaging device with display function of a 44th configuration may be the 43rd configuration, further comprising an infrared light-emitting element, and the backlight may be turned off when scanning of the liquid crystal panel is completed, after scanning of the liquid crystal panel is completed and before the next scan is started, or when the upper or lower end of the display area is being scanned. This makes it possible to suppress beat noise and the like that may be caused by a change in luminance due to turning off the backlight, and to suppress the influence on image display.

[0207] The imaging device with display function of the 45th configuration may be, in the 37th configuration, further comprising a half mirror arranged on the front side of the liquid crystal panel, and in a planar view, the entire through hole of the diffuser may overlap with the half mirror.

[0208] According to this configuration, the image capturing device with a display function can also function as a mirror. By applying it to an in-vehicle rearview mirror, the driver can be monitored without getting caught in the vehicle.

[0209] The image pickup device with a display function of a 46th configuration is the 45th configuration, and the transmittance of the half mirror at a wavelength of 940 nm may be higher than the transmittance at a wavelength of 550 nm. With this configuration, a better infrared image can be acquired.

[0210] The imaging device with a light source for a liquid crystal panel according to the 47th configuration of the present disclosure, in any of the 36th to 46th configurations, may have a color filter on the optical path of light that passes through the through hole of the diffuser and the focusing lens to reach the imaging element, and may not have a black matrix.

[0211] An imaging device with a light source for use with a liquid crystal panel according to a forty-eighth configuration of the present disclosure includes: A backlight having a display light-emitting element; an optical structure including a diffuser disposed at a position through which light emitted from the display light-emitting element passes; an infrared camera including a lens barrel that supports a condenser lens, an image sensor, and the condenser lens at a predetermined gap relative to the image sensor, and at least a portion of the lens barrel is positioned closer to the backlight than the diffuser; Equipped with The diffuser has a through hole, In a plan view, the through hole of the diffuser overlaps with the lens barrel, The area of ​​the through hole in the plan view is smaller than the area of ​​the lens barrel.

[0212] This configuration makes it possible to reduce the area of ​​the infrared camera where brightness is likely to decrease, thereby providing an imaging device with a light source for a liquid crystal panel that makes the presence of the infrared camera less noticeable.

[0213] An imaging device with a light source for a liquid crystal panel in accordance with a 49th configuration may be configured such that, in the 48th configuration, the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recess arranged in the first main surface, the through hole is located between a bottom surface of the recess and the second main surface, and another part of the lens barrel is located within the recess of the diffuser. [Explanation of symbols]

[0214] 10...TFT substrate, 11...substrate, 12...scanning line, 12A...first scanning line, 12B...second scanning line, 12b...gate electrode, 13...insulating layer, 14...data line, 14'...data line, 14s...source electrode, 15...pixel electrode, 15A...first pixel electrode, 15B...second pixel electrode, 16...insulating layer, 17...semiconductor layer, 18...drain electrode, 19...counter electrode, 19s...slit, 30...liquid crystal layer, 40...counter substrate, 41...substrate, 42...black matrix, 42x, 42y...part of black matrix, 43...color filter, 43B...blue filter, 43G...green filter, 43R...red filter, 50...liquid crystal panel, 50a...front, 50b...rear, 60...infrared camera, 61...imaging element, 62...circuit board, 63...condenser lens, 64...infrared transmission filter 65... barrel, 70, 70'... backlight, 71... chassis, 71a... bottom, 71h... chassis through hole, 71h'... through hole, 72... display light emitting element, 73... infrared light emitting element, 74, 74'... mounting board, 75... partition structure, 75r... reflective surface, 76... light shielding body, 77... light guide plate, 77c... side, 77h... through hole, 78... reflective sheet, 78h... through hole, 80, 180, 28 0...optical structure, 80h...optical structure through hole, 81...brightness enhancement film, 81h...through hole, 82...diffuser plate, 82h...through hole, 85, 185...housing, 90...cover glass, 91...first polarizer plate, 92...second polarizer plate, 98...half mirror, 101...image pickup device with display function, 182 diffuser, 182A...first diffuser plate, 182B...second diffuser plate, 182d...recess, 182h...through hole

Claims

1. A liquid crystal panel; an infrared camera having a condenser lens and an image sensor; A backlight disposed on the rear surface of the liquid crystal panel; An imaging device with a display function, the liquid crystal panel has a display area including a first area and a second area positioned so as to surround the first area in a plan view; At least an imaging element of the infrared camera is disposed on an optical path of light transmitted through the first region and the condenser lens, The liquid crystal panel does not have a black matrix at least in the first region, and has color filters in the first region and the second region.

2. 2. The image pickup device with display function according to claim 1, wherein in the first region, the color filter of each pixel is in contact with the color filter of an adjacent pixel.

3. 3. The image pickup device with a display function according to claim 2, wherein the liquid crystal panel has a black matrix arranged so as to overlap at least a boundary between adjacent pixels in the second region.

4. 3. The imaging device with display function according to claim 2, wherein the color filter has at least three different monochrome filters, and two or more different monochrome filters overlap in an area of ​​each pixel in the first region that borders the boundary with an adjacent pixel.

5. 2. The image pickup device with a display function according to claim 1, wherein an area of ​​the first region is equal to or larger than an area of ​​an aperture of the condenser lens.

6. The backlight is a chassis having a bottom portion facing the display area; A plurality of display light emitting elements arranged on the bottom; Equipped with 2. The image pickup device with a display function according to claim 1, wherein the condenser lens is located between a bottom of the chassis and the liquid crystal panel.

7. the infrared camera further includes a circuit board including a drive circuit for driving the image sensor; the imaging element is mounted on the circuit board, the chassis has a chassis through-hole provided at a position overlapping with the first region in a plan view, The image pickup device with a display function according to claim 6 , wherein the circuit board is disposed outside the chassis so that the image pickup element is located inside the chassis through hole.

8. 2. The image capturing device with a display function according to claim 1, wherein the infrared camera further comprises an infrared transmission filter disposed on the optical path and having a higher transmittance at a wavelength of 920 nm than at a wavelength of 550 nm.

9. The image pickup device with a display function according to claim 6 , wherein the backlight is further provided with a cylindrical light shielding body that is arranged in the chassis so as to surround the optical path and that blocks infrared rays.

10. the liquid crystal panel includes a TFT substrate, a counter substrate, and a liquid crystal layer disposed between the TFT substrate and the counter substrate; The TFT substrate is a plurality of scanning lines disposed in the display area, extending in a first direction and arranged in a second direction different from the first direction; a plurality of data lines extending in the second direction and arranged in the first direction; a plurality of switching elements respectively connected to one of the plurality of scanning lines and one of the plurality of data lines; a plurality of pixel electrodes respectively connected to the plurality of switching elements and two-dimensionally arranged in the first direction and the second direction; Equipped with the plurality of scanning lines, the plurality of data lines, the plurality of switching elements, and the plurality of pixel electrodes are located in the first region and the second region of the liquid crystal panel, respectively; 2. The image pickup device with a display function according to claim 1, wherein the interval between adjacent scanning lines in the first region is in the range of 0.5 to 1.5 times the interval between adjacent scanning lines in the second region.

11. A liquid crystal panel having a display area; an infrared camera having a condenser lens, an image sensor, and a lens barrel that supports the condenser lens with a predetermined gap relative to the image sensor; A backlight disposed on the rear surface of the liquid crystal panel; an optical structure including a diffuser, the optical structure being disposed between the liquid crystal panel and the backlight; An imaging device with a display function, The diffuser has a through hole, In a plan view, the through hole of the diffuser overlaps with the lens barrel, an area of ​​the through hole in the plan view is smaller than an area of ​​the lens barrel; An imaging device with a display function.

12. the diffuser has a first main surface located on the backlight side, a second main surface located on the liquid crystal panel side, and a recessed portion disposed on the first main surface, the through hole is located between a bottom surface of the recess and the second main surface, A portion of the lens barrel is located within the recess of the diffuser. The imaging device with a display function according to claim 11.

13. the diffuser includes a first diffuser plate and a second diffuser plate, the first diffuser plate and the second diffuser plate have a first through hole and a second through hole, respectively, an opening area of ​​the second through hole is larger than an opening area of ​​the first through hole, and the first diffuser plate and the second diffuser plate are laminated such that an axis of the first through hole and an axis of the second through hole coincide with each other. The imaging device with a display function according to claim 11.

14. 12. The image pickup device with a display function according to claim 11, wherein the backlight comprises a chassis having a bottom portion facing the display area, and a plurality of display light-emitting elements and a plurality of infrared light-emitting elements arranged on the bottom portion.

15. The imaging device with display function described in claim 11, wherein the optical structure further has a second diffuser located between the liquid crystal panel and the diffuser, and the second diffuser has a greater haze value for visible light than for infrared light.

16. The image capturing device with a display function according to claim 11 , wherein the infrared camera captures images during at least a portion of a period in which the backlight is turned off.

17. 17. The imaging device with display function according to claim 16, further comprising an infrared light emitting element, wherein the backlight is turned off when scanning of the liquid crystal panel ends, when scanning of the liquid crystal panel ends and before starting a next scan, or when scanning an upper end portion or a lower end portion of the display area.

18. A half mirror is further provided in front of the liquid crystal panel. In a plan view, the through hole of the diffuser is entirely overlapped with the half mirror. The imaging device with a display function according to claim 11.

19. The transmittance of the half mirror at a wavelength of 940 nm is greater than the transmittance at a wavelength of 550 nm.

20. The imaging device with a display function according to claim 18.

20. 20. The imaging device with display function described in any one of claims 11 to 19, wherein the liquid crystal panel has a color filter on the optical path of light that passes through the through hole of the diffuser and the focusing lens to reach the imaging element, and does not have a black matrix.

Images