Display system and data processing method
By using multi-layer processing units and neural networks in the display system for image correction, the uneven display and seam problems in high-resolution display devices are solved, the display quality and frame frequency are improved, and power consumption is reduced.
Patent Information
- Application Number
- CN202411248685.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2017-07-21
- Filing Date
- 2018-06-14
- Publication Date
- 2024-11-08
AI Technical Summary
In a high-resolution display device, as the number of pixels increases, characteristic deviations of transistors and characteristic deviations of display elements lead to problems in which display unevenness and the boundary between the display panels are easily seen.
A display system including a processing unit is adopted, which generates the second image data using the first image data and performs image correction using a neural network to reduce display inhomogeneity and the appearance of seams. The processing unit is divided into three levels. The first layer generates more computational data, the second layer multiplies by the weight coefficient, and the third layer generates less image data to improve the accuracy of image correction.
It is realized to reduce display unevenness and seams in high-resolution display devices, improve display quality and frame frequency, and reduce power consumption.
Smart Images

Figure CN118918812A_ABST
Abstract
Description
This application is a divisional application of the invention patent application with the invention name “Display System and Data Processing Method”, the international application date of June 14, 2018, and the application number of 201880041881.8 (the international application number is PCT / IB2018 / 054352). Technical Field
[0001] One embodiment of the present invention relates to a display system and a data processing method.
[0002] Note that an embodiment of the present invention is not limited to the above-mentioned technical field. As an example of a technical field of an embodiment of the present invention, a semiconductor device, a display device, a light-emitting device, a display system, an electronic device, a lighting device, an input device (e.g., a touch sensor), an input-output device (e.g., a touch screen), a driving method of the above-mentioned device, and a manufacturing method of the above-mentioned device can be cited.
[0003] Note that in this specification, etc., semiconductor devices generally refer to all devices that can operate by utilizing semiconductor characteristics. Display devices (liquid crystal display devices, light-emitting display devices, etc.), projection devices, lighting devices, electro-optical devices, power storage devices, storage devices, semiconductor circuits, imaging devices, and electronic devices are sometimes referred to as semiconductor devices. Or, sometimes they include semiconductor devices. Background Art
[0004] In recent years, high-resolution display devices are required. For example, the development of display devices including a large number of pixels, such as full HD (1920×1080 pixels), 4K (e.g., 3840×2160 pixels or 4096×2160 pixels), and 8K (e.g., 7680×4320 pixels or 8192×4320 pixels) display devices, is booming.
[0005] In addition, there is a demand for larger display devices. For example, the screen size of a home television device is mostly larger than 50 inches in diagonal. The larger the screen size, the more information can be displayed at one time, so the screen size of digital signage and the like is required to be larger.
[0006] Flat panel displays represented by liquid crystal display devices and light-emitting display devices are widely used as display devices. Although silicon is mainly used as a semiconductor material in transistors used in these display devices, in recent years, technology for using transistors formed using metal oxides for pixels of display devices has been developed.
[0007] Patent Document 1 discloses a technology in which amorphous silicon is used as a semiconductor material for a transistor. Patent Documents 2 and 3 disclose technologies in which metal oxides are used as semiconductor materials for a transistor. [References] [Patent Document]
[0008] [Patent Document 1] Japanese Patent Application Publication No. 2001-053283 [Patent Document 2] Japanese Patent Application Publication No. 2007-123861 [Patent Document 3] Japanese Patent Application Publication No. 2007-096055
[0009] As the number of pixels in a display device increases, the following problem occurs: the influence of the variation in transistor characteristics and the influence of the variation in display element characteristics increase, resulting in noticeable display unevenness.
[0010] When a display device includes a plurality of display panels arranged to serve as a large display area, there is a problem that the boundaries between the display panels are easily visible due to the variation in characteristics of the display panels.
[0011] An object of one embodiment of the present invention is to provide a display device or a display system with high display quality. Another object of one embodiment of the present invention is to provide a display device or a display system with reduced display unevenness. Another object of one embodiment of the present invention is to provide a display device or a display system with high resolution. Another object of one embodiment of the present invention is to provide a display device or a display system including a large display area. Another object of one embodiment of the present invention is to provide a display device or a display system capable of operating at a high frame rate. Another object of one embodiment of the present invention is to provide a display device or a display system with low power consumption.
[0012] Note that the description of these purposes does not prevent the existence of other purposes. One embodiment of the present invention does not need to achieve all of the above purposes. Other purposes can be extracted from the description of the specification, drawings, and claims. Summary of the invention
[0013] A display system according to one embodiment of the present invention includes a processing unit and a display unit. The processing unit has a function of generating second image data by using first image data. The display unit has a function of displaying an image based on the second image data. The display unit includes a plurality of pixels. The processing unit includes a first layer, a second layer, and a third layer. The first image data is supplied to the first layer. The first image data includes a plurality of data. The plurality of data respectively correspond to any one of a plurality of pixels. The first layer has a function of generating first operation data by using the first image data so that the number of data corresponding to one pixel is greater than the number of the first image data. The second layer has a function of generating second operation data by multiplying the first operation data by a weight coefficient. The third layer has a function of generating second image data by using the second operation data so that the number of data corresponding to one pixel is less than the number of the second operation data.
[0014] A display system according to an embodiment of the present invention includes a processing unit and a display unit. The processing unit has a function of generating second image data by using first image data. The display unit has a function of displaying an image according to the second image data. The display unit includes a plurality of pixels. The processing unit includes a first layer, a second layer, and a third layer. The first image data is supplied to the first layer. The first layer has a function of generating first operation data by using the first image data. The first layer has a function of supplying the first operation data to the second layer. The second layer has a function of generating second operation data by using the first operation data and a weight coefficient. The second layer has a function of supplying the second operation data to the third layer. The third layer has a function of generating second image data by using the second operation data. The first image data includes a (a is an integer greater than 1) first data corresponding to one pixel. The first operation data includes b (b is an integer greater than a) second data corresponding to one pixel. The weight coefficient includes b third data corresponding to one pixel. The second operation data includes b fourth data corresponding to one pixel. The second image data includes c (c is an integer less than b) fifth data corresponding to one pixel. The fourth data is the product of any one of the second data and any one of the third data.
[0015] The display unit may further include a first display area, a second display area, a first drive circuit and a second drive circuit. The first drive circuit has a function of driving the first display area. The second drive circuit has a function of driving the second display area.
[0016] The processing unit may have a function of correcting only the data of pixels corresponding to a part of the first image data.
[0017] The processing unit may have a function of generating the second image data by utilizing a neural network.
[0018] The processing unit may also include neural network circuitry.
[0019] The processing unit may further include a transistor including a metal oxide in a channel formation region or a transistor including silicon in a channel formation region.
[0020] One embodiment of the present invention is an electronic device including a display system having any one of the above-described structures, and at least one of an antenna, a battery, a housing, a camera, a speaker, a microphone, and an operation button.
[0021] One embodiment of the present invention is a data processing method, comprising the steps of: obtaining first brightness data of an image displayed on a display device based on first image data input to the display device; and updating the value of a correction filter used to correct image data by using the first brightness data.
[0022] One embodiment of the present invention is a data processing method, comprising the following steps: obtaining first brightness data of an image displayed on a display device based on first image data input to the display device; updating the value of a correction filter used to correct the image data by using the first brightness data; generating second image data by correcting the first image data using the correction filter whose value is updated using the first brightness; obtaining second brightness data of an image displayed on the display device based on second image data input to the display device; and updating the value of the correction filter by using the second brightness data.
[0023] For example, the first image data includes coordinate data and grayscale data of a first color. The grayscale data of the first color includes a plurality of grayscale values corresponding to different coordinates. When the number of grayscales that can be represented by the grayscale data of the first color is k bits and k is an integer greater than 2, the plurality of grayscale values are 2 k-2 Above and 3×2 k-2 The plurality of grayscale values are preferably the same value.
[0024] The first image data may further include grayscale data of a second color and grayscale data of a third color. The grayscale data of the second color includes a plurality of grayscale values corresponding to different coordinates. The grayscale data of the third color includes a plurality of grayscale values corresponding to different coordinates.
[0025] The grayscale values of the grayscale data of the second color and the grayscale values of the grayscale data of the third color are preferably all 0. In addition, when the number of grayscales that can be represented by the grayscale data of the second color is m bits and m is an integer greater than 2, the grayscale values of the grayscale data of the second color are preferably 2 m-2 Above and 3×2 m-2 Similarly, when the number of grayscales that can be represented by the grayscale data of the third color is n bits and n is an integer greater than 2, the plurality of grayscale values of the grayscale data of the third color are preferably 2 n-2 Above and 3×2 n-2 The following describes that the plurality of grayscale values of the grayscale data of the second color are preferably the same value and the plurality of grayscale values of the grayscale data of the third color are preferably the same value.
[0026] The first brightness data is preferably acquired using a two-dimensional brightness meter.
[0027] One embodiment of the present invention is a display device including a processing unit and a display unit. The processing unit has a function of generating output data by using image data and a correction filter whose value is updated by a data processing method of any one of the above structures. The display unit has a function of displaying an image based on the output data.
[0028] One embodiment of the present invention may provide a display device or display system with high display quality. Another embodiment of the present invention may provide a display device or display system with reduced display unevenness. Another embodiment of the present invention may provide a display device or display system with high resolution. Another embodiment of the present invention may provide a display device or display system including a large display area. Another embodiment of the present invention may provide a display device or display system capable of operating at a high frame rate. Another embodiment of the present invention may provide a display device or display system with low power consumption.
[0029] Note that the description of these effects does not prevent the existence of other effects. One embodiment of the present invention does not need to achieve all of the above effects. Effects other than the above effects can be extracted from the description of the specification, drawings, and claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] In the attached picture: Figure 1A and Figure 1B An example of a display system is shown; Figure 2 An example of a display unit is shown; Figure 3 An example of the operation of the display unit is shown; Figure 4 An example of a processing unit is shown; FIG. 5A to FIG. 5C An example of processing performed in a display system is shown; Figure 6 An example of processing performed in the first layer is shown; Figure 7 An example of processing performed in the second layer is shown; Figure 8 An example of processing performed in the third layer is shown; Fig. 9 An example of processing performed in the third layer is shown; Fig.10 An example of a display unit is shown; Fig.11 An example of a display system is shown; Fig. 12A An example of a display system is shown, Fig. 12B An example of a display panel is shown; Fig.13A An example of a display panel is shown. Fig. 13B and Fig. 13C shows a configuration example of a display panel; Fig.14AAn example of a display device is shown, and FIG. 14B-1 and FIG. 14B-2 show an example of processing performed in the display system; Fig.15 An example of a display system is shown; Fig.16 An example of a display system is shown; 17A to 17C An example of processing performed in a display system is shown; 18A to 18C An example of processing performed in a display system is shown; Fig.19 An example of the structure of a semiconductor device is shown; Fig. 20 An example of the structure of a storage unit is shown; Fig.21 An example of the structure of a bias circuit is shown; Fig. 22 It is a timing diagram; FIG. 23A to FIG. 23E An example of the structure of a pixel is described; Fig.24A and Fig. 24B An example of the structure of a pixel circuit is described; Fig.25 An example of the structure of a display device is described; Fig.26 An example of the structure of a display device is described; Fig. 27 An example of the structure of a display device is described; Fig.28 An example of the structure of a display device is described; FIG. 29A to FIG. 29C Describe the structural example of a transistor; FIG. 30A to FIG. 30D Describe the structural example of a transistor; FIG. 31A to FIG. 31F Describe the structural example of a transistor; Fig.32A and Fig.32B An example of the structure of a display panel is described; Fig.33A and Fig.33B An example of the structure of a display panel is described; Fig.34A and Fig.34B An example of the structure of a display panel is described; Fig.35 An example of the structure of a display device is described; Fig.36A and Fig.36B An example of the structure of a display panel is described. Fig.36C An example of the structure of a display device is described; FIG. 37A to FIG. 37D Describe an example of an electronic device; Fig.38A and Fig.38B An example of a vehicle is shown; FIG. 39A to FIG. 39F is a photograph showing brightness data of Example 1; FIG. 40A to FIG. 40F is a photograph showing the display result of Example 1; Fig.41A and Fig.41B A display device according to Embodiment 2 is described; and Fig.42A and Fig.42B The results of Example 2 are shown. DETAILED DESCRIPTION
[0031] The embodiments are described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the following description. A person skilled in the art can easily understand that the method and details can be transformed into various forms without departing from the purpose and scope of the present invention. Therefore, the present invention should not be interpreted as being limited to the contents described in the embodiments shown below.
[0032] Note that in the inventive structure described below, the same reference numerals are used in common in different drawings to represent the same parts or parts with the same function, and their repeated descriptions are omitted. In addition, the same hatching is sometimes used to represent parts with the same function, and no reference numerals are particularly added to the parts.
[0033] For ease of understanding, the position, size, range, etc. of each component shown in the drawings may not represent its actual position, size, range, etc. Therefore, the disclosed invention is not necessarily limited to the position, size, range, etc. disclosed in the drawings.
[0034] Note that the word "film" and the word "layer" may be interchanged depending on the situation or state. For example, the word "conductive layer" may be replaced with the word "conductive film". Also, the word "insulating film" may be replaced with the word "insulating layer".
[0035] In this specification, etc., metal oxide refers to an oxide of a metal in a broad sense. Metal oxides are classified into oxide insulators, oxide conductors (including transparent oxide conductors), and oxide semiconductors (also referred to as OS). For example, metal oxides used in semiconductor layers of transistors are sometimes referred to as oxide semiconductors. In other words, OSFET is a transistor containing metal oxides or oxide semiconductors.
[0036] In this specification and the like, a metal oxide containing nitrogen may also be referred to as a metal oxide. In addition, a metal oxide containing nitrogen may also be referred to as a metal oxynitride.
[0037] (Implementation Method 1) In this embodiment, refer to Figure 1A and Figure 1B , Figure 2 , Figure 3 , Figure 4 , FIG. 5A to FIG. 5C , Figure 6 , Figure 7 , Figure 8 , Fig. 9 , Fig.10 , Fig.11 , Fig. 12A and Fig. 12B , FIG. 13A to FIG. 13C as well as Fig.14A 14B-1 and 14B-2 illustrate a display system according to an embodiment of the present invention.
[0038] A display system according to one embodiment of the present invention includes a processing unit and a display unit. The processing unit has a function of generating second image data by using first image data. The display unit has a function of displaying an image based on the second image data. The display unit includes a plurality of pixels. The processing unit includes a first layer, a second layer, and a third layer. The first image data is supplied to the first layer. The first image data includes a plurality of data. The plurality of data respectively correspond to any one of a plurality of pixels. The first layer has a function of generating first operation data by using the first image data so that the number of data corresponding to one pixel is greater than the number of the first image data. The second layer has a function of generating second operation data by multiplying the first operation data by a weight coefficient. The third layer has a function of generating second image data by using the second operation data so that the number of data corresponding to one pixel is less than the number of the second operation data.
[0039] For example, when the first image data includes a (a is an integer greater than 1) first data corresponding to one pixel, the first layer generates first operation data including b (b is an integer greater than a) second data corresponding to one pixel. Then, the second layer generates second operation data by using the first operation data and weight coefficients. The weight coefficient includes b third data corresponding to one pixel. The second operation data includes b fourth data corresponding to one pixel. In other words, the number of data corresponding to one pixel included in the second operation data is the same as the number of data corresponding to one pixel included in the first operation data. The fourth data is the product of any one of the second data and any one of the third data. The third layer generates second image data including c (c is an integer less than b) fifth data corresponding to one pixel by using the second operation data.
[0040] The more data corresponding to one pixel, the more parameters used for correction of the image data. Thus, the accuracy of image correction can be improved. By correcting the image data using such a processing unit including three layers, an image in which display unevenness and seams are not easily visible can be displayed on the display unit.
[0041] <1-1. Example 1 of the configuration of the display system> Figure 1A is a block diagram of display system 10A.
[0042] The display system 10A has a function of generating image data by utilizing data received from the outside and a function of displaying an image based on the image data.
[0043] The display system 10A includes a display unit 20A and a signal generation unit 30A. The signal generation unit 30A has a function of generating image data by using data received from the outside. The display unit 20A has a function of displaying an image based on the image data.
[0044] The display section 20A includes a pixel section 21 , a scanning line driving circuit 22 (also referred to as a gate driver), a signal line driving circuit 23 (also referred to as a source driver), and a timing controller 24 .
[0045] The signal generating section 30A includes a front end section 31 , a decoder 32 , a first processing unit 33 , a receiving section 34 , an interface 35 , a control section 36 , and a second processing unit 40 .
[0046] like Figure 1B In the display system 10B shown, the second processing unit 40 may be included in the display unit 20B instead of the signal generating unit 30B. Alternatively, the second processing unit 40 may be provided separately from the display unit and the signal generating unit.
[0047] The following describes the components of the display unit 20A and the signal generation unit 30A. Note that these components may also be included in the display unit 20B and the signal generation unit 30B.
[0048] The pixel unit 21 includes a plurality of pixels and has a function of displaying an image.
[0049] The pixel includes a display element and has a function of displaying a predetermined grayscale. The grayscale of the pixel is controlled by signals supplied from the scanning line driving circuit 22 and the signal line driving circuit 23, so that a predetermined image is displayed on the pixel portion 21.
[0050] The scanning line driving circuit 22 has a function of supplying a signal for selecting a pixel (this signal is also referred to as a selection signal) to the pixel portion 21 .
[0051] The signal line driving circuit 23 has a function of supplying a signal for displaying a specified grayscale on a pixel (this signal is also called an image signal) to the pixel portion 21. By supplying the image signal to the pixel supplied with the selection signal, the pixel displays the specified grayscale and the pixel portion 21 displays a specified image.
[0052] The timing controller 24 has a function of generating timing signals (clock signals, start pulse signals, etc.) used by the scan line drive circuit 22, the signal line drive circuit 23, etc. One or both of the timing of outputting the selection signal from the scan line drive circuit 22 and the timing of outputting the image signal from the signal line drive circuit 23 are controlled by the timing signal generated by the timing controller 24. When the display unit 20A includes a plurality of scan line drive circuits 22, the timing of outputting signals from the plurality of scan line drive circuits 22 is synchronized by the timing signal generated by the timing controller 24. Similarly, when the display unit 20A includes a plurality of signal line drive circuits 23, the timing of outputting signals from the plurality of signal line drive circuits 23 is synchronized by the timing signal generated by the timing controller 24.
[0053] The front end 31 has a function of appropriately performing signal processing according to a signal input from the outside. For example, a broadcast signal encoded and modulated in a specified manner is input to the front end 31. The front end 31 may have a function of, for example, demodulating a received image signal, performing analog-to-digital conversion, etc. In addition, the front end 31 may also have a function of performing error correction. The data received and signal-processed by the front end 31 is output to the decoder 32.
[0054] The decoder 32 has a function of decrypting the encoded signal. When the image data included in the broadcast signal input to the front end 31 is compressed, the data is decompressed by the decoder 32. For example, the decoder 32 may have a function of performing entropy decoding, inverse quantization, inverse orthogonal transform such as inverse discrete cosine transform (IDCT) or inverse discrete sine transform (IDST), intra-frame prediction, inter-frame prediction, and the like.
[0055] H.265 / MPEG-H high efficiency video coding (hereinafter also referred to as HEVC) is adopted as the coding standard for 8K broadcasting. When the image data included in the broadcast signal input to the front end 31 is encoded according to HEVC, decoding according to HEVC is performed by the decoder 32. The image data generated by the decryption processing of the decoder 32 is output to the first processing unit 33.
[0056] The first processing unit 33 has a function of performing image processing on the image data input from the decoder 32 to generate first image data SD1 , and outputting the first image data SD1 to the second processing unit 40 .
[0057] As the image processing, for example, noise removal processing, grayscale conversion processing, tone correction processing, brightness correction processing, etc. can be cited. The tone correction processing or the brightness correction processing can be performed using gamma correction, etc. In addition, the first processing unit 33 may also have functions such as inter-pixel complement processing accompanied by up-conversion of resolution, inter-frame complement processing accompanied by up-conversion of frame frequency, etc.
[0058] Noise removal processing is processing for removing various noises, such as mosquito noise generated near the outline of text, block noise generated in high-speed dynamic images, random noise that generates flicker, and point noise caused by up-conversion of resolution.
[0059] The grayscale conversion process is a process of converting the grayscale of the first image data SD1 into a grayscale corresponding to the output characteristics of the display unit 20A. For example, when the grayscale number increases, the image data input with a smaller grayscale number is supplemented and the grayscale value corresponding to each pixel is assigned, so that the histogram can be smoothed. In addition, high dynamic range (HDR) processing for expanding the dynamic range is also included in the grayscale conversion process.
[0060] The color tone correction process refers to the process of correcting the color tone of the image. The brightness correction process corrects the brightness (brightness contrast) of the image. For example, the brightness or color tone of the image displayed on the display unit 20A is corrected to the most suitable brightness or color tone according to the type, brightness or color purity of the lighting in the space where the display unit 20A is set.
[0061] The inter-pixel supplementation process is a process of supplementing data that does not exist when performing resolution up-conversion. For example, as the color data of the pixel to be supplemented (for example, the grayscale values corresponding to each color of red (R), green (G), and blue (B)), the data is supplemented in such a way that it becomes the data of the intermediate color of the pixel near the pixel with reference to the color data of the pixel near the pixel.
[0062] Inter-frame supplementation processing is a process of generating an image of a frame (supplementary frame) that does not originally exist when the frame rate of the displayed image is increased. For example, the difference between two images is used to generate an image of a supplementary frame inserted between the two images. Alternatively, multiple supplementary frame images can be generated between the two images. For example, when the frame rate of the image data is 60 Hz, by generating multiple supplementary frames, the frame rate of the image signal output to the display unit 20A can be increased to two times (120 Hz), four times (240 Hz), or eight times (480 Hz), etc.
[0063] Note that the above image processing may also be performed using an image processing unit independent of the first processing unit 33. One or more of the above image processing may also be performed by the second processing unit 40.
[0064] The receiving unit 34 has the function of receiving data or control signals input from the outside. The data or control signals can be input to the receiving unit 34 using the operation buttons and touch screen provided in the processing unit 50, remote controller, portable information terminal (e.g., smart phone, tablet terminal), display unit 20A, etc.
[0065] The operation processing device 50 can supply the weight coefficients used in the second processing unit 40 to the display system 10A. As the operation processing device 50, for example, a computer with excellent operation processing capabilities, such as a PC, a server, a cloud server, etc. can be used. The operation processing device 50 can supply the weight coefficients obtained by learning to the second processing unit 40 through the receiving unit 34.
[0066] The interface 35 has a function of appropriately performing signal processing on the data or control signal received by the receiving unit 34 and outputting the data or the signal to the control unit 36 .
[0067] The control unit 36 has a function of supplying control signals to each circuit included in the signal generating unit 30A. For example, the control unit 36 has a function of supplying control signals to the decoder 32, the first processing unit 33, and the second processing unit 40. The control by the control unit 36 can be performed based on the control signal received by the receiving unit 34, etc.
[0068] The second processing unit 40 has a function of generating second image data SD2 by correcting the first image data SD1 input from the first processing unit 33. The second image data SD2 generated by the second processing unit 40 is output to the signal line driving circuit 23.
[0069] For example, the second processing unit 40 has a function of correcting the first image data SD1 in a manner that makes it difficult to see the display unevenness of the pixel portion 21. For example, the display unevenness is caused by the following reasons: the characteristics of the transistors or the sizes of the capacitors in the pixel portion 21 are different; the negative influence of the parasitic resistance or parasitic capacitance of the signal line; the in-plane unevenness of the driving ability of the signal line driving circuit 23; and the in-plane unevenness of the characteristics of the display element. In this case, it is also possible to display an image in which the unevenness is not easily seen by generating the second image data SD2 by the second processing unit 40.
[0070] In addition, for example, when the pixel portion 21 is divided into a plurality of regions, the second processing unit 40 has a function of correcting the first image data SD1 in a manner that compensates for discontinuity of the image at the boundary between the regions. By generating the second image data SD2 by the second processing unit 40, an image that is less likely to be uneven can be displayed.
[0071] <1-2. Example 1 of the structure of the pixel portion> The division of the pixel portion 21 and the correction of the seam by the second processing unit 40 will be described in detail below.
[0072] When a plurality of pixels 25 are provided in the pixel unit 21 in order to display a high-resolution image, the parasitic resistance caused by the scanning lines and the signal lines increases as the lengths of the scanning lines and the signal lines increase. In addition, the scanning lines and the signal lines are provided in a manner of crossing each other. Therefore, as the number of pixels 25 increases, the number of crossing portions also increases, and the parasitic capacitance formed by the scanning lines and the signal lines also increases.
[0073] Thus, a structure can be adopted in which the pixel portion is divided into a plurality of regions and a scanning line driving circuit and a signal line driving circuit are arranged in each region. The above structure can shorten the length of a scanning line or a signal line connected to a driving circuit, thereby reducing parasitic resistance and parasitic capacitance and supplying signals at a high speed. Thus, a high-resolution image can be accurately displayed.
[0074] For example, when the resolution of the display device is 8K, the resolution of one of the pixel sections divided into four regions is 4K. Therefore, a plurality of 4K display device IC chips (also referred to as ICs) and a plurality of printed circuit boards (also referred to as PCBs) can be used to drive one 8K display device. That is, 4K display device ICs and printed circuit boards can be used for 8K display devices, and technologies related to low-resolution display devices can be effectively utilized.
[0075] Figure 2 A configuration example of the display unit 20 in which the pixel unit 21 is divided into four regions is shown.
[0076] The display unit 20 includes a pixel unit 21 , four scanning line drive circuits 22 (scanning line drive circuits 22A, 22B, 22C, and 22D), and four signal line drive circuits 23 (signal line drive circuits 23A, 23B, 23C, and 23D).
[0077] like Figure 2 As shown, the pixel portion 21 includes a plurality of pixels 25 . Figure 2 An example is shown in which the pixel portion 21 includes a plurality of pixels 25 arranged in a matrix of 2m rows and 2n columns (m and n are both integers greater than or equal to 1).
[0078] The pixel portion 21 is divided into four regions (regions 21A, 21B, 21C, and 21D). Each of the four regions includes a plurality of pixels 25 arranged in a matrix of m rows and n columns.
[0079] The display unit 20 includes 2m scanning lines GL (also referred to as selection signal lines, gate lines, etc.). Specifically, the display unit 20 includes m scanning lines GLa and m scanning lines GLb. The m scanning lines GLa and the m scanning lines GLb extend in the row direction, respectively. The m scanning lines GLa are electrically connected to the plurality of pixels 25 arranged in the row direction in the region 21A and the region 21B, respectively. The m scanning lines GLb are electrically connected to the plurality of pixels 25 arranged in the row direction in the region 21C and the region 21D, respectively.
[0080] In this specification, etc., the scanning line GLa electrically connected to the pixels 25 in the i-th row (i is an integer greater than 1 and less than m) in the regions 21A and 21B is described as the scanning line GLa[i]. Similarly, the scanning line GLb electrically connected to the pixels 25 in the i-th row (i is an integer greater than 1 and less than m) in the regions 21C and 21D is described as the scanning line GLb[i].
[0081] One end of the scanning line GLa is electrically connected to the scanning line driving circuit 22A, and the other end of the scanning line GLa is electrically connected to the scanning line driving circuit 22C. Thus, the scanning line driving circuit 22A and the scanning line driving circuit 22C are opposite to each other with the region 21A and the region 21B sandwiched therebetween. Similarly, one end of the scanning line GLb is electrically connected to the scanning line driving circuit 22B, and the other end of the scanning line GLb is electrically connected to the scanning line driving circuit 22D. Thus, the scanning line driving circuit 22B and the scanning line driving circuit 22D are opposite to each other with the region 21C and the region 21D sandwiched therebetween.
[0082] The scanning line drive circuits 22A and 22C have a function of supplying a selection signal to the scanning line GLa. The scanning line drive circuits 22B and 22D have a function of supplying a selection signal to the scanning line GLb. Each scanning line GL has a function of transmitting the selection signal supplied from the scanning line drive circuit 22 to the pixel 25. At this time, the timing of outputting the selection signal from the scanning line drive circuits 22A and 22C is synchronized, and the timing of outputting the selection signal from the scanning line drive circuits 22B and 22D is synchronized.
[0083] The scanning line drive circuits 22A and 22C have the function of sequentially supplying selection signals to the scanning lines GLa[1] to GLa[m]. In other words, the scanning line drive circuits 22A and 22C have the function of sequentially scanning the scanning lines GLa[1] to GLa[m]. After scanning the scanning lines GLa[m], they scan the scanning lines GLa[1] sequentially. Similarly, the scanning line drive circuits 22B and 22D have the function of sequentially supplying selection signals to the scanning lines GLb[1] to GLb[m].
[0084] The ability to supply the selection signal to the scan line GL can be improved by supplying the selection signal to the scan line simultaneously with two scan line drive circuits 22. In addition, one of the scan line drive circuits 22A and 22C and one of the scan line drive circuits 22B and 22D can be omitted without affecting the transmission of the selection signal.
[0085] The display unit 20 includes 4n signal lines SL (also referred to as image signal lines, source lines, etc.). Specifically, the display unit 20 includes n signal lines SLa, n signal lines SLb, n signal lines SLc, and n signal lines SLd. The n signal lines SLa, n signal lines SLb, n signal lines SLc, and n signal lines SLd extend in the column direction, respectively. The n signal lines SLa are electrically connected to a plurality of pixels 25 arranged in the column direction in the region 21A, respectively. Similarly, the signal lines SLb, SLc, and SLd are electrically connected to a plurality of pixels 25 arranged in the column direction in the region 21B, the region 21C, and the region 21D, respectively.
[0086] In this specification, etc., the signal line SLa electrically connected to the pixel 25 in the j-th column (j is an integer greater than 1 and less than n) in the region 21A is referred to as the signal line SLa[j]. Similarly, the signal lines SLb, SLc, and SLd electrically connected to the pixel 25 in the j-th column in each of the regions 21B, 21C, and 21D are referred to as the signal line SLb[j], the signal line SLc[j], and the signal line SLd[j], respectively.
[0087] The signal line SLa is electrically connected to the signal line drive circuit 23A. Similarly, the signal lines SLb, SLc, and SLd are electrically connected to the signal line drive circuits 23B, 23C, and 23D, respectively.
[0088] The signal line driving circuit 23A has a function of supplying an image signal to the signal line SLa. Similarly, the signal line driving circuits 23B, 23C, and 23D have a function of supplying an image signal to the signal lines SLb, SLc, and SLd, respectively. Each signal line SL has a function of transmitting an image signal supplied from the signal line driving circuit 23 to the pixel 25.
[0089] exist Figure 2In the embodiment, the upper area of the pixel portion 21 is further divided into areas 21A and 21B, and the lower area of the pixel portion 21 is divided into areas 21C and 21D. At this time, the timing of outputting the image signal from the signal line driving circuits 23A and 23B is synchronized, and the timing of outputting the image signal from the signal line driving circuits 23C and 23D is synchronized. In addition, the timing of outputting the image signal from the signal line driving circuits 23A, 23B, 23C, and 23D can also be synchronized. Note that the signal line driving circuit that supplies the image signal to the areas 21A and 21B can be composed of a circuit in which the signal line driving circuits 23A and 23B are integrated. In addition, the signal line driving circuits that supply the image signal to the areas 21C and 21D can be composed of a circuit in which the signal line driving circuits 23C and 23D are integrated. In addition, the signal line driving circuits 23A, 23B, 23C, and 23D can also be composed of a plurality of signal line driving circuits, respectively.
[0090] The pixel 25 includes a display element. Examples of display elements in the pixel 25 include liquid crystal elements and light-emitting elements. As liquid crystal elements, transmissive liquid crystal elements, reflective liquid crystal elements, semi-transmissive liquid crystal elements, etc. can be used. As light-emitting elements, for example, self-luminous light-emitting elements such as organic light-emitting diodes (OLED), light-emitting diodes (LED), quantum dot light-emitting diodes (QLED), and semiconductor lasers can be used. As display elements, shutter-type micro-electromechanical systems (MEMS) elements, optical interference-type MEMS elements, microcapsule-type, electrophoresis-type, electrowetting-type, and electronic powder fluid (registered trademark)-type display elements can be used.
[0091] The number of pixels 25 can be set freely. In order to display high-definition images, it is preferable to configure a plurality of pixels. For example, when displaying a 2K image, the number of pixels set is preferably 1920×1080 or more. In addition, when displaying a 4K image, the number of pixels set is preferably 3840×2160 or more or 4096×2160 or more. In addition, when displaying an 8K image, the number of pixels set is preferably 7680×4320 or more or 8192×4320 or more. In addition, more pixels 25 may be set in the pixel portion 21.
[0092] Although in Figure 2 2 shows an example in which the pixel portion 21 is divided into four regions, but the number of divisions is not limited and can be freely set.
[0093] like Figure 2 As shown, when the pixel unit 21 is divided into a plurality of regions, it is preferable to ensure the continuity of the image at the seam between two regions. However, due to the influence of parasitic resistance or parasitic capacitance of the signal line SL, the grayscale displayed by the pixel 25 at the seam and near the seam is prone to error.
[0094] For example, Figure 3 As shown, consider the case where the signal lines SLa[1] and SLc[1] are supplied with image signals. Here, the signal line SL is added with parasitic resistance PR, parasitic capacitance PC formed by the intersection of the signal line SL and the scanning line GL, etc. More specifically, the longer the distance between the pixel 25 and the signal line driving circuit 23, the longer the path of the image signal in the signal line SL, and the larger the parasitic resistance PR. In addition, the greater the number of intersections between the signal line GL and the signal line SL, the larger the parasitic capacitance PC. When the parasitic resistance PR increases or the parasitic capacitance PC increases, for example, image signal delay occurs and an error occurs in the image signal supplied to the pixel 25.
[0095] The error of the image signal is greatest when the image signal is supplied to the pixels 25 (pixels 25A and 25B in the figure) located farthest from the signal line driving circuit 23. Therefore, image discontinuity is particularly likely to occur in the area where these pixels 25 are adjacent to each other (area S in the figure).
[0096] In order to ensure the continuity of the image, the pulse width of the selection signal may be set for the pixels 25A and 25B disposed near the terminal of the signal line SL. However, in this case, the selection period of all pixels 25 becomes longer, and the time required to select all rows becomes longer. As a result, the time required for image update becomes longer and the operating speed decreases.
[0097] Here, the display system of one embodiment of the present invention includes a second processing unit 40 having a function of correcting an image signal by using artificial intelligence (AI). Specifically, the second processing unit 40 can correct the image signal in a manner that alleviates the discontinuity of the image in the seam between the two areas. As a result, an image in which the seam is not easily visible can be displayed, so the display quality of the display unit 20 can be improved.
[0098] Note that artificial intelligence refers to a computer that imitates human intelligence. For example, an artificial neural network (ANN) can be used as the second processing unit 40. An artificial neural network is a circuit that imitates a neural network composed of neurons and synapses and is a type of artificial intelligence. In this specification, etc., the term "neural network" particularly refers to an artificial neural network.
[0099] <1-3. Configuration Example of Second Processing Unit 40> Figure 4 A configuration example of the second processing unit 40 is shown.
[0100] The second processing unit 40 includes a first layer 41, a second layer 42, and a third layer 43. The second processing unit 40 has a function of generating second image data SD2 by correcting the input first image data SD1.
[0101] The first layer 41 can generate operation data including a larger amount of data than the first image data SD1 by using the input first image data SD1. For example, when the first image data SD1 includes three types of data (red (R) data, green (G) data, and blue (B) data) for each pixel, the first layer 41 generates operation data including four or more types of data for each pixel. Thus, the correction accuracy of the second processing unit 40 can be improved.
[0102] The second layer 42 may multiply the operation data generated in the first layer 41 by a weight coefficient. For example, the second layer 42 may perform filtering processing.
[0103] The third layer 43 can generate the second image data SD2 whose data amount is less than the operation data by using the operation data multiplied by the weight coefficient in the second layer 42. The amount of data included in the second image data SD2 can be determined according to the structure of the pixel 25. For example, when the pixel 25 includes three sub-pixels of red, green, and blue (RGB), the second image data SD2 preferably includes three types of RGB data for each pixel. When the pixel 25 includes four sub-pixels of RGBW or RGBY (W and Y represent white and yellow, respectively), the second image data SD2 preferably includes four types of RGBW or RGBY data for each pixel.
[0104] FIG. 5A to FIG. 5C A specific example of learning and inference in the second processing unit 40 is shown. Figure 5A The state of the second processing unit 40 before learning is shown. Figure 5B The state of the second processing unit 40 during learning is shown. Figure 5C The state when the second processing unit 40 performs inference after learning is shown.
[0105] First, in Figure 5A, the first image data SD1 is output from the first processing unit 33. The first image data SD1 is image data corresponding to the image A. Before the learning of the second processing unit 40, the first image data SD1 is not corrected and is output to the signal line driving circuit 23 through the second processing unit 40. The first image data SD1 is supplied to the pixel portion 21, and the pixel portion 21 displays an image according to the first image data SD1. At this time, the image actually displayed on the pixel portion 21 is referred to as image B. Note that the image B can also be displayed on the pixel portion 21 by supplying the first image data SD1 from the first processing unit 33 directly (that is, not through the second processing unit 40) to the signal line driving circuit 23.
[0106] Here, when the pixel portion 21 is divided into a plurality of regions, as described above, the joint region S (see Figure 3 ) sometimes cause image discontinuity near the image. Figure 5A The state when the seam is seen in image B is shown.
[0107] When a seam or display unevenness is seen in the image B, learning by the second processing unit 40 is performed.
[0108] In the learning of the second processing unit 40 , image data corresponding to the image B actually displayed on the pixel unit 21 (hereinafter referred to as image data DD1 ) is used as learning data.
[0109] The image data DD1 can be obtained, for example, by photographing an image displayed on the pixel portion 21 using an image sensor, a camera, or the like. In addition, when the grayscale of the pixel 25 can be determined from a signal obtained from the pixel 25 (for example, a potential held by the pixel 25, a current flowing through the pixel 25, etc.), the image data DD1 can be obtained by reading out the signal.
[0110] In addition, the image data DD1 preferably includes brightness data. The brightness data can be obtained using a brightness meter. Specifically, by using a two-dimensional brightness meter (also called a two-dimensional color brightness meter) or an optical inspection system of a display, the brightness distribution of the pixel unit 21 is obtained with high precision. By using brightness data, the display unevenness can be grasped in more detail than when grayscale data is used. As a result, the correction accuracy of the image can be improved. The acquired brightness data can be properly normalized and used.
[0111] For example, it is preferable to obtain brightness data in a display where display unevenness is easily visible (for example, gray display). This can improve the correction effect.
[0112] The first image data SD1 includes coordinate data and a plurality of grayscale data. The plurality of grayscale data are grayscale data of different colors. Here, an example in which the first image data SD1 includes grayscale data of three colors (grayscale data of red, grayscale data of green, and grayscale data of blue) is described. The grayscale data of each color includes a plurality of grayscale values corresponding to different coordinates.
[0113] For example, the number of grayscales that can be represented by red grayscale data is k bits (2 k grayscale, k is an integer greater than 2), the grayscale data of red preferably includes 2 k-2 Above and 3×2 k-2 The grayscale values can be different according to the coordinates, but the grayscale values of each coordinate are preferably the same. Similarly, the number of grayscales that can be represented by the green grayscale data is m bits (2 m Grayscale, m is an integer greater than 2), the green grayscale data preferably includes 2 m-2 Above and 3×2 m-2 The following multiple grayscale values. The number of grayscale values that can be represented by the blue grayscale data is n bits (2 n Grayscale, n is an integer greater than 2), the blue grayscale data preferably includes 2 n-2 Above and 3×2 n-2 The following multiple grayscale values. When the grayscale data of each color can represent the same grayscale number, it is preferred that the multiple grayscale values included in the grayscale data of all colors are the same value. When the grayscale number that can be represented by each color is different, the grayscale value can also be different according to the color.
[0114] In addition, the first image data SD1 can obtain the brightness data of each of the red display, the green display, and the blue display. In this case, color unevenness can be corrected to further improve the display quality.
[0115] Here, the case of red display is taken as an example. When the number of grayscales that can be represented by the grayscale data of red is k bits (2 k grayscale, k is an integer greater than 2), the grayscale data of red preferably includes 2 k-2 Above and 3×2 k-2 Specifically, when the number of grayscales that can be represented by the grayscale data of red is 8 bits (256 grayscales), the grayscale data of red preferably includes 2 6 Above and 3×2 6 The grayscale values may be different for each coordinate, but the grayscale values for each coordinate are preferably the same. Furthermore, the green grayscale data and the blue grayscale data preferably include a plurality of grayscale values of 0.
[0116] In addition, the resolution (number of pixels) of the image data DD1 is preferably the same as the resolution (number of pixels) of the pixel unit 21. When the resolution of the image data DD1 is different from the resolution of the pixel unit 21, it is preferable that a process for making the resolution of the image data DD1 consistent with the resolution of the pixel unit 21 is performed in a portion other than the second processing unit 40.
[0117] The supervised learning is preferably performed by the second processing unit 40. As the supervised data, the first image data SD1 is preferably used.
[0118] Specifically, if Figure 5B As shown, the image data DD1 is supplied to the second processing unit 40. In the second processing unit 40, the weight coefficient used in the second processing unit 40 is updated in such a way that the difference between the corrected image data DD2 and the first image data SD1 is less than a certain value. The weight coefficient can be updated by using a gradient descent method or the like, and the gradient can be calculated by using a back propagation method or the like. The weight coefficient is updated repeatedly until the difference between the image data DD2 and the first image data SD1 is less than a certain value. In addition, the allowable range of the difference can be freely set.
[0119] When the difference between the final image data DD2 and the first image data SD1 becomes less than a certain value, the learning of the second processing unit 40 ends. Figure 5B As shown in FIG. 1 , the image data DD1 is input to the second processing unit 40 after learning, and the corrected image data DD2 is output to the signal line driving circuit 23. Then, the image data DD2 is supplied to the pixel unit 21, and the pixel unit 21 displays an image based on DD2. At this time, the image actually displayed on the pixel unit 21 is the same as the image B (the difference between the image actually displayed and the image B is less than a certain value).
[0120] The initial value of the weight coefficient used in the second processing unit 40 can be determined by a random number. The initial value of the weight coefficient can sometimes affect the learning speed (for example, the convergence speed of the weight coefficient, the prediction accuracy of the second processing unit 40, etc.), so when the learning speed is slow, the initial value of the weight coefficient can be changed. In addition, the initial value of the weight coefficient can also be determined by pre-learning.
[0121] Next, the first image data SD1 is corrected by inference of the second processing unit 40 that has performed the above learning. Figure 5C As shown, when the first image data SD1 is input to the second processing unit 40, the second processing unit 40 performs calculations using the weight coefficients updated by learning to correct the first image data SD1. The calculation result is output from the second processing unit 40 as the second image data SD2 and supplied to the pixel portion 21 through the signal line driving circuit 23.
[0122] Here, the second image data SD2 is obtained by the second processing unit 40 ( Figure 5B ) corrected image data. Therefore, by supplying the second image data SD2 to the pixel unit 21, an image C with no visible seam can be displayed. Image C is the same as image A (the difference between image C and image A is less than a certain value).
[0123] Alternatively, the correction of the first image data SD1 may be performed for each pixel. In this case, the weight coefficient used when performing the inference of the second processing unit 40 is different for each pixel.
[0124] The correction of the first image data SD1 may also be performed only on pixels in a specified area. For example, the area to be corrected may also be limited to Figure 3 The illustrated region S (region where the region 21A and the region 21C are adjacent to each other) and its vicinity.
[0125] When correcting only the image data supplied to the area S and its vicinity in the first image data SD1, FIG. 5A to FIG. 5C Only the image data of the region S and its vicinity are extracted and learned from the image A and the image B. Then, the second processing unit 40 corrects the image data supplied to the region S and its vicinity of the first image data SD1, and does not correct other image data.
[0126] In this way, by reducing the number of pixels of the image data corrected by the second processing unit 40, the amount of calculation of the second processing unit 40 can be reduced. Thus, power consumption can be reduced and the calculation speed can be increased.
[0127] The area for signal correction can be freely set. For example, the second processing unit 40 can correct the signals supplied by the pixels 25 connected to the scanning lines GLa[i] to GLa[m] (i is an arbitrary integer greater than 3m / 4 and less than m) and the pixels 25 connected to the scanning lines GLb[i] to GLb[m].
[0128] In addition, when the first processing unit 33 performs correction processing (for example, gamma correction, dimming, color adjustment), both image data that has not been subjected to the correction processing and image data that has been subjected to the correction processing can be used as learning data for learning of the second processing unit 40. When the image data that has not been subjected to the correction processing is used, the correction processing can be performed in the second processing unit 40. In this case, the correction processing performed in the first processing unit 33 can be omitted or reduced, and the signal processing can be simplified.
[0129] As described above, by correcting the image data using the second processing unit 40, the seam can be invisible in the displayed image, thereby improving the quality of the high-resolution image.
[0130] The learning of the second processing unit 40 can be performed by using the operation processing device 50 or the like provided outside the signal generating unit 30. The learning of the second processing unit 40 can be performed by using software installed in the operation processing device 50. Furthermore, the weight coefficient obtained by learning is supplied to the second processing unit 40 through the receiving unit 34, so that the weight coefficient used in the second processing unit 40 can be updated. By performing the learning of the second processing unit 40 outside the display system, the structure of the display system can be simplified.
[0131] In addition, the weight coefficients may be updated by the user transmitting a control signal to the receiving unit 34 using a remote controller or the like. Thus, the user can easily upgrade the product even after the product has been shipped.
[0132] In addition, only display systems used by users with specific rights can be allowed to update weight coefficients, thereby providing high-quality television broadcasting services only to specific users.
[0133] Next, refer to Figure 6 , Figure 7 , Figure 8 and Fig. 9 The processing performed in the second processing unit 40 will be described. Figure 6 The processing performed in the first layer 41 is described with reference to Figure 7 The processing performed in the second layer 42 is described with reference to Figure 8 and Fig. 9 The processing performed in the third layer 43 will be described.
[0134] First, image data 81 is input to the first layer 41. Figure 6 As shown, in the first layer 41 , operation data 83 are generated by utilizing image data 81 .
[0135] Image data 81 is equivalent to Figure 5A The first image data SD1 shown in the above example is equivalent to Figure 5B The image data DD1 shown in the figure.
[0136] The image data 81 includes one or more image data 61 . Figure 6 The image data 81 is shown to include three image data 61. Specifically, Figure 6 The image data 81 shown includes the image data 61R, the image data 61G, and the image data 61B.
[0137] The image data 61R, the image data 61G, and the image data 61B include a plurality of pixel data 62R, a plurality of pixel data 62G, and a plurality of pixel data 62B, respectively. The number of pixel data 62R, 62G, and 62B is the same as the number of pixels included in the image data 81 .
[0138] In this specification, etc., the pixel data 62R corresponding to the pixel 25[i, j] is recorded as pixel data 62R[i, j]. Similarly, the pixel data 62G corresponding to the pixel 25[i, j] is recorded as pixel data 62G[i, j], and the pixel data 62B corresponding to the pixel 25[i, j] is recorded as pixel data 62B[i, j].
[0139] Each pixel of the image data 81 includes three pixel data 62. In other words, the number of image data 61 is the same as the number of pixel data 62 per pixel. Specifically, the image data 81 includes pixel data 62R[i, j], 62G[i, j], and 62B[i, j] corresponding to the pixel 25[i, j].
[0140] The operation data 83 includes a plurality of operation data 63 . The number of the operation data 63 is greater than the number of the image data 61 . Figure 6 An example is shown in which n (n is an integer greater than or equal to 4) operation data 63 are generated by using the image data 81. The operation data 83 includes data whose amount is larger than that of the image data 81. Thus, the amount of data used for operation in the second layer 42 can be increased, and the correction accuracy of the image data in the second processing unit 40 can be improved.
[0141] The operation data 63(x) (x is an integer greater than or equal to 1 and less than or equal to n) includes a plurality of operation data 64(x). The number of operation data 64(x) is the same as the number of pixels included in the image data 81. In this specification, the operation data 64(x) corresponding to the pixel 25[i, j] is described as operation data 64(x)[i, j].
[0142] Note that the n operation data 63 are generated independently. Also, the plurality of operation data 64 are generated independently.
[0143] Here, a method of generating operation data 64(1)[i,j] of operation data 63(1) and a method of generating operation data 64(2)[i,j] of operation data 63(2) are described as examples.
[0144] The operation data 64(1)[i,j] can be generated by multiplying the three pixel data 62 corresponding to the pixel 25[i,j] by different weight coefficients and adding the three products together. Specifically, the operation data 64(1)[i,j] can be generated by adding the product of the pixel data 62R[i,j] and the weight coefficient w(11)R[i,j], the product of the pixel data 62G[i,j] and the weight coefficient w(11)G[i,j], and the product of the pixel data 62B[i,j] and the weight coefficient w(11)B[i,j].
[0145] Alternatively, the operation data 64(2)[i,j] may be generated by multiplying the three pixel data 62 corresponding to the pixel 25[i,j] by weight coefficients different from those used when the operation data 64(1)[i,j] is generated and adding the three products. Specifically, the operation data 64(2)[i,j] is generated by adding the product of the pixel data 62R[i,j] and the weight coefficient w(12)R[i,j], the product of the pixel data 62G[i,j] and the weight coefficient w(12)G[i,j], and the product of the pixel data 62B[i,j] and the weight coefficient w(12)B[i,j].
[0146] Similarly, n operation data 64 can be generated by multiplying three pixel data 62 corresponding to the pixel 25 [i, j] by weight coefficients different from the weight coefficients used when generating other operation data 64 and adding these three products. The greater the number of operation data 63 corresponding to one pixel, the greater the number of weight coefficients used in the second layer 42. This is preferable because the correction accuracy in the second processing unit 40 can be improved.
[0147] The number of weight coefficients is preferably the same as the number of pixel data 62. In this case, the weight coefficients can be determined independently for each pixel data 62, so the accuracy of the processing performed in the first layer 41 can be improved. In addition, the number of weight coefficients can be less than the number of pixel data 62 depending on the situation. For example, the weight coefficient can be determined for each image data 61 or each pixel 25.
[0148] In the first layer 41, the pixel data corresponding to one pixel 25[i, j] of the image data 61R, the image data 61G, and the image data 61B are convolved to generate the operation data 64(x)[i, j]. Therefore, it can be said that the first layer 41 uses a convolutional neural network (CNN). In addition, the weight coefficient used in the operation of the first layer 41 is equivalent to the filter value of the filter with a size of 1×1.
[0149] Next, the operation data 83 is input from the first layer 41 to the second layer 42. Figure 7 As shown, in the second layer 42 , the operation data 85 is generated by utilizing the operation data 83 .
[0150] The operation data 85 includes a plurality of operation data 65. The number of the operation data 65 is the same as the number of the operation data 63. Figure 7 An example is shown in which n (n is an integer equal to or greater than 4) pieces of operation data 65 are generated by using the operation data 83 .
[0151] The operation data 65(x) (x is an integer greater than or equal to 1 and less than or equal to n) includes a plurality of operation data 66(x). The number of operation data 66(x) is the same as the number of pixels of the image data 81. In this specification, the operation data 66(x) corresponding to the pixel 25[i, j] is described as operation data 66(x)[i, j].
[0152] Note that the n operation data 65 are generated independently. Also, the plurality of operation data 66 are generated independently.
[0153] Here, a method for generating operation data 66(1)[i,j] of operation data 65(1) and a method for generating operation data 66(2)[i,j] of operation data 65(2) are described as examples.
[0154] The operation data 66 ( 1 ) [i, j] can be generated by multiplying the operation data 63 ( 1 ) [i, j] corresponding to the pixel 25 [i, j] by the weight coefficient w ( 21 ) [i, j].
[0155] The operation data 66 ( 2 ) [i, j] can be generated by multiplying the operation data 63 ( 2 ) [i, j] corresponding to the pixel 25 [i, j] by the weight coefficient w ( 2 2 ) [i, j].
[0156] Similarly, n operation data 66 can be generated by multiplying n operation data 63 corresponding to the pixel 25[i, j] by different weight coefficients. The greater the number of operation data 63 corresponding to one pixel, the greater the types of weight coefficients by which the operation data 63 can be multiplied. Thus, when the operation data 63 is input to the second layer 42, the second processing unit 40 can correct the data with high precision compared to the case where the image data 81 is directly input to the second layer 42 without passing through the first layer 41. At this time, the second processing unit 40 can correct the image data with high precision to improve the display quality of the display unit.
[0157] The number of weight coefficients is preferably the same as the number of operation data 64. In this case, the weight coefficients can be determined independently for each operation data 64, so that the processing accuracy in the second layer 42 can be improved. In addition, the number of weight coefficients can be less than the number of operation data 64 in some cases. For example, the weight coefficients can be determined for each operation data 63 or for each pixel 25.
[0158] Then, the operation data 85 is output from the second layer 42 to the third layer 43. Figure 8 As shown, in the third layer 43 , image data 87 is generated by using the operation data 85 .
[0159] Image data 87 is equivalent to Figure 5C The second image data SD2 shown in the above figure is equivalent to Figure 5B The image data DD2 shown in the figure.
[0160] The image data 87 includes one or more image data 67. The number of image data 67 is less than the number of operation data 65. The number of image data 67 is preferably the same as the number of sub-pixels of the pixel 25. Figure 8 The example in which the image data 87 includes three image data 67 is shown. Specifically, Figure 8 The image data 87 shown includes image data 67R, image data 67G, and image data 67B.
[0161] The image data 67R, the image data 67G, and the image data 67B include a plurality of pixel data 68R, a plurality of pixel data 68G, and a plurality of pixel data 68B, respectively.
[0162] In this specification, etc., the pixel data 68R corresponding to the pixel 25[i, j] is recorded as pixel data 68R[i, j]. Similarly, the pixel data 68G corresponding to the pixel 25[i, j] is recorded as pixel data 68G[i, j], and the pixel data 68B corresponding to the pixel 25[i, j] is recorded as pixel data 68B[i, j].
[0163] Fig. 9 A modified example is shown. Fig. 9 The example in which the image data 87 includes four image data 67 is shown. Specifically, Fig. 9 The illustrated image data 87 includes image data 67R, image data 67G, image data 67B, and image data 67W.
[0164] Note that the image data 67 is generated independently. In addition, the plurality of pixel data 68 is generated independently.
[0165] Here, a method of generating pixel data 68R[i, j] of image data 67R and a method of generating pixel data 68G[i, j] of image data 67G are described as examples.
[0166] Here, pixel data 68R[i,j] can be generated by multiplying n operation data 66 corresponding to pixel 25[i,j] by different weight coefficients and adding these n products together. Specifically, pixel data 68R[i,j] is generated by adding n products (the product of operation data 66(1)[i,j] and weight coefficient w(31)R[i,j] to the product of operation data 66(n)[i,j] and weight coefficient w(3n)R[i,j]).
[0167] In addition, pixel data 68G[i,j] can be generated by multiplying the n operation data 66 corresponding to pixel 25[i,j] by weight coefficients different from the weight coefficients used when generating pixel data 68G[i,j] and adding these n products together. Specifically, pixel data 68G[i,j] is generated by adding n products (the product of operation data 66(1)[i,j] and weight coefficient w(31)G[i,j] to the product of operation data 66(n)[i,j] and weight coefficient w(3n)G[i,j]).
[0168] Similarly, n pixel data 68 can be generated by multiplying n operation data 66 corresponding to pixel 25 [i, j] by weight coefficients different from the weight coefficients used when generating other pixel data 68 and adding these n products together.
[0169] One operation data 66(1)[i,j] is used to generate pixel data 68R[i,j], 68G[i,j], and 68B[i,j]. These three pixel data 68 are preferably generated by multiplying the operation data 66(1)[i,j] by different weight coefficients.
[0170] The number of weight coefficients is preferably the same as the number of operation data 66. In this case, the weight coefficients can be determined independently for each operation data 66, so the accuracy of the processing performed in the third layer 43 can be improved. In addition, the number of weight coefficients can be less than the number of operation data 66 in some cases. For example, the weight coefficient can be determined for each operation data 65 or each pixel 25.
[0171] In the third layer 43, pixel data 68R[i,j] is generated by convolving the operation data 66 corresponding to one pixel 25[i,j] of the n operation data 65. Thus, it can be said that the third layer 43 uses a convolutional neural network (CNN) similarly to the first layer 41.
[0172] By correcting the image data using the second processing unit 40 including three layers, an image in which unevenness is not easily seen or seams are not easily seen can be displayed in the display system of one embodiment of the present invention.
[0173] The second processing unit 40 may also perform a part or all of the image processing that can be performed in the first processing unit 33. In this case, the first processing unit 33 may be simplified or omitted. For example, the second processing unit 40 may perform grayscale conversion processing. Specifically, the second processing unit 40 may have a function of generating second image data SD2 of 12-bit grayscale (4096 grayscale) by using first image data SD1 of 8-bit grayscale (256 grayscale).
[0174] <1-4. Example 2 of the structure of the pixel portion> Fig.10 Shown with Figure 2 The structure of the display unit 20 shown in the figure is different from that of the display unit 20. In the display unit 20, the pixel unit 21 is divided into four areas.
[0175] Fig.10 The display unit 20 shown in FIG. Figure 2 The display section 20 shown is different in that two signal lines SL are provided for pixels 25 on one column, and pixels 25 electrically connected to one signal line SL and pixels 25 electrically connected to the other signal lines SL are arranged alternately.
[0176] The display unit 20 includes a pixel unit 21 , four scanning line drive circuits 22 (scanning line drive circuits 22A, 22B, 22C, and 22D), and four signal line drive circuits 23 (signal line drive circuits 23A, 23B, 23C, and 23D).
[0177] like Fig.10 As shown, the pixel portion 21 includes a plurality of pixels 25 . Fig.10 An example is shown in which the pixel portion 21 includes a plurality of pixels 25 arranged in a matrix of 4m rows and 2n columns (m and n are both integers greater than or equal to 1).
[0178] The pixel unit 21 is divided into four regions (regions 21A, 21B, 21C, and 21D). Each of the four regions includes a plurality of pixels 25 arranged in a matrix of 2m rows and n columns.
[0179] The display unit 20 includes m scanning lines GLA, m scanning lines GLB, 2m scanning lines GLa, and 2m scanning lines GLb. The scanning line GLA[i] (i is an integer greater than 1 and less than m) is electrically connected to the scanning line GLa[2i-1] and the scanning line GLa[2i], and the pixels 25 on the two rows electrically connected to the scanning line GLa are selected at the same time. Similarly, the scanning line GLB[i] (i is an integer greater than 1 and less than m) is electrically connected to the scanning line GLb[2i-1] and the scanning line GLb[2i], and the pixels 25 on the two rows electrically connected to the scanning line GLb are selected at the same time.
[0180] Since the pixels 25 on two rows can be selected at the same time, the writing time of the image signal can be extended. Thus, insufficient writing of the image signal can be prevented in high-speed driving with an increased frame rate. For example, insufficient writing of the image signal can be prevented even when the frame rate is 120 Hz or more.
[0181] In addition to the structure in which two signal lines SL are provided for pixels 25 on one column, the display system structure of an embodiment of the present invention may also adopt a structure in which three, four, or five or more signal lines SL are provided for pixels 25 on one column.
[0182] <1-5. Example 2 of display system configuration> Next, a case where the display unit of the display system includes a plurality of display panels will be described.
[0183] Fig.11 is a block diagram of a display system 10C.
[0184] The display system 10C has: a function of generating image data by using data received from the outside; and a function of displaying an image based on the image data.
[0185] The display system 10C includes a display unit 20C and a signal generating unit 30C. The display unit 20C includes a plurality of display panels DP. The signal generating unit 30C has a function of generating image data by using data received from the outside. The display panel DP has a function of displaying an image based on the image data.
[0186] Fig.11 The example in which the display unit 20C includes a plurality of display panels DP arranged in a matrix of x rows and y columns (x and y are both integers greater than or equal to 1) is shown. Displays on the display panels DP can be controlled independently of each other.
[0187] By arranging a plurality of display panels DP in one or more directions (for example, in a column or in a matrix), it is possible to manufacture a display unit 20C having a large display area.
[0188] When a large display unit 20C is manufactured using a plurality of display panels DP, each display panel DP does not need to be large. Thus, it is not necessary to enlarge the manufacturing device for manufacturing the display panel DP, thereby achieving space saving. In addition, a manufacturing device for small and medium-sized display panels can be used, thereby eliminating the need to use a novel manufacturing device as the display unit 20C becomes larger, thereby reducing manufacturing costs. In addition, it is possible to suppress a decrease in the yield rate caused by the larger display panel DP.
[0189] When the sizes of the display panels DP are the same, a display unit including a plurality of display panels DP has a larger display area than a display unit including one display panel DP, thereby having an effect of being able to display more information at the same time.
[0190] The signal generating unit 30C has Figure 1A In addition to the structure of the signal generating unit 30A shown, a dividing unit 45 is also included.
[0191] The dividing section 45 has a function of dividing the second image data SD2 input from the second processing unit 40. The second image data SD2 is divided into the same number of display panels DP provided in the display section 20C. Fig.11 In the embodiment, the second image data SD2 is divided into x×y data (second image data SD2[1,1] to SD2[x,y]) and output to the display unit 20C. The second image data SD2[p,q] (p is an integer greater than 1 and less than x, and q is an integer greater than 1 and less than y) are image data corresponding to the image displayed on the display panel DP[p,q]. The control signal is supplied to the dividing unit 45 from the control unit 36.
[0192] The image signal supplied from the signal generating section 30C is input to the display panel DP.
[0193] Fig. 12A The signal generation unit 30C supplies image signals to the display panels DP[1,1] to DP[x,y]. The second image data SD2 (second image data SD2[1,1] to SD2[x,y]) divided into x×y pieces is input to the display unit 20C. The second image data SD2[p,q] is input to the display panel DP[p,q].
[0194] Fig. 12B A structural example of the display panel DP[p,q] is shown.
[0195] The display panel DP[p, q] includes a pixel unit 21, a scan line driving circuit 22, and a signal line driving circuit 23. The functions of the pixel unit 21, the scan line driving circuit 22, and the signal line driving circuit 23 can be referred to in the embodiment of the present invention. Figure 1A Description.
[0196] The pixel unit 21 includes a plurality of pixels 25. The plurality of pixels 25 are electrically connected to any one of the plurality of scanning lines GL. The plurality of scanning lines GL are electrically connected to the scanning line driving circuit 22. The plurality of pixels 25 are electrically connected to any one of the plurality of signal lines SL. The plurality of signal lines SL are electrically connected to the signal line driving circuit 23.
[0197] Here, consider a case where the display panel DP includes a non-display area surrounding the pixel portion 21. At this time, for example, when one image is displayed using output images of a plurality of display panels DP, the image is viewed as separate by a user of the display system 10C.
[0198] Although it is possible to prevent images displayed on each display panel DP from being seen as separate by reducing the non-display area of each display panel DP (using a display panel DP with a narrow frame), it is difficult to completely eliminate the non-display area of the display panel DP.
[0199] In addition, when the non-display area of the display panel DP is small, the distance between the end of the display panel DP and the element in the display panel DP is shortened, and thus the element may be easily degraded due to impurities intruding from the outside of the display panel DP.
[0200] Therefore, in one embodiment of the present invention, a plurality of display panels DP are arranged in such a manner that parts thereof overlap with each other. Of the two display panels DP that overlap with each other, at least the display panel DP located on one side (upper side) of the display surface has an area adjacent to the pixel portion 21 that allows visible light to pass through. In one embodiment of the present invention, the pixel portion 21 of the display panel DP arranged on the lower side overlaps with the area of the display panel DP arranged on the upper side that allows visible light to pass through. Therefore, the non-display area between the pixel portions 21 of the two overlapping display panels DP can be reduced or even eliminated. As a result, a large display portion 20C can be obtained in which the user can hardly see the seams of the display panels DP.
[0201] At least a portion of the non-display area of the display panel DP located on the upper side transmits visible light and can overlap with the pixel portion 21 of the display panel DP located on the lower side. In addition, at least a portion of the non-display area of the display panel DP located on the lower side can overlap with the pixel portion 21 of the display panel DP located on the upper side or the area shielding visible light. Since the narrow frame of the display portion 20C (reduction of the area outside the display portion) is not affected by these areas, it is not necessary to reduce the area of the non-display area.
[0202] When the non-display area of the display panel DP is large, the distance between the end of the display panel DP and the elements in the display panel DP increases, thereby suppressing the degradation of the elements due to impurities invading from the outside of the display panel DP. For example, in the case of using an organic EL element as a display element, the longer the distance between the end of the display panel DP and the organic EL element, the less likely it is for impurities such as moisture or oxygen to intrude (or reach) the organic EL element from the outside of the display panel DP. In a display system of one embodiment of the present invention, the area of the non-display area of the display panel DP is fully ensured, thereby realizing a large display unit 20C with high reliability even when a display panel DP including an organic EL element is used.
[0203] As described above, when a plurality of display panels DP are provided in the display section 20C, it is preferable that the plurality of display panels DP are arranged so that the pixel sections 21 are arranged continuously between adjacent display panels DP.
[0204] Fig.13A 1 shows a structural example of the display panel DP, Fig. 13B , Fig. 13C A configuration example of the display panel DP is shown.
[0205] Fig.13A The display panel DP shown in the figure includes a pixel portion 71, a region 72 that allows visible light to pass through, and a region 73 that blocks visible light. The region 72 that allows visible light to pass through and the region 73 that blocks visible light are respectively provided adjacent to the pixel portion 71. Fig.13A In the example shown, the display panel DP is provided with a flexible printed circuit (FPC) 74 .
[0206] The pixel portion 71 includes a plurality of pixels. A pair of substrates included in the display panel DP and a sealant for sealing a display element sandwiched between the pair of electrodes may be provided in the region 72 through which visible light is transmitted. In this case, a material that transmits visible light is used as a member provided in the region 72 through which visible light is transmitted. For example, wiring electrically connected to the pixels in the pixel portion 71 may be provided in the region 73 that shields visible light. In addition, one or both of the scanning line driving circuit 22 and the signal line driving circuit 23 may be provided in the region 73 that shields visible light. In addition, a terminal connected to the FPC 74, wiring connected to the terminal, etc. may be provided in the region 73 that shields visible light.
[0207] Fig. 13B , Fig. 13C Show that Fig.13A The display panels DP shown are arranged in a 2×2 matrix (two display panels DP are arranged in each of the vertical direction and the horizontal direction). Fig. 13B is a perspective view of the display surface side of the display panel DP, Fig. 13C It is a perspective view of the side opposite to the display surface of the display panel DP.
[0208] The four display panels DP (display panels DPa, DPb, DPc, DPd) are arranged in a manner including mutually overlapping areas. Specifically, the display panels DPa, DPb, DPc, DPd are arranged in a manner that the area 72 that allows visible light to pass through one display panel DP includes an area that overlaps with the top surface of the pixel portion 71 (display surface side) of the other display panels DP. In addition, the display panels DPa, DPb, DPc, DPd are arranged in a manner that the area 73 that shields visible light of one display panel DP does not overlap with the top surface of the pixel portion 71 of the other display panels DP. In the portion where the four display panels DP overlap with each other, the display panel DPb, the display panel DPc, and the display panel DPd overlap on the top surface of the display panel DPa, the top surface of the display panel DPb, and the top surface of the display panel DPc, respectively.
[0209] The short side of the display panel DPa overlaps with the short side of the display panel DPb, and a part of the pixel portion 71a overlaps with a part of the region 72b through which visible light is transmitted. In addition, the long side of the display panel DPa overlaps with the long side of the display panel DPc, and a part of the pixel portion 71a overlaps with a part of the region 72c through which visible light is transmitted.
[0210] A portion of the pixel portion 71b overlaps a portion of the region 72c that transmits visible light and a portion of the region 72d that transmits visible light. Also, a portion of the pixel portion 71c overlaps a portion of the region 72d that transmits visible light.
[0211] Thus, the region where the pixel portions 71 a to 71 d are arranged almost seamlessly can be used as the display region 79 of the display portion 20C.
[0212] Here, the display panel DP preferably has flexibility. For example, a pair of substrates included in the display panel DP preferably has flexibility.
[0213] Therefore, if Fig. 13B and Fig. 13CAs shown, the area near the FPC74a of the display panel DPa can be bent, and a part of the display panel DPa and a part of the FPC74a can be arranged on the lower side of the pixel portion 71b of the display panel DPb adjacent to the FPC74a. As a result, the FPC74a can be arranged in a manner that does not physically interfere with the back side of the display panel DPb. In addition, when the display panel DPa and the display panel DPb are overlapped and fixed to each other, since there is no need to consider the thickness of the FPC74a, the height difference between the top surface of the area 72b that allows visible light to pass and the top surface of the display panel DPa can be reduced. As a result, the end of the display panel DPb located on the pixel portion 71a can be less visible.
[0214] Furthermore, since each display panel DP is flexible, the display panel DPb can be slowly bent in such a manner that the top surface height of the pixel portion 71b of the display panel DPb is consistent with the top surface height of the pixel portion 71a of the display panel DPa. Thus, except for the vicinity of the overlapping area of the display panel DPa and the display panel DPb, the height of each display area can be made consistent, thereby improving the display quality of the image displayed on the display area 79.
[0215] Although the above description takes the relationship between the display panel DPa and the display panel DPb as an example, the relationship between other two adjacent display panels DP is the same.
[0216] In order to reduce the step between two adjacent display panels DP, the thickness of the display panel DP is preferably thin. For example, the thickness of the display panel DP is preferably 1 mm or less, more preferably 300 μm or less, and further preferably 100 μm or less.
[0217] like Fig.14A As shown, in the display unit 20C, there is a region where the display panels DP are adjacent, that is, a joint (region S in the figure) between the display panels DP. When a plurality of display panels DP are used to display an image, it is preferable to ensure the continuity of the image in the region S.
[0218] However, the characteristics of the transistors in the pixels 25, the size of the capacitors, the parasitic resistance or capacitance of the signal lines SL, and the driving capability of the signal line driving circuit 23 are different for each display panel DP. Therefore, when the image signals are supplied to the display panels DP, errors occur in the images displayed by the display panels DP, so the images are discontinuous at the seams. Fig. 13B , Fig. 13CAs shown in FIG. 14B-1, when the pixel portion 71 of one display panel DP includes an area overlapping with the area 72 that transmits visible light of the other display panel DP, the image displayed on the pixel portion 71 in the seam is seen through the area 72 that transmits visible light, so a grayscale error occurs. Therefore, when the data obtained by directly dividing the first image data SD1 generated by the first processing unit 33 (first image data SD1[1,1] to SD1[x,y]) is supplied to each display panel DP, a discontinuous image is seen in the area S as shown in FIG. 14B-1.
[0219] Therefore, the display system according to one embodiment of the present invention includes a second processing unit 40 having a function of correcting an image signal using artificial intelligence. Specifically, the second processing unit 40 can correct the image signal in a manner that alleviates the discontinuity of the image in the seams between the plurality of display panels DP. Thus, when the display unit 20 is formed using a plurality of display panels DP, image distortion can be less easily seen in the seams between the display panels DP, thereby improving the image quality.
[0220] Fig.11 The second processing unit 40 shown has a function of correcting the image signal input from the first processing unit 33. Specifically, the second processing unit 40 has a function of correcting the first image data SD1 in such a manner as to display a continuous image in the boundary of the two display panels DP, that is, to compensate for image discontinuity in the seam.
[0221] The correction of the first image data SD1 is performed by the second processing unit 40. Learning is performed in the second processing unit 40 to appropriately correct the image signal so as to alleviate the discontinuity of the image in the seam. Then, when the first image data SD1 is supplied to the second processing unit 40, the second processing unit 40 performs inference and outputs the second image data SD2. Then, the second image data SD2[p, q] generated by the second processing unit 40 is divided by the dividing unit 45, and the second image data SD2[p, q] of x×y parts is supplied to the display panel DP[p, q], and an image in which the seam is not easily visible as shown in FIG. 14B-2 is displayed.
[0222] Specifically, the seam can be made brighter than other areas. As a result, an image in which the seam is not easily visible and is displayed naturally can be realized on the plurality of display panels DP. In addition, display unevenness can be corrected at the same time, so the display quality of the display unit can be further improved.
[0223] The display system of one embodiment of the present invention may also include a plurality of second processing units 40. For example, a second processing unit 40 may be provided in one display panel DP. The plurality of second processing units 40 may perform parallel computing and processing, thereby achieving high-speed processing. Fig.15 and Fig.16 An example of a display system including a plurality of second processing units 40 is described.
[0224] Fig.15 1 is a block diagram of a display system 10D. The display system 10D includes a display unit 20D and a signal generating unit 30D. The display unit 20D includes a plurality of display panels DP. The signal generating unit 30D includes a plurality of second processing units 40. Fig.15 An example is shown in which the number of the display panels DP is the same as the number of the second processing units 40 .
[0225] In the display system 10D, the first image data SD1 generated by the first processing unit 33 is divided into x×y data by the dividing unit 45. The first image data SD1[p,q] is supplied from the dividing unit 45 to the second processing unit 40[p,q], and the second processing unit 40[p,q] corrects the first image data SD1[p,q] to generate the second image data SD2[p,q]. Then, the second image data SD2[p,q] is supplied to the display panel DP[p,q].
[0226] Fig.16 1 is a block diagram of a display system 10E. The display system 10E includes a display unit 20E and a signal generating unit 30E. The display unit 20E includes a plurality of display units DU. The display unit DU includes a display panel DP and a second processing unit 40. Fig.16 An example is shown in which the number of the display panels DP is the same as the number of the second processing units 40 .
[0227] In the display system 10E, the first image data SD1 generated by the first processing unit 33 is divided into x×y data by the dividing unit 45. The first image data SD1[1,1] to SD1[x,y] are supplied from the dividing unit 45 to the display unit 20E. The first image data SD1[p,q] is supplied to the second processing unit 40[p,q] included in the display unit DU[p,q], and the second processing unit 40[p,q] corrects the first image data SD1[p,q] to generate the second image data SD2[p,q]. Then, the second image data SD2[p,q] is supplied to the display panel DP[p,q].
[0228] <1-6. Example of Learning and Inference in Second Processing Unit 40> The following reference 17A to 17C as well as 18A to 18C An example of learning and inference in the second processing unit 40 will be described.
[0229] FIG. 5A to FIG. 5CAn example is shown in which image data DD1 for learning is obtained by using the first image data SD1, and the learning of the second processing unit 40 is performed by using the image data DD1. In one embodiment of the present invention, image data for the second learning can also be obtained by using the second image data SD2 corrected by the second processing unit 40 that has completed the first learning. The second learning of the second processing unit 40 can be performed by using the image data for the second learning. Thus, the correction accuracy of the image data can be improved. Similarly, image data for learning after the third time can also be obtained by using the image data corrected by the second processing unit 40 that has learned at least twice. In other words, learning can also be performed more than three times.
[0230] Sometimes, it is preferable to use artificial intelligence for the second processing unit 40 because the number of times of learning can be reduced. Also, sometimes, it is preferable to perform learning a sufficient number of times so that complicated AI need not be used.
[0231] The following describes the case where the second processing unit 40 performs learning twice. FIG. 5A to FIG. 5C Description.
[0232] Fig.17A The state of the second processing unit 40 before learning is shown. Fig. 17B The state of the second processing unit 40 during the first learning is shown. Fig. 17C The state when the second processing unit 40 performs inference after the first learning is shown. Fig.18A The state of the second processing unit 40 during the second learning is shown. Fig.18B The state when the second processing unit 40 performs inference after the second learning is shown.
[0233] First, in Fig.17A , the first image data SD1 is output from the first processing unit 33. The first image data SD1 is image data corresponding to the image A. The first image data SD1 is not corrected before the learning of the second processing unit 40, and the first image data SD1 is output to the signal line driving circuit 23 through the second processing unit 40. The first image data SD1 is supplied to the pixel portion 21, and the pixel portion 21 displays an image based on the first image SD1. The image actually displayed by the pixel portion 21 is referred to as image B. In addition, the image B can also be displayed on the pixel portion 21 by supplying the first image data SD1 from the first processing unit 33 directly (that is, not through the second processing unit 40) to the signal line driving circuit 23.
[0234] Fig.17A The state in which a seam (region S1) and display unevenness (region U1) are visible in image B is shown.
[0235] When a seam or display unevenness is seen in the image B, learning by the second processing unit 40 is performed.
[0236] In the learning of the second processing unit 40 , image data corresponding to the image B actually displayed on the pixel unit 21 (hereinafter referred to as image data DD1 ) is used as learning data.
[0237] As the image data DD1, for example, grayscale data or brightness data can be used. The image data DD1 is acquired by using an image sensor, a camera, a two-dimensional brightness meter, or an optical inspection system of a display.
[0238] Then, if Fig. 17B As shown, the image data DD1 is supplied to the second processing unit 40. In the second processing unit 40, the weight coefficient used in the second processing unit 40 is updated in such a way that the difference between the corrected image data DD2 and the first image data SD1 is less than a certain value. The weight coefficient can be updated by using a gradient descent method or the like, and the gradient can be calculated by using a back propagation method or the like. The weight coefficient is updated repeatedly until the difference between the image data DD2 and the first image data SD1 is less than a certain value. In addition, the allowable range of the difference can be freely set.
[0239] When the difference between the final image data DD2 and the first image data SD1 becomes less than a certain value, the second processing unit 40 ends the first learning. Fig. 17B As shown in FIG. 1 , the image data DD1 is input to the second processing unit 40 after the first learning is completed, and the corrected image data DD2 is output to the signal line driving circuit 23. Then, the image data DD2 is supplied to the pixel unit 21, and the pixel unit 21 displays an image based on DD2. At this time, the image actually displayed on the pixel unit 21 is the same as the image B (the difference between the actually displayed image and the image B is less than a certain value).
[0240] Next, the first image data SD1 is corrected by inference of the second processing unit 40 after the first learning. Fig. 17C As shown, when the first image data SD1 is input to the second processing unit 40, the second processing unit 40 performs calculations using the weight coefficients updated by learning to correct the first image data SD1. The calculation result is output from the second processing unit 40 as the second image data SD2 and supplied to the pixel portion 21 through the signal line driving circuit 23.
[0241] Here, the second image data SD2 is obtained by the second processing unit 40 ( Fig. 17B ) corrected image data. Therefore, by supplying the second image data SD2 to the pixel unit 21, an image C in which a seam is less easily visible than the image B can be displayed.
[0242] However, sometimes the seams are not completely eliminated or appear uneven. Fig. 17C The state in which a seam (region S2) and display unevenness (region U2) are visible in image C is shown.
[0243] When a seam or display unevenness or the like is seen in the image C, it is preferable to perform the second learning by the second processing unit 40 .
[0244] In the second learning by the second processing unit 40 , image data corresponding to the image C actually displayed on the pixel unit 21 (hereinafter referred to as image data DD3 ) is used as learning data.
[0245] As the image data DD3, for example, grayscale data or brightness data can be used. The image data DD3 is acquired by using an image sensor, a camera, a two-dimensional brightness meter, or an optical inspection system of a display, etc. The image data DD1 and the image data DD3 can be acquired by the same or different methods.
[0246] Specifically, if Fig.18A As shown, the image data DD3 is supplied to the second processing unit 40. In the second processing unit 40, the weight coefficient used in the second processing unit 40 is updated so that the difference between the corrected image data DD4 and the first image data SD1 is less than a certain value. The updating of the weight coefficient is repeated until the difference between the image data DD4 and the first image data SD1 is less than a certain value.
[0247] When the difference between the final image data DD4 and the first image data SD1 is less than a certain value, the second processing unit 40 ends the second learning. Fig.18A As shown in FIG. 1 , the image data DD3 is input to the second processing unit 40 after the second learning is completed, and the corrected image data DD4 is output to the signal line driving circuit 23. Then, the image data DD4 is supplied to the pixel unit 21, and the pixel unit 21 displays an image based on the image data DD4. At this time, the image actually displayed on the pixel unit 21 is the same as the image C (the difference between the actually displayed image and the image C is less than a certain value).
[0248] Next, the first image data SD1 is corrected by inference of the second processing unit 40 that performs the second learning. Fig.18B As shown, when the first image data SD1 is input to the second processing unit 40, the second processing unit 40 performs calculation using the weight coefficient updated by learning to correct the first image data SD1. The calculation result is output from the second processing unit 40 as the third image data SD3 and supplied to the pixel portion 21 through the signal line driving circuit 23.
[0249] Here, the third image data SD3 is the second image data that is learned by the second processing unit 40 ( Fig.18A ) corrected image data. Therefore, by supplying the third image data SD3 to the pixel unit 21, an image D in which a seam is less visible than that of the image C can be displayed. The image D is the same as the image A (the difference between the image D and the image A is less than a certain value).
[0250] In addition, the third learning may be performed when a seam or display unevenness is recognized in the image D. As described above, by repeatedly performing learning using image data obtained by correction, the image data can be corrected with higher accuracy.
[0251] As described above, by correcting the image data using the second processing unit 40, it is possible to display an image without visible seams, thereby improving the quality of high-resolution images.
[0252] In addition, if Fig.18C As shown, the second processing unit 40 may also include only the second layer 42. Filtering may be performed in the second layer 42. In one embodiment of the present invention, in addition to the image data before correction (the first image data SD1), the image data after correction (the second image data SD2, etc.) may also be used to determine the value of the correction filter. Thus, the correction accuracy of the image data may be improved even if the first layer 41 and the third layer 43 are not used.
[0253] When hardware is used for the processing of the second processing unit 40, an operation circuit composed of a transistor including silicon or an oxide semiconductor in the channel formation region is preferably used as the hardware. For example, it is suitable to use an operation circuit including a transistor including silicon (amorphous silicon, low-temperature polysilicon, or single-crystal silicon) or an oxide semiconductor in the channel formation region. When a product-sum operation is performed in the second processing unit 40, an analog circuit is preferably used as the product-sum operation circuit. The details are described in Embodiment 2. In addition, a transistor including an oxide semiconductor is preferably used as a transistor included in the analog memory.
[0254] A display system according to an embodiment of the present invention can display an image in which unevenness or seams are not easily visible by correcting image data using a processing unit including three layers. In the first layer, operation data can be generated using input image data. The operation data includes more data than the image data. In the second layer, the operation data is multiplied by a weight coefficient. In the third layer, image data is generated by using the operation data multiplied by the weight coefficient. The image data includes less data than the above-mentioned operation data. Operation data having a larger data amount than the image data is generated in the first layer, so the amount of data used in the operation of the second layer can be increased. As a result, the correction accuracy of the image data in the processing unit can be improved. Therefore, a display in which unevenness, seams between divided screens, seams between multiple display panels, etc. are not easily visible can be performed.
[0255] This embodiment mode can be combined with any other embodiment mode as appropriate. In this specification, when a plurality of configuration examples are shown in one embodiment mode, the configuration examples can be combined as appropriate.
[0256] (Implementation Method 2) In this embodiment mode, a structural example of a semiconductor device that can be used for a neural network will be described.
[0257] The operation of the second processing unit 40 described in the first embodiment includes an operation of adding the product of the pixel data or the operation data and the weight coefficient, that is, a product-sum operation. The product-sum operation can be performed by software using a program or by hardware. When the product-sum operation is performed by hardware, a product-sum operation circuit can be used. As the product-sum operation circuit, both a digital circuit and an analog circuit can be used. When an analog circuit is used as the product-sum operation circuit, the circuit scale of the product-sum operation circuit can be reduced, or the processing speed can be increased and the power consumption can be reduced by reducing the number of accesses to the memory.
[0258] The product-sum operation circuit can be composed of a transistor including silicon (single crystal silicon, etc.) in the channel formation region (hereinafter referred to as Si transistor), and can also be composed of a transistor including an oxide semiconductor in the channel formation region (hereinafter referred to as OS transistor). In particular, the OS transistor is a transistor with an extremely small off-state current, so it is suitable for a transistor of a memory included in the product-sum operation circuit. In addition, the product-sum operation circuit can also be formed using Si transistors and OS transistors. The following describes a structural example of a semiconductor device having the function of a product-sum operation circuit.
[0259] <Structural example of semiconductor device> Fig.19An example of the structure of a semiconductor device MAC having a function of performing a neural network operation is shown. The semiconductor device MAC has a function of performing a product-sum operation of first data corresponding to the connection strength (weight) between neurons and second data corresponding to input data. Note that the first data and the second data may be analog data or multi-valued digital data (dispersed data), respectively. The semiconductor device MAC also has a function of transforming data obtained by the product-sum operation using an activation function.
[0260] The semiconductor device MAC includes a cell array CA, a current source circuit CS, a current mirror circuit CM, a circuit WDD, a circuit WLD, a circuit CLD, and a bias circuit OFST.
[0261] The cell array CA includes a plurality of memory cells MC and a plurality of memory cells MCref. Fig.19 In the illustrated structural example, the cell array CA includes memory cells MC (memory cells MC[1,1] to MC[m,n]) and memory cells MCref (memory cells MCref[1] to MCref[m]) in m rows and n columns (m and n are integers greater than 1). The memory cells MC have a function of storing first data. In addition, the memory cells MCref have a function of storing reference data for product-sum operations. Note that the reference data may be analog data or multi-valued digital data.
[0262] The memory cell MC[i, j] (i is an integer greater than 1 and less than m, and j is an integer greater than 1 and less than n) is connected to the wiring WL[i], the wiring RW[i], the wiring WD[j], and the wiring BL[j]. In addition, the memory cell MCref[i] is connected to the wiring WL[i], the wiring RW[i], the wiring WDref, and the wiring BLref. Here, the current flowing between the memory cell MC[i, j] and the wiring BL[j] is recorded as I MC[i,j] , the current flowing between the memory cell MCref[i] and the wiring BLref is recorded as I MCref[i] .
[0263] Fig. 20 Specific structural examples of the memory cell MC and the memory cell MCref are shown. Fig. 20 1 and 2 are typical examples of memory cells MC[1,1] and MC[2,1] and memory cells MCref[1] and MCref[2]. However, the same structure can be used in other memory cells MC and memory cells MCref. Both memory cells MC and memory cells MCref include transistors Tr11, Tr12, and capacitor C11. Here, the case where transistors Tr11 and Tr12 are n-channel transistors is described.
[0264] In the memory cell MC, the gate of the transistor Tr11 is connected to the wiring WL, one of the source and drain of the transistor Tr11 is connected to the gate of the transistor Tr12 and the first electrode of the capacitor C11, and the other of the source and drain of the transistor Tr11 is connected to the wiring WD. One of the source and drain of the transistor Tr12 is connected to the wiring BL, and the other of the source and drain of the transistor Tr12 is connected to the wiring VR. The second electrode of the capacitor C11 is connected to the wiring RW. The wiring VR has a function of supplying a specified potential. As an example, the case where a low power supply potential (for example, a ground potential) is supplied from the wiring VR is described below.
[0265] A node connected to one of the source and drain of the transistor Tr11, the gate of the transistor Tr12, and the first electrode of the capacitor C11 is referred to as a node NM. The nodes NM included in the memory cells MC[1,1] and MC[2,1] are referred to as nodes NM[1,1] and NM[2,1], respectively.
[0266] The memory cell MCref has the same structure as that of the memory cell MC. However, the memory cell MCref is connected to the wiring WDref instead of the wiring WD and to the wiring BLref instead of the wiring BL. In addition, the nodes connected to one of the source and the drain of the transistor Tr11, the gate of the transistor Tr12, and the first electrode of the capacitor C11 are respectively described as the node NMref[1] in the memory cell MCref[1] and the node NMref[2] in the memory cell MCref[2].
[0267] The node NM and the node NMref are used as holding nodes of the memory cell MC and the memory cell MCref, respectively. The first data is held in the node NM, and the reference data is held in the node NMref. MC[1,1] ,I MC[2,1] The current I flows from the wiring BL[1] to the transistors Tr12 of the memory cells MC[1,1] and MC[2,1]. MCref[1] ,I MCref[2] The power flows from the wiring BLref to the transistors Tr12 of the memory cells MCref[1] and MCref[2], respectively.
[0268] Since the transistor Tr11 has the function of maintaining the potential of the node NM or the node NMref, the off-state current of the transistor Tr11 is preferably small. Therefore, as the transistor Tr11, it is preferable to use an OS transistor with a very small off-state current. As a result, the potential variation of the node NM or the node NMref can be suppressed and the calculation accuracy can be improved. In addition, the operation of refreshing the potential of the node NM or the node NMref can be performed at a low frequency, thereby reducing power consumption.
[0269] There is no particular limitation on the transistor Tr12, and for example, a Si transistor or an OS transistor may be used. When an OS transistor is used as the transistor Tr12, the transistor Tr12 can be manufactured using the same manufacturing apparatus as the transistor Tr11, thereby reducing manufacturing costs. Note that the transistor Tr12 may be an n-channel transistor or a p-channel transistor.
[0270] The current source circuit CS is connected to the wirings BL[1] to BL[n] and the wiring BLref. The current source circuit CS has a function of supplying current to the wirings BL[1] to BL[n] and the wiring BLref. Note that the value of the current supplied to the wirings BL[1] to BL[n] may be different from the value of the current supplied to the wiring BLref. Here, the current supplied from the current source circuit CS to the wirings BL[1] to BL[n] is referred to as I C The current supplied from the current source circuit CS to the wiring BLref is recorded as I Cref .
[0271] The current mirror circuit CM includes wirings IL[1] to IL[n] and wiring ILref. The wirings IL[1] to IL[n] are connected to wirings BL[1] to BL[n], respectively, and the wiring ILref is connected to the wiring BLref. Here, the wiring IL[1] and the connection between the wiring BL[1] and the wiring IL[n] and the connection between BL[n] are respectively referred to as nodes NP[1] to NP[n]. In addition, the connection between the wiring ILref and the wiring BLref is referred to as a node NPref.
[0272] The current mirror circuit CM has a function of converting a current I corresponding to the potential of the node NPref. CM The function of flowing to the wiring ILref and also transferring the current I CM The function flows to the wiring IL[1] to IL[n]. Fig.19 In the example shown, the current I CM The current I is discharged from the wiring BLref to the wiring ILref. CM The currents flowing from the current mirror circuit CM to the cell array CA through the wirings BL[1] to BL[n] are respectively expressed as I B [1] to I B [n] In addition, the current flowing from the current mirror circuit CM to the cell array CA through the wiring BLref is recorded as I Bref .
[0273] The circuit WDD is connected to the wirings WD[1] to WD[n] and the wiring WDref. The circuit WDD has a function of supplying a potential corresponding to the first data stored in the memory cell MC to the wirings WD[1] to WD[n]. The circuit WDD also has a function of supplying a potential corresponding to the reference data stored in the memory cell MCref to the wiring WDref. The circuit WLD is connected to the wirings WL[1] to WL[m]. The circuit WLD has a function of supplying a signal for selecting the memory cell MC or the memory cell MCref of the data to be written to any one of the wirings WL[1] to WL[m]. The circuit CLD is connected to the wirings RW[1] to RW[m]. The circuit CLD has a function of supplying a potential corresponding to the second data to the wirings RW[1] to RW[m].
[0274] The bias circuit OFST is connected to the wirings BL[1] to BL[n] and the wirings OL[1] to OL[n]. The bias circuit OFST has the function of detecting the amount of current flowing from the wirings BL[1] to BL[n] to the bias circuit OFST and / or the change in the amount of current flowing from the wirings BL[1] to BL[n] to the bias circuit OFST. The bias circuit OFST also has the function of outputting the detection result to the wirings OL[1] to OL[n]. Note that the bias circuit OFST can output the current corresponding to the detection result to the wiring OL, and can also convert the current corresponding to the detection result into a voltage and output it to the wiring OL. The current flowing between the cell array CA and the bias circuit OFST is recorded as I α [1] to I α [n].
[0275] Fig.21 A configuration example of the bias circuit OFST is shown. Fig.21 The bias circuit OFST shown includes circuits OC[1] to OC[n]. In addition, each of the circuits OC[1] to OC[n] includes a transistor Tr21, a transistor Tr22, a transistor Tr23, a capacitor C21, and a resistor R1. Fig.21 The connection relationship of each element is shown in FIG. Note that the node connected to the first electrode of the capacitor C21 and the first terminal of the resistor R1 is referred to as the node Na. In addition, the node connected to the second electrode of the capacitor C21, one of the source and drain of the transistor Tr21, and the gate of the transistor Tr22 is referred to as the node Nb.
[0276] The wiring VrefL has a function of supplying the potential Vref, the wiring VaL has a function of supplying the potential Va, and the wiring VbL has a function of supplying the potential Vb. In addition, the wiring VDDL has a function of supplying the potential VDD, and the wiring VSSL has a function of supplying the potential VSS. Here, the case where the potential VDD is a high power supply potential and the potential VSS is a low power supply potential is described. In addition, the wiring RST has a function of supplying a potential for controlling the conduction state of the transistor Tr21. The transistor Tr22, the transistor Tr23, the wiring VDDL, the wiring VSSL, and the wiring VbL constitute a source follower circuit.
[0277] Next, an operation example of circuits OC[1] to OC[n] is described. Note that although the operation example of circuit OC[1] is described here as a typical example, circuits OC[2] to OC[n] can also operate in the same manner as circuit OC[1]. First, when a first current flows to wiring BL[1], the potential of node Na becomes a potential corresponding to the first current and the resistance value of resistor R1. At this time, transistor Tr21 is in an on state, and thus potential Va is supplied to node Nb. Then, transistor Tr21 becomes an off state.
[0278] Next, when the second current flows to the wiring BL[1], the potential of the node Na changes to a potential corresponding to the second current and the resistance value of the resistor R1. At this time, the transistor Tr21 is in the off state, the node Nb is in the floating state, and as the potential of the node Na changes, the potential of the node Nb changes due to capacitive coupling. Here, the amount of change in the potential of the node Na is ΔV Na When the capacitive coupling coefficient is 1, the potential of node Nb is Va+ΔV Na The threshold voltage of transistor Tr22 is V th When the potential Va+ΔV is output from the wiring OL[1] Na -V th Here, by satisfying Va=V th , the potential ΔV can be output from the wiring OL[1] Na .
[0279] Potential ΔV Na The voltage ΔV is determined by the change from the first current to the second current, the resistor R1, and the potential Vref. Na The amount of change in the current flowing to the wiring BL.
[0280] As described above, a signal corresponding to the amount of current and / or the amount of change in current detected by the bias circuit OFST is output as output data to the wirings OL[1] to OL[n].
[0281] 〈Operation Example of Semiconductor Device〉 By using the semiconductor device MAC, it is possible to perform a product-sum operation on the first data and the second data. Next, an operation example of the semiconductor device MAC when performing a product-sum operation will be described.
[0282] Fig. 22 This is a timing chart showing an operation example of the semiconductor device MAC. Fig. 22 Show Fig. 20 The potential changes of the wiring WL[1], wiring WL[2], wiring WD[1], wiring WDref, node NM[1,1], node NM[2,1], node NMref[1], node NMref[2], wiring RW[1], and wiring RW[2], and the current I B [1] to I α [1] and current I Bref The value of current I B [1] to I α [1] corresponds to the total of currents flowing from the wiring BL[1] to the memory cells MC[1,1] and MC[2,1].
[0283] Although focusing on Fig. 20 The operation is described with reference to the memory cells MC[1, 1], MC[2, 1] and the memory cells MCref[1], MCref[2] shown in the figure, but the other memory cells MC and memory cells MCref can also operate in the same manner.
[0284] [Storage of First Data] First, during the period from time T01 to time T02, the potential of the wiring WL[1] becomes high level, and the potential of the wiring WD[1] becomes V higher than the ground potential (GND). PR -V W[1,1] The potential of the wiring WDref becomes V greater than the ground potential. PR The potential of wiring RW[1] and wiring RW[2] is the standard potential (REFP). W[1,1] The potential V is the potential corresponding to the first data stored in the memory cell MC[1,1]. PR The potential of is the potential corresponding to the reference data. Therefore, the transistor Tr11 of the memory cell MC[1,1] and the memory cell MCref[1] is turned on, and the potentials of the nodes NM[1,1] and NMref[1] become V PR -V W[1,1] and V PR .
[0285] At this time, the current I flowing from the wiring BL[1] to the transistor Tr12 in the memory cell MC[1,1] MC[1,1],0 It can be expressed as follows. Here, k is a constant depending on the channel length, channel width, mobility, and capacitance of the gate insulating film of the transistor Tr12. In addition, V th is the threshold voltage of transistor Tr12.
[0286] I MC[1,1],0 = k(V PR -V W[1,1] -V th ) 2 (E1)
[0287] Furthermore, the current I flowing from the wiring BLref to the transistor Tr12 in the memory cell MCref[1] MCref[1],0 It can be expressed as the following formula.
[0288] I MCref[1],0 = k(V PR -V th ) 2 (E2)
[0289] Next, during the period from time T02 to time T03, the potential of wiring WL[1] becomes low level. As a result, transistor Tr11 included in memory cell MC[1,1] and memory cell MCref[1] is turned off, and the potentials of node NM[1,1] and node NMref[1] are maintained.
[0290] As described above, it is preferable to use an OS transistor as the transistor Tr11. This can suppress the leakage current of the transistor Tr11 and accurately maintain the potentials of the node NM[1, 1] and the node NMref[1].
[0291] Next, during the period from time T03 to time T04, the potential of the wiring WL[2] becomes high level, and the potential of the wiring WD[1] becomes V higher than the ground potential. PR -V W[2,1] The potential of the wiring WDref becomes V greater than the ground potential. PR Note that the potential V W[2,1] The potential of is the potential corresponding to the first data stored in the memory cell MC[2,1]. Therefore, the transistor Tr11 of the memory cell MC[2,1] and the memory cell MCref[2] is turned on, and the potentials of the nodes NM[2,1] and NMref[2] become V PR -V W[2,1] and V PR .
[0292] At this time, the current I flowing from the wiring BL[1] to the transistor Tr12 in the memory cell MC[2,1] MC[2,1],0 It can be expressed as the following formula.
[0293] I MC[2,1],0 = k(V PR -V W[2,1] -V th ) 2 (E3)
[0294] Furthermore, the current I flows from the wiring BLref to the transistor Tr12 in the memory cell MCref[2]. MCref[2],0 It can be expressed as the following formula.
[0295] I MCref[2],0 = k(V PR -V th ) 2 (E4)
[0296] Next, during the period from time T04 to time T05, the potential of wiring WL[2] becomes low level. As a result, transistor Tr11 included in memory cell MC[2,1] and memory cell MCref[2] is turned off, and the potentials of node NM[2,1] and node NMref[2] are maintained.
[0297] Through the above operation, the first data is stored in the memory cells MC[1, 1] and [2, 1], and the reference data is stored in the memory cells MCref[1] and MCref[2].
[0298] Here, from time T04 to time T05, consider the current flowing to wiring BL[1] and wiring BLref. Current is supplied to wiring BLref from current source circuit CS. The current flowing through wiring BLref is discharged to current mirror circuit CM and storage cells MCref[1] and MCref[2]. The following equation is valid in the following case: Cref is the current supplied from the current source circuit CS to the wiring BLref and I CM,0 This is the current discharged from the wiring BLref to the current mirror circuit CM.
[0299] I Cref -I CM,0 =I MCref[1],0 +I MCref[2],0 (E5)
[0300] The current source circuit CS supplies current to the wiring BL[1]. The current flowing through the wiring BL[1] is also discharged to the current mirror circuit CM and the memory cells MC[1, 1] and MC[2, 1]. In addition, the current flows from the wiring BL[1] to the bias circuit OFST. The following equation is valid in the following case: C,0 is the current supplied from the current source circuit CS to the wiring BL[1] and I α,0 This is the current flowing from the wiring BL[1] to the bias circuit OFST.
[0301] I C -I CM,0 =I MC[1,1],0 +I MC[2,1],0 +I α,0 (E6)
[0302] [Product-sum operation of first data and second data] Next, during the period from time T05 to time T06, the potential of wiring RW[1] becomes V higher than the standard potential. X[1] At this time, the potential V X[1] is supplied to each capacitor C11 in the memory cell MC[1,1] and the memory cell MCref[1], so the gate potential of the transistor Tr12 rises due to capacitive coupling. Note that the potential V X[1] The potential of is a potential corresponding to the second data supplied to the memory cell MC[1, 1] and the memory cell MCref[1].
[0303] The change in the potential of the gate of the transistor Tr12 is equivalent to the value obtained by multiplying the change in the potential of the wiring RW by the capacitance coupling coefficient determined according to the structure of the memory cell. The capacitance coupling coefficient is calculated based on the capacitance of the capacitor C11, the gate capacitance of the transistor Tr12, and the parasitic capacitance. In the following description, for convenience, the change in the potential of the wiring RW is equal to the change in the potential of the gate of the transistor Tr12, that is, the capacitance coupling coefficient is set to 1. In fact, considering the capacitance coupling coefficient determines the potential V X , that's it.
[0304] When the potential V X[1] When the voltage is supplied to the capacitor C11 of the memory cell MC[1,1] and the memory cell MCref[1], the potential of the node NM[1,1] and the node NMref[1] both rises by V X[1] .
[0305] Here, during the period from time T05 to time T06, the current I flowing from the wiring BL[1] to the transistor Tr12 in the memory cell MC[1,1] is MC[1,1],1 It can be expressed as the following formula.
[0306] IMC[1,1],1 = k(V PR -V W[1,1] +V X[1] -V th ) 2 (E7)
[0307] That is, by supplying the potential V to the wiring RW[1] X[1] , the current flowing from the wiring BL[1] to the transistor Tr12 in the memory cell MC[1,1] increases by ΔI MC[1,1] =I MC[1,1],1 -I MC[1,1], 0.
[0308] Here, during the period from time T05 to time T06, the current I flowing from the wiring BLref to the transistor Tr12 in the memory cell MCref[1] is MCref[1],1 It can be expressed as the following formula.
[0309] I MCref[1],1 = k(V PR +V X[1] -V th ) 2 (E8)
[0310] That is, by supplying the potential V to the wiring RW[1] X[1] , the current flowing from the wiring BLref to the transistor Tr12 in the memory cell MCref[1] increases by ΔI MCref[1] =I MCref[1],1 -I MCref[1], 0.
[0311] In addition, consider the current flowing through the wiring BL[1] and the wiring BLref. The current I is supplied from the current source circuit CS to the wiring BLref. Cref The current flowing through the wiring BLref is also discharged to the current mirror circuit CM and the memory cells MCref[1] and MCref[2]. The following equation is valid in the following case: CM,1 This is the current discharged from the wiring BLref to the current mirror circuit CM.
[0312] I Cref -I CM,1 =I MCref[1],1 +I MCref[2],0 (E9)
[0313] The current I is supplied from the current source circuit CS to the wiring BL[1]. CThe current flowing through the wiring BL[1] is also discharged to the current mirror circuit CM and the memory cells MC[1,1] and MC[2,1]. Furthermore, the current flows from the wiring BL[1] to the bias circuit OFST. The following equation is valid in the following case: α,1 This is the current flowing from the wiring BL[1] to the bias circuit OFST.
[0314] I C -I CM,1 =I MC[1,1],1 +I MC[2,1],1 +I α,1 (E10)
[0315] In addition, according to equations (E1) to (E10), the current I can be expressed as follows: α,0 With current I α,1 The difference (difference current ΔI α ).
[0316] ΔI α =I α,1 -I α,0 =2kV W[1,1] V X[1] (E11)
[0317] Thus, the difference current ΔI α is the potential corresponding to V W[1,1] With V X[1] The value of the product.
[0318] Then, during the period from time T06 to time T07 , the potential of wiring RW[ 1 ] becomes the ground potential, and the potentials of node NM[ 1 , 1 ] and node NMref[ 1 ] become the same potentials as during the period from time T04 to time T05 .
[0319] Next, during the period from time T07 to time T08, the potential of wiring RW[1] becomes V higher than the standard potential. X[1] The potential of wiring RW[2] becomes V greater than the standard potential. X[2] Therefore, the potential V X[1] The voltage supplied to each capacitor C11 in the memory cell MC[1,1] and the memory cell MCref[1] increases the potential of both the node NM[1,1] and the node NMref[1] by V due to capacitive coupling. X[1] In addition, the potential V X[2] The voltage supplied to each capacitor C11 in the memory cell MC[2,1] and the memory cell MCref[2] increases the potential of both the node NM[2,1] and the node NMref[2] by V due to capacitive coupling. X[2] .
[0320] Here, during the period from time T07 to time T08, the current I flowing from the wiring BL[1] to the transistor Tr12 in the memory cell MC[2,1] is MC[2,1],1 It can be expressed as the following formula.
[0321] I MC[2,1],1 = k(V PR -V W[2,1] +V X[2] -V th ) 2 (E12)
[0322] That is, by supplying the potential V to the wiring RW[2] X[2] , the current flowing from the wiring BL[1] to the transistor Tr12 in the memory cell MC[2,1] increases by ΔI MC[2,1] =I MC[2,1],1 -I MC[2,1], 0.
[0323] In addition, during the period from time T05 to time T06, the current I flowing from the wiring BLref to the transistor Tr12 in the memory cell MCref[2] is MCref[2],1 It can be expressed as the following formula.
[0324] I MCref[2],1 = k(V PR +V X[2] -V th ) 2 (E13)
[0325] That is, by supplying the potential V to the wiring RW[2] X[2] , the current flowing from the wiring BLref to the transistor Tr12 in the memory cell MCref[2] increases by ΔI MCref[2] =I MCref[2],1 -I MCref[2], 0.
[0326] In addition, consider the current flowing through the wiring BL[1] and the wiring BLref. The current I is supplied from the current source circuit CS to the wiring BLref. Cref The current flowing through the wiring BLref is also discharged to the current mirror circuit CM and the memory cells MCref[1] and MCref[2]. The following equation is valid in the following case: CM,2 This is the current discharged from the wiring BLref to the current mirror circuit CM.
[0327] I Cref -I CM,2 =I MCref[1],1 +I MCref[2],1 (E14)
[0328] The current I is supplied from the current source circuit CS to the wiring BL[1]. C The current flowing through the wiring BL[1] is also discharged to the current mirror circuit CM and the memory cells MC[1,1] and MC[2,1]. Furthermore, the current flows from the wiring BL[1] to the bias circuit OFST. The following equation is valid in the following case: α,2 This is the current flowing from the wiring BL[1] to the bias circuit OFST.
[0329] I C -I CM,2 =I MC[1,1],1 +I MC[2,1],1 +I α,2 (E15)
[0330] In addition, according to equations (E1) to (E8) and equations (E12) to (E15), the current I can be expressed as follows: α,0 With current I α,2 The difference (difference current ΔI α ).
[0331] ΔI α =I α,2 -I α,0 =2k(V W[1,1] V X[1] +V W[2,1] V X[2] )(E16)
[0332] Thus, the difference current ΔI α is equivalent to the potential V W[1,1] With potential V X[1] The product of the potential V W[2,1] With potential V X[2] The value of the result of the sum of the products.
[0333] Then, during the period from time T08 to time T09, the potential of wirings RW[1] and RW[2] becomes the ground potential, and the potential of nodes NM[1,1] and NM[2,1] and nodes NMref[1] and NMref[2] becomes the same potential as during the period from time T04 to time T05.
[0334] As shown in equations (E9) and (E16), the differential current ΔI input to the bias circuit OFST is α is equivalent to the potential V corresponding to the first data (weight) X and the potential V corresponding to the second data (input data) W That is, by using the bias circuit OFST to bias the difference current ΔI α By performing the measurement, a result of a product-sum operation of the first data and the second data can be obtained.
[0335] Note that although the above description focuses on memory cells MC[1,1], MC[2,1], MCref[1], and MCref[2], the number of memory cells MC and memory cells MCref can be any number. When the number of rows m of memory cells MC and memory cells MCref is set to any number, the difference current ΔI can be expressed as follows: α .
[0336] ΔI α =2kΣ i V W[i,1] V X[i] (E17)
[0337] Furthermore, as the number n of columns of memory cells MC and memory cells MCref increases, the number of parallel sum-of-product operations can increase.
[0338] As described above, by using the semiconductor device MAC, a product-sum operation can be performed on the first data and the second data. Fig. 20 The structures of the memory cells MC and MCref in the embodiment can form a product-and-sum operation circuit with fewer transistors. Thus, the circuit scale of the semiconductor device MAC can be reduced.
[0339] When the semiconductor device MAC is used for calculations in a neural network, the number m of rows of memory cells MC can correspond to the number of input data supplied to one neuron and the number n of columns of memory cells MC can correspond to the number of neurons.
[0340] Note that there is no particular limitation on the structure of the neural network using the semiconductor device MAC. For example, the semiconductor device MAC can be used for a convolutional neural network (CNN), a recurrent neural network (RNN), an autoencoder, a Boltzmann machine (including a restricted Boltzmann machine), and the like.
[0341] As described above, by using the semiconductor device MAC, it is possible to perform product-sum operations in a neural network. Fig. 20 The memory cell MC and the memory cell MCref shown are used in the cell array CA, and an integrated circuit with improved operation accuracy, reduced power consumption or reduced circuit scale can be provided.
[0342] This embodiment mode can be combined with any other embodiment mode as appropriate.
[0343] (Implementation method 3) In this embodiment, refer to FIG. 23A to FIG. 23E , Fig.24A and Fig. 24B , Fig.25 , Fig.26 , Fig. 27 , Fig.28 , FIG. 29A to FIG. 29C , FIG. 30A to FIG. 30D , FIG. 31A to FIG. 31F , Fig.32A and Fig.32B , Fig.33A and Fig.33B , Fig.34A and Fig.34B as well as Fig.35 A display panel that can be used in a display system according to one embodiment of the present invention will be described.
[0344] <3-1. Example of pixel structure> Reference FIG. 23A to FIG. 23E An example of the structure of the pixel 120 will be described.
[0345] The pixel 120 includes a plurality of pixels 115. Each of the plurality of pixels 115 is used as a sub-pixel. Since one pixel 120 is composed of a plurality of pixels 115 showing mutually different colors, full-color display can be realized in the display unit.
[0346] Fig.23A and Fig. 23B The illustrated pixels 120 each include three sub-pixels. Fig.23A The color combination presented by the pixels 115 of the illustrated pixel 120 is red (R), green (G), and blue (B). Fig. 23B The pixel 120 shown includes pixels 115 that present a color combination of cyan (C), magenta (M), and yellow (Y).
[0347] FIG. 23C to FIG. 23E The illustrated pixels 120 each include four sub-pixels. Fig.23C The color combination displayed by the pixel 115 of the pixel 120 shown is red (R), green (G), blue (B), and white (W). By using sub-pixels that display white, the brightness of the display portion can be increased. Fig.23D The color combination presented by the pixels 115 of the illustrated pixels 120 is red (R), green (G), blue (B), and yellow (Y). Fig.23E The color combination presented by the pixels 115 of the illustrated pixel 120 is cyan (C), magenta (M), yellow (Y), and white (W).
[0348] By appropriately combining more sub-pixels used as one pixel with sub-pixels representing colors such as red, green, blue, cyan, magenta, and yellow, the reproducibility of halftones can be improved. Therefore, the display quality can be improved.
[0349] A display device according to an embodiment of the present invention can reproduce color gamuts of various standards. For example, a display device of one embodiment of the present invention can reproduce color gamuts of the following specifications: Phase Alternating Line (PAL) specifications and National Television System Committee (NTSC) specifications used in television broadcasting; standard RGB (sRGB: standard RGB) specifications and Adobe RGB specifications widely used in display devices for electronic devices such as personal computers, digital cameras, printers, etc.; International Telecommunication Union Radiocommunication Sector Broadcasting Service (Television) 709 (ITU-R BT.709) used in high-definition television (HDTV: High Definition Television, also known as Hi-Vision); Digital Cinema Initiatives P3 (DCI-P3: Digital Cinema Initiatives P3) specifications used in digital cinema projection; and ITU-R BT.2020 Recommendation 2020 (REC.2020) specifications used in ultra-high-definition television (UHDTV: Ultra High Definition Television, also known as Super Hi-Vision), etc.
[0350] When using a matrix of pixels 120 configured at 1920×1080, the display device can display in full color with "full high definition" (also known as "2K resolution", "2K1K" or "2K", etc.). In addition, for example, when using a matrix of pixels 120 configured at 3840×2160, the display device can display in full color with "ultra-high definition" (also known as "4K resolution", "4K2K" or "4K", etc.). In addition, for example, when using a matrix of pixels 120 configured at 7680×4320, the display device can display in full color with "super-high definition" (also known as "8K resolution", "8K4K" or "8K", etc.). By using a larger number of pixels 120, the display device can display in full color with a resolution of 16K or 32K.
[0351] <3-2. Configuration example of pixel circuit> Examples of the display element included in the display device of one embodiment of the present invention include inorganic EL elements, organic EL elements, light-emitting elements such as LEDs, liquid crystal elements, electrophoretic elements, and display elements using micro-electromechanical systems (MEMS).
[0352] Below, use Fig.24A An example of a structure of a pixel circuit including a light-emitting element is described. Fig. 24B A structural example of a pixel circuit including a liquid crystal element is described.
[0353] Fig.24A The pixel circuit 438 shown includes a transistor 446, a capacitor 433, a transistor 251, and a transistor 444. The pixel circuit 438 is electrically connected to the light emitting element 170 used as the display element 442.
[0354] One of a source electrode and a drain electrode of the transistor 446 is electrically connected to a signal line SL_j to which an image signal is supplied, and a gate electrode of the transistor 446 is electrically connected to a scanning line GL_i to which a selection signal is supplied.
[0355] The transistor 446 has a function of controlling whether or not to write an image signal to the node 445 .
[0356] One of the pair of electrodes of the capacitor 433 is electrically connected to the node 445 , and the other of the pair of electrodes of the capacitor 433 is electrically connected to the node 447 . The other of the source electrode and the drain electrode of the transistor 446 is electrically connected to the node 445 .
[0357] The capacitor 433 is used as a holding capacitor that holds data written to the node 445 .
[0358] One of a source electrode and a drain electrode of the transistor 251 is electrically connected to the potential supply line VL_a, and the other of the source electrode and the drain electrode of the transistor 251 is electrically connected to the node 447. A gate electrode of the transistor 251 is electrically connected to the node 445.
[0359] One of a source electrode and a drain electrode of the transistor 444 is electrically connected to the potential supply line V0, and the other of the source electrode and the drain electrode of the transistor 444 is electrically connected to the node 447. A gate electrode of the transistor 444 is electrically connected to the scanning line GL_i.
[0360] One of the anode and the cathode of the light emitting element 170 is electrically connected to the potential supply line VL_b, and the other is electrically connected to the node 447 .
[0361] As the power supply potential, for example, a potential on the relatively high potential side or a potential on the relatively low potential side can be used. The power supply potential on the high potential side is referred to as a high power supply potential (also referred to as VDD), and the power supply potential on the low potential side is referred to as a low power supply potential (also referred to as VSS). In addition, the ground potential can also be used as the high power supply potential or the low power supply potential. For example, when the ground potential is used as the high power supply potential, the low power supply potential is a potential lower than the ground potential, and when the ground potential is used as the low power supply potential, the high power supply potential is a potential higher than the ground potential.
[0362] For example, one of the potential supply line VL_a and the potential supply line VL_b is supplied with the high power supply potential VDD, and the other is supplied with the low power supply potential VSS.
[0363] Including Fig.24A In the display device having the pixel circuit 438 in the display device, the pixel circuit 438 of each row is sequentially selected by the scanning line driving circuit, thereby turning on the transistor 446 and the transistor 444 to write the image signal to the node 445.
[0364] When transistor 446 and transistor 444 are turned off, pixel circuit 438 in which data is written to node 445 is in a hold state. Furthermore, the amount of current flowing between the source electrode and the drain electrode of transistor 251 is controlled according to the potential of the data written to node 445. Light-emitting element 170 emits light at a brightness corresponding to the amount of current flowing. By performing the above steps row by row, an image can be displayed.
[0365] Fig. 24B The pixel circuit 438 in FIG. 4 includes a transistor 446 and a capacitor 433. The pixel circuit 438 is electrically connected to a liquid crystal element 180 which can be used as a display element 442.
[0366] The potential of one of the pair of electrodes of the liquid crystal element 180 is appropriately set according to the specifications of the pixel circuit 438. The alignment state of the liquid crystal element 180 is set according to the data written to the node 445. In addition, a common potential may be supplied to one of the pair of electrodes of the liquid crystal elements 180 respectively included in the plurality of pixel circuits 438. In addition, a different potential may be supplied to one of the pair of electrodes of each liquid crystal element 180 of the pixel circuit 438 of each row.
[0367] In the pixel circuit 438 of the i-th row and j-th column, one of the source electrode and the drain electrode of the transistor 446 is electrically connected to the signal line SL_j, and the other of the source electrode and the drain electrode of the transistor 446 is electrically connected to the node 445. The gate electrode of the transistor 446 is electrically connected to the scanning line GL_i. The transistor 446 has a function of controlling whether to write an image signal to the node 445.
[0368] One of the pair of electrodes of the capacitor 433 is electrically connected to a wiring (hereinafter referred to as a capacitor line CL) to which a specific potential is supplied, and the other of the pair of electrodes of the capacitor 433 is electrically connected to the node 445. The other of the pair of electrodes of the liquid crystal element 180 is electrically connected to the node 445. The potential value of the capacitor line CL is appropriately set according to the specification of the pixel circuit 438. The capacitor 433 is used as a holding capacitor for holding data written to the node 445.
[0369] Including Fig. 24B In the display device having the pixel circuit 438, the pixel circuit 438 is sequentially selected row by row by the scanning line driving circuit 102 and / or the scanning line driving circuit 103, thereby turning on the transistor 446 to write the image signal to the node 445.
[0370] By turning off the transistor 446, the pixel circuit 438 in which the image signal is written to the node 445 is put into a holding state. By sequentially performing the above steps row by row, an image can be displayed on the display unit.
[0371] <3-3. Configuration Example 1 of Display Device> Next, use Fig.25 , Fig.26 , Fig. 27 and Fig.28 A structural example of a display device will be described.
[0372] Fig.25 It is a cross-sectional view of a light-emitting display device that adopts a color filter method and has a top emission structure.
[0373] Fig.25 The display device shown includes a display portion 562 and a scan line driving circuit 564 .
[0374] In the display portion 562, a transistor 251a, a transistor 446a, a light-emitting element 170, and the like are provided over a substrate 111. In the scan line driver circuit 564, a transistor 201a and the like are provided over a substrate 111.
[0375] The transistor 251a includes a conductive layer 221 used as a first gate electrode, an insulating layer 211 used as a first gate insulating layer, a semiconductor layer 231, a conductive layer 222a and a conductive layer 222b used as a source electrode and a drain electrode, a conductive layer 223 used as a second gate electrode, and an insulating layer 225 used as a second gate insulating layer. The semiconductor layer 231 includes a channel formation region and a low resistance region. The channel formation region overlaps with the conductive layer 223 via the insulating layer 225. The low resistance region includes a portion connected to the conductive layer 222a and a portion connected to the conductive layer 222b.
[0376] Transistor 251a includes gate electrodes above and below the channel. The two gate electrodes are preferably electrically connected to each other. Compared with other transistors, a transistor in which two gate electrodes are electrically connected to each other can have a high field effect mobility and can increase the on-state current. As a result, a circuit that can operate at high speed can be obtained. Furthermore, the area occupied by the circuit portion can be reduced. By using a transistor with a large on-state current, even in a display device with an increased number of wirings due to large-scale or high-resolution, the signal delay of each wiring can be reduced, and display unevenness can be suppressed. In addition, since the area occupied by the circuit portion can be reduced, a narrow frame of the display device can be achieved. In addition, by adopting this structure, a transistor with high reliability can be manufactured.
[0377] Insulating layer 212 and insulating layer 213 are provided on conductive layer 223, and conductive layer 222a and conductive layer 222b are provided thereon. In transistor 251a, conductive layer 221 can be easily physically separated from conductive layer 222a or conductive layer 222b, so that parasitic capacitance between conductive layer 221 and conductive layer 222a or conductive layer 222b can be reduced.
[0378] There is no particular restriction on the structure of the transistor in the display device. For example, a planar transistor, a staggered transistor, or an inversely staggered transistor may be used. In addition, a top-gate transistor or a bottom-gate transistor may also be used. Alternatively, gate electrodes may be provided above and below the channel.
[0379] The transistor 251a includes metal oxide in the semiconductor layer 231. The metal oxide can be used as an oxide semiconductor.
[0380] The transistor 446a and the transistor 201a have the same structure as the transistor 251a. In one embodiment of the present invention, the structures of these transistors may be different from each other. The transistor included in the drive circuit portion and the transistor included in the display portion 562 may have the same structure or different structures. The transistors included in the drive circuit portion may all have the same structure or a combination of two or more structures. Similarly, the transistors included in the display portion 562 may all have the same structure or a combination of two or more structures.
[0381] The transistor 446a overlaps with the light-emitting element 170 with the insulating layer 215 interposed therebetween. By providing a transistor, a capacitor, a wiring, and the like so as to overlap with a light-emitting region of the light-emitting element 170, the aperture ratio of the display portion 562 can be increased.
[0382] The light emitting element 170 includes a pixel electrode 171, an EL layer 172, and a common electrode 173. The light emitting element 170 emits light toward the coloring layer 131 side.
[0383] One of the pixel electrode 171 and the common electrode 173 is used as an anode, and the other is used as a cathode. When a voltage higher than the threshold voltage of the light-emitting element 170 is applied between the pixel electrode 171 and the common electrode 173, holes are injected from the anode side into the EL layer 172 and electrons are injected from the cathode side into the EL layer 172. The injected electrons and holes are recombined in the EL layer 172, whereby the light-emitting substance included in the EL layer 172 emits light.
[0384] The pixel electrode 171 is electrically connected to the conductive layer 222b of the transistor 251a. These components can be directly connected or connected through other conductive layers. The pixel electrode 171 used as a pixel electrode is provided in each light emitting element 170. Two adjacent pixel electrodes 171 are electrically insulated by the insulating layer 216.
[0385] The EL layer 172 contains a light-emitting substance.
[0386] The common electrode 173 used as a common electrode is commonly used by the plurality of light emitting elements 170. The common electrode 173 is supplied with a constant potential.
[0387] The light emitting element 170 and the coloring layer 131 overlap with each other via the adhesive layer 174. The insulating layer 216 and the light shielding layer 132 overlap with each other via the adhesive layer 174.
[0388] The light emitting element 170 may also have a microcavity structure. By combining the color filter (coloring layer 131) and the microcavity structure, light with high color purity can be extracted from the display device.
[0389] The coloring layer 131 is a colored layer that transmits light in a specific wavelength region. For example, a color filter that transmits light in a red, green, blue, or yellow wavelength region may be used. Materials that can be used for the coloring layer 131 include metal materials, resin materials, and resin materials containing pigments or dyes.
[0390] In addition, one embodiment of the present invention is not limited to the color filter method, and a separate coating method, a color conversion method, a quantum dot method, etc. can also be adopted.
[0391] The light shielding layer 132 is provided between adjacent coloring layers 131. The light shielding layer 132 shields the light emitted by the adjacent light emitting elements 170, thereby suppressing the color mixing between the adjacent light emitting elements 170. Here, by providing the coloring layer 131 in such a manner that its end overlaps with the light shielding layer 132, light leakage can be suppressed. As the light shielding layer 132, a material that shields the light from the light emitting element 170 can be used, for example, a black matrix can be formed using a metal material or a resin material containing a pigment or a dye. In addition, by providing the light shielding layer 132 in an area outside the display portion 562 such as the scanning line driving circuit 564, unintentional light leakage caused by waveguide light, etc. can be suppressed, so it is preferred.
[0392] The substrate 111 and the substrate 113 are bonded together by an adhesive layer 174 .
[0393] The conductive layer 565 is electrically connected to the FPC 162 through the conductive layer 255 and the connector 242. The conductive layer 565 is preferably formed using the same material and the same process as the conductive layer included in the transistor. In the example described in this embodiment, the conductive layer 565 is formed using the same material and the same process as the conductive layer used as the source electrode and the drain electrode.
[0394] As the connection body 242 , various anisotropic conductive films (ACF: Anisotropic Conductive Film) and anisotropic conductive paste (ACP: Anisotropic Conductive Paste) can be used.
[0395] Fig.26 It is a cross-sectional view of a light-emitting display device that adopts a separate coating method and has a bottom emission structure.
[0396] Fig.26 The display device shown includes a display portion 562 and a scan line driving circuit 564 .
[0397] In the display portion 562, a transistor 251b, a light-emitting element 170, and the like are provided over a substrate 111. In the scan line driver circuit 564, a transistor 201b and the like are provided over a substrate 111.
[0398] The transistor 251b includes a conductive layer 221 serving as a gate electrode, an insulating layer 211 serving as a gate insulating layer, a semiconductor layer 231, and conductive layers 222a and 222b serving as a source electrode and a drain electrode. The insulating layer 216 serves as a base film.
[0399] The transistor 251 b includes low temperature polysilicon (LTPS) in the semiconductor layer 231 .
[0400] The light emitting element 170 includes a pixel electrode 171, an EL layer 172, and a common electrode 173. The light emitting element 170 emits light toward the substrate 111 side. The pixel electrode 171 is electrically connected to the conductive layer 222b of the transistor 251b through an opening formed in the insulating layer 215. The EL layer 172 is separately provided in the light emitting element 170. The common electrode 173 is commonly used by a plurality of light emitting elements 170.
[0401] The light emitting element 170 is sealed by an insulating layer 175. The insulating layer 175 is used as a protective layer for suppressing diffusion of impurities such as water into the light emitting element 170.
[0402] The substrate 111 and the substrate 113 are bonded together by an adhesive layer 174 .
[0403] The conductive layer 565 is electrically connected to the FPC 162 via the conductive layer 255 and the connection body 242 .
[0404] Fig. 27 This is a cross-sectional view of a transmissive liquid crystal display device that adopts a lateral electric field method.
[0405] Fig. 27 The display device shown includes a display portion 562 and a scan line driving circuit 564 .
[0406] In the display portion 562, a transistor 446c, a liquid crystal element 180, and the like are provided over a substrate 111. In the scan line driver circuit 564, a transistor 201c and the like are provided over a substrate 111.
[0407] The transistor 446 c includes a conductive layer 221 which functions as a gate electrode, an insulating layer 211 which functions as a gate insulating layer, a semiconductor layer 231 , an impurity semiconductor layer 232 , and a conductive layer 222 a and a conductive layer 222 b which function as a source electrode and a drain electrode. The transistor 446 c is covered by the insulating layer 212 .
[0408] The transistor 446 c includes amorphous silicon in the semiconductor layer 231 .
[0409] The liquid crystal element 180 is a liquid crystal element using a fringe field switching (FFS: Fringe Field Switching) mode. The liquid crystal element 180 includes a pixel electrode 181, a common electrode 182 and a liquid crystal layer 183. The orientation of the liquid crystal layer 183 can be controlled by an electric field generated between the pixel electrode 181 and the common electrode 182. The liquid crystal layer 183 is located between the orientation film 133a and the orientation film 133b. The pixel electrode 181 is electrically connected to the conductive layer 222b of the transistor 446c through an opening formed in the insulating layer 215. The common electrode 182 can have a comb-shaped top surface shape (also called a plane shape) or a top surface shape formed with a slit. In the common electrode 182, one or more openings can be formed.
[0410] An insulating layer 220 is provided between the pixel electrode 181 and the common electrode 182. The pixel electrode 181 has a portion overlapping with the common electrode 182 via the insulating layer 220. In a portion of the region where the pixel electrode 181 overlaps with the coloring layer 131, the common electrode 182 is not provided on the pixel electrode 181.
[0411] Preferably, an alignment film is provided in contact with the liquid crystal layer 183. The alignment film can control the alignment of the liquid crystal layer 183.
[0412] Light from the backlight unit 552 is emitted to the outside of the display device through the substrate 111, the pixel electrode 181, the common electrode 182, the liquid crystal layer 183, the coloring layer 131, and the substrate 113. As materials for these layers through which light from the backlight unit 552 passes, materials that transmit visible light are used.
[0413] Preferably, a protective layer 121 is provided between the coloring layer 131 or the light shielding layer 132 and the liquid crystal layer 183. The protective layer 121 can reduce diffusion of impurities contained in the coloring layer 131 and the light shielding layer 132 into the liquid crystal layer 183.
[0414] The substrate 111 and the substrate 113 are attached together using an adhesive layer 141. In a region surrounded by the substrate 111, the substrate 113, and the adhesive layer 141, a liquid crystal layer 183 is sealed.
[0415] The polarizing plate 125a and the polarizing plate 125b are arranged in such a manner that the display unit 562 of the display device is sandwiched. Light from the backlight unit 552 arranged outside the polarizing plate 125a is incident on the display device through the polarizing plate 125a. At this time, the orientation of the liquid crystal layer 183 can be controlled by the voltage applied between the pixel electrode 181 and the common electrode 182 to control the optical modulation of the light. That is, the intensity of the light emitted through the polarizing plate 125b can be controlled. In addition, because the light outside the specified wavelength region of the incident light is absorbed by the coloring layer 131. As a result, the emitted light becomes light showing red, blue or green, for example.
[0416] The conductive layer 565 is electrically connected to the FPC 162 via the conductive layer 255 and the connection body 242 .
[0417] Fig.28 This is a cross-sectional view of a transmissive liquid crystal display device having a longitudinal electric field mode.
[0418] Fig.28 The display device shown includes a display portion 562 and a scan line driving circuit 564 .
[0419] In the display portion 562, a transistor 446d, a liquid crystal element 180, and the like are provided over a substrate 111. In the scan line driver circuit 564, a transistor 201d and the like are provided over a substrate 111. Fig.28 In the display device shown, the coloring layer 131 is provided on the side of the substrate 111. Thus, the structure on the side of the substrate 113 can be simplified.
[0420] The transistor 446d includes a conductive layer 221 which functions as a gate electrode, an insulating layer 211 which functions as a gate insulating layer, a semiconductor layer 231, an impurity semiconductor layer 232, and conductive layers 222a and 222b which function as source and drain electrodes. The transistor 446d is covered by insulating layers 217 and 218.
[0421] The transistor 446d includes a metal oxide in the semiconductor layer 231 .
[0422] The liquid crystal element 180 includes a pixel electrode 181, a common electrode 182, and a liquid crystal layer 183. The liquid crystal layer 183 is located between the pixel electrode 181 and the common electrode 182. The alignment film 133a and the alignment film 133b are respectively in contact with the pixel electrode 181 and the common electrode 182. The pixel electrode 181 is electrically connected to the conductive layer 222b of the transistor 446d through an opening formed in the insulating layer 215.
[0423] Light from the backlight unit 552 is emitted to the outside of the display device through the substrate 111, the color layer 131, the pixel electrode 181, the liquid crystal layer 183, the common electrode 182, and the substrate 113. As materials for these layers through which light from the backlight unit 552 passes, materials that transmit visible light are used.
[0424] A protective layer 121 is disposed between the light shielding layer 132 and the common electrode 182 .
[0425] The substrate 111 and the substrate 113 are attached together using an adhesive layer 141. In a region surrounded by the substrate 111, the substrate 113, and the adhesive layer 141, a liquid crystal layer 183 is sealed.
[0426] The polarizing plates 125 a and 125 b are arranged so as to sandwich the display unit 562 of the display device.
[0427] The conductive layer 565 is electrically connected to the FPC 162 via the conductive layer 255 and the connection body 242 .
[0428] <3-4. Example of transistor structure> Next, use FIG. 29A to FIG. 29C , FIG. 30A to FIG. 30D as well as FIG. 31A to FIG. 31F Description and Figure 25 to Figure 28 Examples of the structures of transistors with different structures are shown.
[0429] FIG. 29A to FIG. 29C and FIG. 30A to FIG. 30D The transistors each including a metal oxide are shown in the semiconductor layer 432. Since the semiconductor layer 432 includes a metal oxide, when there is no image change or when the image change is below a certain level, the update frequency of the image signal can be extremely low, and thus power consumption can be reduced.
[0430] Each transistor is provided on the insulating surface 411. Each transistor includes a conductive layer 431 used as a gate electrode, an insulating layer 434 used as a gate insulating layer, a semiconductor layer 432, and a pair of conductive layers 433a and 433b used as a source electrode and a drain electrode. The portion of the semiconductor layer 432 overlapping with the conductive layer 431 is used as a channel formation region. The conductive layer 433a and the conductive layer 433b are in contact with the semiconductor layer 432, respectively.
[0431] Fig.29A The transistor shown includes an insulating layer 484 over a channel formation region of the semiconductor layer 432. The insulating layer 484 is used as an etching stopper in etching the conductive layer 433a and the conductive layer 433b.
[0432] Fig.29B The transistor shown has a structure in which an insulating layer 484 extends over the insulating layer 434 to cover the semiconductor layer 432. In the above structure, the conductive layer 433a and the conductive layer 433b are connected to the semiconductor layer 432 through an opening formed in the insulating layer 484.
[0433] Fig.29C The transistor shown includes an insulating layer 485 and a conductive layer 486. The insulating layer 485 is provided to cover the semiconductor layer 432, the conductive layer 433a, and the conductive layer 433b. The conductive layer 486 is provided on the insulating layer 485 and overlaps with the semiconductor layer 432.
[0434] The conductive layer 486 is located on the opposite side of the conductive layer 431 across the semiconductor layer 432. When the conductive layer 431 is used as the first gate electrode, the conductive layer 486 can be used as the second gate electrode. By supplying the same potential to the conductive layer 431 and the conductive layer 486, the on-state current of the transistor can be increased. In addition, by supplying a potential for controlling the threshold voltage to one of the conductive layer 431 and the conductive layer 486 and supplying a potential for driving to the other of the conductive layer 431 and the conductive layer 486, the threshold voltage of the transistor can be controlled.
[0435] Fig. 30A is a cross-sectional view of the transistor 200a in the channel length direction, Fig. 30B It is a cross-sectional view of the transistor 200 a in the channel width direction.
[0436] Transistor 200a is Fig.28 A modified example of the transistor 201d is shown.
[0437] The transistor 200 a is different from the transistor 201 d in the structure of the semiconductor layer 432 .
[0438] The semiconductor layer 432 of the transistor 200 a includes a semiconductor layer 432_1 on the insulating layer 434 and a semiconductor layer 432_2 on the semiconductor layer 432_1 .
[0439] The semiconductor layer 432_1 and the semiconductor layer 432_2 preferably contain the same element. Each of the semiconductor layer 432_1 and the semiconductor layer 432_2 preferably contains In, M (M is Ga, Al, Y, or Sn), and Zn.
[0440] Each of the semiconductor layer 432_1 and the semiconductor layer 432_2 preferably has a region where the atomic number ratio of In is greater than the atomic number ratio of M. For example, the atomic number ratio of In to M and Zn in each of the semiconductor layer 432_1 and the semiconductor layer 432_2 is preferably set to In:M:Zn=4:2:3 or in the vicinity thereof. Here, the phrase "nearby" includes the case where, when In is 4, M is greater than 1.5 and less than 2.5, and Zn is greater than 2 and less than 4. In addition, the atomic number ratio of In to M and Zn in each of the semiconductor layer 432_1 and the semiconductor layer 432_2 is preferably set to In:M:Zn=5:1:6 or in the vicinity thereof. By making the composition of the semiconductor layer 432_1 and the composition of the semiconductor layer 432_2 substantially the same, the semiconductor layer 432_1 and the semiconductor layer 432_2 can be formed using the same sputtering target, thereby reducing manufacturing costs. Therefore, when the same sputtering target is used, the semiconductor layer 432_1 and the semiconductor layer 432_2 can be continuously formed in the same vacuum processing chamber. This can suppress the mixing of impurities into the interface between the semiconductor layer 432_1 and the semiconductor layer 432_2.
[0441] The semiconductor layer 432_1 may include a region having lower crystallinity than the semiconductor layer 432_2. Note that the crystallinity of each of the semiconductor layer 432_1 and the semiconductor layer 432_2 can be analyzed by X-ray diffraction (XRD) or transmission electron microscope (TEM) analysis.
[0442] The low crystallinity region in the semiconductor layer 432_1 is used as a diffusion path for the peroxide, and the peroxide can diffuse to the semiconductor layer 432_2 having higher crystallinity than the semiconductor layer 432_1. In this way, by adopting a multilayer structure of semiconductor layers with different crystal structures and using the low crystallinity region as a diffusion path for the peroxide, the transistor can have high reliability.
[0443] When the semiconductor layer 432_2 has a region whose crystallinity is higher than that of the semiconductor layer 432_1, impurities can be suppressed from being mixed into the semiconductor layer 432. In particular, by improving the crystallinity of the semiconductor layer 432_2, damage when processing the conductive layer 433a and the conductive layer 433b can be reduced. The surface of the semiconductor layer 432, that is, the surface of the semiconductor layer 432_2 is exposed to the etchant or etching gas when processing the conductive layer 433a and the conductive layer 433b. However, in the case where the semiconductor layer 432_2 has a region with high crystallinity, its etching resistance is higher than that of the semiconductor layer 432_1. Therefore, the semiconductor layer 432_2 is used as an etching stop layer.
[0444] When the semiconductor layer 432_1 has a region having lower crystallinity than the semiconductor layer 432_2 , the carrier density of the semiconductor layer 432_1 may increase.
[0445] When the carrier density of the semiconductor layer 432_1 is high, the Fermi level may become higher relative to the conduction band of the semiconductor layer 432_1. As a result, the conduction band bottom of the semiconductor layer 432_1 may become lower, so that the energy difference between the conduction band bottom of the semiconductor layer 432_1 and the trap energy level that may be formed in the gate insulating layer (here, the insulating layer 434) becomes larger. When this energy difference becomes larger, the charge trapped in the gate insulating layer may be reduced, and the variation of the threshold voltage of the transistor may be reduced. In addition, when the carrier density of the semiconductor layer 432_1 is high, the field effect mobility of the semiconductor layer 432 may be increased.
[0446] Although the semiconductor layer 432 in the transistor 200 a has a multilayer structure including two layers in the above example, the structure of the semiconductor layer 432 is not limited thereto, and the semiconductor layer 432 may also have a multilayer structure including three or more layers.
[0447] In addition, the structure of the insulating layer 436 provided over the conductive layer 433a and the conductive layer 433b is described.
[0448] The insulating layer 436 of the transistor 200a includes an insulating layer 436a and an insulating layer 436b on the insulating layer 436a. The insulating layer 436a has the function of supplying oxygen to the semiconductor layer 432 and the function of suppressing impurities (typically water, hydrogen, etc.) from mixing into the semiconductor layer 432. As the insulating layer 436a, an aluminum oxide film, an aluminum oxynitride film, or an aluminum nitride oxide film can be used. In particular, the insulating layer 436a is preferably an aluminum oxide film formed by a reactive sputtering method. As an example of a method for forming an aluminum oxide film by a reactive sputtering method, the following method can be cited.
[0449] First, a mixed gas of an inert gas (typically Ar gas) and an oxygen gas is introduced into a sputtering chamber. Next, a voltage is applied to an aluminum target disposed in the sputtering chamber, thereby depositing and forming an aluminum oxide film. The power for applying the voltage to the aluminum target can be supplied from a DC power supply, an AC power supply, or an RF power supply. In particular, the use of a DC power supply is preferred because productivity is improved.
[0450] The insulating layer 436b has a function of suppressing the mixing of impurities (typically water, hydrogen, etc.). As the insulating layer 436b, a silicon nitride film, a silicon nitride oxide film, or a silicon oxynitride film can be used. In particular, as the insulating layer 436b, a silicon nitride film formed by a PECVD method is preferably used. A silicon nitride film formed by a PECVD method is preferred because it is easy to achieve a high film density. Note that the hydrogen concentration of a silicon nitride film formed by a PECVD method is sometimes high.
[0451] In the transistor 200 a , the insulating layer 436 a is provided under the insulating layer 436 b , and thus hydrogen in the insulating layer 436 b does not diffuse or is unlikely to diffuse to the semiconductor layer 432 side.
[0452] The transistor 200a is a single-gate transistor. By using a single-gate transistor, the number of masks can be reduced, so that productivity can be improved.
[0453] Fig. 30C is a cross-sectional view of the transistor 200b in the channel length direction, Fig.30D It is a cross-sectional view of the transistor 200 b in the channel width direction.
[0454] Transistor 200b is Fig.29B A modified example of the transistor shown.
[0455] The structure of the transistor 200b is similar to that of the semiconductor layer 432 and the insulating layer 484. Fig.29B Specifically, the transistor 200b includes a semiconductor layer 432 having a two-layer structure, and the transistor 200b includes an insulating layer 484a instead of the insulating layer 484. The transistor 200b also includes an insulating layer 436b and a conductive layer 486.
[0456] The insulating layer 484a has the same function as that of the above-described insulating layer 436a.
[0457] The opening 453 is formed in the insulating layer 434 , the insulating layer 484 a , and the insulating layer 436 b . The conductive layer 486 is electrically connected to the conductive layer 431 in the opening 453 .
[0458] The structures of the transistor 200a and the transistor 200b can be manufactured using existing production lines without requiring large-scale equipment investment. For example, a hydrogenated amorphous silicon manufacturing plant can be simply replaced with an oxide semiconductor manufacturing plant.
[0459] FIG. 31A to FIG. 31F Transistors each including silicon in semiconductor layer 432 are shown.
[0460] Each transistor is provided on the insulating surface 411. Each transistor includes a conductive layer 431 used as a gate electrode, an insulating layer 434 used as a gate insulating layer, one or both of the semiconductor layer 432 and the semiconductor layer 432p, a pair of conductive layers 433a and 433b used as a source electrode and a drain electrode, and an impurity semiconductor layer 435. A portion of the semiconductor layer overlapping with the conductive layer 431 is used as a channel formation region. The semiconductor layer is in contact with the conductive layer 433a or the conductive layer 433b.
[0461] Fig.31A The transistor shown is a channel-etched bottom-gate transistor. An impurity semiconductor layer 435 is provided between the semiconductor layer 432 and the conductive layer 433a or the conductive layer 433b.
[0462] Fig.31A The transistor shown includes a semiconductor layer 437 between the semiconductor layer 432 and the impurity semiconductor layer 435 .
[0463] The semiconductor layer 437 may be formed using the same semiconductor film as the semiconductor layer 432. The semiconductor layer 437 may be used as an etching stopper for preventing the semiconductor layer 432 from disappearing when the impurity semiconductor layer 435 is etched. Fig.31A Although an example in which the semiconductor layer 437 is divided into the left side and the right side is shown, the semiconductor layer 437 may partially cover the channel formation region of the semiconductor layer 432 .
[0464] The semiconductor layer 437 may include an impurity at a concentration lower than that of the impurity semiconductor layer 435. In this case, the semiconductor layer 437 can be used as a lightly doped drain (LDD) region, and hot carrier degradation when the transistor is driven can be suppressed.
[0465] Fig.31BThe transistor shown includes an insulating layer 484 over a channel formation region of the semiconductor layer 432. The insulating layer 484 functions as an etching stopper when the impurity semiconductor layer 435 is etched.
[0466] Fig. 31C The transistor shown includes a semiconductor layer 432p instead of the semiconductor layer 432. The semiconductor layer 432p includes a highly crystalline semiconductor film. For example, the semiconductor layer 432p includes a polycrystalline semiconductor or a single crystal semiconductor. By adopting the above structure, a transistor with high field effect mobility can be formed.
[0467] Fig.31D The transistor shown in the figure includes a semiconductor layer 432p in a channel formation region of the semiconductor layer 432. For example, a semiconductor film to be the semiconductor layer 432 is irradiated with laser light or the like to partially crystallize the semiconductor film, thereby forming a Fig.31D The transistor shown in FIG. 1 can thus obtain a transistor with high field effect mobility.
[0468] Fig.31E The transistor shown in Fig.31A The semiconductor layer 432 shown includes a crystalline semiconductor layer 432 p in a channel formation region.
[0469] Fig.31F The transistor shown in Fig.31B The semiconductor layer 432 shown includes a crystalline semiconductor layer 432 p in a channel formation region.
[0470] [Semiconductor layer] There is no particular limitation on the crystallinity of the semiconductor material used for the transistor disclosed in one embodiment of the present invention, and an amorphous semiconductor or a crystalline semiconductor (a microcrystalline semiconductor, a polycrystalline semiconductor, a single crystal semiconductor, or a semiconductor having a crystalline region in part thereof) can be used. When a crystalline semiconductor is used, it is preferred because it can suppress the degradation of the characteristics of the transistor.
[0471] As a semiconductor material for transistors, metal oxides having an energy gap of 2 eV or more, preferably 2.5 eV or more, and more preferably 3 eV or more can be used. Typical examples thereof include metal oxides containing indium, and for example, CAC-OS described later can be used.
[0472] In addition, a transistor using a metal oxide having a wider band gap and a smaller carrier density than silicon can retain the charge stored in a capacitor connected in series with the transistor for a long period of time because of its small off-state current.
[0473] The semiconductor layer may be, for example, a film represented by an In-M-Zn-based oxide containing indium, zinc, and M (a metal such as aluminum, titanium, gallium, germanium, yttrium, zirconium, lanthanum, cerium, tin, neodymium, or hafnium).
[0474] When the metal oxide included in the semiconductor layer includes an In-M-Zn-based oxide, the atomic number ratio of the metal element of the sputtering target used to form the In-M-Zn oxide film preferably satisfies In≥M and Zn≥M. The atomic number ratio of the metal element of such a sputtering target is preferably, for example, In:M:Zn=1:1:1, In:M:Zn=1:1:1.2, In:M:Zn=3:1:2, In:M:Zn=4:2:3, In:M:Zn=4:2:4.1, In:M:Zn=5:1:6, In:M:Zn=5:1:7, In:M:Zn=5:1:8. Note that the atomic number ratio of the metal element in the formed semiconductor layer varies within the range of ±40% of the atomic number ratio of the metal element in the above-mentioned sputtering target.
[0475] For details of metal oxides suitable for the semiconductor layer, refer to Embodiment 4.
[0476] As a semiconductor material for transistors, for example, silicon can be used. In particular, amorphous silicon is preferably used. By using amorphous silicon, transistors can be formed with high yield on a large substrate, and productivity can be improved.
[0477] In addition, crystalline silicon such as microcrystalline silicon, polycrystalline silicon, and single crystal silicon may be used. In particular, polycrystalline silicon can be formed at a lower temperature than single crystal silicon, and has higher field effect mobility and reliability than amorphous silicon.
[0478] <3-5. Configuration Example 2 of Display Device> Next, refer to Fig.32A and Fig.32B , Fig.33A and Fig.33B as well as Fig.34A and Fig.34B illustrate Fig.13A An example of the structure of the display panel DP is shown. Fig.35 is a cross-sectional view of a display device including two display panels overlapping each other.
[0479] Fig.32A is a top view of the display panel 370 .
[0480] Fig.32A The display panel 370 shown includes a pixel portion 71, a region 72 that transmits visible light, and a drive circuit portion 78. Fig.32A In the illustrated example, the region 72 that transmits visible light is adjacent to the pixel portion 71 and is arranged along two sides of the pixel portion 71 .
[0481] Fig.32B 370A is a cross-sectional view of a display panel 370A that adopts a separate coating method and has a top emission structure. Fig.32B Equivalent to following Fig.32A A cross-sectional view along the dotted line A1-A2 and the dotted line A3-A4.
[0482] The display panel 370A includes a substrate 361, an adhesive layer 363, an insulating layer 365, an insulating layer 367, multiple transistors, a capacitor 305, a conductive layer 307, an insulating layer 312, an insulating layer 313, an insulating layer 314, an insulating layer 315, a light-emitting element 304, a conductive layer 355, a spacer 316, an adhesive layer 317, a substrate 371, an adhesive layer 373, an insulating layer 375 and an insulating layer 377.
[0483] Each layer included in the visible light transmitting region 72 transmits visible light. Fig.32B The example in which the region 72 for transmitting visible light includes a substrate 361, an adhesive layer 363, an insulating layer 365, an insulating layer 367, a gate insulating layer 311, an insulating layer 312, an insulating layer 313, an insulating layer 314, an adhesive layer 317, an insulating layer 377, an insulating layer 375, an adhesive layer 373, and a substrate 371 is shown. In this laminated structure, it is preferable to select the materials of each layer so that the difference in refractive index of each interface is small. By reducing the difference in refractive index of two layers in contact with each other, the user is less likely to see the seam between the two display panels.
[0484] In addition, if Fig.33A The display panel 370B and Fig.33B The display panel 370C shown preferably has a structure in which the number of insulating layers included in the region 72 that transmits visible light is smaller than the number of insulating layers included in the pixel portion 71 .
[0485] The display panel 370B is different from the display panel 370A in that the region 72 that transmits visible light does not include the insulating layer 313 and the insulating layer 314 .
[0486] The display panel 370C is different from the display panel 370A in that the region 72 that transmits visible light does not include the insulating layer 367 , the gate insulating layer 311 , the insulating layer 312 , the insulating layer 313 , the insulating layer 314 , and the insulating layer 377 .
[0487] By reducing the number of insulating layers included in the region 72 through which visible light is transmitted, the number of interfaces with a large difference in refractive index can be reduced. Thus, the reflection of external light in the region 72 through which visible light is transmitted can be suppressed. At this time, the transmittance of visible light in the region 72 through which visible light is transmitted can be increased. Thus, the difference in brightness (brightness) between the portion of the display of the display panel arranged on the lower side that is seen through the region 72 through which visible light is transmitted and the portion that is seen without passing through the region can be reduced. Therefore, the display unevenness or brightness unevenness of the display device can be suppressed.
[0488] The display panels 370A, 370B, and 370C have the same structure except for the region 72 that transmits visible light.
[0489] The driver circuit portion 78 includes a transistor 301 . The pixel portion 71 includes a transistor 302 and a transistor 303 .
[0490] Each transistor includes a gate, a gate insulating layer 311, a semiconductor layer, a back gate, a source and a drain. The gate (the gate on the lower side) and the semiconductor layer overlap each other through the gate insulating layer 311. A portion of the gate insulating layer 311 is used as a dielectric of the capacitor 305. The conductive layer used as the source or drain of the transistor 302 is used as one electrode of the capacitor 305. The back gate (the gate on the upper side) overlaps with the semiconductor layer through the insulating layer 312 and the insulating layer 313.
[0491] The structures of transistors in the driver circuit section 78 and the pixel section 71 are different from each other. The driver circuit section 78 and the pixel section 71 may include transistors of multiple types.
[0492] Each of the transistors 301, 302, and 303 includes two gates, a gate insulating layer 311, a semiconductor layer, a source, and a drain. The two gates are preferably electrically connected to each other.
[0493] The capacitor 305 includes a pair of electrodes and a dielectric therebetween. The capacitor 305 includes a conductive layer formed using the same material and process as the gate (lower gate) of the transistor and a conductive layer formed using the same material and process as the source and drain of the transistor.
[0494] It is preferred that at least one of the insulating layer 312, the insulating layer 313, and the insulating layer 314 be made of a material in which impurities such as water or hydrogen are not easily diffused. This can effectively suppress the diffusion of impurities from the outside into the transistor, thereby improving the reliability of the display panel. The insulating layer 314 is used as a planarization layer. Fig.32B In the example of FIG. 3 , the insulating layer 314 is formed of an organic material and is arranged across the entire display panel. This structure is preferred because it can improve the yield of the stripping process. Fig.33A and Fig.33B As shown in FIG. 1 , an insulating layer formed of an organic material may be not located at the end of the display panel. By adopting the above structure, it is possible to suppress the entry of impurities into the light emitting element 304.
[0495] The insulating layer 365 and the substrate 361 are attached together using the adhesive layer 363. Furthermore, the insulating layer 375 and the substrate 371 are attached together using the adhesive layer 373.
[0496] In the pixel portion 71, the light-emitting element 304 is located between the insulating layer 367 and the insulating layer 377. Impurities can be prevented from entering the light-emitting element 304 in the thickness direction of the display panel 370. Similarly, in the pixel portion 71, a plurality of insulating layers covering transistors are provided, thereby preventing impurities from entering the transistors.
[0497] By arranging the light-emitting element 304 and the transistor between a pair of highly moisture-proof insulating films, it is possible to suppress the entry of impurities such as water into these elements, thereby improving the reliability of the display panel, which is preferred.
[0498] Examples of highly moisture-proof insulating films include films containing nitrogen and silicon (e.g., silicon nitride films, silicon nitride oxide films) and films containing nitrogen and aluminum (e.g., aluminum nitride films). In addition, silicon oxide films, silicon oxynitride films, and aluminum oxide films may also be used.
[0499] For example, the water vapor permeability of a highly moisture-proof insulating film is 1×10 -5 [g / (m 2 ·day)] or less, preferably 1×10 -6 [g / (m 2 ·day)] or less, more preferably 1×10 -7 [g / (m 2 ·day)] or less, more preferably 1×10 -8 [g / (m 2 ·day)] or less.
[0500] The light-emitting element 304 includes an electrode 321, an EL layer 322, and an electrode 323. The light-emitting element 304 may also include an optical adjustment layer 324. The light-emitting element 304 emits light toward the substrate 371 side.
[0501] By arranging transistors, capacitors, wirings, and the like so as to overlap with the light-emitting region of the light-emitting element 304 , the aperture ratio of the pixel portion 71 can be increased.
[0502] The electrode 321 is electrically connected to the source or drain of the transistor 303 directly or through another conductive layer. The electrode 321 is used as a pixel electrode and is provided in each light emitting element 304. Two adjacent electrodes 321 are electrically insulated by an insulating layer 315.
[0503] The EL layer 322 is a layer containing a light-emitting material. As the light-emitting element 304, an organic EL element using an organic compound as a light-emitting material can be appropriately used.
[0504] The EL layer 322 includes at least a light-emitting layer.
[0505] The electrode 323 is used as a common electrode and is provided in the plurality of light emitting elements 304. A constant potential is supplied to the electrode 323.
[0506] The connection portion 306 includes a conductive layer 307 and a conductive layer 355. The conductive layer 307 and the conductive layer 355 are electrically connected to each other. The conductive layer 307 can be formed using the same material and the same process as the source and drain of the transistor. The conductive layer 355 is electrically connected to an external input terminal that transmits a signal or potential from the outside to the drive circuit portion 78. Here, an example in which an FPC 74 is provided as an external input terminal is shown. The FPC 74 and the conductive layer 355 are electrically connected through a connector 319.
[0507] A flexible substrate is preferably used as each of the substrate 361 and the substrate 371. For example, a material such as glass, quartz, resin, metal, alloy, or semiconductor having a thickness that allows flexibility can be used. The substrate on the side where light from the light-emitting element is extracted is formed using a material that transmits the light.
[0508] As the adhesive layer, various curing adhesives such as photocuring adhesives (for example, ultraviolet curing adhesives), reaction curing adhesives, heat curing adhesives, and anaerobic adhesives can be used. In addition, an adhesive sheet or the like can also be used.
[0509] In addition, if Fig.34A The display panel 370D and Fig.34B In the display panel 370E shown, the insulating layer 375 may also be provided in contact with the light emitting element 304. Fig.34A , Fig.34B In the embodiment, substrate 371 is bonded by adhesive layer 317 but not by adhesive layer 373.
[0510] In the manufacturing method of the display panels 370B and 370C, the insulating layer 375 formed on the formation substrate is transferred to the substrate 361. On the other hand, in the manufacturing method of the display panels 370D and 370E, the insulating layer 375 is directly formed on the light emitting element 304. Therefore, the peeling step is not required, and the manufacturing process of the display panel can be simplified.
[0511] Fig.35 consists of two overlapping Fig.33B The display panel 370C shown is an example of a cross-sectional view of a display device.
[0512] Fig.35 The pixel portion 71 a of the lower display panel and a region (such as the drive circuit portion 78 ) that blocks visible light, and the pixel portion 71 b of the upper display panel and a region 72 b that transmits visible light are shown.
[0513] exist Fig.35 In the display device shown, the display panel located on one side (upper side) of the display surface includes an area 72b that allows visible light to pass, adjacent to the pixel portion 71b. The pixel portion 71a of the lower display panel and the area 72b that allows visible light to pass overlap with each other. Therefore, the non-display area between the display areas of the two overlapping display panels can be reduced or even eliminated. As a result, a large display device can be obtained in which the seam of the display panel is not easily visible to the user.
[0514] Fig.35 The display device shown includes a light-transmitting layer 389 having a refractive index higher than that of air and allowing visible light to pass between the pixel portion 71a and the region 72b allowing visible light to pass. In this case, air can be prevented from entering between the pixel portion 71a and the region 72b allowing visible light to pass, and interface reflection caused by the difference in refractive index can be reduced. Furthermore, uneven display or uneven brightness in the display device can be suppressed.
[0515] The light-transmitting layer 389 may overlap the entire surface of the substrate 371 of the lower display panel or the entire surface of the substrate 361 of the upper display panel, or may overlap only the pixel portion 71a and the region 72b that allows visible light to pass. In addition, the light-transmitting layer 389 may overlap the driving circuit portion 78.
[0516] In order to improve the light extraction efficiency of the display device, it is preferable to increase the transmittance of visible light in the light-transmitting layer 389. In the light-transmitting layer 389, the average transmittance of light in the wavelength range of 400 nm to 700 nm is preferably 80% or more, more preferably 90% or more.
[0517] The smaller the difference in refractive index between the light-transmitting layer 389 and the layer in contact with the light-transmitting layer 389, the more light reflection can be suppressed, so it is preferred. For example, the refractive index of the light-transmitting layer 389 is higher than the refractive index of air, preferably 1.3 or more and 1.8 or less. The difference in refractive index between the light-transmitting layer 389 and the layer in contact with the light-transmitting layer 389 (for example, included in the substrate of the display panel) is preferably 0.30 or less, more preferably 0.20 or less, and further preferably 0.15 or less.
[0518] The light-transmitting layer 389 may also be detachably contacted with at least one of the lower display panel and the upper display panel. When the display panels included in the display device are detachably connected, for example, when one display panel is defective, only the display panel with the defective display may be replaced with a new display panel. By continuing to use other display panels, a display device with a long service life and low cost may be realized. As the light-transmitting layer 389, for example, a thin film (such as an adsorption film) having adsorption properties to the display panel may be used.
[0519] Alternatively, the display panels may be fixed to each other using an adhesive or the like as the light-transmitting layer 389 .
[0520] The light-transmitting layer preferably has no adhesiveness or has low adhesiveness. In this case, the light-transmitting layer can be repeatedly adsorbed to and peeled off from the object without damaging or soiling the surface of the object.
[0521] Furthermore, the display device preferably includes an optical member on the display surface side. Fig.35 An example is shown in which a circular polarizer (1 / 4λ plate 381, linear polarizer 383), a support 385, and an anti-reflection member 387 are provided from the display panel side. The 1 / 4λ plate 381 is provided overlapping the linear polarizer 383 so as to have an axis inclined 45° with respect to the axis of the linear polarizer 383. The optical member is preferably fixed to a housing or the like in a state of close contact with the display panel.
[0522] In addition, each display panel of the display device according to one embodiment of the present invention may include a power supply unit and a source driver.
[0523] Alternatively, the display device of one embodiment of the present invention may also adopt a structure in which only a part of the display panels are directly connected to the power supply unit and the source driver, and the other display panels are electrically connected to the power supply unit and the source driver through other display panels. As a result, the structure of the back of the display device can be simplified, thereby achieving lightweight and miniaturization of the display device. FIG. 36A to FIG. 36C Describe such a structure.
[0524] Fig.36A The display surface side (front side) of the display panel 370F is shown. Fig.36B The side opposite to the display surface (the back side) of the display panel 370F is shown.
[0525] The display panel 370F includes a pixel portion 71, a region 72 that transmits visible light, a drive circuit portion 78, a terminal 75, and a terminal 76. The terminal 75 is exposed on the display surface side of the display panel 370F, and the terminal 76 is exposed on the back side of the display panel 370F.
[0526] Fig.36CFIG. 3 is a cross-sectional view of a display device in which two display panels 370F overlap each other.
[0527] The terminal 75a of the upper display panel is electrically connected to the power supply unit 77. The terminal 75a can be electrically connected to a source driver or the like in addition to the power supply unit. The terminal 76a of the upper display panel is electrically connected to the terminal 75b of the lower display panel. By adopting the above structure, the lower display panel can also be electrically connected to the power supply unit 77 through the upper display panel.
[0528] This embodiment mode can be combined with any other embodiment mode as appropriate.
[0529] (Implementation 4) This embodiment describes a metal oxide that can be used for a semiconductor layer of a transistor disclosed in one embodiment of the present invention. Note that when a metal oxide is used for a semiconductor layer of a transistor, the metal oxide can also be referred to as an oxide semiconductor.
[0530] The oxide semiconductor layer is classified into a single crystal oxide semiconductor and a non-single crystal oxide semiconductor. Non-single crystal oxide semiconductors include c-axis-aligned crystalline oxide semiconductor (CAAC-OS), polycrystalline oxide semiconductor, nanocrystalline oxide semiconductor (nc-OS), amorphous-like oxide semiconductor (a-like OS), and amorphous oxide semiconductor.
[0531] In addition, a Cloud-Aligned Composite Oxide Semiconductor (CAC-OS) can be used as a semiconductor layer of a transistor disclosed as one embodiment of the present invention.
[0532] In addition, the semiconductor layer of the transistor disclosed in one embodiment of the present invention can use the above-mentioned non-single-crystal oxide semiconductor or CAC-OS as appropriate. In addition, as the amorphous oxide semiconductor, nc-OS or CAAC-OS can be used as appropriate.
[0533] In one embodiment of the present invention, CAC-OS is preferably used in the semiconductor layer of the transistor. By using CAC-OS, high electrical characteristics and high reliability can be imparted to the transistor.
[0534] The following describes the details of CAC-OS.
[0535] CAC-OS or CAC-metal oxide has a conductive function in a part of the material and an insulating function in another part of the material. As a whole, CAC-OS or CAC-metal oxide has a semiconductor function. When CAC-OS or CAC-metal oxide is used in the channel formation region of a transistor, the conductive function is to allow electrons (or holes) used as carriers to flow through, and the insulating function is to prevent electrons used as carriers from flowing through. Through the complementary effects of the conductive function and the insulating function, CAC-OS or CAC-metal oxide can have a switching function (on / off function). By separating each function in CAC-OS or CAC-metal oxide, each function can be maximized.
[0536] In addition, CAC-OS or CAC-metal oxide includes a conductive region and an insulating region. The conductive region has the function of the above-mentioned conductivity, and the insulating region has the function of the above-mentioned insulation. In addition, in the material, the conductive region and the insulating region are sometimes separated at a nanoparticle level. Sometimes, the conductive region and the insulating region are sometimes unevenly distributed in the material. In addition, sometimes the conductive region whose edges are blurred and connected in a cloud shape is observed.
[0537] In CAC-OS or CAC-metal oxide, the conductive region and the insulating region may be dispersed in the material with a size of 0.5 nm to 10 nm, preferably 0.5 nm to 3 nm.
[0538] In addition, CAC-OS or CAC-metal oxide includes components with different band gaps. For example, CAC-OS or CAC-metal oxide includes a component with a wide gap caused by an insulating region and a component with a narrow gap caused by a conductive region. When this structure is adopted, carriers mainly flow through the component with a narrow gap. In addition, the component with a narrow gap interacts with the component with a narrow gap through a complementary effect with the component with a wide gap, so that carriers flow through the component with a wide gap. Therefore, when the above-mentioned CAC-OS or CAC-metal oxide is used in the channel formation region of a transistor, a high current driving force, that is, a large on-state current and a high field effect mobility can be obtained in the on-state of the transistor.
[0539] That is, CAC-OS or CAC-metal oxide may also be referred to as a matrix composite material (matrix composite) or a metal matrix composite material (metal matrix composite).
[0540] CAC-OS has, for example, a structure in which the elements contained in the oxide semiconductor are unevenly distributed. The size of the unevenly distributed elements is greater than or equal to 0.5 nm and less than or equal to 10 nm, preferably greater than or equal to 1 nm and less than or equal to 2 nm. Note that in the following description of metal oxides, a state in which one or more metal elements are unevenly distributed and regions containing the metal elements are mixed is also referred to as a mosaic or patch shape. The size of each of the regions is greater than or equal to 0.5 nm and less than or equal to 10 nm, preferably greater than or equal to 1 nm and less than or equal to 2 nm.
[0541] Note that the metal oxide preferably contains at least indium. In particular, it is preferred to contain indium and zinc. In addition, it may also contain one or more selected from aluminum, gallium, yttrium, copper, vanadium, beryllium, boron, silicon, titanium, iron, nickel, germanium, zirconium, molybdenum, lanthanum, cerium, neodymium, hafnium, tantalum, tungsten, and magnesium.
[0542] For example, regarding CAC-OS, In-Ga-Zn oxide having a CAC structure (in CAC-OS, In-Ga-Zn oxide may be referred to as CAC-IGZO in particular) has a material structure of indium oxide (InO X1 , X1 is a real number greater than 0) or indium zinc oxide (In X2 Zn Y2 O Z2 , X2, Y2 and Z2 are real numbers greater than 0) and gallium oxide (GaO X3 , X3 is a real number greater than 0) or gallium zinc oxide (Ga X4 Zn Y4 O Z4 , X4, Y4 and Z4 are real numbers greater than 0) to form a mosaic shape. Then, a mosaic-shaped InO X1 or In X2 Zn Y2 O Z2 Evenly distributed in the film. This structure is also called cloud-like structure.
[0543] In other words, CAC-OS is a material containing GaO X3 As the main component of the region and contains In X2 Zn Y2 O Z2 or InO X1 In the present specification, for example, when the atomic number ratio of In to element M in the first region is greater than the atomic number ratio of In to element M in the second region, the In concentration in the first region is higher than that in the second region.
[0544] Note that compounds containing In, Ga, Zn, and O are also considered IGZO. As a typical example of IGZO, InGaO3(ZnO) m1 (m1 is a natural number) represented by a crystalline compound or In (1+x0) Ga (1-x0) O3(ZnO) m0 (-1≤x0≤1, m0 is an arbitrary number).
[0545] The crystalline compound has a single crystal structure, a polycrystalline structure, or a c-axis aligned crystalline (CAAC) structure. Note that the CAAC structure is a crystal structure in which a plurality of IGZO nanocrystals have c-axis alignment and are connected in a non-oriented manner on the ab plane.
[0546] On the other hand, CAC-OS is related to the material composition of metal oxides. CAC-OS refers to a region where nanoparticles with Ga as the main component are partially observed in a material composition containing In, Ga, Zn, and O, and a region where nanoparticles with In as the main component are partially observed. The region of the nanoparticles is irregularly dispersed to form a mosaic shape. Therefore, in CAC-OS, the crystal structure is a secondary factor.
[0547] Note that CAC-OS does not include a stacked-layer structure of two or more films having different compositions, for example, does not include a structure consisting of two layers of a film having In as a main component and a film having Ga as a main component.
[0548] Note that sometimes no GaO is observed X3 As the main component of the region and containing In X2 Zn Y2 O Z2 or InO X1 As clear boundaries between the regions of the main components.
[0549] When one or more of aluminum, yttrium, copper, vanadium, beryllium, boron, silicon, titanium, iron, nickel, germanium, zirconium, molybdenum, lanthanum, cerium, neodymium, hafnium, tantalum, tungsten and magnesium are included in CAC-OS instead of gallium, nanoparticle-like regions having the metal element as the main component are observed in a part of the CAC-OS and nanoparticle-like regions having In as the main component are observed in a part of the CAC-OS, and these nanoparticle regions are irregularly dispersed to form a mosaic shape in the CAC-OS.
[0550] CAC-OS can be formed, for example, by sputtering without intentionally heating the substrate. When CAC-OS is formed by sputtering, one or more selected from an inert gas (typically argon), an oxygen gas, and a nitrogen gas can be used as a film-forming gas. In addition, the lower the flow rate ratio of the oxygen gas in the total flow rate of the film-forming gas during film formation, the better. For example, the flow rate ratio of the oxygen gas is preferably greater than 0% and less than 30%, and more preferably greater than 0% and less than 10%.
[0551] CAC-OS has the following characteristics: when measuring by the Out-of-plane method using θ / 2θ scanning, which is one of the X-ray diffraction (XRD) measurement methods, no clear peak is observed. In other words, according to X-ray diffraction, it can be seen that there is no orientation in the ab plane direction and the c-axis direction in the measurement area.
[0552] In addition, in the electron diffraction pattern of CAC-OS obtained by irradiating an electron beam with a beam diameter of 1 nm (also called a nano-sized electron beam), a ring-shaped area with high brightness and multiple bright spots in the ring-shaped area were observed. Therefore, according to the electron diffraction pattern, it can be seen that the crystal structure of CAC-OS has a nanocrystalline (nc) structure that is not oriented in the plane direction and the cross-sectional direction.
[0553] For example, based on an EDX surface analysis image (EDX-mapping) obtained by energy dispersive X-ray spectroscopy (EDX), it can be confirmed that the In-Ga-Zn oxide of the CAC structure has GaO X3 As the main component of the region and containing In X2 Zn Y2 O Z2 or InO X1 A structure in which the regions of the main components are unevenly distributed and mixed.
[0554] CAC-OS has a different structure from the IGZO compound in which the metal elements are uniformly distributed, and has different properties from the IGZO compound. In other words, in CAC-OS, there is a X3 As the main component of the region and containing In X2 Zn Y2 O Z2 or InO X1 The regions that are the main components are separated from each other to form a mosaic shape.
[0555] In X2 Zn Y2 O Z2 or InOX1 The conductivity of the region containing GaO as the main component is higher than that of X3 In other words, when the carrier flows through the region containing In X2 Zn Y2 O Z2 or InO X1 When the region contains In as the main component, it exhibits the conductivity of an oxide semiconductor. X2 Zn Y2 O Z2 or InO X1 When the region as the main component is distributed in a cloud shape in the oxide semiconductor, high field effect mobility (μ) can be achieved.
[0556] In contrast, GaO X3 The insulation of the region containing In is higher than that of the region containing X2 Zn Y2 O Z2 or InO X1 In other words, when GaO is contained X3 When the region as the main component is distributed in the oxide semiconductor, leakage current can be suppressed and good switching operation can be achieved.
[0557] Therefore, when CAC-OS is used in semiconductor devices, the X3 The insulation properties of etc. and the causes of In X2 Zn Y2 O Z2 or InO X1 The complementary effect of conductivity can achieve high on-state current (I on ) and high field effect mobility (μ).
[0558] In addition, a semiconductor element including CAC-OS has high reliability. Therefore, CAC-OS is suitable for use in various semiconductor devices.
[0559] This embodiment mode can be combined with any other embodiment mode as appropriate.
[0560] (Implementation 5) In this embodiment, refer to FIG. 37A to FIG. 37D as well as Fig.38A and Fig.38B An electronic device according to an embodiment of the present invention will be described.
[0561] The electronic device of this embodiment includes the display system of one embodiment of the present invention. Thus, the display unit of the electronic device can display high-quality images.
[0562] The display unit of the electronic device of this embodiment can display images with full HD, 2K, 4K, 8K, 16K or higher resolutions, for example. In addition, as the screen size of the display unit, the diagonal size can be more than 20 inches, more than 30 inches, more than 50 inches, more than 60 inches or more than 70 inches.
[0563] Examples of electronic devices include television sets, desktop or notebook personal computers, displays for computers, etc., digital signage, large-scale game consoles (pinball machines, etc.) and other electronic devices with relatively large screens; cameras such as digital cameras and digital video cameras; digital photo frames; mobile phones; portable game consoles; portable information terminals; and sound reproduction devices.
[0564] The electronic device according to one embodiment of the present invention may also include an antenna. By receiving a signal through the antenna, the electronic device can display an image or information on a display unit. When the electronic device includes an antenna and a secondary battery, the antenna can be used for contactless power transmission.
[0565] An electronic device of one embodiment of the present invention may also include a sensor (the sensor has the function of measuring the following factors: force, displacement, position, speed, acceleration, angular velocity, rotation speed, distance, light, liquid, magnetism, temperature, chemical substance, sound, time, hardness, electric field, current, voltage, electricity, radiation, flow, humidity, inclination, vibration, smell or infrared).
[0566] An electronic device of one embodiment of the present invention may have various functions, such as a function of displaying various information (static images, dynamic images, text images, etc.) on a display unit; a function of a touch panel; a function of displaying a calendar, date or time, etc.; a function of executing various software (programs); a function of conducting wireless communications; a function of reading programs or data stored in a storage medium; etc.
[0567] Fig.37A An example of a television set is shown. In a television set 7100 , a display portion 7000 is incorporated in a housing 7101 . Here, the housing 7101 is supported by a stand 7103 .
[0568] The display device according to one embodiment of the present invention can be applied to the display portion 7000 .
[0569] The operation switch provided in the housing 7101 or the remote control operation machine 7111 provided separately can be used to control the Fig.37AThe television set 7100 shown in the figure can be operated. In addition, the display unit 7000 can also include a touch sensor. The television set 7100 can be operated by touching the display unit 7000 with a finger or the like. In addition, the remote control unit 7111 can also include a display unit for displaying data output from the remote control unit 7111. By using the operation keys or the touch screen of the remote control unit 7111, the channel and volume can be operated, and the image displayed on the display unit 7000 can be operated.
[0570] In addition, the television device 7100 has a receiver and a modem, etc. General television broadcasts can be received by using the receiver. Furthermore, when the television device is connected to a wired or wireless communication network via a modem, one-way (from a sender to a receiver) or two-way (between a sender and a receiver or between receivers, etc.) information communication can be performed.
[0571] Fig.37B The notebook personal computer 7200 includes a housing 7211 , a keyboard 7212 , a pointing device 7213 , an external connection port 7214 , and the like. A display portion 7000 is incorporated in the housing 7211 .
[0572] The display device according to one embodiment of the present invention can be applied to the display portion 7000 .
[0573] Fig.37C , Fig.37D An example of digital signage is shown.
[0574] Fig.37C The digital signage 7300 shown includes a housing 7301, a display unit 7000, a speaker 7303, etc. In addition, the digital signage may include an LED light, operation keys (including a power switch or an operation switch), a connection terminal, various sensors, a microphone, and the like.
[0575] Fig.37D The digital signage 7400 is shown mounted on a cylindrical pole 7401. The digital signage 7400 includes a display unit 7000 disposed along a curved surface of the pole 7401.
[0576] Can Fig.37C and Fig.37D Each of the display portions 7000 shown is a display device according to one embodiment of the present invention.
[0577] The larger the area of the display unit 7000 is, the more information can be provided at one time. In addition, the larger the display unit 7000 is, the easier it is to attract people's attention, thereby improving the advertising effect, for example.
[0578] By using a touch screen for the display unit 7000, not only static images or dynamic images can be displayed, but the user can also intuitively operate, so it is preferred. In addition, when used to provide information such as route information or traffic information, the ease of use can be improved through intuitive operation.
[0579] In addition, if Fig.37C and Fig.37D As shown, the digital signage 7300 or the digital signage 7400 can be linked with the information terminal 7311 or the information terminal 7411 such as a smartphone carried by the user preferably through wireless communication. For example, the advertisement information displayed on the display unit 7000 can be displayed on the screen of the information terminal 7311 or the information terminal 7411. In addition, by operating the information terminal 7311 or the information terminal 7411, the display of the display unit 7000 can be switched.
[0580] In addition, the digital signage 7300 or the digital signage 7400 can execute the game by using the screen of the information terminal 7311 or the information terminal 7411 as an operation unit (controller). Thus, an unspecified number of users can participate in the game at the same time and enjoy the game.
[0581] The display system according to one embodiment of the present invention may be assembled along a curved surface of an inner wall or outer wall of a house or a building, or an interior decoration or exterior decoration of a vehicle.
[0582] Reference Fig.38A and Fig.38B An example in which the display system according to one embodiment of the present invention is mounted on a vehicle will be described.
[0583] Fig.38A FIG. 5 shows an example of the appearance of a vehicle 5000. The vehicle 5000 includes a plurality of cameras 5005 ( Fig.38A 5005a, camera 5005b, camera 5005c, camera 5005d, camera 5005e, and camera 5005f in the figure). For example, camera 5005a, camera 5005b, camera 5005c, camera 5005d, camera 5005e, and camera 5005f have the functions of photographing the front situation, the rear situation, the right front situation, the left front situation, the right rear situation, and the left rear situation, respectively. Note that the number and function of the cameras photographing the surroundings of the vehicle are not limited to the number and function of the above-mentioned structures. For example, a camera for photographing the situation behind the vehicle is set in front of the vehicle.
[0584] Fig.38BFIG. 5 shows an example of the interior of a vehicle 5000. The vehicle 5000 includes a display unit 5001, a display panel 5008a, a display panel 5008b, and a display panel 5009. The display unit of the display system according to one embodiment of the present invention may be applied to one or more of the display unit 5001, the display panel 5008a, the display panel 5008b, and the display panel 5009. Note that in FIG. Fig.38B In the example shown, the display unit 5001 is installed on a right-hand drive vehicle, but the present invention is not limited thereto and the display unit 5001 may also be installed on a left-hand drive vehicle. Fig.38B The configuration of the structure shown is interchanged left to right.
[0585] Fig.38B The instrument panel 5002, steering wheel 5003, windshield 5004, etc., which are arranged around the driver's seat and the front passenger seat, are shown. The display unit 5001 is arranged at a designated position of the instrument panel 5002, specifically around the driver, and has a substantially T-shaped shape. Fig.38B In the example shown, a single display unit 5001 formed using a plurality of display panels 5007 (display panels 5007a, 5007b, 5007c, and 5007d) is provided along the instrument panel 5002, but the display unit 5001 may be divided and provided in a plurality of portions.
[0586] In addition, the plurality of display panels 5007 may also be flexible. In this case, the display unit 5001 may be formed into a complex shape, for example, it is easy to realize: a structure in which the display unit 5001 is arranged along a curved surface of the instrument panel 5002 or the like; a structure in which the display area of the display unit 5001 is not arranged on the steering wheel connection part, the display unit of the instrument, the air outlet 5006 or the like.
[0587] Display panels 5008a and 5008b are respectively arranged on the pillars. Fig.38A The image captured by the camera 5005 shown in the figure is displayed, and the display panels 5008a and 5008b can supplement the field of view blocked by the pillar. For example, the image captured by the camera 5005d is displayed as the image 5008c on the display panel 5008a. Similarly, it is preferred to display the image captured by the camera 5005c on the display panel 5008b.
[0588] The display panel 5009 may also have a function of displaying an image captured by a subsequent imaging unit (eg, camera 5005b).
[0589] The display panels 5007, 5008a, 5008b, and 5009 may also have the function of displaying legal speed and traffic information, etc.
[0590] The display panels 5008a and 5008b are preferably flexible, so that the display panels 5008a and 5008b can be easily arranged along the curved surface of the pillar portion.
[0591] When viewed from the driver's seat, the image on the display panel arranged along the curved surface appears to be distorted. Therefore, the display panel preferably has a function of displaying an image corrected in a manner to reduce image distortion. Image processing using a neural network is preferably used as the correction.
[0592] Although in Fig.38A , Fig.38B In the example shown, cameras 5005c and 5005d are provided instead of rearview mirrors, but both rearview mirrors and cameras may be provided.
[0593] A CCD camera or a CMOS camera can be used as the camera 5005. In addition, an infrared camera can be used in combination with the above-mentioned camera. Since the output level of the infrared camera increases as the temperature of the object increases, it is possible to detect or extract living organisms such as humans or animals.
[0594] The image captured by the camera 5005 can be output to one or more of the display panel 5007, the display panel 5008a, the display panel 5008b, and the display panel 5009. The display unit 5001, the display panel 5008a, the display panel 5008b, and the display panel 5009 are mainly used for assisting driving. By capturing a wide-angle image of the surroundings of the vehicle with the camera 5005 and displaying the image on the display panel 5007, the display panel 5008a, the display panel 5008b, and the display panel 5009, the driver can see the blind spot area and prevent accidents.
[0595] In addition, by using the display system of one embodiment of the present invention, the discontinuity of the image in the joints between the display panels 5007a, 5007b, 5007c and 5007d can be compensated, thereby realizing image display in which the joints are not easily visible, thereby improving the visibility of the display unit 5001 during driving.
[0596] In addition, the distance image sensor may be disposed on the roof of the vehicle, etc., and the image obtained by the distance image sensor may be displayed on the display unit 5001. As the distance image sensor, an image sensor or a laser radar (LIDAR: Light Detection and Ranging) may be used. By displaying the image obtained by the image sensor and the image obtained by the distance image sensor on the display unit 5001, more information may be provided to the driver to assist driving.
[0597] In addition, the display unit 5001 may also have a function of displaying map information, traffic information, TV images, DVD images, etc. For example, the display panels 5007a, 5007b, 5007c, and 5007d may be used as one display screen to display map information. Note that the number of display panels 5007 may be increased according to the images to be displayed.
[0598] In addition, the images displayed on the display panels 5007a, 5007b, 5007c and 5007d can be freely changed according to the driver's preference. For example, a TV image or a DVD image can be displayed on the display panel 5007d on the left, map information can be displayed on the display panel 5007b in the center, an instrument can be displayed on the display panel 5007c on the right, and audio information can be displayed on the display panel 5007a near the gear lever (between the driver's seat and the front passenger seat). In addition, by combining a plurality of display panels 5007, a fail-safe function can be added to the display unit 5001. For example, even if a display panel 5007 fails for some reason, another display panel 5007 can be used for display by changing the display area.
[0599] The windshield 5004 includes a display panel 5004a. The display panel 5004a has a function of transmitting visible light. The driver can see the background through the display panel 5004a. In addition, the display panel 5004a also has a function of displaying a display that draws the driver's attention. Note that Fig.38B Although the example of the structure in which the display panel 5004a is provided in the windshield 5004 is shown, one embodiment of the present invention is not limited to this. For example, the windshield 5004 may be replaced with the display panel 5004a.
[0600] This embodiment mode can be combined with any other embodiment mode as appropriate. [Example 1]
[0601] In this embodiment, the result of image correction is described.
[0602] First, input image data to the display panel, and use a two-dimensional brightness meter to obtain the brightness data displayed by the display panel. As image data, data including coordinate data and grayscale data of three colors RGB are used. The number of grayscales that can be represented by each grayscale data is 8 bits (256 grayscales). The grayscale value of all coordinates of each color is 127, and the display panel displays gray.
[0603] Next, the acquired brightness data is normalized, and then the value of the correction filter is updated by using the normalized brightness data. The value of the correction filter is determined for each coordinate (each pixel). In other words, the value of the correction filter for the three sub-pixels (RGB) in one pixel is the same.
[0604] Next, the same image data as the above-mentioned image data is input to the display panel, and the image is displayed by correcting the data using the updated correction filter. Then, brightness data is acquired using a two-dimensional brightness meter.
[0605] Next, the acquired luminance data is normalized, and then the value of the correction filter is updated by using the normalized luminance data.
[0606] In this manner, the acquisition of brightness data and the updating of the correction filter value are performed five times in total.
[0607] Fig.39A The luminance data of the display panel before correction obtained by using a two-dimensional luminance meter is shown. FIG. 39B to FIG. 39F The luminance data of the display panel after the first to fifth corrections obtained using a two-dimensional luminance meter are shown. Fig.40A The display result of the display panel before correction is shown. FIG. 40B to FIG. 40F The display results of the display panel after the first to fifth calibrations are shown respectively.
[0608] pass FIG. 39A to FIG. 39F The brightness data shown is consistent with FIG. 40A to FIG. 40F By comparing the display results shown, it can be seen that by obtaining brightness data, the display unevenness can be understood in more detail.
[0609] like Fig.39A and Fig.39B As shown in FIG. 1 , even with only one correction, the display unevenness is reduced. FIG. 39B to FIG. 39F As shown, by repeatedly updating the value of the correction filter, the display unevenness of the display panel can be further reduced. [Example 2]
[0610] In implementation mode 3, referring to Fig.35 A display device comprising two overlapping display panels is described. Fig.35 The display device shown includes a circular polarizer. The larger the angle at which the display device is viewed, the less likely the circular polarizer is to reduce the reflection of external light. As a result, the portion where the two display panels overlap each other (also referred to as the overlapping portion) is easily visible to the user.
[0611] In this embodiment, the manufacturing Fig.33A The display device shown includes two overlapping display panels 370B and Fig.33B The display device shown includes two overlapping display panels 370C. The visibility of each overlapping portion of the two display devices was evaluated by measuring the reflectivity.
[0612] Reference Fig.41AThe structure of the display device of this embodiment is described. The display device of this embodiment is formed by overlapping two display panels in such a way that the non-display area between the display areas of each other is small. The circular polarizer 390 is located on the display surface side of the two display panels. A light-transmitting layer 389 is provided between the visible light-transmitting area 72 of the upper display panel and the display portion of the lower display panel. The substrate 371a and the substrate 361b are bonded together through the light-transmitting layer 389.
[0613] The two display panels are flexible. Fig.41A As shown, the vicinity of the FPC 74a of the lower display panel can be bent, and a part of the lower display panel and a part of the FPC 74a can be arranged below the display portion of the upper display panel adjacent to the FPC 74a. As a result, the FPC 74a and the back surface of the upper display panel can be physically free from interference.
[0614] Each display panel is manufactured by bonding a substrate and an element layer with an adhesive layer. The element layer 153a is sandwiched between the substrate 371a and the substrate 361a via the adhesive layer 157, and the element layer 153b is sandwiched between the substrate 361b and the substrate 371b via the adhesive layer 157. As each substrate, a film with high optical isotropy is used. The element layer 153a has an area 155a including a display element and an area 156a including wiring electrically connected to the display element. Similarly, the element layer 153b has an area 155b including a display element and an area 156b including wiring electrically connected to the display element.
[0615] An LCD evaluation device (LCD-7200 manufactured by Otsuka Electronics Co., Ltd.) was used for the measurement. Fig.41B As shown, the reflectivity is measured in a state where the floodlight 91 and the photodetector 92 are respectively tilted at an angle θ with respect to a direction perpendicular to the measurement object 93. The angle θ is changed from 10° to 70° at intervals of 10°.
[0616] In this embodiment, the measurement Fig.41A Shown are the reflectance of a portion where two display panels overlap each other (overlapping portion) and the reflectance of a portion where two display panels do not overlap each other (non-overlapping portion).
[0617] Fig.42A 370B shows the measurement results of the reflectivity of the display device including two overlapping display panels 370B. Fig.42A As shown, it can be seen that the larger the angle θ is, the greater the difference in reflectivity between the overlapping portion and the non-overlapping portion is.
[0618] Fig.42B 370C shows the measurement results of the reflectivity of the display device including two overlapping display panels 370C. Fig.42BAs shown, in the range of angle θ of 10° to 70°, the difference in reflectivity becomes less than 0.1, and the angular dependence of the difference in reflectivity can be reduced. The number of insulating layers in the region 72 that allows visible light to pass through the display panel 370C is less than that of the display panel 370B, and the interference of light in the display panel 370C is suppressed. As a result, the angular dependence of the reflectivity of the overlapping portion can be made approximately equal to the angular dependence of the reflectivity of the non-overlapping portion. Therefore, a display device including a circular polarizer and in which the overlapping portion is not easily visible even if the angle at which the display device is viewed becomes larger can be obtained. Explanation of symbols
[0619] C11: capacitor, C21: capacitor, DD1: image data, DD2: image data, DD3: image data, DD4: image data, DP: display panel, DPa: display panel, DPb: display panel, DPc: display panel, DPd: display panel, R1: resistor, S1: region, S2: region, SD1: first image data, SD2: second image data, SD3: third image data, Tr11: transistor, Tr12: transistor, Tr21: transistor, Tr22: transistor, Tr23: transistor, U1: region, U2: region, V0: potential supply line, 10A: display system, 10B: display system, 10C: display system, 10D: display system, 10E: Display system, 20: Display unit, 20A: Display unit, 20B: Display unit, 20C: Display unit, 20D: Display unit, 20E: Display unit, 21: Pixel unit, 21A: Region, 21B: Region, 21C: Region, 21D: Region, 22: Scan line driving circuit, 22A: Scan line driving circuit, 22B: Scan line driving circuit, 22C: Scan line driving circuit, 22D: Scan line driving circuit, 23: Signal line driving circuit, 23A: Signal line driving circuit, 23B: Signal line driving circuit, 23C: Signal line driving circuit, 23D: Signal line driving circuit, 24: Timing controller, 25: Pixel, 25A: Pixel, 25B: Pixel, 30: Signal generating unit, 30A : signal generating unit, 30B: signal generating unit, 30C: signal generating unit, 30D: signal generating unit, 30E: signal generating unit, 31: front end unit, 32: decoder, 33: processing unit, 34: receiving unit, 35: interface, 36: control unit, 40: processing unit, 41: first layer, 42: second layer, 43: third layer, 45: dividing unit, 50: operation processing device, 61: image data, 61B: image data, 61G: image data, 61R: image data, 62: pixel data, 62B: pixel data, 62G: pixel data, 62R: pixel data, 63: operation data, 64: operation data, 65: operation data, 66: operation data, 67: image data, 67B: FIG. Image data, 67G: Image data, 67R: Image data, 67W: Image data, 68: Pixel data, 68B: Pixel data, 68G: Pixel data, 68R: Pixel data, 71: Pixel portion, 71a: Pixel portion, 71b: Pixel portion, 71c: Pixel portion, 71d: Pixel portion, 72: Region, 72b: Region, 72c: Region, 72d: Region, 73: Region, 74: FPC, 74a: FPC, 75: Terminal, 75a: Terminal, 75b: Terminal, 76: Terminal, 76a: Terminal, 77: Power supply unit, 78: Driving circuit portion, 79: Display region, 81: Image data, 83: Calculation data, 85: Calculation data, 87: Image data, 91: Floodlighting,92: Photodetector, 93: Measurement object, 102: Scan line drive circuit, 103: Scan line drive circuit, 111: Substrate, 113: Substrate, 115: Pixel, 120: Pixel, 121: Protective layer, 125a: Polarizer, 125b: Polarizer, 131: Coloring layer, 132: Light shielding layer, 133a: Orientation film, 133b: Orientation film, 141: Adhesive layer, 153a: Element layer, 153b: Element layer, 155a: Region including display element, 155b: Region including display element, 156a: Region including wiring, 156b: Region including wiring, 157: Adhesive layer, 162: FPC, 170: Light emitting element, 171: Pixel electrode, 172: EL layer, 173: common electrode, 174: adhesive layer, 175: insulating layer, 180: liquid crystal element, 181: pixel electrode, 182: common electrode, 183: liquid crystal layer, 200a: transistor, 200b: transistor, 201a: transistor, 201b: transistor, 201c: transistor, 201d: transistor, 211: insulating layer, 212: insulating layer, 213: insulating layer, 215: insulating layer, 216: insulating layer, 217: insulating layer, 218: insulating layer, 220: insulating layer, 221: conductive layer, 222a: conductive layer, 222b: conductive layer, 223: conductive layer, 225: insulating layer, 231: semiconductor layer, 232: impurity semiconductor layer, 242: connection, 251: transistor, 251a: transistor, 251b: transistor, 255: conductive layer, 301: transistor, 302: transistor, 303: transistor, 304: light emitting element, 305: capacitor, 306: connection portion, 307: conductive layer, 311: gate insulating layer, 312: insulating layer, 313: insulating layer, 314: insulating layer, 315: insulating layer, 316: spacer, 317: adhesive layer, 319: connection, 321: electrode, 322: EL layer, 323: electrode, 324: optical adjustment layer, 355: conductive layer, 361: substrate, 361a: substrate, 361b: substrate, 363: adhesive layer, 365: insulating layer, 367: insulating layer, 37 0: display panel, 370A: display panel, 370B: display panel, 370C: display panel, 370D: display panel, 370E: display panel, 370F: display panel, 371: substrate, 371a: substrate, 371b: substrate, 373: adhesive layer, 375: insulating layer, 377: insulating layer, 381: λ plate, 383: linear polarizing plate, 385: support body, 387: anti-reflection member, 389: light-transmitting layer, 390: circular polarizing plate, 411: insulating surface, 431: conductive layer, 432: semiconductor layer, 432_1: semiconductor layer, 432_2: semiconductor layer, 432p: semiconductor layer, 433: capacitor, 433a: conductive layer, 433b: conductive layer,434: insulating layer, 435: impurity semiconductor layer, 436: insulating layer, 436a: insulating layer, 436b: insulating layer, 437: semiconductor layer, 438: pixel circuit, 442: display element, 444: transistor, 445: node, 446: transistor, 446a: transistor, 446c: transistor, 446d: transistor, 447: node, 453: opening, 484: insulating layer, 484a: Insulating layer, 485: insulating layer, 486: conductive layer, 552: backlight unit, 562: display unit, 564: scanning line driving circuit, 565: conductive layer, 5000: vehicle, 5001: display unit, 5002: instrument panel, 5003: steering wheel, 5004: windshield, 5004a: display panel, 5005: camera, 5005a: camera, 5005b: camera, 5005c: camera machine, 5005d: camera, 5005e: camera, 5005f: camera, 5006: air outlet, 5007: display panel, 5007a: display panel, 5007b: display panel, 5007c: display panel, 5007d: display panel, 5008a: display panel, 5008b: display panel, 5008c: image, 5009: display panel, 7000: display unit, 7100: Television device, 7101: housing, 7103: stand, 7111: remote control unit, 7200: notebook personal computer, 7211: housing, 7212: keyboard, 7213: pointing device, 7214: external connection port, 7300: digital signage, 7301: housing, 7303: speaker, 7311: information terminal, 7400: digital signage, 7401: pillar, and 7411: information terminal. , This application is based on Japanese Patent Application No. 2017-125173 filed with the Japan Patent Office on June 27, 2017, and Japanese Patent Application No. 2017-141465 filed with the Japan Patent Office on July 21, 2017, the entire contents of which are incorporated herein by reference.
Claims
1. A data processing method comprising the following steps: Displaying an image on the display device by inputting first image data to the display device; Acquire first brightness data containing brightness distribution according to the image; updating a value of a correction filter used to correct image data by using the first brightness data; generating second image data by correcting the first image data by the correction filter whose value is updated using the first brightness data; acquiring second brightness data based on an image displayed on the display device by inputting the second image data to the display device; and by updating the value of the correction filter using the second brightness data, And the first brightness data is obtained by using a two-dimensional brightness meter.
2. The data processing method according to claim 1, The first image data includes coordinate data and grayscale data of a first color, The grayscale data of the first color includes a plurality of grayscale values corresponding to different coordinates, When the number of grayscales represented by the grayscale data of the first color is k bits and k is an integer greater than 2, the plurality of grayscale values are respectively 2 k-2 Above and 3×2 k-2 the following.
3. The data processing method according to claim 2, The multiple grayscale values are the same.
4. The data processing method according to claim 2, The first image data also includes grayscale data of the second color and grayscale data of the third color. The grayscale data of the second color includes a plurality of grayscale values corresponding to the different coordinates, The grayscale data of the third color includes a plurality of grayscale values corresponding to the different coordinates, And the multiple grayscale values of the grayscale data of the second color and the multiple grayscale values of the grayscale data of the third color are 0.
5. The data processing method according to claim 1, The first image data also includes grayscale data of the second color and grayscale data of the third color. The grayscale data of the second color includes a plurality of grayscale values corresponding to different coordinates, The grayscale data of the third color includes a plurality of grayscale values corresponding to different coordinates, When the number of grayscales represented by the grayscale data of the second color is m bits and m is an integer greater than 2, the plurality of grayscale values of the grayscale data of the second color are 2 m-2 Above and 3×2 m-2 the following, When the grayscale number represented by the grayscale data of the third color is n bits and n is an integer greater than 2, the plurality of grayscale values of the grayscale data of the third color are 2 n-2 Above and 3×2 n-2 the following.
6. The data processing method according to claim 4, wherein the plurality of grayscale values of the grayscale data of the second color are the same, And the multiple grayscale values of the grayscale data of the third color are the same.
7. A display system comprising: Processing unit and display unit, wherein the processing unit is configured to generate output data by using the image data and the correction filter whose value is updated by the data processing method according to claim 1, And the display unit is configured to display an image based on the output data.
