Method of driving liquid crystal display device

Abstract

To provide an illumination device which can precisely control brightness for each area.SOLUTION: An illumination device includes a threshold, a plurality of light sources, a spacer and a diffuser panel. The plurality of light sources and the spacer are surrounded with the threshold. The height of the threshold is made higher than that of the plurality of light sources, and an interval between the threshold and the diffuser panel is made shorter than the height of the threshold. An interval between the threshold and the diffuser panel is made longer than the height of the light source. Thus, it is possible to prevent light leakage from the light source to the outside of the threshold, and precisely control brightness for each area.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present invention relates to a display device, a liquid crystal display device, a semiconductor device, a method for producing the same, or In particular, the present invention relates to a driving method for display devices, liquid crystal display devices, semiconductor devices, etc. The present invention relates to a method of operating a digital camera or a method of processing signals therein. [Background technology]

[0002] In recent years, flat panel displays such as liquid crystal displays have become widespread. And the various performances of flat panels are improving more and more. One of the specifications of a panel is its resolution (or number of pixels), and resolution has improved significantly. .

[0003] Therefore, super-resolution processing technology, which is a technology for converting low-resolution images into high-resolution images, is used. Techniques for this purpose are being investigated (Patent Documents 1 to 3). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-160565 A [Patent Document 2] JP 2008-085411 A [Patent Document 3] JP 2008-252701 A Summary of the Invention [Problem to be solved by the invention]

[0005] On the other hand, various techniques for improving the image quality of liquid crystal displays are being considered. Therefore, in flat panel displays such as liquid crystal displays, When performing processing for upward movement, various problems may occur. For example, image quality may deteriorate, the correct image may not be displayed, power consumption may increase significantly, noise may increase, additional components may be required resulting in higher costs, the device may become larger, the bezel of the display device may become larger, the processing may become slower, the display may become slower, the frame frequency may become lower, etc. There is a possibility of such problems.

[0006] From the above, it is an issue to provide a device with improved image quality, its driving method, or its manufacturing method. Or, it is an issue to provide a device that displays the correct image, its driving method, or its manufacturing method. Or, it is an issue to provide a device with low power consumption, its driving method, or its manufacturing method. Or, it is an issue to provide a device with less noise, its driving method or its manufacturing method. Or, it is an issue to provide a device with fewer components, its driving method, or its manufacturing method. Or, it is an issue to provide a device with low cost, its driving method, or its manufacturing method. Or, it is an issue to provide a miniaturized device, its driving method, or its manufacturing method. Or, it is an issue to provide a device with a small bezel, its driving method, or its manufacturing method. Or, it is an issue to provide a device with fast processing, its driving method, or its manufacturing method. Also it is an issue to provide a device with fast display, its driving method, or its manufacturing method. Or, it is an issue to provide a device with a non-low frame frequency, its driving method, or its manufacturing method.

Means for Solving the Problem

[0007] Using super-resolution processing technology, a low-resolution image is converted into a high-resolution image. Then, image processing such as edge enhancement, interpolation of frame data for high display by increasing the frame frequency, data processing for local brightness control (LOCAL DIMMING) using a backlight, data processing for overdrive driving, etc. are performed.

[0008] Alternatively, using super-resolution processing technology, a low-resolution image is converted into a high-resolution image. Then image processing such as edge enhancement, interpolation of frame data for high display by increasing the frame frequency is performed. Then, data processing for local brightness control (LOCAL DIMMING: L OCAL DIMMING) using a backlight, data processing for overdrive driving, etc. are performed. processing, etc. are performed.

[0009] Therefore, it has a first step of performing super-resolution processing and a second step of performing local dimming processing, and is characterized in that the second step is performed after the first step, and a driving method of a liquid crystal display device is provided.

[0010] Alternatively, it has a first step of performing super-resolution processing, a second step of performing local dimming processing, and a third step of performing overdrive processing, and is characterized in that the second step is performed after the first step, and the third step is performed after the second step, and a driving method of a liquid crystal display device is provided.

[0011] Alternatively, it has a first step of performing super-resolution processing and a second step of performing frame interpolation processing ​​​and a third step of performing local dimming processing and a fourth step of performing overdrive processing, where the second step is performed after the first step, the third step is performed after the second step, and the fourth step is performed after the third step, and a driving method of a liquid crystal display device is provided. Or, a first step of performing super-resolution processing, a second step of performing edge enhancement processing, a third step of performing local dimming processing, and a fourth step of performing overdrive processing, where the second step is performed after the first step, the third step is performed after the second step, and the fourth step is performed after the third step, and a driving method of a liquid crystal display device is provided. Note that switches can be of various forms. For example, there are electrical switches and mechanical switches. That is, as long as it can control the flow of current, it is not limited to a specific one. For example, as a switch, a transistor (for example, a bipolar transistor, a MOS transistor, etc.), a diode (for example, a PN diode, a PIN diode, a Schottky diode, a MIM (Metal Insulator Metal) diode, a MIS (Metal Insulator Semiconductor) diode, a transistor connected in diode configuration, etc.) can be used. Or, a logic circuit combining these can be used as a switch.

[0012]

[0013]

[0014] ​​​​​​​​​​​​​​Examples of mechanical switches include those like digital micromirror devices (DMDs) and switches using MEMS (Micro-Electro-Mechanical System) technology. Such switches have electrodes that can be mechanically moved, and by moving these electrodes, they control conduction and non-conduction to operate.

[0015] When using a transistor as a switch, since the transistor operates merely as a switch, the polarity (conductivity type) of the transistor is not particularly limited. However, when wanting to suppress the off-current, it is desirable to use a transistor with the polarity having a lower off-current. Transistors with a low off-current include transistors having an LDD region and transistors having a multi-gate structure. Or, when the potential of the source terminal of the transistor operating as a switch operates at a value close to the potential of the low-potential side power supply (Vss, GND, 0V, etc.), it is desirable to use an N-channel type transistor. Conversely, when the potential of the source terminal operates at a value close to the potential of the high-potential side power supply (Vdd, etc.), it is desirable to use a P-channel type transistor. This is because when the source terminal of an N-channel type transistor operates at a value close to the potential of the low-potential side power supply, and when the source terminal of a P-channel type transistor operates at a value close to the potential of the high-potential side power supply, the absolute value of the voltage between the gate and the source can be made large, so that as a switch, more accurate operation can be performed. Furthermore, since it is less likely for the transistor to perform source follower operation, the magnitude of the output voltage is less likely to become small.

[0016] ​​​​​​​Note that, using both an N-channel transistor and a P-channel transistor, a CMO S type switch may be used as the switch. When using a CMOS type switch, either the P cha nel transistor or the N-channel transistor allows current to flow when it conducts, making it easier to function as a switch. For example, regardless of whether the voltage of the input signal to the switch is high or low, the voltage can be appropriately output. Further, the voltage amplitude value of the signal for turning the switch on or off can be reduced, so the power consumption can also be reduced. When using a transistor as the switch, the switch has an input terminal (one of the source terminal or drain terminal), an output terminal (the other of the source terminal or drain terminal), and a terminal (gate terminal) for controlling conduction. On the other hand, when using a diode as the switch, the switch may not have a terminal for controlling conduction. Therefore, using a diode as the switch rather than a transistor can reduce the wiring for controlling the terminals.

[0017] Note that when explicitly stating that A and B are connected, it shall include the case where A and B are electrically connected, the case where A and B are functionally connected, and the case where A and B are directly connected. Here, A and B are assumed to be objects (for example, devices, elements, circuits, wirings, electrodes, terminals, conductive films, layers, etc.). Therefore, it is not limited to a predetermined connection relationship, for example, the connection relationship shown in the figure or the text, but shall also include those other than the connection relationship shown in the figure or the text. When using a transistor as the switch, the switch has an input terminal (one of the source terminal or drain terminal), an output terminal (the other of the source terminal or drain terminal), and a terminal (gate terminal) for controlling conduction. On the other hand, when using a diode as the switch, the switch may not have a terminal for controlling conduction. Therefore, using a diode as the switch rather than a transistor can reduce the wiring for controlling the terminals. When using a transistor as the switch, the switch has an input terminal (one of the source terminal or drain terminal), an output terminal (the other of the source terminal or drain terminal), and

[0018] Note that when explicitly stating that A and B are connected, it shall include the case where A and B are electrically connected, the case where A and B are functionally connected, and the case where A and B are directly connected. Here, A and B are assumed to be objects (for example, devices, elements, circuits, wirings, electrodes, terminals, conductive films, layers, etc.). Therefore, it is not limited to a predetermined connection relationship, for example, the connection relationship shown in the figure or the text, but shall also include those other than the connection relationship shown in the figure or the text. When using a transistor as the switch, the switch has an input terminal (one of the source terminal or drain terminal), an output terminal (the other of the source terminal or drain terminal), and a terminal (gate terminal) for controlling conduction. On the other hand, when using a diode as the switch, the switch may not have a terminal for controlling conduction. Therefore, using a diode as the switch rather than a transistor can reduce the wiring for controlling the terminals. Note that when explicitly stating that A and B are connected, it shall include the case where A and B are electrically connected, the case where A and B are functionally connected, and the case where A and B are directly connected. Here, A and B are assumed to be objects (for example, devices, elements, circuits, wirings, electrodes, terminals, conductive films, layers, etc.). Therefore, it is not limited to a predetermined connection relationship, for example, the connection relationship shown in the figure or the text, but shall also include those other than the connection relationship shown in the figure or the text. Note that when explicitly stating that A and B are connected, it shall include the case where A and B are electrically connected, the case where A and B are functionally connected, and the case where A and B are directly connected. Here, A and B are assumed to be objects (for example, devices, elements, circuits, wirings, electrodes, terminals, conductive films, layers, etc.). Therefore, it is not limited to a predetermined connection relationship, for example, the connection relationship shown in the figure or the text, but shall also include those other than the connection relationship shown in the figure or the text.

[0019] For example, when A and B are electrically connected, one or more elements that enable the electrical connection between A and B (for example, switches, transistors, capacitive elements, inductors, resistive elements, diodes, etc.) may be connected between A and B. Alternatively, when A and B are functionally connected, a circuit that enables the functional connection between A and B (for example, a logic circuit (such as an inverter, NAND circuit, NOR circuit, etc.), a signal conversion circuit (such as a DA conversion circuit, an AD conversion circuit, a gamma correction circuit, etc.), a potential level conversion circuit (such as a power supply circuit (step-up circuit, step-down circuit, etc.), a level shifter circuit that changes the potential level of a signal, etc.), a voltage source, a current source, a switching circuit, an amplification circuit (a circuit that can increase the signal amplitude or current amount, such as an operational amplifier, a differential amplification circuit, a source follower circuit, a buffer circuit, etc.), a signal generation circuit, a memory circuit, a control circuit, etc.) may be connected between A and B. For example, even if another circuit is interposed between A and B, when the signal output from A is transmitted to B, A and B are considered to be functionally connected. Moreover, when it is explicitly described that A and B are electrically connected, it is assumed to include the case where A and B are electrically connected (that is, connected with another element or another circuit interposed between A and B), the case where A and B are functionally connected (that is, functionally connected with another circuit interposed between A and B), and the case where A and B are directly connected (that is, connected without another element or another circuit interposed between A and B). That is, when it is explicitly described that they are electrically connected, it is considered to be the same as when it is only explicitly described that they are connected.

[0020] ​​

[0021] Note that a display element, a display device having the display element, a light-emitting element, and a device having the light-emitting element can use various forms and have various elements. For example, as the display element, the display device, the light-emitting element, or the light-emitting device, an EL (electroluminescence) element (including an EL element containing an organic substance and an inorganic substance, an organic EL element, and an inorganic EL element), an LE D (such as a white LED, a red LED, a green LED, and a blue LED), a transistor (a transistor that emits light in response to current), an electron-emitting element, a liquid crystal element, electronic ink, an electrophoretic element, a gr ating light valve (GLV), a plasma display panel (PDP), a digital micromirror device (DMD), a piezoelectric ceramic display, a carbon nanotube, etc., can have a display medium in which contrast, brightness, reflectance, transmittance, etc. change due to an electromagnetic action. Note that as a display device using an EL element, there is an EL display, and as a display device using an electron-emitting element, there is a field emission display ( FED) or an SED type flat panel display (SED: Surface-conducti on Electron-emitter Disply), etc. As a display device using a liquid crystal element, there is a liquid crystal display (a transmissive liquid crystal display, a transflective liquid crystal display, a reflective liquid crystal display, a direct-view liquid crystal display, and a projection liquid crystal display). As a display device using electronic ink or an electrophoretic element, there is electronic paper. Note that an EL element is an element having an anode, a cathode, and an EL layer sandwiched between the anode and the cathode. Note that as the EL layer, those using light emission (fluorescence) from singlet excitons are used,

[0022] ​ Those that utilize emission from triplet excitons (phosphorescence) and those that utilize emission from singlet excitons (fluorescence). Some of them use light emitted from triplet excitons (phosphorescence), while others use organic materials. those formed by inorganic matter, those formed by organic matter, Materials formed by inorganic substances, including polymeric materials, low molecular weight materials, polymeric materials However, the present invention is not limited to the above. There can be various types of EL element.

[0023] An electron-emitting device is a device that extracts electrons by concentrating a high electric field on a cathode. For example, As electron emitters, Spindt type, carbon nanotube (CNT) type, metal-insulator - Metal-insulator-metal (MIM) type with metal laminated, metal-insulator MIS (Metal-Insulator-Semiconductor) ctor type, MOS type, silicon type, thin film diode type, diamond type, metal-insulated Body - Semiconductor-metal thin film type, HEED type, EL type, porous silicon type, surface conduction ( However, the electron emission element may have a type such as a SCE type. It can have a variety of things.

[0024] The liquid crystal element is a device that controls the transmission or non-transmission of light by the optical modulation action of liquid crystal. It is an element that consists of a pair of electrodes and liquid crystal. The optical modulation action of liquid crystal is as follows: Controlled by the electric field applied to the liquid crystal (including the horizontal electric field, vertical electric field, or diagonal electric field) The liquid crystal element is a nematic liquid crystal, a cholesteric liquid crystal, a smectic liquid crystal, Cholesteric liquid crystal, discotic liquid crystal, thermotropic liquid crystal, lyotropic liquid crystal, low molecular weight liquid crystal , polymeric liquid crystal, polymer dispersed liquid crystal (PDLC), ferroelectric liquid crystal, antiferroelectric liquid crystal, main chain liquid crystal , side chain polymeric liquid crystal, plasma addressed liquid crystal (PALC), banana type liquid crystal, etc. can be mentioned. In addition, as the driving method of the liquid crystal, TN (Twisted Nematic) mode, STN (Super Twisted Nematic) mode, IPS (In -Plane-Switching) mode, FFS (Fringe Field Sw itching) mode, MVA (Multi-domain Vertical Al ignment) mode, PVA (Patterned Vertical Align ment) mode, ASV (Advanced Super View) mode, ASM (Axially Symmetric aligned Micro-cell) mode , OCB (Optically Compensated Birefringenc e) mode, ECB (Electrically Controlled Birefr ingence) mode, FLC (Ferroelectric Liquid Cry stal) mode, AFLC (AntiFerroelectric Liquid C rystal) mode, PDLC (Polymer Dispersed Liquid Crystal) mode, guest-host mode, blue phase mode, etc. can be used. However, it is not limited to this, and various liquid crystal elements and their driving methods can be used. Note that as electronic paper, those displayed by molecules (optical anisotropy, dye molecule orientation

[0025] ​ such as), those displayed by particles (electrophoresis, particle movement, particle rotation, phase change, etc.), those displayed by the movement of one end of a film, those displayed by the color development / phase change of molecules, those displayed by the light absorption of molecules, those displayed by the spontaneous emission due to the combination of electrons and holes, etc. For example, as the display method of electronic paper, microcapsule type electrophoresis, horizontal movement type electrophoresis, vertical movement type electrophoresis, spherical twist ball, magnetic twist ball, cylindrical twist ball method, charged toner, electronic powder fluid, magnetophoresis type, magnetic sensing heat type, electro-wetting, light scattering (transparent / opaque change), cholesteric liquid crystal / light conductive layer, cholesteric liquid crystal, bistable nematic liquid crystal, ferroelectric liquid crystal, dichroic dye / liquid crystal dispersion type, movable film, color development and discoloration by leuco dye, photochromic, electrochromic, electrodeposition, flexible organic EL, etc. can be used. However, it is not limited to this, and various things can be used as electronic paper and its display method. Here, by using the microcapsule type electrophoresis, the aggregation and precipitation of the electrophoretic particles, which are the drawbacks of the electrophoresis method, can be solved. The electronic powder fluid has merits such as high response speed, high reflectivity, wide viewing angle, low

[0026] power consumption, and memory property. In addition, a plasma display panel has a structure in which a substrate with electrodes formed on its surface and a substrate with electrodes and minute grooves formed on its surface and a phosphor layer formed in the grooves are opposed to each other at a narrow interval and a rare gas is enclosed. Alternatively, a plasma A bulb is formed by sealing a discharge gas, phosphors for each of RGB, etc. inside a glass tube. That is, by applying a voltage between electrodes to generate ultraviolet rays and causing the phosphors to emit light, display can be performed. Note that as a plasma display panel, a DC type P DP or an AC type PDP may be used. Here, as a driving method of the plasma display panel, AWS (Address While Sustain) driving, ADS (Address Display Separated) driving that divides into a reset period, an address period, and a sustain period, CLEAR (HI‐CONTRAST&LOW ENERG Y ADDRESS&REDUCTION OF FALSE CONTOUR SEQ UENCE) driving, ALIS (Alternate Lighting of Surf aces) method, TERES (Technology of Reciprocal S ustainer) driving, etc. can be used. However, it is not limited to this, and various types can be used as the plasma display. Note that as a light source for a display device that requires a light source, for example, a liquid crystal display (transmission type liquid crystal display,

[0027] half - transmission type liquid crystal display, reflection type liquid crystal display, direct - view type liquid crystal display, projection type liquid crystal display), a display device using a grating light valve (GLV), a display device using a digital micromirror device (DMD), etc., as the light source, electroluminescence, cold cathode tubes, hot cathode tubes, LEDs, laser light sources, mercury lamps, etc. can be used. However, it is not limited to this, and various types can be used as the light source.

[0028] ​​​​​ Note that various types of transistors can be used as the transistor. Therefore , there is no limitation on the type of transistor to be used. For example, amorphous silicon, polycrystalline silicon, microcrystalline (also referred to as microcrystal, nanocrystal, semi-amorphous) silicon, etc. A thin-film transistor (TFT) having a non-single crystal semiconductor film represented by any of them can be used. When using a TFT, there are various advantages. For example, in the case of single crystal silicon , it can be manufactured at a lower temperature than that, so that the manufacturing cost can be reduced or the size of the manufacturing apparatus can be increased. Since the manufacturing apparatus can be made larger, it can be manufactured on a large substrate. Therefore, at the same time, many display devices can be manufactured, and thus it can be manufactured at low cost. Furthermore, since the manufacturing temperature is low , a substrate with weak heat resistance can be used. Therefore, a transistor can be manufactured on a substrate having translucency. And the transmission of light in the display element can be controlled by using the transistor on the substrate having translucency. Or, since the film thickness of the transistor is thin, a part of the film constituting the transistor can transmit light. Therefore, the aperture ratio can be improved. Note that when manufacturing polycrystalline silicon, by using a catalyst (such as nickel), the crystallinity can be further improved, and it becomes possible to manufacture a transistor with good electrical characteristics. As a result, a gate driver circuit (scanning line drive circuit), a source driver circuit (signal line drive circuit

[0029] ), a signal processing circuit (such as a signal generation circuit, a gamma correction circuit, a DA conversion circuit, etc.) can be integrally formed on the substrate. Note that when manufacturing microcrystalline silicon, by using a catalyst (such as nickel), the crystallinity can be further improved, and it becomes possible to manufacture a transistor with good electrical characteristics. As a result, a gate driver circuit (scanning line drive circuit), a source driver circuit (signal line drive circuit ), a signal processing circuit (such as a signal generation circuit, a gamma correction circuit, a DA conversion circuit, etc.) can be integrally formed on the substrate. formed on the substrate.

[0030] Note that when manufacturing microcrystalline silicon, by using a catalyst (such as nickel), It becomes possible to manufacture a transistor with further improved crystallinity and good electrical characteristics. In this case, it is also possible to improve the crystallinity only by applying heat treatment without performing laser irradiation. As a result, a part of the source driver circuit (such as an analog switch) and the gate driver circuit (scanning line drive circuit) can be integrally formed on the substrate. Furthermore, when laser irradiation is not performed for crystallization, unevenness in the crystallinity of silicon can be suppressed. Therefore, an image with improved image quality can be displayed.

[0031] However, it is possible to manufacture polycrystalline silicon or microcrystalline silicon without using a catalyst (such as nickel).

[0032] Note that improving the crystallinity of silicon to polycrystalline or microcrystalline etc. is preferably performed for the entire panel, but is not limited thereto. The crystallinity of silicon may be improved only in a part of the panel area. Selectively improving the crystallinity can be achieved by selectively irradiating with laser light etc. For example, laser light may be irradiated only to the peripheral circuit area which is an area other than the pixels. Or, laser light may be irradiated only to areas such as the gate driver circuit and the source driver circuit. Or, laser light may be irradiated only to an area of a part of the source driver circuit (for example, an analog switch). As a result, crystallization of silicon can be improved only in areas where it is necessary to operate the circuit at high speed. Since the pixel area has little need to operate at high speed, the pixel circuit can operate without problems even if the crystallinity is not improved. The area where the crystallinity needs to be improved can be reduced, and thus... Moreover, the manufacturing process can be shortened, throughput can be improved, and manufacturing costs can be reduced. Since the number of manufacturing apparatuses required is small, manufacturing costs can be reduced.

[0033] Alternatively, transistors can be formed using a semiconductor substrate, an SOI substrate, or the like. As a result, transistors with little variation in characteristics, size, shape, etc., high current supply capacity, and small size can be manufactured. Using these transistors, power consumption of the circuit can be reduced, or high integration of the circuit can be achieved.

[0034] Alternatively, transistors having a compound semiconductor or an oxide semiconductor such as ZnO, a-InGaZnO, SiGe, GaAs, indium zinc oxide ( IZO), indium tin oxide (ITO), SnO, etc., or thin film transistors in which these compound semiconductors or oxide semiconductors are thinned can be used. As a result, the manufacturing temperature can be lowered, for example, it becomes possible to manufacture transistors at room temperature. As a result, transistors can be directly formed on a substrate with low heat resistance, for example, a plastic substrate or a film substrate. Note that these compound semiconductors or oxide semiconductors can be used not only for the channel portion of the transistor, but also for other applications. For example, these compound semiconductors or oxide semiconductors can be used as resistive elements, pixel electrodes, and electrodes having translucency. Furthermore, since they can be film-formed or formed simultaneously with the transistor, costs can be reduced.

[0035] Alternatively, transistors formed using an inkjet or a printing method can be used. This enables manufacturing at room temperature, at low vacuum levels, or on large substrates. Since manufacturing can be carried out without using a mask (reticle), the layout of the transistor can be easily changed. Furthermore, since there is no need to use a resist, the material cost is reduced and the number of processes can be decreased. Moreover, since a film is applied only to the necessary parts, compared to the manufacturing method of forming a film over the entire surface and then performing etching, less material is wasted and the cost can be reduced.

[0036] Alternatively, transistors having an organic semiconductor or a carbon nanotube can be used. This enables forming a transistor on a substrate that can be bent. A semiconductor device using such a substrate can be made resistant to shock.

[0037] Furthermore, transistors with various structures can be used. For example, MOS transistors, junction transistors, bipolar transistors, etc. can be used as the transistor. By using an MOS transistor, the size of the transistor can be reduced. Therefore, a large number of transistors can be mounted. By using a bipolar transistor, a large current can be made to flow. Therefore, the circuit can be operated at high speed.

[0038] Note that MOS transistors, bipolar transistors, etc. may be formed in a mixed manner on a single substrate. This can achieve low power consumption, miniaturization, high-speed operation, etc.

[0039] In addition, various other transistors can be used.

[0040] Note that the transistor can be formed using various substrates. The type of substrate is not limited to a specific one. Examples of such substrates include single crystal substrates, SOI substrates, glass substrates, quartz substrates, plastic substrates, stainless steel substrates, substrates having a stainless steel foil, etc. Alternatively, a transistor can be formed using a certain substrate, and then the transistor can be transposed to another substrate and arranged on the other substrate. Examples of the substrate to which the transistor is transposed include single crystal substrates, SOI substrates, glass substrates, quartz substrates, plastic substrates, paper substrates, cellophane substrates, stone substrates, wood substrates, cloth substrates (including natural fibers (silk, cotton, linen), synthetic fibers (nylon, polyurethane, polyester), or recycled fibers (acetate, cupra, rayon, recycled polyester), etc.), leather substrates, rubber substrates, stainless steel substrates, substrates having a stainless steel foil, etc. Alternatively, the skin (epidermis, dermis) or subcutaneous tissue of an animal such as a human can be used as the substrate. Alternatively, a transistor can be formed using a certain substrate, and the substrate can be polished to make it thinner. Examples of the substrate to be polished include single crystal substrates, SOI substrates, glass substrates, quartz substrates, plastic substrates, stainless steel substrates, substrates having a stainless steel foil, etc. By using these substrates, it is possible to form a transistor with good characteristics, form a transistor with low power consumption, manufacture a device that is difficult to break, impart heat resistance, reduce weight, or make it thinner. Note that the configuration of the transistor can take various forms and is not limited to a specific configuration.

[0041] For example, a multi-gate structure having two or more gate electrodes can be applied. When the gate structure is used, the channel regions are connected in series, so multiple transistors are connected in series. The multi-gate structure reduces the off-state current and improves the transistor durability. Alternatively, the multi-gate structure can improve saturation voltage (improve reliability). When operating in the MOSFET region, the drain-source current remains constant even if the drain-source voltage is changed. The voltage-current characteristic does not change much, and the slope of the voltage-current characteristic can be made flat. By taking advantage of the flat slope of As a result, it is possible to realize an active load with good characteristics, such as a differential circuit or a current mirror. The circuit can be realized.

[0042] As another example, a structure in which gate electrodes are arranged above and below the channel can be applied. By using a structure in which gate electrodes are arranged above and below the channel, The current value can be increased because the area is increased. By using a structure in which the poles are arranged, a depletion layer is easily formed, so the S value is improved. In addition, by arranging gate electrodes above and below the channel, This results in a configuration in which multiple transistors are connected in parallel.

[0043] A structure in which a gate electrode is disposed above a channel region, and a structure in which a gate electrode is disposed below a channel region The structure in which the channel region is divided into multiple regions is called the normal staggered structure. a structure in which the channel regions are connected in parallel, or a structure in which the channel regions are connected in series is also applicable. Further, a structure in which a source electrode or a drain electrode overlaps with the channel region (or a part thereof) is also applicable. By forming a structure in which a source electrode or a drain electrode overlaps with the channel region (or a part thereof), it is possible to prevent the operation from becoming unstable due to the accumulation of charges in a part of the channel region. Alternatively, a structure provided with an LDD region can be applied. By providing an LDD region, it is possible to reduce the off-current or improve the breakdown voltage of the transistor (improve the reliability). Alternatively, by providing an LDD region, even when the drain-source voltage changes during operation in the saturation region, the drain-source current does not change so much, and the slope of the voltage-current characteristics can be flattened. is also applicable. By forming a structure in which a source electrode or a drain electrode overlaps with the channel region (or a part thereof), it is possible to prevent the operation from becoming unstable due to the accumulation of charges in a part of the channel region. By forming a structure in which a source electrode or a drain electrode overlaps with the channel region (or a part thereof), it is possible to prevent the operation from becoming unstable due to the accumulation of charges in a part of the channel region. Alternatively, a structure provided with an LDD region can be applied. By providing an LDD region, it is possible to reduce the off-current or improve the breakdown voltage of the transistor (improve the reliability). By providing an LDD region, it is possible to reduce the off-current or improve the breakdown voltage of the transistor (improve the reliability). Alternatively, by providing an LDD region, even when the drain-source voltage changes during operation in the saturation region, the drain-source current does not change so much, and the slope of the voltage-current characteristics can be flattened. Alternatively, by providing an LDD region, even when the drain-source voltage changes during operation in the saturation region, the drain-source current does not change so much, and the slope of the voltage-current characteristics can be flattened. Alternatively, by providing an LDD region, even when the drain-source voltage changes during operation in the saturation region, the drain-source current does not change so much, and the slope of the voltage-current characteristics can be flattened.

[0044] Note that various types of transistors can be used and can be formed using various substrates. Therefore, all of the circuits necessary to realize a predetermined function can be formed on the same substrate. For example, all of the circuits necessary to realize a predetermined function can be formed using various substrates such as a glass substrate, a plastic substrate, a single crystal substrate, or an SOI substrate. By forming all of the circuits necessary to realize a predetermined function on the same substrate, it is possible to reduce costs by reducing the number of components or improve reliability by reducing the number of connection points with circuit components. Alternatively, a part of the circuits necessary to realize a predetermined function can be formed on a certain substrate, and another part of the circuits necessary to realize a predetermined function can be formed on another substrate. That is, all of the circuits necessary to realize a predetermined function can be formed using the same substrate. Note that various types of transistors can be used and can be formed using various substrates. Therefore, all of the circuits necessary to realize a predetermined function can be formed on the same substrate. For example, all of the circuits necessary to realize a predetermined function can be formed using various substrates such as a glass substrate, a plastic substrate, a single crystal substrate, or an SOI substrate. For example, all of the circuits necessary to realize a predetermined function can be formed using various substrates such as a glass substrate, a plastic substrate, a single crystal substrate, or an SOI substrate. By forming all of the circuits necessary to realize a predetermined function on the same substrate, it is possible to reduce costs by reducing the number of components or improve reliability by reducing the number of connection points with circuit components. By forming all of the circuits necessary to realize a predetermined function on the same substrate, it is possible to reduce costs by reducing the number of components or improve reliability by reducing the number of connection points with circuit components. Alternatively, a part of the circuits necessary to realize a predetermined function can be formed on a certain substrate, and another part of the circuits necessary to realize a predetermined function can be formed on another substrate. Alternatively, a part of the circuits necessary to realize a predetermined function can be formed on a certain substrate, and another part of the circuits necessary to realize a predetermined function can be formed on another substrate. That is, all of the circuits necessary to realize a predetermined function can be formed using the same substrate. That is, all of the circuits necessary to realize a predetermined function can be formed using the same substrate. It is not necessary. For example, a part of the circuit required to realize a predetermined function is glass formed by transistors on a glass substrate, and another part of the circuit required to realize a predetermined function is formed on a single crystal substrate and is composed of transistors formed using the single crystal substrate The formed IC chip can be connected to the glass substrate by COG (Chip On Glass) and the IC chip can be arranged on the glass substrate. Alternatively, the IC chip can also be connected to the glass substrate using TAB (Tape Automated Bonding) or a printed circuit board In this way, since a part of the circuit is formed on the same substrate, cost reduction due to reduction in the number of components or reliability improvement due to reduction in the number of connection points with circuit components can be achieved. Alternatively, since the circuits of the parts with high drive voltage and high drive frequency consume a large amount of power, the circuits of such parts are not formed on the same substrate. Instead, for example, the circuits of such parts are formed on a single crystal substrate, and by using the IC chips composed of such circuits the increase in power consumption can be prevented.

[0045] Note that one pixel indicates the minimum unit of an image. Therefore, in the case of a full-color display device composed of color elements of R (red), G (green), and B (blue ), one pixel is composed of a dot of the R color element, a dot of the G color element, and a dot of the B color element. Note that the color elements are not limited to three colors, and more than three colors may be used, or colors other than RGB may be used. For example , white may be added to make it RGBW (W is white). Or, for example, one or more colors such as yellow , cyan, magenta, emerald green, and vermilion may be added to RGB. Also ​​​For example, a color similar to at least one of RGB may be added to RGB. For example, they may be R, G, B1, and B2. Both B1 and B2 are blue, but slightly different in wavelength. Similarly, they may be R1, R2, G, and B. By using such color elements, a display closer to the real object can be achieved. Alternatively, by using such color elements, power consumption can be reduced. Note that there may be multiple dots of color elements of the same color in one pixel. In that case, the multiple color elements may each have a different size of the area contributing to the display. Alternatively, gradation may be expressed by controlling each of the multiple dots of color elements of the same color. This is called the area gradation method. Alternatively, by using multiple dots of color elements of the same color and slightly varying the signals supplied to each dot, the viewing angle may be broadened. That is, the potentials of the pixel electrodes of the multiple color elements of the same color may each be different. As a result, the voltages applied

[0046] to the liquid crystal molecules are different for each pixel electrode. Therefore, the viewing angle can be broadened.

[0046] In addition, in the case of showing a circuit diagram, etc., one pixel may be regarded as representing one element capable of controlling brightness. Therefore, in that case, one pixel represents one color element, and the brightness is expressed by that one color element. Therefore, in the case of a color display device composed of color elements of R (red), G (green), and B (blue), the minimum unit of an

[0047] image may sometimes be considered to be composed of three pixels: an R pixel, a To be arranged in a stripe pattern means that, in the vertical or horizontal direction, pixels are arranged in a straight line or are arranged on a zigzag line. Therefore , for example, when performing full-color display with three color elements (e.g., RGB), it includes the case of stripe arrangement or the case where dots of three color elements are arranged in a delta pattern. Furthermore , it also includes the case of Bayer arrangement. Note that the size of the display area may be different for each dot of the color element . This makes it possible to achieve lower power consumption or longer life of the display element .

[0048] Note that an active matrix method in which a pixel has an active element or a passive matrix method in which a pixel does not have an active element can be used .

[0049] In the active matrix method, as the active element (active element, non-linear element), not only a transistor but also various active elements (active elements, non-linear elements) can be used . For example, it is also possible to use MIM (Metal Insulator Metal) or TFD (Thin Film Diode), etc. These elements have fewer manufacturing steps, so it is possible to reduce the manufacturing cost or improve the yield. Furthermore , since the size of the element is small, the aperture ratio can be improved, and lower power consumption and higher brightness can be achieved .

[0050] Note that as something other than the active matrix method, it is also possible to use a passive matrix type that does not use an active element (active element, non-linear element). The active element (active element, non-linear element) Since it does not use active elements (active elements, non-linear elements), the manufacturing process is less, and it is possible to reduce the manufacturing cost or improve the yield. Since it does not use active elements (active elements, non-linear elements), the aperture ratio can be improved, and low power consumption and high brightness can be achieved. Since it does not use active elements (active elements, non-linear elements), the aperture ratio can be improved, and low power consumption and high brightness can be achieved. Since it does not use active elements (active elements, non-linear elements), the aperture ratio can be improved, and low power consumption and high brightness can be achieved.

[0051] Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region. Note that a transistor is an element having at least three terminals including a gate, a drain, and a source, and has a channel region between the drain region and the source region, and current can flow through the drain region, the channel region, and the source region. Here, since the source and the drain change depending on the structure and operating conditions of the transistor, etc., it is difficult to limit which one is the source or the drain. Therefore, the regions functioning as the source and the drain may not be called the source or the drain. In that case, as an example, they may be denoted as the first terminal and the second terminal, respectively. Alternatively, they may be denoted as the first electrode and the second electrode, respectively. Alternatively, they may be denoted as the first region and the second region.

[0052] Note that a transistor may be an element having at least three terminals including a base, an emitter, and a collector. Also in this case, the emitter and the collector may be denoted as the first terminal, the second terminal, etc. Note that a transistor may be an element having at least three terminals including a base, an emitter, and a collector. Also in this case, the emitter and the collector may be denoted as the first terminal, the second terminal, etc. Note that a transistor may be an element having at least three terminals including a base, an emitter, and a collector. Also in this case, the emitter and the collector may be denoted as the first terminal, the second terminal, etc.

[0053] Note that a semiconductor device refers to a device having a circuit including semiconductor elements (transistors, diodes, thyristors, etc.). Further, generally, a device that can function by utilizing semiconductor characteristics may be called a semiconductor device. Or, a device having a semiconductor material may be called a semiconductor device. Note that a semiconductor device refers to a device having a circuit including semiconductor elements (transistors, diodes, thyristors, etc.). Further, generally, a device that can function by utilizing semiconductor characteristics may be called a semiconductor device. Or, a device having a semiconductor material may be called a semiconductor device. Note that a semiconductor device refers to a device having a circuit including semiconductor elements (transistors, diodes, thyristors, etc.). Further, generally, a device that can function by utilizing semiconductor characteristics may be called a semiconductor device. Or, a device having a semiconductor material may be called a semiconductor device. Note that a semiconductor device refers to a device having a circuit including semiconductor elements (transistors, diodes, thyristors, etc.). Further, generally, a device that can function by utilizing semiconductor characteristics may be called a semiconductor device. Or, a device having a semiconductor material may be called a semiconductor device.

[0054] Note that a display device refers to a device having a display element. Note that the display device may include a plurality of pixels including the display element. Note that the display device may include a peripheral drive circuit for driving a plurality of pixels. Note that the peripheral drive circuit for driving a plurality of pixels may be formed on the same substrate as the plurality of pixels. Note that the display device may include a peripheral drive circuit arranged on the substrate by wire bonding, bumping, etc., that is, an IC chip connected by so-called chip on glass (COG), or an IC chip connected by TAB or the like. Note that the display device may include a flexible printed circuit (FPC) to which an IC chip, a resistive element, a capacitive element, an inductor, a transistor, etc. are attached. Note that the display device may include a printed wiring board (PWB) connected via a flexible printed circuit (FPC) or the like and to which an IC chip, a resistive element, a capacitive element, an inductor, a transistor, etc. are attached. Note that the display device may include an optical sheet such as a polarizing plate or a retardation plate. Note that the display device may include an illumination device, a housing, a voice input / output device, a light sensor, etc. Note that the illumination device may have a backlight unit, a light guide plate, a prism sheet, a diffusion sheet, a reflection sheet, a light source (LED, cold cathode tube, etc.), a cooling device (water-cooled, air-cooled), etc. Note that a light-emitting device refers to a device having a light-emitting element or the like. When having a light-emitting element as a display element, the light-emitting device is one specific example of a display device.

[0055]

[0056]

[0057] Note that the reflection device refers to a device having a light reflection element, a light diffraction element, a light reflection electrode, etc. and the like.

[0058] Note that the liquid crystal display device refers to a display device having a liquid crystal element. The liquid crystal display device includes a direct view type, a projection type, a transmissive type, a reflective type, a transflective type, and the like.

[0059] Note that the driving device refers to a device having a semiconductor element, an electric circuit, or an electronic circuit. For example, a transistor (sometimes called a selection transistor, a switching transistor, etc.) that controls the input of a signal from a source signal line into a pixel, a transistor that supplies a voltage or current to a pixel electrode, a transistor that supplies a voltage or current to a light emitting element, etc. are examples of driving devices. Further, a circuit that supplies a signal to a gate signal line (sometimes called a gate driver, a gate line driving circuit, etc.), a circuit that supplies a signal to a source signal line (sometimes called a source driver, a source line driving circuit, etc.) are examples of driving devices.

[0060] Note that a display device, a semiconductor device, a lighting device, a cooling device, a light emitting device, a reflection device, a driving device, etc. may overlap with each other. For example, a display device may have a semiconductor device and a light emitting device. Alternatively, a semiconductor device may have a display device and a driving device.

[0061] Note that when it is explicitly described that B is formed on A, or B is formed on A, it is not limited to B being directly formed in contact with A. It shall also include cases where they are not in direct contact, that is, cases where another object is interposed between A and B. Here, A and B are objects (for example, devices, elements, circuits, wirings, electrodes, terminals, conductive films, layers , etc.).

[0062] Therefore, for example, when it is explicitly described that layer B is formed on (or above) layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that layer B is formed on layer A (or above layer A), it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that layer B is formed directly in contact with layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that layer B is formed directly in contact with layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that layer B is formed directly in contact with layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer.

[0063] Furthermore, the same applies when it is explicitly described that B is formed above A. It is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that B is formed above A, it is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that B is formed above A, it is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that B is formed above A, it is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that B is formed above A, it is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that B is formed above A, it is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer. When it is described that B is formed above A, it is not limited to the case where B is directly in contact with A, and also includes the case where another object is interposed between A and B. Therefore, for example, when it is described that layer B is formed above layer A, it includes the case where layer B is formed directly in contact with layer A, and the case where another layer (for example, layer C or layer D, etc.) is formed directly in contact with layer A and layer B is formed directly on top of it. Note that another layer (for example, layer C or layer D, etc.) may be a single layer or a multi-layer.

[0064] When it is explicitly described that B is formed on A, B is formed above A, or B is formed above A, it also includes the case where B is formed diagonally above. When it is explicitly described that B is formed on A, B is formed above A, or B is formed above A, it also includes the case where B is formed diagonally above. When it is explicitly described that B is formed on A, B is formed above A, or B is formed above A, it also includes the case where B is formed diagonally above.

[0065] The same also applies to the case where B is below A or B is below A.

[0066] For those explicitly described as singular, it is desirable to be singular. However, it is not limited to this, and it is also possible to have a plurality. Similarly, for those explicitly described as a plurality, it is desirable to have a plurality. However, it is not limited to this, and it is also possible to be singular. and for those described as such, it is desirable to have a plurality. However, it is not limited to this, and it is also possible to be singular.

[0067] In addition, in the figures, there are cases where the size, layer thickness, or area is exaggerated for clarity. Therefore, it is not necessarily limited to that scale.

[0068] In addition, the figures schematically show ideal examples and are not limited to the shapes or values shown in the figures. For example, it is possible to include variations in shape due to manufacturing technology, variations in shape due to errors, variations in signals, voltages, or currents due to noise, or variations in signals, voltages, or currents due to timing deviations. such as variations in shape due to manufacturing technology, variations in shape due to errors, variations in signals, voltages, or currents due to noise, or variations in signals, voltages, or currents due to timing deviations. or currents due to timing deviations.

[0069] In addition, technical terms are often used for the purpose of describing specific embodiments or examples, etc., but are not limited to this.

[0070] In addition, words that are not defined (including scientific and technical words such as technical terms or academic terms) can be used as having the same meaning as the general meaning understood by ordinary skilled persons. Words defined by a dictionary, etc., are preferably interpreted in a meaning that is not inconsistent with the background of the related technology. etc., are preferably interpreted in a meaning that is not inconsistent with the background of the related technology.

[0071] In addition, terms such as first, second, third, etc., are used to describe various elements, members, regions, layers, areas separately from others. Therefore, terms such as first, second, third, etc., do not limit the number of elements, members, regions, layers, areas, etc. Furthermore, for example, "the first" ​​​​​​​It can be replaced with "second", "third", etc.

Advantages of the Invention

[0072] It becomes possible to improve the image quality.

Brief Description of the Drawings

[0073]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Embodiments for Carrying Out the Invention

[0074] Hereinafter, embodiments will be described with reference to the drawings. However, the embodiments can be implemented in many different ways, and it is easily understood by those skilled in the art that the form and details can be variously changed without departing from the spirit and its scope. Therefore, the embodiments should not be construed as being limited to the described content. In the configurations described below, the same part or parts having similar functions are indicated by common reference numerals between different drawings, and detailed descriptions of the same part or parts having similar functions are omitted.

[0075] Note that the content described in one embodiment (even part of the content) can be applied, combined, or replaced with the content described in another part (even part of the content) of the same embodiment, and / or the content described in one or more other embodiments (even part of the content).

[0076] Note that the content described in the embodiments refers to, in each embodiment, using various drawings​​ It refers to the content described as such, or the content described using the text described in the specification.

[0077] Note that the figure (even a part thereof) described in a certain embodiment can be combined with another part of that figure, another figure (even a part thereof) described in that embodiment, and / or a figure (even a part thereof) described in one or more other embodiments to form more figures.

[0078] (Embodiment 1) Super-resolution processing is a process of generating a high-resolution image based on a low-resolution image. Or, super-resolution processing is a process of restoring lost information during shooting or signal transmission. Therefore, due to the low resolution, the fine parts are blurred and averaged. By performing super-resolution processing on the averaged image, an image can be generated that allows accurate recognition even of the fine parts. Therefore, when such a high-resolution image is displayed, a high-quality image can be displayed. For example, in a park where many small stones are arranged, or in a tree with many fine leaves, each small stone and each fine leaf can be accurately identified and seen by performing super-resolution processing. Similarly, unreadable blurred characters can be made readable by performing super-resolution processing so that fine parts can be recognized. For example, super-resolution processing restores image information from an image with a resolution (number of pixels) of 1440×1080 to create an image with a resolution (number of pixels) of 1920×1080. That is, super-resolution processing performs resolution conversion while increasing the information amount of the image from the original image. ​ It is possible to say that it is a technology. Or, super-resolution processing is to restore the frequency components higher than the Nyquist frequency determined by the sampling frequency of the input image among the information contained in the image. It is also possible to say that it is a technology. However, if various processes are performed on the image before performing super-resolution processing, the information of the image will change. Since super-resolution processing is a process of newly creating an image with high resolution, in order to accurately create an image with high resolution, it is desirable to perform super-resolution processing using an image on which various processes related to the image and display have not been performed. That is, it is desirable that various processes be performed after super-resolution processing. However, an example of the embodiment is not limited to this.

[0079] Figure 1 shows an example of the processing flow when various processes are performed after super-resolution processing. In Figure 1(A), a processing flow is shown when super-resolution processing is performed using an image signal obtained from an image source to increase the resolution and then contour enhancement processing is performed. After the contour enhancement processing, various further processes can be performed, and then the image can be displayed. In this way, by performing super-resolution processing before performing contour enhancement processing, the resolution can be accurately improved. Since the image before performing super-resolution processing has not undergone contour enhancement processing, no extra processing has been performed. Therefore, super-resolution processing can be accurately performed. And, using the more accurate and high-resolution image created by super-resolution processing, it is possible to perform various subsequent processes. However, an example of the embodiment is not limited to this. it is possible to perform various subsequent processes. However, an example of the embodiment is not limited to this.

[0080] Figure 1 shows an example of the processing flow when various processes are performed after super-resolution processing.

[0081] In Figure 1(A), a processing flow is shown when super-resolution processing is performed using an image signal obtained from an image source to increase the resolution and then contour enhancement processing is performed. After the contour enhancement processing, various further processes can be performed, and then the image can be displayed. In this way, by performing super-resolution processing before performing contour enhancement processing, the resolution can be accurately improved. Since the image before performing super-resolution processing has not undergone contour enhancement processing, no extra processing has been performed. Therefore, super-resolution processing can be accurately performed. And, using the more accurate and high-resolution image created by super-resolution processing, it is possible to perform various subsequent processes. However, an example of the embodiment is not limited to this.

[0082] In this way, by performing super-resolution processing before performing contour enhancement processing, the resolution can be accurately improved. Since the image before performing super-resolution processing has not undergone contour enhancement processing, no extra processing has been performed. Therefore, super-resolution processing can be accurately performed. And, using the more accurate and high-resolution image created by super-resolution processing, it is possible to perform various subsequent processes. However, an example of the embodiment is not limited to this. it is possible to perform various subsequent processes. However, an example of the embodiment is not limited to this. it is possible to perform various subsequent processes. However, an example of the embodiment is not limited to this. ​​By performing edge enhancement processing, the edges of objects in the image can be obtained more accurately, and a clearer image can be obtained. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing before performing edge enhancement processing. However, an example of the implementation form is not limited to this.

[0083] Regarding the edge enhancement processing, an example of the implementation form is not limited to the above example, and other image processing can be performed. As other image processing, for example, smoothing, distortion correction, error processing, scratch correction, color correction, etc. can be performed instead of, or in addition to, the edge enhancement processing. For example, by performing color correction, an image with an NTSC ratio of 100% or less can be converted into an image of 100% or more. As a result, an image with high color purity can be displayed.

[0084] It should be noted that various other processes can be performed before and after each stage in the processing flow. Examples of various other processes include super-resolution processing, edge enhancement processing, frame interpolation processing, overboard drive processing, local dimming processing, IP conversion processing, enlargement processing, etc., and furthermore, other processes are also possible.

[0085] The image source includes a TV broadcast signal sent from a broadcasting station and / or an image generated from that signal. Or, the image source is a DVD (including for Blu-ray, etc.), a CD, etc. (including a magnetic storage medium or a magneto-optical storage medium), a stream ming, a signal obtained from the Internet, etc., and / or an image generated from that signal. Or, the image source is a mobile phone, a computer, a CPU, a graphic ​​​​​​ It includes signals obtained from a microcomputer for a monitor, a controller, an electronic device, etc., and / or an image generated from such signals. Additionally, the image source also includes the original signal for display and / or an image generated from such signal. In addition, the image source also includes the original signal for display and / or an image generated from such signal. In addition, the image source also includes the original signal for display and / or an image generated from such signal.

[0086] Note that the image includes a still image, and / or a moving image, and / or video.

[0087] Note that the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image. In addition, the image source can be an interlaced (skip-scanned) image or a progressive (non-interlaced, non-skip-scanned) image. Or, the image source can be an image for which IP conversion (interlace-progressive conversion), which is a process of converting an interlaced image into a progressive image, has already been performed. Or, it is possible to perform IP conversion before performing super-resolution processing. FIG. 2(A) shows a part of the processing flow when performing super-resolution processing using a progressive image. FIG. 2(B) shows a part of the processing flow when performing super-resolution processing after IP-converting an interlaced image.

[0088] Normally, super-resolution processing is performed using one image (or a part thereof) or a plurality of images (or parts thereof). And, super-resolution processing creates a high-resolution image by creating new information using those images. Therefore, in order to accurately perform super-resolution processing, it is not desirable for part of the image information to be missing as in the case of interlacing. Therefore, it is desirable for the image on which super-resolution processing is performed to be a progressive (non-interlaced, non-skip-scanned) image. Thus, Normally, super-resolution processing is performed using one image (or a part thereof) or a plurality of images (or parts thereof). And, super-resolution processing creates a high-resolution image by creating new information using those images. Therefore, in order to accurately perform super-resolution processing, it is not desirable for part of the image information to be missing as in the case of interlacing. Therefore, it is desirable for the image on which super-resolution processing is performed to be a progressive (non-interlaced, non-skip-scanned) image. Thus, Normally, super-resolution processing is performed using one image (or a part thereof) or a plurality of images (or parts thereof). And, super-resolution processing creates a high-resolution image by creating new information using those images. Therefore, in order to accurately perform super-resolution processing, it is not desirable for part of the image information to be missing as in the case of interlacing. Therefore, it is desirable for the image on which super-resolution processing is performed to be a progressive (non-interlaced, non-skip-scanned) image. Thus, Normally, super-resolution processing is performed using one image (or a part thereof) or a plurality of images (or parts thereof). And, super-resolution processing creates a high-resolution image by creating new information using those images. Therefore, in order to accurately perform super-resolution processing, it is not desirable for part of the image information to be missing as in the case of interlacing. Therefore, it is desirable for the image on which super-resolution processing is performed to be a progressive (non-interlaced, non-skip-scanned) image. Thus, Normally, super-resolution processing is performed using one image (or a part thereof) or a plurality of images (or parts thereof). And, super-resolution processing creates a high-resolution image by creating new information using those images. Therefore, in order to accurately perform super-resolution processing, it is not desirable for part of the image information to be missing as in the case of interlacing. Therefore, it is desirable for the image on which super-resolution processing is performed to be a progressive (non-interlaced, non-skip-scanned) image. Thus, Normally, super-resolution processing is performed using one image (or a part thereof) or a plurality of images (or parts thereof). And, super-resolution processing creates a high-resolution image by creating new information using those images. Therefore, in order to accurately perform super-resolution processing, it is not desirable for part of the image information to be missing as in the case of interlacing. Therefore, it is desirable for the image on which super-resolution processing is performed to be a progressive (non-interlaced, non-skip-scanned) image. Thus, In the case of an image of an S, IP conversion is performed before super-resolution processing, and it is desirable to perform super-resolution processing using a progressive image. However, an example of an embodiment is not limited to these .

[0089] Note that, as shown in Fig. 2(C), it is desirable that the resolution (number of pixels) of the image after super-resolution processing is higher than that of the image before super-resolution processing. However, an example of an embodiment is not limited to this. For example, assume that the resolution (or number of pixels) is already high due to enlargement processing or the like before super-resolution processing. In that case, since the resolution is already high, the resolution itself does not change before and after super-resolution processing. However, in the enlargement processing before super-resolution processing, the missing image information is not restored. That is , simply being enlarged does not mean that the display itself has high image quality. For example, in a park where many small stones are arranged, or in a tree where many fine leaves are arranged , each small stone or each fine leaf is not accurately displayed by the enlargement processing, but is simply enlarged and displayed in a blurred state . Therefore, by performing super-resolution processing, the resolution (number of pixels) of the image does not change, but it is also possible to obtain a high-quality image in which the missing image information is restored and fine details can be distinguished . That is, as shown in Fig. 2(D), it is also possible to enlarge a 1440×1080 image to a 19 20×1080 image and perform super-resolution processing on a 1920×1080 image to obtain a 1920×1080 image. At this time, when enlarging a 1440×1080 image to a 1920×1080 image, no restored information is obtained. However, for super-resolution processing After the process is performed, since the information has been restored, even fine details can be accurately identified and viewed. It is possible.

[0090] Note that by performing an enlargement process, the resolution can be increased, and then by performing a super-resolution process, the resolution can be further increased. For example, an 800×600 image can be enlarged to a 1440×1080 image, and then the 1440×1080 image can be super-resolved to a 1920×1080 image. However, when the resolution is increased by the enlargement process, the information is not restored. And when the resolution is increased by the super-resolution process, the information is restored. However, an example of the embodiment is not limited to these. Or, by performing a super-resolution process to increase the resolution, and then by performing an enlargement process to increase the resolution. For example, an 800×600 image can be super-resolved to a 1440×1080 image, and then the 1440×1080 image can be enlarged to a 1920×1080 image. However, when the resolution is increased by the enlargement process, the information

[0091] is not restored. And when the resolution is increased by the super-resolution process, the information is restored. However, an example of the embodiment is not limited to these. Or, by performing a super-resolution process to increase the resolution, and then by performing an enlargement process to increase the resolution. For example, an 800×600 image can be super-resolved to a 1440×1080 image, and then the 1440×1080 image can be enlarged to a 1920×1080 image. However, when the resolution is increased by the enlargement process, the information is not restored. And when the resolution is increased by the super-resolution process, the information is restored. However, an example of the embodiment is not limited to these.

[0092] Note that as an example of the enlargement process, it is possible to use the bilinear method or the bicubic method, etc. The bilinear method is a method of collecting and calculating the pixels in the 4-nearest neighbors and interpolating the pixels lacking during enlargement. Or, in the bicubic method, 16 pixel values of 4×4 points are taken out from the original based on the coordinate system after conversion. And these taken-out pixels are used to calculate the pixel values at the new positions. After that, these extracted Weight the 16 - point values and perform a weighted - average - like calculation to determine the pixel value after conversion.

[0093] In this way, before performing processing such as edge enhancement, perform super - resolution processing, that is, after super - resolution processing, perform processing such as edge enhancement, so that a high - resolution image can be accurately created. Furthermore, edge enhancement can be accurately performed. However, the processing performed after super - resolution processing is not limited to edge enhancement and can be similarly applied to other processing cases. Therefore, the content or drawings described in the case of edge enhancement processing can also be similarly applied when other processing is performed. Similarly, the content or drawings described when one processing is performed can also be similarly applied when the other processing is performed. For example, the processing flow when performing frame interpolation processing after super - resolution processing is shown in Fig. 1(B). Frame interpolation processing is a process of creating interpolated frame data when increasing the frame frequency for display in order to reduce afterimages and the like. For example, as shown in Fig. 3, in the image of the first frame, a circle is displayed at the left end, and in the image of the second frame, since the circle has moved from left to right, it is assumed that the circle is displayed at the right end. At this time, data where the circle is displayed in the center is created. The process of creating such data is frame interpolation processing.

[0094] And by frame interpolation processing, it is possible to increase the frame frequency in display by the number of interpolated frames. By performing frame interpolation processing in this way and increasing the frame frequency for display, a smooth image in which the circle moves from left to right can be displayed, and afterimages can be reduced. That is, for moving images, a smooth image can be displayed, and afterimages can be reduced. For example, as shown in Fig. 3, in the image of the first frame, a circle is displayed at the left end, and in the image of the second frame, since the circle has moved from left to right, it is assumed that the circle is displayed at the right end. At this time, data where the circle is displayed in the center is created. The process of creating such data is frame interpolation processing. And by frame interpolation processing, it is possible to increase the frame frequency in display by the number of interpolated frames. By performing frame interpolation processing in this way and increasing the frame frequency for display, a smooth image in which the circle moves from left to right can be displayed, and afterimages can be reduced. That is, for moving images, a smooth image can be displayed, and afterimages can be reduced. By performing frame interpolation processing in this way and increasing the frame frequency for display, a smooth image in which the circle moves from left to right can be displayed, and afterimages can be reduced. That is, for moving images, a smooth image can be displayed, and afterimages can be reduced. The drawing characteristics can be improved.

[0095] In this way, the frame interpolation process is performed, and the driving is performed with the frame frequency increased accordingly. This is called double-speed driving. For example, when the frame frequency is doubled, it is called 2x speed driving, and when the frame frequency is quadrupled, it is called 4x speed driving. In the case of 2x speed driving, images of the same number of frames as the original frames are created by the frame interpolation process. As a result, since the total data amount becomes twice as much, the frame frequency can be doubled for display. Similarly, in the case of 4x speed driving, images of three times the number of original frames are created by the frame interpolation process. As a result, since the total data amount becomes four times as much, the frame frequency can be quadrupled for display. By performing such double-speed driving, the video characteristics can be improved and afterimages can be reduced. As the display device to which this is applied, it is preferably a hold-type display device. For example, it is preferably applied to a liquid crystal display, an organic EL display, etc. Since afterimages are likely to be seen in a hold-type display device, using double-speed driving makes it possible to reduce afterimages.

[0096] In this way, by performing super-resolution processing before performing the frame interpolation process, the resolution can be accurately improved. Since the image before performing the super-resolution processing has not undergone the frame interpolation process, no unnecessary processing is performed. Therefore, the super-resolution processing can be accurately performed. Then, using the more accurate and higher-resolution image created by the super-resolution processing to perform the frame interpolation process, the frame interpolation data can be obtained more accurately. Therefore, it is possible to obtain a smoother image with fewer afterimages. Thus, in order to obtain an image of good quality, it is important to perform super-resolution processing before performing frame interpolation processing. However, an example of an embodiment is not limited to this.

[0097] Here, for an image with a horizontal resolution (number of pixels) of A and a vertical resolution (number of pixels) of B, assuming that by performing super-resolution processing, the horizontal resolution (number of pixels) becomes C and the vertical resolution (number of pixels) becomes D. Or, assuming that for an image with a horizontal resolution (number of pixels) of A and a vertical resolution (number of pixels) of B, by performing enlargement processing and super-resolution processing, the horizontal resolution (number of pixels) becomes C and the vertical resolution (number of pixels) becomes D. At this time, when performing super-resolution processing, the magnification when increasing the resolution is the number obtained by dividing C by A, which is C / A, or, it can be said that it is the number obtained by dividing D by B, which is D / B. On the other hand, when performing double-speed driving, assuming that the frame frequency is multiplied by N. At this time, it is desirable that N > (C / A), or N > (D / B). Or, it is desirable that N ≥ (C / A) and N ≥ (D / B). However, an example of an embodiment is not limited to this.

[0098]

[0099] When performing frame interpolation processing for double-speed driving, even if the number of frame data to be interpolated is increased, data can be created without problems. For example, in the case of FIG. 3(A), it was double-speed, but as shown in FIG. 3(B), by adjusting the position of the circle, it is easily possible to make it three times faster. That is, the frame interpolation processing for double-speed driving ​​​​​​​​​Even if the number of frame data increases, no major problems occur in the image. Or, by increasing the number of interpolated frame data, the video characteristics can be further improved, and it becomes possible to further reduce afterimages.

[0100] On the other hand, super-resolution processing is a process of restoring the resolution information that has been lost during shooting or signal transfer. Therefore, when too much information is lost, it becomes difficult to fully restore it. Therefore, if (C / A) or (D / B) is increased too much, problems occur in the image itself and the image becomes distorted.

[0101] From the above, when performing both frame interpolation processing and super-resolution processing, it is desirable that N > (C / A ), or N > (D / B). Or, it is desirable that N ≥ (C / A) and N ≥ (D / B). Therefore, when performing both super-resolution processing and frame interpolation processing, by satisfying this relationship, it is possible to display a high-quality image with clear visibility down to fine details and no afterimage. However, an example of the embodiment is not limited to this.

[0102] When performing frame interpolation processing, in the area where there is movement on the screen, data is often newly created for frame interpolation processing. And in the area where there is no movement on the screen, data is often not newly created. That is, within the screen, there are areas where new data is created by frame interpolation processing and areas where new data is not created. For example, in the case of FIG. 3(A), as shown in FIG. 3(C), ​In regions 301 and 303, there is no change between the data of the first frame before interpolation and the data of the second frame before interpolation. Therefore, there is no change in the data of the interpolated frame either, and no new data is created. Instead, the data is created using the data of the first frame before interpolation or the data of the second frame before interpolation. On the other hand, in region 302, there is a change between the data of the first frame before interpolation and the data of the second frame before interpolation. Therefore, since there are regions where a circle is erased and regions where a circle is created, new data is being created. That is, when performing frame interpolation processing, there may be regions within the screen where new data is created and regions where new data is not created. And these regions change from moment to moment. For example, examples of regions where data is created include regions where a telop is displayed and the characters move up and down or left and right. In the case of characters, symbols, etc., when a ghost image appears and it becomes difficult to see, it becomes a major problem because it becomes impossible to determine what kind of characters or symbols they are. As described above, when performing frame interpolation processing, it is beneficial to create new data only in some regions within the screen, such as improving the processing speed, reducing power consumption, or improving the processing accuracy. On the other hand, in super-resolution processing as well, it is possible to perform it not in all regions of the screen but only in some regions. That is, when performing super-resolution processing only in some regions of the screen, there are advantages such as improving the processing speed, reducing power consumption, improving the processing accuracy, or reducing image quality degradation.

[0103] In this way, when performing frame interpolation processing, there may be regions within the screen where new data is created and regions where new data is not created. And these regions change from moment to moment. For example, examples of regions where data is created include regions where a telop is displayed and the characters move up and down or left and right. In the case of characters, symbols, etc., when a ghost image appears and it becomes difficult to see, it becomes a major problem because it becomes impossible to determine what kind of characters or symbols they are.

[0104] In this way, when performing frame interpolation processing, making new data only in some regions of the screen has advantages such as improving the processing speed, reducing power consumption, or improving the processing accuracy. That is, making new data only in some regions of the screen when performing frame interpolation processing has advantages such as improving the processing speed, reducing power consumption, or improving the processing accuracy.

[0105] On the other hand, in super-resolution processing as well, it is possible to perform it not in all regions of the screen but only in some regions. That is, when performing super-resolution processing only in some regions of the screen, there are advantages such as improving the processing speed, reducing power consumption, improving the processing accuracy, or reducing image quality degradation. ​ There are advantages such as reduction.

[0106] Therefore, within the screen, there is a first area where new data is created for frame interpolation processing, and a second area where super-resolution processing is performed. Furthermore, there is a third area where no new data is created for frame interpolation processing and no super-resolution processing is performed It is also possible. And it is possible for the first area and the second area to exist within the screen as non-overlapping areas. Or, it is possible for an overlapping area of the first area and the second area to exist within the screen. New data is often created for frame interpolation processing when information such as characters and symbols like telops is displayed, and super-resolution processing is often performed in areas with little movement. Therefore, within the screen, it is preferable for the first area where new data is created for frame interpolation processing and the second area where super-resolution processing is performed to have non-overlapping areas. The reason is as follows. That is, in the first area where new data is created for frame interpolation processing, it is an area with movement, so new data is created for frame interpolation processing to prevent afterimages from being visible. However, in such an area with movement, even if super-resolution processing is performed to increase the resolution, it may be difficult to recognize that resolution with the eyes. Therefore, it can be said that super-resolution processing may not be performed in such an area with movement. And in the second area where super-resolution processing is performed, it is an area where it is desirable to clearly see even fine parts, and it is a static area with no movement area.

[0107] New data is created for frame interpolation processing often when information such as characters and symbols like telops is displayed, and super-resolution processing is often performed in areas with little movement. Therefore, within the screen, it is preferable for the first area where new data is created for frame interpolation processing and the second area where super-resolution processing is performed to have non-overlapping areas. The reason is as follows. That is, in the first area where new data is created for frame interpolation processing, since it is an area with movement, new data is created for frame interpolation processing to prevent afterimages from being visible. However, in such an area with movement, even if super-resolution processing is performed to increase the resolution, it may be difficult to recognize that resolution with the eyes. Therefore, it can be said that super-resolution processing may not be performed in such an area with movement. And in the second area where super-resolution processing is performed, it is an area where it is desirable to clearly see even fine parts, and it is a static area with no movement area. area. In the first area where new data is created for frame interpolation processing, since it is an area with movement, new data is created for frame interpolation processing to prevent afterimages from being visible. However, in such an area with movement, even if super-resolution processing is performed to increase the resolution, it may be difficult to recognize that resolution with the eyes. Therefore, it can be said that super-resolution processing may not be performed in such an area with movement. And in the second area where super-resolution processing is performed, it is an area where it is desirable to clearly see even fine parts, and it is a static area with no movement area. area. area. area where super-resolution processing is performed, it is an area where it is desirable to clearly see even fine parts, and it is a static area with no movement When displaying an image like a still image, it is clear up to fine details It can be said that. Since such a situation may occur, both frame interpolation processing and super-resolution processing Both processes are performed so that a screen having both advantages can be displayed, and at the same time, a first area where new data is created for frame interpolation processing and a second area where super-resolution processing is performed Can have non-overlapping areas. As a result, a more appropriate image can be displayed. However, an example of the embodiment is not limited to this

[0108] Next, as in the case of edge enhancement processing and frame interpolation processing, for the case of overdrive processing as the processing performed after super-resolution processing, the processing flow is shown in Fig. 1(C). Therefore, the content or drawing described in the case of edge enhancement processing can be similarly applied to other processing cases

[0109] Overdrive processing is a process for increasing the response speed of liquid crystal elements. Usually, To each pixel in the screen, a signal matching the gradation to be displayed at each pixel is supplied. However, in the case of liquid crystal elements, since the response speed is slow, even if a signal matching the gradation is supplied, within one frame period Supply pressure. By the above operations, the response speed of the liquid crystal element can be increased. Thus a voltage having an amplitude value larger than the voltage corresponding to the original gradation is temporarily supplied to the liquid crystal element before supplying the voltage corresponding to the original gradation, which is called overdrive driving. Then the process of determining what voltage to supply as a voltage having an amplitude value larger than the voltage corresponding to the original gradation is called overdrive processing.

[0110] Thus, by performing overdrive processing after performing super-resolution processing, the response speed can be increased, the overdrive amount can be set to an appropriate magnitude, and display with less afterimage can be performed. Or, since super-resolution processing is a process of creating a new image, the image changes by that process. Along with that, the gradation of each pixel changes. Therefore, by performing overdrive processing after performing super-resolution processing it becomes possible to change the overdrive processing according to the amount of change caused by the super-resolution processing. Therefore, by performing overdrive processing after performing super-resolution processing the overdrive amount can be set to an appropriate magnitude, so that each pixel can be set to an optimal gradation. Thus, the response speed can be increased, and overdrive driving can be accurately performed. Furthermore, by super-resolution processing, a high-resolution display can be obtained without afterimage. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing before performing overdrive processing. However, an example of an embodiment is not limited to this.

[0111] ​​​​​​​​​​​Here, the overdrive amount refers to the amount by which the amplitude value of the voltage supplied to the liquid crystal element increases due to the overdrive process. The overdrive process is mainly applied to the regions with movement in the screen.

[0112] In the screen, the overdrive process is often performed in the regions where there is movement. In the regions of the screen where there is no movement, since there is no afterimage, the overdrive process is rarely performed. That is, in the screen, there are regions where the overdrive process is performed and regions where the overdrive process is not performed. And these regions change constantly. In this way, when performing the overdrive process only in some regions of the screen, there are advantages such as improving the processing speed, reducing power consumption, or improving the processing accuracy. On the other hand, in the super-resolution process, it is also possible to perform it not in all regions of the screen but only in some regions. In this way, when performing the super-resolution process only in some regions of the screen, there are advantages such as improving the processing speed, reducing power consumption, improving the processing accuracy, or reducing image quality defects.

[0113] When the process is performed in some regions of the screen, in the screen, there is a first region where the overdrive process is performed and a second region where the super-resolution process is performed. Furthermore, it is also possible that there is a third region where neither process is performed. And it is possible that there are non-overlapping regions between the first region and the second region in the screen. Or it is possible that there are overlapping regions between the first region and the second region in the screen.

[0114] When the process is performed in some regions of the screen, in the screen, there is a first region where the overdrive process is performed and a second region where the super-resolution process is performed. Furthermore, it is also possible that there is a third region where neither process is performed. And it is possible that there are non-overlapping regions between the first region and the second region in the screen. Or it is possible that there are overlapping regions between the first region and the second region in the screen. That is, in the screen, there are regions where the overdrive process is performed, regions where the super-resolution process is performed, and regions where neither process is performed.

[0115] Therefore, consider an area where the first area where over-drive processing is performed and the second area where super-resolution processing is performed do not overlap. In such a situation, in the first area where over-drive processing is performed, since it is an area with movement, in order to prevent afterimages from being visible, over-drive processing is performed. However, in such an area with movement, even if super-resolution processing is performed to increase the resolution, it may be difficult to recognize that resolution with the eyes. Therefore, there are cases where super-resolution processing is not performed in such an area with movement, and as a result, in such cases, there may be an area where the first area where over-drive processing is performed and the second area where super-resolution processing is performed do not overlap. And in such a case, in the second area where super-resolution processing is performed, it is an area where it is desirable to clearly see even fine parts, and when displaying an image like a still image without movement, it is possible to clearly see even fine parts. As a result, it can be said that there may be an area where the first area where over-drive processing is performed and the second area where

[0116] super-resolution processing is performed do not overlap. In an area where the first area where over-drive processing is performed and the second area where super-resolution processing is performed overlap, an image with a fast response speed, few

[0117] afterimages, and clear visibility of even fine parts can be displayed, so an image with a sense of presence can be displayed. Yes. Similar to the case of performing edge enhancement processing, frame interpolation processing, and over-drive processing, it is also possible to perform local dimming (local backlight brightness control) processing after the super-resolution imaging. The processing flow in that case is shown in Fig. 1(D). Therefore, the content or drawings described in the case of performing edge enhancement processing, frame interpolation processing, and over-drive processing can also be similarly applied to the case of performing local dimming (local backlight brightness control) processing. Similarly, the content or drawings described in the case of performing local dimming (local backlight brightness control) processing can also be similarly applied to the case of performing another processing. Here, local dimming (local backlight brightness control) refers to a technique of changing the brightness of the backlight in each area within the screen to perform display. Therefore, depending on the image, the brightness of the backlight will be different for each area within one screen. For example, if there is an area within the screen that displays a low tone, the brightness of the backlight in that area is reduced. Further, if there is an area within the screen that displays a high tone, the brightness of the backlight in that area is increased. And based on those backlight brightnesses, the transmittance of each pixel is determined to enable the correct image to be displayed. As a result, within the screen, in the area that displays a low tone, since the brightness of the backlight itself is also low, the influence of light leakage can be reduced. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the brightness of the backlight itself is also high, a sufficiently bright display can be performed. Therefore, in such a

[0118] area, the backlight brightness is high, so a sufficiently bright display can be achieved. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight itself has a high brightness, a sufficiently bright display can be performed. Therefore, in such an area, when it is desired to display black, it can be displayed as complete black. Also, within the screen, in the area that displays a high tone, since the backlight In the field, when it is desired to display white, the luminance is made higher than in the case of normal white, and the peak luminance is made higher, and it becomes possible to display. Therefore, it has come to improve the contrast and be able to display an image with sharpness. Furthermore, by local dimming , since the luminance of the backlight itself can also be lowered, it becomes possible to reduce power consumption. Therefore, in order to perform local dimming, in accordance with the image to be displayed, there are a process for determining the luminance of the backlight in each area and a process for determining the transmittance of each pixel so that the image to be displayed can be correctly displayed on the premise of the backlight luminance. These processes, or some of these processes, are called local dimming processes. Therefore, in the local dimming process, after performing the process of determining the luminance of the backlight in each area, it is possible to perform the process of determining the video signal supplied to each pixel. However, an example of the embodiment is not limited to this. Therefore, as an example, as a processing flow in the case of separately describing the process of determining the luminance of the backlight in each area and the process of determining the video signal supplied to each pixel, it can also be represented as shown in FIG. 1(E). As described above, it is preferable to perform local dimming processing after performing super-resolution processing. When super-resolution processing is performed, a state is obtained in which new information is added by restoring information. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, an area where the number of gradations of the pixels changes before and after super-resolution processing will exist within the screen. Therefore, after the image information has been restored by super-resolution processing, local dimming processing is performed. However, the present invention is not limited to this. Therefore, as an example, as a processing flow in the case of separately describing the process of determining the luminance of the backlight in each area and the process of determining the video signal supplied to each pixel, it can also be represented as shown in FIG. 1(E). Therefore, in the local dimming process, after performing the process of determining the luminance of the backlight in each area, it is possible to perform the process of determining the video signal supplied to each pixel. However, an example of the embodiment is not limited to this. Therefore, as an example, as a processing flow in the case of separately describing the process of determining the luminance of the backlight in each area and the process of determining the video signal supplied to each pixel, it can also be represented as shown in FIG. 1(E). As described above, it is preferable to perform local dimming processing after performing super-resolution processing. When super-resolution processing is performed, a state is obtained in which new information is added by restoring information. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or,

[0119] an area where the number of gradations of the pixels changes before and after super-resolution processing will exist within the screen. Therefore, after the image information has been restored by super-resolution processing, local dimming processing is performed. When super-resolution processing is performed, a state is obtained in which new information is added by restoring information. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, an area where the number of gradations of the pixels changes before and after super-resolution processing will exist within the screen. Therefore, after the image information has been restored by super-resolution processing, local dimming processing is performed. By performing the dimming process, the local dimming process can be accurately performed, so that the contrast can be improved and an accurate image can be displayed. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing before performing the local dimming process. Alternatively, in the local dimming process, it is important to perform super-resolution processing before performing the process of determining the brightness of the backlight. Alternatively, in the local dimming process, it is important to perform super-resolution processing before performing the process of determining the video signal supplied to the pixel . However, an example of the embodiment is not limited to these.

[0120] Furthermore, when the local dimming process is being performed, since the brightness of the backlight is low, even if the transmittance of the pixel changes slightly, the actual display gradation does not change much. Conversely, in a state where the brightness of the backlight is low, by changing the transmittance of the pixel it is possible to express finer gradations. That is, it is possible to make it seem that the number of gradations that can be displayed has increased. Therefore, by performing both the local dimming process and the super-resolution process it is possible to display a high-resolution image with high expressiveness that can distinguish fine parts. In particular, in a dark gradation area within the screen, it is possible to appropriately express the gradation and avoid displaying a gradation that is crushed.

[0121] Note that in an area of the screen where there are many displays with a small number of gradations, the local dimming process is often performed. And in an area of the screen where there are many displays with a large number of gradations, that is, in an area where there are many bright displays with high brightness, it is difficult to lower the brightness of the backlight, so Local dimming processing is rarely performed. That is, within the screen, there are areas where local dimming processing is performed and areas where local dimming processing is not performed. And these areas change from moment to moment. Thus, when performing local dimming processing only in some areas of the screen, there are advantages such as improved processing speed, reduced power consumption, and improved processing accuracy. On the other hand, in super-resolution processing as well, it is also possible to perform it not in all areas of the screen but only in some areas. Thus, when performing super-resolution processing only in some areas of the screen, there are advantages such as improved processing speed, reduced power consumption, improved processing accuracy, or reduction of image quality degradation.

[0122] When processing is performed in some areas of the screen, within the screen, there is a first area where local dimming processing is performed and the backlight brightness is reduced, and a second area where super-resolution processing is performed. Furthermore, it is also possible that there is a third area where neither local dimming processing nor super-resolution processing is performed. And it is possible that within the screen, there are areas where the first area where local dimming processing is performed and the backlight brightness is reduced and the second area where super-resolution processing is performed do not overlap. Or, it is possible that within the screen, there are areas where the first area and the second area overlap. In an area where the first area where local dimming processing is performed and the backlight brightness is reduced overlaps with the second area where super-resolution processing is performed, the contrast is high and smooth.

[0123] When processing is performed in some areas of the screen, within the screen, there is a first area where local dimming processing is performed and the backlight brightness is reduced, and a second area where super-resolution processing is performed. Furthermore, it is also possible that there is a third area where neither local dimming processing nor super-resolution processing is performed. And it is possible that within the screen, there are areas where the first area where local dimming processing is performed and the backlight brightness is reduced and the second area where super-resolution processing is performed do not overlap. Or, it is possible that within the screen, there are areas where the first area and the second area overlap. In an area where the first area where local dimming processing is performed and the backlight brightness is reduced overlaps with the second area where super-resolution processing is performed, the contrast is high and smooth.

[0124] In the area where the first area where local dimming processing is performed and the backlight brightness is reduced overlaps with the second area where super-resolution processing is performed, the contrast is high and smooth. An image capable of tone reproduction, and since fine details can be clearly seen, a realistic image can be displayed.

[0125] When local dimming is performed, the inside of the screen is divided into a plurality of regions, and backlights are arranged in each region. Comparing the length (or width) of the region, or the pitch of the region, with the length (or width) of the pixels of the display device that displays an image with improved resolution by performing super-resolution processing in a partial region of the screen, it is preferable that the length (or width) of the region of the backlight, or the pitch of the region, is longer. This is because when local dimming is performed, not only the brightness of the backlight in each region but also the transmittance of the pixels is controlled to display an image. Therefore, even when an image subjected to super-resolution processing is displayed, if the length (or width) of the region of the backlight, or the pitch of the region, is long and the pitch of each

[0126] Although the processing flow from FIG. 1(A) to FIG. 1(E) has been shown, an example of the configuration (block diagram) in the case of realizing it is shown in FIG. 1(F). An image source is input to the input terminal of circuit 101. And the output terminal of circuit 101 is connected to the input terminal of circuit 102. Circuit 101 has a function of performing super-resolution processing. Circuit 102 has functions of performing edge enhancement processing, frame interpolation processing, overdrive processing, or local dimming processing. Circuit 101 or circuit 102 can have a storage circuit (memory It is possible to have the unit.

[0127] Note that circuit 101 and / or circuit 102 can each realize the functions they have using hardware or can realize the functions using software and can also realize the functions using both hardware and software. By realizing with hardware it is possible to increase the processing speed. Or, it is possible to reduce the power consumption. By realizing with software it is possible to change the processing content and appropriately perform various processes.

[0128] Note that even when the number of processes increases, by increasing circuits such as circuit 101 and circuit 102 it is possible to configure the circuit in the same manner as in FIG. 1(F).

[0129] Note that in the content described so far and / or in the content described below, instead of super-resolution processing it is also possible to perform simple enlargement processing or the like.

[0130] (Embodiment 2) Next, an example of super-resolution processing technology will be described. By performing super-resolution processing, it is possible to display a high-resolution image.

[0131] First, a region with motion is detected and the velocity information of the region is extracted. That is, for an image at an arbitrary point, an optical flow, which is a vector representing the flow of each pixel, is obtained from the two images before and after that image. Then, from the extracted velocity information, the amount of positional shift per image of the region is detected with an accuracy less than the size of one pixel. That is, the obtained optical flow To obtain the amount of misregistration between images. Then, based on the detected amount of misregistration, the luminance values between pixels are interpolated from a plurality of images in the image sequence. By performing such processing, it is possible to generate a high-resolution image that exceeds the physical resolution. Thus, the super-resolution processing technology is a technology for extracting and restoring information for high-resolution image restoration, such as motion vector information, from low-resolution images. can be said to be

[0132] As another method of super-resolution processing technology, for example, first, select consecutive frames with high correlation from the video. Then, detect the motion vectors of the video at a fine granularity close to the pixel unit and track the motion at the pixel unit. From the change information of the tracked pixels between each frame, infer the missing high-resolution pixels. At that time, because the camera is shaking slightly even though the same part is being photographed, the blurring of the photographed low-resolution part is different between frames. Therefore, using this information, it is possible to fill in the missing pixels and increase the resolution to high resolution. That is, this processing method can be said to be a type of super-resolution processing technology that deeply explores in the time direction. In the case of this super-resolution processing, since the motion vectors can be precisely grasped, it is also possible to restore the missing pixels between frames that could not be obtained due to the relationship of the camera resolution during shooting.

[0133] Alternatively, as another super-resolution processing, investigate the similarity for a plurality of frames. Then, align the frames with similarity and grasp the temporal change of each pixel. And it is possible to use a method of predicting and generating the lost high-resolution pixels.

[0134] ​​​​​​​Alternatively, as another super-resolution process, first, a plurality of consecutive image information is analyzed. And The common parts of the subject are corrected to restore the high-frequency components. Thus, an image with high resolution can be obtained.

[0135] Alternatively, as another super-resolution process, it is possible to use a reconstruction-type super-resolution processing method. In the reconstruction-type super-resolution processing method, first, from the original low-resolution image, a high-resolution image (initial high resolution image) is assumed. And from the assumed high-resolution image, based on the point spread function (PSF function) obtained by the camera model, for each pixel of all the low-resolution images, its pixel value is estimated. That is, it is down-converted by a unique function (imaging model function) to create a low-resolution image that is the same as the original low resolution image. And the difference between the estimated value and the observed pixel value (observed value) is taken. And for the image before down-conversion, a high-resolution image is searched for such that the difference becomes small. Note that this search process can be repeated until convergence to improve the accuracy or the search can be done only once. Thus a high-resolution image can be obtained.

[0136] Note that as the imaging model function, for example, a one-dimensional linear filter can be used as an imaging device model that is multiplied two-dimensionally vertically and horizontally. is possible.

[0137] In the case of this reconstruction-type super-resolution processing method, due to the iterative calculation that requires an initial high-resolution image, the high-resolution image is reconstructed. And as the calculation method at that time, M L (Maximum-likelihood) method, MAP (Maximum A Pos terior) method, or POCS (Projection On to Conve It is possible to use methods such as the x Sets method.

[0138] In the ML method, the estimated pixel value from the assumed high-resolution image and the actually observed pixel value are used as the evaluation function with the square error. Then, a high-resolution image that minimizes the evaluation function is used as the estimated image.

[0139] The MAP method is a method for estimating a high-resolution image that minimizes an evaluation function obtained by adding the probability information of the high-resolution image to the square error That is, the MAP method is a super-resolution processing method for estimating a high-resolution image as an optimization problem that maximizes the posterior probability by using certain prior information for the high-resolution image.

[0140] The POCS method is a method for creating a system of simultaneous equations for the pixel values of the high-resolution image and the low-resolution image and sequentially solving the equations.

[0141] Note that a plurality of frames of the image are combined into one frame. Then, the number of pixels is increased to increase the resolution of the image. At that time, it is also possible to perform super-resolution processing so as to cancel the aliasing component.

[0142] Alternatively, as a super-resolution processing method, it is possible to use iterative methods, frequency domain methods, statistical methods, etc. In the case of iterative methods, it mainly consists of three stages. First, an initial estimate is made secondly, there is an imaging process, and thirdly, it consists of a reconstruction process.

[0143] Note that super-resolution processing can be performed on the entire screen. However, an example of the implementation form is not limited to these. Depending on the content of the image, super-resolution processing can be performed ​​​​​It is possible. For example, in an image, in the edge part or flat part, super-resolution processing is not performed, while in the texture part, it is possible to perform super-resolution processing. In that case, real-time spectrum analysis is performed on the image. Then, super-resolution processing can be performed only on the region having high frequencies. In this way, by controlling the presence or absence of super-resolution processing according to the image, it is possible to reduce the possibility that the image will deteriorate conversely.

[0144] Note that the flat part is a part where the frequency of a specific frequency region or a concentrated luminance region is highly distributed. Therefore, it corresponds to, for example, a sky with a relatively smooth color distribution or a blurred background. Thus, it can be said that in the image, it is mainly a region where gradation expression is the main part.

[0145] Note that the texture part is a part with high frequency of the image. In this region, since the frequency is high, there is a high possibility that more detailed parts exist. Therefore, by performing super-resolution processing in the texture part, it can be said that the effect of increasing the resolution is very large.

[0146] Note that when performing super-resolution processing, it is also possible to recognize the resolution in various regions of the image and perform super-resolution processing with different intensities for each region.

[0147] Note that when the resolution of the original image is sufficiently high, it is possible not to perform super-resolution processing.

[0148] In this way, there are various super-resolution processing techniques, but the super-resolution processing technique in this specification is not limited to these.

[0149] ​​​​ (Embodiment 3) In Embodiment 1 and Embodiment 2, super-resolution processing and other processing, for example, edge enhancement processing , frame interpolation processing, overdrive processing, local dimming (local brightness control of the backlight) processing, etc. were shown. However, an example of the embodiment is not limited to these, and in addition to super-resolution processing and other processing, edge enhancement processing, frame interpolation processing, overdrive processing, local dimming (local brightness control of the backlight) processing, etc. can also be further performed . . .

[0150] Therefore, it is possible to combine and apply the content (even a part) and the figure (even a part) described in Embodiment 1 and Embodiment 2 to this embodiment . .

[0151] For example, FIG. 4 shows a processing flow when, in addition to super-resolution processing and edge enhancement processing, another process is further performed. That is, it corresponds to the case where another process is further performed on the content described in FIG. 1(A). However, an example of the embodiment is not limited to these . .

[0152] In FIG. 4(A), using the image signal obtained from the image source, super-resolution processing is performed to increase the resolution, and then frame interpolation processing is performed. After the frame frequency becomes high, the processing flow when edge enhancement processing is performed is shown. Therefore, the processing flow in FIG. 4(A) also corresponds to the case where edge enhancement processing is performed after the processing flow in FIG. 1(B). Or, the processing flow in FIG. 4(A) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 1(A) . . . . .

[0153] ​After the contour enhancement process, various additional processes may be performed, and then the image can be displayed.

[0154] Thus, by performing the super-resolution process before the frame interpolation process and the contour enhancement process, the resolution can be accurately improved. The image before the super-resolution process has not undergone the frame interpolation process and the contour enhancement process, so no unnecessary processes are performed. Therefore, the super-resolution process can be accurately performed. And by using a more accurate and higher-resolution image to perform the frame interpolation process, the frame interpolation data can be obtained more accurately, so a smoother image with less afterimage can be obtained. In particular, by performing the frame interpolation process before the contour enhancement process, the frame interpolation data can be accurately created. And by using a more accurate and higher-resolution image to perform the contour enhancement process, the contours of the objects in the image can be obtained more accurately, so a clearer image can be obtained.

[0155] In FIG. 4(B), a processing flow is shown for the case where super-resolution processing is performed using the image signal obtained from the image source to increase the resolution, then contour enhancement processing is performed, and then frame interpolation processing is performed to increase the frame frequency. Therefore, the processing flow of FIG. 4(B) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow of FIG. 1(B). Or the processing flow of FIG. 4(B) also corresponds to the case where frame interpolation processing is performed after the processing flow of FIG. 1(A).

[0156]

[0157] ​​​​​​​​​​​​​Note that after the frame interpolation process, various other processes are performed, and then the image can be displayed.

[0158] In this way, by performing the super-resolution process before the edge enhancement process and the frame interpolation process, the resolution can be accurately improved. Since the image before the super-resolution process has not undergone the edge enhancement process and the frame interpolation process, no unnecessary processes are performed. Therefore, the super-resolution process can be accurately performed.

[0159] Then, by performing the frame interpolation process using a more accurate and higher-resolution image, frame interpolation data can be obtained more accurately, so that a smoother image with fewer afterimages can be obtained. Furthermore, since the edge enhancement process is performed before the frame interpolation process, the number of data for the edge enhancement process is small. Therefore, the processing time can be shortened.

[0160] In FIG. 4(C), the processing flow when performing the super-resolution process using the image signal obtained from the image source to increase the resolution, then performing the edge enhancement process, and then performing the over-drive process is shown. Therefore, the processing flow in FIG. 4(C) also corresponds to the case where the edge enhancement process is performed with respect to the processing flow in FIG. 1(C). Or, the processing flow in FIG. 4(C) also corresponds to the case where the over-drive process is performed after the processing flow in FIG. 1(A).

[0161] In this way, by performing the super-resolution process before the edge enhancement process, the resolution can be accurately improved. Since the image before the super-resolution process has not undergone the edge enhancement process, ​​​​​​​​​​​​Therefore, no unnecessary processing is performed. This allows for accurate super-resolution processing. Or, after performing super-resolution processing and edge enhancement processing, overdrive processing can be performed. This allows the response speed to be increased and the amount of overdrive to be set to an appropriate level. This allows for a display with less residual images. As the image changes due to processing, the gradation of each pixel changes. Depending on the amount of data, it is possible to change the overdrive processing. After image processing and edge enhancement, overdrive processing is performed to reduce the overdrive noise. Since the amount of overdrive can be adjusted to an appropriate value, each pixel can be made to have the optimal gradation. This allows the response speed to be increased and overdrive driving to be performed accurately. Furthermore, super-resolution processing makes it possible to display high resolution images without image retention. In addition, the edge enhancement process makes it possible to display images with clear edges. Therefore, in order to obtain a good quality image, it is recommended to use the super- It is important to perform resolution processing and edge enhancement processing. Not limited to:

[0162] In Fig. 4(D), the image signal obtained from the image source is used to perform super-resolution processing to increase the resolution. After the brightness is increased, contour emphasis processing is performed, and then local dimming processing is performed. Therefore, the process flow in FIG. 4(D) is different from the process flow in FIG. 4(D) corresponds to the case where edge enhancement processing is performed. This also corresponds to the case where local dimming processing is performed after the processing flow of A).

[0163] Thus, by performing super-resolution processing before performing edge enhancement processing, the resolution can be accurately improved. The image before performing super-resolution processing has not undergone edge enhancement processing, so no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed. Before performing super-resolution processing, the image has not undergone edge enhancement processing, so no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed. Before performing super-resolution processing, the image has not undergone edge enhancement processing, so no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed. .

[0164] Alternatively, it is preferable to perform local dimming processing after performing super-resolution processing and edge enhancement processing. When super-resolution processing is performed, new information is added due to information restoration. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, there may be a region where the number of gradations of pixels changes within the screen before and after super-resolution processing. Similarly, the image is processed such that the outlines of objects in the image are emphasized by edge enhancement processing. Therefore, there will be a region where the number of gradations of pixels changes within the screen. Therefore, after the image information is restored by super-resolution processing and the image is processed by edge enhancement processing, by performing local dimming processing, local dimming processing can be accurately performed, so that the contrast can be improved, and an accurate image can be displayed. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing and edge enhancement processing before performing local dimming processing. Or, in local dimming processing, it is important to perform super-resolution processing and edge enhancement processing before performing the process of determining the luminance of the backlight. Or, in local dimming processing, it is important to perform super-resolution processing before performing the process of determining the video signal supplied to the pixels. When super-resolution processing is performed, new information is added due to information restoration. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, there may be a region where the number of gradations of pixels changes within the screen before and after super-resolution processing. When super-resolution processing is performed, new information is added due to information restoration. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, there may be a region where the number of gradations of pixels changes within the screen before and after super-resolution processing. Or, there may be a region where the number of gradations of pixels changes within the screen before and after super-resolution processing. Similarly, the image is processed such that the outlines of objects in the image are emphasized by edge enhancement processing. Therefore, there will be a region where the number of gradations of pixels changes within the screen. . Therefore, after the image information is restored by super-resolution processing and the image is processed by edge enhancement processing, by performing local dimming processing, local dimming processing can be accurately performed, so that the contrast can be improved, and an accurate image can be displayed. Therefore, after the image information is restored by super-resolution processing and the image is processed by edge enhancement processing, by performing local dimming processing, local dimming processing can be accurately performed, so that the contrast can be improved, and an accurate image can be displayed. . Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing and edge enhancement processing before performing local dimming processing. . Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing and edge enhancement processing before performing local dimming processing. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing and edge enhancement processing before performing local dimming processing. . Or, in local dimming processing, it is important to perform super-resolution processing and edge enhancement processing before performing the process of determining the luminance of the backlight. . Or, in local dimming processing, it is important to perform super-resolution processing and edge enhancement processing before performing the process of determining the luminance of the backlight. . Or, in local dimming processing, it is important to perform super-resolution processing before performing the process of determining the video signal supplied to the pixels. It is important to perform edge extraction and contour enhancement processing. However, an example of an embodiment is not limited to these. It is not limited thereto.

[0165] In FIG. 4(E), using the image signal obtained from the image source, super-resolution processing is performed to increase the resolution, and then frame interpolation processing is performed to increase the frame frequency, and then the processing flow in the case of performing overdrive processing is shown. Therefore, the processing flow of FIG. 4(E) also corresponds to the case where overdrive processing is performed after the processing flow of FIG. 1(B). Or, the processing flow of FIG. 4(E) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow of FIG. 1(C). ). ). E) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow of FIG. 1(C). ).

[0166] In this way, by performing super-resolution processing before performing frame interpolation processing, the resolution can be accurately improved. Since the image before performing super-resolution processing has not undergone frame interpolation processing, no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed. Since the image before performing super-resolution processing has not undergone frame interpolation processing, no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed. Therefore, super-resolution processing can be accurately performed. ).

[0167] Or, by performing overdrive processing after performing super-resolution processing and frame interpolation processing, the response speed can be increased, the overdrive amount can be set to an appropriate size, and display with less afterimage can be performed. Or, since the gradation of each pixel changes as the image changes by super-resolution processing and frame interpolation processing, the overdrive processing can also be changed according to the amount of change. Or, since the frame frequency increases by frame interpolation processing, the overdrive processing can also be changed accordingly. Therefore, super-resolution processing and frame interpolation processing Or, by performing overdrive processing after performing super-resolution processing and frame interpolation processing, the response speed can be increased, the overdrive amount can be set to an appropriate size, and display with less afterimage can be performed. Or, since the gradation of each pixel changes as the image changes by super-resolution processing and frame interpolation processing, the overdrive processing can also be changed according to the amount of change. Or, since the frame frequency increases by frame interpolation processing, the overdrive processing can also be changed accordingly. Therefore, super-resolution processing and frame interpolation processing ). Or, since the gradation of each pixel changes as the image changes by super-resolution processing and frame interpolation processing, the overdrive processing can also be changed according to the amount of change. Or, since the frame frequency increases by frame interpolation processing, the overdrive processing can also be changed accordingly. Therefore, super-resolution processing and frame interpolation processing ). Or, since the frame frequency increases by frame interpolation processing, the overdrive processing can also be changed accordingly. Therefore, super-resolution processing and frame interpolation processing ). After performing the over-drive process, the over-drive amount can be made appropriate in size, so that each pixel can be set to an optimal gradation. Therefore, the response speed can be increased, and the over-drive driving can be accurately performed. Furthermore, by the super-resolution process, a high-resolution display can be obtained without afterimages. Therefore, in order to obtain an image with good image quality, it is important to perform the super-resolution process and the frame interpolation process before performing the over-drive process. However, an example of the embodiment is not limited to this. After performing the over-drive process, the over-drive amount can be made appropriate in size, so that each pixel can be set to an optimal gradation. Therefore, the response speed can be increased, and the over-drive driving can be accurately performed. Furthermore, by the super-resolution process, a high-resolution display can be obtained without afterimages. Therefore, in order to obtain an image with good image quality, it is important to perform the super-resolution process and the frame interpolation process before performing the over-drive process. However, an example of the embodiment is not limited to this. In FIG. 4(F), after performing the super-resolution process using the image signal obtained from the image source to increase the resolution, the frame interpolation process is performed to increase the frame frequency, and then the local dimming process is performed. The processing flow in this case is shown. Therefore, the processing flow in FIG. 4(F) also corresponds to the case where the local dimming process is performed after the processing flow in FIG. 1(B). Or, the processing flow in FIG. 4(F) also corresponds to the case where the frame interpolation process is performed with respect to the processing flow in FIG. 1(D). However, an example of the embodiment is not limited to this. .

[0168] In FIG. 4(F), after performing the super-resolution process using the image signal obtained from the image source to increase the resolution, the frame interpolation process is performed to increase the frame frequency, and then the local dimming process is performed. The processing flow in this case is shown. Therefore, the processing flow in FIG. 4(F) also corresponds to the case where the local dimming process is performed after the processing flow in FIG. 1(B). Or, the processing flow in FIG. 4(F) also corresponds to the case where the frame interpolation process is performed with respect to the processing flow in FIG. 1(D). In FIG. 4(F), after performing the super-resolution process using the image signal obtained from the image source to increase the resolution, the frame interpolation process is performed to increase the frame frequency, and then the local dimming process is performed. The processing flow in this case is shown. Therefore, the processing flow in FIG. 4(F) also corresponds to the case where the local dimming process is performed after the processing flow in FIG. 1(B). Or, the processing flow in FIG. 4(F) also corresponds to the case where the frame interpolation process is performed with respect to the processing flow in FIG. 1(D). Therefore, the processing flow in FIG. 4(F) also corresponds to the case where the local dimming process is performed after the processing flow in FIG. 1(B). Or, the processing flow in FIG. 4(F) also corresponds to the case where the frame interpolation process is performed with respect to the processing flow in FIG. 1(D). However, an example of the embodiment is not limited to this. In FIG. 4(F), after performing the super-resolution process using the image signal obtained from the image source to increase the resolution, the frame interpolation process is performed to increase the frame frequency, and then the local dimming process is performed. The processing flow in this case is shown. Therefore, the processing flow in FIG. 4(F) also corresponds to the case where the local dimming process is performed after the processing flow in FIG. 1(B). Or, the processing flow in FIG. 4(F) also corresponds to the case where the frame interpolation process is performed with respect to the processing flow in FIG. 1(D). However, an example of the embodiment is not limited to this.

[0169] Thus, by performing the super-resolution process before performing the frame interpolation process, the resolution can be accurately improved. Since the image before performing the super-resolution process has not undergone the frame interpolation process, no extra processing is performed. Therefore, the super-resolution process can be accurately performed. Since the image before performing the super-resolution process has not undergone the frame interpolation process, no extra processing is performed. Therefore, the super-resolution process can be accurately performed. Since the image before performing the super-resolution process has not undergone the frame interpolation process, no extra processing is performed. Therefore, the super-resolution process can be accurately performed. Since the image before performing the super-resolution process has not undergone the frame interpolation process, no extra processing is performed. Therefore, the super-resolution process can be accurately performed.

[0170] Alternatively, it is desirable to perform the local dimming process after performing the super-resolution process and the frame interpolation process. When the super-resolution process is performed, new information is added by the restoration of information. Alternatively, it is desirable to perform the local dimming process after performing the super-resolution process and the frame interpolation process. When the super-resolution process is performed, new information is added by the restoration of information. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, there are areas on the screen where the number of pixel gradations changes before and after super-resolution processing. Similarly, a new frame is created by the frame interpolation process, and a new Therefore, there are areas on the screen where the number of pixel gradations changes. Therefore, the image information is restored by the super-resolution process, and frame compensation is performed. By performing local dimming after image processing, It can perform local dimming processing accurately, improving contrast. Therefore, in order to obtain a good quality image, To achieve this, super-resolution processing and frame interpolation processing are performed before local dimming processing. It is important to determine the brightness of the backlight in local dimming processing. It is important to perform super-resolution processing and frame interpolation processing before performing processing to determine the image quality. Or, in local dimming processing, a process is performed to determine the video signal to be supplied to the pixel. It is important to perform super-resolution processing and frame interpolation processing before the image is captured. Examples of the aspect are not limited to these.

[0171] In Fig. 5(A), the image signal obtained from the image source is used for super-resolution processing to improve the resolution. When you first increase the brightness, then perform local dimming and then overdrive. Therefore, the process flow of FIG. 5(A) is the same as the process flow of FIG. 1(C). This also corresponds to the case where local dimming processing is performed on the image. The process flow is equivalent to the process flow in FIG. 1(D) followed by overdrive processing. Do it.

[0172] Thus, it is preferable to perform local dimming processing after performing super-resolution processing. When super-resolution processing is performed, due to the restoration of information, a state is created where new information is added. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, a region where the number of gradations of the pixels changes before and after super-resolution processing will exist within the screen. Thus, after the image information has been restored by super-resolution processing, by performing local dimming processing, the local dimming processing can be accurately performed, so that the contrast can be improved and an accurate image can be displayed. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing before performing local dimming processing. Or, in local dimming processing, it is important to perform super-resolution processing before performing the process of determining the brightness of the backlight. Or, in local dimming processing, it is important to perform super-resolution processing before performing the process of determining the video signal supplied to the pixels. However, an example of the embodiment is not limited to these. Or, by performing overdrive processing after performing super-resolution processing and local dimming processing, the response speed can be increased, the amount of overdrive can be set to an appropriate size, and a display with less afterimage can be performed. Or, as the brightness of the image and the backlight changes due to super-resolution processing and local dimming processing, since the gradation of each pixel changes, the overdrive processing also changes according to the amount of change.

[0173] Or, after performing super-resolution processing and local dimming processing, by performing overdrive processing, the response speed can be increased, the amount of overdrive can be set to an appropriate size, and a display with less afterimage can be performed. Or, as the brightness of the image and the backlight changes due to super-resolution processing and local dimming processing, since the gradation of each pixel changes, the overdrive processing also changes according to the amount of change. As the brightness of the image and the backlight changes due to super-resolution processing and local dimming processing, since the gradation of each pixel changes, the overdrive processing also changes according to the amount of change. This becomes possible. Therefore, after performing super-resolution processing and local dimming processing by performing overdrive processing, the overdrive amount can be set to an appropriate size so that each pixel can be set to an optimal gradation. Thus, the response speed can be increased and overdrive driving can be performed accurately. Furthermore, by super-resolution processing a high-resolution display can be obtained without afterimages. Also, by local dimming processing, it becomes possible to display an image with high contrast. Therefore, in order to obtain an image with good image quality, it is important to perform super-resolution processing and local dimming processing before performing overdrive processing. However, an example of an embodiment is not limited to this.

[0174] In this way, when both local dimming processing and overdrive processing are performed, as shown in FIG. 5(B), it is preferable to perform overdrive processing after performing local dimming processing. However, an example of an embodiment is not limited to this. Note that various other processes can be performed before and after each stage in the processing flow. Examples of various other processes include super-resolution processing, edge enhancement processing, frame interpolation processing, overdrive processing, local dimming processing, IP conversion processing, enlargement processing, etc., and furthermore, other processes are also possible.

[0175] Therefore, in FIG. 4(D), when performing overdrive processing, or in FIG. 4( C), when performing local dimming processing, it is preferable to have a processing flow as shown in FIG. 5(C). However, an example of an embodiment is not limited to this.

[0176] Or, in FIG. 4(F), when performing over-drive processing, or in FIG. 4(E) when performing local dimming processing, it is preferable to have a processing flow as shown in FIG. 5(D). However, an example of the embodiment is not limited to this.

[0177] Next, in FIG. 6(A), using the image signal obtained from the image source, super-resolution processing is performed, and after increasing the resolution, frame interpolation processing is performed to increase the frame frequency, and then contour enhancement processing is performed. After that, the processing flow when performing over-drive processing is shown. However, an example of the embodiment is not limited to this. Therefore, the processing flow in FIG. 6(A) also corresponds to the case where over-drive processing is performed after the processing flow in FIG. 4( A). Or, the processing flow in FIG. 6(A) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow in FIG. 4(C). Or, the processing flow in FIG. 6(A) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow in FIG. 4(E). A). Or, the processing flow in FIG. 6(A) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow in FIG. 4(C). Or, the processing flow in FIG. 6(A) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow in FIG. 4(E). (A). Or, the processing flow in FIG. 6(A) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow in FIG. 4(C). Or, the processing flow in FIG. 6(A) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow in FIG. 4(E).

[0178] Similarly, in FIG. 6(B), using the image signal obtained from the image source, super-resolution processing is performed, and after increasing the resolution, contour enhancement processing is performed, and then frame interpolation processing is performed to increase the frame frequency. After that, the processing flow when performing over-drive processing is shown. However, an example of the embodiment is not limited to this. Therefore, the processing flow in FIG. 6(B) also corresponds to the case where over-drive processing is performed after the processing flow in FIG. 4 (B). Or, the processing flow in FIG. 6(B) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow in FIG. 4(C). Or, the processing flow in FIG. 6(B) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow in FIG. 4(E). (B). Or, the processing flow in FIG. 6(B) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow in FIG. 4(C). Or, the processing flow in FIG. 6(B) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow in FIG. 4(E). 6(B). Or, the processing flow in FIG. 6(B) also corresponds to the case where frame interpolation processing is performed with respect to the processing flow in FIG. 4(C). Or, the processing flow in FIG. 6(B) also corresponds to the case where contour enhancement processing is performed with respect to the processing flow in FIG. 4(E). ​​​​​​​​This also corresponds to the case where edge enhancement processing is performed.

[0179] Before performing edge enhancement processing and frame interpolation processing, as shown in FIGS. 6(A) and 6(B), by performing super-resolution processing, the resolution can be accurately improved. Since the image before performing super-resolution processing has not undergone edge enhancement processing and frame interpolation processing, no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed.

[0180] Similarly, after performing super-resolution processing, frame interpolation processing, and edge enhancement processing, as shown in FIGS. 6(A) and 6(B), by performing overdrive processing, the response speed can be increased, the overdrive amount can be set to an appropriate value, and display with less afterimage can be achieved. Or, as the image changes due to super-resolution processing, frame interpolation processing, and edge enhancement processing, the gradation of each pixel changes. Therefore, the overdrive processing can also be changed according to the amount of change. Or, since the frame frequency increases due to frame interpolation processing, the overdrive processing can also be changed accordingly. Therefore, after performing super-resolution processing, frame interpolation processing, and edge enhancement processing, by performing overdrive processing, the overdrive amount can be set to an appropriate value, so that each pixel can be set to an optimal gradation. Thus, the response speed can be increased, and accurate overdrive driving can be performed. Furthermore, by super-resolution processing, high-resolution display can be obtained without afterimage. Therefore, in order to obtain an image with good image quality, before performing overdrive processing, super-resolution processing, Moreover, high-resolution display can be obtained without afterimage by super-resolution processing. Therefore, to obtain an image with good image quality, before performing overdrive processing, super-resolution processing, It is important to perform frame interpolation processing and edge enhancement processing. However, an example of the embodiment is not limited to this.

[0181] Next, in FIG. 6(C), super-resolution processing is performed using the image signal obtained from the image source, and after increasing the resolution, frame interpolation processing is performed to increase the frame frequency, and then edge enhancement processing is performed. After that, the processing flow in the case of performing local dimming processing is shown. However, an example of the embodiment is not limited to this. Therefore, the processing flow in FIG. 6(C) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4 (A). Alternatively, the processing flow in FIG. 6(C) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 4(D). Alternatively, the processing flow in FIG. 6(C) also corresponds to the case where edge enhancement processing is performed on the processing flow in FIG. 4(F). is not limited to this. Therefore, the processing flow in FIG. 6(C) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4 (A). Alternatively, the processing flow in FIG. 6(C) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 4(D). Alternatively, the processing flow in FIG. 6(C) also corresponds to the case where edge enhancement processing is performed on the processing flow in FIG. 4(F). is not limited to this. Therefore, the processing flow in FIG. 6(C) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4 (A). Alternatively, the processing flow in FIG. 6(C) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 4(D). Alternatively, the processing flow in FIG. 6(C) also corresponds to the case where edge enhancement processing is performed on the processing flow in FIG. 4(F). is not limited to this. Therefore, the processing flow in FIG. 6(C) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4

[0182] Similarly, in FIG. 6(D), super-resolution processing is performed using the image signal obtained from the image source, and after increasing the resolution, edge enhancement processing is performed, and then frame interpolation processing is performed to increase the frame frequency, and then local dimming processing is performed. The processing flow in this case is shown. However, an example of the embodiment is not limited to this. Therefore, the processing flow in FIG. 6(D) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4(B). Alternatively, the processing flow in FIG. 6(D) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 4(D). Alternatively, the processing flow in FIG. 6(D) also corresponds to the case where edge enhancement processing is performed on the processing flow in FIG. 4(F). is not limited to this. Therefore, the processing flow in FIG. 6(D) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4(B). Alternatively, the processing flow in FIG. 6(D) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 4(D). Alternatively, the processing flow in FIG. 6(D) also corresponds to the case where edge enhancement processing is performed on the processing flow in FIG. 4(F). is not limited to this. Therefore, the processing flow in FIG. 6(D) also corresponds to the case where local dimming processing is performed after the processing flow in FIG. 4(B). Alternatively, the processing flow in FIG. 6(D) also corresponds to the case where frame interpolation processing is performed on the processing flow in FIG. 4(D). Alternatively, the processing flow in FIG. 6(D) also corresponds to the case where edge enhancement processing is performed on the processing flow in FIG. 4(F).

[0183] Before performing the contour enhancement process and the frame interpolation process, as shown in FIGS. 6(C) and 6(D) By performing super-resolution processing, the resolution can be accurately improved. Since the image before performing super-resolution processing has not undergone the contour enhancement process and the frame interpolation process, no unnecessary processing is performed. Therefore, super-resolution processing can be accurately performed.

[0184] Similarly, as shown in FIGS. 6(C) and 6(D), it is desirable to perform local dimming processing after performing super-resolution processing, frame interpolation processing, and contour enhancement processing. When super-resolution processing is performed, new information is added due to information restoration. Therefore, the number of gradations of each pixel may be different before and after super-resolution processing. Or, a region where the number of gradations of pixels changes exists within the screen before and after super-resolution processing. Similarly, new frames are created and new images are created by frame interpolation processing. Therefore, a region where the number of gradations of pixels changes exists within the screen. Similarly, the image is processed so that the contours of objects in the image are emphasized by the contour enhancement processing. Therefore, a region where the number of gradations of pixels changes exists within the screen. Therefore, after the image information is restored by super-resolution processing, the image is processed by frame interpolation processing and the contour enhancement processing is performed, and then local dimming processing is performed, so that the contrast can be accurately improved by performing local dimming processing, and an accurate image can be displayed. Therefore, in order to obtain an image with good image quality, it is necessary to perform super-resolution processing, frame interpolation processing, and contour enhancement processing before performing local dimming processing. ​​​​​​​​​​​​​​​is important. Or, in local dimming processing, determining the brightness of the backlight Before performing the process, it is important to perform super-resolution processing, frame interpolation processing, and edge enhancement processing is important. Or, in local dimming processing, before performing the process of determining the video signal supplied to the pixel it is important to perform super-resolution processing, frame interpolation processing, and edge enhancement processing However, an example of an embodiment is not limited to these

[0185] Furthermore, when performing both local dimming processing and overdrive processing, as in FIG. 5( B), it is preferable to perform overdrive processing after performing local dimming processing

[0186] Therefore, in FIG. 6(C), when performing overdrive processing, or in FIG. 6( A), when performing local dimming processing, it is preferable that the processing flow is as shown in FIG. 7(A) However, an example of an embodiment is not limited to this

[0187] Or, in FIG. 6(D), when performing overdrive processing, or in FIG. 6(B) when performing local dimming processing, it is preferable that the processing flow is as shown in FIG. 7(B) However, an example of an embodiment is not limited to this

[0188] (Embodiment 4) Next, a case where a part of the processing flow is modified will be described. Therefore, it is possible to apply the content described in other embodiments

[0189] FIG. 8(A) shows an example of a case where a part of FIG. 1(E) or FIG. 4(F) is modified ​​First, after performing super-resolution processing, frame interpolation processing is performed. At this time, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed. Then, using the data with a higher frame frequency obtained by performing frame interpolation processing and the data of the brightness of the backlight in each determined area with a lower frame frequency, a process of determining the video signal to be supplied to each pixel in local dimming processing is performed. When frame interpolation processing is performed, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if the process of determining the brightness of the backlight in each area in local dimming processing is performed using the data before frame interpolation processing, there is no practical problem. By performing the process shown in FIG. 8(A), since frame interpolation processing and the process of controlling the brightness of the backlight in local dimming processing can be performed simultaneously, the overall processing time can be shortened. Therefore, even when performing a display that requires real-time performance such as a game, it is possible to display without delay. Note that in FIG. 8(A), it is also possible to additionally perform processes such as edge enhancement processing and overdrive processing. As an example, an example in the case where edge enhancement processing is also performed is shown in FIG. 8(B). However, an example of the embodiment is not limited to these. Next, FIG. 9 shows an example of a case where a part of FIG. 1(D) is deformed. First, super-resolution processing is performed. Then, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed.

[0190] When frame interpolation processing is performed, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if the process of determining the brightness of the backlight in each area in local dimming processing is performed using the data before frame interpolation processing, there is no practical problem. By performing the process shown in FIG. 8(A), since frame interpolation processing and the process of controlling the brightness of the backlight in local dimming processing can be performed simultaneously, the overall processing time can be shortened. Therefore, even when performing a display that requires real-time performance such as a game, it is possible to display without delay. Note that in FIG. 8(A), it is also possible to additionally perform processes such as edge enhancement processing and overdrive processing. As an example, an example in the case where edge enhancement processing is also performed is shown in FIG. 8(B). However, an example of the embodiment is not limited to these. Next, FIG. 9 shows an example of a case where a part of FIG. 1(D) is deformed. First, super-resolution processing is performed. Then, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed.

[0191] By performing the process shown in FIG. 8(A), since frame interpolation processing and the process of controlling the brightness of the backlight in local dimming processing can be performed simultaneously, the overall processing time can be shortened. Therefore, even when performing a display that requires real-time performance such as a game, it is possible to display without delay. Note that in FIG. 8(A), it is also possible to additionally perform processes such as edge enhancement processing and overdrive processing. As an example, an example in the case where edge enhancement processing is also performed is shown in FIG. 8(B). However, an example of the embodiment is not limited to these. Next, FIG. 9 shows an example of a case where a part of FIG. 1(D) is deformed. First, super-resolution processing is performed. Then, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed. By performing the process shown in FIG. 8(A), since frame interpolation processing and the process of controlling the brightness of the backlight in local dimming processing can be performed simultaneously, the overall processing time can be shortened. Therefore, even when performing a display that requires real-time performance such as a game, it is possible to display without delay.

[0192] Note that in FIG. 8(A), it is also possible to additionally perform processes such as edge enhancement processing and overdrive processing. As an example, an example in the case where edge enhancement processing is also performed is shown in FIG. 8(B). However, an example of the embodiment is not limited to these. Next, FIG. 9 shows an example of a case where a part of FIG. 1(D) is deformed. First, super-resolution processing is performed. Then, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed. By performing the process shown in FIG. 8(A), since frame interpolation processing and the process of controlling the brightness of the backlight in local dimming processing can be performed simultaneously, the overall processing time can be shortened. Therefore, even when performing a display that requires real-time performance such as a game, it is possible to display without delay.

[0193] Next, FIG. 9 shows an example of a case where a part of FIG. 1(D) is deformed. First, super-resolution processing is performed. Then, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed. Then, simultaneously, the process of controlling the brightness of the backlight in local dimming processing is performed. Perform the process. Then, using the data with increased resolution after performing super-resolution processing and the data of the luminance of the backlight in each determined area with low resolution, perform a process to determine the video signal to be supplied to each pixel in local dimming processing. When performing super-resolution processing, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if a process to determine the luminance of the backlight in each area in local dimming processing is performed using the data before performing super-resolution processing, there is no practical problem. By performing the process shown in FIG. 9, it is possible to simultaneously perform super-resolution processing and the process of controlling the luminance of the backlight in local dimming processing, thereby shortening the overall processing time. Therefore, even in the case of performing a display that requires real-time performance such as a game, it is possible to display without delay.

[0194] When performing super-resolution processing, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if a process to determine the luminance of the backlight in each area in local dimming processing is performed using the data before performing super-resolution processing, there is no practical problem. When performing super-resolution processing, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if a process to determine the luminance of the backlight in each area in local dimming processing is performed using the data before performing super-resolution processing, there is no practical problem. When performing super-resolution processing, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if a process to determine the luminance of the backlight in each area in local dimming processing is performed using the data before performing super-resolution processing, there is no practical problem. When performing super-resolution processing, the image may not change significantly. On the other hand, the pitch of the arrangement of the backlights is much larger compared to the pixel pitch. Therefore, even if a process to determine the luminance of the backlight in each area in local dimming processing is performed using the data before performing super-resolution processing, there is no practical problem.

[0195] By performing the process shown in FIG. 9, it is possible to simultaneously perform super-resolution processing and the process of controlling the luminance of the backlight in local dimming processing, thereby shortening the overall processing time. Therefore, even in the case of performing a display that requires real-time performance such as a game, it is possible to display without delay. By performing the process shown in FIG. 9, it is possible to simultaneously perform super-resolution processing and the process of controlling the luminance of the backlight in local dimming processing, thereby shortening the overall processing time. Therefore, even in the case of performing a display that requires real-time performance such as a game, it is possible to display without delay. By performing the process shown in FIG. 9, it is possible to simultaneously perform super-resolution processing and the process of controlling the luminance of the backlight in local dimming processing, thereby shortening the overall processing time. Therefore, even in the case of performing a display that requires real-time performance such as a game, it is possible to display without delay. By performing the process shown in FIG. 9, it is possible to simultaneously perform super-resolution processing and the process of controlling the luminance of the backlight in local dimming processing, thereby shortening the overall processing time. Therefore, even in the case of performing a display that requires real-time performance such as a game, it is possible to display without delay.

[0196] In addition, in FIG. 9, it is also possible to additionally perform processes such as edge enhancement processing, over-drive processing, and frame interpolation processing. In addition, in FIG. 9, it is also possible to additionally perform processes such as edge enhancement processing, over-drive processing, and frame interpolation processing.

[0197] (Embodiment 5) In this embodiment, an example of a lighting device is shown. The lighting device can be used as a backlight of a liquid crystal display device, or as an indoor light, etc. However, an example of the embodiment is not limited to this. In this embodiment, an example of a lighting device is shown. The lighting device can be used as a backlight of a liquid crystal display device, or as an indoor light, etc. However, an example of the embodiment is not limited to this. In this embodiment, an example of a lighting device is shown. The lighting device can be used as a backlight of a liquid crystal display device, or as an indoor light, etc. However, an example of the embodiment is not limited to this.

[0198] FIG. 10 shows a backlight or a lighting device when using point light sources. As shown in FIG. 10(A), a plurality of point light sources 1002 are arranged in the device 1001. The arrangement As shown in FIG. 10(A), a plurality of point light sources 1002 are arranged in the device 1001. The arrangement By arranging the point light source 1002 in this manner, it becomes possible to configure a uniform surface light source. The device 1001 can be used as a backlight of a liquid crystal display device or a part thereof. It is possible.

[0199] And the threshold 1003 is arranged to extend in the horizontal direction. Also, the threshold 1004 is arranged to extend in the vertical direction. By arranging a plurality of these thresholds 1003 and 1004 it is possible to divide the surface light source into a plurality of regions. In Fig. 10(A), the vertical direction is divided into 3 regions and the horizontal direction is divided into 9 regions. Therefore, light leakage to other regions can be reduced by the thresholds. And by controlling the brightness of the point light source 10 02 in each region, local dimming (local brightness control of the backlight, LOCAL DIMMING) can be realized. In particular, by arranging the thresholds it is possible to reduce light leakage to other regions, so that the brightness of each region can be precisely controlled to become. Therefore, it becomes easy to derive the transmittance of the liquid crystal element of each pixel. Or, since there is little light leakage the contrast can be improved. However, an example of the embodiment is not limited to this.

[0200] Or, it is possible to turn off a part of the light source and move the off state within the screen. That is, it is possible to partially turn off the point light sources within the screen and scan the turned-off regions . For example, it is possible to scan from top to bottom . By performing such backlight scanning, afterimages can be reduced and the moving image characteristics can be improved . It is possible.

[0201] As the threshold, only those arranged to extend horizontally, such as threshold 1003, can be arranged. Or, as the threshold, only those arranged to extend vertically, such as threshold 1004, can be arranged. Or, it is also possible not to provide the threshold itself. Moreover, as the threshold, it is also possible to arrange only those arranged to extend horizontally, such as threshold 1003. Or, as the threshold, it is also possible to arrange only those arranged to extend vertically, such as threshold 1004. Or, it is also possible not to provide the threshold itself. Moreover, as the threshold, it is also possible to arrange only those arranged to extend vertically, such as threshold 1004. Or, it is also possible not to provide the threshold itself. It is also possible not to provide the threshold itself.

[0202] Note that the surface of threshold 1003 or threshold 1004 is preferably a mirror surface or white. However, an example of the embodiment is not limited to this. In the case of a mirror surface, since light can be reflected, light can be effectively utilized. Therefore, power consumption can be reduced. In the case of white, light can be diffused. Therefore, since the boundary of the region becomes difficult to see, the visibility can be improved. However, an example of the embodiment is not limited to this. In the case of a mirror surface, since light can be reflected, light can be effectively utilized. Therefore, power consumption can be reduced. In the case of white, light can be diffused. Therefore, since the boundary of the region becomes difficult to see, the visibility can be improved. In the case of a mirror surface, since light can be reflected, light can be effectively utilized. Therefore, power consumption can be reduced. In the case of white, light can be diffused. Therefore, since the boundary of the region becomes difficult to see, the visibility can be improved. Since the boundary of the region becomes difficult to see, the visibility can be improved.

[0203] Note that the transmittance of threshold 1003 or threshold 1004 is desirably 50% or less, preferably 30% or less. Or, the transmittance of threshold 1003 or threshold 1004 is desirably 1% or more, preferably 5% or more. However, an example of the embodiment is not limited to these. By having a low transmittance, light leakage can be reduced, and the luminance control for each region can be made precise. However, if it does not completely transmit, the boundary of the region may be visible, and the visibility may decrease. Therefore, by allowing a slight transmission, the boundary of the region becomes difficult to see, and the visibility can be improved. Note that the transmittance of threshold 1003 or threshold 1004 is desirably 50% or less, preferably 30% or less. Or, the transmittance of threshold 1003 or threshold 1004 is desirably 1% or more, preferably 5% or more. However, an example of the embodiment is not limited to these. By having a low transmittance, light leakage can be reduced, and the luminance control for each region can be made precise. However, if it does not completely transmit, the boundary of the region may be visible, and the visibility may decrease. Therefore, by allowing a slight transmission, the boundary of the region becomes difficult to see, and the visibility can be improved. By having a low transmittance, light leakage can be reduced, and the luminance control for each region can be made precise. However, if it does not completely transmit, the boundary of the region may be visible, and the visibility may decrease. Therefore, by allowing a slight transmission, the boundary of the region becomes difficult to see, and the visibility can be improved. Since the boundary of the region becomes difficult to see, the visibility can be improved.

[0204] Note that threshold 1003 or threshold 1004 can be composed of an organic substance such as acrylic, plastic, polycarbonate, or PET. However, the embodiment is Note that threshold 1003 or threshold 1004 can be composed of an organic substance such as acrylic, plastic, polycarbonate, or PET. However, the embodiment is An example is not limited to this.

[0205] It is also possible to provide the spacer 1005. However, an example of the embodiment is not limited to this, and it is also possible not to provide the spacer 1005. The spacer 1005 is a sheet disposed on the point light source 1002, the threshold 1003, or the threshold 1004, etc. and has a function of preventing the sheet from sagging.

[0206] When providing the spacer 1005, it is possible to provide it in a small number rather than a large number. Therefore, for example, in FIG. 10(A), it is divided into 3 regions in the vertical direction and 9 regions in the horizontal direction, and has a total of 27 regions, but it is possible to create a region where the spacer 1005 is provided and a region where the spacer 1005 is not provided. Or, the number of the spacers 1005 can be provided to be less than the number of regions. In this way, by not providing the spacer 1005 in all regions, it is possible to facilitate the manufacture and / or reduce the cost.

[0207] Note that the spacer 1005 is preferably transparent, black, or white. By using transparent, black, or white, it is possible to reduce the occurrence of luminance unevenness and color shift due to the presence or absence of the spacer 1005. However, an example of the embodiment is not limited to this.

[0208] Note that the spacer 1005 can be composed of an organic substance such as acrylic, plastic, polycarbonate, or PET. However, an example of the embodiment is not limited to this. specified.

[0209] Note that the point light source 1002 is composed of, for example, light-emitting diodes for three colors or lasers for three colors. And each light-emitting diode or laser has the colors of red, blue, and green. And, for example, by using light-emitting diodes of three colors, it is possible to produce white. Therefore, if it can be made white, the colors are not limited to red, blue, and green. For example, it is also possible to use CMYK such as cyan, magenta, and yellow as the point light source.

[0210] In this way, when the luminance can be controlled for each color, more precise local dimming can be performed, so that it becomes possible to reduce power consumption or improve contrast.

[0211] Note that it is preferable that the number of light-emitting diodes for each color is the same. However, an example of the embodiment is not limited to these. It is also possible to increase the number of light-emitting diodes for only one color. For example, it is possible to double the number of green light-emitting diodes compared to the number of red or blue light-emitting diodes. In this way, by making the number of light-emitting diodes different for each color, the chromaticity can be easily adjusted. Also, it is possible to reduce the possibility that the lifetimes of the light-emitting diodes will differ for each color.

[0212] Note that the light-emitting diodes are not limited to three colors. For example, by using light-emitting diodes having colors close to a certain color, the chromaticity can be broadened. For example, in addition to red, blue, and green, it is also possible to add a color close to green and configure it with four colors.

[0213] In addition to red, blue, and green light-emitting diodes, white light-emitting diodes may also be used. By using white light-emitting diodes, it becomes possible to extend the lifespan of the light-emitting diodes. Or, by using white light-emitting diodes, it becomes possible to reduce color changes due to temperature.

[0214] It is also possible to use only white light-emitting diodes and not use light-emitting diodes other than white, such as red, blue, and green. By using only white, it is possible to prevent colors from mixing. Or, by using only white, it is possible to reduce the occurrence of color deviation due to deterioration.

[0215] The horizontal pitch 1007 of the point light source 1002 is preferably shorter than the vertical pitch 1006 of the point light source 1002. However, an example of the embodiment is not limited to these.

[0216] The number of regions in the horizontal direction is preferably larger than the number of regions in the vertical direction. For example, in FIG. 10(A), the number of regions in the vertical direction is 3, and the number of regions in the horizontal direction is 9.

[0217] The number of regions in one screen is preferably less than the number of light-emitting diodes of a certain color. That is, for each color in one region, it is desirable to have a plurality of point light sources. And for the point light sources arranged in one region, the brightness of the plurality of point light sources having a certain color is preferably controlled to be the same at the same time. That is, in one region, it is preferable that the brightness is controlled for each color. For example Well, if there are three red light-emitting diodes in one area, when increasing the brightness, all three light-emitting diodes increase their brightness, and when decreasing the brightness, all three decrease their brightness. This is preferable. However, in the case of light-emitting diodes and the like, it is difficult to achieve exactly the same brightness because of the variation in characteristics. Therefore, it is desirable to emit light at the same brightness to the extent that includes characteristic variations. For example, it is desirable to emit light at the same brightness with a variation of about 30%. In this way, by arranging a plurality of point light sources in one area, it is possible to reduce brightness unevenness. Or it is possible to reduce the degradation of the point light source. However, an example of the embodiment is not limited to these. Well, if there are three red light-emitting diodes in one area, when increasing the brightness, all three light-emitting diodes increase their brightness, and when decreasing the brightness, all three decrease their brightness. This is preferable. However, in the case of light-emitting diodes and the like, it is difficult to achieve exactly the same brightness because of the variation in characteristics. Therefore, it is desirable to emit light at the same brightness to the extent that includes characteristic variations. For example, it is desirable to emit light at the same brightness with a variation of about 30%. In this way, by arranging a plurality of point light sources in one area, it is possible to reduce brightness unevenness. Or it is possible to reduce the degradation of the point light source. However, an example of the embodiment is not limited to these.

[0218] FIG. 10(B) shows an example of a part of the cross-section of FIG. 10(A). On the device 1001, a diffusion plate 1011 is arranged. The diffusion plate 1011 reduces brightness unevenness. The diffusion plate 1011 is supported by the spacer 1005 so as not to bend even at the center of the screen. The diffusion plate 1011 is supported by the spacer 1005 so as not to bend even at the center of the screen. It is supported.

[0219] On the diffusion plate 1011, a display panel 1012 is arranged. The display panel has, for example, pixels, a driving circuit, liquid crystal elements, a glass substrate, thin film transistors, a polarizing plate, a retardation plate, a color filter, and / or a prism sheet. By operating the display panel 1012 in cooperation with the backlight, it is possible to realize an appropriate display. Well, if there are three red light-emitting diodes in one area, when increasing the brightness, all three light-emitting diodes increase their brightness, and when decreasing the brightness, all three decrease their brightness. This is preferable. However, in the case of light-emitting diodes and the like, it is difficult to achieve exactly the same brightness because of the variation in characteristics. Therefore, it is desirable to emit light at the same brightness to the extent that includes characteristic variations. For example, it is desirable to emit light at the same brightness with a variation of about 30%.

[0220] Note that the diffusion plate 1011 has a function of diffusing light while transmitting light. Therefore, it is preferable that the diffusion plate has a high transmittance while having a function of diffusing light. Therefore, the diffusion Well, if there are three red light-emitting diodes in one area, when increasing the brightness, all three light-emitting diodes increase their brightness, and when decreasing the brightness, all three decrease their brightness. This is preferable. The transmittance of the diffuser plate 1011 is preferably higher than that of the threshold 1003. Diffusion Since the transmittance of the plate 1011 is high, the light reflected by the threshold 1003 can pass through the diffuser plate 101 1. Therefore, while reducing the leakage of light to other areas , light can easily emerge on the screen. Thus, the control of the luminance for each area can be precisely achieved , and local dimming can be appropriately performed. However, an example of the embodiment is not limited to these .

[0221] Note that the height 1014 of the threshold 1003 is preferably higher than the height 1013 of the point light source 1002 . In order to prevent the light emitted from the point light source 1002 from leaking into another area , it is desirable that the height 1014 of the threshold 1003 is higher. However, an example of the embodiment is not limited to these .

[0222] Note that the distance 1015 between the threshold 1003 and the diffuser plate 1011 is preferably shorter than the height 1 014 of the threshold 1003. When the distance 1015 is long, too much light will leak . Therefore, the distance 1015 is preferably shorter than the height 1014 of the threshold 1003 . However, an example of the embodiment is not limited to these

[0223] Note that the distance 1015 between the threshold 1003 and the diffuser plate 1011 is preferably longer than the height 1 013 of the point light source 1002. When the distance 1015 is too small, the boundary of the area will be too distinct , and there is a possibility that the boundary can be seen on the screen. Therefore, in order to prevent the boundary of the area from being visible on the screen , a length that allows some light to leak is required is necessary. Therefore, by making the height 1014 of the threshold 1003 longer than the height 1013 of the point light source 1002, it becomes possible to let an appropriate amount of light leak. However, an example of an embodiment is not limited to these. Moreover, an example of an embodiment is not limited to these. is not limited to these.

[0224] Note that the height 1014 of the threshold 1003 and the height of the threshold 1004 are preferably substantially equal. Substantially equal means equal in the case where there may be some differences including manufacturing errors and variations. For example, it is possible to have variations within about 10%. By making the heights of the thresholds substantially equal, the amount of light leakage becomes uniform, so it becomes possible to reduce luminance unevenness. However, an example of an embodiment is not limited to these. is preferably substantially equal. Substantially equal means equal in the case where there may be some differences including manufacturing errors and variations. For example, it is possible to have variations within about 10%. By making the heights of the thresholds substantially equal, the amount of light leakage becomes uniform, so it becomes possible to reduce luminance unevenness. However, an example of an embodiment is not limited to these. is preferably substantially equal. Substantially equal means equal in the case where there may be some differences including manufacturing errors and variations. For example, it is possible to have variations within about 10%. By making the heights of the thresholds substantially equal, the amount of light leakage becomes uniform, so it becomes possible to reduce luminance unevenness. However, an example of an embodiment is not limited to these. is preferably substantially equal. Substantially equal means equal in the case where there may be some differences including manufacturing errors and variations. For example, it is possible to have variations within about 10%. By making the heights of the thresholds substantially equal, the amount of light leakage becomes uniform, so it becomes possible to reduce luminance unevenness. However, an example of an embodiment is not limited to these. is preferably substantially equal. Substantially equal means equal in the case where there may be some differences including manufacturing errors and variations. For example, it is possible to have variations within about 10%. By making the heights of the thresholds substantially equal, the amount of light leakage becomes uniform, so it becomes possible to reduce luminance unevenness. However, an example of an embodiment is not limited to these. is not limited to these.

[0225] In addition, in FIG. 10, point light sources are arranged in each region, but an example of an embodiment is not limited to this. It is also possible to arrange small surface light sources for each region. FIG. 11 shows an example when surface light sources are arranged in each region. When using a surface light source, it can be configured in the same way as when using a point light source. Therefore, the content described in FIG. 10 (even a part) can be applied to FIG. 11. In addition, in FIG. 10, point light sources are arranged in each region, but an example of an embodiment is not limited to this. It is also possible to arrange small surface light sources for each region. FIG. 11 shows an example when surface light sources are arranged in each region. When using a surface light source, it can be configured in the same way as when using a point light source. Therefore, the content described in FIG. 10 (even a part) can be applied to FIG. 11. In addition, in FIG. 10, point light sources are arranged in each region, but an example of an embodiment is not limited to this. It is also possible to arrange small surface light sources for each region. FIG. 11 shows an example when surface light sources are arranged in each region. When using a surface light source, it can be configured in the same way as when using a point light source. Therefore, the content described in FIG. 10 (even a part) can be applied to FIG. 11. In addition, in FIG. 10, point light sources are arranged in each region, but an example of an embodiment is not limited to this. It is also possible to arrange small surface light sources for each region. FIG. 11 shows an example when surface light sources are arranged in each region. When using a surface light source, it can be configured in the same way as when using a point light source. Therefore, the content described in FIG. 10 (even a part) can be applied to FIG. 11. In addition, in FIG. 10, point light sources are arranged in each region, but an example of an embodiment is not limited to this. It is also possible to arrange small surface light sources for each region. FIG. 11 shows an example when surface light sources are arranged in each region. When using a surface light source, it can be configured in the same way as when using a point light source. Therefore, the content described in FIG. 10 (even a part) can be applied to FIG. 11.

[0226] In FIG. 11(A), surface light sources 1102 are arranged in each region. The surface light source 1102 can be realized using various configurations. In FIG. 11(A), surface light sources 1102 are arranged in each region. The surface light source 1102 can be realized using various configurations.

[0227] In addition, in FIG. 11(A), the case where the thresholds 1003 and 1004 are not provided is shown, but an example of an embodiment is not limited to this. Similar to the threshold 1003, In addition, in FIG. 11(A), the case where the thresholds 1003 and 1004 are not provided is shown, but an example of an embodiment is not limited to this. Similar to the threshold 1003, It is also possible to arrange only those that are arranged to extend horizontally. Or, a threshold 1 such as 004, it is also possible to arrange only those that are arranged to extend vertically Or, it is also possible to provide both thresholds.

[0228] It is also possible to provide the spacer 1005. However, an example of the embodiment is not limited to this and it is also possible not to provide the spacer 1005. The spacer 1005 has a function of preventing the sheet disposed on the surface light source 1102 or the like from sagging However, in the case of a surface light source, since the area where cavities can be formed within the region is small, it is possible not to provide the spacer 10 05.

[0229] Note that the horizontal pitch of the surface light source 1102 is preferably shorter than the vertical pitch of the surface light source 1102. However, an example of the embodiment is not limited to these

[0230] Note that it is preferable that the height of the threshold is higher than the height of the surface light source 1102. In order to prevent the light emitted from the surface light source 1102 from leaking into another region, it is desirable that the height of the threshold is higher However, an example of the embodiment is not limited to these

[0231] Furthermore, when a diffusion plate is provided on the surface light source 1102, the distance between the threshold and the diffusion plate is preferably longer than the height of the surface light source 1102. If the distance is too small, the boundary of the region will be too sharp, and there is a possibility that the boundary will also be visible on the screen. Therefore, in order to prevent the boundary of the region from being visible on the screen, a length that allows some light to leak is required Therefore, by making the threshold longer than the height of the surface light source 1102, an appropriate amount ​​​​ It is possible to let light leak. However, an example of an embodiment is not limited to these. That's all.

[0232] Next, as an example of the surface light source 1102, a cross-sectional view in the case of forming a small surface light source having a light guide plate and a linear light source (or a collection of point light sources) is shown in FIG. 11(B). In FIG. 11(B), cross-sectional views of three surface light sources are shown. Light is incident from the linear light source 1103 to the light guide plate 1104. In the light guide plate 1104, the light is repeatedly totally reflected and propagated. Then, the bottom surface 1105 of the light guide plate 1104 is processed. Therefore, light exits from the surface of the light guide plate 1104, and a surface light source is realized. Regarding the processing of the bottom surface 1105, as an example, there are cases where unevenness is formed in a prism shape or where ink is printed. By controlling these densities or shapes, a uniform surface light source can be realized. When using a surface light source as shown in FIG. 11(A), it is possible to provide a diffusion plate 1011 on the surface light source. Thereby, it is possible to reduce luminance unevenness. However, when using the surface light source 1102, unlike the case of a point light source, since the luminance is already uniform to some extent within a certain region, it is also possible not to provide the diffusion plate 1011. As another example of the surface light source 1102, it is possible to use a flat fluorescent tube (flat cathode tube). Or, as shown in FIG. 11(C), the fluorescent tube (cathode tube) 1106 is bent and arranged within the region.

[0233]

[0234]

[0235]

[0236] ​​​​​​​​​​It is also possible to realize a surface light source by making it similar to a flat fluorescent tube (flat cathode ray tube). In this case, as shown in the cross-sectional view of FIG. 11(D), the area around the fluorescent tube (cathode tube) 1106, especially the upper It is also possible to place a diffusion plate 1107 on the side to approximate a uniform surface light source. However, the embodiment is not limited to these examples.

[0237] (Embodiment 6) Next, another example of the configuration of the display device and a method of driving the same will be described. In the case of a display using a display element with a slow luminance response (long response time) to signal writing, In this embodiment, a liquid crystal display device having a long response time is used. A display element will be described as an example, but the display element in this embodiment is not limited to this. A variety of display elements may be used that have a slow response of luminance to writing.

[0238] In the case of a general LCD device, the response of brightness to signal writing is slow, and the signal is not applied to the liquid crystal element. Even if voltage is continuously applied, it takes more than one frame period for the response to be completed. Even if you display a moving image on such a display element, it is not possible to reproduce the moving image faithfully. Furthermore, in the case of active matrix driving, the time it takes to write a signal to one liquid crystal element is is usually calculated by dividing the signal writing period (one frame period or one subframe period) by the number of scanning lines. The time it takes for the liquid crystal element to respond is only one scan line selection period. Therefore, most of the response of the liquid crystal element occurs during the period when no signal is written. Here, the dielectric constant of the liquid crystal element changes according to the transmittance of the liquid crystal element. However, the fact that the liquid crystal element responds during the period when no signal is written means that the liquid crystal element This means that the dielectric constant of the liquid crystal element changes in a state where no charge transfer occurs with the outside (constant charge state). That is, in the formula (charge) = (capacitance) × (voltage), since the capacitance changes in a state where the charge is constant, the voltage applied to the liquid crystal element will change from the voltage at the time of signal writing according to the response of the liquid crystal element. Therefore, when driving a liquid crystal element with a slow luminance response to signal writing using an active matrix, the voltage applied to the liquid crystal element cannot reach the voltage at the time of signal writing in principle. In the display device according to the present embodiment, in order to make the display element respond to a desired luminance within the signal writing period, the signal level at the time of signal writing is set to a preliminarily corrected value (correction signal), whereby the above problem can be solved. Furthermore, since the response time of the liquid crystal element becomes shorter as the signal level becomes larger, the response time of the liquid crystal element can also be shortened by writing the correction signal. Such a driving method of adding such a correction signal is also called overdrive. The overdrive in the present embodiment can make the display element respond to a desired luminance within the signal writing period by correcting the signal level according to the signal writing period even when the signal writing period is shorter than the period of the image signal input to the display device (input image signal period Tin). The case where the signal writing period is shorter than the input image signal period Tin includes, for example, the case where one original image is divided into a plurality of sub-images and the plurality of sub-images are sequentially displayed within one frame period. When driving a liquid crystal element with a slow luminance response to signal writing using an active matrix, the voltage applied to the liquid crystal element cannot reach the voltage at the time of signal writing in principle.

[0239] In the display device according to the present embodiment, in order to make the display element respond to a desired luminance within the signal writing period, the signal level at the time of signal writing is set to a preliminarily corrected value (correction signal), whereby the above problem can be solved. Furthermore, since the response time of the liquid crystal element becomes shorter as the signal level becomes larger, the response time of the liquid crystal element can also be shortened by writing the correction signal. Such a driving method of adding such a correction signal is also called overdrive. The overdrive in the present embodiment can make the display element respond to a desired luminance within the signal writing period by correcting the signal level according to the signal writing period even when the signal writing period is shorter than the period of the image signal input to the display device (input image signal period Tin). The case where the signal writing period is shorter than the input image signal period Tin includes, for example, the case where one original image is divided into a plurality of sub-images and the plurality of sub-images are sequentially displayed within one frame period.

[0240] Next, in the display device with active matrix driving, the signal level at the time of signal writing is corrected. ​​​​​​​​​An example of the method will be described with reference to FIGS. 12(A) and (B). FIG. 12(A) is a graph showing the time change of the luminance of the signal level at the time of signal writing, with the horizontal axis representing time and the vertical axis representing the signal level at the time of signal writing for a certain display element. FIG. 12(B) is a graph showing the time change of the display level for a certain display element, with the horizontal axis representing time and the vertical axis representing the display level. When the display element is a liquid crystal element, the signal level at the time of signal writing can be the voltage, and the display level can be the transmittance of the liquid crystal element. Hereinafter, it will be described on the assumption that the vertical axis of FIG. 12(A) is the voltage and the vertical axis of FIG. 12(B) is the transmittance. Note that the overdrive in this embodiment includes cases where the signal level is other than voltage (duty ratio, current, etc.). Note that the overdrive in this embodiment includes cases where the display level is other than transmittance (luminance, current, etc.). When the liquid crystal element is a normally black type (e.g., VA mode, IPS mode, etc.) that becomes black display when the voltage is 0 and a normally white type (e.g., TN mode, OCB mode, etc.) that becomes white display when the voltage is 0 exist, the graph shown in FIG. 12(B) corresponds to both. In the case of the normally black type, the transmittance increases as going upward in the graph, and in the case of the normally white type, the transmittance increases as going downward in the graph. That is, the liquid crystal mode in this embodiment can be either a normally black type or a normally white type. Note that the signal writing timing is indicated by a dotted line on the time axis, and the period from when signal writing is performed until the next signal writing is performed is called the holding period Fi. In this embodiment, i is an integer and is an index representing each holding period. FIG. 1 In the case of the normally black type, the transmittance increases as going upward in the graph, and in the case of the normally white type, the transmittance increases as going downward in the graph. That is, the liquid crystal mode in this embodiment can be either a normally black type or a normally white type. Note that the signal writing timing is indicated by a dotted line on the time axis, and the period from when signal writing is performed until the next signal writing is performed is called the holding period Fi. In this embodiment, i is an integer and is an index representing each holding period. FIG. 1 until the next signal writing is performed is called the holding period Fi. In this embodiment, i is an integer and is an index representing each holding period. FIG. 1 In FIGS. 2(A) and (B), i is shown as ranging from 0 to 2, but i can also take other integers (not shown for values other than 0 to 2). During the holding period Fi, let the transmittance for realizing the luminance corresponding to the image signal be Ti, and let the voltage applied to give the transmittance Ti in the steady state be Vi. The dashed line 5101 in FIG. 12(A) represents the time change of the voltage applied to the liquid crystal element when no over-drive is performed, and the solid line 5102 represents the time change of the voltage applied to the liquid crystal element when over-drive is performed in the present embodiment. Similarly, the dashed line 5103 in FIG. 12(B) represents the time change of the transmittance of the liquid crystal element when no over-drive is performed, and the solid line 5104 represents the time change of the transmittance of the liquid crystal element when over-drive is performed in the present embodiment. The difference between the desired transmittance Ti and the actual transmittance at the end of the holding period Fi will be denoted as the error αi.

[0241] In the graph shown in FIG. 12(A), during the holding period F0, the desired voltage V0 is applied to both the dashed line 5101 and the solid line 5102. Similarly, in the graph shown in FIG. 12(B), the desired transmittance T0 is obtained for both the dashed line 5103 and the solid line 5104. When no over-drive is performed, as shown by the dashed line 5101, the desired voltage V1 is applied to the liquid crystal element at the beginning of the holding period F1. However, as already described, the period during which the signal is written is extremely short compared to the holding period, and since most of the holding period is in a constant charge state, the voltage applied to the liquid crystal element changes with the change in transmittance during the holding period, and at the end of the holding period F1, it becomes a voltage significantly different from the desired voltage V1. At this time, , the dashed line 5103 in the graph shown in Fig. 12(B) also becomes significantly different from the desired transmittance T1. As a result, a display faithful to the image signal cannot be performed, and the image quality deteriorates. On the other hand, when over-driving is performed in the present embodiment, as shown by the solid line 51 02, at the beginning of the holding period F1, a voltage V1 ' larger than the desired voltage V1 is applied to the liquid crystal element. That is, in anticipation of the voltage applied to the liquid crystal element gradually changing during the holding period F1, the voltage applied to the liquid crystal element at the end of the holding period F1 is made to be a voltage near the desired voltage V1. By applying the corrected voltage V1' obtained from the desired voltage V1 to the liquid crystal element at the beginning of the holding period F1, it becomes possible to accurately apply the desired voltage V1 to the liquid crystal element. At this time, as shown by the solid line 510 4 in the graph shown in Fig. 12(B), the desired transmittance T1 is obtained at the end of the holding period F1. That is, even though it becomes a constant charge state for most of the holding period, the response of the liquid crystal element within the signal writing period can be realized. Next, in the holding period F2, the case where the desired voltage V2 is smaller than V1 is shown. Also in this case, similar to the holding period F1, in anticipation of the voltage applied to the liquid crystal element gradually changing during the holding period F2, the voltage applied to the liquid crystal element at the end of the holding period F2 is made to be a voltage near the desired voltage V2. By applying the corrected voltage F2' obtained from the desired voltage V2 to the liquid crystal element at the beginning of the holding period F2, as shown by the solid line 5104 in the graph shown in Fig. 12(B), the desired transmittance T2 is obtained at the end of the holding period F2. Note that when Vi becomes larger than Vi- 1 as in the holding period F1, the corrected voltage Vi' becomes larger than the desired voltage Vi. In the holding period F2, the voltage applied to the liquid crystal element gradually changes. At the end of the holding period F2, the voltage applied to the liquid crystal element is made to be a voltage near the desired voltage V2. The corrected voltage F2' obtained from the desired voltage V2 may be applied to the liquid crystal element at the beginning of the holding period F2. By doing so, as shown by the solid line 5104 in the graph shown in Fig. 12(B), the desired transmittance T2 is obtained at the end of the holding period F2. When Vi is larger than Vi-1, the corrected voltage Vi' becomes larger than the desired voltage Vi. It is preferably corrected as such. Further, when Vi becomes much smaller than Vi-1 like the holding period F2, the corrected voltage Vi´ is preferably corrected so as to be smaller than the desired voltage Vi. Regarding the specific correction value, it can be derived by measuring the response characteristics of the liquid crystal element in advance. As a method of implementing it in the device, a method of formulating a correction formula and incorporating it into a logic circuit, a method of storing the correction value in a memory as a look-up table, and reading out the correction value as needed can be used. When compared, if it becomes much smaller, For the specific correction value, it can be derived by measuring the response characteristics of the liquid crystal element in advance. As a method of implementing it in the device, a method of formulating a correction formula and incorporating it into a logic circuit, a method of storing the correction value in a memory as a look-up table, and reading out the correction value as needed can be used. For the specific correction value, it can be derived by measuring the response characteristics of the liquid crystal element in advance. As a method of implementing it in the device, a method of formulating a correction formula and incorporating it into a logic circuit, a method of storing the correction value in a memory as a look-up table, and reading out the correction value as needed can be used. a method of formulating a correction formula and incorporating it into a logic circuit, a method of storing the correction value in a memory as a look-up table, and reading out the correction value as needed can be used. a method of formulating a correction formula and incorporating it into a logic circuit, a method of storing the correction value in a memory as a look-up table, and reading out the correction value as needed can be used.

[0242] When actually realizing the overdrive in this embodiment as a device, there are various restrictions. For example, voltage correction must be performed within the rated voltage range of the source driver. That is, if the desired voltage is originally a large value and the ideal correction voltage exceeds the rated voltage of the source driver, it cannot be fully corrected. The problems in such cases will be described with reference to FIGS. 12(C) and (D). FIG. 12(C) is a graph schematically showing the time change of the voltage in a certain liquid crystal element with the horizontal axis being time and the vertical axis being voltage, similar to FIG. 12(A), with the solid line 5105. FIG. 12(D) is a graph schematically showing the time change of the transmittance in a certain liquid crystal element with the horizontal axis being time and the vertical axis being transmittance, similar to FIG. 12(B), with the solid line 5106. Regarding other notation methods, since they are the same as those in FIGS. 12(A) and (B), the description is omitted. FIGS. 12(C) and (D) show that the correction voltage V1´ for realizing the desired transmittance T1 in the holding period F1 exceeds the rated voltage of the source driver, so V1´ = V1 has to be set. voltage correction must be performed within the rated voltage range of the source driver. That is, if the desired voltage is originally a large value and the ideal correction voltage exceeds the rated voltage of the source driver, it cannot be fully corrected. voltage correction must be performed within the rated voltage range of the source driver. That is, if the desired voltage is originally a large value and the ideal correction voltage exceeds the rated voltage of the source driver, it cannot be fully corrected. If the desired voltage is originally a large value and the ideal correction voltage exceeds the rated voltage of the source driver, it cannot be fully corrected. The problems in such cases will be described with reference to FIGS. 12(C) and (D). FIG. 12(C) is a graph schematically showing the time change of the voltage in a certain liquid crystal element with the horizontal axis being time and the vertical axis being voltage, similar to FIG. 12(A), with the solid line 5105. FIG. 12(D) is a graph schematically showing the time change of the transmittance in a certain liquid crystal element with the horizontal axis being time and the vertical axis being transmittance, similar to FIG. 12(B), with the solid line 5106. Regarding other notation methods, since they are the same as those in FIGS. 12(A) and (B), the description is omitted. FIGS. 12(C) and (D) show that the correction voltage V1´ for realizing the desired transmittance T1 in the holding period F1 exceeds the rated voltage of the source driver, so V1´ = V1 has to be set. (C) is a graph schematically showing the time change of the voltage in a certain liquid crystal element with the horizontal axis being time and the vertical axis being voltage, similar to FIG. 12(A), with the solid line 5105. (C) is a graph schematically showing the time change of the voltage in a certain liquid crystal element with the horizontal axis being time and the vertical axis being voltage, similar to FIG. 12(A), with the solid line 5105. (D) is a graph schematically showing the time change of the transmittance in a certain liquid crystal element with the horizontal axis being time and the vertical axis being transmittance, similar to FIG. 12(B), with the solid line 5106. (D) is a graph schematically showing the time change of the transmittance in a certain liquid crystal element with the horizontal axis being time and the vertical axis being transmittance, similar to FIG. 12(B), with the solid line 5106. Regarding other notation methods, since they are the same as those in FIGS. 12(A) and (B), the description is omitted. FIGS. 12(C) and (D) show that the correction voltage V1´ for realizing the desired transmittance T1 in the holding period F1 exceeds the rated voltage of the source driver, so V1´ = V1 has to be set. FIGS. 12(C) and (D) show that the correction voltage V1´ for realizing the desired transmittance T1 in the holding period F1 exceeds the rated voltage of the source driver, so V1´ = V1 has to be set. It represents a state where it has disappeared and sufficient correction cannot be made. At this time, the transmittance at the end of the holding period F1 becomes a value deviated from the desired transmittance T1 by the error α1. However, since the error α1 increases only when the desired voltage is originally a large value, the deterioration of the image quality due to the occurrence of the error α 1 is often within an acceptable range. However, when the error α1 increases, the error within the voltage correction algorithm also increases. That is to say, in the voltage correction algorithm, assuming that the desired transmittance is obtained at the end of the holding period, actually, even though the error α1 has increased, the error α1 is considered small and the voltage is corrected, so an error is included in the correction in the next holding period F2, and as a result, the error α2 also becomes large. Furthermore, if the error α2 becomes large the next error α3 becomes even larger, and the error increases chain - like, resulting in a significant deterioration of the image quality. In the overdrive in this embodiment in order to suppress the situation where the error increases chain - like, when the correction voltage Vi´ exceeds the rated voltage of the source driver in the holding period Fi, the error αi at the end of the holding period Fi is estimated, and considering the magnitude of the error αi, the correction voltage in the holding period Fi + 1 can be adjusted. By doing so, even if the error αi becomes large the influence it has on the error αi + 1 can be minimized, so the situation where the error increases chain - like can be suppressed. Regarding an example of minimizing the error α2 in the overdrive in this embodiment, it will be described with reference to FIGS. 12(E) and (F). The graph shown in FIG. 12(E) is the correction voltage V2´ of the graph shown in FIG. 12(C). In the overdrive in this embodiment, in order to suppress the situation where the error increases chain - like, when the correction voltage Vi´ exceeds the rated voltage of the source driver in the holding period Fi, the error αi at the end of the holding period Fi is estimated, and considering the magnitude of the error αi, the correction voltage in the holding period Fi + 1 can be adjusted. By doing so, even if the error αi becomes large the influence it has on the error αi + 1 can be minimized, so the situation where the error increases chain - like can be suppressed. Regarding an example of minimizing the error α2 in the overdrive in this embodiment, it will be described with reference to FIGS. 12(E) and (F). the error αi at the end of the holding period Fi is estimated, and considering the magnitude of the error αi, the correction voltage in the holding period Fi + 1 can be adjusted. By doing so, even if the error αi becomes large the influence it has on the error αi + 1 can be minimized, so the situation where the error increases chain - like can be suppressed. Regarding an example of minimizing the error α2 in the overdrive in this embodiment, it will be described with reference to FIGS. 12(E) and (F). even if the error αi becomes large, the influence it has on the error αi + 1 can be minimized, so the situation where the error increases chain - like can be suppressed. In the overdrive in this embodiment in order to suppress the situation where the error increases chain - like, when the correction voltage Vi´ exceeds the rated voltage of the source driver in the holding period Fi, the error αi at the end of the holding period Fi is estimated, and considering the magnitude of the error αi, the correction voltage in the holding period Fi + 1 can be adjusted. By doing so, even if the error αi becomes large the influence it has on the error αi + 1 can be minimized, so the situation where the error increases chain - like can be suppressed. Regarding an example of minimizing the error α2 in the overdrive in this embodiment, it will be described with reference to FIGS. 12(E) and (F). The graph shown in FIG. 12(E) is the correction voltage V2´ of the graph shown in FIG. 12(C). When adjusted further to obtain the corrected voltage V2'', the time change of the voltage is represented by the solid line 5107. The graph shown in Fig. 12(F) represents the time change of the transmittance when voltage correction is performed according to the graph shown in Fig. 12(E). In the solid line 5106 in the graph shown in Fig. 12(D), overcorrection occurs due to the corrected voltage V2'. However, in the solid line 5108 in the graph shown in Fig. 12(F), the overcorrection is suppressed by the corrected voltage V2'' adjusted in consideration of the error α1, and the error α2 is minimized. Note that specific correction values can be derived by measuring the response characteristics of the liquid crystal element in advance. As for the method of implementing it in the device, methods such as formulating a correction formula and incorporating it into a logic circuit, storing the correction values in a memory as a look-up table and reading out the correction values as needed, etc. can be used. And these methods can be added separately from the part that calculates the corrected voltage Vi', or can be incorporated into the part that calculates the corrected voltage Vi'. Note that the correction amount (the difference from the desired voltage Vi) of the corrected voltage Vi'' adjusted in consideration of the error αi−1 is preferably smaller than the correction amount of Vi'. That is, it is preferable that |Vi'' - Vi| < |Vi' - Vi|. In addition, the error αi caused by the ideal correction voltage exceeding the rated voltage of the source driver increases as the signal writing period becomes shorter. This is because the shorter the signal writing period, the shorter the response time of the liquid crystal element needs to be, and as a result, a larger correction voltage is required. Furthermore, as the required correction voltage increases, the frequency of the correction voltage exceeding the rated voltage of the source driver also increases, so the frequency of generating a large error αi also increases. And these methods can be added separately from the part that calculates the corrected voltage Vi', or can be incorporated into the part that calculates the corrected voltage Vi'. As for the method of implementing it in the device, methods such as formulating a correction formula and incorporating it into a logic circuit, storing the correction values in a memory as a look-up table and reading out the correction values as needed, etc. can be used. And these methods can be added separately from the part that calculates the corrected voltage Vi', or can be incorporated into the part that calculates the corrected voltage Vi'. Note that the correction amount (the difference from the desired voltage Vi) of the corrected voltage Vi'' adjusted in consideration of the error αi−1 is preferably smaller than the correction amount of Vi'. That is, it is preferable that |Vi'' - Vi| < |Vi' - Vi|. In addition, the error αi caused by the ideal correction voltage exceeding the rated voltage of the source driver increases as the signal writing period becomes shorter. This is because the shorter the signal writing period, the shorter the response time of the liquid crystal element needs to be, and as a result, a larger correction voltage is required. Furthermore, as the required correction voltage increases, the frequency of the correction voltage exceeding the rated voltage of the source driver also increases, so the frequency of generating a large error αi also increases. And these methods can be added separately from the part that calculates the corrected voltage Vi', or can be incorporated into the part that calculates the corrected voltage Vi'. Note that the correction amount (the difference from the desired voltage Vi) of the corrected voltage Vi'' adjusted in consideration of the error αi−1 is preferably smaller than the correction amount of Vi'. That is, it is preferable that |Vi'' - Vi| < |Vi' - Vi|.

[0243] In addition, the error αi caused by the ideal correction voltage exceeding the rated voltage of the source driver increases as the signal writing period becomes shorter. This is because the shorter the signal writing period, the shorter the response time of the liquid crystal element needs to be, and as a result, a larger correction voltage is required. Furthermore, as the required correction voltage increases, the frequency of the correction voltage exceeding the rated voltage of the source driver also increases, so the frequency of generating a large error αi also increases. And these methods can be added separately from the part that calculates the corrected voltage Vi', or can be incorporated into the part that calculates the corrected voltage Vi'. Note that the correction amount (the difference from the desired voltage Vi) of the corrected voltage Vi'' adjusted in consideration of the error αi−1 is preferably smaller than the correction amount of Vi'. That is, it is preferable that |Vi'' - Vi| < |Vi' - Vi|. It becomes shorter. Therefore, it can be said that the overdrive in the present embodiment is more effective when the signal writing cycle is shorter. Specifically, when one original image is divided into a plurality of sub-images and the plurality of sub-images are sequentially displayed within one frame period, the movement included in the images is detected from the plurality of images, and an image in an intermediate state of the plurality of images is generated. When it is inserted and driven (so-called motion compensation double-speed drive) between the plurality of images, or when these are combined, etc., when such a driving method is performed, the overdrive in the present embodiment is used. It will have a remarkable effect. When combined, etc., when such a driving method is performed, the overdrive in the present embodiment is used, and it will have a remarkable effect. When combined, etc., when such a driving method is performed, the overdrive in the present embodiment is used, and it will have a remarkable effect. When combined, etc., when such a driving method is performed, the overdrive in the present embodiment is used, and it will have a remarkable effect. When combined, etc., when such a driving method is performed, the overdrive in the present embodiment is used, and it will have a remarkable effect. When combined, etc., when such a driving method is performed, the overdrive in the present embodiment is used, and it will have a remarkable effect.

[0244] Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi. Note that in addition to the upper limit described above, there is also a lower limit for the rated voltage of the source driver. For example, there is a case where a voltage smaller than voltage 0 cannot be applied. At this time, similar to the case of the upper limit described above, since an ideal correction voltage cannot be applied, the error αi becomes large. However, even in this case, similar to the method described above, the error αi at the end of the holding period Fi is estimated, and the correction voltage in the holding period Fi+1 is adjusted in consideration of the magnitude of the error αi. When a voltage smaller than voltage 0 (negative voltage) can be applied as the rated voltage of the source driver, a negative voltage may be applied to the liquid crystal element as the correction voltage. By doing so, in anticipation of the potential fluctuation due to the constant charge state, it is possible to adjust the voltage applied to the liquid crystal element at the end of the holding period Fi to a voltage near the desired voltage Vi.

[0245] Note that in order to suppress the deterioration of the liquid crystal element, so-called inversion driving, which periodically inverts the polarity of the voltage applied to the liquid crystal element, can be implemented in combination with overdrive. That is, Note that in order to suppress the deterioration of the liquid crystal element, so-called inversion driving, which periodically inverts the polarity of the voltage applied to the liquid crystal element, can be implemented in combination with overdrive. That is, That is, the overdrive in the present embodiment also includes the case where it is performed simultaneously with the reverse drive. For example, when the signal writing period is 1 / 2 of the input image signal period Tin, if the period for reversing the polarity is about the same as the input image signal period Tin, the writing of the positive-polarity signal and the writing of the negative-polarity signal will be alternately performed every two times. In this way, by making the period for reversing the polarity longer than the signal writing period, the frequency of charge and discharge of the pixels can be reduced, so that the power consumption can be reduced. However, if the period for reversing the polarity is made too long, there may occur a problem that the brightness difference due to the difference in polarity is recognized as flicker. Therefore, it is preferable that the period for reversing the polarity is about the same as or shorter than the input image signal period Tin.

[0246] (Embodiment 7) Next, another configuration example of the display device and its driving method will be described. In the present embodiment, an image that interpolates the movement of an image (input image) input from the outside of the display device is generated inside the display device based on a plurality of input images, and the generated image (generated image) and the input image are sequentially displayed. By setting the generated image as an image that interpolates the movement of the input image, the movement of the moving image can be made smooth, and furthermore, the problem of deterioration of the quality of the moving image due to afterimages or the like caused by hole driving can be improved. Here, the interpolation of the moving image will be described below. The display of the moving image is ideally realized by controlling the luminance of each pixel in real time. However, the real-time individual control of the pixels has problems such as an extremely large number of control circuits, a wiring space problem, and a problem of an extremely large data amount of the input image, and it is difficult to realize. Therefore, the display device's display of the moving image ​ The display is performed by sequentially displaying a plurality of still images at a constant period so that the display appears as a moving image. This period (referred to as the input image signal period in this embodiment and denoted as Tin) is standardized. For example, in the NTSC standard, it is 1 / 60 second, and in the PAL standard, it is 1 / 50 second. Even with such a period, in a CRT which is an impulse type display device, no problem occurred in moving image display. However, in a hold type display device, if a moving image conforming to these standards is displayed as it is, a problem (hold blur) occurs where the display becomes unclear due to afterimages and the like caused by the hold type. Hold blur is recognized as a discrepancy between the unconscious movement interpolation by the human eye's tracking and the hold type display. Therefore, it can be reduced by shortening the input image signal period (bringing it closer to real-time individual control of pixels) compared to the conventional standard. However, shortening the input image signal period involves changing the standard and further increasing the data volume, so it is difficult. However, based on the standardized input image signal, an image that interpolates the movement of the input image is generated inside the display device, and the input image is interpolated and displayed by the generated image, so that hold blur can be reduced without changing the standard or increasing the data volume. Thus, generating an image signal inside the display device based on the input image signal and interpolating the movement of the input image is called interpolation of a moving image. By the method of interpolating a moving image in this embodiment, moving image blur can be reduced. The method of interpolating a moving image in this embodiment can be divided into an image generation method and an image display method.

[0247] It can be cut. And for a specific pattern of movement, by using another image generation method and / or image display method, motion blur can be effectively reduced. FIGS. 13(A) and (B) are schematic diagrams for explaining an example of an interpolation method for a video in the present embodiment. In FIGS. 13(A) and (B), the horizontal axis represents time, and the timing at which each image is processed is represented by the horizontal position. The part marked "input" represents the timing at which the input image signal is input. Here, we are focusing on two temporally adjacent images, image 5121 and image 5122. The input images are input at intervals of a period Tin. Note that the length of one period Tin may be referred to as one frame or one frame period. The part marked "generate" represents the timing at which a new image is generated from the input image signal. Here, we are focusing on the generated image, image 5123, which is generated based on image 5121 and image 5122. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. In FIGS. 13(A) and (B), the horizontal axis represents time, and the timing at which each image is processed is represented by the horizontal position. The part marked "input" represents the timing at which the input image signal is input. Here, we are focusing on two temporally adjacent images, image 5121 and image 5122. The input images are input at intervals of a period Tin. Note that the length of one period Tin may be referred to as one frame or one frame period. The part marked "generate" represents the timing at which a new image is generated from the input image signal. Here, we are focusing on the generated image, image 5123, which is generated based on image 5121 and image 5122. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. Here, we are focusing on two temporally adjacent images, image 5121 and image 5122. The input images are input at intervals of a period Tin. Note that the length of one period Tin may be referred to as one frame or one frame period. The part marked "generate" represents the timing at which a new image is generated from the input image signal. Here, we are focusing on the generated image, image 5123, which is generated based on image 5121 and image 5122. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. The input images are input at intervals of a period Tin. Note that the length of one period Tin may be referred to as one frame or one frame period. The part marked "generate" represents the timing at which a new image is generated from the input image signal. Here, we are focusing on the generated image, image 5123, which is generated based on image 5121 and image 5122. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. The part marked "generate" represents the timing at which a new image is generated from the input image signal. Here, we are focusing on the generated image, image 5123, which is generated based on image 5121 and image 5122. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. The part marked "generate" represents the timing at which a new image is generated from the input image signal. Here, we are focusing on the generated image, image 5123, which is generated based on image 5121 and image 5122. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. The part marked "display" represents the timing at which the image is displayed on the display device. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. Although only the images other than the images we are focusing on are marked with dashed lines, by treating them in the same way as the images we are focusing on, an example of the interpolation method for a video in the present embodiment can be realized. An example of the interpolation method for a video in the present embodiment is, as shown in FIG. 13(A), to perform video interpolation by displaying the generated image generated based on two temporally adjacent input images in the gap between the timings at which the two input images are shown. At this time, it is preferable that the display period of the display image is 1 / 2 of the input period of the input image.

[0248] An example of the interpolation method for a video in the present embodiment is, as shown in FIG. 13(A), to perform video interpolation by displaying the generated image generated based on two temporally adjacent input images in the gap between the timings at which the two input images are shown. At this time, it is preferable that the display period of the display image is 1 / 2 of the input period of the input image. An example of the interpolation method for a video in the present embodiment is, as shown in FIG. 13(A), to perform video interpolation by displaying the generated image generated based on two temporally adjacent input images in the gap between the timings at which the two input images are shown. At this time, it is preferable that the display period of the display image is 1 / 2 of the input period of the input image. An example of the interpolation method for a video in the present embodiment is, as shown in FIG. 13(A), to perform video interpolation by displaying the generated image generated based on two temporally adjacent input images in the gap between the timings at which the two input images are shown. At this time, it is preferable that the display period of the display image is 1 / 2 of the input period of the input image. At this time, it is preferable that the display period of the display image is 1 / 2 of the input period of the input image. However, the display period is not limited to this, and various display periods can be used. For example, the display period can be set to the input period. By setting the display period to less than half the normal period, the video can be displayed more smoothly. By making the period longer than half the input period, power consumption can be reduced. An image is generated based on two adjacent input images, but the number of input images is limited to two. A number is not fixed and may be any number. For example, three (or more) adjacent in time If we generate an image based on an input image (which may be better), it will be easier to generate an image based on two input images. In this way, a generated image with high accuracy can be obtained. The same time as the input timing of the image 5122, that is, the display timing relative to the input timing The display time in the video interpolation method of this embodiment is one frame behind. The timing is not limited to this, and various display timings can be used. For example, You can delay the display timing by one or more frames. This allows the display timing of the generated image 5123 to be delayed, so that the image This allows for more time for the generation of 5123, and reduces power consumption and manufacturing costs. If the display timing is too slow relative to the input timing, The input image is stored for a longer period of time, and the memory capacity required for storage increases. The display timing relative to the input timing is about 1 to 2 frames behind. preferable.

[0249] Here, the specific example of the image 5123 generated based on the image 5121 and the image 5122 is In order to interpolate a moving image, it is necessary to detect the motion of the input image. Although it is necessary, in this embodiment, a method called block matching can be used to detect the movement of the input image. However, it is not limited to this, and various methods (methods for taking the difference of image data, methods using Fourier transform, etc.) can be used. In the block matching method, first, the image data for one input image (here, the image data of image 5121) is stored in data storage means (a storage circuit such as a semiconductor memory, RAM, etc.). Then, the image in the next frame (here, image 5122) is divided into a plurality of regions. The divided regions can be rectangles of the same shape as shown in FIG. 13(A), but it is not limited to this, and various shapes (changing the shape or size depending on the image, etc.) can be used. After that, for each divided region, a comparison is made between the image data of the previous frame stored in the data storage means (here, the image data of image 5121) and the data, and a region where the image data is similar is searched. In the example of FIG. 13(A), a region where the data is similar to region 5124 in image 5122 is searched in image 5121, and it is assumed that region 5126 has been searched. When searching in image 5121, the search range is preferably limited. In the example of FIG. 13(A), region 5125, which is about four times the area of region 5124, is set as the search range. By making the search range larger than this, the detection accuracy can be increased even in a fast-moving video. However, if the search is performed too widely, the search time will become extremely long, making it difficult to realize the detection of movement. Therefore, region 5125 is preferably about two to six times the area of region 5124. After that, the searched region 5126 and the region in image 5122 In the example of FIG. 13(A), a region where the data is similar to region 5124 in image 5122 is searched in image 5121, and it is assumed that region 5126 has been searched. When searching in image 5121, the search range is preferably limited. In the example of FIG. 13(A), region 5125, which is about four times the area of region 5124, is set as the search range. By making the search range larger than this, the detection accuracy can be increased even in a fast-moving video. However, if the search is performed too widely, the search time will become extremely long, making it difficult to realize the detection of movement. Therefore, region 5125 is preferably about two to six times the area of region 5124. After that, the searched region 5126 and the region in image 5122 However, if the search is performed too widely, the search time will become extremely long, making it difficult to realize the detection of movement. Therefore, region 5125 is preferably about two to six times the area of region 5124. After that, the searched region 5126 and the region in image 5122 The difference in position from area 5124 is obtained as motion vector 5127. Motion vector 51 27 represents the motion of the image data in area 5124 over one frame period. And then in order to generate an image representing an intermediate state of the motion, an image generation vector 5128 is created with the same direction as the motion vector but a different magnitude and the image data included in area 5126 in image 5121 is moved according to the image generation vector 5128 to form the image data within area 5129 in image 512 3. By performing this series of processes for all areas in image 51 22, image 5123 is generated. And by sequentially displaying image 5121, image 5123, and image 5122, the video can be interpolated . Note that object 5130 in the image has different positions (i.e., is moving) in image 5121 and image 5122, but the generated image 5123 is at the midpoint of the objects in image 5121 and image 5122. By displaying such an image, the motion of the video can be smoothed and the blurriness of the video due to afterimages etc. can be improved . Incidentally, the magnitude of the image generation vector 5128 can be determined according to the display timing of image 5123 . In the example of Fig. 13(A), the display timing of image 5123 is set as the midpoint (1 / 2) of the display timings of image 5121 and image 5122, so the magnitude of the image generation vector 5128 is set as 1 / 2 of the motion vector 5127, but also, for example, if the display timing is at 1 / 3, the magnitude can be set as 1 / 3, and if the display timing is at 2 / 3, the magnitude can be set as 2 / 3

[0250] . Incidentally, the magnitude of the image generation vector 5128 can be determined according to the display timing of image 5123 . In the example of Fig. 13(A), the display timing of image 5123 is the midpoint (1 / 2) of the display timings of image 5121 and image 5122, so the magnitude of the image generation vector 5128 is 1 / 2 of the motion vector 5127, but also, for example, if the display timing is 1 / 3, the magnitude can be 1 / 3, and if the display timing is 2 / 3, the magnitude can be 2 / 3 . . .

[0251] In this way, multiple regions with various motion vectors are moved to create a new image. When creating an image, there are areas where other areas have already been moved (overlaps) within the destination area, and There may be some blank areas that are not moved from the area. The method for correcting the overlapping parts is, for example, The method is to take the average of the motion vectors, and then prioritize the data with the highest priority. A method to make the data in the generated image, prioritize color (or brightness) but not brightness ( For the color, the average method can be used. The image data at the corresponding position of the image 5121 or 5122 is directly transferred to the generated image. A method of converting the image data into image data, and averaging the image data at the relevant position of the image 5121 or the image 5122. Then, the generated image 5123 is generated by the image generation By displaying the vectors at the same time according to the size of the vector 5128, the movement of the video becomes smoother. Furthermore, the quality of the video may be reduced due to image retention caused by hold drive. The problem can be improved.

[0252] Another example of the moving image interpolation method according to the present embodiment is a time-domain interpolation method as shown in FIG. A generated image based on two input images that are adjacent to each other is called a generated image. When displaying images in the gap between the times they are displayed, each image is further divided into multiple sub-images. By dividing the image into several parts and displaying them, it is possible to perform video interpolation. In addition to the benefits of a shorter period, dark images are periodically displayed (the display method is In other words, the image display period is Compared with the case of simply making it half as long as the input period, the blurriness of the video due to afterimages and the like can be further improved. In the example of Fig. 13(B), for "input" and "generation", the same processing as in the example of Fig. 13(A) can be performed, so the description is omitted. The "display" in the example of Fig. 13(B) can display one input image or / and generated image by dividing it into a plurality of sub-images. Specifically, as shown in Fig. 13(B), by dividing the image 5121 into sub-images 5121a and 5121b and sequentially displaying them, it is made to be perceived by the human eye as if the image 5121 is displayed. By dividing the image 5123 into sub-images 5123a and 51 23b and sequentially displaying them, it is made to be perceived by the human eye as if the image 5123 is displayed. By dividing the image 5122 into sub-images 5122a and 5122b and sequentially displaying them in the same way, it is made to be perceived by the human eye as if the image 5122 is displayed. That is, while the image perceived by the human eye is the same as in the example of Fig. 13(A), the display method can be made closer to the impulse type, so the blurriness of the video due to afterimages and the like can be further improved. Note that although the number of divisions of the sub-images is two in Fig. 13(B), it is not limited to this and various numbers of divisions can be used. Note that the timing at which the sub-images are displayed is equally spaced (1 / 2) in Fig. 13( B), but it is not limited to this and various display timings can be used. For example, by making the display timing of the dark sub-images (5121b, 5122b, 5123b) earlier (specifically, from 1 / 4 to 1 / 2 timing), the display method can be made closer to the impulse type, so the blurriness of the video due to afterimages and the like can be further improved. For example, by making the display timing of the dark sub-images (5121b, 5122b, 5123b) earlier (specifically, from 1 / 4 to 1 / 2 timing), the display method can be made closer to the impulse type, so the blurriness of the video due to afterimages and the like can be further improved. It can be further improved. Or, by delaying the display timing of the dark sub-image (specifically, at the timing from 1 / 2 to 3 / 4), the display period of the bright image can be lengthened, thereby improving the display efficiency and reducing the power consumption. / 2 to 3 / 4), the display period of the bright image can be lengthened, thus improving the display efficiency and reducing the power consumption.

[0253] Another example of the video interpolation method in this embodiment is an example in which the shape of an object moving within an image is detected and different processes are performed depending on the shape of the moving object. The example shown in FIG. 13(C) represents the display timing in the same way as the example in FIG. 13(B), but shows the case where the displayed content is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is the same as in the example of FIG. 13(B), but shows the case where the displayed content is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The blurriness of the video in hold drive may vary depending on the nature of the moving object. In particular, it is often significantly recognized when the character is moving. This is because when reading a moving character, the line of sight inevitably follows the character, making it easier for hold blur to occur. Furthermore, since characters often have distinct outlines, the blurriness due to hold blur may be further emphasized. That is, determining whether the object moving within the image is a character and performing special processing when it is a character is effective for reducing hold blur. Specifically, for an object moving within an image, contour detection or / and pattern detection, etc. are performed. When it is determined that the object is a character, motion interpolation is performed even between sub-images divided from the same image, and the intermediate state of the motion is displayed to make the motion smooth. When the object is a moving character (also called scrolling text, subtitle, telop, etc.). Note that since "input" and "generation" may be the same as in FIG. 13(B), they are not shown. The...

Claims

[Claim 1] A method for driving a liquid crystal display device having a backlight and pixels, comprising the steps of: A first step of performing super-resolution processing using first data; a second step of performing edge enhancement processing using the second data on which the super-resolution processing has been performed; a third step of performing frame interpolation processing using the third data that has been subjected to the edge enhancement processing; a fourth step of performing a first local dimming process using the third data on which the edge enhancement process has been performed; a fifth step of performing a second local dimming process using the fourth data on which the frame interpolation process has been performed and the fifth data on which the first local dimming process has been performed; a sixth step of performing an overdrive process using sixth data on which the second local dimming process has been performed; the first local dimming process includes a process of controlling the luminance of the backlight, the second local dimming process includes a process of controlling a signal to be supplied to the pixel, The third step and the fourth step are performed simultaneously, A method for driving a liquid crystal display device, comprising the steps of: performing the fifth step after the third step and after the fourth step.

Images