Electronic apparatus and display system

Abstract

Provided is a new electronic apparatus. The present invention has a system control unit, a light emission drive unit, a light emitting device, an imaging device, and an image synthesis unit. The system control unit has a light emission luminance setting unit for setting the luminance of the light emitting device. The light emission drive unit has a luminance switching unit that switches the luminance of the light emitting device from a first luminance level to a second luminance level. The light emitting device has a function of exposing a subject to be imaged by the imaging device to light at the first luminance level or second luminance level. The imaging device has a function of outputting, to the image synthesis unit, first image data obtained by imaging the subject that has been exposed by the light emitting device at the first luminance level, and second image data obtained by imaging the subject that has been exposed by the light emitting device at the second luminance level.

Description

Electronic devices and display systems

[0001] One aspect of the present invention relates to an electronic device, a display system, and the like.

[0002] Note that one embodiment of the present invention is not limited to the above technical field. The technical field of one embodiment of the invention disclosed in this specification and the like relates to an object, a method, a driving method, or a manufacturing method. Alternatively, one embodiment of the present invention relates to a process, a machine, manufacture, or a composition of matter. More specifically, examples of the technical field of one embodiment of the present invention disclosed in this specification and the like include semiconductor devices, display devices, light-emitting devices, power storage devices, optical devices, imaging devices, lighting devices, arithmetic devices, control devices, memory devices, input devices, output devices, input / output devices, signal processing devices, arithmetic processing devices, electronic computers, and driving methods thereof or manufacturing methods thereof.

[0003] Electronic devices equipped with imaging devices for capturing images of a subject, such as digital cameras and smartphones, are becoming increasingly common. When bright areas (highlight areas) and dark areas (shadow areas) exist within an image capture area that includes the subject, phenomena such as blown-out highlights and crushed shadows (halation) occur. For this reason, high dynamic range (HDR) processing is used to capture images of the subject, in which image data is acquired under different exposure conditions, such as by varying exposure times, and then the image data is combined (see, for example, Patent Document 1).

[0004] International Publication No. 2019 / 171782

[0005] When a dark area exists in the imaging area including the subject, it is effective to suppress blackout by increasing the brightness of a light-emitting device such as an LED (Light Emitting Diode) light or a display unit during imaging. Also, when a bright area exists in the imaging area including the subject, it is effective to suppress whiteout by shortening the exposure time. However, since a flash of light with a constant brightness is required during the exposure time to prevent whiteout and blackout, a large amount of power is consumed.

[0006] An object of one embodiment of the present invention is to provide an electronic device that can suppress an increase in power consumption.An object of one embodiment of the present invention is to provide an electronic device that displays a captured image with excellent display quality.An object of one embodiment of the present invention is to provide an electronic device that is highly convenient.An object of one embodiment of the present invention is to provide a novel electronic device.

[0007] The above-listed problems do not preclude the existence of other problems. Note that one embodiment of the present invention does not necessarily solve all of the above-listed problems. Note that problems other than the above-listed problems will become apparent from the description of this specification, drawings, claims, etc., and problems other than the above-listed problems can be extracted from the description of this specification, drawings, claims, etc.

[0008] One embodiment of the present invention is an electronic device including a system control unit, a light-emitting driving unit, a light-emitting device, an imaging device, and an image synthesis unit. The system control unit includes a light-emitting luminance setting unit that sets the luminance of the light-emitting device. The light-emitting driving unit includes a luminance switching unit that switches the luminance of the light-emitting device from a first luminance to a second luminance. The light-emitting device has a function of irradiating a subject to be imaged by the imaging device with light at the first luminance or the second luminance. The imaging device has a function of outputting, to the image synthesis unit, first image data obtained by imaging the subject when irradiated with light at the first luminance by the light-emitting device and second image data obtained by imaging the subject when irradiated with light at the second luminance by the light-emitting device.

[0009] One embodiment of the present invention is an electronic device including a system controller, a light-emitting driver, a light-emitting device, an imaging device, an image synthesis unit, and an illuminance sensor. The system controller includes a light-emitting luminance setting unit that sets the luminance of the light-emitting device based on an output of the illuminance sensor. The light-emitting driver unit includes a luminance switching unit that switches the luminance of the light-emitting device from a first luminance to a second luminance. The light-emitting device has a function of irradiating a subject to be imaged by the imaging device with light at the first luminance or the second luminance. The imaging device has a function of outputting, to the image synthesis unit, first image data obtained by imaging the subject when irradiated with light at the first luminance by the light-emitting device and second image data obtained by imaging the subject when irradiated with light at the second luminance by the light-emitting device.

[0010] In one aspect of the present invention, an electronic device is preferably provided that includes an optical system that controls exposure of an imaging device and an optical system driving unit that controls driving of the optical system, wherein the system control unit includes an exposure time setting unit that sets the exposure time of the imaging device, and the optical system driving unit includes an exposure time switching unit that switches the exposure time of the imaging device from a first exposure time to a second exposure time, and the first exposure time and the second exposure time have different lengths.

[0011] In one aspect of the present invention, the electronic device is preferably configured such that the image synthesis unit outputs synthesized image data by replacing signal saturation regions in the first image data with corresponding regions in the second image data.

[0012] Another embodiment of the present invention is a display system having a light-emitting device and an imaging device, in which the light-emitting device is connected to a system control unit via a light-emitting drive unit, the imaging device is connected to an image synthesis unit and the system control unit, the system control unit has a light-emitting luminance setting unit that sets the luminance of the light-emitting device, the light-emitting drive unit has a luminance switching unit that switches the luminance of the light-emitting device from a first luminance to a second luminance, the imaging device outputs first image data obtained by imaging a subject illuminated by the light-emitting device with light of the first luminance and second image data obtained by imaging the subject illuminated by the light-emitting device with light of the second luminance to the image synthesis unit, and the image synthesis unit synthesizes the first image and the second image.

[0013] Other aspects of the present invention will be described in the following embodiments and in the drawings.

[0014] According to one embodiment of the present invention, it is possible to provide an electronic device that can suppress an increase in power consumption. Alternatively, it is possible to provide an electronic device that displays captured images with excellent quality. Alternatively, it is possible to provide an electronic device that is highly convenient. Alternatively, it is possible to provide a novel electronic device.

[0015] The effects listed above do not preclude the existence of other effects. It is not necessary for one embodiment of the present invention to have all of the effects listed above. Effects other than the effects listed above will become apparent from the description in this specification, drawings, claims, etc., and other effects other than the effects listed above can be extracted from the description in this specification, drawings, claims, etc.

[0016] FIGS. 1A to 1C are block diagrams and schematic diagrams illustrating electronic devices. FIGS. 2A and 2B are schematic diagrams illustrating electronic devices. FIGS. 3A and 3B are schematic diagrams illustrating electronic devices. FIGS. 4A to 4C are schematic diagrams illustrating the operation of electronic devices. FIG. 5 is a flowchart illustrating electronic devices. FIGS. 6A to 6D are schematic diagrams illustrating electronic devices. FIGS. 7A and 7B are schematic diagrams illustrating electronic devices. FIG. 8 is a schematic diagram illustrating electronic devices. FIGS. 9A and 9B are schematic diagrams illustrating electronic devices. FIGS. 10A and 10B are schematic diagrams illustrating electronic devices. FIG. 11 is a flowchart illustrating electronic devices. FIGS. 12A and 12B are schematic diagrams illustrating electronic devices. FIGS. 13A to 13D are circuit diagrams illustrating electronic devices. FIGS. 14A and 14B are schematic diagrams illustrating electronic devices. FIG. 15 is a schematic diagram illustrating electronic devices. FIGS. 16A to 16C are schematic diagrams illustrating electronic devices. FIG. 17 is a schematic diagram illustrating electronic devices. 18A to 18C are schematic diagrams illustrating electronic devices. FIG. 19 is a schematic diagram illustrating an electronic device. FIGS. 20A to 20C are schematic diagrams illustrating an electronic device. FIGS. 21A to 21C are schematic diagrams illustrating an electronic device. FIGS. 22A and 22B are block diagrams illustrating an electronic device. FIGS. 23A and 23B are schematic diagrams illustrating an electronic device. FIGS. 24A and 24B are schematic diagrams illustrating an electronic device. FIGS. 25A and 25B are diagrams illustrating an example of an electronic device. FIGS. 26A to 26D are diagrams illustrating an example of an electronic device. FIGS. 27A to 27G are diagrams illustrating an example of an electronic device.

[0017] Hereinafter, embodiments will be described with reference to the drawings. However, the embodiments can be implemented in many different ways. Therefore, it will be readily understood by those skilled in the art that various changes in form and details can be made without departing from the spirit and scope of the present invention. Therefore, one aspect of the present invention should not be interpreted as being limited to the description of the embodiments.

[0018] In this specification and the like, the configuration shown in each embodiment can be appropriately combined with the configuration shown in another embodiment to form one aspect of the present invention. Furthermore, when multiple configurations are shown in one embodiment, these configurations can be appropriately combined to form one aspect of the present invention.

[0019] In addition, in the drawings explaining the embodiments, the same symbols may be used in common between different drawings for the same parts or parts having similar functions in the configuration of the invention, thereby omitting repeated explanations.

[0020] In addition, in this specification and drawings, the components of the present invention may be classified by function and shown as independent elements. However, it may be difficult to separate the components by function, and one element may be involved in multiple functions, or one function may be involved across multiple elements. Therefore, the elements shown in this specification and drawings may not be limited to the descriptions therein and may be rephrased appropriately.

[0021] Furthermore, in this specification and drawings, when the same reference numeral is used for multiple elements, and particularly when it is necessary to distinguish between them, the reference numeral may be accompanied by an identifying symbol such as "A", "b", "_1", "[n]", or "[m, n]". Furthermore, when explaining matters common to multiple elements accompanied by identifying symbols, or when it is not necessary to distinguish between them, the elements may be described without the identifying symbol.

[0022] Embodiment 1 An electronic device according to one embodiment of the present invention and its operation will be described with reference to the drawings.

[0023] <Configuration Example 1> FIG. 1A is a block diagram showing a configuration example of an electronic device.

[0024] The electronic device 100 has a system control unit 110, a light emitting driving unit 140, a light emitting device 150, an imaging device driving unit 120, an imaging device 121, an image synthesis unit 170, an optical system driving unit 130, an optical system 131, a memory unit 198, and a main memory 199.

[0025] The system control unit 110 has a function of reading out programs, data, etc. stored in the storage unit 198 and performing signal processing in the electronic device 100. The system control unit 110 has a function of writing programs, data, etc. obtained by signal processing into the storage unit 198. The system control unit 110 controls each circuit within the electronic device 100 by signal processing of the programs, data, etc.

[0026] The storage unit 198 has a function of storing various data, programs, application software, etc. The storage unit 198 is a storage device having a non-volatile storage medium such as a flash memory or an SSD (Solid State Drive).

[0027] The main memory 199 has an area for temporarily storing various data such as image data, etc. The main memory 199 is a storage device having a volatile storage medium such as a DRAM (Dynamic Random Access Memory).

[0028] The imaging device 121 can capture an image of a subject via the optical system 131. The imaging device 121 can capture still images or videos. The imaging device 121 has an element (imaging element) that receives light from a subject (subject light) and generates an imaging signal (image data). Note that generating image data by receiving subject light and exposing the imaging element in the imaging device 121 is sometimes referred to as imaging (or simply imaging) of the subject in the imaging device 121. Examples of imaging elements include image sensors such as a CCD (Charge Coupled Device) and a CMOS (Complementary Metal Oxide Semiconductor) that convert an optical image into an electrical signal. The imaging device driver 120 is a circuit that controls the imaging device 121 to acquire image data.

[0029] The image data output from the imaging device 121 is subjected to processing such as gain adjustment, and then converted into digital image data via an A / D (Analog to Digital) conversion circuit or the like. The digitized image data is output to the image synthesis unit 170. The image data output from the imaging device 121 can also be stored in the storage unit 198 or the main memory 199.

[0030] The image synthesis unit 170 performs image processing on the image data generated by the imaging device 121. Specifically, it has a function of generating synthesized image data by replacing signal saturation areas in multiple pieces of input image data with corresponding areas in other image data. The synthesized image data will be described later. The synthesized image data may also be referred to as synthesized image data. The image data and synthesized image data that have undergone image processing may be stored in the main memory 199 and read out in accordance with the image processing.

[0031] The optical system 131 has a lens, an aperture, a mechanical shutter (hereinafter referred to as the shutter), etc. Subject light passes through the optical system 131 and is received by the imaging device 121 having an image sensor, thereby performing exposure. The optical system driving unit 130 is a driving unit for driving the lens, aperture, shutter, etc.

[0032] The light-emitting device 150 has an element, such as a light-emitting element, that can be controlled to emit light of different luminances within an imaging period for acquiring multiple pieces of image data. Because the light emitted by the light-emitting device 150 can adjust the subject light, the imaging device 121 can capture images with different exposures. As the light-emitting element, a light-emitting diode (light-emitting diode) or an organic electroluminescence element can be used. In the case of an element having an organic electroluminescence element, the light-emitting device 150 can be an OLED (organic LED) display. In addition to displaying images, an OLED display can be used as a flashlight by controlling the luminance by controlling the amount of current for each region. The light-emitting driver 140 is a driver for driving the light-emitting element.

[0033] The light that light-emitting device 150 irradiates onto the subject is light emitted from a light-emitting element that serves as a light source. Light of different luminances that light-emitting device 150 irradiates onto the subject can be controlled according to the magnitude of the current flowing through the light-emitting element. For example, when irradiating the subject with light of a first luminance from light-emitting device 150, a first current is passed through the light-emitting element of light-emitting device 150, and when irradiating the subject with light of a second luminance that is lower than the first luminance from light-emitting device 150, a second current that is lower than the first current is passed through the light-emitting element of light-emitting device 150, thereby making it possible to irradiate the subject with light of different luminances.

[0034] Brightness corresponds to the intensity of light (luminous flux) per unit area and per unit solid angle. The brightness of the light emitted by the light-emitting device 150 can be calculated by observing the light in front of the light-emitting device 150 (in the direction of the subject) using a luminance meter. Note that luminous intensity corresponds to the intensity of light per unit solid angle. Furthermore, illuminance corresponds to the intensity of light per unit area. Therefore, brightness can be replaced with luminous intensity or illuminance.

[0035] FIG. 1B is a block diagram for explaining the functions of the system control unit 110, the light emission driving unit 140, and the light emitting device 150. As shown in FIG.

[0036] The system control unit 110 has a light emission luminance setting unit 111. The light emission luminance setting unit 111 sets the luminance of the light emitting device 150. The light emission luminance setting unit 111 performs settings for gradually switching the luminance of the light irradiated onto the subject by the light emitting device 150 according to the number of multiple pieces of image data for generating composite image data.

[0037] The light-emitting drive unit 140 has a luminance switching unit 141. The luminance switching unit 141 switches the luminance of the light-emitting device 150 according to the setting in the light-emitting luminance setting unit 111. For example, when two pieces of image data are combined to generate composite image data, the luminance switching unit 141 drives the light-emitting device 150 to switch the luminance of light irradiated onto the subject from a first luminance to a second luminance during the imaging period. During the imaging period, the light reflected by the light-emitting device 150 irradiated onto the subject is exposed by the imaging element of the imaging device 121. In other words, by varying the luminance of the light irradiated onto the subject by the light-emitting device 150, the imaging device 121 can output image data with different amounts of light captured by the imaging element.

[0038] 1C is a schematic diagram showing the appearance of electronic device 100. As shown in FIG. 1C , as an example, a light-emitting device 150 and an imaging device 121 are provided on a first surface (e.g., the front surface) of housing 190. Furthermore, integrated circuits such as a system control unit 110 are provided inside housing 190. By having light-emitting device 150 and imaging device 121 on the same surface, electronic device 100 can capture an image with imaging device 121 in a state where light is irradiated from light-emitting device 150 onto a subject.

[0039] 2A is a diagram schematically illustrating the luminance of light-emitting device 150, and the imaging and exposure time of a subject in imaging device 121 according to one embodiment of the present invention. As shown in FIG. 2A , during a period (hereinafter referred to as period TA) during which multiple pieces of image data are acquired to obtain composite image data, the luminance of light-emitting device 150 is changed from luminance L1 to luminance L2. Imaging device 121 performs imaging E1 during exposure time T1. Imaging device 121 performs imaging E2 during exposure time T2. Because the luminance changes continuously during period TA, the luminance per unit time during exposure time T1 and the luminance per unit time during exposure time T2 can be different.

[0040] By varying the luminance of the light-emitting device 150 during the period TA, the images E1 and E2 can be captured in different exposure states. The exposure time T1 can be the same as the exposure time T2.

[0041] This configuration allows the luminance of the light-emitting device to be varied for each exposure time during which imaging is performed. In the imaging device 121, the amount of light taken into the imaging element can be varied for each different imaging session, allowing imaging with different exposures. This allows image data to be acquired with reduced whiteout and / or blackout. Furthermore, the period TA includes a period during which the luminance of the light-emitting device 150 can be reduced, thereby reducing power consumption compared to when imaging is performed multiple times at a constant luminance. Furthermore, the shutter opening and closing speed can be kept constant when imaging is performed multiple times in the optical system 131.

[0042] The configuration of Fig. 2A is also effective when capturing images with three or more different exposures and using the resulting image data to obtain composite image data. Fig. 2B is a schematic diagram showing a case where three images E1 to E3 are captured with exposure times T1 to T3 within a period TA in the configuration of Fig. 2A.

[0043] 2A illustrates a configuration in which the image data acquired by image capture E1 at exposure time T1 and the image data acquired by image capture E2 at exposure time T2 are combined to obtain composite image data when the luminance of light-emitting device 150 is changed at a constant rate from luminance L1 (>L2) to luminance L2, but other configurations are also possible. For example, the composite image data may be obtained by combining image data acquired by capturing an image with light-emitting device 150 at a constant luminance L1 during exposure time T1 with image data acquired by capturing an image with light-emitting device 150 at a constant luminance L2 during exposure time T2.

[0044] 3A shows a schematic diagram of a configuration in which, during a period TA, image data is acquired by capturing an image E1 with an exposure time T1 while the luminance of the light-emitting device 150 is set to luminance L1, and image data is acquired by capturing an image E2 with an exposure time T2 while the luminance of the light-emitting device 150 is set to luminance L2. This configuration allows the luminance of the light-emitting device 150 to be kept constant during exposure times T1 and T2, thereby making it possible to maintain a constant light intensity during exposure of the subject light by the imaging device 121. This reduces image unevenness when the acquired image data is displayed.

[0045] The configuration of Fig. 3A is also effective when capturing images with three or more different exposures as shown in Fig. 2B and using the resulting image data to obtain composite image data. Fig. 3B shows a schematic diagram of the configuration of Fig. 3A when three images E1 to E3 are captured with exposure times T1 to T3 within a period TA.

[0046] 2A and 3A, a configuration in which the luminance of light-emitting device 150 is changed nonlinearly from luminance L1 to luminance L2 during period TA is also possible. Specifically, FIGS. 4A and 4B show schematic diagrams of a configuration in which the luminance of light-emitting device 150 is changed nonlinearly from luminance L1 to luminance L2 during period TA, image data is acquired by image capture E1 with exposure time T1, and then image data is acquired by image capture E2 with exposure time T2. This configuration allows the luminance of light-emitting device 150 to change sharply during exposure times T1 and T2, making it possible to acquire image data with exposures different from those in FIGS. 2A and 3A.

[0047] 2A and 2B show a configuration in which image capturing is performed with multiple exposure times to reduce the luminance of light-emitting device 150 from luminance L1 to luminance L2 during period TA, and multiple pieces of image data are acquired, but other configurations are also possible. For example, as shown in FIG. 4C , it is also possible to perform image capturing with multiple exposure times to increase the luminance from L2 to L1 during period TA, and acquire multiple pieces of image data.

[0048] Next, in a configuration in which image data is acquired by switching the luminance of the light-emitting device during the period TA described in Figures 2A to 4C and capturing images over multiple exposure periods, a flowchart for obtaining composite image data from multiple image data will be described with reference to Figure 5. Figures 6A to 7B are schematic diagrams for explaining the steps shown in Figure 5.

[0049] In step S11, a first image is captured at a first luminance. The first image is a series of operations for acquiring image data by capturing an image E1 during the exposure time T1. In step S11, the first luminance can be constant or can be varied.

[0050] 6A is a schematic diagram of the first imaging in step S11. In FIG. 6A, light-emitting device 150 in housing 190 irradiates subjects 200 and 201 with light L1 (light with luminance L1). Subject light R1 obtained by the irradiation is used by imaging device 121 for exposure to obtain image data. Subject 200 is illustrated as a person, and subject 201 is illustrated as a light source. Imaging device 121 captures subjects 200 and 201 illuminated by light-emitting device 150 at luminance L1, and outputs the image data obtained to image synthesis unit 170.

[0051] 6B is a schematic diagram of image data obtained by capturing images of subjects 200 and 201 using light-emitting device 150 that emits light L1 in step S11. In image data F1 shown in FIG. 6B, subject 200 is displayed clearly by light L1, while subject 201 is displayed as a blown-out area (shown by a dotted line in the drawing).

[0052] In step S12, a second image is captured at the second luminance. The second image is a series of operations for acquiring image data by image capture E2 performed during the exposure time T2 described above. In step S12, the second luminance can be constant or can be varied. Note that step S12 shown in FIG. 5 can be performed interchangeably with step S11.

[0053] 6C is a schematic diagram of the second imaging in step S12. In FIG. 6C, light-emitting device 150 in housing 190 irradiates subjects 200 and 201 with light L2 (light with luminance L2). Subject light R2 obtained by the irradiation is used by imaging device 121 for exposure to obtain image data. Subject 200 is illustrated as a person, and subject 201 is illustrated as a light source. Imaging device 121 captures subjects 200 and 201 illuminated by light-emitting device 150 at luminance L2, and outputs the image data obtained to image synthesis unit 170.

[0054] 6D is a schematic diagram of image data obtained by capturing images of subjects 200 and 201 using light-emitting device 150 that emits light L2 in step S12. Light L2 has a lower luminance than light L1. Therefore, in image data F2 shown in FIG. 6D, subject 200, which is illuminated by light L2, appears as a blocked-up area (shown with hatching in the drawing), while subject 201 appears clearly.

[0055] In step S13, areas of blown out highlights or blocked up shadows are identified in the image data obtained in the first imaging in step S11. In step S14, areas of blown out highlights or blocked up shadows are identified in the image data obtained in the second imaging in step S12. It is preferable that the areas of blown out highlights or blocked up shadows are identified by the image synthesis unit 170 to which the image data obtained by the imaging device 121 is output. Note that step S13 shown in FIG. 5 can also be performed immediately after step S11. Note that step S14 shown in FIG. 5 can also be performed immediately after step S12.

[0056] The block diagram in Fig. 7A is a diagram illustrating an example of the configuration of the image synthesis unit 170. The image synthesis unit 170 has an image data acquisition unit 171 and an image data generation unit 172. The image data acquisition unit 171 has a function of identifying areas of blown-out highlights or blocked-up shadows in the image data output from the imaging device 121. To identify areas of blown-out highlights or blocked-up shadows, areas having signal saturation areas in the plurality of image data input can be identified as areas of blown-out highlights, and areas having zero signal in the plurality of image data input can be identified as areas of blocked-up shadows.

[0057] In step S13, the image data (also referred to as first image data) in which blown out highlight or blocked up shadow areas have been identified in the image data output from the imaging device 121 corresponds to the image data F1 shown in Fig. 6B. In step S14, the image data (also referred to as second image data) in which blown out highlight or blocked up shadow areas have been identified in the image data output from the imaging device 121 corresponds to the image data F2 shown in Fig. 6D. The image data generation unit 172 has a function of generating composite image data using the first image data and the second image data in which blown out highlight or blocked up shadow areas have been identified.

[0058] In step S15, the first image data and the second image data in which the blown-out highlight or crushed shadow areas obtained in steps S13 and S14 have been identified are combined to obtain combined image data. The image data combination is preferably performed by an image combination unit 170 having an image data generation unit 172.

[0059] 7B is a schematic diagram illustrating the composite image data obtained by combining the first image data and the second image data in step S15. The blown-out highlight areas in image data F1, which is the first image data, are areas that include subject 201. The crushed-black areas in image data F2, which is the second image data, are areas that include subject 200. In the composite image data FG, the blown-out highlight areas in image data F1 are replaced with non-blown-out highlight areas in image data F2, thereby making it possible to obtain clear images of both subjects 200 and 201.

[0060] In the configuration of one embodiment of the present invention described above, the luminance of a light-emitting device that irradiates a subject with light is varied for each exposure time for acquiring multiple pieces of image data. Since the intensities of subject light vary in the imaging device 121, the multiple pieces of image data can be output as image data with different exposures. Therefore, blown-out highlights and / or crushed shadows are reduced, and an electronic device can acquire composite image data with excellent display quality. Because the luminance of the light-emitting device is varied for each image acquisition period for acquiring multiple pieces of image data for obtaining composite image data, the electronic device can consume less power than when imaging is performed with the luminance of the light-emitting device set to a constant luminance.

[0061] <Configuration Example 2> In addition to the configuration in which the shutter opening / closing speed is constant when acquiring a plurality of pieces of image data in the optical system 131, the electronic device of one embodiment of the present invention can also change the shutter opening / closing speed in accordance with a change in luminance. With this configuration, in addition to the change in luminance of the light-emitting device for each image capture, the exposure time can be varied, which makes it easier to acquire image data with different exposures.

[0062] 8 is a block diagram illustrating an example of a configuration for changing the opening and closing speed of the shutter of the optical system 131 in accordance with changes in the luminance of the light emitting device. The system control unit 110, the light emission driving unit 140, the light emitting device 150, the optical system driving unit 130, and the optical system 131 are shown in FIG.

[0063] The system control unit 110 has an exposure time setting unit 112 in addition to the light emission luminance setting unit 111. The exposure time setting unit 112 sets the opening and closing speed of the shutter in the optical system 131. The exposure time setting unit 112 performs settings to gradually switch the length of the exposure time depending on the number of image data for generating composite image data.

[0064] The optical system driver 130 has an exposure time switcher 132. The exposure time switcher 132 switches the opening and closing speed of the shutter in the optical system 131, i.e., the length of the exposure time, according to the setting in the exposure time setting unit 112. For example, when combining two pieces of image data to generate combined image data, the exposure time switcher 132 drives the light emitting device 150 to switch to a first exposure time when the light emitting device 150 has a first luminance, and to a second exposure time when the light emitting device 150 has a second luminance. By varying the luminance of the light irradiated onto the subject for each image capture and varying the length of the exposure time for each image capture, it is possible to easily obtain image data with different exposure states.

[0065] FIG. 9A is a diagram schematically illustrating the luminance of light-emitting device 150, and the imaging and exposure time of a subject in imaging device 121 according to one embodiment of the present invention. As shown in FIG. 9A , during a period TA, the luminance of light-emitting device 150 is changed from luminance L1 to luminance L2. The imaging device 121 captures an image E1 for an exposure time T1 (>T2). The imaging device 121 captures an image E2 for an exposure time T2 (<T1). Because the luminance continuously changes during period TA, the luminance per unit time during exposure time T1 can be different from the luminance per unit time during exposure time T2. Furthermore, exposure time T1 and exposure time T2 can be different periods.

[0066] By varying the luminance of the light emitting device 150 and the exposure time of the imaging device 121 in the period TA, the images E1 and E2 can be captured in different exposure states.

[0067] This configuration allows the luminance and exposure time of the light-emitting device to be varied for each image capture. The image capture device 121 can capture images with different exposures because the amount of light taken into the image sensor can be varied for each image capture. This allows image data to be acquired with reduced overexposure and / or underexposure. Furthermore, the period TA includes a period during which the luminance of the light-emitting device 150 can be reduced, thereby reducing power consumption compared to capturing images multiple times at a constant luminance.

[0068] The configuration of Fig. 9A is also effective when capturing images with three or more different exposures and using the resulting image data to obtain composite image data. Fig. 9B is a schematic diagram showing a case where three images E1 to E3 are captured with exposure times T1 to T3 within a period TA in the configuration of Fig. 9A.

[0069] 9A illustrates a configuration in which the image data acquired by image capture E1 at exposure time T1 and the image data acquired by image capture E2 at exposure time T2 are combined to obtain composite image data when the luminance of light-emitting device 150 is changed at a constant rate from luminance L1 (>L2) to luminance L2, but other configurations are also possible. For example, the composite image data may be obtained by combining image data acquired by capturing an image with light-emitting device 150 at a constant luminance L1 during exposure time T1 with image data acquired by capturing an image with light-emitting device 150 at a constant luminance L2 during exposure time T2.

[0070] 10A shows a schematic diagram of a configuration in which, during a period TA, image data is acquired by capturing an image E1 with an exposure time T1 while the luminance of the light-emitting device 150 is set to luminance L1, and image data is acquired by capturing an image E2 with an exposure time T2 while the luminance of the light-emitting device 150 is set to luminance L2. This configuration allows the luminance of the light-emitting device 150 to be kept constant during exposure times T1 and T2, thereby making it possible to maintain a constant light intensity during exposure of the subject light by the imaging device 121. This reduces image unevenness when the acquired image data is displayed.

[0071] The configuration of Fig. 10A is also effective when capturing images with three or more different exposures as shown in Fig. 9B and using the resulting image data to obtain composite image data. Fig. 10B shows a schematic diagram of the configuration of Fig. 10A when three images E1 to E3 are captured with exposure times T1 to T3 within a period TA.

[0072] Next, in a configuration in which the brightness of the light-emitting device is switched during the period TA described in Figures 9A to 10B and image data is acquired by capturing images using multiple exposure times of different lengths, a flowchart for obtaining composite image data from multiple image data will be described with reference to Figure 11.

[0073] In step S21, a first image is captured at a first luminance and a first exposure time. The first image is a series of operations for acquiring image data by capturing an image E1 with the exposure time T1. In step S21, the first luminance can be constant or can be varied.

[0074] In step S22, a second image is captured at a second luminance and a second exposure time. The second image is a series of operations for acquiring image data by image capture E2 performed with the exposure time T2 described above. In step S12, the second luminance can be constant or can be varied. Note that step S22 shown in FIG. 11 can be performed interchangeably with step S21.

[0075] In step S23, areas of blown out highlights or blocked up shadows are identified in the image data obtained in the first imaging in step S21. In step S24, areas of blown out highlights or blocked up shadows are identified in the image data obtained in the second imaging in step S22. It is preferable that the areas of blown out highlights or blocked up shadows are identified by the image synthesis unit 170 to which the image data obtained by the imaging device 121 is output. Note that step S23 shown in FIG. 11 can also be performed immediately after step S21. Note that step S24 shown in FIG. 11 can also be performed immediately after step S22.

[0076] In step S25, the first image data and the second image data in which the blown-out highlight or blocked-up shadow areas obtained in steps S23 and S24 have been identified are combined to obtain combined image data.

[0077] The above-described configuration of one embodiment of the present invention is configured such that the luminance of the light-emitting device irradiated onto a subject is varied for each exposure period for acquiring a plurality of image data, and the length of the exposure period is also varied. Since the intensity of subject light varies in the imaging device 121, the plurality of image data can be output as image data with different exposure states. Therefore, blown-out highlights and / or crushed shadows are reduced, and an electronic device can acquire composite image data with excellent display quality. Since the luminance of the light-emitting device is varied for each imaging period for acquiring a plurality of image data for acquiring composite image data, an electronic device can consume less power than when imaging is performed with the luminance of the light-emitting device set to a constant luminance.

[0078] In the configuration of FIG. 9A, the imaging device 121 has been described as using a global shutter system in which the exposure time for acquiring image data is the entire frame, but other configurations, such as a rolling shutter system, may also be used.

[0079] Fig. 12B is a diagram schematically showing the luminance of light-emitting device 150 and the period of imaging by imaging device 121 when the rolling shutter method is applied to the configuration of Fig. 9A. As shown in Fig. 12A, imaging in the rolling shutter method is performed by scanning the imaging elements (sensors) of imaging device 121 in the horizontal direction in order from the upper level to the lower level of the sensors. As shown in Fig. 12A, it is preferable that the luminance of light-emitting device 150, which is changed during the imaging period, is changed over a period from when the operation is completed on the upper level to when the operation is completed on the lower level of the sensors.

[0080] The configuration of Fig. 12A is also effective for the configuration described in Fig. 2A. Fig. 13B is a schematic diagram showing the case where imaging using the rolling shutter method is applied to the configuration of Fig. 2A.

[0081] <Configuration Example 3> An electronic device of one embodiment of the present invention can also be applied to a display portion having a plurality of pixels as a light-emitting device. Note that an electronic device of one embodiment of the present invention having a display portion can also be referred to as a display system. The display system is, for example, a system including a display device and an imaging device.

[0082] Fig. 13A is a block diagram in which light-emitting device 150 in Fig. 1B is replaced with light-emitting device 150D having a display unit 151. Fig. 13A illustrates light-emitting device 150D having display unit 151 having a plurality of pixels 152, in addition to system control unit 110 and light-emitting drive unit 140 described in Fig. 1B.

[0083] 13B is a block diagram illustrating a light-emitting device 151D including a display unit 151. The display unit 151 has a plurality of pixels 152 arranged in a matrix. The pixels 152 have sub-pixels 160R, 160G, and 160B. The sub-pixels 160R, 160G, and 160B each have a light-emitting device that functions as a display device.

[0084] The pixel 152 is connected to a wiring GL, a wiring SLR, a wiring SLG, and a wiring SLB. The wirings SLR, SLG, and SLB are each connected to a source line driver circuit (also referred to as a source driver). The wiring GL is connected to a gate line driver circuit 364. The wiring GL functions as a gate line, and the wirings SLR, SLG, and SLB function as source lines.

[0085] Sub-pixel 160R has a light-emitting device that emits red light. Sub-pixel 160G has a light-emitting device that emits green light. Sub-pixel 160B has a light-emitting device that emits blue light. This allows the display device 300A to display full color. Note that pixel 152 may also have sub-pixels that have light-emitting devices that emit light of other colors. For example, pixel 152 may have, in addition to the above three sub-pixels, a sub-pixel that has a light-emitting device that emits white light, or a sub-pixel that has a light-emitting device that emits yellow light.

[0086] The line GL is connected to the sub-pixels 160R, 160G, and 160B arranged in the row direction (extension direction of the line GL). The line SLR, line SLG, and line SLB are connected to the sub-pixels 160R, 160G, and 160B (not shown) arranged in the column direction (extension direction of the line SLR, etc.), respectively.

[0087] 13C shows an example of a circuit diagram of a pixel 160 that can be applied to the subpixels 160R, 160G, and 160B. The pixel 160 includes a transistor M1, a transistor M2, a transistor M3, a capacitor C1, and a light-emitting device EL. A wiring GL and a wiring SL are connected to the pixel 160. The wiring SL corresponds to any one of the wirings SLR, SLG, and SLB shown in FIG. 13B.

[0088] The transistor M1 has a gate connected to a wiring GL, one of its source and drain connected to a wiring SL, and the other connected to one electrode of the capacitor C1 and the gate of the transistor M2. The transistor M2 has one of its source and drain connected to a wiring AL, and the other connected to one electrode of the light-emitting device EL, the other electrode of the capacitor C1, and one of the source and drain of the transistor M3. The transistor M3 has a gate connected to a wiring GL, and the other of its source and drain connected to a wiring RL. The light-emitting device EL has the other electrode connected to a wiring CL.

[0089] A data potential D is applied to the wiring SL. A selection signal is applied to the wiring GL. The selection signal includes a potential for turning on a transistor and a potential for turning off a transistor.

[0090] A reset potential is applied to the wiring RL. An anode potential is applied to the wiring AL. A cathode potential is applied to the wiring CL. In the pixel 160, the anode potential is higher than the cathode potential. The reset potential applied to the wiring RL can be a potential such that the potential difference between the reset potential and the cathode potential is smaller than the threshold voltage of the light-emitting device EL. The reset potential can be a potential higher than the cathode potential, the same as the cathode potential, or a potential lower than the cathode potential.

[0091] The transistors M1 and M3 function as switches. The transistor M2 functions as a transistor for controlling the current flowing through the light-emitting device EL. For example, it can be said that the transistor M1 functions as a selection transistor and the transistor M2 functions as a drive transistor.

[0092] Here, it is preferable that all of the transistors M1 to M3 be transistors having silicon in their semiconductor layers (Si transistors). Alternatively, it is preferable that the transistors M1 and M3 be transistors having oxide semiconductors in their semiconductor layers (OS transistors) and the transistor M2 be a Si transistor. Alternatively, it is preferable that all of the transistors M1 to M3 be OS transistors.

[0093] An OS transistor can achieve an extremely small off-state current. Therefore, the small off-state current allows charge accumulated in a capacitor connected in series with the transistor to be held for a long period of time. Therefore, it is preferable to use a transistor including an oxide semiconductor for each of the transistors M1 and M3 connected in series with the capacitor C1. By using a transistor including an oxide semiconductor as the transistor M1 or M3, charge held in the capacitor C1 can be prevented from leaking through the transistor M1 or M3. Furthermore, because charge held in the capacitor C1 can be held for a long period of time, a still image can be displayed for a long period of time without rewriting data in the pixel 160.

[0094] 13C, the transistors M1 to M3 are represented as n-channel transistors, but p-channel transistors can also be used. For example, a transistor that passes a current through the light-emitting device EL can be a p-channel transistor, and the other transistors can be n-channel transistors.

[0095] The transistor included in the pixel 160 can be a transistor having a pair of gates overlapping with each other through a semiconductor layer. A transistor having a pair of gates has advantages in that the on-state current of the transistor is increased and the saturation characteristics are improved by connecting the pair of gates to each other and applying the same potential. A potential for controlling the threshold voltage of the transistor may be applied to one of the pair of gates. Applying a constant potential to one of the pair of gates can improve the stability of the electrical characteristics of the transistor. For example, one gate of the transistor may be connected to a wiring to which a constant potential is applied, or may be connected to its own source or drain.

[0096] 13D is a circuit diagram illustrating the control of brightness in a light-emitting device 150D. In a transistor M2 of a pixel 160 having a light-emitting device EL, a current I flows between a source S and a drain D. ＤＳ The luminance of the light emitting device EL can be controlled by the current I ＤＳ The magnitude of the potential difference EL can be controlled by the voltage VGS between the gate G and the source S. Therefore, in the display unit 151 having the pixel 160, the luminance of the light-emitting device EL can be varied for each region of the display unit 151 by controlling the voltage applied to the transistor M2.

[0097] 14A is a schematic diagram illustrating the appearance of an electronic device including a display unit 151 included in a light-emitting device 150D. As shown in FIG. 14A , as an example, a display unit 151 and an imaging device 121 are provided on a second surface (e.g., the back surface) of a housing 190. By having the display unit 151 and the imaging device 121 on the same surface, the electronic device 100 can capture an image using the imaging device 121 in a state where light is irradiated from the display unit 151 onto a subject.

[0098] Display unit 151 can control the brightness of the light-emitting device for each of multiple pixels. Therefore, light-emitting device 151D can emit light of different brightness in multiple regions, such as regions 151T, 151M, and 151B. Region 151T corresponds to the upper side of display unit 151, region 151M corresponds to the center side of display unit 151, and region 151B corresponds to the lower side of display unit 151.

[0099] 14B is a schematic diagram illustrating a state in which light beams with different luminances are irradiated onto subject 200 in a plurality of regions 151T, 151M, and 151B of display unit 151 shown in FIG. １５１Ｔ The object 200 is irradiated with light of luminance L １５１Ｍ The object 200 is irradiated with light of luminance L １５１Ｂ This configuration makes it easier to irradiate the subject 200 with light perpendicular to the subject 200, which makes it less likely that a shadow will be cast on the subject 200 and makes it easier to obtain clear image data.

[0100] 15 shows the luminance L of each of the regions 151T, 151M, and 151B of the display portion 151 of the light-emitting device 150D according to one embodiment of the present invention. １５１Ｔ , luminance L １５１Ｍ , luminance L １５１Ｂ 10A and 10B are diagrams schematically illustrating the imaging of a subject and the exposure time in the imaging device 121.

[0101] As shown in FIG. 15, in the period TA, the luminance L １５１Ｔ luminance L1 Ｔ to luminance L2 Ｔ Similarly, the brightness L １５１Ｍ luminance L1 Ｍ to luminance L2 Ｍ Similarly, the brightness L １５１Ｂ luminance L1 Ｂ to luminance L2 ＢThe imaging device 121 performs an image capture E1 during an exposure time T1 and outputs image data. The imaging device 121 performs an image capture E2 during an exposure time T2 and outputs image data. By continuously changing the luminance in any region of the display unit 151 during the period TA, the luminance per unit time during the exposure time T1 and the luminance per unit time during the exposure time T2 can be made different.

[0102] By configuring the display unit 151, which functions as a light-emitting device 151D that irradiates light onto the subject during period TA, to have different brightness levels for each area, the imaging device 121 can vary the amount of light taken into the imaging element for each different image capture, thereby enabling imaging with different exposure conditions.

[0103] Luminance L1 Ｔ , luminance L1 Ｍ , and luminance L1 Ｂ can be different luminances. Ｔ , luminance L2 Ｍ , and luminance L2 Ｂ The brightness of each of the regions 151T, 151M, and 151B can be different. It is also preferable to make the gradient of the brightness change in the region 151T, the gradient of the brightness change in the region 151M, and the gradient of the brightness change in the region 151B different. In addition to the effects described in the above configuration example, this configuration makes it possible to vary the brightness of each region according to the unevenness of the subject 200. As a result, shadows are less likely to appear on the subject 200, and clear image data can be acquired.

[0104] 16A is a schematic diagram illustrating the appearance of an electronic device including a display unit 151 of a light-emitting device 150D having a different shape from that of FIG. 14A . As shown in FIG. 16A , as an example, a display unit 151 and an imaging device 121 are provided on a second surface (e.g., the back surface) of a housing 190. By having the display unit 151 and the imaging device 121 on the same surface, the electronic device 100 can capture an image with the imaging device 121 in a state where light is irradiated onto a subject from the display unit 151 of the light-emitting device 150D.

[0105] 14A, the display unit 151 shown in Fig. 16A can control the luminance of the light-emitting device for each of multiple pixels, so that the light-emitting device 151D can irradiate multiple regions, such as multiple regions 151T, 151M, and 151B, with light having different luminances.

[0106] 16A has a self-luminous element such as an OLED display, and therefore functions as a flexible display. Therefore, by providing a foldable mechanism in the housing 190, it becomes possible to capture an image with the display unit 151 folded. For example, as shown in FIG. 16B, it is possible to capture an image with the display surface of the display unit 151 folded outward.

[0107] 16C is a schematic diagram illustrating how light with different luminances is irradiated onto subject 200 in a plurality of regions 151T, 151M, and 151B of display unit 151 shown in FIGS. １５１Ｔ The object 200 is irradiated with light of luminance L １５１Ｍ In this configuration, light can be easily irradiated perpendicularly to the subject 200 in the areas 151T and 151M, making it difficult for a shadow to appear on the subject 200 and facilitating the acquisition of clear image data. In addition, the area 151B does not irradiate light onto the subject 200. Therefore, the luminance L １５１Ｂ By setting is to zero (0) or making it small, it is possible to reduce power consumption.

[0108] FIG. 17 shows the luminance L of each of the regions 151T, 151M, and 151B of the display unit 151 according to one embodiment of the present invention. １５１Ｔ , luminance L １５１Ｍ , luminance L １５１Ｂ 10A and 10B are diagrams schematically illustrating the imaging of a subject and the exposure time in the imaging device 121.

[0109] As shown in FIG. 17, in the period TA, the luminance L １５１Ｔ the luminance L １Ｔ to luminance L2 Ｔ Similarly, the brightness L １５１Ｍ luminance L1 Ｍto luminance L2 Ｍ On the other hand, the brightness L １５１Ｂ is set to 0. The imaging device 121 performs an image capture E1 during an exposure time T1 and outputs image data. The imaging device 121 performs an image capture E2 during an exposure time T2 and outputs image data. In the period TA, the luminance L １５１Ｔ and luminance L １５１Ｍ Since the luminance per unit time in the exposure time T1 changes continuously, the luminance per unit time in the exposure time T2 can be different from the luminance per unit time in the exposure time T1.

[0110] The case where the luminance of light-emitting device 150D is the darkest may include a case where light is not emitted for imaging. For example, when taking a selfie and displaying one's face on light-emitting device 150D, this may include a case where light is not emitted for imaging.

[0111] By configuring the luminance of the display portion 151 of the light-emitting device 150D to be different during the period TA, the amount of light taken into the imaging element in the imaging device 121 can be made different for each different imaging, thereby enabling imaging with different exposure conditions.

[0112] Luminance L1 Ｔ and luminance L1 Ｍ can be different luminances. Ｔ and luminance L2 Ｍ The brightness of each of the regions 151T and 151M can be different. It is also preferable to make the gradient of the brightness change in the region 151T different from the gradient of the brightness change in the region 151M. In addition to the effects described in the above configuration example, this configuration makes it possible to vary the brightness of each region according to the unevenness of the subject 200. As a result, shadows are less likely to appear on the subject 200, and clear image data can be acquired.

[0113] 18A is a schematic diagram illustrating the appearance of an electronic device having a display unit 151 provided in a front light-emitting device 150D, which has a configuration different from those illustrated in FIGS. 14A and 16A . As illustrated in FIG. 18A , as an example, a second surface (e.g., a back surface) of a housing 190 is provided with a display unit 151 and an imaging device 121. By having the display unit 151 and the imaging device 121 on the same surface, the electronic device 100 can capture an image using the imaging device 121 while irradiating a subject with light from the display unit 151.

[0114] 14A and 16A, the display unit 151 shown in Fig. 18A can control the luminance of the light-emitting device for each of multiple pixels. Therefore, the light-emitting device 151D can irradiate multiple regions, such as multiple regions 151T, 151M, and 151B, with light having different luminances.

[0115] 18A has a self-luminous element such as an OLED display, and therefore functions as a flexible display. Therefore, by providing a foldable mechanism in the housing 190, it becomes possible to capture an image with the display unit 151 folded. For example, as shown in FIG. 18B, it is possible to capture an image with the display surface of the display unit 151 folded inward.

[0116] 18C is a schematic diagram illustrating how light with different luminances is irradiated onto subject 200 in a plurality of regions 151T, 151M, and 151B of display unit 151 shown in FIGS. １５１Ｔ The object 200 is irradiated with light of luminance L １５１Ｍ In this configuration, light can be easily irradiated perpendicularly to the subject 200 in the areas 151T and 151M, which makes it difficult for a shadow to appear on the subject 200, making it easier to obtain clear image data. １５１Ｂ The light with a luminance of L １５１Ｔ Light and brightness L １５１ＭSince the light is emitted from an oblique direction different from the light from the area 151B, the light emitted from the area 151B is less likely to enter the imaging device 121. As a result, the contrast of the captured image data can be improved.

[0117] FIG. 19 shows the luminance L of each of regions 151T, 151M, and 151B of light-emitting device 150D according to one embodiment of the present invention. １５１Ｔ , luminance L １５１Ｍ , luminance L １５１Ｂ 10A and 10B are diagrams schematically illustrating the imaging of a subject and the exposure time in the imaging device 121.

[0118] As shown in FIG. 19, in the period TA, the luminance L １５１Ｔ luminance L1 Ｔ to luminance L2 Ｔ Similarly, the brightness L １５１Ｍ luminance L1 Ｍ to luminance L2 Ｍ On the other hand, the brightness L １５１Ｂ is the maximum brightness L ＭＡＸ The image pickup device 121 performs an image pickup E1 with an exposure time T1 and outputs image data. The image pickup device 121 performs an image pickup E2 with an exposure time T2 and outputs image data. In the period TA, the luminance L １５１Ｔ and luminance L １５１Ｍ Since the luminance per unit time in the exposure time T1 changes continuously, the luminance per unit time in the exposure time T2 can be different from the luminance per unit time in the exposure time T1.

[0119] The luminance in the region 151B of the light-emitting device 150D is the maximum luminance L ＭＡＸ By setting the brightness of the light emitted from the region 151T and the region 151M to 151D, the light from the region 151B can be used as dedicated illumination when the brightness of the light emitted from the region 151T and the region 151M is insufficient.

[0120] By configuring the brightness of the display unit 151 to differ for each region during the period TA, the imaging device 121 can vary the amount of light taken into the imaging element for each different image capture, thereby enabling images to be captured with different exposure conditions.

[0121] Luminance L1 Ｔ , and luminance L1 Ｍcan be different luminances. Ｔ and luminance L2 Ｍ The brightness of each of the regions 151T and 151M can be different. It is also preferable to make the gradient of the brightness change in the region 151T different from the gradient of the brightness change in the region 151M. In addition to the effects described in the above configuration example, this configuration makes it possible to vary the brightness of each region according to the unevenness of the subject 200. As a result, shadows are less likely to appear on the subject 200, and clear image data can be acquired.

[0122] <Structure Example 4> A plurality of light-emitting devices can be applied to the electronic devices of one embodiment of the present invention.

[0123] Fig. 20A is a block diagram including light-emitting device 150 shown in Fig. 1B and light-emitting device 150D shown in Fig. 13A. Fig. 20A shows light-emitting device 150D including display unit 151 having a plurality of pixels 152 shown in Fig. 13A in addition to system control unit 110, light-emitting drive unit 140, and light-emitting device 150 described in Fig. 1B.

[0124] FIG. 20B is a schematic diagram illustrating the appearance of an electronic device including a light-emitting device 150 and a display unit 151 included in the light-emitting device 150D. As shown in FIG. 20B , the display unit 151 and the imaging device 121 are provided on a second surface (e.g., the back surface) of the housing 190, as an example. When the display unit 151 is positioned closer to the imaging device 121, if the subject is a person, it is easy to align the gaze of the subject 200 with the imaging device 121, as shown schematically in FIG. 20C . Therefore, when capturing an image, it is easy to make the subject's gaze appear to be directed toward the imaging device 121. As a result, the captured image can be captured with the subject's gaze properly aligned.

[0125] 20B has the light-emitting device 150 and the imaging device 121 on the same surface, allowing the imaging device 121 to capture an image while irradiating a subject with light from the light-emitting device 150. As described above, the light-emitting device 150 can control the luminance during multiple imaging periods. Therefore, the imaging device 121 can vary the amount of light taken into the imaging element for each different imaging, allowing imaging with different exposures to be performed.

[0126] Although FIG. 20B illustrates a configuration in which the imaging device 121 is disposed in a region different from the display unit 151, other configurations are also possible. For example, the imaging device 121 can be disposed in a region overlapping the display unit 151. For example, the imaging device 121B illustrated in FIG. 21A is disposed in a region where the display unit 151 is provided. The imaging device 121B can adopt a punch-hole type or an under-display camera (UDC) type in the display unit 151. This configuration can be realized by replacing part of the pixel circuit of the display unit 151 with the circuit configuration of the imaging device 121B. By disposing the imaging device 121B in a region where the display unit 151 is provided, the light-emitting device 150 can be disposed so as to surround the outer periphery of the display unit 151. With this configuration, the display unit 151 can irradiate light emitted by the light-emitting device 150 from a direction different from that of the light emitted by the light-emitting device 150, thereby improving the quality of captured image data.

[0127] 21A shows a configuration in which the light-emitting device 150 is disposed in a region different from the display unit 151, but other configurations are also possible. For example, the light-emitting device 150 can be disposed in a region overlapping with the display unit 151. For example, the light-emitting device 150B shown in FIG. 21B is disposed in a region where the display unit 151 is provided. This configuration can be realized by disposing the light-emitting device 150B in a position where it overlaps with a pixel circuit of the display unit 151, as shown in FIG. 21C. By disposing the light-emitting device 150B in the region where the display unit 151 is provided, it becomes easier to irradiate the subject 200 with light perpendicularly, which makes it less likely that a shadow will be cast on the subject 200 and makes it easier to obtain clear image data.

[0128] This embodiment mode can be combined with other embodiment modes as appropriate.

[0129] (Embodiment 2) In this embodiment, a configuration example different from that of the electronic device described in the above-mentioned Embodiment 1 will be described. Note that in the description of this embodiment, the description of the above-mentioned Embodiment 1 will be used for the configuration that overlaps with that of the above-mentioned Embodiment 1, and the description thereof may be omitted.

[0130] Electronic device 100A shown in FIG. 22A includes illuminance sensor 180 in addition to the configuration of electronic device 100 described in the first embodiment.

[0131] 22B is a block diagram for explaining the function of the illuminance sensor 180. In addition to the illuminance sensor 180, the system control unit 110, the light emission driving unit 140, and the light emitting device 150 are also shown in FIG.

[0132] Illuminance sensor 180 has a function of measuring the illuminance around electronic device 100A. Information about the illuminance around electronic device 100A obtained by illuminance sensor 180 is output to system control unit 110. System control unit 110 sets the luminance or the amount of change in luminance of light-emitting device 150 in light emission luminance setting unit 111 based on the output of illuminance sensor 180. For example, when the illuminance measured by illuminance sensor 180 is high, the luminance of light-emitting device 150 is reduced, and when the illuminance measured by illuminance sensor 180 is low, the luminance of light-emitting device 150 is increased. This configuration makes it possible to increase the luminance of light-emitting device 150 when the illuminance is low, thereby obtaining clear image data. Furthermore, when the illuminance is high, the luminance of light-emitting device 150 is reduced, thereby reducing areas of blown-out highlights.

[0133] FIG. 23A is a diagram schematically illustrating the luminance of light-emitting device 150A, as well as the imaging of a subject and exposure time of imaging device 121 according to one embodiment of the present invention. As shown in FIG. 23A , during period TA, the luminance of light-emitting device 150 is changed from luminance L1_H to luminance L2 (line IL_H). As shown in FIG. 23A , during period TA, the luminance of light-emitting device 150 is changed from luminance L1_L to luminance L2 (line IL_L). Regardless of the change in luminance (line IL_H, line IL_L), the luminance changes continuously during period TA. Therefore, the luminance per unit time during exposure time T1 and the luminance per unit time during exposure time T2 can be different. By switching this difference in luminance in response to the difference in illuminance at illuminance sensor 180, the amount of change in luminance according to the illuminance can be switched.

[0134] 23B is a diagram, different from FIG. 23A , that schematically illustrates the luminance of light-emitting device 150A, as well as the imaging and exposure time of a subject in imaging device 121. As shown in FIG. 23B , during period TA, the luminance of light-emitting device 150 is changed from luminance L1 to luminance L2_H (line IL_L). As shown in FIG. 23B , during period TA, the luminance of light-emitting device 150 is changed from luminance L1 to luminance L2_L (line IL_H). In either case of the luminance change (line IL_H, line IL_L), the luminance changes continuously during period TA, so the luminance per unit time during exposure time T1 and the luminance per unit time during exposure time T2 can be different.

[0135] 24A is a diagram schematically illustrating the luminance of light-emitting device 150A, as well as the imaging and exposure time of a subject in imaging device 121, which is different from those in FIGS. 23A and 23B. As shown in FIG. 24A, during a period TA, the luminance of light-emitting device 150 is changed from luminance L1 to zero (0) (line IL_H). As shown in FIG. 24A, during a period TA, the luminance of light-emitting device 150 is changed from luminance L1 to luminance L2 (line IL_L). Regardless of the luminance change (line IL_H, line IL_L), the luminance changes continuously during period TA, so the luminance per unit time during exposure time T1 and the luminance per unit time during exposure time T2 can be different.

[0136] 24B is a diagram schematically illustrating the luminance of light-emitting device 150A, as well as the imaging of a subject and exposure time in imaging device 121, which is different from those in FIGS. 23A, 23B, and 24A. As shown in FIG. 24B, during a period TA, the luminance of light-emitting device 150 is changed from luminance L2 to luminance L1 (line IL_L). As shown in FIG. 24B, during a period TA, the luminance of light-emitting device 150 is changed from luminance L1 to luminance L2 (line IL_H). Regardless of the luminance change (line IL_H, line IL_L), the luminance changes continuously during period TA, so the luminance per unit time during exposure time T1 and the luminance per unit time during exposure time T2 can be different.

[0137] This configuration allows the luminance of the light-emitting device to be varied for each exposure time during which imaging is performed. In the imaging device 121, the amount of light taken into the imaging element can be varied for each different imaging session, allowing imaging with different exposures. This allows image data to be acquired with reduced whiteout and / or blackout. Furthermore, the period TA includes a period during which the luminance of the light-emitting device 150 can be reduced, thereby reducing power consumption compared to when imaging is performed multiple times at a constant luminance. Furthermore, the shutter opening and closing speed can be kept constant when imaging is performed multiple times in the optical system 131.

[0138] This embodiment mode can be combined with other embodiment modes as appropriate.

[0139] 25 to 27. The electronic devices of this embodiment have a display portion including a light-emitting device. Therefore, the electronic devices can be used as display portions of various electronic devices.

[0140] Examples of electronic devices include electronic devices with relatively large screens such as television sets, desktop or notebook personal computers, computer monitors, digital signage, large game machines such as pachinko machines, as well as digital cameras, digital video cameras, digital photo frames, mobile phones, portable game machines, personal digital assistants, and sound playback devices.

[0141] The electronic device 6500 shown in FIG. 25A is a portable information terminal that can be used as a smartphone.

[0142] The electronic device 6500 includes a housing 6501, a display portion 6502, a power button 6503, a button 6504, a speaker 6505, a microphone 6506, a camera 6507, a light source 6508, and the like. The display portion 6502 has a touch panel function.

[0143] The light source 6508 and the display portion 6502 can be used as a light-emitting device according to one embodiment of the present invention.

[0144] FIG. 25B is a schematic cross-sectional view including the end of the housing 6501 on the microphone 6506 side.

[0145] A light-transmitting protective member 6510 is provided on the display surface side of the housing 6501, and a display panel 6511, optical members 6512, a touch sensor panel 6513, a printed circuit board 6517, a battery 6518, etc. are arranged in the space surrounded by the housing 6501 and the protective member 6510.

[0146] A display panel 6511, an optical member 6512, and a touch sensor panel 6513 are fixed to the protective member 6510 by adhesive layers (not shown).

[0147] In a region outside the display portion 6502, a part of the display panel 6511 is folded back, and an FPC 6515 is connected to the folded back part. An IC 6516 is mounted on the FPC 6515. The FPC 6515 is connected to a terminal provided on a printed circuit board 6517.

[0148] A flexible display can be applied to the display panel 6511. Therefore, an extremely lightweight electronic device can be realized. In addition, since the display panel 6511 is extremely thin, a large-capacity battery 6518 can be mounted while suppressing the thickness of the electronic device. In addition, by folding back a part of the display panel 6511 and arranging a connection portion with the FPC 6515 on the back side of the pixel portion, an electronic device with a narrow frame can be realized.

[0149] 26A shows an example of a television set. A television set 7100 has a display portion 7000 built into a housing 7101. Here, the housing 7101 is supported by a stand 7103.

[0150] The display portion 7000 can be used as a light-emitting device according to one embodiment of the present invention.

[0151] 26A can be operated using operation switches provided on the housing 7101 and a separate remote control 7111. Alternatively, the display portion 7000 may be provided with a touch sensor, and the television set 7100 may be operated by touching the display portion 7000 with a finger or the like. The remote control 7111 may have a display portion that displays information output from the remote control 7111. Using operation keys or a touch panel provided on the remote control 7111, the channel and volume can be controlled, and an image displayed on the display portion 7000 can be controlled.

[0152] The television device 7100 is configured to include a receiver, a modem, and the like. The receiver can receive general television broadcasts. Furthermore, by connecting to a wired or wireless communication network via the modem, it is possible to perform one-way (from a sender to a receiver) or two-way (between a sender and a receiver, or between receivers, etc.) information communication.

[0153] 26B shows an example of a laptop personal computer 7200. The laptop personal computer 7200 includes a housing 7211, a keyboard 7212, a pointing device 7213, an external connection port 7214, and the like. The housing 7211 includes a display portion 7000.

[0154] The display portion 7000 can be used as a light-emitting device according to one embodiment of the present invention.

[0155] 26C and 26D show an example of digital signage.

[0156] 26C includes a housing 7301, a display portion 7000, and a speaker 7303. The digital signage 7300 may further include an LED lamp, operation keys (including a power switch or an operation switch), a connection terminal, various sensors, a microphone, and the like.

[0157] 26D shows a digital signage 7400 attached to a cylindrical pillar 7401. The digital signage 7400 has a display unit 7000 provided along the curved surface of the pillar 7401.

[0158] 26C and 26D, the display portion 7000 can be used as a light-emitting device according to one embodiment of the present invention.

[0159] The larger the display unit 7000, the more information can be provided at one time. Also, the larger the display unit 7000, the more easily it will attract people's attention, which can increase the advertising effectiveness of, for example, advertisements.

[0160] Applying a touch panel to the display unit 7000 is preferable because it not only displays images or videos on the display unit 7000 but also allows the user to intuitively operate it. Furthermore, when used to provide information such as route information or traffic information, the intuitive operation can improve usability.

[0161] 26C and 26D , the digital signage 7300 or the digital signage 7400 is preferably capable of wirelessly linking with an information terminal 7311 or an information terminal 7411 such as a smartphone carried by a user. For example, advertising information displayed on the display unit 7000 can be displayed on the screen of the information terminal 7311 or the information terminal 7411. By operating the information terminal 7311 or the information terminal 7411, the display on the display unit 7000 can be switched.

[0162] Furthermore, the digital signage 7300 or the digital signage 7400 can be made to run a game using the screen of the information terminal 7311 or the information terminal 7411 as an operation means (controller), thereby allowing an unspecified number of users to simultaneously participate in and enjoy the game.

[0163] The electronic device shown in Figures 27A to 27G has a housing 9000, a display unit 9001, a speaker 9003, operation keys 9005 (including a power switch or an operation switch), a connection terminal 9006, a sensor 9007 (including a function to measure force, displacement, position, speed, acceleration, angular velocity, rotation speed, distance, light, liquid, magnetism, temperature, chemical substance, sound, time, hardness, electric field, current, voltage, power, radiation, flow rate, humidity, gradient, vibration, odor or infrared rays), a microphone 9008, etc.

[0164] The electronic devices shown in Figures 27A to 27G have various functions. For example, they may have a function to display various information (still images, videos, text images, etc.) on a display unit, a touch panel function, a function to display a calendar, date, or time, a function to control processing using various software (programs), a wireless communication function, a function to read and process programs or data recorded on a recording medium, etc. Note that the functions of the electronic devices are not limited to these, and they may have various other functions. The electronic devices may have multiple display units. Furthermore, the electronic devices may have a function to include a camera or the like to capture still images or videos and store them on a recording medium (external or built-in to the camera), a function to display the captured images on a display unit, etc.

[0165] The electronic devices shown in Figures 27A to 27G will be described in detail below.

[0166] FIG. 27A is a perspective view showing a mobile information terminal 9101. The mobile information terminal 9101 can be used as, for example, a smartphone. Note that the mobile information terminal 9101 may be provided with a speaker 9003, a connection terminal 9006, a sensor 9007, and the like. The mobile information terminal 9101 can display text and image information on multiple surfaces. FIG. 27A shows an example in which three icons 9050 are displayed. Information 9051, indicated by a dashed rectangle, can also be displayed on another surface of the display unit 9001. Examples of the information 9051 include notifications of incoming emails, SNS messages, phone calls, etc., the title of the email or SNS message, the sender's name, the date and time, the remaining battery level, and radio wave intensity. Alternatively, an icon 9050 or the like may be displayed in the position where the information 9051 is displayed.

[0167] 27B is a perspective view showing the mobile information terminal 9102. The mobile information terminal 9102 has a function of displaying information on three or more surfaces of the display unit 9001. Here, an example is shown in which information 9052, information 9053, and information 9054 are displayed on different surfaces. For example, a user can check information 9053 displayed in a position that can be observed from above the mobile information terminal 9102 while storing the mobile information terminal 9102 in a breast pocket of clothes. The user can check the display without taking the mobile information terminal 9102 out of the pocket and decide, for example, whether to answer a call.

[0168] 27C is a perspective view showing a tablet terminal 9103. The tablet terminal 9103 is capable of executing various applications such as mobile phone calls, e-mail, text browsing and creation, music playback, internet communication, and computer games, for example. The tablet terminal 9103 has a display unit 9001, a camera 9002, a microphone 9008, and a speaker 9003 on the front side of a housing 9000, operation keys 9005 as operation buttons on the left side of the housing 9000, and a connection terminal 9006 on the bottom.

[0169] FIG. 27D is a perspective view showing a wristwatch-type mobile information terminal 9200. The mobile information terminal 9200 can be used as, for example, a smart watch (registered trademark). The display surface of the display unit 9001 is curved, and display can be performed along the curved display surface. The mobile information terminal 9200 can also perform hands-free calling by communicating with, for example, a wirelessly capable headset. The mobile information terminal 9200 can also perform data transmission and charging with another information terminal through a connection terminal 9006. Note that charging may be performed by wireless power supply.

[0170] 27E to 27G are perspective views showing a foldable mobile information terminal 9201. Also, FIG. 27E is a perspective view of the mobile information terminal 9201 in an unfolded state, FIG. 27G is a perspective view of the mobile information terminal 9201 in a folded state, and FIG. 27F is a perspective view of a state in the process of changing from one of FIGS. 27E and 27G to the other. The mobile information terminal 9201 has excellent portability in a folded state, and excellent display visibility due to a seamless, wide display area in an unfolded state. The display portion 9001 of the mobile information terminal 9201 is supported by three housings 9000 connected by hinges 9055. For example, the display portion 9001 can be bent with a curvature radius of 0.1 mm or more and 150 mm or less.

[0171] This embodiment mode can be combined with other embodiment modes as appropriate.

[0172] (Additional Notes Regarding the Description of the Present Specification, etc.) The following additional notes will be given regarding the above-described embodiments and the explanation of each configuration in the embodiments.

[0173] The configurations shown in each embodiment can be combined with the configurations shown in other embodiments as appropriate to form one aspect of the present invention. In addition, when multiple configuration examples are shown in one embodiment, the configuration examples can be combined as appropriate.

[0174] In addition, the content (or even a part of the content) described in one embodiment can be applied to, combined with, or replaced with another content (or even a part of the content) described in that embodiment, and / or the content (or even a part of the content) described in one or more other embodiments.

[0175] The contents described in the embodiments refer to the contents described in each embodiment using various figures or the contents described using text in the specification.

[0176] Furthermore, a figure (or even a part thereof) described in one embodiment can be combined with another part of that figure, another figure (or even a part thereof) described in that embodiment, and / or a figure (or even a part thereof) described in one or more other embodiments to form even more figures.

[0177] In addition, in the present specification and the like, in the block diagrams, components are classified by function and shown as mutually independent blocks. However, in actual circuits, etc., it is difficult to separate components by function, and there may be cases where one circuit is involved in multiple functions, or where one function is involved across multiple circuits. Therefore, the blocks in the block diagrams are not limited to the components described in the specification, but may be rephrased appropriately.

[0178] In this specification and the like, when describing the connection relationship of a transistor, the terms "one of the source or drain" (or first electrode or first terminal) and "the other of the source or drain" (or second electrode or second terminal) are used. This is because the source and drain of a transistor vary depending on the structure or operating conditions of the transistor. Note that the source and drain of a transistor can be appropriately referred to as source (drain) terminal, source (drain) electrode, or the like.

[0179] Furthermore, in this specification and the like, the terms voltage and potential can be interchanged as appropriate. Voltage refers to the potential difference from a reference potential. For example, if the reference potential is a ground voltage (earth voltage), then voltage can be interchanged with potential. Ground potential does not necessarily mean 0 V. Note that potential is relative, and the potential applied to wiring, etc. may change depending on the reference potential.

[0180] In this specification, the channel length refers to, for example, in a top view of a transistor, a region where a semiconductor (or a portion in the semiconductor through which current flows when the transistor is on) and a gate overlap, or a distance between a source and a drain in a region where a channel is formed.

[0181] In this specification, the channel width refers to, for example, the length of the region where the semiconductor (or the portion in the semiconductor through which current flows when the transistor is on) and the gate electrode overlap, or the length of the portion where the source and drain face each other in the region where the channel is formed.

[0182] In this specification and the like, the "on state" of a transistor refers to, for example, a state in which the source and drain of the transistor can be considered to be short-circuited. For example, the "on state" refers to a state in which the voltage between the gate and source of an n-channel transistor is higher than the threshold voltage, or a state in which the voltage between the gate and source of a p-channel transistor is lower than the threshold voltage. Note that the "on state" of a transistor refers to a state in which current can flow between the source and drain. Therefore, the "on state" of a transistor may also be referred to as the "conducting state" of the transistor.

[0183] In this specification and the like, the "off state" of a transistor refers to a state in which the source and drain of the transistor can be considered to be cut off. For example, the "off state" refers to a state in which the voltage between the gate and source of an n-channel transistor is lower than the threshold voltage, or a state in which the voltage between the gate and source of a p-channel transistor is higher than the threshold voltage. The "off state" of a transistor may also be referred to as the "non-conducting state" of the transistor.

[0184] In this specification and the like, the voltage between the gate and the source (gate-source) may be referred to as the “gate voltage,” the voltage between the drain and the source (drain-source) may be referred to as the “drain voltage,” and the voltage between the backgate and the source (backgate-source) may be referred to as the “backgate voltage.” Also, the current flowing from the drain to the source may be referred to as the “drain current.”

[0185] In this specification, unless otherwise specified, the "off-state current" of a transistor refers to the drain current when the transistor is in an off state. In this specification, the off-state current and the current flowing from the gate to the source and drain (also referred to as gate leakage current) may be referred to as leakage current.

[0001] In this specification, "connection" includes, for example, "electrical connection." When the term "electrical connection" is used to define the connection relationship between circuit elements as a physical entity, "electrical connection" includes, for example, "direct connection" and "indirect connection." For example, "A and B are directly connected" refers to a connection between A and B without the intervention of a circuit element (e.g., a transistor or a switch; wiring is not considered a circuit element). On the other hand, "A and B are indirectly connected" refers to a connection between A and B via one or more circuit elements.

[0002] Here, when "A and B are indirectly connected," the following connection relationship may be used: In other words, assuming that a circuit is operating, if there is a timing during the operation of the circuit when an exchange of electrical signals or an interaction of potentials occurs between A and B, such a circuit can be defined as an object, with "A and B indirectly connected." Even if there is a timing during the operation of the circuit when no exchange of electrical signals or an interaction of potentials occurs between A and B, "A and B can be defined as indirectly connected." Note that "A and B are indirectly connected" is a definition of the connection relationship between circuit elements as an object. Therefore, for example, even when a power supply voltage is not supplied to a circuit and the circuit is not operating, the circuit can be defined as an object, with "A and B indirectly connected" (however, as an example, this is limited to the case where an exchange of electrical signals or an interaction of potentials occurs between A and B during the operation of the circuit when a power supply voltage is supplied to the circuit and the circuit is operating).

[0003] Specific examples of "indirect connection" are shown below. First,An example of a case where "A and B are indirectly connected" is when A and B are connected via the source and drain of one or more transistors. Another example of a case where "A and B are indirectly connected" is when A and B are connected via one or more switches. When "A and B are indirectly connected," it is assumed that, assuming the circuit is operating, there is at least one time when a transistor between A and B is in an on state, a conductive state, or a state in which a current can flow. Note that "A and B are indirectly connected" also includes a case where a transistor between A and B is in an off state or a non-conductive state. When "A and B are indirectly connected," if multiple transistors are connected between A and B, it is assumed that, assuming the circuit is operating, each of the multiple transistors between A and B is in an on state, a conductive state, or a state in which a current can flow at least one time. In other words, when "A and B are indirectly connected," it is not necessary for all of the multiple transistors to be in an on state, a conductive state, or a state in which current can flow simultaneously. Therefore, when "A and B are indirectly connected," it also includes cases where the multiple transistors between A and B are in an off state or a non-conductive state at the same time or at different times. As another example, when A and C are connected via the source and drain of transistor TrP and B and C are connected via the source and drain of transistor TrQ, it can be defined as "A and C are indirectly connected," "B and C are indirectly connected," or "A and B are indirectly connected." However, as will be described later, when a constant potential V is supplied to C from a power supply, GND, or the like, it can be said that "A and C are indirectly connected" or "B and C are indirectly connected," but it cannot be said that "A and B are indirectly connected."

[0004] Although we have given examples of cases where "indirect connection" can and cannot be said,Here is another example of a case where "indirect connection" cannot be said. Even if exchange of electrical signals or potential interaction occurs between A and B during the operation of the circuit, there are exceptional cases where it cannot be said that "A and B are indirectly connected." An example of such an exceptional case is when A and B are connected via an insulator. In other words, when A and B are connected via an insulator, it cannot be said that "A and B are indirectly connected." A specific example of a case where A and B are connected via an insulator is when a capacitive element is connected between A and B. Another example of a case where A and B are connected via an insulator is when a gate insulating film of a transistor is interposed between A and B. In this case, it cannot be said that "A (the gate of the transistor) and B (the source or drain of the transistor) are indirectly connected."

[0005] Another example of a case where it cannot be said that "A and B are indirectly connected" is when there is no timing when exchange of electrical signals or potential interaction occurs between A and B. For example, a path from A to B may have multiple transistors connected via their sources and drains, and a constant potential V may be supplied to a node between the transistors from a power supply, GND, or the like. In this case, it cannot be said that "A and B are indirectly connected," but it is possible to say that "A and V are indirectly connected" or "B and V are indirectly connected." Note that if A and C are connected via the source and drain of transistor TrP and B and C are connected via the source and drain of transistor TrQ, and a constant potential V is supplied to C from a power supply, GND, or the like, it cannot be said that "A and B are indirectly connected," but it is possible to say that "A and C are indirectly connected" or "B and C are indirectly connected."

[0006] While an example of "indirect connection" has been given above, the definition of "indirect connection" is included in the definition of "electrical connection," so that when "A and B are indirectly connected," it can also be said that "A and B are electrically connected."

[0007] Next,A specific example of a "direct connection" is shown below. An example of "A and B are directly connected" is when A and B are connected without any circuit element between them. When A and B are connected to a power supply that supplies a constant potential V or to GND without any circuit element between them, it can be said that "A and B are directly connected," "A and V are directly connected," or "B and V are directly connected." It can also be said that "A and B are directly connected" when A (or B) is connected to a constant potential V via the source and drain of a transistor. It can also be said that "A and B are directly connected." Because A and V or B and V are connected via the source and drain of a transistor, it cannot be said that they are directly connected, and it can be said that "A and V are indirectly connected" or "B and V are indirectly connected."

[0008] Although an example of "direct connection" has been shown above, as an example, the definition of "direct connection" is included in the definition of "electrical connection", so that when "A and B are directly connected", it can also be said that "A and B are electrically connected". [Explanation of symbols]

[0192] AL: wiring, CL: wiring, FG: composite image data, GL: wiring, IDS: current, IL_H: line, IL_L: line, L151B: luminance, L151M: luminance, L151T: luminance, LMAX: maximum luminance, RL: wiring, SL: wiring, SLB: wiring, SLG: wiring, SLR: wiring, TA: period, TrP: transistor, TrQ: transistor, VGS: voltage, 100: electronic device, 100A: electronic device, 110: system control unit, 111: light emission luminance setting unit, 112: exposure time setting unit, 120: imaging device driving unit, 121: imaging device, 1 21B: imaging device, 130: optical system driving unit, 131: optical system, 132: exposure time switching unit, 140: light emission driving unit, 141: brightness switching unit, 150: light emitting device, 150A: light emitting device, 150B: light emitting device, 150D: light emitting device, 151: display unit, 151B: region, 151D: light emitting device, 151M: region, 151T: region, 152: pixel, 160: pixel, 160B: sub-pixel, 160G: sub-pixel, 160R: sub-pixel, 170: image synthesis unit, 171: image data acquisition unit, 172: image data generation unit, 180: illuminance sensor, 190: housing,198: storage unit, 199: main memory, 200: subject, 201: subject, 300A: display device, 364: gate line driving circuit, 6500: electronic device, 6501: housing, 6502: display unit, 6503: power button, 6504: button, 6505: speaker, 6506: microphone, 6507: camera, 6508: light source, 6510: protective member, 6511: display panel, 6512: optical member, 6513: touch sensor panel, 6515: FPC, 6516: IC, 6517: printed circuit board, 6518: battery, 7000: display unit, 7100: television device, 7101: housing, 7103: stand, 7111: remote control, 7200: notebook personal computer, 7211: housing , 7212: Keyboard, 7213: Pointing device, 7214: External connection port, 7300: Digital signage, 7301: Housing, 7303: Speaker, 7311: Information terminal, 7400: Digital signage, 7401: Pillar, 7411: Information terminal, 9000: Housing, 9001: Display unit, 9002: Camera, 9003: Speaker, 9005: Operation key, 9006: Connection terminal, 9007: Sensor, 9008: Microphone, 9050: Icon, 9051: Information, 9052: Information, 9053: Information, 9054: Information, 9055: Hinge, 9101: Portable information terminal, 9102: Portable information terminal, 9103: Tablet terminal, 9200: Portable information terminal, 9201: Portable information terminal,

Claims

The system control unit, the light emission driving unit, the light emitting device, the imaging device, and the image synthesis unit are included, the system control unit has a light emission luminance setting unit that sets the luminance of the light emitting device, the light emission driving unit has a luminance switching unit that switches the luminance of the light emitting device from the first luminance to the second luminance, the light emitting device has a function of irradiating a subject to be imaged by the imaging device with light at the first luminance or the second luminance; the imaging device has a function of outputting, to the image synthesis unit, first image data obtained by imaging the subject when the light emitting device irradiates the subject with light of the first luminance, and second image data obtained by imaging the subject when the light emitting device irradiates the subject with light of the second luminance; electronic equipment. 　 In claim 1, an optical system for controlling exposure of the imaging device; an optical system driving unit for controlling driving of the optical system, the system control unit has an exposure time setting unit that sets an exposure time of the imaging device, the optical system driving unit has an exposure time switching unit that switches an exposure time of the imaging device from a first exposure time to a second exposure time, The first exposure time and the second exposure time are different in length. electronic equipment. 　 In claim 1, the image synthesis unit outputs synthesized image data by replacing a signal saturation region in the first image data with a corresponding region in the second image data. electronic equipment. 　 The system includes a system control unit, a light emission driving unit, a light emitting device, an imaging device, an image synthesis unit, and an illuminance sensor, the system control unit has a light emission luminance setting unit that sets the luminance of the light emitting device based on an output of the illuminance sensor; the light emission driving unit has a luminance switching unit that switches the luminance of the light emitting device from the first luminance to the second luminance, the light emitting device has a function of irradiating a subject to be imaged by the imaging device with light at the first luminance or the second luminance; the imaging device has a function of outputting, to the image synthesis unit, first image data obtained by imaging the subject when the light emitting device irradiates the subject with light of the first luminance, and second image data obtained by imaging the subject when the light emitting device irradiates the subject with light of the second luminance; electronic equipment. 　 In claim 4, an optical system for controlling exposure of the imaging device; an optical system driving unit for controlling driving of the optical system, the system control unit has an exposure time setting unit that sets an exposure time of the imaging device, the optical system driving unit has an exposure time switching unit that switches an exposure time of the imaging device from a first exposure time to a second exposure time, The first exposure time and the second exposure time are different in length. electronic equipment. 　 In claim 4, the image synthesis unit outputs synthesized image data by replacing a signal saturation region in the first image data with a corresponding region in the second image data. electronic equipment. 　 A display system having a light emitting device and an imaging device, the light emitting device is connected to a system control unit via a light emitting drive unit; the imaging device is connected to an image synthesis unit and the system control unit; the system control unit has a light emission luminance setting unit that sets the luminance of the light emitting device, the light emission driving unit has a luminance switching unit that switches the luminance of the light emitting device from a first luminance to a second luminance, The imaging device includes: First image data obtained by capturing an image of the subject illuminated with light of the first luminance by the light emitting device; and outputting to the image synthesis unit second image data obtained by capturing an image of the subject illuminated with the light of the second luminance by the light emitting device. The image synthesis unit includes: The first image and the second image are combined. Display system.

Images