Electronic device including display device and operation method thereof

Abstract

In an electronic device including a display device, the display device may include: a pixel layer including a plurality of light emitting pixels and a plurality of light receiving pixels; and a lens layer disposed on the pixel layer and including a plurality of lenses respectively corresponding to the plurality of light receiving pixels. The electronic device may obtain first light receiving signals from first group light receiving pixels among the plurality of light receiving pixels and second light receiving signals from second group light receiving pixels among the plurality of light receiving pixels by applying a first driving voltage to the first group light receiving pixels and applying a second driving voltage having a voltage value different from that of the first driving voltage to the second group light receiving pixels, and generate an HDR image on the basis of the obtained first light receiving signals and second light receiving signals.

Description

Electronic device including a display device and method of operation thereof

[0001] The present disclosure relates to an electronic device including a display device and a method of operating the electronic device. Specifically, it relates to an electronic device including a display device that displays an output image and acquires a sensing image regarding the surrounding environment, and a method of operating the electronic device.

[0002] Driven by advancements in electronic technology, various types of electronic devices are being developed and disseminated. Furthermore, through the development of camera technology, cameras can be incorporated into electronic devices.

[0003] Conventional electronic devices are equipped with a display that displays images, and can display various images to provide to the user.

[0004] In addition, technology is being utilized in which the user can capture images through a camera included in the electronic device, and the electronic device displays the acquired images or stores and manages them within the electronic device.

[0005] In addition, the electronic device includes both a display and a camera, acquires user input based on an image acquired through the camera, and can control the image displayed on the display based on the acquired user input.

[0006] According to one aspect of one embodiment of the present disclosure, an electronic device is provided.

[0007] An electronic device according to one embodiment of the present disclosure may include: a display device; a memory in which a plurality of instructions are stored; and at least one processor including a processing circuitry.

[0008] In one embodiment of the present disclosure, the display device may include: a pixel layer comprising a plurality of light-emitting pixels and a plurality of light-receiving pixels including a first group of light-receiving pixels and a second group of light-receiving pixels; and a lens layer disposed on top of the pixel layer and comprising a plurality of lenses corresponding to each of the plurality of light-receiving pixels.

[0009] An electronic device according to one embodiment of the present disclosure can obtain first light receiving signals from first group light receiving pixels and second light receiving signals from second group light receiving pixels by having at least one processor execute a plurality of instructions individually or collectively, thereby applying a first driving voltage to first group light receiving pixels and applying a second driving voltage having a voltage value different from the first driving voltage to second group light receiving pixels.

[0010] An electronic device according to one embodiment of the present disclosure can generate an HDR image based on acquired first light receiving signals and second light receiving signals by having at least one processor execute a plurality of instructions individually or collectively.

[0011] According to one aspect of one embodiment of the present disclosure, a method of operating an electronic device is provided.

[0012] An electronic device according to one embodiment of the present disclosure may include a display device comprising: a pixel layer including a plurality of light-emitting pixels and a plurality of light-receiving pixels; and a lens layer disposed on top of the pixel layer and including a plurality of lenses corresponding to each of the plurality of light-receiving pixels.

[0013] A method of operating an electronic device according to one embodiment of the present disclosure may include the step of obtaining first light receiving signals from first group light receiving pixels and second light receiving signals from second group light receiving pixels by applying a first driving voltage to first group light receiving pixels among a plurality of light receiving pixels and applying a second driving voltage having a voltage value different from the first driving voltage to second group light receiving pixels among a plurality of light receiving pixels.

[0014] A method of operating an electronic device according to one embodiment of the present disclosure may include the step of generating an HDR image based on acquired first light receiving signals and second light receiving signals.

[0015] The present disclosure may be understood by the combination of the following detailed description and the accompanying drawings, where reference numerals denote structural elements.

[0016] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0017] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0018] FIG. 3 is a block diagram for explaining the configuration of a display device according to one embodiment of the present disclosure.

[0019] FIG. 4 is a drawing for explaining the configuration of a display device according to one embodiment of the present disclosure.

[0020] FIG. 5 is a drawing for explaining the arrangement of a plurality of components included in a display device according to one embodiment of the present disclosure.

[0021] FIG. 6 is a drawing for explaining a circuit layer and a light-emitting layer according to one embodiment of the present disclosure.

[0022] FIG. 7 is a drawing for explaining the arrangement of a plurality of components included in a display device according to one embodiment of the present disclosure.

[0023] FIG. 8 is a flowchart for explaining the operation of generating an HDR image of an electronic device according to one embodiment of the present disclosure.

[0024] FIG. 9 is a diagram illustrating the operation of an electronic device for acquiring an HDR image according to one embodiment of the present disclosure.

[0025] FIG. 10 is a graph showing the IV characteristic curve of a light-receiving pixel according to one embodiment of the present disclosure.

[0026] FIG. 11 exemplarily illustrates images obtained through a plurality of light-receiving pixels according to one embodiment of the present disclosure.

[0027] FIG. 12 is a flowchart for explaining the operation of generating a high-resolution image of an electronic device according to one embodiment of the present disclosure.

[0028] FIG. 13 is a drawing for explaining the operation of an electronic device for acquiring a high-resolution image according to one embodiment of the present disclosure.

[0029] FIG. 14 is a flowchart for explaining the operation of an electronic device that applies a driving voltage to light-receiving pixels according to one embodiment of the present disclosure.

[0030] FIG. 15 is a flowchart for explaining the operation of an electronic device for generating an HDR image according to one embodiment of the present disclosure.

[0031] FIG. 16 is a diagram illustrating the operation of an electronic device that acquires a plurality of light receiving signals through time division of each frame according to one embodiment of the present disclosure.

[0032] FIG. 17 is a flowchart for explaining the operation of an electronic device that generates an HDR image based on a plurality of light reception signals according to one embodiment of the present disclosure.

[0033] FIG. 18 is a flowchart for explaining the operation of an electronic device that generates an HDR image based on a plurality of light reception signals according to one embodiment of the present disclosure.

[0034] FIG. 19 is a diagram illustrating the operation of an electronic device that generates an HDR image based on a plurality of light reception signals according to one embodiment of the present disclosure.

[0035] FIG. 20 is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure.

[0036] FIG. 21 is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure.

[0037] FIG. 22a is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure.

[0038] FIG. 22b is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure.

[0039] The terms used in this disclosure will be briefly explained, and an embodiment of this disclosure will be described in detail.

[0040] Throughout this disclosure, unless specifically stated otherwise, "or" is inclusive and not exclusive. Accordingly, "A or B" may mean "A, B, or both" unless clearly indicated otherwise by the context.

[0041] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.

[0042] The terms used in this disclosure have been selected to be as widely used as possible, taking into account the functions in the embodiments of this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description section of the relevant embodiments of this disclosure. Therefore, the terms used in this disclosure should be defined not merely by their names, but based on their meanings and the content throughout this disclosure.

[0043] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification.

[0044] Throughout this disclosure, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "...part," "module," etc., as used in this disclosure refer to a unit that processes at least one function or operation, and may be implemented in hardware or software, or as a combination of hardware and software.

[0045] The expression “configured to” as used in this disclosure may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware. Instead, in some situations, the expression “system configured to” may mean that the system is “capable of” together with other devices or components. For example, the phrase “a processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing said operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) capable of performing said operations by executing one or more software programs stored in memory.

[0046] In addition, when a component is described in the present disclosure as being “connected” or “connected” to another component, it should be understood that the component may be directly connected to or directly connected to the other component, but unless otherwise specifically stated, it may also be connected or connected through another component in between.

[0047] In this specification, where a component (or region, layer, part, etc.) is described as being “on,” “connected,” or “joined” another component, it means that it may be directly placed / connected / joined on the other component, or that a third component may be placed between them.

[0048] Meanwhile, in the present application, "direct placement" may mean that there are no additional layers, films, regions, plates, etc. added between a part such as a layer, film, region, or plate and another part. For example, "direct placement" may mean that two layers or two members are placed without using additional members such as adhesive members between them.

[0049] In addition, terms such as “below,” “lower side,” “above,” “upper side,” “on,” “upper surface,” and “lower surface” are used to describe the relationships between components illustrated in the drawings. These terms are relative concepts and are described based on the directions indicated in the drawings.

[0050] It should be understood that the blocks in each flowchart and combinations of flowcharts can be executed by one or more computer programs containing computer-executable instructions. One or more computer programs may be stored all in a single memory or may be partitioned and stored in multiple different memories.

[0051] All functions or operations described in this document may be processed by a single processor or a combination of multiple processors.

[0052] In this disclosure, terms “containing, including, comprising, having, comprising” and similar terms are used to specify features, quantities, steps, actions, elements, components, or combinations thereof, and do not exclude the presence or addition of one or more features, quantities, steps, actions, elements, components, or combinations thereof.

[0053] Additionally, in this disclosure, the meaning of “identical” includes cases where they have similar characteristics or are similar within a certain range. Furthermore, unless otherwise clearly indicated, stated, and / or illustrated, the terms “identical,” “uniform,” “equal,” and / or “the same” as used herein mean “substantially identical,” “substantially uniform,” “substantially equal,” “about the same,” and / or “substantially the same.”

[0054] The meaning of “substantially identical” should be understood to include numerical values ​​within manufacturing error ranges, machining or processing tolerance ranges, and / or differences within a range insignificant enough not to substantially alter, impede, or impair the structure or function of the embodiments according to the present disclosure.

[0055] Unless otherwise indicated, where a particular type of component exists in multiple quantities in this disclosure, any two components of that type are considered “adjacent” or “adjacent to” each other, provided that other components of that type do not occupy the space between the two components. That is, two components are considered adjacent to each other if they are not separated from each other by an intervening component of the same type.

[0056] Additionally, one or more embodiments may include additional features not explicitly described as disclosed in this specification, as well as features disclosed herein, but other embodiments may not include any undisclosed elements. For example, in one or more embodiments according to this disclosure, undisclosed elements may be completely omitted.

[0057] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement them. However, an embodiment of the present disclosure may be implemented in various different forms and is not limited to the embodiment described herein. Furthermore, in order to clearly explain an embodiment of the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the present disclosure are denoted by similar reference numerals.

[0058] Embodiments of the present disclosure will be described in detail below with reference to the drawings.

[0059] FIG. 1 is a drawing for explaining the operation of an electronic device according to one embodiment of the present disclosure.

[0060] FIG. 1 illustrates an electronic device (100) and a user (200) using the electronic device (100). Referring to FIG. 1, in one embodiment of the present disclosure, the electronic device (100) may include a display device (110). The display device (110) may have a shape parallel to a plane defined by a first direction (10) and a second direction (20).

[0061] The electronic device (100) in FIG. 1 is depicted as a bar-shaped rigid type electronic device, but is not particularly limited thereto. In one embodiment of the present disclosure, the electronic device (100) may be a foldable, rollable, or sliderable type electronic device. In this case, the display device (110) may also have a bent or folded shape based on a plane defined by the first direction (10) and the second direction (20).

[0062] Hereinafter, the normal direction substantially perpendicular to the plane defined by the first direction (10) and the second direction (20) is defined as the third direction (30). In this specification, the meaning of "when viewed in a plane" may mean the state viewed from the third direction (30). That is, the plane may be parallel to the plane defined by the first direction (10) and the second direction (20).

[0063] In one embodiment of the present disclosure, the electronic device (100) may be implemented as an electronic device of various shapes, such as a smartphone, a laptop computer, a tablet PC, a television, a mobile device, a digital signage device, and a head-mounted display device.

[0064] In one embodiment of the present disclosure, the display device (110) may include a pixel layer comprising a plurality of light-emitting pixels. The electronic device (100) may display an image (111) by controlling through the plurality of light-emitting pixels.

[0065] In one embodiment of the present disclosure, the electronic device (100) may display an image (111) in a third direction (30) through a display device (110) and provide it to a user (200). The direction in which the image (111) is displayed through the display device (110) may correspond to the front surface of the electronic device (100). Hereinafter, the image (111) displayed through the display device (110) will be referred to as the output image (111).

[0066] In one embodiment of the present disclosure, the display device (110) may include a pixel layer comprising a plurality of light-receiving pixels. The electronic device (100) can sense a user (200) using the electronic device (100) through the plurality of light-receiving pixels and acquire a plurality of image data (211, 212) corresponding to the user (200). The electronic device (100) can acquire a plurality of image data (211, 212) corresponding to each of the two or more driving voltages by applying two or more driving voltages having different voltage values ​​to the plurality of light-receiving pixels (e.g., applying them simultaneously (in the present disclosure, 'simultaneously' may include cases where they are applied simultaneously for at least a portion of time)). The plurality of image data (211, 212) may correspond to image data received under different sensitivity conditions. For example, the plurality of image data (211, 212) may include one or more of image data received under relatively high sensitivity conditions in a low-light area or image data received under relatively low sensitivity conditions in a medium / high-light area.

[0067] For example, the electronic device (100) can sense the user (200) through first group light-receiving pixels to which a first driving voltage is applied, and obtain first image data (211) corresponding to the user (200). The electronic device (100) can sense the user (200) through second group light-receiving pixels to which a second driving voltage different from the first driving voltage is applied, and obtain second image data (212) corresponding to the user (200).

[0068] However, the present disclosure is not limited thereto, and the electronic device (100) may acquire a plurality of image data (211, 212) by sensing the environment around the electronic device (100) (e.g., an object or background located around the electronic device (100)) through a plurality of light-receiving pixels.

[0069] In one embodiment of the present disclosure, an electronic device (100) can generate an image (220) based on a plurality of image data (211, 212). Hereinafter, the image (220) generated through the display device (110) will be referred to as a sensing image (220).

[0070] For example, the sensing image (220) may be a High Dynamic Range (HDR) image. The electronic device (100) can generate an HDR image (220) by aligning and fusing multiple image data (211, 212) using an HDR synthesis algorithm. In the present disclosure, the HDR image (220) may refer to an image generated based on multiple image data (211, 212) obtained under different sensitivity conditions. Since the HDR image (220) can express a brightness range (e.g., a bright area and / or a dark area) that is difficult to express with image data obtained under a single sensitivity condition, it can provide an extended dynamic range. Through this, the electronic device (100) can obtain a sensing image (220) in which the bright area and the dark area are simultaneously expressed with high precision through multiple light-receiving pixels to which different multiple driving voltages are applied.

[0071] According to one embodiment of the present disclosure, an electronic device (100) can acquire multiple image data of the same scene acquired under different sensitivity conditions by applying different driving voltages to light-receiving pixels at the same time. Through this, the electronic device (100) can acquire a sensing image (220, e.g., HDR image) without ghosting even for a moving subject. In addition, the electronic device (100) can implement the sensing image (220, e.g., HDR image) at a relatively high speed.

[0072] According to one embodiment of the present disclosure, the electronic device (100) can acquire multiple image data from the same scene acquired under different sensitivity conditions without adjusting the exposure time by controlling sensitivity through a driving voltage. Through this, the electronic device (100) does not need to provide a separate configuration for controlling the exposure time, so the structure can be simplified. In addition, when the exposure time is set long for low-light shooting, the sensing speed may be delayed and ghosting may occur on moving subjects, but in the case of the electronic device (100) according to one embodiment of the present disclosure, by controlling sensitivity through a driving voltage, the sensing speed can be prevented and ghosting can be prevented.

[0073] In one embodiment of the present disclosure, the display device (110) may include a lens layer disposed on a pixel layer and comprising a plurality of lenses corresponding to each of a plurality of light-receiving pixels. In one embodiment of the present disclosure, the lens layer may be disposed on the upper surface of the pixel layer with respect to a third direction (30).

[0074] In one embodiment of the present disclosure, light incident from outside the electronic device (100) to the display device (110) can be concentrated through a plurality of lenses included in the lens layer and provided to a plurality of light-receiving pixels.

[0075] Additionally, in one embodiment of the present disclosure, the display device (110) may include an optical layer disposed between a pixel layer and a lens layer. Light provided to the display device (110) from the outside may be provided to a plurality of light-receiving pixels through a plurality of lenses and an optical layer.

[0076] At this time, the thickness of the optical layer can be determined such that a plurality of light-receiving pixels are located at the focal length of each of the plurality of lenses. Through the optical layer, the focal point of each of the plurality of lenses can be aligned with the corresponding plurality of light-receiving pixels.

[0077] Accordingly, a clear sensing image (220) can be obtained through the display device (110). In one embodiment of the present disclosure, the electronic device (100) may obtain the sensing image (220) by sensing not only an object in contact with the display device (110) (e.g., touching the display device (110) or a part of a body area in contact with the display device (110), but also an object spaced apart from the display device (110) by a certain distance (e.g., a user (200) viewing the display image (111) through the display device (110)).

[0078] In one embodiment of the present disclosure, the electronic device (100) can acquire a sensing image (220) by sensing a user or the surrounding environment through a display device (110) without having a separate configuration such as a camera or an IR (Infrared Ray) sensor.

[0079] In one embodiment of the present disclosure, the electronic device (100) may perform an operation of displaying an output image (111) to a user (200) through a display device (110), or perform an operation of recognizing the user (200) and acquiring a sensing image (220), or perform both operations simultaneously. Through this, the electronic device (100) may acquire the movements, facial expressions, or instructions of the user (200) viewing the output image (111) through the sensing image (220) and perform an interaction with the user (200). According to one embodiment of the present disclosure, the electronic device (100) can improve the accuracy of the interaction with the user (200) by acquiring a sensing image (220) in which the bright area and the dark area are simultaneously expressed with high precision.

[0080] Alternatively, in one embodiment of the present disclosure, the electronic device (100) may utilize the sensing image (220) obtained through the display device (110) for ambient illumination adaptation (e.g., brightness adjustment of the output image, color temperature correction, etc.). According to one embodiment of the present disclosure, the electronic device (100) may display an output image that maintains readability and visibility according to the ambient environment by improving the accuracy of ambient illumination sensing by obtaining a sensing image (220) in which bright areas and dark areas are simultaneously expressed with high precision.

[0081] Hereinafter, the configuration of the display device (110) included in the electronic device (100) and the operation of the electronic device (100) will be described in detail.

[0082] FIG. 2 is a block diagram for explaining the configuration of an electronic device according to one embodiment of the present disclosure.

[0083] Referring to FIGS. 1 and FIGS. 2, in one embodiment of the present disclosure, an electronic device (100) may include a display device (110), a memory (120), at least one processor (130), an input / output interface (140), and a communication interface (150).

[0084] However, not all of the components shown in FIG. 2 are essential components. The electronic device (100) may be implemented with more components than those shown in FIG. 2, or with fewer components.

[0085] A display device (110), memory (120), at least one processor (130), an input / output interface (140), and a communication interface (150) included in an electronic device (100) can each be electrically connected to one another.

[0086] In one embodiment of the present disclosure, as at least one processor (130) controls the display device (110), the electronic device (100) can display an image. Additionally, as at least one processor (130) controls the display device (110), the electronic device (100) can acquire an image by sensing light provided from the surroundings.

[0087] In one embodiment of the present disclosure, a display device (110) may include a plurality of light-emitting pixels. The plurality of light-emitting pixels included in the display device (110) may include organic light-emitting diodes. However, the present disclosure is not limited thereto, and the plurality of light-emitting pixels included in the display device (110) may include inorganic light-emitting diodes. However, the present disclosure is not limited thereto, and the display device (110) may include other types of light-emitting pixels capable of displaying images (e.g., a combination of a backlight and a color filter).

[0088] In one embodiment of the present disclosure, the display device (110) may include a plurality of light-receiving pixels. The plurality of light-receiving pixels included in the display device (110) may include inorganic photodiodes, for example, thin film transistor (TFT) photodiodes. The TFT photodiodes may include amorphous silicon PIN diodes or oxide thin film transistor (oxide TFT) photodiodes.

[0089] However, the present disclosure is not limited thereto, and a plurality of light-receiving pixels included in the display device (110) may include organic photodiodes.

[0090] Hereinafter, the components included in the display device (110) and the arrangement of the components in the display device (110) will be described later in FIGS. 3 to 7e.

[0091] In one embodiment of the present disclosure, the memory (120) may store instructions, data structures, and program code that can be read by at least one processor (130). In one embodiment of the present disclosure, there may be one or more memory units. Operations performed by the electronic device (100) may be implemented by at least one processor (130) executing the instructions (or codes) of a program stored in the memory (120).

[0092] In one embodiment of the present disclosure, the memory (120) may include at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid-state drive (SSD).

[0093] In one embodiment of the present disclosure, the memory (120) may not exist separately and may be configured to be included in at least one processor (130).

[0094] In one embodiment of the present disclosure, instructions or program code for performing functions or operations of an electronic device (100) may be stored in the memory (120). The instructions, algorithms, data structures, program code, and application programs stored in the memory (120) may be implemented in a programming or scripting language such as, for example, C, C++, Java, Python, assembler, etc.

[0095] In one embodiment of the present disclosure, various types of modules that can be used to perform the operation of the electronic device (100) may be stored in the memory (120).

[0096] In one embodiment of the present disclosure, an image display module (121) and an image acquisition module (122) may be stored in the memory (120). However, not all modules shown in FIG. 2 are required. More modules than those shown in FIG. 2 may be stored in the memory (120), or fewer modules may be stored.

[0097] In one embodiment of the present disclosure, a 'module' included in the memory (120) may mean a unit that processes a function or operation performed by at least one processor (130). The 'module' included in the memory (120) may be implemented as software such as instructions, algorithms, data structures, or program code.

[0098] In one embodiment of the present disclosure, the image display module (121) may be composed of instructions or program code regarding an operation or function of displaying an output image (111) through a display device (110).

[0099] In one embodiment of the present disclosure, by having at least one processor (130) execute instructions or program code of an image display module (121), the electronic device (100) can display an output image (111) through a display device (110).

[0100] In one embodiment of the present disclosure, the image acquisition module (122) may be composed of instructions or program code regarding an operation or function of acquiring a sensing image (220) through a display device (110). For example, the image acquisition module (122) may be composed of instructions or program code regarding an operation or function of acquiring a plurality of image data corresponding to each of the plurality of driving voltages through a plurality of light-receiving pixels to which different plurality of driving voltages are applied according to the position (or region) of the light-receiving pixel, and acquiring a sensing image (220) based on the acquired plurality of image data.

[0101] In one embodiment of the present disclosure, by having at least one processor (130) execute instructions or program code of an image acquisition module (122), the electronic device (100) can acquire a sensing image (220) through a display device (110). For example, by having at least one processor (130) execute instructions or program code of an image acquisition module (122), the electronic device (100) can acquire a plurality of image data corresponding to each of the plurality of driving voltages through a plurality of light-receiving pixels to which different driving voltages are applied according to the position (or region) of the light-receiving pixel, and can acquire a sensing image (220) based on the acquired plurality of image data.

[0102] In one embodiment of the present disclosure, at least one processor (130) may be configured to control a series of processes to operate an electronic device (100) according to an embodiment described below, and may be composed of one or more processors.

[0103] In one embodiment of the present disclosure, at least one processor (130) may be composed of at least one of a Central Processing Unit, a microprocessor, a Graphic Processing Unit, an Application Processor (AP), an Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), or a Communication Processor (CP), but is not limited thereto.

[0104] In one embodiment of the present disclosure, at least one processor (130) may be composed of a circuit such as a System on Chip (SoC) or an Integrated Circuit (IC).

[0105] In one embodiment of the present disclosure, at least one processor (130) can execute various types of modules stored in memory (120). At least one processor (130) can execute at least one instruction constituting various types of modules stored in memory (120) individually or collectively.

[0106] By executing a program or at least one instruction stored in memory (120), at least one processor (130) can process data according to a predefined operation rule.

[0107] In one embodiment of the present disclosure, at least one processor (130) may include a plurality of processors. In one embodiment of the present disclosure, at least one of a plurality of modules in memory (120) may be executed by any one of the plurality of processors. The remaining modules among the plurality of modules stored in memory (120) may be executed by another processor among the plurality of processors.

[0108] In one embodiment of the present disclosure, at least one processor (130) may include a controller (301, see FIG. 3), a data driver (302, see FIG. 3), and a sensing driver (303, see FIG. 3). However, the present disclosure is not limited thereto, and at least one of the controller (301), the data driver (302), or the sensing driver (303) may be a component included in the display device (110).

[0109] Additionally, in one embodiment of the present disclosure, at least one component of the scan driver (304) or light-emitting driver (305) included in the display device (110) may be a component included in at least one processor (130).

[0110] Hereinafter, the controller (301), data driver (302), sensing driver (303), scan driver (304) and light-emitting driver (305) will be described later in FIG. 3.

[0111] In one embodiment of the present disclosure, the input / output interface (140) may perform input / output operations with an external electronic device using at least one of an input / output method including an HDMI port (High-Definition Multimedia Interface port), DVI (Digital Visual Interface), a component jack, a PC port, or a USB port (Universal Serial Bus port). However, the present disclosure is not limited to the above-mentioned input / output methods.

[0112] In one embodiment of the present disclosure, at least one processor (130) controls an input / output interface (140), so that the electronic device (100) can obtain an image signal and a scan control signal from an external electronic device, etc., through the input / output interface (140).

[0113] In one embodiment of the present disclosure, the electronic device (100) can display an output image (111) through a display device (110) based on an image signal obtained through an input / output interface (140).

[0114] In one embodiment of the present disclosure, the communication interface (150) can perform data communication with an external server or an external electronic device using at least one of a data communication method including, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, Zigbee, WFD (Wi-Fi Direct), infrared communication (IrDA, infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet), WiMAX (World Interoperability for Microwave Access), SWAP (Shared Wireless Access Protocol), WiGig (Wireless Gigabit Alliance), and RF communication.

[0115] In one embodiment of the present disclosure, at least one processor (130) controls a communication interface (150), so that the electronic device (100) can perform data communication with an external server or an external electronic device.

[0116] FIG. 3 is a block diagram for explaining the configuration of a display device according to one embodiment of the present disclosure.

[0117] Referring to FIGS. 1, 2 and 3, in one embodiment of the present disclosure, FIG. 3 shows a display device (110) included in an electronic device (100). FIG. 3 also shows a controller (301), a data driver (302), and a sensing driver (303) among a plurality of components included in the display device (110).

[0118] In one embodiment of the present disclosure, the display device (110) may include a scan driver (304) and a light-emitting driver (305).

[0119] In one embodiment of the present disclosure, the display device (110) may include a display area where an image (111) is displayed and a non-display area (e.g., a bezel area) adjacent to the display area where the image (111) is not displayed. In one embodiment of the present disclosure, a scan driver (304) and a light-emitting driver (305) may be placed in the non-display area.

[0120] In FIG. 3, the controller (301), data driver (302), and sensing driver (303) are shown as distinct components, but the present disclosure is not limited thereto. Operation by two or more of the controller (301), data driver (302), and sensing driver (303) may be performed in a single component.

[0121] Additionally, although the scan driver (304) and the light-emitting driver (305) are depicted as separate components, it is obvious that the operation of the scan driver (304) and the light-emitting driver (305) may be performed in a single component. Furthermore, a component that performs the operation of the scan driver (304) and the light-emitting driver (305) together may be composed of two or more components and placed within a non-display area.

[0122] In one embodiment of the present disclosure, the display device (110) may include a pixel layer (540, see FIG. 5) including a plurality of light-emitting pixels (311) and a plurality of light-receiving pixels (320), and a lens layer (570, see FIG. 5) including a plurality of lenses (330).

[0123] At this time, the lens layer (570) may represent an arrangement of multiple lenses (330). That is, if each of the multiple lenses (330) is a micro lens having a size in the micrometer unit, the lens layer may represent a micro lens array (MLA) representing an arrangement of multiple micro lenses.

[0124] In one embodiment of the present disclosure, FIG. 3 shows a plurality of light-emitting pixels (311), a plurality of light-receiving pixels (320), and a plurality of lenses (330) among the components included in the display device (110), but the present disclosure is not limited thereto, and the display device (110) may include more components than those shown in FIG. 3 (e.g., a base layer (500, see FIG. 5), an optical layer (560, see FIG. 5), etc.).

[0125] In one embodiment of the present disclosure, each of the plurality of light-emitting pixels (311) may include a plurality of subpixels including a light-emitting diode that generates different color light. In this case, the light-emitting diode may refer to a light-emitting element including a light-emitting diode.

[0126] Specifically, each of the plurality of light-emitting pixels (311) may include a red subpixel including a red light-emitting diode that generates red color light, a green subpixel including a green light-emitting diode that generates green color light, and a blue subpixel including a blue color diode that generates blue color light.

[0127] However, the present disclosure is not limited thereto, and each of the plurality of light-emitting pixels (311) may include at least one subpixel comprising light-emitting diodes that generate various combinations of color light for displaying an output image (111).

[0128] Although not shown in FIG. 3, each of the plurality of light-emitting pixels (311) may be electrically connected to at least one transistor and at least one capacitor. At least one transistor and at least one capacitor electrically connected to each of the plurality of light-emitting pixels (311) may be referred to as a light-emitting pixel driving circuit.

[0129] In one embodiment of the present disclosure, a light-emitting pixel driving circuit may be included in a circuit layer (510, see FIG. 5) included in a display device (110). In one embodiment of the present disclosure, a pixel layer (540) may be disposed on the circuit layer (510). A plurality of light-emitting pixels (311) included in the pixel layer (540) may each be electrically connected to light-emitting pixel driving circuits included in the circuit layer (510).

[0130] In one embodiment of the present disclosure, the scan driver (304) and the light-emitting driver (305) may also include a plurality of transistors and may be included in the circuit layer (510). However, the present disclosure is not limited thereto, and if the data driver (302) is included in the display device (110), the data driver (302) may also be included in the circuit layer (510).

[0131] In one embodiment of the present disclosure, the display device (110) may include a plurality of first scan lines that extend from a scan driver (304) in a second direction (20) and are spaced apart from each other in a first direction (10) that intersects the second direction (20). Additionally, the display device (110) may include a plurality of light-emitting lines that extend from a light-emitting driver (305) in a direction opposite to the second direction (20) and are spaced apart from each other in a first direction (10).

[0132] In one embodiment of the present disclosure, the display device (110) may include a plurality of data lines that extend in the opposite direction of the first direction (10) from the data driver (302) and are spaced apart from each other in the second direction (20).

[0133] In one embodiment of the present disclosure, a plurality of first scan lines, a plurality of light-emitting lines and a plurality of data lines may be included in the circuit layer (510).

[0134] In one embodiment of the present disclosure, each of the plurality of light-emitting pixels (311) may be electrically connected to a corresponding plurality of first scan lines, a plurality of light-emitting lines, and a plurality of data lines. In one embodiment of the present disclosure, depending on the configuration of the light-emitting pixel driving circuit included in each of the plurality of light-emitting pixels (311), the connection relationship between each of the plurality of light-emitting pixels (311) and the plurality of first scan lines, the plurality of light-emitting lines, and the plurality of data lines may be changed.

[0135] In one embodiment of the present disclosure, the controller (301) can acquire an image signal and a scan control signal from an external source. The controller (301) can provide an output image signal, converted in the data format of the image signal, to the data driver (302) so as to be suitable for the data driver (302) and the display device (110).

[0136] In one embodiment of the present disclosure, the data driver (302) may convert an output image signal into a plurality of data signals and provide the plurality of data signals to each of the plurality of data lines. The plurality of data signals may be analog voltages converted to correspond to the grayscale level of the output image signal.

[0137] In one embodiment of the present disclosure, the scan control signal may include a vertical start signal for initiating the operation of the scan driver (304), a vertical start signal for initiating the operation of the light-emitting driver (305), and a clock signal for determining the timing of the output of the vertical start signals.

[0138] In one embodiment of the present disclosure, the scan driver (304) may generate a plurality of first scan signals based on a scan control signal. The scan driver (304) may provide a plurality of first scan signals to each of a plurality of first scan lines.

[0139] In one embodiment of the present disclosure, the light-emitting driver (305) can generate a plurality of light-emitting signals based on a scan control signal. The light-emitting driver (305) can provide a plurality of light-emitting signals to each of a plurality of light-emitting lines.

[0140] In one embodiment of the present disclosure, the electronic device (100) controls the timing of applying a first scan signal, a data signal, and a light-emitting signal to each of a plurality of light-emitting pixels (311), and adjusts the length or size of the signal interval included in each signal, so that an output image (111) can be displayed through a display device (110).

[0141] In one embodiment of the present disclosure, a plurality of light-receiving pixels (320) may be arranged to correspond to each of a plurality of light-emitting pixels (311). Specifically, when the area containing each light-emitting pixel is referred to as a pixel area (310), each light-receiving pixel may be arranged to correspond to the pixel area (310). However, the present disclosure is not limited thereto, and it is understood that two or more light-receiving pixels may be arranged to be included in each pixel area (310).

[0142] In one embodiment of the present disclosure, a light-receiving pixel may be arranged to correspond to each pixel area (310). A light-receiving pixel may be arranged to be included in each pixel area (310). However, the present disclosure is not limited thereto, and it is understood that two or more light-receiving pixels may be arranged to correspond to or included in each pixel area (310), or that a light-receiving pixel may be arranged to correspond to or included in two or more pixel areas (310).

[0143] In one embodiment of the present disclosure, each of the plurality of light-receiving pixels (320) may include a photodiode that senses light provided from the outside and converts it into an electrical signal. Each of the plurality of light-receiving pixels (320) may sense light reflected from the surrounding environment of the display device (110) or light provided from the outside to obtain an electrical signal regarding the surrounding environment.

[0144] In one embodiment of the present disclosure, each of the plurality of lenses (330) may be arranged to correspond to each light-receiving pixel. Specifically, one lens may be arranged to correspond to one light-receiving pixel.

[0145] Although not shown in FIG. 3, each of the plurality of light-receiving pixels (320) may be electrically connected to at least one transistor. At least one transistor electrically connected to each of the plurality of light-receiving pixels (320) may be referred to as a light-receiving pixel driving circuit.

[0146] In one embodiment of the present disclosure, a light-receiving pixel driving circuit may be included in a circuit layer (510) included in a display device (110). The light-receiving pixel driving circuit may be formed through the same process as the light-emitting pixel driving circuit and included in the circuit layer (510).

[0147] In one embodiment of the present disclosure, each of the plurality of light-receiving pixels (320) included in the pixel layer (540) may be electrically connected to a light-receiving pixel driving circuit included in the circuit layer (510).

[0148] In one embodiment of the present disclosure, the display device (110) may include a plurality of second scan lines that extend from the scan driver (304) in a second direction (20) and are spaced apart from each other in a first direction (10) that intersects the second direction (20).

[0149] In one embodiment of the present disclosure, the display device (110) may include a plurality of sensing lines that extend in the opposite direction of the first direction (10) from the sensing driver (303) and are spaced apart from each other in the second direction (20).

[0150] In one embodiment of the present disclosure, a plurality of second scan lines and a plurality of sensing lines may be included in the circuit layer (510).

[0151] In one embodiment of the present disclosure, each of the plurality of light-receiving pixels (320) may be electrically connected to each of the corresponding plurality of second scan lines and plurality of sensing lines. In one embodiment of the present disclosure, depending on the configuration of the light-receiving pixel driving circuit included in each of the plurality of light-emitting pixels (320), the connection relationship between each of the plurality of light-receiving pixels (320) and the plurality of second scan lines and plurality of sensing lines may be changed.

[0152] In one embodiment of the present disclosure, the scan driver (304) may generate a plurality of second scan signals based on a scan control signal. The scan driver (304) may provide a plurality of second scan signals to each of a plurality of second scan lines.

[0153] In one embodiment of the present disclosure, the electronic device (100) controls the timing of applying a second scan signal to each of the plurality of light-receiving pixels (320) and adjusts the length or size of the signal interval included in the second scan signal, thereby obtaining image data (211, 212) for generating a sensing image (220) through a display device (110).

[0154] In one embodiment of the present disclosure, the sensing driver (303) can acquire an electrical signal sensed from a plurality of light receiving pixels (320) through a plurality of sensing signals. The sensing driver (303) can acquire image data (211, 212) by converting the acquired electrical signal.

[0155] In one embodiment of the present disclosure, an electronic device (100) can acquire first image data (211) through a first group of light-receiving pixels (321) among a plurality of light-receiving pixels (320). At the same time, the electronic device (100) can acquire second image data (212) through a second group of light-receiving pixels (322) among a plurality of light-receiving pixels (320). The first image data (211) and the second image data (212) may correspond to image data received under different sensitivity conditions (e.g., high sensitivity conditions for low-light sensing and low sensitivity conditions for medium / high-light sensing). The electronic device (100) can obtain first image data (211) and second image data (212) in the same scene obtained under different sensitivity conditions by simultaneously applying different driving voltages to the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322).

[0156] The electronic device (100) can generate a sensing image (220) based on the first image data (211) and the second image data (212). The electronic device (100) can acquire a sensing image (220) in which a bright area and a dark area are simultaneously expressed with high precision through a plurality of light-receiving pixels (320) to which a plurality of different driving voltages are applied. The electronic device (100) can acquire a sensing image (220) without ghosting even for a moving subject.

[0157] In one embodiment of the present disclosure, the display device (110) may include one or more voltage lines that apply a driving voltage to each of the plurality of light-receiving pixels (320). For example, the display device (110) may include a first voltage line capable of applying a first driving voltage to a first group of light-receiving pixels (321) and a second voltage line capable of applying a second driving voltage to a second group of light-receiving pixels (322). However, the embodiment is not limited thereto, and the display device (110) may control the connection relationship between the light-receiving pixels (320) and one or more voltage lines through a separate voltage control circuit. A detailed description regarding the connection relationship between the plurality of light-receiving pixels (320) and one or more voltage lines will be provided later.

[0158] In one embodiment of the present disclosure, a sensing driver (303) provides first image data and second image data to a controller (301), and the controller (301) can acquire (e.g., generate) a sensing image (220) using the first image data and second image data.

[0159] FIG. 4 is a drawing for explaining the configuration of a display device according to one embodiment of the present disclosure.

[0160] Referring to FIGS. 1, FIGS. 3 and FIGS. 4, in one embodiment of the present disclosure, FIG. 4 shows a display device (110) included in an electronic device (100).

[0161] In one embodiment of the present disclosure, the display device (110) may include a display module (400), a lens layer (410), and a window (420). In this case, the display module (400) may include a base layer (500), a circuit layer (510), a pixel layer (540), an optical adhesive layer (550), and an optical layer (560) as illustrated in FIG. 5. FIG. 4 is illustrated as including a driving circuit (401), a plurality of light-emitting pixels (402), and a plurality of light-receiving pixels (403) in the display module (400), but it is obvious that more components may be included.

[0162] In one embodiment of the present disclosure, the lens layer (410) may include a plurality of lenses (411) and a light blocking film (412) surrounding the plurality of lenses (411). In this case, the light blocking film (412) may include a plurality of openings that overlap with the plurality of lenses (411).

[0163] In one embodiment of the present disclosure, the window (420) may be made of a transparent material capable of transmitting a first image (111) displayed by the display device (110) or providing light provided from the outside to the display device (110). For example, it may be composed of glass, sapphire, plastic, etc. The window (420) is illustrated as a single layer, but is not limited thereto and may include a plurality of layers.

[0164] In one embodiment of the present disclosure, a lens layer (410) may be laminated on a display module (400). At this time, "on the display module (400)" may mean that the lens layer (410) is laminated on the upper surface of the display module (400) with respect to the third direction (30).

[0165] In one embodiment of the present disclosure, a window (420) may be laminated on a lens layer (410). In this case, "on the lens layer (410)" may mean that the window (420) is laminated on the upper surface of the lens layer (410) with respect to the third direction (30).

[0166] FIG. 5 is a drawing for explaining the arrangement of a plurality of components included in a display device according to one embodiment of the present disclosure.

[0167] Referring to FIGS. 3, 4, and 5, in one embodiment of the present disclosure, FIG. 5 shows a plurality of components included in a display device (110).

[0168] In one embodiment of the present disclosure, the display device (110) may include a base layer (500).

[0169] In one embodiment of the present disclosure, the base layer (500) may include a synthetic resin layer. The synthetic resin layer may include a thermosetting resin. In particular, the synthetic resin layer may be a polyimide-based resin layer, and the material thereof is not particularly limited. The synthetic resin layer may include at least one of an acrylic resin, a methacrylate resin, a polyisoprene, a vinyl resin, an epoxy resin, a urethane resin, a cellulose resin, a siloxane resin, a polyamide resin, or a perylene resin. In addition, the base layer (500) may include a glass substrate, a metal substrate, or an organic / inorganic composite material substrate, etc.

[0170] In one embodiment of the present disclosure, the display device (110) may include a circuit layer (510) disposed on a base layer (500). In this case, the circuit layer (510) may include small elements such as a plurality of transistors (511) for driving a plurality of light-emitting pixels (531) and a plurality of light-receiving pixels (521).

[0171] In one embodiment of the present disclosure, the circuit layer (510) may be disposed on the upper surface of the base layer (500). The circuit layer (510) may be laminated in a third direction (30) on the base layer (500). The circuit layer (510) will be described later in FIG. 6.

[0172] In one embodiment of the present disclosure, the display device (110) may include a pixel layer (540) disposed on a circuit layer (510). The pixel layer (540) may be disposed on the upper surface of the circuit layer (510). The pixel layer (540) may be stacked in a third direction (30) with respect to the circuit layer (510).

[0173] In one embodiment of the present disclosure, the pixel layer (540) may include a light-emitting layer (530) including a plurality of light-emitting pixels (311) and a light-receiving layer (520) including a plurality of light-receiving pixels (521). In one embodiment of the present disclosure, the light-receiving layer (520) may be disposed on the upper surface of the circuit layer (510), and the light-emitting layer (530) may be disposed on the upper surface of the light-receiving layer (520).

[0174] However, the stacking order and arrangement relationship of the light-emitting layer (530) and the light-receiving layer (520) may vary depending on the type of the plurality of light-emitting pixels (531) and the type of the plurality of light-receiving pixels (521). In one embodiment of the present disclosure, when the plurality of light-receiving pixels (521) include inorganic photodiodes and the plurality of light-emitting pixels (531) include organic light-emitting diodes, the light-emitting layer (530) may be disposed on the upper surface of the light-receiving layer (520).

[0175] On the other hand, when a plurality of light-receiving pixels (521) include inorganic photodiodes and a plurality of light-emitting pixels (531) include inorganic light-emitting diodes, the light-emitting layer (530) and the light-receiving layer (520) may be disposed in the same layer. That is, a plurality of light-receiving pixels (521) and a plurality of light-emitting pixels (531) may be included in the same layer.

[0176] In addition, even when a plurality of light-receiving pixels (521) include organic photodiodes and a plurality of light-emitting pixels (531) include organic light-emitting diodes, it is obvious that the plurality of light-receiving pixels (521) and the plurality of light-emitting pixels (531) may be included on the same layer.

[0177] Hereinafter, for the convenience of explanation, a plurality of light-emitting pixels (531) are described as including organic light-emitting diodes, and a plurality of light-receiving pixels (521) are described as including inorganic photodiodes.

[0178] In one embodiment of the present disclosure, each light-receiving pixel may include an active layer (522) that senses light and converts it into an electrical signal, and an electrode (523) for applying voltage to the active layer. In one embodiment of the present disclosure, if the light-receiving pixel is a PIN diode, the active layer (522) may refer to a PIN layer. However, the present disclosure is not limited thereto, and it is understood that the structure and arrangement of each light-receiving pixel included in the light-receiving layer (520) may vary depending on the type of photodiode included in the light-receiving pixel.

[0179] In one embodiment of the present disclosure, the light-emitting layer (530) may include a plurality of light-emitting pixels (531) and a protective film (532) covering the plurality of light-emitting pixels (531).

[0180] In one embodiment of the present disclosure, the protective film (532) may be a film for protecting a plurality of light-emitting pixels (531) from the outside. The protective film (532) may refer to a thin film encapsulation (TFE). Although the protective film (532) is depicted as a single layer, it may have a structure in which a plurality of inorganic layers and organic layers are alternately stacked. In this case, the inorganic layer protects the plurality of light-emitting pixels (531) from external moisture, and the organic layer prevents defects in the plurality of light-emitting pixels (531) caused by foreign substances introduced during the manufacturing process. In this case, the protective film (532) may be referred to as an encapsulation layer.

[0181] However, the present disclosure is not limited thereto, and in the case where a plurality of light-emitting pixels (531) include inorganic light-emitting diodes, the protective film (532) may stabilize surface states, suppress leakage current, or provide an insulating function. In this case, the protective film (532) may be referred to as a passivation layer.

[0182] In addition, a flat surface can be provided when an optical layer (560), etc. is combined on the pixel layer (540) through the protective film (532).

[0183] In one embodiment of the present disclosure, the display device (110) may include an optical adhesive layer (550) on a pixel layer (540). The optical adhesive layer (550) may be a layer that serves to bond the pixel layer (540) and the optical layer (560). The optical adhesive layer (550) may be disposed between the pixel layer (540) and the optical layer (560).

[0184] However, the optical adhesive layer (550) shown in FIG. 5 is illustrated for illustrative purposes only, and the thickness of the optical adhesive layer (550) included in the display device (110) may be thinner than that shown in FIG. 5. Additionally, it is obvious that the configuration of the optical adhesive layer (550) may be omitted when describing the configuration of the display device (110).

[0185] In one embodiment of the present disclosure, the optical adhesive layer (550) has excellent light transmission properties, so that light loss between the multiple layers being bonded is minimized and light reflection or refraction is minimized.

[0186] In one embodiment of the present disclosure, the optical adhesive layer (550) may be a layer formed by applying and curing an optically clear resin (OCR) in the form of a liquid resin. Additionally, the optical adhesive layer (550) may be a layer formed of an optically clear adhesive (OCA) in the form of a film.

[0187] However, the present disclosure is not limited thereto, and the optical adhesive layer (550) may include other types of materials with excellent light transmission properties and adhesive strength.

[0188] In one embodiment of the present disclosure, the display device (110) may include an optical layer (560) disposed on a pixel layer (540). The optical layer (560) may be stacked in a third direction (30) with respect to the pixel layer (540). In one embodiment of the present disclosure, the optical layer (560) may be bonded to the pixel layer (540) using an optical adhesive layer (550).

[0189] In one embodiment of the present disclosure, the optical layer (560) may include an optically transparent material, such as glass or polyimide (PI).

[0190] In one embodiment of the present disclosure, the thickness (561) of the optical layer (560) may be determined to correspond to the focal length of each of the plurality of lenses. In the present disclosure, the fact that the thickness of the optical layer (560) corresponds to the focal length of each of the lenses may mean that the thickness of the optical layer (560) is set such that the focus of the light passing through each lens can be formed on the corresponding light receiving pixel (521). As the optical layer (560) having a thickness corresponding to the focal length of each lens is disposed between the lens layer (570) and the pixel layer (540), the focal plane of the light passing through the lenses coincides with the active area of ​​the corresponding light receiving pixel (521), thereby allowing the focused light to reach the corresponding light receiving pixel (521). Through this, the energy of the incident light can be incident into the corresponding light receiving pixel (521) with minimal loss, thereby improving the signal-to-noise ratio (SNR), reducing noise, and obtaining a signal with high sensitivity. Therefore, the light receiving pixel (521) can obtain information with improved reliability.

[0191] In one embodiment of the present disclosure, as the display device (110) includes an optical layer (560), the focus of light reflected from an object (590) located at a certain distance from the display device (110) passes through a plurality of lens layers (570) and is formed on a plurality of light receiving pixels (521), so that the display device (110) may acquire a sensing image (220).

[0192] Through this, the electronic device (100) can obtain a sensing image (220) by capturing an object (e.g., a part of the body such as a finger) in contact with the surface of the display device (110) (e.g., a window (420)), as well as an object located at a certain distance from the display device (110) (e.g., the face or pupil of a user (200) watching the output image (111) displayed through the display device (110).

[0193] In one embodiment of the present disclosure, a protective layer (580) may be disposed on the lens layer (570) to protect a plurality of lenses included in the lens layer (570) from the outside. At this time, the protective layer (580) is shown as a single layer, but may have a structure in which a plurality of inorganic layers and organic layers are alternately stacked. However, the present disclosure is not limited thereto, and the protective layer (580) may refer to the window (420) shown in FIG. 4.

[0194] FIG. 6 is a drawing for explaining a circuit layer and a light-emitting layer according to one embodiment of the present disclosure.

[0195] Referring to FIG. 5 and FIG. 6, in one embodiment of the present disclosure, FIG. 6 illustrates a base layer (500), a circuit layer (510), and a light receiving layer (520) among a plurality of components included in a display device (110).

[0196] In one embodiment of the present disclosure, the circuit layer (510) may include a plurality of transistors, and the light receiving layer (520) may also include a plurality of light receiving pixels. In FIG. 6, for convenience of explanation, one transistor and one light receiving pixel are shown arranged.

[0197] In one embodiment of the present disclosure, a circuit layer (510) stacked on a base layer (500) may include a first semiconductor pattern (600), a first insulating layer (610), a gate electrode (611), a second insulating layer (620), a source electrode (621), a drain electrode (622), and a third insulating layer (630).

[0198] In one embodiment of the present disclosure, the insulating layer included in the circuit layer (510) and the light receiving layer (520) may be an inorganic layer and / or an organic layer and may have a single layer or a multilayer structure. The insulating layer included in the circuit layer (510) and the light receiving layer (520) may include at least one of aluminum oxide, titanium oxide, silicon oxide, silicon nitride, silicon oxynitride, zirconium oxide, or hafnium oxide.

[0199] Additionally, the insulating layer included in the circuit layer (510) and the light receiving layer (520) may include general-purpose polymers such as BCB (Benzocyclobutene), polyimide, HMDSO (Hexamethyldisiloxane), polymethylmethacrylate (PMMA), or polystyrene (PS), polymer derivatives having a phenolic group, acrylic polymers, imide polymers, aryl ether polymers, amide polymers, fluorine polymers, p-xylene polymers, vinyl alcohol polymers, and blends thereof, but is not particularly limited thereto.

[0200] In one embodiment of the present disclosure, a first semiconductor pattern (600) may be disposed on a base layer (500). In one embodiment of the present disclosure, the first semiconductor pattern (600) may be divided into a source region, a gate region, and a drain region according to the doping concentration or conductivity of the semiconductor pattern. In one embodiment of the present disclosure, the source region and the drain region may be a p-type semiconductor layer or an n-type semiconductor layer. The gate region may be an active layer or a channel layer disposed between the source region and the drain region.

[0201] In one embodiment of the present disclosure, the first semiconductor pattern (600) may include a silicon semiconductor. For example, the silicon semiconductor may include amorphous silicon, polycrystalline silicon, etc. Or the first semiconductor pattern (600) may include an oxide of a material selected from group 12, 13, 14 metals such as indium (In), gallium (Ga), tin (Sn), cadmium (Cd), aluminum (Al), germanium (Ge), zinc (Zinc) or hafnium (Hf), and combinations thereof.

[0202] In one embodiment of the present disclosure, a first insulating layer (610) may be disposed on a base layer (500). The first insulating layer (610) may cover a first semiconductor pattern (600).

[0203] In one embodiment of the present disclosure, the first insulating layer (610) may be an inorganic layer and / or an organic layer and may have a single layer or a multilayer structure.

[0204] In one embodiment of the present disclosure, a gate electrode (611) may be disposed on a first insulating layer (610). The gate electrode (611) may be disposed on top of a first semiconductor pattern (600). The gate electrode (611) may overlap with the gate region of the first semiconductor pattern (600).

[0205] In one embodiment of the present disclosure, the gate electrode (611) may include titanium (Ti), silver (Ag), a silver-containing alloy, molybdenum (Mo), a molybdenum-containing alloy, aluminum (Al), an aluminum-containing alloy, aluminum nitride (AlN), tungsten (W), tungsten nitride (WN), copper (Cu), indium tin oxide (ITO), indium zinc oxide (IZO), etc., but is not particularly limited thereto.

[0206] In one embodiment of the present disclosure, a second insulating layer (620) may be disposed on a first insulating layer (610). The second insulating layer (620) may cover a gate electrode (611). The second insulating layer (620) may have a single layer or a multilayer structure. The second insulating layer (620) may be an inorganic layer and / or an organic layer.

[0207] In one embodiment of the present disclosure, a source electrode (621) and a drain electrode (622) may be disposed on a second insulating layer (620). The source electrode (621) and the drain electrode (622) may include titanium (Ti), silver (Ag), a silver-containing alloy, molybdenum (Mo), a molybdenum-containing alloy, aluminum (Al), an aluminum-containing alloy, aluminum nitride (AlN), tungsten (W), tungsten nitride (WN), copper (Cu), indium tin oxide (ITO), indium zinc oxide (IZO), etc., but are not particularly limited thereto.

[0208] In one embodiment of the present disclosure, the source electrode (621) may be electrically connected to the source region of the first semiconductor pattern (600) through a through hole penetrating the first insulating layer (610) and the second insulating layer (620). However, the present disclosure is not limited thereto, and the source electrode (621) may be electrically connected to the source region through a connecting electrode penetrating the first insulating layer (610) and the second insulating layer (620).

[0209] In one embodiment of the present disclosure, the drain electrode (622) may be electrically connected to the drain region of the first semiconductor pattern (600) through a through hole penetrating the first insulating layer (610) and the second insulating layer (620). However, the present disclosure is not limited thereto, and the drain electrode (622) may be electrically connected to the drain region through a connecting electrode penetrating the first insulating layer (610) and the second insulating layer (620).

[0210] In one embodiment of the present disclosure, a third insulating layer (630) may be disposed on a second insulating layer (620). The third insulating layer (630) may cover a source electrode (621) and a drain electrode (622). The third insulating layer (630) may have a single layer or a multilayer structure. The third insulating layer (630) may be an inorganic layer and / or an organic layer.

[0211] In one embodiment of the present disclosure, a light receiving layer (520) stacked on a circuit layer (510) may include a second semiconductor pattern (631), a transparent electrode (632), a fourth insulating layer (640), a first electrode (641), a second electrode (642), and a fifth insulating layer (650).

[0212] In one embodiment of the present disclosure, a second semiconductor pattern (631) may be disposed on a drain electrode (622). In one embodiment of the present disclosure, the second semiconductor pattern (631) may be formed in an opening formed by etching a portion of a third insulating layer (630) covering the drain electrode (622). The second semiconductor pattern (631) may be electrically connected to the drain electrode (622).

[0213] In one embodiment of the present disclosure, the second semiconductor pattern (631) may include a silicon semiconductor. For example, the silicon semiconductor may include amorphous silicon, polycrystalline silicon, etc. Or the second semiconductor pattern (631) may include an oxide of a material selected from group 12, 13, 14 metals such as indium (In), gallium (Ga), tin (Sn), cadmium (Cd), aluminum (Al), germanium (Ge), zinc (Zinc) or hafnium (Hf), and combinations thereof.

[0214] In one embodiment of the present disclosure, the second semiconductor pattern (631) may be a PIN layer in which a p-type semiconductor layer, an i-type (intrinsic type) semiconductor layer, and an n-type semiconductor layer are sequentially stacked. A photocurrent corresponding to light incident on the second semiconductor pattern (631) may be generated and provided to the drain electrode (622).

[0215] In one embodiment of the present disclosure, a transparent electrode (632) may be disposed on a second semiconductor pattern (631). The transparent electrode (632) may refer to an electrode that is optically transparent and electrically conductive. The transparent electrode (632) may include an ITO (Indium Tin Oxide) electrode. However, the present disclosure is not limited thereto, and the transparent electrode (632) may include a transparent conductive oxide such as IZO (Indium Zinc Oxide) or GZO (Gallium-doped Zinc Oxide).

[0216] In one embodiment of the present disclosure, a fourth insulating layer (640) may be disposed on a transparent electrode (632). The fourth insulating layer (640) may cover the second semiconductor pattern (631) and the transparent electrode (632). The fourth insulating layer (640) may have a single layer or a multilayer structure. The fourth insulating layer (640) may be an inorganic layer and / or an organic layer.

[0217] In one embodiment of the present disclosure, a first electrode (641) and a second electrode (642) may be disposed on a fourth insulating layer (640). The first electrode (641) and the second electrode (642) may include titanium (Ti), silver (Ag), a silver-containing alloy, molybdenum (Mo), a molybdenum-containing alloy, aluminum (Al), an aluminum-containing alloy, aluminum nitride (AlN), tungsten (W), tungsten nitride (WN), copper (Cu), indium tin oxide (ITO), indium zinc oxide (IZO), etc., but are not particularly limited thereto.

[0218] In one embodiment of the present disclosure, the second electrode (642) may be electrically connected to the transparent electrode (632) through a through hole penetrating the fourth insulating layer (640). However, the present disclosure is not limited thereto, and the second electrode (642) may be electrically connected to the transparent electrode (632) through a connecting electrode penetrating the fourth insulating layer (640).

[0219] In one embodiment of the present disclosure, the first electrode (641) may be an electrode constituting another light-receiving element included in the light-receiving layer (520) or another light-emitting element included in the light-emitting layer (530).

[0220] In one embodiment of the present disclosure, a fifth insulating layer (650) may be disposed on a fourth insulating layer (640). The fifth insulating layer (650) may cover the first electrode (641) and the second electrode (642). The fifth insulating layer (650) may have a single layer or a multilayer structure. The fifth insulating layer (650) may be an inorganic layer and / or an organic layer.

[0221] In one embodiment of the present disclosure, the illustration in FIG. 6 is an example of a cross-sectional view for explaining the positional relationship between the base layer (500), the circuit layer (510), and the light receiving layer (520). Of course, the cross-sectional view of each layer may vary depending on the configuration of the driving circuit included in the circuit layer (510) or the type of light receiving pixel included in the light receiving layer (520).

[0222] In addition, it goes without saying that a light-emitting layer (530) may be disposed on the light-receiving layer (520). A plurality of light-emitting pixels (531) included in the light-emitting layer (530) and a plurality of electrodes for driving the plurality of light-emitting pixels (531) may be disposed on the light-receiving layer (520).

[0223] FIG. 7 is a drawing for explaining the arrangement of a plurality of components included in a display device according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to components identical to those described in FIG. 5, and redundant descriptions are omitted.

[0224] Referring to FIGS. 5 and 7, in one embodiment of the present disclosure, a display device (110) may include a base layer (500), a circuit layer (510), a pixel layer (540), an optical adhesive layer (550), an optical layer (560), a lens layer (570), and a protective layer (580) that are sequentially stacked in a third direction (30).

[0225] In one embodiment of the present disclosure, the circuit layer (510) may include a plurality of transistors (511) for driving a plurality of light-receiving pixels (521) and a plurality of light-emitting pixels included in the pixel layer (540).

[0226] In one embodiment of the present disclosure, the pixel layer (540) may include a light receiving layer (520) and a light emitting layer (530). In this case, for convenience of explanation, in FIG. 7, two of the plurality of light receiving pixels (521) included in the light receiving layer (520) are shown, and the plurality of light emitting pixels included in the light emitting layer (530) are not shown. However, FIG. 7 is a cross-sectional view of a part of the display device (110) shown for explanation purposes, and it is obvious that the arrangement of the light receiving pixels and light emitting pixels included in the light receiving layer (520) and the light emitting layer (530) may vary.

[0227] Additionally, in one embodiment of the present disclosure, the display device (110) may include a light blocking film (700) disposed on an optical layer (560). The light blocking film (700) may be stacked in a third direction (30) with respect to the optical layer (560). The light blocking film (700) may be disposed on the top of the optical layer (560). In this case, the top of the optical layer (560) may refer to a surface adjacent to an object (590) in the third direction (30) with respect to the bottom of the optical layer (560).

[0228] In one embodiment of the present disclosure, the light blocking film (700) may include a plurality of first openings that overlap with a plurality of lenses included in the lens layer (570). In one embodiment of the present disclosure, each first opening may overlap with a corresponding lens. In one embodiment of the present disclosure, the first opening and the lens corresponding to the first opening may overlap in a third direction (30).

[0229] In one embodiment of the present disclosure, the light-receiving pixel corresponding to the lens in the third direction (30) and the first opening may overlap. The area that is not the opening of the light-receiving pixel and the light-blocking film (700) in the third direction (30) may not overlap.

[0230] However, although not illustrated in FIG. 7, the present disclosure is not limited thereto and the light blocking film (700) may further include a plurality of openings that overlap with a plurality of light-emitting pixels included in the pixel layer (540). Through this, light provided through the plurality of light-emitting pixels is not blocked by the light blocking film (700) and can be provided as an output image (111). Hereinafter, the light blocking film included in the display device (110) of the present invention may include a plurality of openings that overlap with a plurality of light-emitting pixels.

[0231] In one embodiment of the present disclosure, the width (591) of each of the plurality of first openings may be equal to the width of each lens. In this case, the width of the lens may refer to the diameter of the lens. However, the present disclosure is not limited thereto, and the width (591) of each opening may be smaller than the diameter of the corresponding lens.

[0232] In one embodiment of the present disclosure, the width of each of the plurality of light-receiving pixels (521) may be referred to as the pixel width (592). The width (591) may be larger than the pixel width (592).

[0233] The light-blocking film described in one embodiment of the present disclosure may be made of an optically opaque material. In one embodiment of the present disclosure, the light-blocking film may include a metal such as chromium (Cr), molybdenum (Mo), aluminum (Al), etc., or a resin including carbon black, etc. However, the present disclosure is not limited thereto, and the light-blocking film may include an inorganic material or an organic material having absorptive or reflective properties.

[0234] In one embodiment of the present disclosure, the light blocking film may be patterned through a photolithography process to block external light in areas other than specific apertures. In one embodiment of the present disclosure, the light blocking film may be referred to as a Black Matrix (BM).

[0235] In one embodiment of the present disclosure, light that has not passed through a plurality of lenses can be prevented from being provided to a plurality of light-receiving pixels (521) through a light blocking film (700). Specifically, among the light provided to the display device (110) from the outside, light that has passed through each lens can be provided to a light-receiving pixel corresponding to each lens through an optical layer (560). Light that has not passed through each lens can be prevented from being provided to a light-receiving pixel through an optical layer (560) through a light blocking film (700).

[0236] Through this, when the display device (110) acquires the sensing image (220), light of noise components that has not passed through the lens is provided to the light receiving pixel, thereby preventing image quality degradation such as crosstalk.

[0237] Meanwhile, in one embodiment of the present disclosure, the light blocking film may be disposed on the optical adhesive layer (550). Alternatively, in one embodiment of the present disclosure, the light blocking film may be provided in a plurality, some of the plurality of light blocking films may be disposed on the optical layer (560), and the remainder may be disposed on the optical adhesive layer (550). Alternatively, in one embodiment of the present disclosure, some of the plurality of light blocking films may be disposed inside the optical layer (560).

[0238] Alternatively, in one embodiment of the present disclosure, the circuit layer (510) may further include a plurality of metal wirings, wherein the metal wirings may be electrodes constituting a circuit element included in the circuit layer (510), or wirings electrically connected to a circuit element, or configurations formed by the same process as these. The metal wirings may be designed so as not to overlap with the light receiving pixels (521) in the third direction (30), and the metal wirings may prevent light of a noise component from being provided to the light receiving pixels (521). For example, openings that overlap with the light receiving pixels (521) in the third direction (30) may be formed in the metal wirings.

[0239] FIG. 8 is a flowchart illustrating the operation of generating an HDR image of an electronic device according to one embodiment of the present disclosure. FIG. 9 is a diagram illustrating the operation of an electronic device acquiring an HDR image according to one embodiment of the present disclosure.

[0240] Referring to FIG. 8, a method of operation of an electronic device (100) according to one embodiment of the present disclosure may include steps S810 and S820. In one embodiment of the present disclosure, steps S810 and S820 may be executed by at least one processor (130) included in the electronic device (100). The method of operation of the electronic device (100) is not limited to that shown in FIG. 8 and, in one or more embodiments, may further include steps not shown in FIG. 8.

[0241] In step S810 of FIG. 8, an electronic device (100) according to one embodiment of the present disclosure can obtain first light receiving signals sensed from the first group of light receiving pixels (321) and second light receiving signals sensed from the second group of light receiving pixels (322) by applying a first driving voltage (Vbias1) to the first group of light receiving pixels (321) among the plurality of light receiving pixels (320) and applying a second driving voltage (Vbias2) having a voltage value different from the first driving voltage (Vbias1) to the second group of light receiving pixels (322) among the plurality of light receiving pixels (320) (e.g., simultaneously).

[0242] Referring together with FIG. 9, in one embodiment of the present disclosure, a plurality of light-receiving pixels (320) may include a first group of light-receiving pixels (321) and a second group of light-receiving pixels (322). In sensing the surrounding environment at a given time, the first group of light-receiving pixels (321) may be light-receiving pixels to which a first driving voltage (Vbias1) is applied, and the second group of light-receiving pixels (322) may be light-receiving pixels to which a second driving voltage (Vbias2) different from the first driving voltage (Vbias1) is applied.

[0243] In one embodiment of the present disclosure, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged alternately in rows (or row units). Within the same row, the first group of light-receiving pixels (321) may be arranged continuously along the first direction (10) to form a first group of light-receiving pixel row, or the second group of light-receiving pixels (322) may be arranged continuously along the first direction (10) to form a second group of light-receiving pixel row. The first group of light-receiving pixel row and the second group of light-receiving pixel row may be arranged alternately along the second direction (20).

[0244] However, the arrangement of the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) is not limited to this. For example, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged repeatedly in various forms. Alternatively, for example, some of the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged intensively only in specific areas where sensing is required under specific sensitivity conditions.

[0245] In one embodiment of the present disclosure, the electronic device (100) may include a first voltage supply unit (921) that applies a first driving voltage (Vbias1) and a second voltage supply unit (922) that applies a second driving voltage (Vbias2). The first driving voltage (Vbias1) may be a variable voltage. For example, the first driving voltage (Vbias1) may be determined as a voltage value such that the first group of light-receiving pixels (321) can detect light under medium or high light conditions. The second driving voltage (Vbias2) may be a fixed voltage. For example, the second driving voltage (Vbias2) may be determined as a voltage value such that the second group of light-receiving pixels (322) can detect light under low light conditions. The magnitude (or absolute value) of the second driving voltage (Vbias2) may be greater than the magnitude (or absolute value) of the first driving voltage (Vbias1).

[0246] In one embodiment of the present disclosure, the display device (110) may include a plurality of voltage lines (911, 912) electrically connected to a plurality of light-receiving pixels (320). For example, the display device (110) may include a first voltage line (911) and a second voltage line (912). The first voltage line (911) may be electrically connected to a first group of light-receiving pixels (321). The second voltage line (912) may be electrically connected to a second group of light-receiving pixels (322). For convenience of explanation, FIG. 9 illustrates only the light-emitting pixels (311), light-receiving pixels (320), and voltage lines (911, 912) electrically connected to the light-receiving pixels (320) among the components of the display device (110).

[0247] In one embodiment of the present disclosure, the electronic device (100) may further include a voltage control circuit (930). The voltage control circuit (930) is electrically connected to voltage lines (911, 912) and can control the driving voltage applied to each voltage line.

[0248] In one embodiment of the present disclosure, the voltage control circuit (930) may include a first transistor (T1) and a second transistor (T2). The first transistor (T1) may be electrically connected between a second voltage supply (922) and a second voltage line (912). The second transistor (T2) may be electrically connected between a first node (N1) to which the first transistor (T1) and the second voltage line (912) are connected, and a second node (N2) to which the first voltage supply (921) and the first voltage line (911) are connected.

[0249] The first transistor (T1) may include a gate electrode that receives a gate signal, a first electrode connected to a second voltage supply (922) (or receiving a second driving voltage (Vbias2)), and a second electrode connected to a second voltage line (912). The first transistor (T1) may operate in an on state based on a gate signal of a first voltage level (e.g., high level) being applied to the gate electrode. The first transistor (T1) may operate in an off state based on a gate signal of a second voltage level (e.g., low level) being applied to the gate electrode. For example, the first transistor (T1) may be an n-type transistor.

[0250] The second transistor (T2) may include a gate electrode that receives a gate signal, a first electrode connected to a first node (N1) to which the second electrode of the first transistor (T1) and the second voltage line (912) are connected, and a second electrode connected to a second node (N2) to which the first voltage supply (921) and the first voltage line (911) are connected (or, receiving a first driving voltage (Vbias1)). The second transistor (T2) may operate in an off state based on a gate signal of a first voltage level (e.g., high level) being applied to the gate electrode. The second transistor (T2) may operate in an on state based on a gate signal of a second voltage level (e.g., low level) being applied to the gate electrode. For example, the second transistor (T2) may be a p-type transistor.

[0251] In one embodiment of the present disclosure, when a gate signal of a first voltage level (e.g., high level) is applied to the gate electrode of the first transistor (T1) and the gate electrode of the second transistor (T2), the first transistor (T1) may be turned on and the second transistor (T2) may be turned off. By turning on the first transistor (T1), the second voltage supply unit (922) and the second voltage line (912) may be electrically connected. By turning off the second transistor (T2), the first node (N1) and the second node (N2) may be electrically disconnected from each other. That is, the first voltage supply unit (921) and the second voltage line (912) may be electrically disconnected from each other. Accordingly, a first driving voltage (Vbias1) can be applied to the first voltage line (911) through the first voltage supply unit (921), and at the same time, a second driving voltage (Vbias2) can be applied to the second voltage line (912) through the second voltage supply unit (922). A first driving voltage (Vbias1) can be applied to the first group of light-receiving pixels (321) through the first voltage line (911), and at the same time, a second driving voltage (Vbias2) can be applied to the second group of light-receiving pixels (322) through the second voltage line (912).

[0252] The electronic device (100) can acquire first light receiving signals through a first group of light receiving pixels (321) to which a first driving voltage (Vbias1) is applied. The electronic device (100) can acquire second light receiving signals through a second group of light receiving pixels (322) to which a second driving voltage (Vbias2) is applied. In other words, the electronic device (100) can acquire first light receiving signals acquired under a first sensitivity condition corresponding to the first driving voltage (Vbias1) and second light receiving signals acquired under a second sensitivity condition corresponding to the second driving voltage (Vbias2). For example, the first sensitivity condition may be a low sensitivity condition for sensing a medium illuminance area or a low sensitivity condition for sensing a high illuminance area, and the second sensitivity condition may be a high sensitivity condition for sensing a low illuminance area.

[0253] Meanwhile, the configuration of the voltage control circuit (930) is not limited to this, and is not limited to any single circuit configuration as long as it is a circuit configuration capable of electrically connecting the first voltage supply unit (921) and the first voltage line (911) based on a specific input signal, and simultaneously electrically connecting the second voltage supply unit (922) and the second voltage line (912).

[0254] In step S820 of FIG. 8, an electronic device (100) according to one embodiment of the present disclosure can generate an HDR image based on the acquired first light receiving signals and second light receiving signals.

[0255] Referring together with FIG. 9, the electronic device (100) can generate first image data by digitizing and image processing first light reception signals obtained through the first group of light reception pixels (321). The electronic device (100) can generate second image data by digitizing and image processing second light reception signals obtained through the second group of light reception pixels (322). The first image data and the second image data may correspond to image data received under different sensitivity conditions (e.g., high sensitivity conditions for low-light sensing and low sensitivity conditions for medium / high-light sensing). That is, the electronic device (100) can obtain first image data and second image data in the same scene obtained under different sensitivity conditions by applying different driving voltages (e.g., simultaneously) to the first group of light reception pixels (321) and the second group of light reception pixels (322).

[0256] The electronic device (100) can generate an HDR image based on first image data and second image data. The electronic device (100) can generate an HDR image by aligning and fusing the first image data and second image data using an HDR synthesis algorithm. In one embodiment of the present disclosure, the HDR image may be an image generated based on first and second image data obtained under low sensitivity conditions for medium / high illumination sensing and high sensitivity conditions for low illumination sensing. Through this, the HDR image (220) can express a brightness range (e.g., a bright area and / or a dark area) that is difficult to express with image data obtained under a single sensitivity condition, thereby providing an extended dynamic range.

[0257] According to one embodiment of the present disclosure, an electronic device (100) can acquire a sensing image (220) in which a bright area and a dark area are simultaneously expressed with high precision through a plurality of light-receiving pixels (320) to which different driving voltages are applied. In addition, the electronic device (100) can acquire a sensing image (220) without ghosting even for a moving subject.

[0258] FIG. 10 is a graph showing the IV characteristic curve of a light-receiving pixel according to one embodiment of the present disclosure.

[0259] The graph (1010) of FIG. 10 is a graph showing the change in photocurrent (Iphoto) according to the applied driving voltage (Vapply) under different incident light irradiance conditions. In the graph (1010) of FIG. 10, the incident light irradiance conditions were set to 0 lx, 100 lx, 200 lx, 500 lx, and 1000 lx, and the applied driving voltage was set to a range of about -1V to 5V.

[0260] As illustrated in the graph (1010) of FIG. 10, the light-receiving pixel may exhibit variable light sensitivity characteristics in which the response characteristics of the photocurrent to the incident light illuminance vary depending on the applied driving voltage. It can be observed that the measured photocurrent tends to increase as the applied driving voltage increases under all illuminance conditions. Additionally, it can be observed that under conditions where the same driving voltage is applied, the measured photocurrent tends to increase as the incident light illuminance increases.

[0261] When a high driving voltage (e.g., 3.5V to 5V) is applied, the photocurrent exhibits a characteristic of increasing relatively significantly even in a low-light area (e.g., 0 lx to 100 lx). Accordingly, when a relatively high driving voltage is applied to a light-receiving pixel, a sufficient electrical signal is secured even for a low-light area corresponding to a relatively dark area, so that the dark area can be sensed relatively brightly. By applying a high driving voltage, the electronic device (100) senses the low-light area under high-sensitivity conditions, thereby mitigating the loss of detail in the dark area.

[0262] On the other hand, when a low driving voltage (e.g., 0V to 1.5V) is applied, the photocurrent growth rate in the medium / high brightness region (e.g., 500 lx to 1000 lx) is limited. Accordingly, when a relatively low driving voltage is applied to the light-receiving pixel, the slope of the photocurrent is maintained gently even in the medium / high brightness region corresponding to the relatively bright area, thereby forming a relatively low electrical signal, so that the bright area can be sensed as relatively dark. By applying a low driving voltage, the electronic device (100) senses the medium / high brightness region under low sensitivity conditions, thereby preventing signal saturation in the bright area and mitigating the loss of detail in the bright area.

[0263] FIG. 11 illustrates exemplary images obtained through a plurality of light-receiving pixels according to one embodiment of the present disclosure. FIG. 11 illustrates, for the same scene, a first image (1110) taken in a low-light environment, a second image (1120) taken in a high-light environment, and a third image (1130) corresponding to an HDR image.

[0264] Referring to FIG. 11, since the first image (1110) is captured in a low-light environment, the amount of light incident on each light-receiving pixel may be relatively small. Because the magnitude of the electrical signal generated at each light-receiving pixel is small, the difference in output between adjacent light-receiving pixels may not be sufficiently secured. Accordingly, information in the dark area within the same scene may be lost, and the first image (1110) in which the details of the dark area are not sufficiently reproduced may be output.

[0265] As the second image (1120) is captured in a high-illumination environment, the amount of light incident on each light-receiving pixel may be relatively large. As the electrical signal generated at each light-receiving pixel approaches or exceeds the maximum operating range, a saturation phenomenon may occur in which the output signal no longer increases even if the illumination increases. Consequently, information in the highlight area within the same scene is lost, and the second image (1120) in which the details of the highlight area are not sufficiently reproduced may be output.

[0266] The third image (1130) may be an image formed by applying a high driving voltage to the corresponding light-receiving pixel for the low-light area to reflect data sensed with high sensitivity, and applying a low driving voltage to the corresponding light-receiving pixel for the high-light area to reflect data sensed with low sensitivity. Accordingly, in the low-light area, details in the dark area can be secured by amplifying the output signal, and in the high-light area, details in the bright area can be secured by limiting the excessive increase of the output signal. Therefore, in the HDR image, by synthesizing the data received under different sensitivity conditions, it can be confirmed that the bright area and the dark area can be clearly expressed simultaneously.

[0267] FIG. 12 is a flowchart illustrating the operation of generating a high-resolution image of an electronic device according to one embodiment of the present disclosure. FIG. 13 is a diagram illustrating the operation of an electronic device acquiring a high-resolution image according to one embodiment of the present disclosure. In FIG. 13, the same reference numerals are assigned to components corresponding to those described in FIG. 9, and since their configuration and operation are substantially identical, a detailed description is omitted, and the description focuses on the differences.

[0268] Referring to FIG. 12, a method of operation of an electronic device (100) according to one embodiment of the present disclosure may further include steps S1210 and S1220. In one embodiment of the present disclosure, steps S1210 and S1220 may be executed by at least one processor (130) included in the electronic device (100). The method of operation of the electronic device (100) is not limited to that shown in FIG. 12, and in one or more embodiments, may further include steps not shown in FIG. 12.

[0269] In step S1210 of FIG. 12, an electronic device (100) according to one embodiment of the present disclosure can obtain third light receiving signals sensed from a plurality of light receiving pixels by applying a driving voltage of the same level to all of the plurality of light receiving pixels.

[0270] Referring together with FIG. 13, in one embodiment of the present disclosure, a plurality of light-receiving pixels (320) may include a first group of light-receiving pixels (321) and a second group of light-receiving pixels (322). The first group of light-receiving pixels (321) may be electrically connected to a first voltage line (911). The second group of light-receiving pixels (322) may be electrically connected to a second voltage line (912).

[0271] In one embodiment of the present disclosure, the electronic device (100) may further include a voltage control circuit (930). The voltage control circuit (930) is electrically connected to voltage lines (911, 912) and can control the driving voltage applied to each voltage line. Since the configuration of the voltage control circuit (930) has been described in detail with reference to FIG. 9, the description thereof will be omitted below.

[0272] In one embodiment of the present disclosure, when a gate signal of a second voltage level (e.g., low level) is applied to the gate electrode of the first transistor (T1) and the gate electrode of the second transistor (T2), the first transistor (T1) may be turned off and the second transistor (T2) may be turned on. By turning off the first transistor (T1), the second voltage supply unit (922) and the second voltage line (912) may be electrically disconnected from each other. By turning on the second transistor (T2), the first node (N1) and the second node (N2) may be electrically connected to each other. That is, the first voltage supply unit (921) and the second voltage line (912) may be electrically connected to each other. Accordingly, a first driving voltage (Vbias1) can be applied to the first voltage line (911) through the first voltage supply unit (921), and at the same time, a first driving voltage (Vbias1) can also be applied to the second voltage line (912) through the first voltage supply unit (921). A first driving voltage (Vbias1) can be applied to the first group of light-receiving pixels (321) through the first voltage line (911), and at the same time, a first driving voltage (Vbias1) can also be applied to the second group of light-receiving pixels (322) through the second voltage line (912). That is, a first driving voltage (Vbias1) of the same level can be applied to all light-receiving pixels (320). The first driving voltage (Vbias1) may be a variable voltage. For example, the first driving voltage (Vbias1) can be determined as a voltage value at which the first group of light-receiving pixels (321) can detect light under any one of low light conditions, medium light conditions, and high light conditions.

[0273] The electronic device (100) can acquire third light receiving signals through light receiving pixels (320) to which a first driving voltage (Vbias1) is applied. The electronic device (100) can acquire third light receiving signals acquired under sensitivity conditions corresponding to the first driving voltage (Vbias1). For example, the sensitivity condition corresponding to the first driving voltage (Vbias1) can be selected as any one of a low light condition, a medium light condition, and a high light condition. That is, by applying the same level of driving voltage to all light receiving pixels (320), the electronic device (100) can acquire light receiving signals acquired under the same sensitivity conditions from all light receiving pixels (320).

[0274] Meanwhile, the configuration of the voltage control circuit (930) is not limited to this, and is not limited to any single circuit configuration as long as it is a circuit configuration capable of electrically connecting the first voltage supply unit (921) and the first voltage line (911) based on a specific input signal and simultaneously electrically connecting the first voltage supply unit (921) and the second voltage line (912).

[0275] In step S1220 of FIG. 12, an electronic device (100) according to one embodiment of the present disclosure can generate a high-resolution image having a higher resolution than an HDR image based on the acquired third light receiving signals.

[0276] Referring together with FIG. 13, the electronic device (100) can generate third image data by digitizing and image processing third light reception signals obtained through all light reception pixels (320). The third image data may correspond to image data received under specific sensitivity conditions (e.g., low light, medium light, or high light). The electronic device (100) can obtain third image data in the same scene obtained under specific sensitivity conditions by simultaneously applying driving voltages of the same level to all light reception pixels (320).

[0277] According to one embodiment of the present disclosure, an electronic device (100) can electrically connect all light-receiving pixels (320) to the same voltage supply unit (e.g., a first voltage supply unit (921)) through a voltage control circuit (930) that controls the electrical connection between the light-receiving pixels (320) and the voltage supply units (921, 922). The electronic device (100) can acquire a sensing image expressed within a specific sensitivity condition through all light-receiving pixels (320) to which the same level of driving voltage is applied. In the present disclosure, the sensing image expressed within a specific sensitivity condition through all light-receiving pixels (320) may be referred to as a high-resolution image. The high-resolution image may be an image having a higher resolution compared to an HDR image based on first image data expressed within a first sensitivity condition through some of the light-receiving pixels (320) (e.g., first group light-receiving pixels (321)) and second image data expressed within a second sensitivity condition through other parts of the light-receiving pixels (e.g., second group light-receiving pixels (322)) by acquiring the same scene under a specific sensitivity condition through all light-receiving pixels (320).

[0278] In one embodiment of the present disclosure, an electronic device (100) may selectively generate an HDR image described with reference to FIGS. 8 and 9 or a high-resolution image described with reference to FIGS. 12 and 13 through a voltage control circuit (930) that controls the electrical connection between light receiving pixels (320) and voltage supply units (921, 922). In the present disclosure, the operation of the electronic device acquiring an HDR image may be defined as performing a "first mode," and the operation of the electronic device acquiring a high-resolution image may be defined as performing a "second mode."

[0279] In one embodiment of the present disclosure, the electronic device (100) may selectively operate a first mode or a second mode depending on the shooting environment. That is, the electronic device (100) may selectively generate an HDR image or a high-resolution image depending on the shooting environment. For example, the electronic device (100) may select a mode for image generation based on the illumination conditions of the shooting environment and / or the dynamic range of the scene. If the electronic device (100) has low contrast in the scene and sufficient gradation can be secured within a single exposure range, the electronic device (100) may operate in the first mode to generate a high-resolution image. On the other hand, if the difference between the bright and dark areas of the scene is large, the electronic device (100) may operate in the second mode to generate an HDR image with an extended dynamic range in which the bright and dark areas are simultaneously expressed with high precision. Since the electronic device (100) may selectively provide a first mode for generating an HDR image and a second mode for generating a high-resolution image, an image with optimal quality for the sensing environment can be obtained. Meanwhile, according to one embodiment of the present disclosure, the electronic device (100) may acquire light signals in a sensing environment through light receiving pixels before selecting an operation mode, and identify the illumination conditions of the sensing environment and / or the dynamic range of the scene.

[0280] Alternatively, in one embodiment of the present disclosure, the electronic device (100) may selectively operate a first mode or a second mode according to user selection. That is, the electronic device (100) may selectively generate an HDR image or a high-resolution image according to user selection. This will be explained in detail with reference to FIG. 14 below.

[0281] FIG. 14 is a flowchart for explaining the operation of an electronic device that applies a driving voltage to light-receiving pixels according to one embodiment of the present disclosure.

[0282] Referring to FIG. 14, a method of operation of an electronic device (100) according to one embodiment of the present disclosure may further include steps S1410 to S1430. In one embodiment of the present disclosure, steps S1410 to S1430 may be executed by at least one processor (130) included in the electronic device (100). Step S1420 may be a specific operation of step S810 of FIG. 8. Step S1430 may be a specific operation of step S1210 of FIG. 12.

[0283] In step S1410 of FIG. 14, an electronic device (100) according to one embodiment of the present disclosure may receive input from a user selecting a first mode or a second mode. The electronic device (100) may display a user interface through a display device (110) that allows selecting a mode for acquiring a sensing image. The electronic device (100) may receive input from a user selecting an execution mode for the sensing image through the user interface.

[0284] In step S1420 of FIG. 14, an electronic device (100) according to one embodiment of the present disclosure may apply a first driving voltage to a first group of light-receiving pixels and apply a second driving voltage to a second group of light-receiving pixels based on receiving input from a user selecting a first mode. That is, in step S1410, the electronic device (100) may perform step S1420 based on receiving input from a user selecting a first mode for acquiring an HDR image. That is, the electronic device (100) may perform a first mode in acquiring a sensing image. The sensing operation of step S1420 may be substantially the same as the operation described above in step S810. Subsequently, the electronic device (100) may perform step S820 to generate an HDR image based on first light-receiving signals acquired from the first group of light-receiving pixels and second light-receiving signals acquired from the second group of light-receiving pixels. As the operation for performing the first mode has been described in detail with reference to FIGS. 8 and FIGS. 9, a detailed description thereof will be omitted below.

[0285] In step S1430 of FIG. 14, the electronic device (100) according to one embodiment of the present disclosure may apply a driving voltage of the same level to all of the plurality of light-receiving pixels based on receiving a user input selecting a second mode. That is, in step S1410, the electronic device (100) may perform step S1430 based on receiving a user input selecting a second mode for acquiring a high-resolution image. That is, the electronic device (100) may perform the second mode in acquiring a sensing image. The sensing operation of step S1430 may be substantially the same as the operation described above in step S1210. Subsequently, the electronic device (100) may perform step S1220 to generate a high-resolution image based on the third light-receiving signals acquired from the light-receiving pixels. Since the operation for performing the second mode has been described in detail with reference to FIG. 12 and FIG. 13, a detailed description thereof will be omitted below.

[0286] FIG. 15 is a flowchart for explaining the operation of an electronic device for generating an HDR image according to one embodiment of the present disclosure. FIG. 16 is a diagram for explaining the operation of an electronic device for acquiring a plurality of light receiving signals through time division of each frame according to one embodiment of the present disclosure.

[0287] Referring to FIG. 15, the method of operation of an electronic device (100) according to one embodiment of the present disclosure may further include steps S1510 to S1540. In one embodiment of the present disclosure, steps S1510 to S1540 may be executed by at least one processor (130) included in the electronic device (100).

[0288] In one embodiment of the present disclosure, the electronic device (100) may generate an HDR image by referencing not only the first light receiving signals and the second light receiving signals obtained through a first mode operation, but also the third light receiving signals obtained through a second mode operation. This will be explained in detail with reference to FIGS. 15 and 16.

[0289] In step S1510 of FIG. 15, the electronic device (100) according to one embodiment of the present disclosure can acquire first image data based on first light reception signals and second image data based on second light reception signals by operating in a first mode in a first section of each frame. In step S1520 of FIG. 15, the electronic device (100) according to one embodiment of the present disclosure can acquire third image data based on third light reception signals by operating in a second mode in a second section of each frame.

[0290] Referring to FIG. 16, the 1 Frame (1 Frame) interval can be time-divided into a first mode sensing interval (t1) and a second mode sensing interval (t2).

[0291] During the first mode sensing period (t1), the electronic device (100) can supply a driving signal corresponding to the first mode to the voltage control circuit. For example, the voltage control circuit may correspond to the voltage control circuit (930) shown in FIG. 9. At this time, as shown in FIG. 9, during the first mode sensing period (T1), the electronic device (100) can supply a gate signal of a first voltage level (e.g., high level) to the gate electrode of the first transistor (T1) and the gate electrode of the second transistor (T2). Through the voltage control circuit (930), the electronic device (100) can electrically connect the first group of light-receiving pixels (321) to a first voltage supply unit (921) that provides a first driving voltage (Vbias1), and electrically connect the second group of light-receiving pixels (322) to a second voltage supply unit (922) that provides a second driving voltage (Vbias2).

[0292] Through this, during the first mode sensing period (t1), the electronic device (100) can apply a first driving voltage (Vbias1) to the first group of light-receiving pixels (321) among the plurality of light-receiving pixels (320) and apply a second driving voltage (Vbias2) having a voltage value different from the first driving voltage (Vbias1) to the second group of light-receiving pixels (322) among the plurality of light-receiving pixels (320) (e.g., simultaneously). During the first mode sensing period (t1), the sensing driver can acquire first light-receiving signals from the first group of light-receiving pixels (321) and acquire second light-receiving signals from the second group of light-receiving pixels (322). The electronic device (100) can generate first image data by digitizing and image processing the first light-receiving signals acquired through the first group of light-receiving pixels (321). The electronic device (100) can generate second image data by digitizing and image processing second light reception signals obtained through the second group of light reception pixels (322). The first image data and the second image data may correspond to image data received under different sensitivity conditions (e.g., high sensitivity conditions for low light sensing and low sensitivity conditions for medium / high light sensing).

[0293] During the second mode sensing period (t2), the electronic device (100) can supply a driving signal corresponding to the second mode to the voltage control circuit. For example, the voltage control circuit may correspond to the voltage control circuit (930) shown in FIG. 13. At this time, as shown in FIG. 13, during the second mode sensing period (t2), the electronic device (100) can supply a gate signal of a second voltage level (e.g., low level) to the gate electrode of the first transistor (T1) and the gate electrode of the second transistor (T2). Through the voltage control circuit (930), the electronic device (100) can electrically connect the first group of light-receiving pixels (321) to a first voltage supply unit (921) that provides a first driving voltage (Vbias1), and the second group of light-receiving pixels (322) can also be electrically connected to the first voltage supply unit (921) that provides a first driving voltage (Vbias1). The first driving voltage (Vbias1) applied in the second mode may be the same as or different from the first driving voltage (Vbias1) applied in the first mode.

[0294] Through this, during the second mode sensing period (t2), the electronic device (100) can apply a first driving voltage (Vbias1) of the same level to all light-receiving pixels (320). During the second mode sensing period (t2), the sensing driver can acquire third light-receiving signals from all light-receiving pixels (320). The electronic device (100) can generate third image data by digitizing and image processing the third light-receiving signals acquired through the light-receiving pixels (320). The third image data may correspond to image data received under specific sensitivity conditions (e.g., low light, medium light, or high light). The third image data acquired from all light-receiving pixels (320) may have a higher resolution compared to the first and second image data acquired from some light-receiving pixels, respectively.

[0295] In one embodiment of the present disclosure, a controller (301, see FIG. 3) may generate a synchronization signal (Tsync) that synchronizes the operation timing of a first mode and a second mode. By changing the synchronization signal (Tsync) in predetermined time units, the first mode sensing period (t1) and the second mode sensing period (t2) may be alternately changed. For example, in response to a synchronization signal (Tsync) of a high level voltage, the display device (110) may apply a first driving voltage (Vbias1) to the first group of light-receiving pixels (321) during the first mode sensing period (t1) and simultaneously apply a second driving voltage (Vbias2) to the second group of light-receiving pixels (322). In response to a synchronization signal (Tsync) of a low level voltage, the display device (110) may apply a first driving voltage (Vbias1) to all light-receiving pixels (320) during the second mode sensing period (t2).

[0296] In one embodiment of the present disclosure, after the electronic device (100) performs step S1520 of FIG. 15, the electronic device (100) may perform the operation of step S1531 of FIG. 15. In step S1531 of FIG. 15, the electronic device (100) may upscale the first image data and the second image data, respectively, by a factor of 2. By doing so, the resolution of the first image data and the second image data, respectively, may be matched to the resolution of the third image data.

[0297] For example, the electronic device (100) can expand the resolution of the first image data by a factor of 2 in the horizontal and vertical directions, respectively, thereby increasing the total number of pixels by a factor of 4. The electronic device (100) can expand the resolution of the second image data by a factor of 2 in the horizontal and vertical directions, respectively, thereby increasing the total number of pixels by a factor of 4. To fill the empty spaces of the expanded pixels, the electronic device (100) may use an interpolation algorithm (e.g., Neareast Neighbor Interpolation, Bilinear Interpolation) or a neural network-based super-resolution model.

[0298] Alternatively, in one embodiment of the present disclosure, after the electronic device (100) performs step S1520 of FIG. 15, the electronic device (100) may perform the operation of step S1532 of FIG. 15. In step S1532 of FIG. 15, the electronic device (100) may downscale the third image data by a 1 / 2x magnification. By doing so, the resolution of the third image data can be matched to the resolution of the first image data and the second image data, respectively.

[0299] For example, the electronic device (100) can reduce the resolution of the third image data by half in the horizontal and vertical directions, respectively, thereby reducing the total number of pixels by a quarter. To integrate multiple image data into one, the electronic device (100) may use filtering methods based on mean, weighted average, median, sub-sampling, and anti-aliasing filters.

[0300] The electronic device (100) can convert all first to third image data into image data of the same resolution through the operation of step S1531 of FIG. 15 or the operation of step S1532 of FIG. 15. Subsequently, in step S1532 of FIG. 15, the electronic device (100) can synthesize the first image data, the second image data, and the third image data to generate an HDR image.

[0301] If the electronic device (100) performs the operation of step S1531 of FIG. 15, it can synthesize the third image data with the upscaled first and second image data. Alternatively, if the electronic device (100) performs the operation of step S1532 of FIG. 15, it can synthesize the first and second image data with the downscaled third image data.

[0302] The electronic device (100) can generate an HDR image by aligning and fusing the first to third image data using various HDR synthesis algorithms. A detailed description of the various HDR synthesis algorithms will be provided later with reference to FIGS. 17 to 19.

[0303] According to one embodiment of the present disclosure, an electronic device (100) can simultaneously acquire a plurality of image data acquired under different sensitivity conditions and high-resolution image data acquired under a single sensitivity condition for a scene to be sensed. Through the plurality of image data acquired under different sensitivity conditions, the electronic device (100) can acquire a sensing image expressed with an extended dynamic range. Additionally, the electronic device (100) can acquire a high-resolution sensing image through the image data acquired under a single sensitivity condition. Accordingly, the electronic device (100) can acquire a sensing image expressed in high resolution, in which bright areas and dark areas are simultaneously expressed with high precision.

[0304] Hereinafter, various HDR synthesis algorithms will be described in detail with reference to FIGS. 17 to 19.

[0305] FIG. 17 is a flowchart for explaining the operation of an electronic device that generates an HDR image based on a plurality of light reception signals according to one embodiment of the present disclosure.

[0306] Referring to FIG. 17, a method of operation of an electronic device (100) according to one embodiment of the present disclosure may further include steps S1710 and S1720. In one embodiment of the present disclosure, steps S1710 and S1720 may be executed by at least one processor (130) included in the electronic device (100). Steps S1710 and S1720 may be a specific operation of step S1540 of FIG. 15.

[0307] In step S1710 of FIG. 17, an electronic device (100) according to one embodiment of the present disclosure may generate a radianca map based on first to third image data. For example, the electronic device (100) may estimate the relative exposure time of each light-receiving pixel based on the sensing conditions of each light-receiving pixel. The electronic device (100) may generate a radianca map based on the first to third image data and the estimated relative exposure time.

[0308] The electronic device (100) can obtain pixel brightness values ​​of a light-receiving pixel according to various VSS (Value Shutter Setting) values. VSS may be a parameter that indirectly determines the amount of charge accumulated in the light-receiving pixel and the pixel brightness by controlling exposure conditions. For example, VSS may include a driving voltage applied to the light-receiving pixel. Pixel brightness may be a brightness value representing the result of converting the tourmaline signal generated by the light-receiving pixel receiving light into a digital value. Based on the multiple obtained pixel brightness values, the electronic device may estimate the functional relationship between the VSS value and the pixel brightness (P) through regression analysis and generate a regression model of the form P = G(VSS).

[0309] Meanwhile, the pixel intensity of a light-receiving pixel has the characteristic of increasing in proportion to the exposure time. This is because the light-receiving pixel collects more light as the exposure time increases. Since the exposure time has a direct correlation with pixel intensity, the regression model G(VSS) can be applied equally to the estimation of the exposure time. Therefore, by substituting the correlation equation of the form P = G(VSS) to correspond to the exposure time (E), a regression model of the form E = G(VSS) can be defined. Through this, the electronic device (100) can estimate the exposure time corresponding to the scene capture from the set VSS value. At this time, the electronic device (100) may directly generate the regression model internally, or the electronic device (100) may receive a regression model generated by an external electronic device.

[0310] A radiance map may be data that numerically represents the physical amount of light (radiance) (or actual amount of light) incident on each light-receiving pixel in a scene to be sensed. A radiance map may be expressed as a function of exposure time. A radiance calculation function may be defined as F(E), and the physical amount of light can be calculated by subtracting the exposure time information reflected in the pixel brightness value through the radiance calculation function F(E). By substituting the regression model E = G(VSS) regarding exposure time into the radiance calculation function F(E), the radiance map can be calculated based on F(G(VSS)). That is, according to one embodiment of the present disclosure, an electronic device may generate a radiance map by estimating the exposure time from the VSS value and applying the said exposure time to the radiance calculation function to derive the radiance value of the sensed scene.

[0311] Meanwhile, the electronic device (100) can derive first to third radiance values ​​corresponding to first to third image data, respectively, at each pixel (or at the same location). At this time, the electronic device (100) can synthesize the first to third radiance values ​​to generate a single radiance value. As an example, the electronic device (100) can finally determine the single radiance value at the corresponding pixel by weighting the first to third radiance values ​​according to the reliability of the pixel brightness. At this time, a relatively low weight may be assigned to high pixel brightness values ​​or low pixel brightness values, and a relatively high weight may be assigned to medium pixel brightness values.

[0312] In step S1720 of FIG. 17, an electronic device (100) according to one embodiment of the present disclosure can perform tone mapping based on a radiance map.

[0313] For example, the electronic device (100) can convert the overall brightness distribution into a form suitable for LDR by applying a predefined tone mapping function (or a predefined operation rule) to each pixel of the radiance map to compress relatively high radiance values ​​and correct relatively low radiance values. Through this, the electronic device (100) can compress the radiance map to a range that the display can represent. Accordingly, the electronic device (100) can generate a final sensing image (i.e., an HDR image) by reflecting the radiance values ​​adjusted through tone mapping.

[0314] FIG. 18 is a flowchart for explaining the operation of an electronic device that generates an HDR image based on a plurality of light reception signals according to one embodiment of the present disclosure.

[0315] Referring to FIG. 18, a method of operation of an electronic device (100) according to one embodiment of the present disclosure may further include steps S1810 to S1840. In one embodiment of the present disclosure, steps S1810 to S1840 may be executed by at least one processor (130) included in the electronic device (100). Steps S1810 to S1840 may be a specific operation of step S1540 of FIG. 15.

[0316] An electronic device (100) according to one embodiment of the present disclosure can generate an HDR image by weighted fusion of first to third image data. At this time, the electronic device (100) can generate a weighted fusion map that places low weights on saturated pixels and dark pixels, and places weights on areas where details are clearly visible. In the present disclosure, a saturated pixel may refer to a pixel in which the pixel brightness value reaches the maximum charge amount and no additional change in light intensity is reflected. In the present disclosure, a dark pixel may refer to a pixel located in a range where the pixel brightness value is relatively small due to low illumination of the scene or a low exposure state of the light-receiving pixel. In the present disclosure, the weighted fusion map may be a map that includes weights assigned based on reliability to image data at the same location among a plurality of image data obtained under different illumination conditions.

[0317] In step S1810 of FIG. 18, an electronic device (100) according to one embodiment of the present disclosure may calculate a first weight based on contrast information. The first weight may also be referred to as a contrast weight. Contrast may be a value representing the degree of visual distinction determined by the difference in pixel brightness values ​​between adjacent pixels or between adjacent regions. Since a high contrast region is likely to be an area where details are clearly visible, the electronic device (100) may calculate a first weight that assigns a high weight to a high contrast region. The first weight (C) may be expressed by the following mathematical formula 1.

[0318]

[0319] Here, (x, y) represents the position of a pixel, j represents the j-th sensing scene, and ΔI may represent the pixel-specific contrast value. For example, the pixel-specific contrast value may be calculated by applying a high-frequency component extraction operation such as a first-order derivative-based Sobel filter or a second-order derivative-based Laplacian filter, but the embodiments are not limited thereto.

[0320] In step S1820 of FIG. 18, an electronic device (100) according to one embodiment of the present disclosure may calculate a second weight based on brightness information. The second weight may also be referred to as a brightness weight. Since details are likely to be well preserved at medium brightness, the electronic device (100) may calculate a second weight that can be given a higher weight as the pixel brightness value is closer to the medium value. The second weight (M) may be expressed by the following mathematical formula 2.

[0321]

[0322] The electronic device (100) may use a Gaussian function to calculate the second weight. For example, I j (x,y) can be pixel brightness values ​​normalized to [0, 1]. In this case, the second weight can be set to have a maximum weight at the median value of 0.5, and to decrease as it approaches 0 or 1.

[0323] In step S1830 of FIG. 18, an electronic device (100) according to one embodiment of the present disclosure may calculate a third weight based on local variance information. The third weight may also be referred to as a variance weight. Since a higher local variance in a local window is likely to be an area where details are clearly visible, the electronic device (100) may calculate a third weight that can place a high weight on a local window area with high local variance. The third weight (T) may be expressed by the following Equation 3.

[0324]

[0325] Here, Var(I j "in nxn window at (x,y))" can refer to the dispersion of pixel brightness values ​​within a local window of size nxn centered on the pixel at position (x,y).

[0326] In step S1840 of FIG. 18, an electronic device (100) according to one embodiment of the present disclosure can perform weighted fusion of first to third image data using first to third weights.

[0327] The electronic device (100) can generate a Weighted Fusion Map using the first to third weights. The Weighted Fusion Map may include a final weight value (W) expressed by the following mathematical formula 4.

[0328]

[0329] Here, C j (x,y) represents the first weight at position (x,y), and M j (x,y) represents the second weight at position (x,y), and T j(x,y) may represent a third weight at position (x,y). α may represent a first weight parameter for the first weight, β may represent a second weight parameter for the second weight, and γ may represent a third weight parameter for the third weight.

[0330] The electronic device (100) can weight-combine the first to third image data using the generated weighted combination map (i.e., the calculated final weight value (W)). The electronic device (100) can generate a final sensing image (i.e., an HDR image) based on the weighted-combined final image data.

[0331] FIG. 19 is a diagram illustrating the operation of an electronic device that generates an HDR image based on a plurality of light reception signals according to one embodiment of the present disclosure.

[0332] Referring to FIG. 19, a method of operation of an electronic device (100) according to one embodiment of the present disclosure may further include step S1910. In one embodiment of the present disclosure, step S1910 may be executed by at least one processor (130) included in the electronic device (100). Step S1910 may be a specific operation of step S1540 of FIG. 15.

[0333] In step S1910, an electronic device (100) according to one embodiment of the present disclosure can generate an HDR image (1920) based on first image data (1911), second image data (1912), and third image data (1913) using an artificial intelligence model (1900).

[0334] In one embodiment of the present disclosure, an electronic device (100) may input first image data (1911), second image data (1912), and third image data (1913) into an artificial intelligence model (1900). The electronic device (100) may input the first to third image data (1911, 1912, 1913) into the artificial intelligence model (1900) to obtain an HDR image (1920) output as an inference result. The artificial intelligence model (1900) may be a pre-trained model that receives the first to third image data (1911, 1912, 1913) and outputs an HDR image (1920) as an inference result.

[0335] In the present disclosure, functions related to 'Artificial Intelligence' may be operated through a processor and memory. The processor may be composed of one or more processors. In this case, the one or more processors may be general-purpose processors such as CPUs, APs, and DSPs (Digital Signal Processors), graphics-dedicated processors such as GPUs and VPUs (Vision Processing Units), or AI-dedicated processors such as NPUs. The one or more processors control the processing of input data according to predefined operation rules or AI models stored in memory. Alternatively, if the one or more processors are AI-dedicated processors, the AI-dedicated processors may be designed with a hardware structure specialized for processing a specific AI model.

[0336] In the present disclosure, a predefined rule of action or an artificial intelligence model is characterized by being created through learning. Here, being created through learning means that a predefined rule of action or an artificial intelligence model configured to perform a desired characteristic (or objective) is created by a basic artificial intelligence model being trained using a number of learning data by a learning algorithm. Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0337] In the present disclosure, an 'artificial intelligence model' may be composed of a plurality of neural network layers. Each of the plurality of neural network layers has a plurality of weight values ​​and performs neural network operations through operations between the results of operations of a previous layer and the plurality of weights. The plurality of weights possessed by the plurality of neural network layers may be optimized by the learning results of the artificial intelligence model. For example, the plurality of weights may be updated so that the loss value or cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. The artificial neural network model may include a Deep Neural Network (DNN), such as a Convolutional Neural Network, a Recurrent Neural Network, a Restricted Boltzmann Machine, a Deep Belief Network, a Bidirectional Recurrent Deep Neural Network, or Deep Q-Networks, but is not limited to the examples described above.

[0338] In one embodiment of the present disclosure, when pre-training an artificial intelligence model (1900), a captured image taken in an ideal lighting environment may be used as ground truth data. An ideal lighting environment may refer to an environment in which the illuminance of the area to be captured is located within a preset range such that no saturation or low-light noise occurs within the sensing range of the light-receiving pixels.

[0339] Additionally, for the prior training of the artificial intelligence model (1900), a first training image data corresponding to the first image data (1911), a second training image data corresponding to the second image data (1912), and a third training image data corresponding to the third image data (1913) may be used as training data. For example, the first training image data may be data sensed under an illuminance condition (e.g., medium / high illuminance condition) corresponding to the first driving voltage in the first mode. The second training image data may be data sensed under an illuminance condition (e.g., low illuminance condition) corresponding to the second driving voltage in the first mode. The third training image data may be data sensed under an illuminance condition corresponding to the first driving voltage in the second mode. As an example, the first training image data may be data sensed under a high illuminance condition, and the second and third training image data may be data sensed under a low illuminance condition.

[0340] The artificial intelligence model (1900) may be a model trained to receive first to third training image data as input and to output a captured image based on the received first to third training image data. During the training process, the error between the predicted image output by the artificial intelligence model (1900) and the captured image set as the correct answer data can be calculated through a loss function, and model parameters can be adjusted to minimize the value of the loss function while performing iterative training. Model parameters refer to internal variables that the model learns through training data. Model parameters are values ​​required for the model to perform predictions and may be factors that determine the performance of the model. Model parameters are automatically adjusted during the model training process, and optimized values ​​can be found by learning the patterns of the input training data. Subsequently, the gradient of the loss function can be calculated through a backpropagation algorithm, and the model parameters can be gradually updated using gradient descent or an optimization algorithm (such as Adam).

[0341] Through this, the artificial intelligence model (1900) can be configured to output an HDR image (1920) in which the bright area and the dark area are simultaneously expressed with high precision, by reducing saturation and low-light noise when multiple image data (1911, 1912, 1913) sensed under different illumination conditions are input.

[0342] FIG. 20 is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 9 and FIG. 13, and redundant descriptions are omitted.

[0343] Referring to FIG. 20, in one embodiment of the present disclosure, a plurality of light-receiving pixels (320) may include a first group of light-receiving pixels (321) and a second group of light-receiving pixels (322). In sensing the surrounding environment at a point in time in a first mode, the first group of light-receiving pixels (321) may be light-receiving pixels to which a first driving voltage (Vbias1) is applied, and the second group of light-receiving pixels (322) may be light-receiving pixels to which a second driving voltage (Vbias2) different from the first driving voltage (Vbias1) is applied.

[0344] In one embodiment of the present disclosure, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged alternately in columns (or in columns). Within the same column, the first group of light-receiving pixels (321) may be arranged continuously along the second direction (20) to form a first group of light-receiving pixel columns, or the second group of light-receiving pixels (322) may be arranged continuously along the second direction (20) to form a second group of light-receiving pixel columns. The first group of light-receiving pixel columns and the second group of light-receiving pixel columns may be arranged alternately along the first direction (10).

[0345] FIG. 21 is a drawing for explaining a display device and a voltage control circuit according to an embodiment of the present disclosure. Hereinafter, the same reference numerals are assigned to configurations identical to those described in FIG. 9 and FIG. 13, and redundant descriptions are omitted.

[0346] Referring to FIG. 21, in one embodiment of the present disclosure, a plurality of light-receiving pixels (320) may include a first group of light-receiving pixels (321) and a second group of light-receiving pixels (322). In sensing the surrounding environment at a point in time in a first mode, the first group of light-receiving pixels (321) may be light-receiving pixels to which a first driving voltage (Vbias1) is applied, and the second group of light-receiving pixels (322) may be light-receiving pixels to which a second driving voltage (Vbias2) different from the first driving voltage (Vbias1) is applied.

[0347] In one embodiment of the present disclosure, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged alternately in both rows (or row units) and columns (or column units). That is, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged in a grid shape. Within the same column, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged alternately with each other. Additionally, within the same row, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be arranged alternately with each other.

[0348] FIG. 22a is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure. FIG. 22b is a drawing for explaining a display device and a voltage control circuit according to one embodiment of the present disclosure.

[0349] Referring together to FIG. 22a and FIG. 22b, a display device (110) according to one embodiment of the present disclosure may include a plurality of light-receiving pixels (320c) and a voltage line (2210) electrically connected to the plurality of light-receiving pixels (320c). The light-receiving pixels (320c) may be arranged along a first direction (10) and a second direction (20). In this case, all of the light-receiving pixels (320c) may be electrically connected to the same voltage line (2210).

[0350] In one embodiment of the present disclosure, the electronic device (100) may include a first voltage supply unit (921) that applies a first driving voltage (Vbias1) and a second voltage supply unit (922) that applies a second driving voltage (Vbias2). The first driving voltage (Vbias1) may be a variable voltage. For example, the first driving voltage (Vbias1) may be determined as a voltage value such that the light-receiving pixels (320c) can detect light under medium or high illumination conditions. The second driving voltage (Vbias2) may be a fixed voltage. For example, the second driving voltage (Vbias2) may be determined as a voltage value such that the light-receiving pixels (320c) can detect light under low illumination conditions. The magnitude (or absolute value) of the second driving voltage (Vbias2) may be greater than the magnitude (or absolute value) of the first driving voltage (Vbias1). However, the embodiments are not limited thereto, and the first driving voltage (Vbias1) and the second driving voltage (Vbias2) may both be variable voltages or both may be fixed voltages.

[0351] In one embodiment of the present disclosure, the electronic device (100) may further include a voltage control circuit (2230). The voltage control circuit (2230) is electrically connected to a voltage line (2210) and can control a driving voltage applied to the voltage line (2210).

[0352] In one embodiment of the present disclosure, the voltage control circuit (2230) may include a first transistor (T1') and a second transistor (T2'). The first transistor (T1') may be electrically connected between a first voltage supply (921) and a voltage line (2210). The second transistor (T2') may be electrically connected between a second voltage supply (922) and a voltage line (2210).

[0353] The first transistor (T1') may include a gate electrode that receives a gate signal, a first electrode connected to a second voltage supply (922) (or receiving a second driving voltage (Vbias2)), and a second electrode connected to a voltage line (2210). The first transistor (T1') may operate in an off state based on a low-level gate signal being applied to the gate electrode. The first transistor (T1') may operate in an on state based on a high-level gate signal being applied to the gate electrode. For example, the first transistor (T1') may be an n-type transistor.

[0354] The second transistor (T2') may include a gate electrode that receives a gate signal, a first electrode connected to the first voltage supply (921) (or receiving the first driving voltage (Vbias1)), and a second electrode connected to the voltage line (2210). The second transistor (T2') may operate in an on state based on a low-level gate signal being applied to the gate electrode. The second transistor (T2') may operate in an off state based on a high-level gate signal being applied to the gate electrode. For example, the second transistor (T2') may be a p-type transistor.

[0355] In one embodiment of the present disclosure, the driving voltage applied to the light-receiving pixels (320c) can be controlled through time division of each frame. For example, one frame interval may be time-divided into a first sensitivity sensing interval (t1') and a second sensitivity sensing interval (t2'). The electronic device (100) may operate in a first sensitivity mode that performs sensing under a first sensitivity condition during the first sensitivity sensing interval (t1'), and the electronic device (100) may operate in a second sensitivity mode that performs sensing under a second sensitivity condition different from the first sensitivity condition during the second sensitivity sensing interval (t2').

[0356] During the first sensitivity sensing period (t1'), the electronic device (100) can supply a driving signal corresponding to the first sensitivity mode to the voltage control circuit (2230). For example, as shown in FIG. 22a, during the first sensitivity sensing period (t1'), a low-level gate signal can be supplied to the gate electrode of the first transistor (T1') and the gate electrode of the second transistor (T2'). Through this, the first transistor (T1') can be turned off and the second transistor (T2') can be turned on. By turning off the first transistor (T1'), the second voltage supply unit (922) and the voltage line (2210) can be electrically disconnected from each other. By turning on the second transistor (T2'), the first voltage supply unit (921) and the voltage line (2210) can be electrically connected to each other. Through this, a first driving voltage (Vbias1) can be applied to the light receiving pixels (320c). In the first sensitivity sensing interval (t1'), light can be detected under a sensitivity condition corresponding to the first driving voltage (Vbias1) (e.g., a low sensitivity condition for sensing a medium illuminance area or a high illuminance area).

[0357] During the second sensitivity sensing period (t2'), the electronic device (100) can supply a driving signal corresponding to the second sensitivity mode to the voltage control circuit (2230). For example, as shown in FIG. 22b, during the second sensitivity sensing period (t2'), a high-level gate signal can be supplied to the gate electrode of the first transistor (T1') and the gate electrode of the second transistor (T2'). Thus, as shown in FIG. 22b, when a high-level gate signal is applied to the gate electrode of the first transistor (T1') and the gate electrode of the second transistor (T2'), the first transistor (T1') can be turned on and the second transistor (T2') can be turned off. By turning on the first transistor (T1'), the second voltage supply unit (922) and the voltage line (2210) can be electrically connected to each other. By turning off the second transistor (T2'), the first voltage supply unit (921) and the voltage line (2210) can be electrically disconnected from each other. Through this, the second driving voltage (Vbias2) can be applied to the light receiving pixels (320c). In the second sensitivity sensing period (t2'), light can be detected under a sensitivity condition corresponding to the second driving voltage (Vbias2) (e.g., a high sensitivity condition for sensing a low-light area).

[0358] Meanwhile, the configuration of the voltage control circuit (2230) is not limited to this, and is not limited to any single circuit configuration as long as it is a circuit configuration capable of selectively electrically connecting the first voltage supply unit (921) or the second voltage supply unit (922) to the voltage line (2210) based on a specific input signal.

[0359] The electronic device (100) can acquire first light receiving signals acquired under a first sensitivity condition during a first sensitivity sensing interval (t1') in a frame interval, and can acquire second light receiving signals acquired under a second sensitivity condition during a second sensitivity sensing interval (t2'). The electronic device (100) can generate an HDR image based on the acquired first light receiving signals and second light receiving signals.

[0360] According to one embodiment of the present disclosure, an electronic device (100) can obtain a sensing image in which a bright area and a dark area are simultaneously expressed with high precision by applying different driving voltages to a plurality of light-receiving pixels (320c) through time division of each frame.

[0361] In order to solve the above-described technical problem, in one embodiment of the present disclosure, an electronic device (100) is provided.

[0362] In one embodiment of the present disclosure, the electronic device (100) may include a display device (110); a memory (120) in which a plurality of instructions are stored; and at least one processor (130) including a processing circuitry. In one embodiment of the present disclosure, the display device (110) may include a pixel layer (540) comprising a plurality of light-emitting pixels (311) and a plurality of light-receiving pixels (320); and a lens layer (570) disposed on top of the pixel layer (540) and comprising a plurality of lenses (330) corresponding to each of the plurality of light-receiving pixels (320). In one embodiment of the present disclosure, the plurality of light-receiving pixels (320) may include a first group of light-receiving pixels and a second group of light-receiving pixels.

[0363] In one embodiment of the present disclosure, an electronic device (100) can obtain first light receiving signals from the first group of light receiving pixels (321) and second light receiving signals from the second group of light receiving pixels (322) by having at least one processor (130) execute a plurality of instructions individually or collectively, thereby applying a first driving voltage to the first group of light receiving pixels (321) among the plurality of light receiving pixels (320) and applying a second driving voltage having a voltage value different from the first driving voltage to the second group of light receiving pixels (322) among the plurality of light receiving pixels (320). In one embodiment of the present disclosure, the electronic device (100) can generate an HDR image based on the obtained first light receiving signals and second light receiving signals by having at least one processor (130) execute a plurality of instructions individually or collectively.

[0364] In one embodiment of the present disclosure, an electronic device (100) can obtain third light receiving signals from a plurality of light receiving pixels (320) by applying the same level of driving voltage to all of the plurality of light receiving pixels (320) by having at least one processor (130) execute a plurality of instructions individually or in combination. In one embodiment of the present disclosure, an electronic device (100) can generate a high-resolution image having a higher resolution than the HDR image based on the obtained third light receiving signals by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0365] In one embodiment of the present disclosure, the electronic device (100) may apply the first driving voltage to the first group of light-receiving pixels (321) and apply the second driving voltage to the second group of light-receiving pixels (322) based on receiving a user input selecting a first mode by having at least one processor (130) execute a plurality of instructions individually or in combination. In one embodiment of the present disclosure, the electronic device (100) may apply the same level of driving voltage to all of the plurality of light-receiving pixels (320) based on receiving a user input selecting a second mode by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0366] In one embodiment of the present disclosure, the electronic device (100) may further include: a first voltage line (911) electrically connected to the first group of light-receiving pixels (321); a first voltage supply unit (921) providing the first driving voltage; a second voltage line (912) electrically connected to the second group of light-receiving pixels (322); and a second voltage supply unit (922) providing the second driving voltage. The first driving voltage may be characterized as being a variable voltage. The second driving voltage may be characterized as being a fixed voltage.

[0367] In one embodiment of the present disclosure, the electronic device (100) may further include: a first transistor (T1) electrically connected between the second voltage supply unit (922) and the second voltage line (912); and a second transistor (T2) electrically connected between a first node (N1) to which the first transistor (T1) and the second voltage line (912) are connected and a second node (N2) to which the first voltage supply unit (921) and the first voltage line (911) are connected. The first transistor (T1) may operate in an on state based on the application of a first voltage level and may operate in an off state based on the application of a second voltage level different from the first voltage level. The second transistor (T2) may operate in an off state based on the application of the first voltage level and may operate in an on state based on the application of the second voltage level.

[0368] In one embodiment of the present disclosure, the electronic device (100) may apply the first driving voltage to the first group of light-receiving pixels (321) through the first voltage line (911) and apply the second driving voltage to the second group of light-receiving pixels (322) through the second voltage line (912) by applying the first voltage level to each of the first transistor (T1) and the second transistor (T2) based on receiving input from a user selecting the first mode by executing a plurality of instructions individually or in combination by at least one processor (130).

[0369] In one embodiment of the present disclosure, the electronic device (100) may apply the first driving voltage to the first group of light-receiving pixels (321) through the first voltage line (911) and apply the first driving voltage to the second group of light-receiving pixels (322) through the second voltage line (912) by applying the second voltage level to each of the first transistor (T1) and the second transistor (T2) based on receiving input from a user selecting the second mode by executing a plurality of instructions individually or in combination by at least one processor (130).

[0370] In one embodiment of the present disclosure, an electronic device (100) can obtain first image data based on the first light receiving signals and second image data based on the second light receiving signals by having at least one processor (130) execute a plurality of instructions individually or in combination, thereby applying the first driving voltage to the first group of light receiving pixels (321) and applying the second driving voltage to the second group of light receiving pixels (322) in a first section of each frame. In one embodiment of the present disclosure, an electronic device (100) can obtain third image data based on the third light receiving signals by having at least one processor (130) execute a plurality of instructions individually or in combination, thereby applying the same level of driving voltage to all of the plurality of light receiving pixels (320) in a second section of each frame. In one embodiment of the present disclosure, an electronic device (100) can generate an HDR image based on the first image data, the second image data, and the third image data by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0371] In one embodiment of the present disclosure, the electronic device (100) can upscale the second image data and the third image data by a factor of 2 by having at least one processor (130) execute a plurality of instructions individually or in combination. In one embodiment of the present disclosure, the electronic device (100) can generate the HDR image by synthesizing the first image data, the upscaled second image data, and the upscaled third image data by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0372] In one embodiment of the present disclosure, the electronic device (100) can downscale the first image data by a factor of 0.5 by having at least one processor (130) execute a plurality of instructions individually or in combination. In one embodiment of the present disclosure, the electronic device (100) can generate the HDR image by synthesizing the second image data, the third image data, and the downscaled first image data by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0373] In one embodiment of the present disclosure, an electronic device (100) can generate a radiance map based on the first image data, the second image data, and the third image data by having at least one processor (130) execute a plurality of instructions individually or in combination. In one embodiment of the present disclosure, an electronic device (100) can generate the HDR image by having at least one processor (130) execute a plurality of instructions individually or in combination, thereby performing tone mapping based on the radiance map.

[0374] In one embodiment of the present disclosure, an electronic device (100) can generate the HDR image by weighted fusion of the first image data, the second image data, and the third image data using a final weight value calculated by reflecting a first weight based on contrast information, a second weight based on brightness information, and a third weight based on local variance information, by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0375] In one embodiment of the present disclosure, an electronic device (100) can generate the HDR image by inputting the first image data, the second image data, and the third image data to an artificial intelligence model (1900) by having at least one processor (130) execute a plurality of instructions individually or in combination.

[0376] In one embodiment of the present disclosure, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be characterized by being arranged alternately in rows (or rows) or columns (or columns).

[0377] In one embodiment of the present disclosure, the first group of light-receiving pixels (321) and the second group of light-receiving pixels (322) may be characterized by being arranged alternately in both rows (or row units) and columns (or column units).

[0378] In order to solve the above-described technical problem, in one embodiment of the present disclosure, a method of operating an electronic device (100) is provided.

[0379] In one embodiment of the present disclosure, the method of operation of an electronic device (100) may include the step (S810) of obtaining first light receiving signals from the first group of light receiving pixels and second light receiving signals from the second group of light receiving pixels by applying a first driving voltage to the first group of light receiving pixels and applying a second driving voltage having a voltage value different from the first driving voltage to the second group of light receiving pixels.

[0380] In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S820) of generating an HDR image based on the acquired first light receiving signals and second light receiving signals.

[0381] In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S1210) of obtaining third light receiving signals from the plurality of light receiving pixels by applying a driving voltage of the same level to all of the plurality of light receiving pixels. In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S1220) of generating a high-resolution image having a higher resolution than the HDR image based on the obtained third light receiving signals.

[0382] In one embodiment of the present disclosure, the step (S810) of obtaining the first light receiving signals and the second light receiving signals by applying the first driving voltage to the first group of light receiving pixels and applying the second driving voltage to the second group of light receiving pixels may include the step (S1420) of applying the first driving voltage to the first group of light receiving pixels and applying the second driving voltage to the second group of light receiving pixels based on receiving input from a user selecting a first mode.

[0383] In one embodiment of the present disclosure, the step (S1210) of acquiring the third light receiving signals by applying the same level of driving voltage to all of the plurality of light receiving pixels may include the step (S1430) of applying the same level of driving voltage to all of the plurality of light receiving pixels based on receiving input from a user selecting a second mode.

[0384] In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S1510) of obtaining first image data based on the first light receiving signals and second image data based on the second light receiving signals by applying the first driving voltage to the first group of light receiving pixels and applying the second driving voltage to the second group of light receiving pixels in a first section of each frame. In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S1520) of obtaining third image data based on the third light receiving signals by applying the same level of driving voltage to all of the plurality of light receiving pixels in a second section of each frame. In one embodiment of the present disclosure, the method of operation of the electronic device (100) may include the step (S1540) of generating an HDR image based on the first image data, the second image data, and the third image data.

[0385] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0386] According to one embodiment of the present disclosure, the methods according to the embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

Claims

1. In an electronic device (100), Display device (110); Memory (120) where multiple instructions are stored; and at least one processor (130) including processing circuitry; and The above display device (110) is, A pixel layer (540) comprising a plurality of light-emitting pixels (311) and a plurality of light-receiving pixels (320), including a first group of light-receiving pixels and a second group of light-receiving pixels; and A lens layer (570) disposed on the pixel layer (540) and comprising a plurality of lenses (330) corresponding to each of the plurality of light-receiving pixels (320); By having the above at least one processor (130) execute the plurality of instructions individually or collectively, the electronic device (100) By applying a first driving voltage to the first group of light-receiving pixels (321) and applying a second driving voltage having a voltage value different from the first driving voltage to the second group of light-receiving pixels (322), first light-receiving signals from the first group of light-receiving pixels (321) and second light-receiving signals from the second group of light-receiving pixels (322) are obtained, An electronic device (100) that generates an HDR image based on the first light receiving signals and the second light receiving signals obtained above.

2. In Paragraph 1, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) By applying the same level of driving voltage to all of the plurality of light-receiving pixels (320), third light-receiving signals are obtained from the plurality of light-receiving pixels (320), and An electronic device (100) that generates a high-resolution image having a higher resolution than the HDR image based on the third light reception signals obtained above.

3. In Paragraph 2, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) Based on receiving input from a user selecting a first mode, the first driving voltage is applied to the first group of light-receiving pixels (321), and the second driving voltage is applied to the second group of light-receiving pixels (322). An electronic device (100) that applies the same level of driving voltage to all of the plurality of light-receiving pixels (320) based on receiving input from a user selecting a second mode.

4. In any one of paragraphs 1 to 3, The above electronic device (100) is, A first voltage line (911) electrically connected to the first group of light-receiving pixels (321); A first voltage supply unit (921) that provides the first driving voltage; A second voltage line (912) electrically connected to the second group of light-receiving pixels (322); and It further includes a second voltage supply unit (922) that provides the second driving voltage; and An electronic device (100) in which the first driving voltage is a variable voltage and the second driving voltage is a fixed voltage.

5. In Paragraph 4, The above electronic device (100) is, A first transistor (T1) electrically connected between the second voltage supply unit (922) and the second voltage line (912); and It further includes a second transistor (T2) electrically connected between a first node (N1) to which the first transistor (T1) and the second voltage line (912) are connected, and a second node (N2) to which the first voltage supply unit (921) and the first voltage line (911) are connected. The first transistor (T1) operates in an on state based on the application of a first voltage level and operates in an off state based on the application of a second voltage level different from the first voltage level. The electronic device (100), wherein the second transistor (T2) operates in an off state based on the application of the first voltage level and operates in an on state based on the application of the second voltage level.

6. In Paragraph 5, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) Based on receiving input from a user selecting a first mode, the first voltage level is applied to each of the first transistor (T1) and the second transistor (T2), thereby applying the first driving voltage to the first group of light-receiving pixels (321) through the first voltage line (911), and applying the second driving voltage to the second group of light-receiving pixels (322) through the second voltage line (912). An electronic device (100) that, based on receiving input from a user selecting a second mode, applies the second voltage level to each of the first transistor (T1) and the second transistor (T2), thereby applying the first driving voltage to the first group of light-receiving pixels (321) through the first voltage line (911) and applying the first driving voltage to the second group of light-receiving pixels (322) through the second voltage line (912).

7. In any one of paragraphs 1 through 6, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) In the first section of each frame, the first driving voltage is applied to the first group of light-receiving pixels (321), and the second driving voltage is applied to the second group of light-receiving pixels (322), thereby obtaining first image data based on the first light-receiving signals and second image data based on the second light-receiving signals. In the second section of each frame, by applying the same level of driving voltage to all of the plurality of light-receiving pixels (320), third image data based on the third light-receiving signals is obtained, and An electronic device (100) that generates an HDR image based on the first image data, the second image data, and the third image data.

8. In Paragraph 7, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) Upscale each of the second image data and the third image data by a factor of 2, and An electronic device (100) that generates the HDR image by synthesizing the first image data, the upscaled second image data, and the upscaled third image data.

9. In Paragraph 7, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) The above first image data is downscaled by a magnification of 0.5 times, and An electronic device (100) that generates the HDR image by synthesizing the second image data, the third image data, and the downscaled first image data.

10. In any one of paragraphs 7 through 9, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) Based on the first image data, the second image data, and the third image data, a radiance map is generated, and An electronic device (100) that generates the HDR image by performing tone mapping based on the above radiance map.

11. In any one of paragraphs 7 through 9, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) An electronic device (100) that generates the HDR image by weighted fusion of the first image data, the second image data, and the third image data using a final weight value calculated by reflecting a first weight based on contrast information, a second weight based on brightness information, and a third weight based on local variance information.

12. In any one of paragraphs 7 through 9, By having at least one processor (130) execute the plurality of instructions individually or in combination, the electronic device (100) An electronic device (100) that generates the HDR image by inputting the first image data, the second image data, and the third image data into an artificial intelligence model (1900).

13. A method of operating an electronic device (100) including a display device, The above display device comprises: a pixel layer including a plurality of light-emitting pixels and a plurality of light-receiving pixels including a first group of light-receiving pixels and a second group of light-receiving pixels; and a lens layer disposed on top of the pixel layer and including a plurality of lenses corresponding to each of the plurality of light-receiving pixels. The above method of operation is, A step (S810) of obtaining first light reception signals from the first group of light reception pixels and second light reception signals from the second group of light reception pixels by applying a first driving voltage to the first group of light reception pixels and applying a second driving voltage having a voltage value different from the first driving voltage to the second group of light reception pixels; and A method of operation of an electronic device (100), comprising the step (S820) of generating an HDR image based on the first light receiving signals and the second light receiving signals obtained above.

14. In Paragraph 13, The above method of operation is, A step (S1210) of obtaining third light reception signals from the plurality of light reception pixels by applying a driving voltage of the same level to all of the plurality of light reception pixels; and A method of operation of an electronic device (100), further comprising the step (S1220) of generating a high-resolution image having a higher resolution than the HDR image based on the third light reception signals obtained above.

15. In any one of paragraphs 13 to 14, The above method of operation is, In a first section of each frame, a first driving voltage is applied to the first group of light-receiving pixels and a second driving voltage is applied to the second group of light-receiving pixels, thereby obtaining first image data based on the first light-receiving signals and second image data based on the second light-receiving signals (S1510); A step (S1520) of acquiring third image data based on the third light reception signals by applying the same level of driving voltage to all of the plurality of light reception pixels in the second section of each frame; and A method of operation of an electronic device (100), further comprising the step (S1540) of generating an HDR image based on the first image data, the second image data, and the third image data.

Images