Electronic device and driving method of electronic device

Abstract

An electronic device and a driving method of the electronic device are provided, the electronic device including a display panel including a first area in which a plurality of pixels are disposed and a second area having a transmittance higher than that of the first area, and an electronic module disposed under the display panel and overlapping the second area. The electronic module includes a camera module configured to image a subject to obtain a plurality of first images having a first resolution, an actuator configured to move the camera module while capturing each of the plurality of first images, and a processor configured to obtain a second image having a second resolution higher than the first resolution using the captured plurality of first images.

Description

[0001] This application claims priority to Korean Patent Application No. 10-2020-0114060, filed on September 7, 2020, the entire disclosure of which is incorporated herein by reference. Technical Field

[0002] This disclosure relates herein to electronic devices and methods for driving electronic devices, and more specifically, to electronic devices including under-panel cameras (UPC) and methods for driving electronic devices. Background Technology

[0003] Electronic devices such as smartphones or tablet PCs can include various electronic components, such as display panels, input detection devices for detecting external input, and electronic modules. These electronic components can be electrically connected to each other via signal lines arranged in various configurations. The display panel includes pixels for displaying images. The input detection device can include detection electrodes for detecting external input. The electronic module can include a camera, an infrared detection sensor, and a proximity sensor. When the electronic module is positioned under the display panel, the camera can be referred to as an under-panel camera (UPC). A UPC can be used to authenticate users, capture images, or record video. However, the quality of images captured by a UPC is generally lower than that of images captured by a rear-facing camera. Summary of the Invention

[0004] At least one embodiment of this disclosure provides an electronic device including a camera with improved image quality and a method for driving the electronic device.

[0005] Embodiments of the inventive concept provide an electronic device including a display panel and an electronic module. The display panel includes a first region having a plurality of pixels and a second region having a higher transmittance than the first region. The electronic module is disposed below the display panel and stacked on the second region. The electronic module includes a camera module, an actuator, and a processor. The camera module is configured to image an object to obtain a plurality of first images having a first resolution. The actuator is configured to move the camera module while capturing each of the plurality of first images. The processor is configured to use the captured plurality of first images to obtain a second image having a second resolution higher than the first resolution.

[0006] In one embodiment, the camera module includes: a lens configured to collect light emitted from an object; and an image sensor configured to acquire a plurality of first images using the collected light.

[0007] In one embodiment, the actuator controls the movement of the camera module, thereby capturing multiple first images at different locations.

[0008] In this embodiment, the processor obtains a second image from multiple first images using a super-resolution algorithm.

[0009] In one embodiment, the actuator controls the movement of the camera module within the second region.

[0010] In an embodiment, the second region includes a plurality of light-emitting regions in which pixels are arranged and a plurality of signal transmission regions respectively adjacent to the plurality of light-emitting regions.

[0011] In one embodiment, the camera module includes a pattern sensor configured to collect first pattern information about the layout pattern of a plurality of signal transmission areas.

[0012] In one embodiment, the processor determines second pattern information about the positional pattern of the actuator as it moves, based on first pattern information collected from the pattern sensor, and sends the second pattern information to the actuator.

[0013] In one embodiment, the actuator controls the movement of the camera module based on the second pattern information.

[0014] In one embodiment, the processor includes an actuator driving unit, an imaging unit, and a resolution processing unit. The actuator driving unit is configured to control the movement of an actuator to move the camera module. The imaging unit is configured to control the imaging operation of the camera module. The resolution processing unit is configured to generate a second image by converting multiple first images.

[0015] In one embodiment, the actuator driving unit controls the movement of the actuator based on pattern information about the layout pattern of the signal transmission area arranged in the second region.

[0016] In one embodiment, the processor receives transmittance information about the transmittance of a second region of the display panel and controls the camera module and actuators based on the received transmittance information.

[0017] In this embodiment, the transmittance of the second region is inversely proportional to the number of the plurality of first images.

[0018] In an embodiment of the inventive concept, an electronic device includes a display panel, an electronic module, and a processor. The display panel includes a first region in which a plurality of pixels are arranged, and a second region having a higher transmittance than the first region. The electronic module is disposed below the display panel and includes a camera module and an actuator. The camera module is stacked with the second region. The actuator is connected to the camera module. The processor is configured to control the operation of the electronic module. The processor includes an actuator driving unit, an imaging unit, and a resolution processing unit. The actuator driving unit is configured to instruct the actuator to move the camera module to multiple positions. The imaging unit is configured to issue imaging commands to the camera module, causing the camera module to acquire multiple first images having a first resolution at the multiple positions. The resolution processing unit is configured to use the multiple first images to generate a second image having a second resolution higher than the first resolution.

[0019] In this embodiment, multiple locations exist within the second region.

[0020] In an embodiment, the second region includes a plurality of light-emitting regions in which pixels are arranged and a plurality of signal transmission regions respectively adjacent to the plurality of light-emitting regions.

[0021] In an embodiment, the actuator driving unit determines the position pattern of the actuator to multiple locations based on the pattern information of the layout pattern of multiple signal transmission areas.

[0022] In one embodiment, the electronic module includes a processor.

[0023] In one embodiment, the electronic device further includes a control module configured to control the operation of the display panel and the electronic module, wherein the control module includes a processor.

[0024] In an embodiment of the inventive concept, a driving method for an electronic device includes the following steps: moving a camera module of the electronic module to multiple positions via an actuator of the electronic module; capturing multiple first images with different first resolutions at the multiple positions via the camera module during the movement; and obtaining a second image with a second resolution higher than the first resolution from the multiple first images via a processor. In this driving method, the electronic module is disposed below a display panel, the display panel including a first region and a second region, the first region including multiple pixels, the second region having a higher transmittance than the first region, the electronic module being superimposed on the second region, and the multiple positions being located within the second region.

[0025] An embodiment of the inventive concept provides an electronic device including a display panel, a processor, and an electronic module. The display panel includes a first region with a plurality of first pixels having a first density and a second region with a plurality of second pixels having a second density lower than the first density. The electronic module is disposed below the display panel and stacked with the second region. The electronic module includes a camera module and an actuator. The camera module is configured to acquire a plurality of first images having a first resolution, and the actuator is configured to move the camera module to different positions while simultaneously capturing the plurality of first images. The processor is configured to acquire a second image with a second resolution higher than the first resolution from the captured plurality of first images.

[0026] In an embodiment, the second region includes: a first sub-region with a first transmittance, the first sub-region including a second pixel; and a second sub-region with a second transmittance greater than the first transmittance, the second sub-region not including any pixels. Attached Figure Description

[0027] The accompanying drawings are included to provide a further understanding of the inventive concept, and are incorporated in and form a part of this specification. The drawings illustrate embodiments of the inventive concept and, together with the description, serve to explain the principles of the inventive concept. In the drawings:

[0028] Figure 1 This is a perspective view showing an electronic device according to an embodiment of the inventive concept;

[0029] Figure 2 This is an exploded perspective view showing an electronic device according to an embodiment of the inventive concept;

[0030] Figure 3 This is a block diagram illustrating an electronic device according to an embodiment of the inventive concept;

[0031] Figure 4A and Figure 4B This is a cross-sectional view showing a display device according to an embodiment of the inventive concept;

[0032] Figure 5 This is a plan view showing a display panel according to an embodiment of the inventive concept;

[0033] Figures 6A to 6D yes Figure 5 A magnified view of region XX';

[0034] Figure 7 It shows along Figure 5 A sectional view of the section cut by line I-I';

[0035] Figure 8 This is a block diagram illustrating an electronic module according to an embodiment of the inventive concept;

[0036] Figure 9 This is a block diagram illustrating a processor according to an embodiment of the inventive concept; and

[0037] Figure 10 This is a flowchart illustrating a driving method for an electronic device according to an embodiment of the inventive concept. Detailed Implementation

[0038] It will be understood that when an element (or region, layer, part, etc.) is referred to as being "on" another element, "connected to" or "bonded to" another element, the element may be directly on or directly connected to the other element, or a third element may be present between the element and the other element.

[0039] The same reference numerals refer to the same elements. In the drawings, for clarity, the thickness, proportions, and dimensions of elements may be exaggerated. As used herein, the term "and / or" includes any combination that may be defined by the associated elements.

[0040] The terms “first,” “second,” etc., may be used to describe various elements, but the elements should not be construed as being limited by the terms. Such terms are used only to distinguish one element from others. For example, without departing from the teachings of this disclosure, a first element may be referred to as a second element, and vice versa. Unless otherwise stated, singular terms may include plural forms.

[0041] Furthermore, terms such as "below," "under," "on," and "above" are used to describe the relationships between the elements shown in the accompanying drawings. These relative terms are used based on the directions shown in the drawings.

[0042] In the following, embodiments of the inventive concept will be described in detail with reference to the accompanying drawings.

[0043] Figure 1 This is a perspective view illustrating an electronic device according to an embodiment of the inventive concept, and Figure 2 This is an exploded perspective view showing an electronic device according to an embodiment of the inventive concept.

[0044] Reference Figure 1 and Figure 2The electronic device ED can be a device activated in response to an electrical signal. The electronic device ED can include various embodiments. For example, the electronic device ED can include not only large electronic devices such as televisions, monitors, or outdoor billboards, but also small and medium-sized electronic devices such as personal computers, tablets, laptops, personal digital assistants, vehicle navigation units, gaming systems, portable electronic devices, and cameras. These devices are merely examples, and therefore other electronic devices can be employed without departing from the inventive concept. In this embodiment, the electronic device ED is shown as a smartphone or mobile device.

[0045] The electronic device ED can display an image IM on a third direction DR3 on a display surface FS parallel to each of the first direction DR1 and the second direction DR2. The display surface FS on which the image IM is displayed can correspond to the front surface of the electronic device ED and can also correspond to the front surface FS of the window 100. Hereinafter, the display surface and front surface of the electronic device ED, as well as the front surface of the window 100, can be indicated by the same reference numerals. The image IM can include not only dynamic (or moving) images but also still (or static) images. A clock window and application icons are shown as... Figure 1 An example of an image IM.

[0046] In this embodiment, the front (or top) and rear (or bottom) surfaces of the component can be defined based on the direction of the displayed image IM. The front and rear surfaces can face each other on a third direction DR3, and the normal direction of each of the front and rear surfaces can be parallel to the third direction DR3. The third direction DR3 can intersect with the first direction DR1 and the second direction DR2. The first direction DR1, the second direction DR2, and the third direction DR3 can be perpendicular to each other.

[0047] Here, the surface defined by the first direction DR1 and the second direction DR2 can be defined as a plane, and the phrase "in a planar view" can be defined as the state viewed from the third direction DR3.

[0048] In this embodiment, the electronic device ED includes a window 100, a display device 200, a drive circuit unit 300, a housing 400, and an electronic module 500. In this embodiment, the window 100 and the housing 400 can be combined with each other to form the exterior of the electronic device ED.

[0049] Window 100 may include an optically transparent insulating material. For example, window 100 may include glass or plastic. Window 100 may have a multi-layered structure or a single-layered structure. For example, window 100 may include multiple plastic films bonded together by an adhesive, or it may include a glass substrate and a plastic film bonded together by an adhesive.

[0050] In the plan view, window 100 can be divided into a transmission region TA and a border region BZA. The transmission region TA can be an optically transparent region. Compared to the transmission region TA, the border region BZA can have a relatively low light transmittance. The border region BZA can define the shape of the transmission region TA. The border region BZA can be adjacent to and surround the transmission region TA.

[0051] The border area BZA may have a predetermined color. The border area BZA may cover the peripheral area NAA of the display device 200 to prevent the peripheral area NAA from being viewed from the outside. However, this is merely illustrative, and according to embodiments of the inventive concept, the border area BZA may be omitted from the window 100.

[0052] In an embodiment of the inventive concept, the sensing region SSA is superimposed on the electronic module 500. The electronic device ED can receive external signals required by the electronic module 500 via the sensing region SSA, or can provide signals output from the electronic module 500. According to an embodiment of the inventive concept, the sensing region SSA is superimposed on the transmission region TA. Therefore, the additional area providing the sensing region SSA outside the transmission region TA can be omitted. Therefore, the area of ​​the border region BZA can be reduced.

[0053] although Figure 1 and Figure 2 One sensing area SSA is shown, but embodiments of the inventive concept are not limited thereto. For example, at least two sensing areas SSA may be defined. Furthermore, although Figure 1 and Figure 2 The sensing area SSA is shown to be defined on the upper left side of the transmission area TA, but the sensing area SSA may be located in other areas (such as the upper right side of the transmission area TA, the central part of the transmission area TA, the lower left side of the transmission area TA, or the lower right side of the transmission area TA).

[0054] The display device 200 may be arranged below the window 100. The display device 200 may display an image IM. The display device 200 may include a front surface IS comprising an active area AA and a peripheral area NAA. The active area AA may be an area that is activated in response to an electrical signal. In an embodiment, the active area AA includes a plurality of pixels for displaying the image IM.

[0055] In this embodiment, the effective area AA can be the area where the image IM is displayed. The transmission area TA can be superimposed on the effective area AA. For example, the transmission area TA can be superimposed on the entire surface of the effective area AA or at least a portion thereof. Therefore, the user can view the image IM through the transmission area TA.

[0056] The peripheral area NAA can be the area covered by the border area BZA. The peripheral area NAA can be adjacent to the active area AA. The peripheral area NAA can surround the active area AA. The drive circuitry or drive wiring used to drive the active area AA can be arranged in the peripheral area NAA.

[0057] In this embodiment, the display device 200 is assembled in a flat state where the effective area AA and the peripheral area NAA face the window 100. However, this is merely illustrative, and a portion of the peripheral area NAA may be bent. Here, a portion of the peripheral area NAA may face the rear surface of the electronic device ED, thereby reducing the area occupied by the bezel area BZA on the front surface of the electronic device ED. Alternatively, the display device 200 may be assembled in a state where a portion of the effective area AA is bent. Alternatively, in the display device 200 according to the embodiment of the inventive concept, the peripheral area NAA is omitted.

[0058] The driving circuit unit 300 can be electrically connected to the display device 200. The driving circuit unit 300 may include a main circuit board MB and a flexible film CF.

[0059] The flexible film CF can be electrically connected to the display device 200. The flexible film CF can connect to pads (also referred to as solder pads) arranged in the peripheral area NAA of the display device 200. The flexible film CF can provide electrical signals to the display device 200 for driving the display device 200. These electrical signals can be generated in the flexible film CF or in the main circuit board MB. The main circuit board MB may include various drive circuits for driving the display device 200 or connectors for supplying power.

[0060] In embodiments of the inventive concept, the area of ​​the display device 200 corresponding to the sensing area SSA has relatively high transmittance compared to the effective area AA which is not superimposed on the sensing area SSA. For example, at least a portion of the elements of the display device 200 can be removed. Therefore, the electronic module 500 can easily transmit and / or receive signals via the sensing area SSA.

[0061] In one embodiment, the electronic module 500 is disposed below the display device 200. In another embodiment, the electronic module 500 is disposed below the display panel of the display device 200. The electronic module 500 may be superimposed on the sensing area SSA in a plan view. The electronic module 500 may receive external input transmitted through the sensing area SSA, or may provide output through the sensing area SSA. In one embodiment, the electronic module 500 includes a camera module (e.g., circuitry) and associated electronic components. The camera module may include a camera and various sensors, such as infrared detection sensors and proximity sensors.

[0062] The housing 400 can be integrated with the window 100. The housing 400 can provide interior space by integrating with the window 100. The display device 200 and the electronic module 500 can be accommodated within the interior space.

[0063] The housing 400 may comprise a material with relatively high rigidity. For example, the housing 400 may comprise glass, plastic, or metal, or may comprise multiple frames and / or plates constructed by combining them. The housing 400 can stably protect the components of the electronic device ED housed within the internal space from external impacts.

[0064] Figure 3 This is a block diagram illustrating an electronic device according to an embodiment of the inventive concept.

[0065] Reference Figure 3 The electronic device ED includes a display device 200, a power module PM (e.g., a power supply), a first electronic module EM1 (e.g., a first electronic circuit), and a second electronic module EM2 (e.g., a second electronic circuit). The display device 200, the power module PM, the first electronic module EM1, and the second electronic module EM2 can be electrically connected to each other.

[0066] The display device 200 may include a display panel 210 and an input detection unit 220 (e.g., an input detection circuit or an input detection device).

[0067] The display panel 210 can essentially generate an image IM. The image IM generated by the display panel 210 is displayed on the front surface IS and is viewed externally by the user through the transmissive region TA.

[0068] Input detection unit 220 detects externally applied external input TC (see...) Figure 1 For example, the input detection unit 220 can detect external input TC provided from window 100. External input TC can be user input. User input includes various types of external input, such as a part of the user's body, light, heat, pen, or pressure.

[0069] In this embodiment, the external input TC is shown as a user's hand applied to the front surface FS. However, this is merely illustrative, and the external input TC can be provided in various forms as described above, and depending on the structure of the electronic device ED, the external input TC can be applied to the side or rear surface of the electronic device ED, and is not limited to a particular embodiment.

[0070] The power module (PM) supplies the power required for the overall operation of the electronic device (ED). The power module (PM) may include a battery module.

[0071] The first electronic module EM1 and the second electronic module EM2 may include various functional modules for operating the electronic device ED.

[0072] The first electronic module EM1 can be directly mounted on a motherboard electrically connected to the display device 200, or it can be mounted on a separate board and electrically connected to the motherboard via a connector (not shown). In this embodiment, the motherboard is the main circuit board MB.

[0073] In an embodiment, the first electronic module EM1 includes a control module CM (e.g., control circuitry), a wireless communication module TM (e.g., transceiver), an image input module IIM, an audio input module AIM, a memory MM, and an external interface IF (e.g., interface circuitry). Some of these modules can be electrically connected to the motherboard via a flexible circuit board, without being mounted on the motherboard.

[0074] The control module CM controls the overall operation of the electronic device ED. The control module CM can be a microprocessor. For example, the control module CM enables or disables the display device 200. The control module CM can control other modules such as the image input module IIM or the audio input module AIM based on touch signals received from the display device 200.

[0075] The control module CM may be a microprocessor connected to the electronic module 500 to control the operation of the electronic module 500. In an embodiment, the control module CM may control the overall operation of the electronic module 500. The control module CM may include a processor that controls the electronic module 500. For example, the control module CM may execute algorithms for converting and reproducing images captured by the electronic module 500.

[0076] The wireless communication module TM can send / receive wireless signals to / from another terminal using Bluetooth or WiFi lines. The wireless communication module TM can also send / receive voice signals using ordinary communication lines. The wireless communication module TM may include a transmitting unit TM1 (e.g., a transmitter) for modulating and transmitting the signal to be transmitted, and a receiving unit TM2 (e.g., a receiver) for demodulating the received signal.

[0077] The image input module IIM processes image signals to convert them into image data that can be displayed on the display device 200. The audio input module AIM receives external audio signals via a microphone in recording mode or voice recognition mode and converts the external audio signals into electronic voice data. In an exemplary embodiment, the audio input module AIM includes a digital signal processor and / or an analog-to-digital converter for converting analog audio signals into digital voice data.

[0078] The external interface IF can be used as an interface to connect to an external charger, wired / wireless data port, or card slot (e.g., a card slot for memory cards, SIM / UIM cards, etc.).

[0079] According to an embodiment of the inventive concept, the second electronic module EM2 includes an audio output module AOM, a light-emitting module LM, a light-receiving module LRM, and an electronic module 500. These components can be directly mounted on a motherboard, or mounted on a separate board and electrically connected to the display device 200 via a connector (not shown), or electrically connected to the first electronic module EM1.

[0080] In one embodiment, the audio output module AOM converts audio data received from the wireless communication module TM or audio data stored in the memory MM, and outputs the converted audio data. In another embodiment, the audio output module AOM includes a digital signal processor and / or a digital-to-analog converter that converts digital audio data into analog audio signals for output.

[0081] A light-emitting module (LM) generates and outputs light. The LM can output infrared light. The LM may include a light source or element such as at least one light-emitting diode (LED). A light-receiving module (LRM) can detect the infrared light. The LRM can be activated when at least a predetermined level of infrared light is detected. The LRM may include a complementary metal-oxide-semiconductor (CMOS) sensor. After outputting the infrared light generated by the LM, the infrared light can be reflected from an external object (e.g., a user's finger or face) and can be incident on the LRM. An electronic module 500 can capture external images.

[0082] An electronic module 500 according to an embodiment of the inventive concept may be included in at least one of a first electronic module EM1 and a second electronic module EM2. For example, electronic module 500 may be included in the second electronic module EM2 along with an audio output module AOM, a light emission module LM, and a light receiving module LRM. Electronic module 500 may detect external objects received through a sensing area SSA, or may provide sound signals such as speech or light such as infrared light outward through the sensing area SSA. Electronic module 500 may include a camera module or actuator for capturing images of external objects. Electronic module 500 will be described in more detail below. In embodiments, the actuator is a component of a machine responsible for moving the mechanism. For example, the actuator may be an electric actuator and may include one or more electromechanical actuators or linear motors.

[0083] Figure 4A and Figure 4B This is a cross-sectional view showing a display device according to an embodiment of the inventive concept.

[0084] Figure 4A This is a cross-sectional view showing a display device according to an embodiment.

[0085] Reference Figure 4AThe display device 200 includes a display panel 210 and an input detection unit 220. The display panel 210 includes a substrate BL, a circuit element layer ML, a light-emitting element layer EML, and a thin-film encapsulation layer TFE. The input detection unit 220 includes the substrate TFE and a detection circuit layer ML-T. The thin-film encapsulation layer TFE and the substrate TFE can be the same element.

[0086] According to an embodiment of the inventive concept, the display panel 210 and the input detection unit 220 are formed through a continuous process. That is, the detection circuit layer ML-T can be directly formed on the thin-film encapsulation layer TFE (or the substrate layer TFE). For example, the detection circuit layer ML-T can directly contact the thin-film encapsulation layer TFE.

[0087] The substrate BL can be a silicon substrate, a plastic substrate, a glass substrate, an insulating film, or a stacked structure including multiple insulating layers.

[0088] The circuit element layer ML can be disposed on the substrate BL. The circuit element layer ML may include multiple insulating layers, multiple conductive layers, and semiconductor layers. The multiple conductive layers of the circuit element layer ML can form the signal lines or control circuits of a pixel.

[0089] The light-emitting element layer (EML) can be disposed on the circuit element layer (ML). The EML may include a light-emitting layer that generates light. For example, the light-emitting layer of an organic light-emitting display panel may include an organic light-emitting material. The light-emitting layer of a quantum dot light-emitting display panel may include at least one of quantum dots and quantum rods.

[0090] The detection circuit layer ML-T can be disposed on the substrate BL. For example, the detection circuit layer ML-T can be stacked with the substrate BL. The detection circuit layer ML-T may include multiple insulating layers and multiple conductive layers. The multiple conductive layers can form detection electrodes for detecting external input, detection lines connected to the detection electrodes, and detection pads connected to the detection lines.

[0091] Figure 4B This is a cross-sectional view showing a display device according to an embodiment. (Referring above) Figure 4A The described elements are in Figure 4B The same reference numerals are used to denote the same figures.

[0092] Reference Figure 4B The display device 200-1 includes a display panel 210-1 and an input detection unit 220-1 (e.g., an input detection circuit). In an embodiment, Figure 2 , Figure 3 or Figure 4AThe display device 200 is implemented by the display device 200-1. In an embodiment, the display panel 210-1 includes a substrate BL, a circuit element layer ML, and a light-emitting element layer EML. In an embodiment, the input detection unit 220-1 includes a cover substrate CBL and a detection circuit layer ML-T.

[0093] The cap substrate CBL can be disposed on the light-emitting element layer EML. For example, the cap substrate CBL can be stacked with the light-emitting element layer EML. The cap substrate CBL can be a silicon substrate, a plastic substrate, a glass substrate, an insulating film, or a laminated structure including multiple insulating layers. A predetermined space can be defined between the cap substrate CBL and the light-emitting element layer EML. The space can be filled with air or an inert gas. Furthermore, in embodiments of the inventive concept, the space can be filled with a filler, such as a silicone polymer, an epoxy resin, or an acrylamide resin.

[0094] A bonding member SLM can be disposed between the substrate BL and the cap substrate CBL. The bonding member SLM can bond the substrate BL and the cap substrate CBL together. The bonding member SLM can include organic materials such as photocurable resins or photoplastic resins, or inorganic materials such as glass frit sealants, but is not limited thereto. In an embodiment, the bonding member SLM includes a pair of struts or pillars spaced apart from each other and supporting the cap substrate CBL. In an embodiment, the struts are substantially the same height.

[0095] Figure 5 This is a plan view showing a display panel according to an embodiment of the inventive concept.

[0096] Reference Figure 5 The effective area AA of the display panel 210 can correspond to the display device 200 (see...). Figure 2 The effective area AA (see) Figure 2 ).

[0097] Multiple pixels (PX) can be arranged within the effective area AA. Multiple pixels (PX) can be arranged along a first direction DR1 and a second direction DR2. Each of the multiple pixels (PX) can display one of the primary colors or one of the mixed colors. Primary colors can include red, green, and blue. Mixed colors can include various colors such as yellow, cyan, magenta, etc. However, the colors displayed by the pixel (PX) are not limited to these.

[0098] The first region DA1 and the second region DA2 can be confined to the valid region AA.

[0099] In an embodiment, electronic module 500 (see...) Figure 2The first region DA1 is arranged below the second region DA2. The first region DA1 has a first transmittance, and the second region DA2 has a second transmittance. In an embodiment, the second transmittance is higher than the first transmittance. Therefore, signals can be easily transmitted through the second region DA2 to the electronic module 500 (see...). Figure 2 ) and / or electronic module 500 (see Figure 2 (Received.) A portion of the elements in the second region DA2 can be omitted to increase transmittance. For example, a portion of the pixels PX arranged in the second region DA2 can be removed.

[0100] In the plan view, the second region DA2 can be compared with the sensing region SSA (see...). Figure 2 ) superimposed. In an embodiment, the second region DA2 has a larger area than the sensing region SSA (see Figure 2 (The area of ​​the larger area)

[0101] In this embodiment, the first region DA1 and the second region DA2 are defined within the effective region AA. The second region DA2 can be defined within the sensing region SSA (see...). Figure 2 The location of the second region DA2 corresponds to that of the multiple sensing regions SSA. Although only one second region DA2 is shown in the attached figure, multiple second regions DA2 can be set with multiple sensing regions SSA (see [reference]) when multiple sensing regions SSA are set in different locations. Figure 2 The corresponding settings are as follows. The second region DA2 can be surrounded by the first region DA1.

[0102] Figures 6A to 6D yes Figure 5 An enlarged view of region XX' surrounding the second region DA2.

[0103] Figure 6A and Figure 6C This is a magnified view of region XX'. Figure 6B and Figure 6D yes Figure 6A A magnified view of a portion of the second region DA2. (See reference...) Figure 5 The following description is provided.

[0104] Figure 6A and Figure 6C This is an enlarged view of the first region DA1 and the second region DA2, which are defined within the display panel 210. Figure 6A In the diagram, the first region DA1 and the second region DA2 each include multiple light-emitting regions EA. Each of the light-emitting regions EA may include multiple pixels PX.

[0105] In an embodiment, the second region DA2 includes a plurality of signal transmission regions STA. The signal transmission regions STA can be arranged adjacent to a plurality of light-emitting regions EA. The light-emitting regions EA within the second region DA2 can be referred to as a first sub-region of the second region DA2, and the signal transmission regions STA within the second region DA2 can be referred to as a second sub-region of the second region DA2. In an embodiment, the signal transmission regions STA correspond to regions having a higher transmittance than the light-emitting regions EA. For example, in the second region DA2, the signal transmission regions STA can be regions where no pixels PX are disposed, and the light-emitting regions EA can be regions where pixels PX are disposed.

[0106] Figure 6A and Figure 6C The second regions DA2 and DA2a, which include multiple signal transmission areas STA arranged in different patterns, are shown respectively. Figure 6A and Figure 6C The number of signal transmission areas (STAs) shown is illustrative only, and the number of signal transmission areas (STAs) is not limited to this. For example, arranged in Figure 6A The number of signal transmission areas STA in the second region DA2 can be equal to the number of areas arranged in the second region DA2. Figure 6C The number of signal transmission areas (STAs) in the second region DA2a. Refer to the layout pattern of the signal transmission areas (STAs) for details. Figure 6B and Figure 6D .

[0107] Reference Figure 6B and Figure 6D The luminescent region EA may include multiple sub-luminescent regions SA1 to SA4. Although the figures show a luminescent region EA as including four sub-luminescent regions comprising a first sub-luminescent region SA1, a second sub-luminescent region SA2, a third sub-luminescent region SA3, and a fourth sub-luminescent region SA4, the number of sub-luminescent regions according to the embodiments may be greater than or less than four.

[0108] Each of the sub-light-emitting regions SA1 to SA4 may include at least one of a first color light-emitting region, a second color light-emitting region, and a third color light-emitting region. Here, the first color light-emitting region may correspond to a region emitting red light, the second color light-emitting region may correspond to a region emitting green light, and the third color light-emitting region may correspond to a region emitting blue light. In an embodiment, each of the light-emitting regions EA may include at least one first color light-emitting region, two second color light-emitting regions, and one third color light-emitting region. For example, two of the first sub-light-emitting regions SA1 to the fourth sub-light-emitting regions SA4 may each include one first color light-emitting region and one second color light-emitting region, and the other two of the first sub-light-emitting regions SA1 to the fourth sub-light-emitting regions SA4 may each include one second color light-emitting region and one third color light-emitting region. The first sub-light-emitting regions SA1 to the fourth sub-light-emitting regions SA4 may be freely arranged in each of the light-emitting regions EA.

[0109] In one embodiment, the transmittance of the light-emitting region EA included in the second region DA2 is higher than that of the light-emitting region EA included in the first region DA1. In another embodiment, the density of sub-light-emitting regions included in the light-emitting region EA in the first region DA1 is higher than the density of sub-light-emitting regions included in the light-emitting region EA in the second region DA2.

[0110] exist Figure 6B In the second region DA2, the signal transmission region STA and the light emission region EA can be arranged in a first pattern PP1. The signal transmission region STA and the light emission region EA can be arranged alternately in the first direction DR1 and the second direction DR2. In the second region DA2, the number of signal transmission regions STA and the number of light emission regions EA can be substantially equal.

[0111] The signal transmission area STA arranged in the second area DA2 can have various layout patterns. Figure 6B A first pattern PP1 is shown among a layout pattern of multiple signal transmission areas STA. According to an embodiment, multiple first patterns PP1 can be repeatedly defined in a second region DA2 of the display panel 210. The first pattern PP1 may include multiple signal transmission areas STA. For example, the first pattern PP1 may include a first signal transmission area STA1 and a second signal transmission area STA2. The first signal transmission areas STA1 and the second signal transmission area STA2 may be arranged so that they are not adjacent to each other in the first direction DR1 and the second direction DR2. That is, in the first pattern PP1, the signal transmission areas STA1 and STA2 and the light-emitting area EA may be arranged alternately in a clockwise direction.

[0112] exist Figure 6DIn the second region DA2a, the signal transmission region STA is arranged in a second pattern PP2. The signal transmission region STA can be arranged adjacent to multiple light-emitting regions EA. Each of the signal transmission regions STA can be adjacent to three light-emitting regions EA. In a second pattern PP2, one signal transmission region STA and three light-emitting regions EA can be arranged. The second pattern PP2 can be... Figure 6C Repeated several times.

[0113] exist Figure 6B and Figure 6D In this embodiment, the second region DA2, which includes the signal transmission region STA arranged with the first pattern PP1, can have a higher transmittance than the second region DA2a, which includes the signal transmission region STA arranged with the second pattern PP2. That is, in the exemplary embodiment, Figure 6B The transmittance of DA2 in the second region is higher than that in the second region. Figure 6D The transmittance of the second region DA2a.

[0114] Figure 7 It shows along Figure 5 A sectional view of the section cut by line I-I'. Figure 7 This is a cross-sectional view of the display panel 210 according to an embodiment of the inventive concept. Figure 7 An electronic module 500 is shown arranged below the display panel 210 and superimposed on the second region DA2.

[0115] Reference Figure 7 The display panel 210 includes a substrate BL, a circuit element layer ML, a light-emitting element layer EML, and a thin-film encapsulation layer TFE. (The following is not related to the above reference.) Figure 4A and Figure 4B The provided descriptions overlap. The substrate BL, circuit element layer ML, and thin-film encapsulation layer TFE may include transparent materials.

[0116] In an embodiment, the light-emitting element layer EML includes a first electrode AE, a light-emitting layer EL, and a second electrode CE.

[0117] In an embodiment, the first electrode AE ​​corresponds to a pixel electrode. The first electrode AE ​​may be disposed on the circuit element layer ML. The light-emitting layer EL may be disposed on the first electrode AE. The second electrode CE may be disposed on the light-emitting layer EL. In an embodiment, the second electrode CE corresponds to a common electrode. The light-emitting layer EL may include an inorganic material. The light-emitting layer EL may include an electron control layer (not shown) and a hole control layer (not shown). In an embodiment, the first electrode AE, the second electrode CE, and the light-emitting layer EL may be respectively associated with the light-emitting region EA (see...). Figure 6A Stacked.

[0118] In one embodiment, the electronic module 500 is arranged below the display panel 210 to overlap with the second region DA2. The second region DA2 may include a light-emitting region EA and a signal transmission region STA. Multiple sub-light-emitting regions SA1, SA2, and SA3 may be arranged within the light-emitting region EA. Although the figures show a light-emitting region EA including a first sub-light-emitting region SA1, a second sub-light-emitting region SA2, and a third sub-light-emitting region SA3, embodiments of the inventive concept are not limited thereto. Reference to sub-light-emitting regions... Figures 6A to 6D .

[0119] The electronic module 500 can be arranged below the signal transmission area STA to image the object through the signal transmission area STA.

[0120] Figure 8 This is a block diagram illustrating an electronic module according to an embodiment of the inventive concept.

[0121] Reference Figure 8 The electronic module 500 includes a camera module 510, an actuator 520, and a processor 530. Referring below... Figure 7 describe Figure 8 .

[0122] Camera module 510 includes a lens ("lens", or referred to as a "lens") 512 and a sensor 514 (e.g., a sensing device). Camera module 510 acquires an image by imaging an object. Camera module 510 can image an object via a second region DA2.

[0123] Lens 512 collects light emitted from the object. In an embodiment, lens 512 collects light emitted from the object and passing through the signal transmission region STA in the second region DA2. Sensor 514 may include image sensor 62. Image sensor 62 can use the light collected by lens 512 to obtain an image of the object. Here, the image includes a still image or a moving image.

[0124] Sensor 514 may include pattern sensor 64. In an embodiment, pattern sensor 64 is configured to detect the layout pattern of a plurality of signal transmission regions STA through which light emitted from an object passes in the second region DA2. Pattern sensor 64 collects pattern information about the layout pattern of the detected signal transmission regions STA.

[0125] In this embodiment, the signal transmission area STA has a first pattern PP1 (see...). Figure 6B In the case of a pattern sensor 64, the pattern sensor 64 can detect the first pattern PP1 to collect corresponding pattern information. For example, the pattern information can indicate whether the detected pattern is the first pattern PP1 or the second pattern PP2.

[0126] Actuator 520 may be connected to camera module 510. For example, actuator 520 may be physically connected to camera module 510. Actuator 520 may correspond to a mechanical device that makes minute movements in various directions or moves minutely to various positions. Actuator 520 may be attached to camera module 510 to move camera module 510 to various positions or angles. In an embodiment, actuator 520 is configured to move camera module 510 to one of a plurality of different positions and / or angles. In an embodiment, actuator is configured to adjust the angle of lens 512 to one of a plurality of different angles.

[0127] In this embodiment, the actuator 520 can minutely move the camera module 510, which images the object, to various positions. While performing imaging, the camera module 510 can continuously move to multiple positions due to the movement of the actuator 520. Therefore, the camera module 510 can acquire multiple images of the object at multiple different positions. In other words, the actuator 520 can control the movement of the camera module 510 so that the camera module 510 can acquire multiple images captured at multiple positions.

[0128] In this embodiment, the actuator 520 can move within the second region DA2. That is, the actuator 520 can move the camera module 510 within the second region DA2.

[0129] In this embodiment, the actuator 520 controls movement based on pattern information about the signal transmission area STA in the second region DA2. For example, when pattern information about the signal transmission area STA having a first pattern PP1 is collected, and when pattern information about the signal transmission area STA having a second pattern PP2 is collected, the actuator 520 can move to different positions or in different directions.

[0130] When the camera module 510 is performing imaging, the actuator 520 moves the camera module 510 to ensure the field of view of the lens 512, which is blocked by the multiple light-emitting areas EA in the second region DA2. That is, the actuator 520 can adjust the angle of the camera module 510 so that the camera module 510 can image the object through the signal transmission area STA without being obstructed by the light-emitting areas EA.

[0131] Processor 530 can be connected to camera module 510 and actuator 520 to control the overall operation of camera module 510 and actuator 520. Processor 530 controls the imaging operation of camera module 510. Processor 530 controls the movement of actuator 520. In an embodiment, processor 530 controls image sensor 62 and pattern sensor 64 of camera module 510. In an embodiment, processor 530 receives pattern information about signal transmission area STA from pattern sensor 64, calculates the transmittance of second area DA2 from the pattern information, and controls image sensor 62 to acquire multiple images based on the calculated transmittance. For example, processor 530 can instruct actuator 520 to adjust the angle and / or position of camera module 510 based on the calculated transmittance.

[0132] In an embodiment, the processor 530 calculates the transmittance of the second region DA2 as a value that is higher when the signal transmission region STA has the first pattern PP1 than when the signal transmission region STA has the second pattern PP2.

[0133] In one embodiment, the processor 530 controls the image sensor 62 such that when pattern information about a signal transmission region STA having a first pattern PP1 is received, fewer images are acquired than when pattern information about a signal transmission region STA having a second pattern PP2 is received. For example, when the pattern information indicates the first pattern PP1, the processor 530 may control the image sensor 62 to capture a first number of images during a given time period, and when the pattern information indicates the second pattern PP2, the processor 530 may control the image sensor 62 to capture a second number of images greater than the first number during a given time period. In one embodiment, the transmittance of the second region (e.g., DA2) is inversely proportional to the number of the first images.

[0134] In one embodiment, the processor 530 controls the movement of the actuator 520 based on first pattern information about the layout pattern of the signal transmission region STA collected from the pattern sensor 64. The processor 530 may determine second pattern information about the position pattern of the actuator 520 as it moves, based on the first pattern information about the layout pattern of the signal transmission region STA.

[0135] When the first pattern information includes the first pattern PP1 and when the first pattern information includes the second pattern PP2, the processor 530 can determine different second pattern information. The processor 530 sends the second pattern information determined based on the first pattern information to the actuator 520. The actuator 520 can move the camera module 510 to a position within the second region DA2 based on the received second pattern information.

[0136] The processor 530 can use multiple first images captured by the camera module 510 and generate a second image due to the positioning of the actuator 520. In an embodiment, each of the first images has a lower resolution than the second image. The first images may correspond to multiple low-resolution images obtained by imaging the object at multiple locations varying within the second region DA2, and the second image may be a single high-resolution image of the object.

[0137] In other words, processor 530 can generate a high-resolution final image using multiple low-resolution images. In an embodiment, processor 530 can obtain a second image from a first image using a super-resolution algorithm. Here, the super-resolution algorithm can be implemented using one of various techniques for reconstructing a high-resolution image from low-resolution images. For example, the super-resolution algorithm can be an image processing technique using machine learning or deep learning. The super-resolution algorithm can generate a high-resolution image by performing resolution processing such as noise reduction and color adjustment on multiple low-resolution images.

[0138] The electronic module 500 according to an embodiment images an object through a second region DA2 comprising both a light-emitting region EA and a signal transmission region STA. The processor 530 according to an embodiment of the inventive concept can use various resolution enhancement algorithms, including super-resolution algorithms, to improve image quality.

[0139] In one embodiment, processor 530 is included in electronics module 500 and connected to camera module 510 and actuator 520. In another embodiment, processor 530 is disposed outside of electronics module 500. For example, processor 530 may be included in control module CM (see...). Figure 3 In the electronic module 500, a control module CM is connected to the electronic module 500 to control the overall operation of the electronic module 500. In an embodiment of the inventive concept that omits the processor 530 from the electronic module 500, the electronic device includes a display panel, an electronic module, and a processor located outside the electronic module. The display panel includes a first region comprising a plurality of pixels and a second region having a higher transmittance than the first region. The electronic module is disposed below the display panel and superimposed on the second region. The electronic module includes a camera module and an actuator, the camera module being configured to image an object to obtain a plurality of first images having a first resolution, and the actuator being configured to move the camera module while capturing each of the plurality of first images. The processor is configured to use the captured first images to obtain a second image having a second resolution higher than the first resolution.

[0140] Figure 9 This is a block diagram illustrating a processor according to an embodiment of the inventive concept.

[0141] Reference Figure 9The processor 530 includes an imaging unit 910, an actuator driving unit 920, a resolution processing unit 930, and a control unit 940. (Refer to...) Figures 6A to 7 Provide a description.

[0142] Imaging unit 910 images the object through camera module 510. That is, imaging unit 910 can send imaging commands to camera module 510.

[0143] The actuator drive unit 920 controls the movement of the actuator 520 connected to the camera module 510. That is, the actuator drive unit 920 can move the camera module 510 connected via the actuator 520; specifically, the actuator drive unit 920 instructs the actuator 520 to move the camera module 510 to multiple different positions. In an embodiment, the actuator drive unit 920 controls the movement of the actuator 520 based on first pattern information regarding the layout pattern of the signal transmission area STA arranged in the second region DA2.

[0144] The camera module 510 and actuator 520 can acquire multiple first images of an object under the control of the imaging unit 910 and the actuator driving unit 920.

[0145] In this embodiment, the resolution processing unit 930 generates a second image with high resolution by converting multiple first images with low resolution. The resolution processing unit 930 can use a super-resolution algorithm to generate a single high-resolution image from the multiple low-resolution images.

[0146] The control unit 940 can control the signals between the imaging unit 910, the actuator driving unit 920 and the resolution processing unit 930, and can control the overall operation of the processor 530.

[0147] Figure 10 This is a flowchart illustrating a driving method for an electronic device according to an embodiment of the inventive concept.

[0148] A method for driving an electronic device may include preparing an electronic module, capturing multiple first images, and obtaining a second image.

[0149] An electronic module (e.g., 500) is disposed below a display panel (e.g., 210), which defines a first region in which a plurality of pixels are disposed and a second region having a higher transmittance than the first region, and the electronic module (e.g., 500) is superimposed on the second region. The electronic module may include a camera module (e.g., 510) and an actuator (e.g., 520). In an embodiment, the electronic module may include a processor (e.g., 530).

[0150] The camera module acquires multiple low-resolution images of the object while being moved to various positions by the actuator (S110).

[0151] In one embodiment, an actuator (e.g., 520) receives a command from a processor (e.g., 530) to move a camera module (e.g., 510) based on pattern information about the signal transmission area. The camera module acquires multiple low-resolution images while moving within a second area.

[0152] The processor can generate a high-resolution image from multiple low-resolution images using a super-resolution algorithm (S120). The processor can freely use at least one algorithm or technique to obtain a high-resolution image.

[0153] According to at least one embodiment of the inventive concept, the problem of image quality degradation caused by the camera module being obstructed by panel pixels can be solved. That is, the electronic device according to an embodiment of the inventive concept can acquire multiple low-resolution first images captured at various locations via an actuator. The electronic device according to an embodiment of the inventive concept can generate a high-quality second image by converting the multiple low-resolution first images by a processor.

[0154] Embodiments of the inventive concept may provide an electronic device including a camera with improved image quality and a method for driving the electronic device.

[0155] Embodiments of the inventive concept can solve the problem of image quality degradation in cameras caused by reduced transmittance due to the characteristics of the UPC structure.

[0156] Embodiments of the inventive concept can obtain low-resolution images of an object at various locations using actuators connected to a camera module, and can obtain high-resolution images from low-resolution images using super-resolution technology.

[0157] Although embodiments of the invention have been described, it will be understood that the invention is not limited to these embodiments, but can be modified and altered by those skilled in the art within the spirit and scope of the invention as claimed.

Claims

1. An electronic device, the electronic device comprising: The display panel includes a first region comprising a plurality of pixels and a second region having a higher transmittance than the first region; as well as An electronic module is disposed below the display panel and stacked with the second area, wherein the electronic module includes: A camera module is configured to image an object to obtain a plurality of first images with a first resolution; An actuator is configured to move the camera module while simultaneously capturing each of the plurality of first images; and The processor is configured to obtain a second image with a second resolution higher than the first resolution from the captured plurality of first images.

2. The electronic device according to claim 1, wherein, The camera module includes: A lens is configured to collect light emitted from the object; and An image sensor is configured to obtain the plurality of first images from the collected light.

3. The electronic device according to claim 1, wherein, The actuator controls the movement of the camera module, thereby capturing the plurality of first images at different locations.

4. The electronic device according to claim 1, wherein, The processor obtains the second image from the plurality of first images using a super-resolution algorithm.

5. The electronic device according to claim 1, wherein, The actuator controls the movement of the camera module within the second region.

6. The electronic device according to claim 1, wherein, The second region includes a plurality of light-emitting regions in which pixels are arranged and a plurality of signal transmission regions respectively adjacent to the plurality of light-emitting regions.

7. The electronic device according to claim 6, wherein, The camera module includes a pattern sensor configured to collect first pattern information about the layout pattern of the plurality of signal transmission areas.

8. The electronic device according to claim 7, wherein, The processor determines second pattern information about the positional pattern of the actuator as it moves, based on the first pattern information collected from the pattern sensor, and sends the second pattern information to the actuator.

9. The electronic device according to claim 8, wherein, The actuator controls the movement of the camera module based on the second pattern information.

10. The electronic device according to claim 1, wherein, The processor includes: An actuator drive unit is configured to control the movement of the actuator to move the camera module; An imaging unit is configured to control the imaging operation of the camera module; and The resolution processing unit is configured to generate the second image by converting the plurality of first images.

11. The electronic device according to claim 10, wherein, The actuator driving unit controls the movement of the actuator based on pattern information about the layout pattern of the signal transmission area arranged in the second region.

12. The electronic device according to claim 1, wherein, The processor receives transmittance information about the second region of the display panel and controls the camera module and the actuator based on the received transmittance information.

13. The electronic device according to claim 12, wherein, The transmittance of the second region is inversely proportional to the number of the plurality of first images.

14. An electronic device, the electronic device comprising: The display panel includes a first region in which a plurality of pixels are arranged and a second region having a higher transmittance than the first region. An electronic module is disposed below the display panel and includes a camera module superimposed on the second region and an actuator connected to the camera module; as well as The processor is configured to control the operation of the electronic module. The processor includes: An actuator drive unit is configured to instruct the actuator to move the camera module to multiple different positions; An imaging unit is configured to issue an imaging command to the camera module, causing the camera module to acquire multiple first images of the object with a first resolution at the multiple locations; and The resolution processing unit is configured to generate a second image with a second resolution higher than the first resolution from the plurality of first images.

15. The electronic device according to claim 14, wherein, The plurality of locations exist within the second region.

16. The electronic device according to claim 14, wherein, The second region includes a plurality of light-emitting regions in which pixels are arranged and a plurality of signal transmission regions respectively adjacent to the plurality of light-emitting regions.

17. The electronic device according to claim 16, wherein, The actuator driving unit determines the position pattern of the actuator to the plurality of positions based on the pattern information of the layout pattern of the plurality of signal transmission areas.

18. The electronic device according to claim 14, wherein, The electronic module includes the processor.

19. The electronic device of claim 14, further comprising a control module configured to control the operation of the display panel and the electronic module, wherein, The control module includes the processor.

20. A method for driving an electronic device, the method comprising the following steps: The camera module of the electronic module is moved to multiple positions by the actuator of the electronic module; During movement, the camera module captures multiple first images with different first resolutions at the multiple locations; as well as The processor obtains a second image with a higher resolution than the first resolution from the plurality of first images. The electronic module is disposed below the display panel, which includes a first region and a second region. The first region includes multiple pixels, and the second region has a higher transmittance than the first region. The electronic module is superimposed on the second region, and the multiple pixels are located within the second region.

Images