Electronic device including illuminance sensor

Abstract

A portable electronic device according to various embodiments includes: a housing including a front surface and a rear surface; a display disposed in a space formed inside the housing and exposed through the front surface; an illuminance sensor disposed below a sensor area in an active area of ​​the display where visual information will be displayed when facing the display; and a processor connected to the display and the illuminance sensor, wherein the processor may be configured to calculate an illuminance value by using data received from the illuminance sensor, obtain color information about an image displayed in the active area, calculate a first color value of the active area and a second color value of the sensor area by using the color information, correct the illuminance value based on the first color value and the second color value, and configure the brightness of the display based on the corrected illuminance value. Various other embodiments are possible.

Description

Technical Field

[0001] Various embodiments are directed to a portable electronic device configured to configure brightness of a display by using an illumination sensor. Background Art

[0002] The electronic device may include a display and an illuminance sensor disposed under a designated area (e.g., a region of interest (ROI) or a sensor area) of the display to measure external illuminance. The electronic device may adjust the brightness of the display based on the measured illuminance. For example, the electronic device may configure the screen to be dark in a dark environment where the surrounding external illuminance is low, and may configure the screen to be bright in a bright environment where the external illuminance is relatively high, thereby improving visibility. Summary of the invention

[0003] Technical issues

[0004] When an illuminance sensor is positioned below a display, the measured illuminance may be distorted due to the brightness in the sensor area.

[0005] When various images are displayed on a display, the color information held by the portion to be displayed in the sensor area of ​​the display may be the same between the multiple images, but the brightness of the light emitted from the sensor area (hereinafter, referred to as the brightness of the sensor area) may be different. For example, the ratio of white configured to be displayed on the display may be different between the images. As an example, in the case where the first image and the second image are similar, the color information held by the portion to be displayed in the sensor area may be white, but from an overall perspective, the ratio of white held by the first image may be higher than the ratio of white held by the second image. As another example, the color information may be the same between the images, but the position (or distribution) of the white to be displayed on the display may be different between the images. As an example, in the case where the first image and the second image are similar, the color information held by the portion to be displayed in the sensor area may be black, but the position of the white included in the first image may be different from the position of the white included in the second image. Due to such a difference in ratio and / or position, when each image is displayed, although the color information held by the portion to be displayed in the sensor area is the same, the brightness of the sensor area may be different.

[0006] As a result, when the measured illuminance is corrected by using the color information of the sensor area, the accuracy of the correction may be reduced due to deviation (difference in brightness and / or color).

[0007] In various embodiments, the electronic device may improve the measurement accuracy regarding the external illuminance by correcting the illuminance value in consideration of the deviation.

[0008] The technical problems to be solved by the present disclosure are not limited to the above-mentioned technical problems, and other technical problems not mentioned herein will be clearly understood by those skilled in the art to which the present disclosure belongs from the following description.

[0009] Technical Solution

[0010] According to various embodiments, a portable electronic device may include: a shell including a front surface and a rear surface; a display disposed in a space formed inside the shell and exposed through the front surface; an illuminance sensor disposed below a sensor area in an active area of ​​the display where visual information is to be displayed when facing the display; and a processor connected to the display and the illuminance sensor, wherein the processor is configured to calculate an illuminance value by using data received from the illuminance sensor, obtain color information of an image displayed in the active area, calculate a first color value about the active area and a second color value about the sensor area by using the color information, correct the illuminance value based on the first color value and the second color value, and configure the brightness of the display based on the corrected illuminance value.

[0011] Beneficial Effects

[0012] Various embodiments may provide an electronic device configured to improve the measurement accuracy regarding external illumination by correcting the illumination value in consideration of brightness deviation in a sensor area occurring when an image is displayed on a display. Various other advantageous effects that are explicitly or implicitly identified through the present disclosure may be provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0014] Figure 2 is a block diagram of a display module according to various embodiments.

[0015] Figure 3 A portable electronic device having a bar-type housing structure according to an embodiment is shown.

[0016] Figure 4 A portable electronic device having a housing structure folded about a single folding axis in an outward folding type according to an embodiment is shown.

[0017] Figure 5a and Figure 5b A portable electronic device having a slidable (or rollable) housing structure according to an embodiment is shown.

[0018] Figure 6 is a cross-sectional view of a display and an illuminance sensor disposed therebelow according to an embodiment.

[0019] Figure 7 The configuration of a display according to the embodiment is shown.

[0020] Figure 8 The configuration of a portable electronic device according to various embodiments is shown.

[0021] Fig. 9 An illuminance measuring operation based on a period of turning on and off a display according to an embodiment is shown.

[0022] Fig.10 An illumination correction operation based on image color information according to an embodiment is shown.

[0023] Fig.11 Shows images that can be displayed in the active area of ​​the display.

[0024] Fig.12 A first graph and a second graph are shown. The first graph shows when Fig.11 is displayed in the active area, and the second graph shows the ratio between the color value of the active area and the color value of the sensor area.

[0025] Fig.13a shows the active area and sensor area of ​​the display, and Fig.13b Shows images that can be displayed in the active area.

[0026] Fig.14 A third graph is shown which shows experimentally obtained luminance values ​​when the image in FIG. 13 is displayed in the active area.

[0027] Fig.15 Shown in Fig.13a The image displayed in the active area in .

[0028] Fig.16 A fourth curve diagram is shown, which shows that when Fig.15 Illumination values ​​obtained experimentally when the image in is displayed in the active area.

[0029] Fig.17a shows a display in which the active area according to an embodiment is adjustable, and Fig.17b Shows images that can be displayed in the active area of ​​the display.

[0030] Fig.18a shows a display in which the active area according to an embodiment is adjustable, and Fig.18b Shows images that can be displayed in the active area of ​​the display.

[0031] Fig.19An operation for configuring the brightness of a screen by using an illuminance sensor according to various embodiments is illustrated. DETAILED DESCRIPTION

[0032] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160).

[0033] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0034] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 180 or a communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated through machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0035] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0036] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0037] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0038] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0039] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display module 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0040] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0041] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or a data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0042] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly with an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0043] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.

[0045] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0046] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0047] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0048] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) separated from each other. The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0049] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less for a round trip).

[0050] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiation element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiation element may be additionally formed as a part of the antenna module 197.

[0051] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high frequency band.

[0052] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.

[0053] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the requested function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology or IoT-related technologies.

[0054] Figure 2 2 is a block diagram 200 showing a display module 160 according to various embodiments. Figure 2, the display module 160 may include a display 210 and a display driver integrated circuit (DDI) 230 for controlling the display 210. The DDI 230 may include an interface module 231, a memory 233 (e.g., a buffer memory), an image processing module 235, or a mapping module 237. The DDI 230 may receive image information including image data or an image control signal corresponding to a command for controlling image data from another component of the electronic device 101 via the interface module 231. For example, according to an embodiment, the image information may be received from the processor 120 (e.g., the main processor 121 (e.g., an application processor)) or the auxiliary processor 123 (e.g., a graphics processing unit), wherein the auxiliary processor 123 operates independently of the function of the main processor 121. The DDI 230 may communicate with, for example, the touch circuit 250 or the sensor module 176 via the interface module 231. The DDI 230 may also store at least a portion of the received image information in the memory 233, for example, frame by frame. The image processing module 235 may perform pre-processing or post-processing (e.g., adjustment of resolution, brightness, or size) on at least a portion of the image data. According to an embodiment, for example, the pre-processing or post-processing may be performed at least in part based on one or more features of the image data or one or more features of the display 210. The mapping module 237 may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed by the image processing module 235. According to an embodiment, for example, the generation of the voltage value or the current value may be performed at least in part based on one or more attributes of the pixel (e.g., an array of pixels (such as RGB stripes or a pentile structure) or the size of each sub-pixel). For example, at least some pixels of the display 210 may be driven at least in part based on the voltage value or the current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed via the display 210.

[0055] According to an embodiment, the display module 160 may further include a touch circuit 250. The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251. The touch sensor IC 253 may control the touch sensor 251 to sense a touch input or a hovering input for a specific position on the display 210. To this end, for example, the touch sensor 251 may detect (e.g., measure) a signal (e.g., voltage, light amount, resistance, or one or more charge amounts) corresponding to a specific position on the display 210. The touch circuit 250 may provide input information (e.g., position, area, pressure, or time) indicating a touch input or a hovering input detected via the touch sensor 251 to the processor 120. According to an embodiment, at least a portion of the touch circuit 250 (e.g., the touch sensor IC 253) may be formed as a part of the display 210 or the DDI 230, or as a part of another component (e.g., the auxiliary processor 123) located outside the display module 160.

[0056] According to an embodiment, the display module 160 may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illumination sensor) of the sensor module 176 or a control circuit for the at least one sensor. In such a case, the at least one sensor or the control circuit for the at least one sensor may be embedded in a portion of a component (e.g., the display 210, the DDI 230, or the touch circuit 250) of the display module 160. For example, when the sensor module 176 embedded in the display module 160 includes a biosensor (e.g., a fingerprint sensor), the biosensor may acquire biometric information (e.g., a fingerprint image) corresponding to a touch input received via a portion of the display 210. As another example, when the sensor module 176 embedded in the display module 160 includes a pressure sensor, the pressure sensor may acquire pressure information corresponding to a touch input received via a partial area or the entire area of ​​the display 210. According to an embodiment, the touch sensor 251 or the sensor module 176 may be arranged between pixels in a pixel layer of the display 210, or above or below the pixel layer.

[0057] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0058] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., the second element)”, “coupled to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” with or without the terms “operably” or “communicatively” being used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0059] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0060] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0061] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be published online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a manufacturer's server, an application store's server, or a memory of a forwarding server).

[0062] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities, and some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performing one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.

[0063] Will refer to Figure 3 5 describe housings having various structures that can be used as housings of the electronic device 101. In the following, a display (eg, Figure 1 The surface of the display module 160 in the electronic device will be defined as the front surface of the electronic device. The surface opposite to the front surface will be defined as the rear surface. The surface surrounding the space between the front surface and the rear surface will be defined as the side surface of the electronic device. The term "state" may refer to the structural form, appearance or shape of the electronic device (or display).

[0064] Figure 3 A portable electronic device 300 having a bar-type housing structure according to an embodiment is shown. Figure 3 , the portable electronic device 300 (eg, Figure 1 The electronic device 101 in the embodiment may include a housing 310, a display 320, and a sensor module (not shown). In an embodiment, the housing 310 may include a front cover 311, a rear cover (not shown), and a side frame 312. The display 320 may be disposed in a space formed between the front cover 311 and the rear cover so as to display visual information through at least a portion of the front cover 311. When facing the front surface, the sensor module (e.g., Figure 1 The sensor module 176 in the display 320 may be disposed below the display 320. For example, the sensor module may be disposed below the sensor area (or light-transmitting area) 321 of the display 320. The position and / or size of the sensor area 321 may be determined by the position and / or size of the illumination sensor disposed thereunder. For example, the size (e.g., diameter) of the sensor area 321 may be determined based on the field of view (FOV) of the illumination sensor. In an embodiment, the sensor area 321 may be configured to have a lower pixel density and / or a lower wiring density than its surroundings in order to improve optical transmittance.

[0065] Figure 4 A portable electronic device 400 having a housing structure folded around a single folding axis in an outward folding type according to an embodiment is shown. Figure 3 Description of features, functions and / or structures that are the same as the features, functions and / or structures in Figure 4 , a portable electronic device 400 (eg, Figure 1 The electronic device 101 in may include a first shell 410, a second shell 420, a hinge assembly 430 configured to connect the first shell 410 and the second shell 420 so that the second shell 420 can rotate relative to the first shell 410, a flexible or foldable display 440 arranged in a space formed by the foldable shells 410 and 420, and a sensor module (not shown).

[0066] According to an embodiment, the display 440 may be provided across the hinge assembly 430 from the first housing 410 to the second housing 420. The display 440 may be divided into a first display area 441 provided in the inner space of the first housing 410 and a second display area 442 provided in the inner space of the second housing 420 about the folding axis A. When facing the front surface, a sensor module (e.g., an illumination sensor) may be provided below a sensor area 442a of the second display area 442.

[0067] According to an embodiment, the hinge assembly 430 may be implemented in an outward folding type so that when the electronic device 400 switches from the unfolded state to the folded state, the two display areas 441 and 442 face opposite directions. For example, when the electronic device 400 is in the unfolded state, the two display areas 441 and 442 may face the same direction. As a result of the state transition 460 from the unfolded state to the folded state, the two display areas 441 and 442 may rotate in opposite directions.

[0068] According to an embodiment, the state of the portable electronic device 400 may be defined based on the angle between the two display areas 441 and 442. For example, when the angle between the two display areas 441 and 442 is approximately 180°, the electronic device 400 may be defined as being in an unfolded state. When the angle between the two display areas 441 and 442 is approximately 360°, the electronic device 400 may be defined as being in a folded (or closed) state. When the angle between the two display areas 441 and 442 is greater than the angle in the unfolded state and less than the angle in the folded state (e.g., between approximately 181° and 359°), the electronic device 400 may be defined as being in a folded state. Figure 4 The intermediate state (or partially folded state, partially unfolded state or free rest state) is shown.

[0069] According to an embodiment, an active area may be determined in the display 440 based on the state of the electronic device 500. For example, when the electronic device 400 is in a folded state, the active area may be determined as the first display area 441 or the second display area 442. Of the first display area 441 and the second display area 442, an area located relatively above may be determined as the active area. When the electronic device 400 is in an unfolded state, the entire area of ​​the display 440 (e.g., both the first display area 441 and the second display area 442) may be determined as the active area.

[0070] Figure 5a and Figure 5b A portable electronic device 500 having a slidable (or rollable) housing structure according to an embodiment is shown. Figure 5a and Figure 5b , a portable electronic device 500 (eg, Figure 1 The electronic device 101 in may include a first shell 510, a second shell 520, a rotatable component (or a scroll unit) (not shown), a flexible or foldable display 530 disposed in a space formed by the slidable shells 510 and 520, and a sensor module (not shown).

[0071] According to an embodiment, the second housing 520 may be coupled to the first housing 510 so as to be able to slide. A rotatable assembly (or a reel unit) may be disposed in the internal space of the second housing 520. The display 530 may include a first display area 531 disposed adjacent to the first housing 510 and a second display area 532 disposed in the internal space while surrounding the reel unit. When the second housing 520 slides toward the first housing 510, the second display area 532 may move into the second housing 520 and may be wound around the rotatable assembly. When the second housing 520 slides away from the first housing 510, the second display area 532 may be unfolded from the rotatable assembly and may be exposed to the outside.

[0072] According to an embodiment, the state of the electronic device 500 may be defined based on the rotation angle of the rotatable component (e.g., the angle at which the rotatable component rotates in the direction in which the display 530 is unfolded from the rotatable component (e.g., the clockwise direction)). For example, if the rotation angle of the rotatable component exceeds a first threshold, the state of the electronic device 500 may be defined as a first state (or a normal state) in which the first display area 531 is exposed (or the second display area 532 is hidden). If the rotation angle of the rotatable component exceeds a second threshold greater than the first threshold, the state of the electronic device 500 may be defined as a second state (or an extended state) in which the entire area of ​​the display 530 (e.g., the first display area 531 and the second display area 532) is exposed.

[0073] According to another embodiment, the state of the electronic device 500 may be defined based on the curvature (bending degree) of a specific portion of the display 530. For example, if the curvature of the second display area 532 corresponds to a value (or is within a range) indicating concavity (or convexity), the state of the electronic device 500 may be defined as the first state. If the curvature of the second display area 532 corresponds to a value (or is within a range) indicating flatness, the state of the electronic device 500 may be defined as the second state.

[0074] According to an embodiment, when facing the front surface, a sensor module (eg, an illumination sensor) may be disposed below the sensor region 531 a of the first display region 531 .

[0075] According to an embodiment, the active area may be determined in the display 530 based on the state of the electronic device 500. For example, if the electronic device 500 is in the first state, the active area may be determined as the first display area 531. If the electronic device 500 is in the second state, the active area may be determined as the entire area of ​​the display 530 (e.g., the first display area 531 and the second display area 532).

[0076] Figure 6 is a cross-sectional view of a display according to an embodiment and an illuminance sensor disposed thereunder. Figure 6 , the display 610 and the illuminance sensor 620 may be arranged in reference Figure 3 To the housing with various structures described in Figure 5.

[0077] According to an embodiment, the display 610 may include a first protective cover 611, a display panel 612 (eg, Figure 2 210 in the display panel 610) and the second protective cover 613. For example, the first protective cover 611 may be attached to the front surface of the display panel 612 and may be implemented by using a flexible transparent material (e.g., colorless polyimide (CPI)). The second protective cover 613 may be attached to the rear surface of the display panel 612 and may include a metal layer (e.g., a Cu sheet) and / or a light shielding layer (e.g., a black embossed layer). The illuminance sensor 620 (e.g., an ambient light sensor (ALS)) may be located below the second protective cover 613 and mounted on the substrate assembly 630. An opening 613a may be formed in at least a portion of the second protective cover 613 disposed above the illuminance sensor 620 so that the illuminance sensor 620 can sense external light. The opening 613a may be formed to have a position and / or size corresponding to a field of view (FOV) angle θ of the illuminance sensor 620a. In an embodiment, the display panel 612 may have a sensor area (e.g., Figure 3 Sensor area 321 or Figure 8 sensor area 822b in the image).

[0078] In an embodiment, although not shown, the illuminance sensor 620 may include a package form further including a light emitting unit. For example, the illuminance sensor 620 including the light emitting unit may operate as a proximity sensor. In another embodiment, although not shown, the illuminance sensor 620 may be included in a display panel (e.g., Figure 2 210). For example, at least some of the pixels included in the display 210 may include a light receiving unit to measure the illuminance. In this case, the opening 613a may not be formed. In addition, the sensor area may be formed to have a position and / or size corresponding to the pixel including the light receiving unit. Those skilled in the art will readily understand that the type of the illuminance sensor 620 is not limited.

[0079] Figure 7 2 shows a configuration of a display according to an embodiment. Figure 7 , display 700 (eg, Figure 1 The display module 160 in the display module 160 may include a display panel (hereinafter, simply referred to as a “panel”) 710 and a DDI 720. The DDI 720 (eg, Figure 2 The DDI 230 in the embodiment may include a gate driver 721 (or a scan driver), a data driver 722, a timing controller 723 and / or an interface block 724. The power supply unit 730 (eg, Figure 1 The power management module 188 in the control module 180 may generate at least one driving voltage (eg, ELVDD, ELVSS) for driving the panel 710 , and may supply the generated driving voltage to the panel 710 .

[0080] According to an embodiment, the panel 710 may include a display area 711 and a non-display area 712. For example, the non-display area 712 may be an edge area of ​​the panel 710 where no pixels are provided and may be printed in black. Figure 3 5) may include a plurality of pixels, and a pixel may include a plurality of sub-pixels P. An illuminance sensor may be disposed below the display area 711. Based on an illuminance sensor (eg, Figure 6 Based on the FOV angle of the illumination sensor in the display area 711, a portion of the display area 711 can be designated as the sensor area 711a.

[0081] According to an embodiment, the panel 710 may include a plurality of gate lines (GL) GL1-GLn and a plurality of data lines (DL) DL1-DLm intersecting therewith. The sub-pixel P may be formed in an area where GL and DL intersect. The panel 710 may include a plurality of power supply lines (e.g., VDD line, VSS line, Vcas line) VL1-VLm for supplying power to the sub-pixels. In an embodiment, a voltage drop (e.g., IR drop) may occur in the power supply line VL. For example, when the current generated in the power supply unit 730 is supplied to the sub-pixel through the power supply line VL, due to the resistance component of the power supply line VL, a smaller amount of current may flow to the sub-pixel disposed relatively far from the power supply unit 730 compared to the sub-pixel disposed close to the power supply unit 730. As a result, even if the same color information (e.g., color ratio information about the pixel) is configured for the pixel, the brightness and / or color may be different depending on the position of the pixel. Although not shown, the panel 710 may further include a compensation circuit for compensating for the voltage drop occurring in the power supply line VL.

[0082] According to an embodiment, the panel 710 may be in a quadrilateral form having a first side (e.g., right side) 710a extending in a first direction A, a second side (e.g., left side) 710b extending in parallel to the first side 710a, a third side (e.g., lower side) 710c extending in a second direction B perpendicular to the first side 710a, and a fourth side (e.g., upper side) 710d extending in parallel to the third side 710c. The power lines VL1-VLm may be disposed on the panel 710 from the third side 710c to the fourth side 710d so as to be parallel to the first direction A. The power supply unit 730 may be disposed adjacent to the third side 710c, the data driver 722 may be disposed adjacent to the fourth side 710d, and the gate driver 721 may be disposed adjacent to the second side 710b. In an embodiment, since the illumination sensor is located adjacent to the fourth side 710d, a portion of the display area 711 adjacent to the fourth side 710d may be designated as a sensor area 711a.

[0083] According to an embodiment, each sub-pixel P may include an OLED and at least one driving circuit for driving the OLED. The driving circuit may include at least one thin film transistor and at least one capacitor, may be electrically connected to one of the gate lines GL, and may be electrically connected to one of the data lines DL. The driving circuit may charge the capacitor by a data voltage supplied from the data driver 722 via the connected data line DL in response to a scan signal received from the gate driver 721 via the connected gate line GL. The driving circuit may control the amount of current supplied to the connected OLED according to the data voltage used to charge the capacitor. For example, each sub-pixel may display visual information based on at least a scan signal and a data signal.

[0084] According to an embodiment, the gate driver 721 may supply a scan signal (or a scan pulse) to a plurality of gate lines GL1-GLn according to at least one gate control signal (GCS) provided from the timing controller 723. The data driver 722 may convert the image data (RGB) provided from the timing controller 723 into a data voltage according to at least one data control signal (DCS) provided from the timing controller 723. The data driver 722 may continuously supply the generated data voltage to a plurality of pixels line by line (or row by row). The timing controller 723 may arrange the image data (RGB) provided from the interface block 724 according to the size and resolution of the panel 710. The timing controller 723 may supply the arranged image data (RGB) to the data driver 722. The timing controller 723 may send a plurality of control signals (e.g., GCS, DCS) by using at least one synchronization signal (SYNC) provided from the interface block 724. The plurality of control signals (e.g., GCS, DCS) may include at least one gate control signal (GCS) and at least one data control signal (DCS). The gate control signal (GCS) may be a signal for controlling the driving timing of the gate driver 721. The data control signal (DCS) may be a signal for controlling the driving timing of the data driver 722. The interface block 724 may receive a signal from a processor (eg, Figure 1 The interface block 724 may generate at least one synchronization signal (SYNC) and may transmit it to the timing controller 723. The interface block 724 may control the power supply unit 730 (eg, Figure 1 The power management module 188 in the power supply module 188 is used to supply at least one driving voltage (eg, ELVDD, ELVSS) to the panel 710.

[0085] Figure 8 8 shows a configuration of a portable electronic device 800 according to various embodiments. Figure 8 , the electronic device 800 (eg, Figure 1 The electronic device 101 in FIG. 1 may include an illumination sensor 810 , a display 820 , a display driver 830 , a state sensing sensor 840 , a memory 850 , and a processor 860 .

[0086] In an embodiment, the illumination sensor 810 (e.g., Figure 6 The illumination sensor 620 in the electronic device 800 may generate data used to identify the illumination of the surroundings of the electronic device 800. In an embodiment, the illumination sensor 810 may include at least one photodiode and may be implemented as a single module (e.g., ASIC). The illumination sensor 810 may be molded (e.g., complete molding) to protect its internal components.

[0087] In an embodiment, the illuminance sensor 810 may include a light receiving unit 811 for reading RGB values ​​of visible light and an analog-to-digital converter (ADC) 812 for digitizing the RGB values, and may output the digitized RGB values ​​(ADC values) to the processor 860. For example, the light receiving unit 811 may include a photodiode that reacts to visible light (e.g., light having a wavelength of about 400-750 nm). The light receiving unit 811 may also include a photodiode that receives infrared rays. When facing an external light source, the light receiving unit 811 may generate a current through a photoelectric effect. The ADC 812 may convert the current into digital data (e.g., an ADC value) and may deliver it to the processor 860. For example, if the light is strong, data indicating a high illuminance value may be output to the processor 860, and if the light is weak, data indicating a relatively low illuminance value may be output to the processor 860. The processor 860 may convert the data received from the illuminance sensor 810 into illuminance, and may control the brightness (or brightness) of the display 820 based on the illuminance.

[0088] In an embodiment, the light receiving unit 811 may include a plurality of channels capable of measuring light. In an embodiment, the light receiving unit 811 may include a red (R) channel 811a configured to receive red series light (e.g., light having a wavelength of about 550nm-700nm), a green (G) channel 811b configured to receive green series light (e.g., light having a wavelength of about 450nm-650nm), a blue (B) channel 811c configured to receive blue series light (e.g., light having a wavelength of about 400nm-550nm), and / or a colorless (C) channel 811d configured to receive white light (e.g., all of R, G, and B). At least one of the channels 811a, 811b, 811c, and 811d may include a photodiode. The R, G, and B channels 811a, 811b, and 811c may include filters configured to transmit light in the corresponding series.

[0089] In an embodiment, in addition to a photodiode, the illumination sensor 810 may also include various light-based sensors such as a color detection sensor (e.g., a selector sensor), a flicker sensor, an image sensor, a photoplethysmography (PPG) sensor, a proximity sensor, an iris sensor, a spectrometer sensor, or an ultraviolet sensor. Optionally, the illumination sensor 810 may also be included in the display 820.

[0090] In an embodiment, the display 820 (e.g., Figure 1 The display module 160 in FIG. 1 may include a DDI 821 and a display panel 822. The DDI 821 (eg, Figure 2 DDI 230 in the control panel 822 (e.g., Figure 2820) to display image information. In an embodiment, the DDI 821 may control the panel 822 to output the image information frame by frame. The DDI 821 may provide color information of the image to be output (or has been output) to another element (e.g., the processor 860). For example, the color information may include color ratio (COPR) information about the pixel. In an embodiment, the COPR information may indicate a ratio (R value, G value, and B value) of R / G / B related to the image data to be output in a specified area of ​​the display 820. For example, the COPR information may indicate an average value of R value, an average value of G value, and an average value of B value to be displayed in the pixels included in the specified area, respectively. The R average value may be a red value within a range of 0-255, the G average value may be a green value within a range of 0-255, and the B average value may be a blue value within a range of 0-255. For example, the COPR information of the area may have a value (R, G, B: 255, 255, 255) in which a white portion included in the image to be displayed on the display 820 is displayed. The designated area may include, for example, at least one of a plurality of partitions delimited in the area of ​​the currently displayed image, the entire active area 822c of the display 820, the sensor area 822b, or the active area 822c, and the plurality of partitions may be distinguished by the coordinate values ​​of the pixels or the physical location information of the area stored in the memory 850. The physical location information of the area may include, for example, area delimiting line information, which is information (e.g., line number) about at least one of the lines (e.g., GL line, DL line, VDD line, VSS line, Vcas line) included in the display 820.

[0091] In an embodiment, the panel 822 may include a display area 822a and a non-display area, and because the illumination sensor 810 is disposed below the display area 822, a portion of the display area 822a may be designated as a sensor area 822b based on the position and FOV angle of the illumination sensor 810. The sensor area 822b may be designated when the electronic device 800 is manufactured or started. Information about the area designated as the sensor area 822b may be stored in the memory 850. For example, the information about the area may include at least one of a coordinate value of a pixel corresponding to the sensor area 822b or physical location information (e.g., wiring information) of the sensor area 822b.

[0092] In an embodiment, the display driver 830 may adjust the brightness of the display 820 based on the control of the processor 860. In an embodiment, the display driver 830 may perform an operation of adjusting the brightness of the display 820 in real time according to the illuminance identified by using the illuminance sensor 810 based on a first command from the processor 860 (hereinafter referred to as a real-time adjustment operation). For example, the display driver 830 may receive first data (e.g., RT (real time)_flag) indicating the first command from the processor 860, and may perform a real-time adjustment operation according thereto. Based on a second command from the processor 860, the display driver 830 may perform the following operations: when the illuminance identified by using the illuminance sensor 810 is within a predetermined illuminance range, the brightness of the display 820 is maintained, and when the illuminance identified by using the illuminance sensor 810 is outside the illuminance range, the brightness of the display 820 is adjusted (hereinafter referred to as a hysteresis adjustment operation). For example, the processor 860 may stop the transmission of the first data as the second command, and the display driver 830 may perform a hysteresis adjustment operation accordingly. Compared with the real-time adjustment operation, the hysteresis adjustment operation can prevent the display brightness from changing frequently. For example, in the case of a real-time adjustment operation, as the illuminance may be changed upward, the display becomes brighter, while in the case of a hysteresis adjustment operation, even if the illuminance is changed upward to the same value, the display brightness may remain unchanged. In an embodiment, the first data may include flag type data (hereinafter referred to as RT_flag) having at least one bit indicating the on / off state of the real-time adjustment operation (or the operation to be performed in the real-time adjustment operation and the hysteresis adjustment operation). Hereinafter, for ease of description, RT_flag is assumed to be the first data, but the format of the first data is not limited thereto, and those skilled in the art will understand that any data for switching between the real-time adjustment operation and the hysteresis adjustment operation may be used as the first data. For example, the first data may be data for indicating the on / off state of the real-time adjustment operation or the hysteresis adjustment operation. In an embodiment, the processor 860 may generate the first data periodically. For example, the processor 860 may generate the first data once in a specified period (e.g., 100ms).

[0093] In an embodiment, the display driver 830 may be implemented as software. Therefore, the processor 860 may be configured to execute the display driver 830 so as to perform the operation of the display driver 830. In this case, the operation of the display driver 830 may represent the operation of the processor 860.

[0094] In an embodiment, the state sensing sensor 840 (e.g., Figure 1The sensor module 176 in the electronic device 800 may generate data used to identify the state of the electronic device 800. In an embodiment, when the electronic device 800 includes a foldable housing or a rollable housing, the state sensing sensor 840 may include a sensor module 176 attached to a hinge assembly (eg, Figure 4 5) or a sensor (e.g., an encoder or a Hall sensor) of a rotatable component (e.g., a rotatable component provided in the electronic device 500 in FIG. 5) to generate and output data corresponding to the angle. In another embodiment, the state sensing sensor 840 may include a motion sensor (e.g., an acceleration sensor and / or a gyroscope sensor) provided in the inner space of the housing of the electronic device 800. For example, the state sensing sensor 840 may include a sensor provided in the first housing (e.g., Figure 4 The first housing 410 in the embodiment of the present invention is provided with a first motion sensor in order to generate data corresponding to the position and / or movement of the first housing, and a second housing (eg, Figure 4 In another embodiment, the state sensing sensor 840 may include a sensor (e.g., a pressure sensor) disposed on a designated portion of the display (e.g., the second display area 532 in FIG. 5 ) to generate data corresponding to the curvature of the corresponding portion.

[0095] In an embodiment, the memory 850 (eg, Figure 1The memory 130 in the DDI 821 may store instructions that, when executed, cause the processor 860 to perform operations of the display driver 830 (e.g., real-time adjustment operations and / or hysteresis adjustment operations) based on data received from the state sensing sensor 840. The memory 850 may be a memory of the DDI 821, or may include at least a portion of the memory. In an embodiment, the memory 850 may store a lookup table (e.g., Table 1) used for the real-time adjustment operation. For example, during the real-time adjustment operation, the processor 860 may identify a brightness code corresponding to the ambient illuminance in Table 1, and may configure the brightness corresponding to the identified code as the brightness of the display 820. In an embodiment, the memory 850 may store a lookup table (e.g., Table 2) used for the hysteresis adjustment operation. The processor 860 may configure the brightness corresponding to the illuminance (e.g., wake-up illuminance) acquired from the illuminance sensor 810 immediately before turning on the display 820 as the brightness of the display 820, and then may turn on the display 820. After turning on the display 820, the processor 860 may perform the hysteresis adjustment operation. For example, referring to Table 2, when the wake-up illuminance is 10 lux, the downward hysteresis can be configured as 1 lux, and the upward hysteresis can be configured as 81 lux. Therefore, if the measured illuminance is 1 lux or less, the brightness lower than the wake-up brightness can be configured as the screen brightness. If the measured illuminance is 81 lux or more, the brightness higher than the wake-up brightness can be configured as the screen brightness.

[0096] [Table 1]

[0097]

[0098] [Table 2]

[0099]

[0100] In an embodiment, the instructions may cause the processor 860 to perform the following operations: measure illuminance by using the illuminance sensor 810; obtain a first color value with respect to an active area 822c of the panel 822 (e.g., the entire display area 822a) and a second color value with respect to a sensor area 822b inside the active area 822c; calculate a correction value to be used when correcting the measured illuminance value based on a ratio between the first color value and the second color value; calculate an illuminance value (e.g., a noise component) corresponding to the brightness of the sensor area 822b based on the second color value and the correction value; and remove the noise component from the illuminance value obtained by using the illuminance sensor, thereby correcting the illuminance value.

[0101] According to an embodiment, the panel 822, the sensor area 822b, the power supply unit, and the power line may be configured as follows: Figure 7Therefore, the instructions may cause the processor 860 to perform the following operations: along the direction in which the power lines (eg, power lines VL1-VLm) extend (eg, Figure 7 The active area 822c is divided into a plurality of partitions (eg, the entire active area 822c, a lower partition, a central partition, and an upper partition); the partitions defined by using the power lines are connected along the gate lines (eg, Figure 7 The gate lines GL1-GLm) extend in the direction (eg, Figure 7 The operation of acquiring color information about each of the delineated sub-partitions may include an operation of acquiring an R / G / B ratio of pixels included in each sub-partition. For example, the R / G / B ratio may include an average value, a median value, or a mode value (e.g., a value that appears most frequently among the values) about each of R / G / B, for example, as a value representing an R value, a G value, and a B value of a pixel included in each sub-partition.

[0102] According to the embodiment, the Figure 4 5 to expand or reduce the active area 822c where visual information (e.g., text, images, or icons) is displayed. Therefore, the instructions may cause the processor 860 to perform the following operations: determine the active area 822c where visual information is displayed in the display area 822a based on the change in the state of the electronic device 800; and divide the determined active area 822c into a plurality of partitions. For example, referring to Figure 5a and Figure 5b , the sensor area 531a may be disposed inside the first housing 510 to be aligned with an upper side 530a (eg, Figure 7 The power supply unit may be disposed inside the second housing 520 to be adjacent to the lower side 530b (eg, Figure 7 The power lines (e.g., power lines VL1-VLm) connected to the power supply unit may extend from the lower side 530b to the upper side 530a. When the electronic device 500 is in the first state (e.g., the normal state), the active area may be the first display area 531, and the processor 860 may accordingly move the first display area 531 along the first direction (e.g., Figure 7 The processor 860 may be arranged along a second direction (eg, a first direction A) extending along the gate line to define a plurality of partitions (eg, two partitions at the same interval). Figure 7The processor 860 may delimit each of the delimited partitions into a plurality of sub-partitions (e.g., each sub-partition may be delimited into two partitions at the same interval, for a total of four sub-partitions) along the first direction (e.g., each sub-partition may be delimited into two partitions at the same interval, for a total of four sub-partitions). When the electronic device 500 undergoes a state change from the first state to the second state (e.g., a state in which the second display area 532 is exposed), the processor 860 may adjust the active area to the entire area of ​​the display 530 (e.g., the first display area 531 and the second display area 532). When the active area is expanded to the entire area, the processor 860 may delimit the entire area into a plurality of partitions (e.g., three partitions) along the first direction, and may delimit each partition into a plurality of sub-partitions along the second direction (e.g., each sub-partition may be delimited into two partitions, for a total of six partitions).

[0103] In an embodiment, the processor 860 (e.g., Figure 1 The processor 120 in the embodiment may include an application processor (AP) 861 and / or an auxiliary processor 862, and may be operably connected to the illuminance sensor 810, the display 820, the display driver 830, the state sensing sensor 840, and the memory 850. The processor 860 may adjust the brightness of the display 820 by using data received from the illuminance sensor 810 and / or the state sensing sensor 840. The AP 861 may convert the data received from the illuminance sensor 810 into an illuminance value, and may correct the illuminance value by using data received from the display 820 (e.g., the DDI 821) (e.g., color information of visual information to be displayed in the active area 822c and the sensor area 822b). The auxiliary processor 862 (e.g., a sensor hub processor) may control the sensor modules (e.g., Figure 1 The auxiliary processor 862 may be used to collect data from the sensor module and process the data while consuming less power than the AP 861. For example, the auxiliary processor 862 may convert data received from the illuminance sensor 810 into an illuminance value, may read the brightness corresponding to the illuminance value from a lookup table (e.g., Table 1), and may transmit it to the DDI 821. The auxiliary processor 862 may correct the illuminance value based on color information of an image displayed in the panel 822 (e.g., the active area 822c and the sensor area 822b), thereby preventing the surrounding illuminance from being distorted due to the driving of the display 820. According to an embodiment, the auxiliary processor 862 may be omitted from the elements of the electronic device 800, and then the AP 861 may perform the function of the auxiliary processor 862.

[0104] In an embodiment, the processor 860 (eg, the AP 861 and / or the auxiliary processor 862) may convert data received from the illuminance sensor 810 into an illuminance value. The processor 860 may perform a real-time adjustment operation or a hysteresis adjustment operation based at least on the illuminance value.

[0105] In an embodiment, the processor 860 (e.g., the AP 861 and / or the auxiliary processor 862) may identify the state of the electronic device 800 by using the data received from the state sensing sensor 840. For example, when the electronic device 800 is a foldable device or a rollable device, the processor 860 may use the data received from the state sensing sensor 840 to calculate at least one of the angle between display areas, the angle of rotation of a rotatable component (e.g., the rotatable component in FIG. 5 ), or the curvature of a designated portion of the display (e.g., the second display area 532 in FIG. 5 ), and may identify the state of the electronic device 800 based on the data acquired as a result of the calculation. The processor 860 may determine the active area 822c of the visual information to be displayed in the display area 822a based on the state of the electronic device 800.

[0106] In an embodiment, the processor (e.g., AP 861 and / or auxiliary processor 862) may configure the measurement time (e.g., integration time) and the measurement cycle of the illumination sensor 810 to acquire light based on the cycle of turning on and off and / or the ratio of turning off (e.g., AMOLED off ratio (AOR)) of the display 820. For example, the display 820 may display a frame while repeatedly turning on and off multiple times. In an embodiment, the illumination around the electronic device 800 may be distorted due to the influence of turning on the display 820. In order to prevent such distortion, the processor 860 may convert the data received from the illumination sensor 810 when the display 820 is turned off into an illumination value.

[0107] In an embodiment, the processor (e.g., the AP 861 and / or the auxiliary processor 862) may measure the illuminance of the surroundings of the electronic device 800 by using data received from the illuminance sensor 810. The processor 860 may correct the illuminance value obtained as a result of the measurement based on color information of an image displayed in the panel 822 (e.g., the active area 822c and the sensor area 822b), thereby preventing the surrounding illuminance from being distorted due to the driving of the display 820.

[0108] Fig. 9 900 is a diagram illustrating an illumination measurement operation based on a period of turning on and off a display according to an embodiment. Figure 8 and Fig. 9, the display 820 may be repeatedly turned on and off multiple times during the time period of the display frame. The time period (e.g., 16.6 ms) during which all the scan lines (e.g., data lines, gate lines, power lines) of the display 820 are continuously operated may be the time (frame time) of the display frame. The turning on and off of the display 820 may be repeated multiple times (e.g., four times) during the frame time. A single time period for turning on and off may be referred to as a pulse period, and the ratio of the opening time (e.g., 4.16 ms) of the pulse period to the entire time may be referred to as a duty cycle.

[0109] In an embodiment, the illumination sensor 810 may be repeatedly turned on and off multiple times during a single frame time. The period during which the illumination sensor 810 is turned on and off may be shorter than the period during which the display 820 is turned on and off.

[0110] In an embodiment, the processor 860 may configure a period and a duty cycle for turning on and off the display 820. The processor 860 may configure the turn-on time of the illuminance sensor 810 to be shorter than the turn-on time of the display 820 so that the illuminance sensor 810 may be turned on when the display 820 is turned off. When the display 820 is turned off, the processor 860 may calculate an illuminance value by using data received from the illuminance sensor 810. With respect to calculating the illuminance value, the processor 860 may exclude data received from the illuminance sensor 860 when the display 820 is turned on.

[0111] Fig.10 1000 is a diagram illustrating an illumination correction operation based on image color information according to an embodiment. Figure 8 and Fig.10 , the illuminance sensor 810 may receive light during a designated measurement time (eg, 50 ms) 1010, may convert the received light into data, and may provide the data to the processor 860. The illuminance sensor 810 may generate an interrupt signal at a time point of providing the data.

[0112] In an embodiment, the display 820 (eg, the DDI 821) may display the active area (eg, Figure 8 The image information may be displayed frame by frame in an active area 822c in the active area, color information corresponding to the frame to be displayed in the active area may be generated, and the color information may be provided to a processor 860 (eg, AP 861 or auxiliary processor 862).

[0113] In an embodiment, the processor 860 may receive a signal from the display 820 (eg, the DDI 821) or a display driver (eg, Figure 8The processor 860 may identify the occurrence of the interrupt signal and may accordingly identify the color information in the memory 850 (e.g., referring to the color information in the memory 850). Fig.10 , regarding third color information 1020 of a third frame displayed on the display 820).

[0114] In an embodiment, the processor 860 may measure the illuminance of the surroundings of the electronic device 800 by using the data received from the illuminance sensor 810, and may correct the illuminance value obtained as a result of the measurement based on the color information recognized in response to the occurrence of the interruption. For example, the processor 860 may acquire the ratio of R (hereinafter referred to as A (active area)_COPR R), the ratio of G (A_COPR G), and the ratio of B (A_COPR B) in the active area 822c from the recognized color information (eg, the third color information 1020) in the memory 850. The processor 860 may acquire the ratio of R (hereinafter referred to as S (sensor area)_COPR R), the ratio of G (S_COPR G), and the ratio of B (S_COPR B) in the sensor area 822b from the color information. In addition, the processor 860 may acquire COPR R / G / B for each demarcated partition (or sub-partition) from the color information. The processor 860 may calculate an illuminance value (e.g., a noise component) corresponding to the brightness of the sensor area 822b based on the acquired ratio information, and may remove the noise component from the illuminance value obtained as a result of the measurement, thereby correcting the illuminance value so as to converge toward the actual illuminance on the periphery of the electronic device 800. For example, the ratio of R in the active area 822c (A_COPR R) may correspond to a value (such as an average, a median, or a mode value) representing R of an image to be displayed in the active area 822c. The ratio of R in the sensor area 822b (S_COPR R) may correspond to a value (such as an average, a median, or a mode value) representing a portion of an image to be displayed in the sensor area 822b.

[0115] When an image is displayed in an active area in an environment with the same external illumination, even if the color information (e.g., COPR information) maintained by the portion to be displayed in the sensor area is the same between a plurality of images, the brightness in the sensor may be different when each image is displayed. Therefore, the illuminance value (e.g., noise component) corresponding to the brightness of the sensor area may be calculated differently between the plurality of images. Therefore, the noise component may be calculated differently each time, and the correction of the illuminance value acquired by using the illuminance sensor 810 may become inaccurate due to such deviation. Fig.11 and Fig.12 The described embodiments may provide an electronic device configured to reduce the above-mentioned deviation so that the correction accuracy may be improved.

[0116] Fig.11 The display can be displayed (for example, Figure 8 The active area of ​​the display 820 (eg, Figure 8 Images A, B and C are displayed in the active area 822c). Fig.12 A first graph 1210 and a second graph 1220 are shown. The first graph 1210 shows when Fig.11 The illuminance values ​​experimentally obtained when images A, B, and C in are displayed in the active area (e.g., by using Figure 8 ), the second graph 1220 shows a value obtained by multiplying the ratio between the color value of the active area (e.g., A_COPR W) and the color value of the sensor area (e.g., sensor area 822 b) (e.g., S_COPR W) by a predetermined value (e.g., 150) for comparison with the first graph 1210.

[0117] Reference Fig.11 , the corresponding images A, B, and C can be displayed in the active area at a specified frame time (e.g., 16ms). The display (e.g., Figure 8 820) or a display driver (e.g., Figure 8 The display driver 830 in FIG. 8 may generate color information for each image and may provide it to a processor (eg, Figure 8 The color information of the image displayed in the active area may be different between images A, B, and C, but the color information of the portions 1110, 1120, and 1130 corresponding to the sensor area may be the same. For example, as given in Table 3 below, when images A, B, and C are displayed, the portion corresponding to the active area of ​​the image and the portion corresponding to the sensor area thereof may have different A_COPR R / G / B and the same S_COPR R / G / B.

[0118] [Table 3]

[0119]

[0120] Referring to Table 3 and the first graph 1210, when images A, B, and C are displayed in the active area, different illuminance values ​​may be experimentally obtained. For example, it may be confirmed from Table 3 and the first graph 1210 that there is a relationship between the A_COPR R / G / B of the active area and the illuminance value measured by the illuminance sensor. For example, the color information (A_COPR R / G / B) and the illuminance value in the active area have an inverse relationship, and the reason may be, for example, as follows.

[0121] In an embodiment, the brightness of a pixel may be related to the power supplied from a power supply unit (eg, Figure 7 The power supply unit 730 in the embodiment is proportional to the size of the current supplied to the pixel. Figure 7 It is assumed that the power supply unit 730 is located at the lower end of the display 820, but it will be easily understood by those skilled in the art that the position of the power supply unit 730 is not limited thereto. In an embodiment, the active area may play the role of a heavy load, which consumes relatively more power when displaying the second image B having more bright parts (e.g., white having a specified or higher R / G / B value) than when displaying the first image A (hereinafter, referred to as the first condition). Therefore, in the case of the second condition, a relatively small amount of current may flow to the pixels in the sensor area compared to the first condition. At the same time, the illuminance sensor may have a sensitivity (e.g., gain) configured to be high so as to receive external light that has passed through the sensor area. Therefore, even in the case of a slight change in the brightness of the sensor area, the illuminance value obtained by using the illuminance sensor may also change relatively significantly. Therefore, although the external illuminance is the same, the brightness of the sensor area under the second condition may become slightly smaller than the first condition, and the illuminance value measured by using the illuminance sensor may be significantly reduced.

[0122] In an embodiment, when an image is displayed in the active area, the processor (e.g., Figure 8 The processor 860 in the embodiment may, for example, retrieve data from a memory (e.g., Figure 8 The processor may obtain the color information of the image by using the color information obtained from the memory 850. The processor may obtain the first color value about the active area and the second color value about the sensor area by using the color information obtained from the memory. In an embodiment, the processor may obtain A_COPR W and S_COPR W as the first color value and the second color value by using the following equation 1. In equation 1, Cr, Cg, and Cb are coefficients obtained experimentally. For example, referring to Table 3, images A, B, and C may have different A_COPR W and the same S_COPR W.

[0123] [Equation 1]

[0124]

[0125] In an embodiment, a processor (e.g., Figure 8 The processor 860 in the embodiment may calculate a first correction value to be used when correcting an illuminance value acquired by using the illuminance sensor based on a ratio between the first color value and the second color value.

[0126] In an embodiment, a processor (e.g., Figure 8The processor 860 in the display may configure the ratio so as to have a proportional relationship with the illuminance value. For example, the ratio R may be configured as in the following equation 2. As is clear from the first graph 1210 indicating the illuminance value and the second graph 1220 indicating "ratio (S COPR W / A COPR W)*150", the ratio has been configured to have a proportional relationship with the illuminance value. For example, when an image including many color values ​​(e.g., image C) whose COPR W value is close to 255 is displayed, a low illuminance value may be measured, and the ratio R may be reduced by a relatively large amount.

[0127] [Equation 2]

[0128]

[0129] In an embodiment, a processor (e.g., Figure 8 The processor 860 in FIG. 8 may obtain the load Lux ​​as the first correction value by using the following equation 3. In equation 3, load a, load b, and load c are coefficients obtained experimentally.

[0130] [Equation 3]

[0131]

[0132] According to a comparative example to be compared with the embodiment of the present disclosure, if the illuminance value is corrected by using the second color value (eg, S_COPR W), the correction accuracy may be reduced. Figure 8 , the portable electronic device 800 may configure the brightness corresponding to the illuminance (e.g., wake-up illuminance) acquired from the illuminance sensor 810 immediately before turning on the display 820 as the brightness of the display 820, and then may turn on the display 820. After turning on the display 820, the portable electronic device 800 may perform a hysteresis adjustment operation. For example, referring to Table 2, when the wake-up illuminance is 100 lux, the downward hysteresis may be configured to 40 lux, and the upward hysteresis may be configured to 402 lux. Therefore, if the measured illuminance is 40 lux or less, a brightness lower than the wake-up brightness may be configured as the screen brightness. If the measured illuminance is 402 lux or more, a brightness higher than the wake-up brightness may be configured as the screen brightness. Meanwhile, if a specific image (e.g., image A) is displayed in the active area 822c even after changing to a dark environment (e.g., a dark room) where the external illumination is 40 lux or less, the processor 860 may mistakenly recognize that the external illumination is relatively higher than 40 lux due to the second color value (e.g., S_COPR W), and may still maintain the brightness of the display 820 at the wake-up brightness.

[0133] In an embodiment, a processor (e.g., Figure 8The processor 860 in the embodiment may calculate the illuminance (noise component) corresponding to the brightness of the sensor area based on the second color value and the first correction value. For example, the processor may correct the second color value to a third color value (e.g., S_COPR W+load lux) by using the first correction value. The processor may calculate the illuminance value (noise component) corresponding to the brightness of the sensor area based on the third color value.

[0134] In an embodiment, a processor (e.g., Figure 8 The processor 860 in the display may remove a noise component from the illuminance value acquired by using the illuminance sensor, thereby correcting the illuminance. For example, in the case where the external illuminance changes to 40 lux or less (e.g., a dark room) while a specific image is being displayed, the processor may configure the display brightness to be lower than the wake-up brightness, thereby preventing the user's eyes from being dazzled.

[0135] When an image is displayed in an active area in an environment where the external illumination is the same, in some cases, the brightness in the sensor area may be different between multiple images, although the first color value and the second color value are the same between the multiple images. Therefore, a different noise component may be calculated each time, and the correction of the illumination acquired by using the illumination sensor 810 may become inaccurate due to such deviation. The embodiments described below with reference to FIGS. 13 to 18 may provide an electronic device that is configured to reduce the above deviation so that the correction accuracy can be improved.

[0136] Fig.13a An active area 1300 and a sensor area 1310 of a display are shown, and Fig.13b Images D, E, and F that may be displayed in active area 1300 are shown. Fig.14 A third graph is shown which shows experimentally obtained luminance values ​​(eg, by using Figure 8 illuminance value obtained by the illuminance sensor 810 in FIG. 8 ).

[0137] Refer to Figure 13 and Fig.14 , can be in the active area 1300 (eg, Figure 8 The corresponding images D, E and F are displayed in the active area 822c in the display (e.g., Figure 8 820) or a display driver (e.g., Figure 8 The display driver 830 in FIG. 8 may generate color information for each image and may provide it to a processor (eg, Figure 8860 in the processor). For example, the processor may obtain D(A_COPR W) and D(S_COPR W) as the first color value and the second color value by using Equation 1. The processor 860 may similarly obtain E(A_COPR W), E(S_COPR W), F(A_COPR W), and F(S_COPR W).

[0138] In the sensor area 1310 (eg, Figure 8 The portion shown in the sensor area 822b in FIG. 1300 may be the same in all images D, E, and F. For example, the active area 1300 may be based on the Figure 7 and Figure 8 The demarcation method is demarcated into a plurality of partitions a, b, c, d, e, f, g, and h. The processor may specify "b" among the demarcated partitions as a partition including the sensor area 1310. The number of partitions shown is merely an example, and the technical concept of the present disclosure is not limited thereto. For example, the active area 1300 may be demarcated more densely or wider than shown. The active area 1300 may be demarcated more densely in proportion to the proximity of the illumination sensor. For example, a partition close to the sensor area 1310 may have a small area, while a partition relatively far from the sensor area 1310 may have a relatively large area. The second color values ​​D (S_COPR W), E (S_COPR W), and F (S_COPR W) corresponding to the sensor area 1310 may be the same. However, although the first color values ​​D (A_COPR W), E (A_COPR W), and F (A_COPR W) corresponding to the entire active area 1300 are also calculated to be the same, as shown in FIG. Fig.14 As shown, experimentally obtained luminance values ​​may differ between images D, E, and F. For example, a bright portion (e.g., white) of image D is displayed in subareas c and d in active area 1300, a bright portion of image E is displayed in subareas e and f in active area 1300, and a bright portion of image F is displayed in subareas g and h in active area 1300. Fig.14 It is clear from FIG. 1 that the farther such a bright portion is located from the sensor region 1310, the greater the illuminance value becomes. That is, the distance between the bright portion and the sensor region 1310 is inversely proportional to the illuminance value, and can be referred to as Figure 7 and Figure 8 Describe the reasons as follows:

[0139] The panel 822, the sensor area 822b, the power supply unit and the power line can be configured as follows: Figure 7The type and structure in are constructed. As described above, a voltage drop (e.g., IR drop) may occur in the power line, so a smaller amount of current may flow to the sub-pixel (sensor area 822b) that is relatively far from the power supply unit compared to the sub-pixel that is arranged close to the power supply unit. However, when the bright part moves toward the power supply unit, the voltage drop in the power line may decrease. The current flowing to the pixel in the sensor area 822b may increase in proportion to the amount of reduction in the voltage drop, and the brightness of the sensor area 822b may increase in proportion to the increased amount of current. At the same time, the illuminance sensor may have a sensitivity (e.g., gain) that is configured to be high because the illuminance sensor receives external light that has passed through the sensor area 822b. Therefore, even in the case where the brightness of the sensor area 822b changes slightly, the illuminance value obtained by using the illuminance sensor may also change relatively greatly. Therefore, although the external illuminance is the same, and although the color value corresponding to the active area 822c is calculated to be equal, the brightness of the sensor area 822b may change slightly according to the distance between the bright part and the sensor area 822b. Such small changes may result in large errors in the illuminance values ​​measured by using an illuminance sensor.

[0140] and Figure 7 Unlike the structure in FIG. 1 , the power supply unit can be arranged close to the sensor area (for example, Figure 7 In this case, the distance between the bright portion and the sensor region 822b may be proportional to the brightness of the sensor region 822b.

[0141] In an embodiment, a processor (e.g., Figure 8 The processor 860 in the embodiment may delimit the active area into a plurality of partitions, and may obtain color values ​​regarding the corresponding delimited partitions. Referring to FIG. 13 , for example, the processor may delimit the active area 1300 into a, b, c, d, e, f, g, and h, and may obtain color values ​​regarding the respective partitions (a_COPR W, b_COPR W, c_COPR W, d_COPR W, e_COPR W, f_COPR W, g_COPR W, h_COPR W) by using Equation 1.

[0142] In an embodiment, a processor (e.g., Figure 8The processor 860 in the sensor area 1310 may calculate a second correction value to be used during the correction of the illuminance value based on the acquired color values ​​about each partition. Referring to FIG. 13 , for example, the processor may calculate a first reference value based on the maximum value among the color values ​​(a_COPR W, b_COPR W, c_COPR W, d_COPR W, e_COPR W, f_COPR W, g_COPR W, h_COPR W), the first reference value representing the distance between the brightest part and the sensor area 1310 (hereinafter referred to as the reference distance). The processor may correct the ratio R by using the first reference value, and may correct the first correction value using the corrected ratio, thereby obtaining the second correction value. Alternatively, the processor may correct the first correction value by using the first reference value, thereby obtaining the second correction value. If the reference distance is inversely proportional to the brightness of the sensor area 1310, the ratio (or the first correction value) may be adjusted downward as the first reference value increases. If the reference distance is proportional to the brightness of the sensor area 1310, the ratio (or the first correction value) may be adjusted upward as the first reference value increases.

[0143] In an embodiment, a processor (e.g., Figure 8 The processor 860 in the sensor area 822b may calculate an illuminance value (eg, a noise component) corresponding to the brightness of the sensor area 822b based on the second color value and the second correction value, and may remove the noise component from the illuminance value acquired by using the illuminance sensor 810, thereby correcting the illuminance value.

[0144] In the embodiment shown in FIG. 13 , the reference gate lines GL1 -GLm extend in a direction (eg, Figure 7 The second direction B in the direction of the line VL1-VLm extending (eg, Figure 7 In the first direction A in FIG, the plurality of partitions are divided into a plurality of partitions a, b, c, d, e, f, g and h, but this is not limited in any way. For example, a plurality of partitions may be divided only in the first direction A.

[0145] Fig.15 Shown in Fig.13a Images G, H, I, J, K, and L are displayed in the active area 1300 in FIG. Fig.16 A fourth graph is shown, which shows that when Fig.15 The illumination values ​​experimentally obtained when the image in is displayed in the active area 1300.

[0146] According to various embodiments, the active area 1300 may be demarcated into a plurality of partitions a, b, c, d, e, f, g, and h according to a specified demarcation method. Figure 6 The partition is defined by the position of the illumination sensor in the electronic device or the position of the sensor area 1310. Figure 8 The display driver 830 in the processor may use a line (e.g., a power line) with reference to the position of the illumination sensor or the position of the sensor area 1310 to delimit the partitions so that the sensor area 1310 is included in one group thereof and not included in another group thereof. For example, the partitions may be delimited by the processor with reference to a line (e.g., a power line number 20) so that the partition "b" includes the sensor area 1310. For ease of description, it will be assumed that, with reference to the line used for delimitation, the partitions in the same row or column (e.g., partitions "b", "d", "f", and "h") are located on the same line.

[0147] Reference Fig.15 and Fig.16 , although all images have the same ratio occupied by bright parts (e.g., white) in each image, the brightness of sensor area 1310 is higher when more bright parts are on the same line as the partition including sensor area 1310. For example, a comparison between images G and H shows that although both images have the same bright part ratio, the bright part of image H is on the same line as the partition where sensor area 1310 is located, and the bright part of image G is not on the same line as the part that will be displayed in partition b. Fig.16 As a result, it can be confirmed that the illuminance value when the image H is displayed is higher than the illuminance value when the image G is displayed.

[0148] In an embodiment, a processor (e.g., Figure 8 The processor 860 in the sensor area 1310 may group the partitions b, d, f, and h located on the same line as the partition b including the sensor area 1310 among the demarcated partitions a, b, c, d, e, f, g, and h into a first group, and may group the partitions a, c, e, and g located on different lines into a second group. For example, the processor may obtain color values ​​of the first group (e.g., b_COPR W, d_COPR W, f_COPR W, h_COPR W) and color values ​​of the second group (e.g., a_COPR W, c_COPR W, e_COPR W, f_COPR W) by using Equation 1.

[0149] In an embodiment, a processor (e.g., Figure 8The processor 860 in the embodiment of the present invention may calculate a third correction value to be used when correcting the illuminance value acquired by using the illuminance sensor based on the color values ​​of the first group and the second group. For example, the processor may calculate a second reference value corresponding to the difference between the color of the first group and the color of the second group. For example, the second reference value may indicate the difference between the average value of the color values ​​of the first group and the average value of the color values ​​of the second group. The processor may obtain the third correction value by correcting the ratio R using the second reference value, and may correct the first correction value by using the corrected ratio. Alternatively, the processor may obtain the third correction value by correcting the second correction value using the second reference value. For example, if the second reference value indicates that the second group is brighter than the first group, the ratio (or the second correction value) may be adjusted downward to a lower value.

[0150] Fig.17a A display 1700 is shown in which the active area is adjustable according to an embodiment, and Fig.17b Images 1740 and 1750 that may be displayed in the active area of ​​display 1700 are shown.

[0151] Reference Fig.17a , the display 1700 may be mounted on Figure 4 The display 440 on the portable electronic device 400 in FIG. Figure 7 and Figure 8 The demarcation method described herein demarcates the display 1700 into a plurality of partitions a, b, c, d, e, f, g, and h. Among the demarcated partitions, partition b may be accessed by a processor (e.g., Figure 8 The processor 860 in the display 1700 is designated as a partition including a sensor area 1710, under which an illumination sensor is disposed. The closer to the illumination sensor, the more densely the display 1700 can be demarcated. For example, when the power supply unit is disposed in contact with the lower side of the panel (e.g., Figure 7 When the illumination sensor is disposed adjacent to the upper side (eg, Figure 7 When the fourth side 710d in FIG. 1 is adjacent to the illumination sensor, and when the power line extends from the lower side to the upper side, a more severe voltage drop (e.g., IR drop) may occur closer to the illumination sensor. Therefore, the processor may delimit the portion of the display 1700 adjacent to the illumination sensor more densely than the portion of the display 1700 adjacent to the power supply unit. In an embodiment, the processor (e.g., Figure 8The processor 860 in the display 1700 may determine the active area in the display 1700 according to the state of the portable electronic device, and may divide the active area into a plurality of partitions. For example, when the portable electronic device is identified as being in a folded state, the processor may determine a portion 1720 of the display area 1730 as the active area, and may divide the portion 1720 into a plurality of partitions, such as a, b, c, and d. The processor may display the portion 1720 designated as the active area. Fig.17b The processor may obtain a color value (A_COPR W) about the entire active area (e.g., part 1720) and color values ​​(a_COPR W, b_COPR W, c_COPR W, d_COPR W) about each partition based on color information received from the display 1700, for example, by using Equation 1. The processor may obtain a correction value to be used during illuminance value correction based on the acquired color value. For example, the processor may calculate a ratio between a color value (b_COPR W) of the partition b including the sensor area 1710 and a color value (A_COPR W) about the entire active area, for example, by using Equation 2, and may obtain a correction value (e.g., load lux in Equation 3) by using the calculated ratio. The processor may calculate a noise component by using the color value (COPR W) of the partition b including the sensor area 1710 and the calculated correction value, and may remove the noise component from the illuminance value acquired by using the illuminance sensor, thereby correcting the illuminance value.

[0152] In an embodiment, a processor (e.g., Figure 8 The processor 860 in the display 1700 may apply a weight to (e.g., multiply) a ratio (e.g., a ratio calculated by using Equation 2) or a correction value (e.g., a load Lux ​​in Equation 3) based on a display position of a bright portion (e.g., white) of an image to be displayed on the display 1700. For example, the processor may obtain the correction value based on a distance between a partition b designated as the sensor area 1710 and a partition (e.g., partition d) having a maximum color value (COPR W) among other partitions. For example, the distance may be a distance between a center coordinate of the partition b and a center coordinate of the partition d. As another example, the processor may group partitions (e.g., partitions b and d) located on the same line as the partition b including the sensor area 1710 into a first group, and may group partitions (e.g., partitions a and c) located on a line different from the partition b into a second group. The processor may further obtain the correction value based on a difference between a color of the first group and a color of the second group (e.g., a difference between an average value of color values ​​of the first group and an average value of color values ​​of the second group).

[0153] In an embodiment, a processor (e.g., Figure 8The processor 860 in the display 1700 may change the active area of ​​the display 1700 as the state of the portable electronic device changes. For example, the processor may recognize that the state of the portable electronic device changes from the folded state to the unfolded state. In response to such a state change, the processor may determine the entire display area 1730 as the active area, and may delimit the display area 1730 into a plurality of partitions, such as a, b, c, d, e, f, g, and h. The processor may designate the partition b among the delimited partitions as a partition including the sensor area 1710 with the illuminance sensor disposed thereunder. The processor may display the image 1750 in the entire display area 1730 designated as the active area, and may acquire a color value (A_COPRW) about the entire active area (i.e., the display area 1730) and color values ​​(a_COPR W, b_COPR W, c_COPR W, d_ COPR W, e_COPR W, f_COPRW, g_COPR W, h_COPR W) about each partition based on the color information received from the display 1700, for example, by using Equation 1. The processor may obtain a correction value by using the acquired color value, and may correct the illuminance value by using the correction value.

[0154] In the embodiment shown in FIG. 17 , the reference gate lines GL1 -GLm extend in a direction (eg, Figure 7 , and the direction in which the line VL1 -VLm extends (for example, Figure 7 In the first direction A of the image processing unit, the plurality of partitions are divided into a plurality of partitions a, b, c, d, e, f, g and h, but this is not limited in any way. For example, a plurality of partitions may be divided only in the first direction A.

[0155] Fig.18a A display 1800 is shown in which the active area is adjustable according to an embodiment, and Fig.18b 18, the display 1800 may be the display 530 mounted on the portable electronic device 500 in FIG. 5. In an embodiment, the processor (eg, Figure 8The processor 860 in the portable electronic device may determine the active area of ​​the display 1800 according to the state of the portable electronic device, and may delimit the active area into a plurality of partitions. For example, when the portable electronic device is identified as being in the first state (or normal state), the processor may determine a portion 1820 of the display area 1830 as the active area. The processor may display a first image 1840 in the active area (portion 1820). The processor may delimit the portion 1820 designated as the active area into a plurality of partitions, such as a, b, c, and d, and may designate a partition b among the plurality of partitions as a partition including the sensor area 1810. When the portable electronic device is identified as being in the second state (or extended state), the processor may designate the entire display area 1830 as the active area. The processor may display a second image 1850 in the entire display area 1830. The processor may delimit the entire display area 1830 designated as the active area into a plurality of partitions, such as a, b, c, d, e, and f, and may designate a partition b among the plurality of partitions as a partition including the sensor area 1810. The processor may correct the illuminance value in the same manner as used in FIG. 17 .

[0156] Fig.19 An operation for configuring the brightness of a screen by using an illuminance sensor according to various embodiments is illustrated.

[0157] In operation 1910 , the illuminance sensor 810 may receive light during a designated measurement time, may convert the received light into data, and may provide the data to the processor 860 .

[0158] In operation 1920 , the processor 860 may measure the illuminance of the surroundings of the electronic device 800 by using the data received from the illuminance sensor 810 in response to an interrupt signal generated by the illuminance sensor 810 at a data provision time point.

[0159] In operation 1930, the processor 860 may acquire color information (eg, COPR, AOR) of an image displayed in the active region 822c. For example, the processor 860 may determine, based on the state of the electronic device 800, to display the image in the display region (eg, Figure 8 The active area (eg, display area 822a) of the image is displayed in the display area 822b. Figure 8The display 820 may display an image in the active area 822c determined by the processor 860 at each designated frame time. The display 820 (e.g., the DDI 821) or the display driver 830 may provide the processor 860 with color information corresponding to the image displayed (or to be displayed) in the active area 822c. The processor 860 may update the color information stored in the memory 850 to the provided color information. The processor 860 may obtain the updated color information from the memory 850 in response to the interrupt signal. In addition, the processor 860 may update the color information stored in the memory 850 by referring to the interrupt signal. Figure 7 and Figure 8 The described demarcation method demarcates the active area 822c into a plurality of partitions.

[0160] At operation 1940, the processor 860 may obtain a first color value regarding the active area 822c and a second color value regarding the sensor area 822b (or a partition including the sensor area 822b) by using the acquired color information. In addition, the processor 860 may acquire color values ​​regarding corresponding demarcated partitions.

[0161] In operation 1950, the processor 860 may correct the illuminance value acquired as a result of measuring the ambient illuminance based on at least the first color value and the second color value. For example, the processor 860 may obtain a first correction value by using equations 1, 2, and 3, may correct the second color value to a third color value by using the first correction value, may calculate an illuminance value (noise component) corresponding to the brightness of the sensor area 822b (or a partition including the sensor area 822b) based on the third color value, and may remove the noise component from the illuminance value acquired as a result of the measurement. As another example, the processor 860 may obtain a second correction value based on the acquired color values ​​about each partition, may calculate an illuminance value (noise component) corresponding to the sensor area 822b (or a partition including the sensor area 822b) based on the second color value and the second correction value, and may remove the noise component from the illuminance value acquired by using the illuminance sensor 810. As another example, the processor 860 may divide the delineated partition into a first group located on the same line (power line) as the portion to be displayed on the partition including the sensor area 822 b and a second group located on a different line, and may calculate a third correction value based on the color value of the first group and the color value of the second group (e.g., the average color value of the first group and the average color value of the second group). An illuminance value (noise component) corresponding to the partition including the sensor area 822 b may be calculated based on the second color value and the third correction value, and the noise component may be removed from the illuminance value acquired by using the illuminance sensor 810.

[0162] In operation 1960 , the processor 860 may configure the brightness of the display 820 based on the corrected illuminance value.

[0163] A portable electronic device according to various embodiments may include: a housing (eg, Figure 3 The housing 310, Figure 4 5 ), including a front surface and a rear surface; a display, which is disposed in a space formed inside the housing and is exposed through the front surface; an illuminance sensor, which is disposed in an active area of ​​the display (e.g., Figure 8 and a processor connected to the display and the illuminance sensor, wherein the processor is configured to: calculate an illuminance value by using data received from the illuminance sensor, obtain color information of an image displayed in the active area, calculate a first color value about the active area and a second color value about the sensor area by using the color information, correct the illuminance value based on the first color value and the second color value, and configure the brightness of the display based on the corrected illuminance value.

[0164] The processor may be configured to calculate a first color value by using a ratio of RGB in the active area acquired from the color information, and to calculate a second color value by using a ratio of RGB in the sensor area acquired from the color information. The ratio of RGB in the active area may include an average value of R values, an average value of G values, and an average value of B values ​​to be displayed at pixels in the active area. The ratio of RGB in the sensor area may include an average value of R values, an average value of G values, and an average value of B values ​​to be displayed at pixels in the sensor area.

[0165] The processor may be configured to obtain a color ratio of the second color value to the first color value, and calculate a first correction value to be used when correcting the calculated illuminance value based on the color ratio. The processor may be configured to correct the second color value to a third color value by using the first correction value, calculate a noise component corresponding to the brightness of the sensor area based on the third color value, and correct the illuminance value by removing the noise component from the illuminance value.

[0166] The display may include a panel and a display driver IC (DDI), the panel including a plurality of pixels and a plurality of power lines for supplying power to the pixels, the display driver IC being configured to control the panel so as to display visual information, and the processor may be configured to demarcate the active area into a plurality of partitions along a first direction in which the plurality of power lines extend, calculate color values ​​regarding each of the partitions by using the color information, and acquire a second correction value to be used when correcting the calculated illuminance value by correcting a color ratio or a first correction value based on the color values ​​regarding each of the partitions.

[0167] The processor may be configured to delimit each of the delimited partitions into a plurality of sub-partitions along a second direction perpendicular to the first direction.

[0168] The processor may be configured to divide a portion of the active area into a plurality of first partitions along an extension direction of a first power line among the plurality of power lines, the sensor area being located on the first power line, divide another portion of the active area into a plurality of second partitions along an extension direction of a second power line, the sensor area being not located on the second power line, and obtain a third correction value to be used when correcting the calculated illuminance value by correcting the color ratio or the second correction value based on a difference between a color value of the first partition and a color value of the second partition obtained by using the color information.

[0169] The panel may have a quadrilateral shape having a first side extending in a first direction, a second side extending parallel to the first side, a third side extending in a second direction perpendicular to the first side, and a fourth side extending parallel to the third side, the power line may extend from the first side to the second side parallel to the first direction, the power supply unit may be disposed adjacent to the first side so as to supply power to the pixel through the power line, and the illuminance sensor may be disposed adjacent to the second side.

[0170] The portable electronic device may also include a state sensing sensor configured to generate data used to identify multiple structurally different states of the portable electronic device, and the processor may be configured to identify the structural state of the portable electronic device based on the data received from the state sensing sensor, and determine the active area in the display area of ​​the display based on the identified state.

[0171] The shell may include a first shell and a second shell coupled to the first shell so as to be able to slide from the first shell, the display may include a first display area and a second display area, the second display area is constructed to be exposed from the shell when the second shell slides from the first shell, and to move into the shell when the second shell slides toward the first shell, and the processor may be configured to determine the first display area as the active area when the portable electronic device is in a first state in which the second display area is hidden, and to determine the first display area and the second display area as the active area when the portable electronic device is in a second state in which the second display area is exposed.

[0172] When the second shell slides toward the first shell, the second display area may be wrapped around a rotatable component arranged in the second shell, and when the second shell slides away from the first shell, the second display area may be unfolded from the rotatable component, and the state sensing sensor may include an encoder sensor or a Hall sensor attached to the rotatable component.

[0173] The housing may include a first housing and a second housing coupled to the first housing so as to be rotatable, the display may include a first display area disposed on the first housing and a second display area disposed on the second housing, and the processor may be configured to identify that the portable electronic device is in a first state or a second state based on data indicating an angle between the first housing and the second housing received from the state sensing sensor. When the portable electronic device is in the first state, the first display area or the second display area is determined as the active area, and when the portable electronic device is in the second state, the first display area and the second display area are determined as the active area. The state sensing sensor may include: an encoder sensor or a Hall sensor attached to a hinge assembly connecting the first housing and the second housing; or a first motion sensor disposed in the first housing and a second motion sensor disposed in the second housing.

[0174] The display may include a display driver IC (DDI) and a panel, and the DDI may be configured to control the panel to output an image frame by frame and transmit color ratio (COPR) information on pixels of the frame to be output as color information to a processor.

[0175] According to various embodiments, a portable electronic device may include: a slidable shell (e.g., shells 510 and 520 in FIG. 5 ), including a first shell and a second shell coupled to the first shell so as to be able to slide relative to the first shell; a scroll unit (or a rotatable component); a flexible display, including a first display area disposed adjacent to the first shell and a second display area disposed in an internal space of the portable electronic device while surrounding the scroll unit; an illuminance sensor, when facing the display, disposed below a sensor area in an active area of ​​the display where visual information will be displayed; a processor, connected to the display and the illuminance sensor; and a memory, connected to the processor, and the memory may store instructions that, when executed, cause the processor to perform: an operation of calculating an illuminance value by using data received from the illuminance sensor, an operation of acquiring color information of an image displayed in the active area, an operation of calculating a first color value about the active area and a second color value about the sensor area by using the color information, an operation of correcting the illuminance value based on the first color value and the second color value, and an operation of configuring the brightness of the display based on the corrected illuminance value.

[0176] The embodiments of the present disclosure disclosed in the specification and the drawings are only specific examples given to easily describe the technical content according to the embodiments of the present disclosure and to help understand the embodiments of the present disclosure, and are not intended to limit the scope of the embodiments of the present disclosure. Therefore, in addition to the embodiments disclosed herein, the scope of the various embodiments of the present disclosure should be interpreted as covering all changes or modifications derived from the technical ideas of the various embodiments of the present disclosure.

Claims

1. A portable electronic device, comprising: a housing, comprising a front surface and a rear surface; a display disposed in a space formed inside the housing and exposed through the front surface; an illumination sensor disposed, facing the display, below a sensor area in an active area of ​​the display where visual information will be displayed; as well as a processor connected to the display and the illuminance sensor, Wherein, the processor is configured to: calculating an illuminance value by using data received from the illuminance sensor; Acquire color information of an image displayed in the active area; calculating a first color value for the active area and a second color value for the sensor area by using the color information; Obtaining a color ratio of a second color value to a first color value; calculating a first correction value based on the color ratio; Correcting the calculated illuminance value using the first correction value; and The brightness of the display is configured based on the corrected luminance value.

2. The portable electronic device according to claim 1, wherein: The processor is configured to: calculating a first color value by using a ratio of RGB in the active area acquired from the color information; and A second color value is calculated by using a ratio of RGB in the sensor area acquired from the color information.

3. The portable electronic device according to claim 2, wherein: The ratio of RGB in the active area includes an average value of R values, an average value of G values, and an average value of B values ​​to be displayed at pixels in the active area, and The ratio of RGB in the sensor area includes an average value of R values, an average value of G values, and an average value of B values ​​to be displayed at pixels in the sensor area.

4. The portable electronic device according to claim 1, wherein: The processor is configured to: correcting the second color value to a third color value by using the first correction value; calculating a noise component corresponding to the brightness of the sensor area based on a third color value; and The illuminance value is corrected by removing the noise component from the illuminance value.

5. The portable electronic device according to claim 1, wherein: The display includes a panel including a plurality of pixels and a plurality of power supply lines for supplying power to the pixels, and a display driver IC (DDI) configured to control the panel so as to display visual information, and Wherein, the processor is configured to: Delimiting the active area into a plurality of partitions along a first direction in which the plurality of power lines extend; calculating a color value for each partition by using the color information; and A second correction value to be used in the case of correcting the calculated illuminance value is acquired by correcting the color ratio or the first correction value based on the color values ​​regarding the respective partitions.

6. The portable electronic device according to claim 5, wherein: The processor is configured to demarcate each of the demarcated partitions into a plurality of sub-partitions along a second direction perpendicular to the first direction.

7. The portable electronic device according to claim 5, wherein: The processor is configured to: dividing a portion of the active area into a plurality of first subareas along an extension direction of a first power line among the plurality of power lines, wherein the sensor area is located on the first power line; dividing another part of the active area into a plurality of second subareas along the extension direction of the second power line, wherein the sensor area is not located on the second power line; as well as A third correction value to be used in the case of correcting the calculated illuminance value is acquired by correcting the color ratio or the second correction value based on a difference between the color value of the first subarea acquired by using the color information and the color value of the second subarea.

8. The portable electronic device according to claim 5, wherein: The panel has a quadrilateral shape having a first side extending in a first direction, a second side extending parallel to the first side, a third side extending in a second direction perpendicular to the first side, and a fourth side extending parallel to the third side, The power line extends from the first side to the second side in parallel with the first direction. wherein a power supply unit is arranged adjacent to the first side so as to supply power to the pixel through the power supply line, and Wherein, the illumination sensor is arranged adjacent to the second side.

9. The portable electronic device of claim 1, further comprising a state sensing sensor configured to generate data used to identify a plurality of different states of the structure of the portable electronic device, in, The processor is configured to: identifying a structural state of the portable electronic device based on data received from the state sensing sensor; as well as Based on the identified state, the active area in the display area of ​​the display is determined.

10. The portable electronic device according to claim 9, wherein: The housing includes a first housing and a second housing coupled to the first housing so as to be slidable from the first housing, wherein the display includes a first display area and a second display area, the second display area being configured to be exposed from the housing when the second housing slides from the first housing, and to move into the housing when the second housing slides toward the first housing, and Wherein, the processor is configured to: When the portable electronic device is in a first state in which the second display area is hidden, determining the first display area as the active area; and In a case where the portable electronic device is in a second state in which the second display area is exposed, the first display area and the second display area are determined as the active area.

11. The portable electronic device according to claim 10, wherein: When the second housing slides toward the first housing, the second display area is wound around a rotatable component disposed in the second housing, and when the second housing slides away from the first housing, the second display area is unfolded from the rotatable component, and Wherein, the state sensing sensor includes an encoder sensor or a Hall sensor attached to the rotatable component.

12. The portable electronic device according to claim 9, wherein: The housing includes a first housing and a second housing coupled to the first housing so as to be rotatable, The display includes a first display area disposed on the first housing and a second display area disposed on the second housing, and Wherein, the processor is configured to: identifying that the portable electronic device is in a first state or a second state based on data indicating an angle between the first housing and the second housing received from the state sensing sensor; When the portable electronic device is in a first state, determining the first display area or the second display area as the active area; and When the portable electronic device is in the second state, the first display area and the second display area are determined as the active areas.

13. The portable electronic device according to claim 12, wherein: The state sensing sensor comprises: An encoder sensor or a Hall sensor attached to a hinge assembly connecting the first housing and the second housing; or A first motion sensor is disposed in the first housing and a second motion sensor is disposed in the second housing.

14. A portable electronic device comprising: A slidable housing including a first housing and a second housing coupled to the first housing to be slidable relative to the first housing; Reel unit; a flexible display including a first display area disposed adjacent to the first housing and a second display area surrounding the scroll unit and disposed in an inner space of the portable electronic device; an illumination sensor disposed, facing the display, below a sensor area in an active area of ​​the display where visual information will be displayed; a processor connected to the display and the illuminance sensor; as well as a memory, connected to the processor, The memory stores instructions, which, when executed, cause the processor to execute: The operation of calculating the illuminance value by using the data received from the illuminance sensor, an operation of obtaining color information of an image displayed in the active area, an operation of calculating a first color value for the active area and a second color value for the sensor area by using the color information, an operation of obtaining a color ratio of a second color value to a first color value, an operation of calculating a first correction value based on the color ratio, an operation of correcting the calculated illuminance value using a first correction value, and An operation is performed to configure the brightness of the display based on the corrected luminance value.

Images