Electronic device and illumination sensing method based on display information on electronic device

Abstract

An electronic device is provided. The electronic device includes: a housing including a front surface and a rear surface; a display exposed through a portion of the front surface; an illuminance sensor arranged between the display and the rear surface to overlap with an area of ​​the display when viewed from above the front surface; a processor located within the housing and operably connected to the display; and a memory located within the housing and operably connected to the processor; wherein the memory stores instructions configured to, when executed, enable the processor to: receive first illuminance data measured using the illuminance sensor, identify display parameter information associated with the first illuminance data, obtain second illuminance data based on the display parameter information and at least a portion of the first illuminance data, and adjust the brightness of the display based on at least a portion of the second illuminance data.

Description

Technical Field

[0001] The present disclosure relates to illumination sensing by electronic devices. Background Art

[0002] The continuous advancement of information communication and semiconductor technology has accelerated the popularization and use of various electronic devices. In particular, recent electronic devices can perform communication while being carried and may include one or more sensors for obtaining various types of environmental information. Sensors in electronic devices can obtain various information. Depending on the information to be obtained, there may be a diversity of sensor types.

[0003] Among various sensors of electronic devices, optical sensors can detect light and perform various sensing operations based at least on the sensing of light.

[0004] Optical sensors include proximity sensors and illuminance sensors, which detect external light to electronic devices, that is, ambient brightness.

[0005] The optical sensor may be arranged around a component of the electronic device that may affect the electronic device's detection of external light. For example, the component that may affect the detection of external light may be a display.

[0006] At least one of the color, brightness, or transmittance of the display may affect the external light sensed by the optical sensor. When the optical sensor is placed around the display, it may detect light under the influence of the display of the electronic device, and thus may have difficulty in accurately obtaining the illuminance of the external light. For example, even when the outside of the electronic device is dark, the optical sensor may detect light that has been brightened by the display, resulting in the light detection information (e.g., illuminance) of the external light being ultimately determined to be higher than the actual illuminance in the dark environment.

[0007] External light detection information obtained by the optical sensor can be provided to other components of the electronic device for various functions. When incorrect external light detection information is provided from the optical sensor, various functions using the external light detection information may be incorrectly performed. For example, when the brightness of a display is adjusted using the external light detection information, incorrect detection of external light may cause the brightness of the display to be incorrectly adjusted.

[0008] The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion has been made, as to whether any of the above content may be applicable as prior art with respect to the present disclosure. Summary of the invention

[0009] Technical issues

[0010] An aspect of the present disclosure is to solve at least the above-mentioned problems and / or disadvantages and to provide at least the advantages described below. Therefore, an aspect of the present disclosure is to provide an electronic device capable of accurately detecting external light not affected by a display, and a method for sensing illumination based on display information by the electronic device.

[0011] Another aspect of the present disclosure is to provide an electronic device capable of adjusting the brightness of a display to a brightness that does not fatigue the user's eyes according to accurate external light information not affected by the display, and a method of sensing illuminance based on display information by the electronic device.

[0012] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments.

[0013] Solution to the problem

[0014] According to one aspect of the present disclosure, an electronic device is provided. The electronic device includes: a housing including a front surface and a rear surface facing away from the front surface; a display included in the housing and exposed through a portion of the front surface; an illuminance sensor arranged between the display and the rear surface to overlap with an area of ​​the display when viewed from above the front surface; a processor located in the housing and operably connected to the display; and a memory located in the housing and operably connected to the processor; wherein the memory stores instructions configured to, when executed, enable the processor to receive first illuminance data measured using the illuminance sensor, identify display parameter information associated with the first illuminance data, obtain second illuminance data based on the display parameter information and at least a portion of the first illuminance data, and adjust the brightness of the display based on at least a portion of the second illuminance data.

[0015] According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes: a housing including a first panel and a back panel facing away from the first panel; a touch screen display included in the housing, configured to be viewed through a portion of the first panel, and including at least one pixel; an illumination sensor arranged between the touch screen display and the back panel to overlap with at least one pixel of the touch screen display when viewed from above the first panel; a processor located in the housing and operably connected to the touch screen display and the illumination sensor; and a memory located in the housing and operably connected to the processor; wherein the memory stores instructions configured to, when executed, enable the processor to receive from the illumination sensor an amount of light measured by the illumination sensor during a first time period when the touch screen display is operated, calculate a first illumination value based on at least a portion of the received amount of light, identify parameter information related to at least one pixel of the touch screen display during the first time period or at the end of the first time period, determine a second illumination value based on the identified parameter information and at least a portion of the calculated first illumination value, and adjust the brightness of the touch screen display based on at least a portion of the determined second illumination value.

[0016] According to another aspect of the present disclosure, a method for sensing illumination by an electronic device is provided. The method includes: receiving first illumination data measured using an illumination sensor, identifying display parameter information associated with the first illumination data, obtaining second illumination data based on the display parameter information and at least a portion of the first illumination data, and adjusting the brightness of a display based on at least a portion of the second illumination data.

[0017] According to another aspect of the present disclosure, a non-transitory storage medium is provided. The non-transitory storage medium includes stored instructions, the stored instructions are configured to be executed by at least one circuit, so that the at least one circuit can perform at least one operation, the at least one operation including: receiving first illuminance data measured using an illuminance sensor, identifying display parameter information associated with the first illuminance data, obtaining second illuminance data based on the display parameter information and at least a portion of the first illuminance data, and adjusting the brightness of a display based on at least a portion of the second illuminance data.

[0018] Advantageous Effects of the Invention

[0019] Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0021] Figure 1 is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure;

[0022] Figure 2 is a block diagram showing a display device according to an embodiment of the present disclosure;

[0023] Figure 3a is a front perspective view showing an electronic device according to an embodiment of the present disclosure;

[0024] Figure 3b is a rear perspective view showing an electronic device according to an embodiment of the present disclosure;

[0025] Figure 3c is a cross-sectional view showing an electronic device according to an embodiment of the present disclosure;

[0026] Figure 4 and Figure 5 is a perspective view showing a front surface of an electronic device according to various embodiments of the present disclosure;

[0027] Figure 6 is a view showing an illuminance value measured when an illuminance sensor is affected by a display according to an embodiment of the present disclosure;

[0028] Figure 7 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure;

[0029] Figure 8 is a view showing color on pixel ratio (COPR) information about an image output from a display and first illuminance data measured using an illuminance sensor according to an embodiment of the present disclosure;

[0030] Fig. 9 is a flowchart illustrating an illumination sensing method based on display parameter information in an electronic device according to an embodiment of the present disclosure;

[0031] Fig.10 is a flowchart illustrating a method of correcting illumination data in an electronic device according to an embodiment of the present disclosure;

[0032] Fig.11 is a diagram showing the relationship between brightness and illuminance according to an embodiment of the present disclosure;

[0033] Fig.12 , Fig.13 and Fig.14 is a view showing first illuminance data and second illuminance data according to various embodiments of the present disclosure; and

[0034] Fig.15a and Fig.15bis a view illustrating a method of adjusting brightness of a display using illuminance data in an electronic device according to various embodiments of the present disclosure.

[0035] The same reference numerals are used to denote the same elements throughout the drawings. DETAILED DESCRIPTION

[0036] The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of the various embodiments of the present disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding, but these are to be considered as exemplary only. Therefore, it will be appreciated by those of ordinary skill in the art that various changes and modifications may be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0037] The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used by the inventor to enable a clear and consistent understanding of the present disclosure. Therefore, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustrative purposes only and not for the purpose of limiting the present disclosure as defined by the appended claims and their equivalents.

[0038] It should be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.

[0039] Figure 1 is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure.

[0040] refer to Figure 1, the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).

[0041] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 , or as part of the main processor 121 .

[0042] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123.

[0043] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0044] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0045] The input device 150 may receive a command or data to be used by another component (e.g., processor 120) of the electronic device 101 from outside (e.g., user) of the electronic device 101. The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0046] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.

[0047] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.

[0048] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0049] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 1801, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0050] The interface 177 may support one or more specific protocols that will be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0051] The connection end 178 may include a connector, wherein the electronic device 101 may be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0052] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0053] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0054] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0055] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0056] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a Wide Area Network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0057] The antenna module 197 may send a signal or power to the outside (e.g., an external electronic device) or receive a signal or power from the outside (e.g., an external electronic device). According to an embodiment, the antenna module may include an antenna including a radiator formed by a conductor or a conductive pattern formed on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from a plurality of antennas by, for example, the communication module 190. Signals or power may then be sent or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, other parts (e.g., a radio frequency integrated circuit (RFIC)) other than the radiator may be further formed as a part of the antenna module 197.

[0058] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0059] According to an embodiment, instructions or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be run on the electronic device 101 may be run on one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically perform a function or service or should perform a function or service in response to a request from a user or another device, the electronic device 101 may request one or more external electronic devices to perform at least part of the function or service instead of running the function or service, or the electronic device 101 may request one or more external electronic devices to perform at least part of the function or service in addition to running the function or service. The one or more external electronic devices that receive the request may perform at least part of the requested function or service, or perform another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology or client-server computing technology may be used, for example.

[0060] Figure 2 is a block diagram illustrating a display device according to an embodiment of the present disclosure.

[0061] refer to Figure 2, block diagram 200 shows a display device 160, which may include a display 210 and a display driver integrated circuit (DDI) 230 for controlling the display 110. The DDI 230 may include an interface module 231, a memory 233 (e.g., a buffer memory), an image processing module 235, or a mapping module 237. The DDI 230 may receive image information including image data or an image control signal corresponding to a command for controlling image data from another component of the electronic device 101 via the interface module 231. For example, according to an embodiment, the image information may be received from a processor 120 (e.g., a main processor 121 (e.g., an application processor)) or an auxiliary processor 123 (e.g., a graphics processing unit), wherein the auxiliary processor 123 operates independently of the function of the main processor 121. The DDI 230 may communicate with, for example, the touch circuit 150 or the sensor module 176 via the interface module 231. The DDI 230 may also store at least a portion of the received image information in the memory 233, for example, frame by frame. The image processing module 235 may perform pre-processing or post-processing (e.g., adjustment of resolution, brightness, or size) for at least a portion of the image data. According to an embodiment, for example, the pre-processing or post-processing may be performed at least in part based on one or more features of the image data or one or more features of the display 210. The mapping module 237 may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed by the image processing module 135. According to an embodiment, for example, the generation of the voltage value or the current value may be performed at least in part based on one or more properties of the pixels of the display 210 (e.g., an array of pixels (such as RGB stripes or a pentile structure) or the size of each sub-pixel). For example, at least some pixels of the display 210 may be driven at least in part based on the voltage value or the current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed via the display 210.

[0062] According to an embodiment, the display device 160 may further include a touch circuit 250. The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 151. The touch sensor IC 253 may control the touch sensor 251 to sense a touch input or a hovering input for a certain position on the display 210. To this end, for example, the touch sensor IC 253 may detect (e.g., measure) a change in a signal (e.g., voltage, light amount, resistance, or one or more charge amounts) corresponding to a specific position on the display 210. The touch sensor IC 253 may provide input information (e.g., position, area, pressure, or time) indicating the detected touch input or hovering input to the processor 120. According to an embodiment, at least a portion of the touch circuit 250 (e.g., the touch sensor IC 253) may be formed as a part of the display 210 or the DDI 230, or as a part of another component (e.g., the auxiliary processor 123) located outside the display device 160.

[0063] According to an embodiment, the display device 160 may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illumination sensor) of the sensor module 176 or a control circuit for at least one sensor. In such a case, the at least one sensor or the control circuit for at least one sensor may be embedded in a portion of a component (e.g., the display 210, the DDI 230, or the touch circuit 150) of the display device 160. For example, when the sensor module 176 embedded in the display device 160 includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may acquire biometric information (e.g., a fingerprint image) corresponding to a touch input received via a portion of the display 210. As another example, when the sensor module 176 embedded in the display device 160 includes a pressure sensor, the pressure sensor may acquire pressure information corresponding to a touch input received via a partial area or the entire area of ​​the display 210. According to an embodiment, the touch sensor 251 or the sensor module 176 may be arranged between pixels in a pixel layer of the display 210, or above or below the pixel layer.

[0064] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to the above electronic devices.

[0065] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents or alternative forms of corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of items listed together with a corresponding phrase in a plurality of phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish a corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., a second element)”, “coupled to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” with or without the terms “operably” or “communicatively” being used, it means that one element may be directly (e.g., wired) connected to another element, wirelessly connected to another element, or connected to another element via a third element.

[0066] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or the smallest unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0067] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of a machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to at least one instruction called. One or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0068] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or the computer program product may be published online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM), or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a manufacturer's server, an application store's server, or a memory of a forwarding server).

[0069] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performs one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.

[0070] Figure 3a is a front perspective view showing an electronic device according to an embodiment of the present disclosure.

[0071] Figure 3b is a rear perspective view showing an electronic device according to an embodiment of the present disclosure.

[0072] refer to Figure 3a and Figure 3b According to an embodiment, the electronic device 300 may include a housing 310 having a first (or front) surface 310A, a second (or rear) surface 310B, and a side surface 310C surrounding a space between the first surface 310A and the second surface 310B. According to another embodiment (not shown), the housing may represent a housing formed Figure 3a and Figure 3b The structure of the first surface 310A, the second surface 310B and the part of the side surface 310C. According to an embodiment, at least a portion of the first surface 310A may have a substantially transparent front plate 302 (e.g., a glass plate or a polymer plate including various coatings). The second surface 310B may be formed by a substantially opaque rear plate 311. The rear plate 311 may be formed by, for example, laminated or tinted glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS) or magnesium), or a combination of at least two thereof. The side surface 310C may be formed by a side frame structure (or "side member") 318, which is coupled to the front plate 302 and the rear plate 311 and includes metal and / or polymer. According to an embodiment, the rear plate 311 and the side frame plate 318 may be integrally formed together and include the same material (e.g., a metal, such as aluminum).

[0073] In the illustrated embodiment, the front plate 302 may include two first regions 310D that extend seamlessly and curvedly from the first surface 310A to the rear plate 311 on two long sides of the front plate 302. Figure 3b), the back plate 311 may include a second area 310E that extends seamlessly and curvedly from the second surface 310B to the front plate on two long sides. According to an embodiment, the front plate 302 (or the back plate 311) may include only one of the first area 310D (or the second area 310E). Alternatively, the first area 310D or the second area 310E may be partially excluded. According to an embodiment, in a side view of the electronic device 300, the side frame structure 318 may have a first thickness (or width) for the side without the first area 310D or the second area 310E, and a second thickness less than the first thickness for the side with the first area 310D or the second area 310E.

[0074] According to an embodiment, the electronic device 300 may include at least one or more of a display 301, audio modules 303, 307, and 314, sensor modules 304, 316, and 319, camera modules 305, 312, and 313, a key input device 317, a light emitting device 306, and connection holes 308 and 309. According to an embodiment, the electronic device 300 may not include at least one of these components (e.g., the key input device 317 or the light emitting device 306), or other components may be added.

[0075] The display 301 may be exposed through, for example, a substantial portion of the front plate 302. According to an embodiment, at least a portion of the display 301 may be exposed through the front plate 302 forming the first surface 310A and the first region 310D of the side surface 310C. According to an embodiment, the edge of the display 301 may be formed to be substantially the same shape as the adjacent outer edge of the front plate 302. According to an embodiment (not shown), the spacing between the outer edge of the display 301 and the outer edge of the front plate 302 may be maintained substantially uniform to provide a larger exposed area for the display 301.

[0076] According to an embodiment (not shown), the screen display area of ​​the display 301 may have a groove or an opening in a portion thereof, and at least one or more of the audio module 314, the sensor module 304, the camera module 305, and the light emitting device 306 may be aligned with the groove or the opening. According to an embodiment (not shown), at least one or more of the audio module 314, the sensor module 304, the camera module 305, the fingerprint sensor 316, and the light emitting device 306 may be included on the rear surface of the screen display area of ​​the display 301. According to an embodiment (not shown), the display 301 may be arranged to be coupled to or adjacent to a touch detection circuit, a pressure sensor capable of measuring touch intensity (pressure), and / or a digitizer for detecting a magnetic field type stylus. According to an embodiment, at least a portion of the sensor modules 304 and 319 and / or at least a portion of the key input device 317 may be arranged in the first area 310D and / or the second area 310E.

[0077] The audio modules 303, 307, and 314 may include a microphone hole 303 and speaker holes 307 and 314. The microphone hole 303 may have a microphone inside to obtain external sound. According to an embodiment, there may be multiple microphones to be able to detect the direction of the sound. The speaker holes 307 and 314 may include an external speaker hole 307 and a phone receiver hole 314. According to an embodiment, the speaker holes 307 and 314 and the microphone hole 303 may be implemented as a single hole, or the speaker may be placed without the speaker holes 307 and 314 (e.g., a piezoelectric speaker).

[0078] The sensor modules 304, 316, and 319 may generate electrical signals or data values ​​corresponding to the internal operating state or external environmental state of the electronic device 300. The sensor modules 304, 316, and 319 may include a first sensor module 304 (e.g., a proximity sensor) and / or a second sensor module (not shown) (e.g., a fingerprint sensor) arranged on the first surface 310A of the housing 310 and / or a third sensor module 319 (e.g., a heart rate monitor (HRM) sensor) and / or a fourth sensor module 316 (e.g., a fingerprint sensor) arranged on the second surface 310B of the housing 310. The fingerprint sensor may be arranged on the second surface 310B of the housing 310 or on the first surface 310A (e.g., the display 301) of the housing 310. The electronic device 300 may further include an illumination sensor 320. The illuminance sensor 320 may be disposed between the display 301 and the second surface (or rear surface) 310B to overlap with an area of ​​the display 301 when viewed from above the first surface (or front surface) 310A of the housing 310 .

[0079] The electronic device 300 may further include a sensor module not shown, for example, at least one of a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, or a humidity sensor.

[0080] The camera modules 305, 312, and 313 may include a first camera device 305 arranged on a first surface 310A of the electronic device 300, and a second camera device 312 and / or a flash 313 arranged on a second surface 310B. The camera modules 305 and 312 may include one or more lenses, an image sensor, and / or an image signal processor. The flash 313 may include, for example, a light emitting diode (LED) or a xenon lamp. According to an embodiment, two or more lenses (an infrared (IR) camera, a wide-angle lens, and a telescopic lens) and an image sensor may be arranged on one surface of the electronic device 300.

[0081] The key input device 317 may be arranged on the side surface 310C of the housing 310. According to an embodiment, the electronic device 300 may exclude all or some of the key input devices 317 mentioned above, and the excluded key input devices 317 may be implemented in other forms, for example, as soft keys, on the display 301. According to an embodiment, the key input device may include a sensor module 316 arranged on the second surface 310B of the housing 310.

[0082] The light emitting device 306 may be arranged, for example, on the first surface 310A of the housing 310. The light emitting device 306 may provide, for example, information about the state of the electronic device 300 in the form of light. According to an embodiment, the light emitting device 306 may provide a light source that interacts with, for example, the camera module 305. The light emitting device 306 may include, for example, a light emitting device (LED), an infrared (IR) LED, or a xenon lamp.

[0083] The connector holes 308 and 309 may include a first connector hole 308 for receiving a connector for sending or receiving power and / or data to / from an external electronic device (e.g., a universal serial bus (USB) connector), and / or a second connector hole 309 for receiving a connector for sending or receiving audio signals to / from an external electronic device (e.g., a headphone jack).

[0084] Figure 3c is a cross-sectional view showing an electronic device according to an embodiment of the present disclosure.

[0085] refer to Figure 3c According to an embodiment, the first plate 302, the touch screen panel 327, the display panel 329, the digitizer panel 331, the shielding layer 333 and the middle plate 335 may be stacked in a direction from the first surface (or front surface) 310A to the second surface (or rear surface) 310B. When viewed from the first surface (or front surface) 310A to the second surface (or rear surface) 310B, the illuminance sensor 320 may be arranged between the display panel 329 and the rear plate 311 to overlap with the area of ​​the display panel 329. According to an embodiment, the order of stacking the touch screen panel 327 and the display panel 329 may be different. The first plate 302 may be formed of glass. According to an embodiment, the first plate 302 may be formed of a transparent resin, without being limited to glass.

[0086] According to an embodiment, the display 301 may include a first board 302, a display panel 329 and / or a touch screen panel 327. The display 301 may display a screen according to a specified screen ratio (e.g., 18.5:9 (default) or 21:9). According to an embodiment, the display 301 may display a user interface according to a floating mode or a split mode. According to an embodiment, the display 301 may display a user interface including an application area or a control area. The display 301 may display a control object (e.g., a soft key) on the control area. According to an embodiment, the display 301 may have a Y-OCTA structure, and the touch screen panel 327 may be attached to the display panel 329 in an add-on-cell type.

[0087] According to an embodiment, the touch screen panel 327 may receive a user touch input on the first plate 302. The touch screen panel 327 may receive an electrical signal of a user's touch input. The touch screen panel 327 may have the same size as the first plate 302, and may receive an electrical signal of the same coordinates as the coordinates of the touch input on the first plate 302. According to an embodiment, the touch screen panel 327 is not limited to the same size as the first plate 302, but may be larger or smaller than the first plate 302. The touch screen panel 327 may be driven in a capacitive type including an RX electrode and a TX electrode. According to an embodiment, the touch screen panel 327 is not limited to a capacitive type, but may be driven in a pressurized type or an optical type. The RX electrode and the TX electrode may be arranged on the same layer. According to an embodiment, the RX electrode and the TX electrode are not limited to being arranged on the same layer, but may be arranged on different layers.

[0088] The display panel 329 may include a plurality of pixels including red (R), green (G) and blue (B) sub-pixels. As data and current are supplied to each of the plurality of pixels, the display panel 329 may output an image in a combination of the colors of the sub-pixels of the pixel.

[0089] The shielding layer 333 may be electrically connected to the ground of the digitizer panel 331 or the display panel 329. The shielding layer 333 may absorb noise signals through the ground. The shielding layer 333 may be attached to the housing 310 with a dielectric interposed therebetween to prevent the shielding layer 333 itself from being grounded together with the housing 310. The shielding layer 333 may include a copper sheet.

[0090] According to an embodiment, the illuminance sensor 320 may be disposed under the middle plate 335 and may include a light receiving unit for receiving external light incident from the outside of the electronic device 300 through the display 301. The circuit board 360 may be disposed at the bottom of the illuminance sensor 320.

[0091] According to an embodiment, various electronic components, such as a processor (e.g., processor 120) or a communication module (e.g., communication module 190), may be mounted on a circuit board 360. The circuit board 360 may be fixed to the housing 310 by a coupling member (not shown), such as a screw. The circuit board 360 may be electrically connected to the housing 310 to be utilized as a ground for the antenna. According to an embodiment, the circuit board 360 is not limited to being utilized as a ground, but may be used as a feeder for applying current to the antenna radiator. For example, the circuit board 360 may include a printed circuit board (PCB).

[0092] According to an embodiment, the side member 318 may be combined with the first plate 302 and the back plate 311, and may include metal and / or polymer. According to an embodiment, the back plate 311 and the side member (e.g., a frame structure or a housing antenna) 318 may be integrally formed together and include the same material (e.g., a metal such as aluminum). The side member 318 may be used as a housing antenna. According to an embodiment, when the side member 318 is used as a housing antenna, the side member 318 may be electrically connected to a wireless communication module (e.g., wireless communication module 192) arranged on the circuit board 360 via a connecting member.

[0093] Figure 4 and Figure 5 is a perspective view showing a front surface of an electronic device according to various embodiments of the present disclosure.

[0094] refer to Figure 4 According to an embodiment, the electronic device 400 may include a light emitting element 404 and a camera module 406 on a top middle portion of a first surface (or front surface) 410A, wherein the first surface (or front surface) 410A is included in a housing 410. The housing 410 may include a bezel member 402 and a side portion 418 disposed at the top of the display 401. The illumination sensor 420 may be disposed between the display 401 and the second surface (or rear surface) 410B to overlap with an area of ​​the display 401 when viewed from above the first surface (or front surface) 410A included in the housing 410, wherein the area is located adjacent to the top middle portion of the front surface 410A.

[0095] refer to Figure 5According to an embodiment, the electronic device 500 may include a light emitting element 504 and a camera module 506 on an upper right portion of a first surface (or front surface) 510A, wherein the first surface (or front surface) 510A is included in a housing 510. The housing 510 may include a bezel member 502 and a side portion 518 disposed on the top of the display 501. The illuminance sensor 520 may be disposed between the display 501 and the second surface (or rear surface) 510B to overlap with an area of ​​the display 501 when viewed from above the first surface (or front surface) 510A included in the housing 510, wherein the area is located adjacent to the upper right portion of the front surface 510A.

[0096] According to an embodiment, an illumination sensor (e.g., Figure 3a 320 Figure 4 420 or Figure 5 520) can be placed in various other positions besides the positions described above. When the illuminance sensor is arranged adjacent to the display (e.g., Figure 1 and 2 160 Figure 3a 301 Figure 4 401, or Figure 5 501) (e.g., when the illuminance sensor is arranged below the display, or when the illuminance sensor is arranged between the display and the rear surface to overlap with the area of ​​the display when viewed from above the front surface of the electronic device), external light incident on the illuminance sensor may be affected by the display. Figure 1 and Figure 2 160 Figure 3a 301 Figure 4 401, or Figure 5 The color, brightness, or brightness component of the transmittance of the image output by 501) may affect the external light incident on the illuminance sensor.

[0097] Figure 6 is a view illustrating an illuminance value measured when an illuminance sensor is affected by a display according to an embodiment of the present disclosure.

[0098] refer to Figure 6 , the horizontal axis can represent the value of the display (e.g., Figure 1 and Figure 2 160 Figure 3a 301 Figure 4 401, or Figure 5 The vertical axis may represent the color, brightness, or transmittance of an image output from the display (e.g., 501), and the vertical axis may represent the brightness value (cd) of the image output by the illuminance sensor (e.g., Figure 3a 320 Figure 4 420, or Figure 5 The illuminance value (lux) measured by the 520).

[0099] According to an embodiment, the first illuminance may indicate a state in which external light is blocked, a darkroom state, or a 0-lux state, the second illuminance may indicate a state in which the brightness of the external light is low or a 66-lux state, and the third illuminance may indicate a state in which the brightness of the external light is high or a 460-lux state. In a zero brightness state in which no image is output on the display in each illumination environment, the first to third illuminances may be measured relatively accurately. According to an embodiment, when the display outputs an image, a brightness component may be generated by the color, brightness, or transmittance of the output image, and the illuminance value measured by the illuminance sensor may be higher than the illuminance value in the original illumination environment, proportional to the brightness component generated by the display. For example, the illuminance sensor may measure external light that has been affected by the light of the image output from the display, resulting in failure to obtain accurate illuminance of the external light.

[0100] Figure 7 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

[0101] refer to Figure 7 According to an embodiment, the electronic device 700 (eg, Figure 1 Electronic devices 101, Figure 3a-3c Electronic equipment 300, Figure 4 Electronic equipment 400 or Figure 5 The electronic device 500 may include a processor 720, a memory 730, a display 760 and an illumination sensor 776.

[0102] According to an embodiment, the processor 720 (e.g., Figure 1 The processor 120 of the electronic device 700 may execute software (e.g., program 140) to control at least one other component (e.g., memory 730, display 760, or illuminance sensor 776) of the electronic device 700 electrically connected to the processor 720 and may perform various types of data processing or calculation. According to an embodiment, the processor 720 may be an application processor (AP) and may include a display driver 722 or a sensor hub 724, or perform the functions of the display driver 722 or the sensor hub 724. The display driver 722 may communicate with a display driver integrated circuit (IC) 762 of the display 760 and may provide image information to be output through the display 760. The sensor hub 724 may control the overall driving of the sensors (at least one sensor module, including the illuminance sensor 776) included in the electronic device 700, store or obtain a display brightness table, and provide the display driver IC 762 with a display brightness corresponding to the second illuminance data, wherein the second illuminance data has been corrected as the first illuminance data measured by the illuminance sensor 776 is corrected.

[0103] According to an embodiment, the processor 720 may receive first illuminance data measured using the illuminance sensor 776, identify display parameter information associated with the first illuminance data, obtain second illuminance data based on the display parameter information and the first illuminance data, and adjust the brightness of the display based on the second illuminance data. According to an embodiment, the display parameter information associated with the first illuminance data may include information associated with at least one of the color, brightness, or transmittance of the display 760 when the first illuminance data is measured. According to an embodiment, the display parameter information associated with the first illuminance data may include color pixel ratio (COPR) information associated with an image output from the display 760 when the first illuminance data is measured. For example, the COPR information may be a ratio of R, G, and B values ​​of an image output from the display 760. According to an embodiment, the display parameter information associated with the first illuminance data may include active matrix organic light emitting diode (AMOLED) off ratio (AOR) information associated with the display 760 when the first illuminance data is measured.

[0104] According to an embodiment, the processor 720 may receive first illuminance data measured during a specified time (e.g., 50 ms) from the illuminance sensor 776, and may receive an interrupt signal together with the first illuminance data. The processor 720 may receive display parameter information in each image frame (e.g., 16.6 ms) output from the display 760, and may recognize that the display parameter information when receiving the interrupt signal is the display parameter information associated with the first illuminance data.

[0105] According to an embodiment, the processor 720 may receive the first illuminance data, identify the display parameter information (e.g., the first display parameter information) associated with the first illuminance data, obtain correction information using the illuminance raw data corresponding to the display parameter information (e.g., the second display parameter information) when the external light is blocked, and correct the first illuminance data using the correction information. According to an embodiment, the illuminance raw data may be data obtained based on the illuminance value detected by the illuminance sensor 776 when the electronic device 700 outputs an image on the display 760 in a dark room (a place of 0-lux).

[0106] According to an embodiment, the illuminance raw data may be a value obtained when the illuminance sensor senses light generated from an image output from the display device 760 based on R, G, and B values ​​when light is blocked from the outside. For example, the illuminance sensor may sense light generated from an image output from the display device 760 when light is blocked from the outside using R, G, B, and C channels, thereby obtaining an R channel sensing value, a G channel sensing value, a B channel sensing value, and a C channel sensing value. The R channel sensing value may be a sensing value of an R channel component of light generated from the image output from the display device 760 when light is blocked from the outside, the G channel sensing value may be a sensing value of a G channel component of light generated from the image output from the display device 760 when light is blocked from the outside, the B channel sensing value is a sensing value of a B channel component of light generated from the image output from the display device 760 when light is blocked from the outside, and the C channel sensing value is a sensing value of a visible light band component of light generated from the image output from the display device 760.

[0107] According to an embodiment, the illuminance raw data may include illuminance values ​​calculated based on R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values, which are obtained when the illuminance sensor senses light generated from an image output on the display 760 based on R, G, and B values ​​when light is blocked from the outside.

[0108] According to an embodiment, the processor 720 may obtain correction information associated with the display parameter information using the illuminance raw data. For example, the correction information may be information that the illuminance value affected by the display may be excluded from the first illuminance data. The processor 720 may obtain second illuminance data based on the first illuminance data and the correction information. For example, the processor 720 may obtain second illuminance data, wherein the second illuminance data is generated by excluding the illuminance value affected by the display from the first illuminance data using the correction information.

[0109] According to an embodiment, the memory 730 may store instructions to enable the processor 720 to receive first illuminance data measured using the illuminance sensor 776 when the instructions are executed, identify display parameter information associated with the first illuminance data, obtain second illuminance data based on the display parameter information and the first illuminance data, and adjust the brightness of the display based on the second illuminance data. For example, the memory 730 may store instructions to enable the processor 720 to receive from the illuminance sensor the amount of light measured by the illuminance sensor 776 during a first time period when the display is operated, calculate a first illuminance value based on at least a portion of the received amount of light, identify parameter information related to at least one pixel of the display 760 during the first time period or at the end of the first time period, determine a second illuminance value based on the identified parameter information and at least a portion of the calculated first illuminance value, and adjust the brightness of the display based on at least a portion of the determined second illuminance value.

[0110] According to an embodiment, the display 760 may include a display driver IC 762 (eg, Figure 2 DDI230) and display panel 764.

[0111] According to an embodiment, the display driver IC 762 may perform control to output image information through the display panel 764. According to an embodiment, the display driver IC 762 may perform control to output image information on a per-image frame basis, and may provide color information about the image output per frame, for example, COPR information. According to an embodiment, the COPR information may represent the amount of R, G, and B values ​​of the output image. For example, the R value may represent a red value in the range of 0 to 255, the G value may represent a green value in the range of 0 to 255, and the B value may represent a blue value in the range of 0 to 255. For example, COPR information about a white screen may have a value of (R, G, B: 255, 255, 255).

[0112] According to an embodiment, the display panel 764 may include a plurality of pixels including a red (R) sub-pixel, a green (G) sub-pixel, and a blue (B) sub-pixel. As data and current are provided to each of the plurality of pixels under the control of the display driver IC 762, the display panel 764 may output an image with a combination of the colors of the sub-pixels of the pixel.

[0113] According to an embodiment, the illuminance sensor 776 may be an ambient light sensor. The illuminance sensor 776 may sense ambient light and output illuminance data. According to an embodiment, the illuminance sensor 776 may provide first illuminance data measured during a specified time (e.g., 50 ms), and may provide an interrupt signal together with the first illuminance data.

[0114] According to an embodiment, the illumination sensor 776 may include a plurality of channels for sensing ambient light. According to an embodiment, the plurality of channels may include a channel for receiving light in a visible light band or a channel for receiving light in a light band other than the visible light band (e.g., an infrared (IR) band or an ultraviolet (UV) band). For example, the plurality of channels may include a first channel, a second channel, a third channel, and a fourth channel 776-1, 776-2, 776-3, and 776-4. According to an embodiment, the plurality of channels may also include other channels in addition to the first to fourth channels 776-1 to 776-4, or may not include some of the first to fourth channels 776-1 to 776-4. For example, the first channel 776-1, the second channel 776-2, the third channel 776-3, and the fourth channel 776-4 may be a red (R) channel, a green (G) channel, a blue (B) channel, and a clear (clear, C) channel, respectively. According to an embodiment, the R channel may receive light with a wavelength band ranging from 550nm to 700nm, centered at 650nm. The G channel can receive light with a wavelength band ranging from 450nm to 650nm, centered at 550nm. The B channel can receive light with a wavelength band ranging from 400nm to 550nm, centered at 450nm. The C channel can receive light with a wavelength band ranging from 400nm to 750nm (e.g., the visible light band of light). According to an embodiment, the wavelength band of light receivable by each channel can be specified to be different from the above. The illuminance sensor 776 can use multiple channels to receive light of each specified band at a specified time, and combine these light bands to output the first illuminance data sensed for external light.

[0115] According to an embodiment, an electronic device (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 The electronic device 700 includes a housing (eg, Figure 3a 310), the housing including a front surface (e.g., Figure 3a A front surface 310A) and a rear surface facing away from the front surface (e.g., Figure 3b a rear surface 310B); a display included in the housing and exposed through a portion of the front surface (e.g., Figure 1 and Figure 2 Display device 160, Figure 3a Display 301, Figure 4 Display 401, Figure 5 Display 501 or Figure 7 an illuminance sensor (e.g., Figure 1 Sensor module 176, Figure 2 Sensor module 276, Figure 3a Illuminance sensor 320, Figure 4 Illuminance sensor 420, Figure 5 Illuminance sensor 520, or Figure 7 a sensor module 776); a processor (e.g., Figure 1 The processor 120 or Figure 7 and a memory (e.g., Figure 1 Memory 130 or Figure 7 The present invention relates to a memory 730 of the present invention, wherein the memory stores instructions that are configured to, when executed, enable the processor to receive first illuminance data measured using an illuminance sensor, identify display parameter information associated with the first illuminance data, obtain second illuminance data based on the display parameter information and at least a portion of the first illuminance data, and adjust the brightness of the display based on at least a portion of the second illuminance data.

[0116] According to an embodiment, the display parameter information may include information associated with at least one of color, brightness, or transmittance of the display.

[0117] According to an embodiment, the display parameter information may include COPR information about an image output through the display and / or AOR information about the display.

[0118] According to an embodiment, the illuminance sensor may be arranged under at least one area of ​​the display.The display parameter information may be COPR information about an image output from at least one area of ​​the display.

[0119] According to an embodiment, the instructions may be configured to measure first illuminance data using an illuminance sensor at each specified first time interval, receive the first illuminance data measured from the illuminance sensor while an interruption occurs when measurement of the first illuminance data is terminated, and identify COPR information about an image output from at least one area of ​​a display.

[0120] According to an embodiment, the instructions may be configured to enable the processor to identify COPR information about an image frame output from the display when the interruption occurs.

[0121] According to an embodiment, the instructions may be configured to enable the processor to obtain illuminance raw data when light is blocked outside, obtain correction information associated with display parameter information using the obtained illuminance raw data, and obtain second illuminance data using the obtained correction information and the received first illuminance data.

[0122] According to an embodiment, the illuminance raw data may include R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values ​​of the illuminance sensor, which respectively correspond to the R value, G value, B value, and C value of the image output from the display when light is blocked from the outside.

[0123] According to an embodiment, the illuminance raw data may include an illuminance value calculated based on at least a portion of an R channel sensing value, a G channel sensing value, a B channel sensing value, and a C channel sensing value of the illuminance sensor, wherein the R channel sensing value, the G channel sensing value, the B channel sensing value, and the C channel sensing value respectively correspond to the R value, the G value, the B value, and the C value of the image output from the display when light is blocked from the outside.

[0124] According to an embodiment, an electronic device (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 The electronic device 700 includes a housing (eg, Figure 3a The housing 310 includes a first plate (eg, Figure 3a 310A) and a rear plate facing away from the first plate (eg, Figure 3b A touch screen display (eg, a touch screen display that is viewed through a portion of the first panel and includes at least one pixel) included in the housing; Figure 1 and Figure 2 Display device 160, Figure 3a Display 301, Figure 4 Display 401, Figure 5 Display 501 or Figure 7 an illuminance sensor (e.g., Figure 1 Sensor module 176, Figure 2 Sensor module 276, Figure 3a Illuminance sensor 320, Figure 4 Illuminance sensor 420, Figure 5 Illuminance sensor 520, or Figure 7 sensor module 776); a processor (e.g., located within the housing and operably connected to the display and the illuminance sensor) Figure 1 The processor 120 or Figure 7 and a memory (e.g., Figure 1 Memory 130 or Figure 7 A memory 730) is provided, wherein the memory stores instructions that are configured to, when executed, enable the processor to receive from the illuminance sensor an amount of light measured by the illuminance sensor during a first time period when the display is operated, calculate a first illuminance value based on at least a portion of the received amount of light, identify parameter information related to at least one pixel of the display during the first time period or at the end of the first time period, determine a second illuminance value based on the identified parameter information and at least a portion of the calculated first illuminance value, and adjust the brightness of the display based on at least a portion of the determined second illuminance value.

[0125] According to an embodiment, an illumination sensor may be arranged under at least a region of the display.

[0126] According to an embodiment, the parameter information may include COPR information and / or AOR information about an image output through at least a region of the display.

[0127] Figure 8 is a view illustrating COPR information about an image output from a display and first illuminance data measured using an illuminance sensor according to an embodiment of the present disclosure.

[0128] refer to Figure 8 According to an embodiment, an illumination sensor (eg, Figure 7 The illuminance sensor 776 of the display device may provide first illuminance data based on the amount of light measured during a first time period or during a specified time (e.g., 50 ms), and generate an interrupt signal when providing the first illuminance data. Figure 7 The display 760) can output an image frame every specified time (e.g., 16.6 ms) 810 based on each image frame, and generate COPR data corresponding to the image frame in each image frame.

[0129] According to an embodiment, COPR data may represent a ratio of R, G, and B values ​​of an output image frame. For example, the R value may represent a red value within a range of 0 to 255, the G value may represent a green value within a range of 0 to 255, and the B value may represent a blue value within a range of 0 to 255. For example, COPR information about a white image frame may have a value of (R, G, B: 255, 255, 255).

[0130] For example, when the first frame (i.e., 1Frame) is output, the display 760 may generate COPR data 1 corresponding to 1Frame, and, when the second frame (i.e., 2Frame) is output, the display 760 may generate COPR data 2 corresponding to 2Frame. The COPR data may be updated and stored in the memory 730 each time an image frame is output. According to an embodiment, the processor 720 may recognize that a display parameter corresponding to the first illuminance data is COPR data 4 (820) based on an interrupt signal generated when the first illuminance data is provided. According to an embodiment, the display parameter may be parameter information associated with at least one pixel of the display 760. According to an embodiment, in the electronic device 700, the time when the illuminance data is measured by the illuminance sensor and the period of outputting one frame of image may vary.

[0131] According to an embodiment, an electronic device (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic equipment 500 or Figure 7 The method of sensing illumination of the electronic device 700) includes receiving an illumination sensor (eg, Figure 1 Sensor module 176, Figure 2 Sensor module 276, Figure 3a Illuminance sensor 320, Figure 4 Illuminance sensor 420, Figure 5 Illuminance sensor 520, or Figure 7 The method further comprises: determining first illuminance data measured by a sensor module 776 of the embodiment of the present invention, identifying display parameter information associated with the first illuminance data, obtaining second illuminance data based on the display parameter information and at least a portion of the first illuminance data, and adjusting the display based on at least a portion of the second illuminance data (e.g., Figure 1 and Figure 2 Display device or Figure 7 The brightness of the display 760).

[0132] According to an embodiment, the display parameter information may include information associated with at least one of color, brightness, or transmittance of the display.

[0133] According to an embodiment, the display parameter information may include COPR information about an image output through the display.

[0134] According to an embodiment, the display parameter information may further include AOR information about the display.

[0135] According to an embodiment, the display parameter information may be COPR information about an image output from at least a region of a display of the electronic device.

[0136] According to an embodiment, the method may further include receiving an interruption occurring when illuminance measurement is terminated, and illuminance data measured at each specified first time interval from the illuminance sensor, receiving COPR information for each frame from the display, and identifying COPR information about an image frame output from the display when the interruption is received.

[0137] According to an embodiment, the method may further include obtaining illuminance raw data when light is blocked outside, and obtaining correction information associated with the display parameter information using the illuminance raw data, wherein the second illuminance data is obtained using the obtained correction information and the received first illuminance data.

[0138] According to an embodiment, the illuminance raw data may include R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values ​​of the illuminance sensor, which respectively correspond to the R value, G value, B value, and C value of the image output from the display when light is blocked from the outside.

[0139] According to an embodiment, the illuminance raw data may include illuminance data obtained based on R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values ​​of the illuminance sensor, wherein the R channel sensing values, the G channel sensing values, the B channel sensing values, and the C channel sensing values ​​respectively correspond to the R value, G value, B value, and C value of the image output from the display when light is blocked from the outside.

[0140] Fig. 9 is a flowchart illustrating an illumination sensing method based on display parameter information in an electronic device according to an embodiment of the present disclosure.

[0141] refer to Fig. 9 According to an embodiment, operations 910 to 940 may be understood as being performed by an electronic device (eg, Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 A processor (eg, Figure 1 The processor 120 or Figure 7 The processor 720, hereinafter, Figure 7 According to an embodiment, at least one of operations 910 to 940 may be omitted or changed in order, or other operations may be added.

[0142] According to an embodiment, in operation 910, the processor 720 may receive a signal using an illumination sensor (eg, Figure 1 Sensor module 176, Figure 2 Sensor module 276, Figure 3a Illuminance sensor 320, Figure 4 Illuminance sensor 420, Figure 5 Illuminance sensor 520, or Figure 7 According to an embodiment, the processor 720 may receive the first illuminance data (e.g., the first illuminance value) from the illuminance sensor 776 based on the amount of light measured during the first time period. For example, the first illuminance data may be a value that fails to exclude the display (e.g., Figure 1 and Figure 2 Display device 160, Figure 3a Display 301, Figure 4 Display 401, Figure 5 Display 501, or Figure 7 The display 760, hereinafter, Figure 7 The illuminance value or illuminance data affected by the display 760 is described as an example.

[0143] According to an embodiment, in operation 920, the processor 720 may identify display parameter information associated with the first illuminance data. According to an embodiment, the display parameter information associated with the first illuminance data may be identified as parameter information associated with at least one pixel of the display 760 at the time of full measurement of the first illuminance data, during the first time period, or at the end of the first time period. For example, the parameter information associated with at least one pixel of the display 760 may include information associated with at least one of the color, brightness, or transmittance of the display 760. According to an embodiment, the display parameter information associated with the first illuminance data may be COPR information associated with an image output from the display 760 at the time of measuring the first illuminance data, during the first time period, or at the end of the first time period. For example, the COPR information may be a ratio of R, G, and B values ​​of the image output from the display 760. According to an embodiment, the display parameter information associated with the first illuminance data may include AOR information associated with the display 760 at the time of measuring the first illuminance data.

[0144] According to an embodiment, in operation 930, the processor 720 may obtain second illuminance data (e.g., a second illuminance value) based on the display parameter information and the second illuminance data. According to an embodiment, the processor 720 may obtain illuminance raw data based on the illuminance value measured by the illuminance sensor 776 when the display 760 outputs an image with external light blocked. For example, the processor 720 may obtain correction information of the first illuminance data using the illuminance raw data, and apply the correction information to the first illuminance data, thereby obtaining second illuminance data in which the illuminance value affected by the display 760 has been excluded from the first illuminance data.

[0145] According to an embodiment, in operation 940, the processor 720 may adjust the brightness of the display 760 based on the second illuminance data. For example, the processor 720 may determine the actual ambient brightness (e.g., the brightness corresponding to the second illuminance value or the second illuminance data) that is not affected by the display 760 based on the second illuminance data from which the influence of the display 760 has been excluded, and adjust the brightness of the display 760 to the actual ambient brightness. According to the prior art, due to the influence of the display 760, the ambient brightness may be determined to be high even in the dark, and therefore, the user's eyes may feel fatigued due to the high brightness of the display 760. However, according to an embodiment of the present disclosure, the brightness of the display 760 may be adjusted based on the actual ambient brightness while excluding the influence of the display 760, which can relieve eye fatigue.

[0146] Fig.10 is a flowchart illustrating a method of correcting illuminance data in an electronic device according to an embodiment of the present disclosure.

[0147] refer to Fig.10 According to an embodiment, operations 1010 to 1040 may be understood as being performed by an electronic device (eg, Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 A processor (eg, Figure 1 The processor 120 or Figure 7 The processor 720, hereinafter, Figure 7 According to an embodiment, at least one of operations 1010 to 1040 may be omitted or changed in order, or other operations may be added.

[0148] According to an embodiment, in operation 1010, the processor 720 may receive a signal using an illumination sensor (eg, Figure 1 Sensor module 176, Figure 2Sensor module 276, Figure 3a Illuminance sensor 320, Figure 4 Illuminance sensor 420, Figure 5 Illuminance sensor 520 or Figure 7 According to an embodiment, the display parameter information associated with the first illuminance data may include the display parameter information associated with the display (e.g., Figure 1 and Figure 2 Display device 160, Figure 3a Display 301, Figure 4 Display 401, Figure 5 Display 501 or Figure 7 The display 760, hereinafter, Figure 7 The display parameter information associated with the first illuminance data may include information associated with at least one of color, brightness, or transmittance of the display 760 as described as an example. According to an embodiment, the display parameter information associated with the first illuminance data may include COPR information associated with the image output from the display 760 when the first illuminance data is measured. For example, the COPR information may be a ratio of R, G, and B values ​​of the image output from the display 760. According to an embodiment, the display parameter information associated with the first illuminance data may include AOR information associated with the display 760 when the first illuminance data is measured.

[0149] According to an embodiment, in operation 1020, when external light is blocked, the processor 720 may obtain illuminance raw data corresponding to the display parameter information. According to an embodiment, when the display 760 outputs an image when external light is blocked, the processor 720 may obtain illuminance raw data based on the illuminance value measured by the illuminance sensor 776. According to an embodiment, the illuminance raw data may be a value obtained when the illuminance sensor senses light generated from an image output from the display device 760 based on R, G, and B values ​​when light is blocked outside. For example, the illuminance sensor may use R, G, B, and C channels to sense light generated from an image output from the display 760 when light is blocked outside, thereby obtaining an R channel sensing value, a G channel sensing value, a B channel sensing value, and a C channel sensing value. The R channel sensing value may be a sensing value of an R channel component of light generated from an image output from the display 760 when the light is blocked from the outside, the G channel sensing value may be a sensing value of a G channel component of light generated from an image output from the display 760 when the light is blocked from the outside, the B channel sensing value is a sensing value of a B channel component of light generated from an image output from the display 760 when the light is blocked from the outside, and the C channel sensing value is a sensing value of a visible light band component of light generated from the image output from the display 760.

[0150] According to an embodiment, the illuminance raw data may include illuminance values ​​calculated based on R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values, which are obtained when the illuminance sensor senses light generated from an image output on the display 760 based on R, G, and B values ​​when light is blocked from the outside.

[0151] According to an embodiment, in operation 1030, the processor 720 may obtain correction information associated with display parameter information using the illuminance raw data.

[0152] According to an embodiment, the processor 720 may obtain the first correction information or the second correction information.

[0153] According to an embodiment, the first correction information may be an illuminance value corresponding to each of the R, G, and B values ​​having a value of 1, that is, as an illuminance value sensed by the illuminance sensor 776 when each of the R, G, and B values ​​included in the display parameter information is 1 in a case where the external light is blocked. For example, the first correction information may include an illuminance value when the R value is 1 in a case where the external light is blocked, an illuminance value when the G value is 1 in a case where the external light is blocked, or an illuminance value when the B value is 1 in a case where the external light is blocked (e.g., an R channel sensing value when the R value is 1, a G channel sensing value when the G value is 1, or a B channel sensing value when the B value is 1).

[0154] According to an embodiment, the second correction information may include information about the relationship between R, G, and B values ​​of each of the multiple images included in the display parameter information when external light is blocked (e.g., a mathematical equation or formula), and the illuminance value measured when each of the multiple images is output.

[0155] According to an embodiment, the processor 720 may obtain second illuminance data based on the first illuminance data and the correction information in operation 1040. According to an embodiment, the processor 720 may obtain second illuminance data by excluding the illuminance value according to the first correction information from the illuminance value according to the first illuminance data, wherein the second illuminance data is the ambient brightness not affected by the display 760. According to an embodiment, the processor 720 may obtain second illuminance data by inputting the first illuminance data into an equation according to the second correction information to obtain an illuminance value (e.g., COPR illuminance value) affected by the display 760 when external light is blocked, and excluding (deducting) the COPR illuminance value from the first illuminance data, wherein the second illuminance data is the ambient brightness not affected by the display 760.

[0156] According to an embodiment, an electronic device (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 The electronic device 700 may be in a memory (eg, Figure 1 Memory 130 or Figure 7 A table representing illuminance raw data corresponding to display parameter information (eg, COPR information) when external light is blocked (0 lux) is stored in the memory 730).

[0157] Table 1 below is an example table representing illuminance raw data corresponding to display parameter information (eg, COPR information) in a state where external light is blocked.

[0158] [Table 1]

[0159]

[0160]

[0161] Referring to Table 1, the processor 720 may obtain the illuminance raw data corresponding to the display parameter information in the state where the external light is blocked from the memory 730. For example, the processor 720 may obtain that the R channel sensing value measured when the B value is 253 in the state where the external light is blocked (0lux) is 1, the G channel sensing value is 15, the B channel sensing value is 30, the C channel sensing value is 20, and the illuminance value (LUX) is 1.9, the R channel sensing value measured when the G value is 254 in the state where the external light is blocked (0lux) is 39, the G channel sensing value is 138, the B channel sensing value is 42, the C channel sensing value is 88, and the illuminance value (LUX) is 33.5, and the R channel sensing value measured when the R value is 238 in the state where the external light is blocked (0lux) is 83, the G channel sensing value is 4, the B channel sensing value is 1, the C channel sensing value is 40, and the illuminance value (LUX) is 1.9.

[0162] Table 2 below may be an example table representing correction information (e.g., first correction information) obtained by reflecting a specified brightness (e.g., 70 cd) to display parameter information (e.g., COPR information) in a state where external light is blocked and dividing the illuminance raw data by the display parameter information after the brightness is reflected.

[0163] [Table 2]

[0164]

[0165] Referring to Table 2, the processor 720 may obtain correction information (e.g., first correction information), for example, a COPR coefficient for each of the B, G, and R values ​​having a value of 1, by reflecting the specified brightness (e.g., 70 cd) to the display parameter information (e.g., COPR information) in a state where the external light is blocked and dividing the illuminance raw data by the display parameter information after the brightness is reflected. For example, the processor 720 may obtain the first COPR coefficient (R, G, B, C: 0.014, 0.214, 0.429, 0.286) for the B value having a value of 1 by dividing the R value (1) of the illuminance raw data by the B value (70) after the brightness is reflected, dividing the G value (15) of the illuminance raw data by the B value (70) after the brightness is reflected, dividing the B value (30) of the illuminance raw data by the B value (70) after the brightness is reflected, and dividing the C value (20) of the illuminance raw data by the B value (70) after the brightness is reflected. The second and third COPR coefficients of the G and R values ​​having a value of 1 may also be obtained in the same manner as applied to the B value. For example, the first correction information may be a COPR coefficient for each of the R, G, and B values.

[0166] Table 3 below may be an example table for describing a method of obtaining a luminance value (COPR luminance value) affected by a display (COPR of the display) by obtaining a first luminance data after the current brightness is reflected by correction information, and excluding (deducting) the COPR luminance value from the first luminance data to obtain second luminance data, wherein the second luminance data is the ambient brightness not affected by the display 760.

[0167] [Table 3]

[0168]

[0169] Referring to Table 3, the processor 720 can obtain an illuminance value (COPR illuminance value) affected by the display (COPR of the display) by reflecting (multiplying) the first correction information to the first illuminance data measured using the illuminance sensor 776, and reflecting the current brightness (e.g., 0.28) to the first illuminance data after the first correction information is reflected, and the processor 720 can obtain second illuminance data by excluding (deducting) the COPR illuminance value from the first illuminance data, wherein the second illuminance data is the ambient brightness not affected by the display.

[0170] According to an embodiment, an electronic device (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 The processor 720 of the electronic device 700) can correct the first illumination data using the second correction information.

[0171] Table 4 may be an example table representing R, G, and B values ​​of each of a plurality of images output to obtain second correction information when external light is blocked, and illuminance raw data measured when each of the plurality of images is output.

[0172] [Table 4]

[0173]

[0174]

[0175] Referring to Table 4, electronic devices (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic equipment 500 or Figure 7 The processor 720 of the electronic device 700) can obtain the R, G, and B values ​​of each of the multiple images output when the external light is blocked and the illuminance raw data measured when each of the multiple images is output. For example, the processor 720 can obtain the R, G, and B values ​​of each of 4*4 (e.g., (1, 85, 170, 255)*(1, 85, 170, 255))=64 images (where each image has different R, G, and B values ​​from other images), 64 illuminance raw data (where each is measured when a corresponding one of the 64 images is output), and a reference illuminance value (ref LUX) corresponding to the 64 illuminance raw data. According to an embodiment, Equation 1 for obtaining the reference illuminance value (ref LUX) corresponding to the illuminance raw data may be as follows.

[0176] [Mathematical equation 1]

[0177]

[0178] In the above equation 1, the R, G, B, and C values ​​may be illuminance raw data, DGF may be a constant, coef may be a coefficient, Atime may be an illuminance measurement time, and Again may be the sensitivity of the illuminance sensor. The R, G, B, and C values ​​may be multiplied by at least one coef that is the same or different.

[0179] The processor 720 may calculate a luminance value (W) corresponding to each of the R, G, and B values ​​in a state where external light is blocked using a reference luminance value (ref LUX) corresponding to each of the R, G, and B values ​​of each of the plurality of images. For example, Equation 2 for calculating a luminance value W1 (e.g., a COPR luminance value) affected by the R, G, and B values ​​in a state where external light is blocked may be as follows.

[0180] [Mathematical equation 2]

[0181] W1=Cr*R 2.2 +Cg*G 2.2 +Cb*B 2.2

[0182] In the above equation 2, Cr, Cg, and Cb can be coefficients, each of the R, G, and B values, raised to the power of 2.2, which can reflect the point of exponential increase as the R, G, or B value increases.

[0183] When the COPR illuminance value W1 is calculated, the processor 720 may calculate a final COPR illuminance value W2 by reflecting the current brightness.

[0184] Fig.11 is a diagram showing the relationship between brightness and illuminance according to an embodiment of the present disclosure.

[0185] refer to Fig.11 , the horizontal axis may represent brightness (cd), and the vertical axis may represent the rate of change of the COPR illuminance value W1. When the first brightness changes to the second brightness, the COPR illuminance value W1 may change linearly.

[0186] Therefore, the processor 720 may calculate the final COPR illuminance value W2 using a linear equation for applying the current brightness to the calculated COPR illuminance value W1, such as the following Equation 3.

[0187] [Mathematical equation 3]

[0188] W2=GainF*W1*(coefficient)

[0189] In the above formula 3, GainF may be a compensation coefficient according to brightness. Coefficient may be a brightness modeling coefficient.

[0190] The processor 720 may obtain second illuminance data by excluding (deducting) the final COPR illuminance value W2 from the first illuminance data measured by the illuminance sensor 776 , wherein the second illuminance data is the ambient brightness not affected by the display 760 .

[0191] Fig.12 , Fig.13 and Fig.14 is a view illustrating first illuminance data and second illuminance data according to various embodiments of the present disclosure.

[0192] refer to Figure 12 to Figure 14According to an embodiment, first illuminance data 1210, 1310, or 1410 and second illuminance data 1220, 1320, or 1420 may be shown for each of Image 1, Image 2, and Image 3. The first illuminance data 1210, 1310, or 1410 may be illuminance data measured by the illuminance sensor 776 without excluding an illuminance value affected by the display in a state where external light is blocked (0 lux), and the second illuminance data 1220, 1320, or 1420 may be determined after excluding an illuminance value affected by the display from the first illuminance data.

[0193] Unless the illuminance value of the display 760 is excluded from the illuminance data measured by the illuminance sensor 776, the illuminance sensor 776 may recognize that the brightness of the external light is measured to be higher than the actual brightness (0 lux) due to the influence of the display 760. It can be recognized that excluding the illuminance value affected by the display 760 from the illuminance data measured by the illuminance sensor 776 produces a brightness similar to the actual ambient brightness (0 lux).

[0194] Fig.15a and Fig.15b is a view illustrating a method of adjusting brightness of a display using illuminance data in an electronic device according to various embodiments of the present disclosure.

[0195] refer to Fig.15a and Fig.15b According to an embodiment, when the external illumination is high, for example, Fig.15a Outdoors under strong sunlight as shown in FIG, electronic device 1501 (e.g., Figure 1 Electronic devices 101, Figure 3a to Figure 3c Electronic equipment 300, Figure 4 Electronic equipment 400, Figure 5 Electronic device 500, or Figure 7 The electronic device 700) may be provided with a display 1560 (eg, Figure 1 and Figure 2 Display device 160, Figure 3a Display device 301, Figure 4 Display device 401, Figure 5 Display device 501 or Figure 7 The brightness of the display device 760) is increased to enhance visibility and display information brighter than the specified brightness (1512).

[0196] According to an embodiment, when the external illumination is low, for example, Fig.15bAt night when sleep is required, the electronic device 1501 can reduce the brightness of the display 1560 to a brightness lower than the specified brightness and display information darker than the specified brightness (1514). The electronic device 1501 can use the illuminance sensor 1520 (e.g., Figure 1 Sensor module 176, Figure 2 Sensor module 276, Figure 3a Illuminance sensor 320, Figure 4 Illuminance sensor 420, Figure 5 Illuminance sensor 520 or Figure 7 The illuminance sensor 776 of the display 1501 measures external light, thereby determining whether the external illuminance is high or low. According to an embodiment, since the first illuminance data measured using the illuminance sensor 1520 may be affected by the illuminance value corresponding to the display parameter information, the electronic device 1501 may obtain second illuminance data generated by excluding the illuminance value corresponding to the display parameter information from the first illuminance data, and adjust the brightness of the display based on the second illuminance data.

[0197] For example, the electronic device 1501 can determine the actual ambient brightness that is not affected by the display based on the second illuminance data of the illuminance value that has been excluded from the influence of the display (e.g., display parameter information), and adjust the brightness of the display to the actual ambient brightness. Therefore, it can be prevented that the ambient brightness is determined to be high due to the influence of the display in the dark and the user's eyes are tired due to the increased brightness of the display. According to an embodiment, in the electronic device 1501, the display parameter information may include COPR information. When the ratio of the B value in the COPR information is higher than the specified ratio, the electronic device 1501 may provide information indicating that the user's eyes have been exposed to blue light.

[0198] Each of the above components of the electronic device may include one or more parts, and the name of the part may vary with the type of the electronic device. The electronic device according to various embodiments of the present disclosure may include at least one of the above components, omit some of them, or include (multiple) other additional components. Some of the components may be combined into an entity, but the entity may perform the same function as the component may do.

[0199] The term "module" may refer to a unit including one of hardware, software and firmware, or a combination thereof. The term "module" may be used interchangeably with unit, logic, logic block, component or circuit. A module may be the smallest unit or part of an integrated component. A module may be the smallest unit or part that performs one or more functions. A module may be implemented mechanically or electronically. For example, a module may include at least one of an application specific integrated circuit (ASIC) chip, a field programmable gate array (FPGA) or a programmable logic array (PLA) that performs some operations, which is already known or will be developed in the future.

[0200] According to an embodiment of the present disclosure, at least a portion of a device (e.g., a module or its function) or a method (e.g., an operation) may be implemented as an instruction stored in a computer-readable storage medium, for example, in the form of a program module. When the instruction is executed by a processor (e.g., processor 120), the processor may be enabled to perform the corresponding function. The computer-readable storage medium may be, for example, memory 130.

[0201] According to an embodiment, a non-transitory storage medium storing instructions is provided, the instructions being configured to be executed by at least one circuit so as to enable the at least one circuit to perform at least one operation, the at least one operation comprising: receiving first illuminance data measured using an illuminance sensor, identifying display parameter information associated with the first illuminance data, obtaining second illuminance data based on the display parameter information and at least a portion of the first illuminance data, and adjusting the brightness of a display based on at least a portion of the second illuminance data.

[0202] Computer-readable storage media may include hardware devices such as hard disks, floppy disks, and magnetic tapes (e.g., magnetic tapes), optical media such as compact disk ROMs (CD-ROMs) and digital versatile disks (DVDs), magneto-optical media such as floppy disks, ROMs, RAMs, flash memories, and the like. Examples of program instructions may include not only machine language codes but also high-level language codes, which may be executed by various computing devices using interpreters. The above-mentioned hardware devices may be configured to operate as one or more software modules to perform various embodiments of the present disclosure, and vice versa.

[0203] The module or programming module according to various embodiments of the present disclosure may include at least one or more of the above-mentioned components, omit some of them, or further include other additional components. The operations performed by the modules, programming modules or other components according to various embodiments of the present disclosure may be performed sequentially, simultaneously, repeatedly or heuristically. In addition, some of the operations may be performed or omitted in different orders, or other additional (multiple) operations may be included.

[0204] As is apparent from the above description, according to various embodiments, the electronic device can accurately detect external light that is not affected by the display. For example, the electronic device can use parameters associated with an image output from the display to correct the illuminance of light detected under the influence of the display, thereby accurately detecting the illuminance of light that is not affected by the display.

[0205] According to various embodiments, the electronic device may provide illumination of light not affected by the display to various functions using external illumination, thereby preventing the functions using the external illumination from malfunctioning.

[0206] According to various embodiments, the electronic device may use the illuminance of light not affected by the display when adjusting the brightness of the display, thereby resulting in the brightness of the display being accurately adjusted to a brightness at which the user does not feel tired.

[0207] While the disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: a housing, the housing comprising a front surface and a rear surface facing away from the front surface; a display included in the housing and exposed through a portion of the front surface; an illumination sensor disposed between the display and the rear surface to overlap an area of ​​the display when viewed from above the front surface; a processor located within the housing and operably connected to the display; and a memory located within the housing and operably connected to the processor, wherein the memory stores instructions that, when executed, are configured to cause the processor to: receiving first illuminance data measured using the illuminance sensor; identifying display parameter information associated with the first illumination data, wherein the display parameter information is information associated with at least one of color, brightness, or transmittance of the display; When the light is blocked outside, the raw data of illumination is obtained; obtaining correction information for excluding the influence of the display from the first illuminance data by reflecting a specified luminance to display parameter information in a state where external light is blocked and dividing the illuminance raw data by the luminance-reflected display parameter information, obtaining second illumination data by excluding the correction information from the first illumination data, and The brightness of the display is adjusted based on at least a portion of the second illumination data.

2. The electronic device according to claim 1, wherein: The display parameter information includes at least one of the following information: color pixel ratio (COPR) information about an image output through the display, or active matrix organic light emitting diode (AMOLED) off rate (AOR) information about the display.

3. The electronic device according to claim 2, in, The illumination sensor is arranged below at least one area of ​​the display, and The display parameter information is COPR information about an image output from at least the area of ​​the display.

4. The electronic device according to claim 1, wherein: The instructions are further configured to cause the processor to: Using the illumination sensor to measure the first illumination data at each designated first time interval, receiving, from the illuminance sensor, the first illuminance data measured while an interruption occurs at a time when measurement of the first illuminance data is terminated, and Color pixel ratio (COPR) information about an image output from at least a region of the display is identified.

5. The electronic device according to claim 4, wherein: The instructions are also configured to enable the processor to identify COPR information about an image frame output from the display when the interrupt occurs.

6. The electronic device according to claim 5, wherein: The illuminance raw data includes R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values ​​of the illuminance sensor, and the R channel sensing values, G channel sensing values, B channel sensing values, and C channel sensing values ​​respectively correspond to R values, G values, B values, and C values ​​of an image output from the display when light is blocked from the outside.

7. The electronic device according to claim 5, wherein: The illuminance raw data includes an illuminance value calculated based on at least a portion of an R channel sensing value, a G channel sensing value, a B channel sensing value, and a C channel sensing value of the illuminance sensor, wherein the R channel sensing value, the G channel sensing value, the B channel sensing value, and the C channel sensing value respectively correspond to an R value, a G value, a B value, and a C value of an image output from the display when light is blocked from the outside.

8. An electronic device comprising: A housing, the housing comprising a first plate and a rear plate facing away from the first plate; a touch screen display included in the housing, configured to be viewed through a portion of the first panel, and comprising at least one pixel; an illumination sensor disposed between the touch screen display and the back panel to overlap at least one pixel of the touch screen display when viewed from above the first panel; a processor located within the housing and operably connected to the touch screen display and the illumination sensor; and a memory located within the housing and operably connected to the processor, wherein the memory stores instructions that, when executed, are configured to cause the processor to: receiving from the illuminance sensor an amount of light measured by the illuminance sensor during a first time period while the touch screen display is operated, calculating a first illuminance value based on at least a portion of the amount of light received, identifying, during or at the end of the first time period, display parameter information associated with the at least one pixel of the touch screen display; When the light is blocked outside, the raw data of illumination is obtained; obtaining correction information for excluding the influence of the touch screen display from the first illuminance value by reflecting a specified luminance to display parameter information in a state where external light is blocked and dividing the illuminance raw data by the luminance reflected display parameter information, obtaining a second illuminance value by excluding the correction information from the first illuminance value, and Based on at least a portion of the determined second illumination value, a brightness of the touch screen display is adjusted.

9. The electronic device according to claim 8, wherein: The illumination sensor is disposed beneath at least a region of the touch screen display.

10. The electronic device according to claim 9, wherein: The display parameter information includes at least one of the following information: color pixel ratio (COPR) information about an image output through at least one area of ​​the touch screen display, or active matrix organic light emitting diode (AMOLED) off rate (AOR) information.

11. A method for sensing illumination by an electronic device, the method comprising: receiving first illuminance data measured using an illuminance sensor; identifying display parameter information associated with the first illumination data, wherein the display parameter information includes information associated with at least one of color, brightness, or transmittance of a display; When the light is blocked outside, the raw data of illumination is obtained; obtaining correction information for eliminating the influence of the display from the first illuminance data by reflecting the specified luminance to the display parameter information in a state where the external light is blocked and dividing the illuminance raw data by the luminance reflected display parameter information, obtaining second illumination data by excluding the correction information from the first illumination data, and Based on at least a portion of the second illumination data, the brightness of the display is adjusted.

12. The method of claim 11, wherein: The display parameter information includes color pixel ratio (COPR) information about an image output through the display, or active matrix organic light emitting diode (AMOLED) off rate (AOR) information about the display.

13. A non-transitory storage medium storing instructions, the instructions being configured to be executed by at least one circuit to cause the at least one circuit to perform at least one operation, the at least one operation comprising: receiving first illuminance data measured using an illuminance sensor; identifying display parameter information associated with the first illumination data, wherein the display parameter information includes information associated with at least one of color, brightness, or transmittance of a display; When the light is blocked outside, the raw data of illumination is obtained; obtaining correction information for eliminating the influence of the display from the first illuminance data by reflecting the specified luminance to the display parameter information in a state where the external light is blocked and dividing the illuminance raw data by the luminance reflected display parameter information, obtaining second illumination data by excluding the correction information from the first illumination data, and Based on at least a portion of the second illumination data, the brightness of the display is adjusted.

Images