Electronic device, method, and non-transitory computer-readable storage medium for identifying external object adjacent to electronic device

Abstract

According to an embodiment, a method performed by an electronic device may comprise an operation of acquiring a set of sensing data for an illuminance level around the electronic device while displaying an image on a display of the electronic device. The method may comprise an operation of identifying first information about a first duty ratio of a pulse signal. The method may comprise an operation of identifying second information about a second duty ratio of the pulse signal, the second information corresponding to brightness setting information. The method may comprise an operation of determining that an external object is adjacent to the electronic device, on the basis of the second information about the second duty ratio being within a reference range with respect to the first information about the first duty ratio.

Description

Electronic device, method, and non-transitory computer-readable storage medium for identifying an external object adjacent to an electronic device

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable storage media for identifying external objects adjacent to an electronic device.

[0002] An electronic device may include a proximity sensor for identifying an external object adjacent to the electronic device. The proximity sensor may use infrared light to identify an external object adjacent to the electronic device. The proximity sensor may identify an external object by emitting infrared light and identifying the light reflected by the external object.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0004] According to one embodiment, an electronic device may include a display configured to change brightness in response to a pulse signal for pulse width modulation (PWM) techniques, the display including a display area, an ambient light sensor disposed below the display area, a memory storing instructions and including one or more storage media, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain, using the ambient light sensor, a set of sensed data regarding an ambient light level in the electronic device's surroundings while displaying an image on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify, using the set of sensed data, first information regarding a first duty ratio of the pulse signal. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the display.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: identify, using the set of sensing data, first data about an amount of light received by the light sensor while the image is displayed on the display; identify second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; and determine, based on the second data being different from the first data, that an external object is adjacent to the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the second information about the second duty ratio being outside the reference range with respect to the first information about the first duty ratio, that an external object is not adjacent to the electronic device.

[0005] According to one embodiment, a foldable electronic device may include a first housing, a second housing, a hinge structure rotatably connecting the first housing to the second housing about a folding axis, a display area including a first display area corresponding to one side of the first housing and a second display area corresponding to one side of the second housing, the display area being divided about the folding axis, the flexible display configured to change brightness according to a pulse signal for a pulse width modulation (PWM) technique, an illumination sensor disposed below the first display area, a memory storing instructions and including one or more storage media, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a set of sensing data regarding an illumination level around the electronic device using the illumination sensor while displaying an image on the flexible display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify first information regarding a first duty ratio of the pulse signal using the set of sensing data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the flexible display.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: identify, using the set of sensing data, first data about an amount of light received by the light sensor while the image is displayed on the display; identify second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; and identify, based on the second data being different from the first data, a folding state of the foldable electronic device.

[0006] According to one embodiment, an electronic device may include a display configured to change brightness in response to a pulse signal, the display including a display area, an ambient light sensor disposed below the display area, a memory storing instructions and including one or more storage media, and at least one processor including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a set of sensed data regarding an ambient light level around the electronic device using the ambient light sensor while displaying an image on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify first brightness data using the sensed data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second brightness data corresponding to brightness setting information of the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: identify, using the sensing data, first data about an amount of light received by the light sensor while the image is displayed on the display; identify second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; and determine, based on the second data being different from the first data, that an external object is adjacent to the electronic device.

[0007] According to one embodiment, a method performed in an electronic device may include an operation of obtaining a set of sensing data regarding an illuminance level around the electronic device using an illuminance sensor of the electronic device while displaying an image on a display of the electronic device. The method may include an operation of identifying, using the set of sensing data, first information regarding a first duty ratio of a pulse signal for changing a luminance of a display area of ​​the display. The method may include an operation of identifying second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the display. The method may include: identifying, using the set of sensing data, first data about an amount of light received by the light sensor while displaying the image based on the second information about the second duty ratio that is within a reference range with respect to the first information about the first duty ratio; identifying second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; determining, based on the second data that is different from the first data, that an external object is adjacent to the electronic device; and determining, based on the second information about the second duty ratio that is outside a reference range with respect to the first information about the first duty ratio, that an external object is not adjacent to the electronic device.

[0008] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0009] Figure 2 illustrates an example of an electronic device including a light sensor.

[0010] Figure 3 illustrates an example of a simplified block diagram of an electronic device.

[0011] Figure 4a illustrates an example in which light emitted from a display is identified through a light sensor.

[0012] Figure 4b illustrates an example in which light emitted from a display is identified through a light sensor.

[0013] Figure 4c shows an example of the illuminance level over time, as identified by the illuminance sensor, depending on the external conditions.

[0014] FIG. 5 illustrates a flowchart of the operation of an electronic device for determining whether an external object is adjacent to the electronic device.

[0015] Figure 6 shows an example of illuminance identified according to exposure cycle.

[0016] Figures 7a and 7b illustrate the illuminance level over time, as identified by the illuminance sensor, according to the first exposure time and the second exposure time.

[0017] FIG. 8 illustrates a flowchart of the operation of an electronic device for identifying second information regarding a second duty ratio.

[0018] Figure 9 illustrates a flowchart regarding the operation of an electronic device for identifying second data.

[0019] Figure 10 illustrates an example of the operation of an electronic device for identifying a folding state.

[0020] Figure 11a illustrates an example of an electronic device including a camera.

[0021] Figure 11b shows an example of a simplified block diagram of a camera.

[0022] FIG. 11c illustrates a flowchart of the operation of an electronic device for determining whether an external object is adjacent to the electronic device using a camera.

[0023] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0024] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0025] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0026] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0027] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0028] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0029] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0030] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0031] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0032] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0033] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0034] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0035] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0036] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0037] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0038] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0039] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0040] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0041] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0042] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0043] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0044] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0045] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0046] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0047] According to one embodiment, an electronic device (e.g., electronic device (101)) can identify an external object adjacent to the electronic device. For example, the electronic device can identify an external object adjacent to the electronic device using a proximity sensor. The electronic device can identify an external object approaching the electronic device using the proximity sensor.

[0048] For example, a proximity sensor can identify an external object adjacent to an electronic device based on infrared light. The electronic device can use the proximity sensor to emit infrared light and identify an external object adjacent to the electronic device based on the reflected light. For example, the proximity sensor can be configured based on a touch screen display (TSP) and a motion sensor (e.g., an acceleration sensor and / or a gyroscope sensor). The electronic device can identify an external object adjacent to the electronic device based on a change in an electric field identified by the proximity sensor.

[0049] As described above, the proximity sensor may be configured to identify an external object adjacent to the electronic device based on a change in an electric field or reflected infrared light. However, if the external object is identified based on a change in an electric field, the external object may not be identified if the electric field does not change depending on the nature of the external object. Furthermore, if the external object is identified based on reflected infrared light, a photoelectric effect may occur in the display due to the light emission of the LED (light emitting diode) of the proximity sensor. Accordingly, flickering may occur in the area of ​​the display around the proximity sensor, and malfunctions may occur around devices that emit infrared light identical to or similar to the infrared light emitted by the proximity sensor.

[0050] As described above, in cases where a proximity sensor malfunctions and the electronic device does not include a proximity sensor, a method for identifying external objects adjacent to the electronic device may be required. Therefore, the following description will describe technical features for identifying external objects adjacent to the electronic device using a light sensor (or camera).

[0051] Figure 2 illustrates an example of an electronic device including a light sensor.

[0052] Referring to FIG. 2, the electronic device (200) may include a light sensor (220) and a display (230).

[0053] According to one embodiment, the display (230) may include a display area (281). The display area (281) may include sub-pixels configured to emit light for displaying an image. For example, the display (230) may display a screen (e.g., an image or a video) on the display area (281) based on one of a pulse width modulation (PWM) technique and / or a pulse amplitude modulation (PAM) technique. For example, according to the PWM technique, the luminance of the display (230) may be changed based on the duration of pulse signals having the same intensity (or amplitude). For example, according to the PAM technique, the luminance of the display (230) may be changed based on the intensity (or amplitude) of pulse signals having the same duration.

[0054] According to one embodiment, the light sensor (220) may be positioned below the sensing area (282) in the display area (281) of the display (230). For example, the display (230) may include a display panel (not shown) having a front side including the display area (281) and a back side opposite to the front side. The light sensor (220) may be positioned below the display panel (not shown) toward the back side of the display panel (not shown). For example, the sensing area (282) may be configured based on the angle of view of the light sensor (220). The sensing area (282) may correspond to an area configured based on the angle of view of the light sensor (220) within the display area.

[0055] For example, the light sensor (220) can identify reflected light (e.g., visible light) based on the reflection of light (e.g., visible light) emitted through the display (230). The light sensor (220) can identify light reflected by internal components (e.g., glass) of the electronic device (200). The light sensor (220) can identify light reflected by external objects. For example, the light sensor (220) can identify light that enters from the outside of the electronic device (200).

[0056] According to one embodiment, the electronic device (200) can identify an external object (e.g., a user's body) adjacent to the electronic device (200) using a light sensor (220). The electronic device (200) can emit (or output) light by displaying an image through a display (230). The electronic device (200) can identify light reflected by the external object using the light sensor (220). The electronic device (200) can identify that the external object is adjacent to the electronic device (200) based on the light reflected by the external object.

[0057] For example, the electronic device (200) may identify that the light identified by the light sensor (220) is based on reflection of light emitted through the display (230) based on identifying that a characteristic (e.g., duty ratio or PWM duty ratio) of the light identified by the light sensor (220) corresponds to a characteristic of light emitted through the display (230). Since the light identified by the light sensor (220) may be light reflected from within the electronic device (200), the electronic device may determine that the light emitted through the display (230) is reflected by an external object and that the reflected light is identified by the light sensor (220) based on the intensity of the identified light being greater than or equal to a reference intensity. Accordingly, the electronic device (200) can determine that an external object is adjacent to the electronic device (200) based on determining that light emitted through the display (230) is reflected by the external object and that the reflected light is identified through the light sensor (220).

[0058] For example, the electronic device (200) may not display the screen of the display (230) based on determining that an external object (e.g., a part of the user's body) is adjacent to the electronic device (200). For example, the electronic device (200) may deactivate the display (230) based on determining that an external object is adjacent to the electronic device (200).

[0059] According to one embodiment, the electronic device (200) can identify that the electronic device (200) is in the user's pocket based on determining that an external object is in proximity to the electronic device (200). For example, the electronic device (200) can determine that an external object is in proximity to the electronic device (200) and identify that the electronic device (200) is in the user's pocket through at least one of an acceleration sensor and / or a gyro sensor. Based on identifying that the electronic device (200) is in the user's pocket, the electronic device (200) can restrict touch input by disabling the display (230).

[0060] According to one embodiment, the electronic device (200) can display a screen in a low power mode of the display (230). The screen displayed in the low power mode may be referred to as an always on display (AOD) screen. While the AOD screen is displayed, the electronic device (200) can determine that an external object is adjacent to the electronic device (200). Based on determining that the external object is adjacent to the electronic device (200), the electronic device (200) may not display the AOD screen. Based on determining that the external object is adjacent to the electronic device (200), the electronic device (200) may change the low power mode of the display (230) to a deactivated mode and not display the AOD screen.

[0061] According to one embodiment, the electronic device (200) may determine that an external object (e.g., a part of the user's body) is in proximity to the electronic device (200). Based on determining that the external object is in proximity to the electronic device (200), the electronic device (200) may adjust (or limit, control) the power provided to the antenna to lower the specific absorption rate (SAR).

[0062] As described above, specific operations for identifying an external object adjacent to the electronic device (200) through the light sensor (220) will be described below.

[0063] Figure 3 illustrates an example of a simplified block diagram of an electronic device.

[0064] Referring to FIG. 3, the electronic device (200) may provide a function for identifying an external object adjacent to the electronic device (200) using a light sensor (220). For example, the electronic device (200) may include at least some or all of the components of the electronic device (101) of FIG. 1. For example, the electronic device (200) may correspond to the electronic device (101) of FIG. 1.

[0065] According to one embodiment, the electronic device (200) may include a processor (210), a light sensor (220), a display (230), and / or a memory (240). Depending on the embodiment, the electronic device (200) may include at least one of the processor (210), the light sensor (220), the display (230), and / or the memory (240). For example, the electronic device (200) may omit at least some of the processor (210), the light sensor (220), the display (230), and / or the memory (240) depending on the embodiment.

[0066] According to one embodiment, the electronic device (200) may include a processor (210). The processor (210) may be operatively or operably coupled with or connected with a light sensor (220), a display (230), and / or a memory (240). The processor (210) being operatively or operably coupled with the light sensor (220), the display (230), and / or the memory (240) may mean that the processor (210) may control the light sensor (220), the display (230), and / or the memory (240). For example, the light sensor (220), the display (230), and / or the memory (240) may be controlled by the processor (210).

[0067] For example, the processor (210) may include at least a portion of the processor (120) of FIG. 1, or may correspond to at least a portion of the processor (120). For example, the processor (210) may include the main processor (121) of FIG. 1. For example, the processor (210) may include the auxiliary processor (121) of FIG. 1. For example, the processor (210) may include one or more processors, including an application processor (AP) and / or a communication processor (CP). For example, the processor (210) may be implemented as a single chip, such as a system on chip (SoC), or may be implemented as multiple chips. For example, the processor (210) may be implemented as a single integrated circuit or may be implemented as multiple integrated circuits. For example, the processor (210) may be distributedly arranged within the electronic device (200).

[0068] According to one embodiment, the electronic device (200) may include a light sensor (220). For example, the light sensor (220) may include at least a portion of the sensor module (176) of FIG. 1. For example, the light sensor (220) may be used to obtain a light level (or data representing a light level) around the electronic device (200). However, the present invention is not limited thereto.

[0069] For example, the light sensor (220) may include a light receiving circuit. The light receiving circuit may include a photodiode whose electrical characteristics change depending on the amount of light received. The light sensor (220) may obtain sensing data regarding the amount of light using an analog-to-digital converter (ADC).

[0070] For example, the light sensor (220) may operate based on exposure time (or integration time). The light sensor (220) may obtain sensing data indicating an average of the amount of light acquired during the exposure time.

[0071] For example, if the light waveform corresponds to a direct current waveform, the sensing data obtained from the light sensor (220) may be the same at all times when light is emitted.

[0072] For example, if the waveform of light corresponds to an AC waveform, the sensing data acquired from the light sensor (220) may vary depending on the acquisition time of the light. If the waveform of light corresponds to an AC waveform, the processor (210) may identify the waveform of the light using the light sensor (220). The processor (210) may acquire a set of sensing data based on a first exposure time and a second exposure time longer than the first exposure time. The processor (210) may identify the waveform of the light based on the set of sensing data. If the waveform of the light corresponds to an AC waveform, a specific operation for identifying the waveform of the light through the light sensor (220) will be described later in FIG. 6.

[0073] According to one embodiment, the electronic device (200) may include a display (230). The display (230) of the electronic device (200) may output visualized information (e.g., a screen, an image, a video) to a user. For example, the display (230) may be controlled by a controller, such as a graphic processing unit (GPU), to output visualized information to the user. The display (230) may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs). The display (230) may include a flat panel display (FPD) and / or electronic paper. The embodiment is not limited thereto, and the display (230) may have an at least partially curved shape or a deformable shape. A display (230) having a deformable shape may be referred to as a flexible display.

[0074] For example, the display (230) may include a display driving circuit (231) and / or a display panel (232).

[0075] For example, the display driver circuit (231) may be operatively coupled with the display panel (232). For example, when the display panel (232) includes a plurality of LEDs arranged in a two-dimensional matrix form, the display driver circuit (231) may be configured to control at least one LED included in a corresponding row or column among the plurality of LEDs. The display driver circuit (231) controlling the at least one LED may include an operation of adjusting the luminance (or light quantity, brightness) of the LEDs. For example, the display driver circuit (231) may be referred to as a DDI (display driver integrated circuit). In the present disclosure, luminance may mean the intensity of light emitted from pixels of the display (230) (e.g., nit (or cd / m 2 ) of light intensity measured in units of luminance). For example, the brightness value of the display (230) may mean the maximum value of luminance.

[0076] The display driving circuit (231) may receive, for example, image information including image data or an image control signal corresponding to a command for controlling the image data from another component of the electronic device (200). According to one embodiment, the image information may be received from the processor (210) (e.g., a main processor or a secondary processor). According to an embodiment, the display driving circuit (231) may communicate with the light sensor (220). For example, the display driving circuit (231) may store at least some of the received image information in a memory included in the display driving circuit (231) on a frame basis. For example, the display driving circuit (231) may perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least some of the image data based on at least a characteristic of the image data or a characteristic of the display panel (232). The display driving circuit (231) may generate a voltage value or a current value corresponding to the preprocessed or postprocessed image data. According to one embodiment, the generation of the voltage value or current value may be performed at least in part based on, for example, properties of pixels of the display panel (232) (e.g., arrangement of pixels (RGB stripe or pentile structure), or size of each sub-pixel). At least some pixels of the display panel (232) may be driven at least in part based on, for example, the voltage value or current value, so that visual information (e.g., text, image, or icon) corresponding to the image data may be displayed through the display panel (232).

[0077] For example, one of the PWM technique and / or the PAM technique may be used to change the brightness of the display panel (232). According to the PWM technique, the display driving circuit (231) may change the PWM duty ratio according to the fixed brightness. The display driving circuit (231) may store information about pixels currently emitting light in the display panel (232) in a memory included in the display driving circuit (231). According to an embodiment, the display driving circuit (231) may communicate with the processor (210) using at least one of a serial peripheral interface (SPI) and an inter-integrated circuit (I2C). For example, the display driving circuit (231) may provide (or transmit) color data about an image displayed on the display (230) to the processor (210). For example, the display driving circuit (231) may provide (or transmit) color information of a display area and color information of a sensing area to the processor (210).

[0078] According to one embodiment, the electronic device (200) may include a memory (240). For example, the memory (240) may include a circuit and / or a storage medium for storing data and / or instructions input and / or output to the processor (210). The memory (240) may include a display driver (241) and / or a light sensor driver (242). The processor (210) may perform control operations, calculation operations, and / or communication operations related to the display (230) using the display driver (241). The processor (210) may perform control operations, calculation operations, and / or communication operations related to the light sensor (220) using the light sensor driver (242). For example, the processor (210) may set (or change) an exposure time (or integration time) of the light sensor (220) using the light sensor driver (242). For example, the light sensor driver (242) can set (or change) the exposure time (or integration time) of the light sensor (220) using at least one of SPI (serial peripheral interface) and I2C (inter-integrated circuit). For example, the processor (210) can identify a maximum value and / or a minimum value among the values ​​of sensing data acquired through the light sensor (220) using the light sensor driver (242). According to an embodiment, the processor (210) can acquire (or identify) luminance information through the display driver (241) using the light sensor driver (242).

[0079] The memory (240) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The non-volatile memory may be referred to as storage. The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, solid state drive (SSD), and embedded multi media card (eMMC).

[0080] For example, the memory (240) may include at least a portion of the memory (130) of FIG. 1 or may correspond to at least a portion of the memory (130) of FIG. 1. For example, the memory (240) may be implemented as a single chip or as multiple chips. For example, the memory (240) may be implemented as a single integrated circuit or as multiple integrated circuits. For example, the memory (240) may be distributedly arranged within the electronic device (200).

[0081] Figure 4a illustrates an example in which light emitted from a display is identified through a light sensor.

[0082] Figure 4b illustrates an example in which light emitted from a display is identified through a light sensor.

[0083] Figure 4c shows an example of the illuminance level over time, as identified by the illuminance sensor, depending on the external conditions.

[0084] Referring to FIGS. 4A and 4B, FIGS. 4A and 4B are cross-sectional views taken along line A-A' of FIG. 2. FIGS. 4A and 4B are cross-sectional views of a display (230) and a light sensor (220) positioned below the display (230). A state (401) of FIG. 4A is a state in which an external object (450) is not positioned above a sensing area (e.g., the sensing area (282) of FIG. 2). A state (402) of FIG. 4B is a state in which an external object (450) is positioned above the sensing area (282).

[0085] For example, the display (230) may include a protective cover (420) and a display panel (232). The display (230) may be supported by a support member (430). For example, the protective cover (420) may be attached to the front of the display panel (232). As an example, the protective cover (420) may be made of a transparent material (e.g., colorless polyimide (CPI) or glass). For example, the support member (430) may be attached to the bottom of the display panel (232) and may include a metal layer (e.g., a copper sheet) and / or a light-shielding layer (e.g., a black emboss layer).

[0086] The light sensor (220) may be mounted on the substrate assembly (440). The support member (430) may include an opening (431) (e.g., a hole, a slit, or a slot) so that the light sensor (220) can identify (or detect) external light. For example, the opening (431) may be formed at a position and / or a size corresponding to a field of view (FOV) angle of the light sensor (220). According to one embodiment, the sensing area (282) of FIG. 2 may be configured based on the position and / or size corresponding to the FOV angle. As a non-limiting example, the size of the opening (431) may be larger than the size of the light sensor (220). As a non-limiting example, the size of the opening (431) may be the same as the size of the light sensor (220). As a non-limiting example, the size of the aperture (431) may be smaller than the size of the light sensor (220).

[0087] In state (401), the display panel (232) may include at least one pixel (410). At least one pixel (410) may emit light (481). Light (482), which is a part of the light (481), may pass through the protective cover (420). The light (482) may be emitted to the outside of the electronic device (200). Light (483), which is the remaining part of the light (481), may be reflected by the protective cover (420). The light (483) may be identified (or detected) by the light sensor (220). Light (484) emitted from an external light source (490) may enter the interior of the electronic device (200). The light (484) may be identified (or detected) by the light sensor (220).

[0088] For example, the light sensor (220) can identify not only light (484) emitted from an external light source (490), but also light (483), which is a portion of light (481) emitted from the display panel (232). For example, the waveform of the light (481) (or light (483)) may correspond to an AC waveform. The waveform of the light (484) may correspond to a DC waveform. The graph (491) represents the intensity of the light (481) over time. As in the graph (491), the waveform of the light (481) may be configured based on an AC waveform. The graph (492) represents the intensity of the light (484) over time. As in the graph (491), the waveform of the light (484) may be configured based on a DC waveform.

[0089] In state (402), an external object (450) may be positioned on the display (230). At least one pixel (410) of the display panel (232) may emit light (481). The light (481) may be reflected by the external object (450). The light (485) may be reflected light for the light (481). The light (485) may be identified (or detected) by the light sensor (220). For example, the light sensor (220) may identify (or detect) the light (485) that is reflected by the external object (450). As an example, the waveform of the light (481) (or the light (485)) may correspond to an alternating current waveform. The graph (491) represents the intensity of the light (481) over time.

[0090] Referring to state (401) and state (402), the closer an external object (e.g., external object (450)) is positioned to the display (230), the less the influence of an external light source (e.g., external light source (490)) on light identified by the light sensor (220) may be. In addition, the closer an external object (e.g., external object (450)) is positioned to the display (230), the more the influence of the display panel (232) on light identified by the light sensor (220) may be.

[0091] Referring to FIG. 4C, a graph (461) represents illuminance over time, obtained through an illuminance sensor (220), while an image is output through a display (230) in a first state in which the electronic device (200) is located in a darkroom. A graph (462) represents illuminance over time, obtained through an illuminance sensor (220), while an image is output through a display (230) in a second state in which an external light source emitting light having a waveform corresponding to a DC waveform is present. A graph (463) represents illuminance over time, obtained through an illuminance sensor (220), while an image is output through a display (230) in a third state in which an external light source emitting light having a waveform corresponding to a DC waveform is present and an external object is located over a sensing area.

[0092] In the second state, where the direct current component is the largest, the influence of the external light source on the light sensor (220) may be the largest. In the third state, where the alternating current component is the largest, the influence of the display (230) on the light sensor (220) may be the largest. In the first state, where there is no external light source, only the influence of the display (230) on the light sensor (220) may occur.

[0093] Figure 5 illustrates a flowchart of the operations of an electronic device for determining whether an external object is adjacent to the electronic device. In the following embodiments, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0094] Referring to FIG. 5, in operation 501, the processor (210) of the electronic device (200) may obtain a set of sensing data regarding the illuminance level around the electronic device (200) using the illuminance sensor (220). For example, the processor (210) may obtain a set of sensing data regarding the illuminance level around the electronic device (200) using the illuminance sensor (220) while displaying an image on the display (230).

[0095] For example, the light sensor (220) may be positioned under the display (230) (or display panel (232)) of the electronic device (200). The light sensor (220) may be positioned toward the display (230). The light sensor (220) may obtain a set of sensing data regarding the light level around the display (230).

[0096] For example, a set of sensing data may include first sensing data and second sensing data. The processor (210) may obtain the first sensing data using the light sensor (220) based on a first exposure time. The processor (210) may obtain the second sensing data based on a second exposure time. The second exposure time may be shorter than the first exposure time.

[0097] For example, the processor (210) may acquire first sensing data based on a first exposure time during a first time interval. The processor (210) may acquire second sensing data based on a second exposure time during a second time interval that is distinct from the first time interval. However, the present invention is not limited thereto. According to an embodiment, the processor (210) may simultaneously acquire first sensing data based on a first exposure time and second sensing data based on a second exposure time.

[0098] In operation 502, the processor (210) may identify first information regarding a first duty ratio using a set of sensing data. For example, the processor (210) may identify first information regarding a first duty ratio of a pulse signal using the set of sensing data. For example, the display (230) may operate based on a PWM technique. The display (230) may be configured to change brightness according to a pulse signal for the PWM technique. The processor (210) may identify a first duty ratio of the pulse signal for the PWM technique. The first duty ratio of the pulse signal for the PWM technique may be referred to as a first PWM duty ratio.

[0099] According to one embodiment, the processor (210) can estimate the first duty ratio of the pulse signal using a set of sensing data. The processor (210) can identify a waveform of light using the light sensor (220) and estimate the first duty ratio of the pulse signal based on the identified waveform of light.

[0100] According to one embodiment, the set of sensing data may include first sensing data acquired based on a first exposure time (or a first integration time) and second sensing data acquired based on a second exposure time (or a second exposure time).

[0101] The processor (210) can identify a ratio of a first value of the first sensing data to a second value of the second sensing data. Based on identifying the ratio of the first value to the second value, the processor (210) can identify first information regarding a first duty ratio of the pulse signal.

[0102] For example, the first value may correspond to a minimum value among the values ​​relating to the first sensing data. The second value may correspond to a maximum value among the values ​​relating to the second sensing data. However, the present invention is not limited thereto. According to an embodiment, the first value may be a representative value (e.g., a maximum value, a minimum value, a median value, or an average value) among the values ​​relating to the first sensing data. The second value may be a representative value (e.g., a maximum value, a minimum value, a median value, or an average value) among the values ​​relating to the second sensing data.

[0103] As described above, the processor (210) uses the light sensor (220) to identify (or estimate) the first duty ratio of the pulse signal, and the specific operation will be described later in FIGS. 6, 7a, and 7b.

[0104] In operation 503, the processor (210) may identify second information regarding a second duty ratio of a pulse signal corresponding to brightness setting information of the display (230). For example, the processor (210) may identify second information regarding a second duty ratio of a pulse signal corresponding to brightness setting information based on information regarding the display driver (241).

[0105] For example, the processor (210) can identify the second duty ratio of the pulse signal corresponding to the brightness setting information of the display (230) by applying the brightness setting information of the display (230) to the reference data. The specific operation of operation 503 will be described later in FIG. 8.

[0106] In operation 504, the processor (210) can identify whether the second information is within a reference range with respect to the first information. For example, the processor (210) can identify whether the first duty ratio identified through the light sensor (220) corresponds to the second duty ratio identified through the brightness setting information of the display (230).

[0107] For example, the processor (210) can identify whether the second information is within a reference range with respect to the first information to identify whether the light identified through the light sensor (220) corresponds to the light emitted through the display (230).

[0108] For example, the processor (210) can identify whether the light source for the first duty ratio and the light source for the second duty ratio are the same based on identifying whether the first duty ratio and the second duty ratio are the same or similar. The processor (210) can identify whether the light source for the first duty ratio and the light source for the second duty ratio are the same based on identifying whether the first duty ratio and the second duty ratio are within a reference range.

[0109] In operation 505, the processor (210) may determine that the external object is not adjacent to the electronic device (200) if the second information is not within a reference range with respect to the first information. For example, the processor (210) may determine that the external object is not adjacent to the electronic device (200) based on identifying that the second information is not within a reference range with respect to the first information. For example, the processor (210) may determine that the external object is not adjacent to the electronic device (200) based on the second information being outside a reference range with respect to the first information. For example, the processor (210) may determine that the external object is not adjacent to the electronic device (200) based on the first information being outside a reference range with respect to the second information.

[0110] The processor (210) can identify, based on the first information that is different from the second information, that the ratio of light emitted from an external light source to light acquired through the light sensor (220) is large. The processor (210) can determine that no external object exists around the electronic device (200) (or the display (230) of the electronic device (200).

[0111] In operation 506, if the second information is within a reference range with respect to the first information, the processor (210) may identify first data regarding the amount of light received by the light sensor (220) using the set of sensing data. For example, based on the processor (210) identifying that the second information is within a reference range with respect to the first information, the processor (210) may identify first data regarding the amount of light received by the light sensor (220) using the set of sensing data. For example, the processor (210) may identify first data regarding the amount of light received by the light sensor (220) using the first sensing data and the second sensing data included in the set of sensing data.

[0112] For example, the processor (210) can identify first data about the amount of light received by the light sensor (220) while displaying an image on the display (230) based on first information about the first duty ratio and second sensing data. For example, the second sensing data can be acquired based on a short exposure time. Since the second sensing data is acquired based on a short exposure time, the processor (210) can identify the magnitude of the alternating component of light emitted from the display (230) based on the sensing data. The processor (210) can identify the first data about the amount of light received by the light sensor (220) based on the following mathematical equation.

[0113]

[0114]

[0115]

[0116] In operation 508, the processor (210) may identify whether the first data corresponds to the second data. As described above, the processor (210) may identify whether the light identified by the light sensor (220) corresponds to light emitted from the display (230) based on operations 501 to 504. A situation in which the light identified by the light sensor (220) corresponds to light emitted from the display (230) may include a first situation and a second situation. The first situation may be a situation in which no external light source exists. The second situation may be a situation in which an external object is adjacent to the electronic device (200).

[0117] For example, in a first situation where no external light source exists, light identified by the light sensor (220) may correspond to light emitted from the display (230). For example, in a second situation where an external object is adjacent to the electronic device (200) (or the display (230)), light identified by the light sensor (220) may correspond to light emitted from the display (230).

[0118] Accordingly, the processor (210) may perform operation 508 to determine one of the first situation and the second situation.

[0119] For example, based on light emitted from the display (230) being reflected inside the electronic device (200), the first reflected light can be identified through the light sensor (220). Based on light emitted from the display (230) being reflected outside the electronic device (200), the second reflected light can be identified through the light sensor (220). For example, first data can be associated with the first reflected light and the second reflected light. The first data can be acquired from the light sensor (220) based on the first reflected light and the second reflected light. For example, second data can be associated with the first reflected light. The second data can be acquired from the light sensor (220) based on the first reflected light. For example, the first reflected light can be identified regardless of whether an external object is adjacent to the electronic device (200). The second reflected light can be generated when an external object is adjacent to the electronic device (200). For example, the first data may be equal to or greater than the second data.

[0120] The processor (210) can identify whether the first data corresponds to the second data by identifying whether the difference between the first data and the second data is within a reference value. For example, if the difference between the first data and the second data is within the reference value, the processor (210) can identify the first data as corresponding to the second data. If the difference between the first data and the second data is greater than the reference value, the processor (210) can identify the first data as different from the second data.

[0121] In operation 509, the processor (210) may determine that the external object is adjacent to the electronic device (200) if the first data does not correspond to the second data. The processor (210) may determine that the external object is adjacent to the electronic device (200) based on identifying that the first data is different from the second data. The processor (210) may determine that the external object is adjacent to the electronic device (200) if the difference between the first data and the second data is outside a reference value. The processor (210) may determine that the external object is adjacent to the electronic device (200) based on identifying that the first data is different from the second data is outside a reference value.

[0122] In operation 510, the processor (210) may determine that the ambient illumination level of the electronic device (200) is a reference level if the first data corresponds to the second data. For example, the processor (210) may determine that the ambient illumination level of the electronic device (200) is a reference level based on the first data corresponding to the second data. For example, the reference level may refer to an ambient illumination level identified by the ambient illumination sensor (220) based on light emitted from the display (230) in the absence of an external light source. The processor (210) may identify that no external light source exists based on the first data corresponding to the second data.

[0123] As described above, the processor (210) can use the light sensor (220) to determine whether an external object is adjacent to the electronic device (200).

[0124] According to an embodiment, the electronic device (200) may include both a proximity sensor and a light sensor. The battery consumption of the proximity sensor may be greater than that of the light sensor. The processor (210) may identify that the remaining battery capacity of the electronic device (200) is within a reference range. While the remaining battery capacity of the electronic device (200) is within the reference range, the processor (210) may deactivate the proximity sensor and use the light sensor to determine whether an external object is adjacent to the electronic device (200). For example, the processor (210) may use the proximity sensor to identify whether an external object is adjacent to the electronic device (200) in a normal mode. The processor (210) may use the light sensor (220) to identify whether an external object is adjacent to the electronic device (200) in a low-power mode.

[0125] According to an embodiment, the processor (210) may identify the execution of one application within a set of applications determined based on configuration information of the electronic device (200). For example, the configuration information of the electronic device (200) may instruct the set of applications determined to identify whether an external object is adjacent to the electronic device (200) using a light sensor (220). The processor (210) may identify the execution of one application within the set of applications. For example, the executed application may be a phone application. While the application is being executed, the processor (210) may stop displaying a screen through the display (230) based on determining that an external object is adjacent to the electronic device (200) through the light sensor (220).

[0126] Figure 6 shows an example of illuminance identified according to exposure cycle.

[0127] Referring to FIG. 6, light may be output from a light source in the form of a graph (600). For example, the light source may include a display (230) of an electronic device (200). The display (230) (or display panel (232)) may output light using a pulse signal for a PWM technique. For example, the pulse signal may be configured based on a period (601) (e.g., 2 [ms] (milli-second)). The pulse signal may be configured based on a fixed brightness for a time (602) within the period (601). The ratio of the time (602) to the period (601) may be referred to as a duty ratio of the pulse signal.

[0128] For example, the display (230) may operate based on a PWM technique for brightness setting and screen update. The display (230) may have a unique PWM cycle. The PWM duty ratio may be determined based on the brightness (e.g., luminance code) of the display (230) (or the display panel (232)). The processor (210) may identify a waveform (e.g., cycle, size) of light emitted from the display (230) based on the brightness setting information of the display (230) (or information about the display panel (232). The processor (210) may identify the PWM duty ratio based on the brightness setting information of the display (230) (or information about the display panel (232).

[0129] For example, an external light source that is distinct from the display (230) of the electronic device (200) may generally not have a periodicity. On the other hand, an external light source (or AC lighting) that outputs light in an alternating current waveform may output light with a period of 120 Hz to 480 Hz. The processor (210) may distinguish the light sources through a duty ratio of a pulse signal (e.g., PWM duty ratio) even if the light sources (e.g., the display (230) and the external light sources) output light with the same period. The processor (210) may identify whether the identified light is light output from the display (230) based on the duty ratio of the pulse signal for the light identified through the light sensor (220).

[0130] The light sensor (220) can identify the light level based on a first exposure time (610) (e.g., 25 [ms] (milli-second)) during a first time interval from time point (t1) to time point (t2). The light sensor (220) can identify the light level based on a second exposure time (620) (e.g., 0.1 [ms]) during a second time interval from time point (t2) to time point (t3).

[0131] The light sensor (220) can identify the average light level at a designated location over a set exposure time. For example, the light sensor (220) can identify information regarding the light level of a sensing area. Information regarding the light level of a sensing area can be displayed as images (651) and (652).

[0132] For example, the image (651) may represent illuminance levels within a sensing area identified by the illuminance sensor (220) according to a first exposure time (610). The illuminance sensor (220) may identify an average value of illuminance levels identified within a unit area during the first exposure time (610). The average values ​​of illuminance levels identified within the sensing area by the illuminance sensor (220) during the first exposure time (610) may be configured as the image (651).

[0133] For example, the image (652) may represent illuminance levels within a sensing area identified by the illuminance sensor (220) according to a second exposure time (620) that is shorter than the first exposure time (610). The illuminance sensor (220) may identify an average value of the illuminance levels identified within a unit area during the second exposure time (620). The average values ​​of the illuminance levels identified within the sensing area by the illuminance sensor (220) during the second exposure time (620) may be configured as the image (652). Since the second exposure time (620) is shorter than the period (601) of the pulse signal, the illuminance sensor (220) may identify illuminance levels identified at specific points in time. For example, illuminance levels identified in an area (661) within the image (652) may be greater than illuminance levels identified in an area (662) within the image (652). The illumination levels identified in the sensing area can be changed depending on the setting information (or scanning method) of the display (230).

[0134] Figures 7a and 7b illustrate the illuminance level over time, as identified by the illuminance sensor, according to the first exposure time and the second exposure time.

[0135] Referring to FIG. 7A, the display (230) (or display panel (232)) can output light using a pulse signal for a PWM technique. A graph (710) may be related to the output of the display (230). The graph (710) represents the brightness of the display (230) over time. For example, the graph (710) may be composed of a plurality of pulse signals. The ratio of the time intervals during which the signal is turned on (or activated) with respect to the time interval of one pulse signal may be referred to as a duty ratio. According to the graph (710), the duty ratio (or PWM duty ratio) may be set to 50%.

[0136] According to one embodiment, the light sensor (220) can identify the illuminance (or illuminance level) based on a first exposure time (e.g., the first exposure time (610) of FIG. 6). For example, the first exposure time can be set to be longer than the time interval of one pulse signal. Graph (721) represents the illuminance over time. The illuminance identified by the light sensor (220) based on the first exposure time can be displayed as in graph (721).

[0137] The illuminance sensor (220) can identify illuminance (or illuminance level) based on a second exposure time (e.g., the second exposure time (620) of FIG. 6). For example, the second exposure time can be set to be shorter than the time interval of one pulse signal. Graph (722) represents illuminance over time. The illuminance identified by the illuminance sensor (220) based on the second exposure time can be displayed as shown in graph (722).

[0138] Referring to FIG. 7B, the display (230) (or display panel (232)) can output light using a pulse signal for a PWM technique. A graph (730) may be related to the output of the display (230). The graph (730) represents the brightness of the display (230) over time. For example, the graph (730) may be composed of a plurality of pulse signals. The ratio of the time intervals during which the signal is turned on (or activated) with respect to the time interval of one pulse signal may be referred to as a duty ratio. According to the graph (730), the duty ratio (or PWM duty ratio) may be set to 80%.

[0139] According to one embodiment, the light sensor (220) can identify the illuminance (or illuminance level) based on a first exposure time (e.g., the first exposure time (610) of FIG. 6). For example, the first exposure time can be set to be longer than the time interval of one pulse signal. Graph (741) represents illuminance over time. The illuminance identified by the light sensor (220) based on the first exposure time can be displayed as in graph (741).

[0140] The illuminance sensor (220) can identify illuminance (or illuminance level) based on a second exposure time (e.g., the second exposure time (620) of FIG. 6). For example, the second exposure time can be set to be shorter than the time interval of one pulse signal. Graph (722) represents illuminance over time. The illuminance identified by the illuminance sensor (220) based on the second exposure time can be displayed as in graph (742).

[0141] Referring to FIGS. 7A and 7B , the illuminance sensor (220) can identify illuminance (or illuminance level) based on the first exposure time and the second exposure time. For example, when the illuminance sensor (220) identifies illuminance (or illuminance level) based on the first exposure time, the average illuminance during the first exposure time can be identified. When the illuminance sensor (220) identifies illuminance (or illuminance level) based on the second exposure time, the maximum value and / or minimum value of the luminance output from the display (230) can be identified.

[0142] According to one embodiment, the processor (210) may identify first sensing data (e.g., graph (721) or graph (741)) acquired through the light sensor (220) based on a first exposure time and second sensing data (e.g., graph (722) or graph (742)) acquired through the light sensor (220) based on a second exposure time. The processor (210) may identify a first duty ratio of a pulse signal for the display (230) based on the first sensing data and the second sensing data.

[0143] For example, the first duty ratio may be identified (or estimated) based on the following mathematical equation. The first duty ratio may be a duty ratio identified (or estimated) based on data identified by the light sensor (220). The second duty ratio may be an actual duty ratio identified based on the brightness level of the display (230).

[0144]

[0145]

[0146] For example, in FIG. 7A, graph (721) may be related to first sensing data. Graph (722) may be related to second sensing data. The minimum value of graph (721) (or values ​​related to the first sensing data) is 50 [lux]. The maximum value of graph (722) (or values ​​related to the second sensing data) is 100 [lux]. According to Equation 2, the first duty ratio (e.g., first PWM duty ratio) may be identified (or estimated) as 50%. The first duty ratio identified through the light sensor (220) may correspond to the second duty ratio (e.g., duty ratio of the pulse signal according to graph (710)) related to the display (230).

[0147] For example, in FIG. 7B, graph (741) may be related to first sensing data. Graph (722) may be related to second sensing data. The minimum value of graph (741) (or values ​​related to the first sensing data) is 80 [lux]. The maximum value of graph (742) (or values ​​related to the second sensing data) is 100 [lux]. According to Equation 2, the first duty ratio (e.g., first PWM duty ratio) may be identified (or estimated) as 80%. The first duty ratio identified through the light sensor (220) may correspond to the second duty ratio (e.g., duty ratio of the pulse signal according to graph (730)) related to the display (230).

[0148] As described above, the processor (210) can obtain first sensing data based on a first exposure time and second sensing data based on a second exposure time using the light sensor (220). Based on the first sensing data and the second sensing data, the processor (210) can identify (or estimate) a duty ratio (e.g., PWM duty ratio) of a pulse signal for the display (230).

[0149] Figure 8 illustrates a flowchart of the operation of an electronic device for identifying second information regarding a second duty ratio. In the following embodiments, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0150] Referring to FIG. 8, in operation 810, the processor (210) can identify brightness setting information of the display (230). The processor (210) can obtain brightness information of the display (230) using the display driver (241). For example, the brightness information may include a brightness code.

[0151] For example, the luminance information may be set based on the ambient illuminance of the electronic device (200). For example, the luminance information may be set based on a user's input. The display (230) (or display panel (232)) may change the duty ratio based on the luminance information. For example, if the luminance code is set high, the duty ratio may be set high. If the luminance code is set low, the duty ratio may be set low. The duty ratio according to the luminance code may be related to the reference data described below.

[0152] In operation 820, the processor (210) may apply brightness setting information of the display (230) to reference data. For example, the reference data may include information regarding a duty ratio set according to a luminance code. The reference data may be set as shown in the table below.

[0153] Luminance Code Duty Ratio (%) Luminance Code Duty Ratio (%) Luminance Code Duty Ratio (%) 1~1610.04031.36956.71710.84232.67158.21811.94333.97259.71913.04435.27461.02014.14636.57562.52215.14737.77764.02316.24939.07965.52417.35040.38066.82518.45241.68268.32719.453 43.18469.82820.55544.48571.32921.85645.78773.13122.95847.08974.63224.25948.59176.13325.36149.89277.63526.56351.19479.33627.66452.69680.83728.96653.99782.33930.26755.499~25584.0

[0154] Referring to Table 1, the duty ratio can be set according to the luminance code. The display driver (241) can provide the duty ratio according to each luminance code. For example, if the luminance code is 58, the duty ratio can be set to 47%.

[0155] In operation 830, the processor (210) may identify second information regarding the second duty ratio. For example, the processor (210) may identify second information regarding the second duty ratio by applying brightness setting information of the display (230) to reference data. For example, the processor (210) may identify brightness setting information (e.g., luminance code) of the display (230). Based on the reference data, the processor (210) may identify second information regarding the second duty ratio corresponding to the brightness setting information.

[0156] Figure 9 illustrates a flowchart of the operations of an electronic device for identifying second data. In the following embodiments, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0157] Referring to FIG. 9, in operation 910, the processor (210) may obtain color data regarding an image. For example, the processor (210) may obtain color data regarding an image displayed on a display area from the display driving circuit (231). For example, the display driving circuit (231) may provide color data of an image to be output (or output) to the processor (210). The processor (210) may obtain color data regarding an image displayed on a display area from the display driving circuit (231).

[0158] In operation 920, the processor (210) can identify color information of a display area (e.g., display area (281) of FIG. 2) and color information of a sensing area (e.g., sensing area (282) of FIG. 2). For example, the processor (210) can identify color information of the display area and color information of the sensing area based on color data regarding the image.

[0159] For example, color information may include color on pixel ratio (COPR) information. The COPR information may indicate the ratio of R / G / B (R value, G value, and B value) for a specified area (e.g., display area or sensing area) of the display (230).

[0160] For example, the COPR information may represent the average of R values, the average of G values, and the average of B values ​​that should be displayed in the pixels included in the specified area, respectively. The R average value may be a red value and may be a value within 0 to 255, the G average value may be a green value and may be a value within 0 to 255, and the B average value may be a blue value and may be a value within 0 to 255. As an example, the COPR information of an area where a white portion is displayed on the display (230) may be set to a value of (R, G, B: 255, 255, 255).

[0161] For example, the processor (210) can obtain the ratio of R (hereinafter, A(active area)_COPR R), the ratio of G (A_COPR G), and the ratio of B (A_COPR B) in the display area based on the color data. The processor (210) can obtain the ratio of R (hereinafter, S(sensor area)_COPR R), the ratio of G (S_COPR G), and the ratio of B (S_COPR B) in the sensing area based on the color data.

[0162] For example, the ratio of R in the display area (A_COPR R) may mean a value representing R of the image displayed in the display area, such as a mean value, a median value, or a mode value. The ratio of R in the sensing area (S_COPR R) may mean a value representing a portion of the image to be displayed in the sensing area, such as a mean value, a median value, or a mode value.

[0163] According to an embodiment, the processor (210) may obtain color information of the display area and color information of the sensing area from the display driving circuit (231).

[0164] In operation 930, the processor (210) can identify second data on the amount of light corresponding to the color information of the sensing area. For example, the processor (210) can identify second data on the amount of light corresponding to the color information of the sensing area based on the color information of the display area and the color information of the sensing area.

[0165] For example, the processor (210) may identify (or obtain) a first color value for the display area based on color information of the display area. The processor (210) may identify a second color value for the sensing area based on color information of the sensing area. The first color value and the second color value may be identified based on the following mathematical equations.

[0166]

[0167] Referring to mathematical expression 3, Cr, Cg, and Cb are coefficients.

[0168] For example, when Equation 3 is used to identify the first color value, COPR W is the first color value for the display area. COPR R is the proportion of R in the display area (A_COPR R). COPR G is the proportion of G in the display area (A_COPR G). COPR B is the proportion of B in the display area (A_COPR B).

[0169] For example, when Equation 3 is used to identify a second color value, COPR W is the second color value for the sensing region. COPR R is the proportion of R in the sensing region (S_COPR R). COPR G is the proportion of G in the sensing region (S_COPR G). COPR B is the proportion of B in the sensing region (S_COPR B).

[0170] The processor (210) can identify a ratio between a first color value (A_COPR W) and a second color value (S_COPR_W). The ratio (R) between the first color value (A_COPR W) and the second color value (S_COPR_W) can be identified based on the following mathematical equation.

[0171]

[0172] The processor (210) can identify second data on the amount of light corresponding to the color information of the sensing area based on the ratio (R) between the first color value (A_COPR W) and the second color value (S_COPR_W). The second data can be identified based on the following mathematical formula.

[0173]

[0174]

[0175] After acquiring the second data, the processor (210) can identify whether the first data corresponds to the second data, as described in FIG. 5 . For example, if the difference between the first data and the second data is within a reference value, the processor (210) can determine that the ambient illumination level of the electronic device (200) is the reference level. For example, if the difference between the first data and the second data is outside the reference value, the processor (210) can determine that an external object is adjacent to the electronic device (200).

[0176] Figure 10 illustrates an example of the operation of an electronic device for identifying a folding state.

[0177] Referring to FIG. 10, in states (1001) and (1002), the electronic device (200) may be a foldable device that folds along a folding axis (1093). For example, the electronic device (200) may include a first housing (1010), a second housing (1020), and a hinge structure (1030). For example, the hinge structure (1030) may rotatably couple the first housing (1010) to the second housing (1020) about the folding axis (1093).

[0178] For example, the display (230) can be folded along the folding axis (1093). The display (230) may be referred to as a flexible display. The display (230) may be divided into a first display area (1051) and a second display area (1052) based on the folding axis (1093). The first display area (1051) may correspond to one side of the first housing (1010). The second display area (1052) may correspond to one side of the second housing (1020).

[0179] According to one embodiment, the electronic device (200) may be defined in a folding state and an unfolding state based on an angle (1063) between a first direction (1061) toward which the first display area (1051) faces and a second direction (1062) toward which the second display area (1052) faces.

[0180] For example, while the angle (1063) is within the reference angle range, the electronic device (200) may be in the unfolded state. While the angle (1063) is outside the reference angle range, the electronic device (200) may be in the folded state. State (1001) may be an example of the unfolded state. State (1002) may be an example of the folded state.

[0181] According to one embodiment, the processor (210) may identify a folding state of the electronic device (200) using the light sensor (220). For example, the light sensor (220) may be disposed within the first housing (1010). The processor (210) may identify whether the second housing (1020) is adjacent to the first housing (1010) using the light sensor (220), according to the above-described embodiment. Based on identifying that the second housing (1020) is adjacent to the first housing (1010), the processor (210) may identify that the electronic device (200) is in a folding state. Based on identifying that the second housing (1020) is adjacent to the first housing (1010), the processor (210) may identify that the angle (1063) is within a reference range.

[0182] According to one embodiment, the processor (210) may obtain a set of sensing data about the illumination level around the electronic device (200) using the illumination sensor (220) while displaying an image on the display (230). For example, the processor (210) may display an image on the display (230) while the electronic device (200) is in an unfolded state. The processor (210) may obtain a set of sensing data about the illumination level around the electronic device (200) using the illumination sensor (220) while displaying an image on the display (230). The processor (210) may identify first information about a first duty ratio of a pulse signal using the set of sensing data. The processor (210) may identify second information about a second duty ratio of the pulse signal corresponding to brightness setting information of the display (230). The processor (210) can identify first data on the amount of light received by the light sensor (220) using a set of sensing data based on second information on the second duty ratio within a reference range with respect to first information on the first duty ratio. The processor (210) can identify second data on the amount of light corresponding to color information of a sensing area located above the light sensor in the display area. The processor (210) can identify that the second housing (1020) is adjacent to the first housing (1010) based on the second data that is different from the first data. The processor (210) can identify that the electronic device (200) is in a folded state based on identifying that the second housing (1020) is adjacent to the first housing (1010).

[0183] The above-described embodiment only illustrates an example of identifying a folding state in a foldable device, but is not limited thereto. According to an embodiment, if an electronic device (200) is equipped with a case including a display cover, the electronic device (200) may use a light sensor (220) to identify whether the display cover is covering the display (230).

[0184] Unlike the embodiments described above, the electronic device (200) can use a camera to identify whether an external object is adjacent to the electronic device (200). The camera can perform at least some of the operations of a light sensor, as it receives external light by adjusting the exposure. Accordingly, in the following FIGS. 11A to 11C, an operation for identifying whether an external object is adjacent to the electronic device using a camera will be described.

[0185] Figure 11a illustrates an example of an electronic device including a camera.

[0186] Figure 11b shows an example of a simplified block diagram of a camera.

[0187] FIG. 11c illustrates a flowchart of the operation of an electronic device for determining whether an external object is adjacent to the electronic device using a camera.

[0188] Referring to FIG. 11A, the electronic device (200) may include a camera (1100) and a display (230).

[0189] According to one embodiment, the display (230) may include a display area (1181). The display area (1181) may include sub-pixels configured to emit light for displaying an image. For example, the display (230) may display a screen (e.g., an image or a video) on the display area (1181) based on one of a pulse width modulation (PWM) technique and / or a pulse amplitude modulation (PAM) technique.

[0190] According to one embodiment, the camera (1100) may be positioned below the sensing area (1182) in the display area (1181) of the display (230). For example, the display (230) may include a display panel (not shown) including a front side including the display area (1181) and a back side opposite to the front side. Depending on the embodiment, the display area (1181) and the sensing area (1182) may be distinguished. For example, an image (or video) may not be displayed in the sensing area (1182). For example, the sensing area (1182) may be configured based on an area of ​​the display area (1181) corresponding to the angle of view of the camera (1100).

[0191] For example, the camera (1100) can acquire an image based on an exposure value (EV). The exposure value can be used to control the amount of light acquired through the lens of the camera (1100). The exposure value can be set based on an aperture value (focal number, f-number) and shutter speed.

[0192] According to one embodiment, the electronic device (200) can identify an external object (e.g., a user's body) adjacent to the electronic device (200) using the camera (1100). The electronic device (200) can acquire an image while displaying a screen (e.g., a preview image or a camera application) through the display (230). The electronic device (200) can emit (or output) light by displaying a screen (e.g., a preview image or a camera application) through the display (230). The electronic device (200) can identify that an external object is adjacent to the electronic device (200) based on light reflected by the external object.

[0193] Referring to FIG. 11b, the camera (1100) may include a lens assembly (1101), an image sensor (1102), and / or an image processor (1103).

[0194] For example, the lens assembly (1101) can be used to collect light emitted from a subject. Not only light emitted from the subject, but also light emitted from the display (230) can be collected together through the lens assembly (1101).

[0195] For example, the image sensor (1102) can be used to convert light collected through the lens assembly (1102) into an electrical signal. The image sensor (1102) can acquire an image by converting light collected through the lens assembly (1102) into an electrical signal. The image sensor (1102) can include a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

[0196] For example, the image processor (1103) may be used to perform processing on an image acquired through the image sensor (1102). For example, the image processor (1103) may perform control on shutter speed, aperture value, and / or ISO (International Organization for Standardization) sensitivity. Based on the processing performed on the image, the image processor (1103) may display the processed image through the display (230). For example, the image processor (1103) may be distinguished from the processor (210) of the electronic device (200). According to an embodiment, the image processor (1103) may be configured as at least a part of the processor (210).

[0197] Referring to FIG. 11C, in operation 1191, the processor (210) may acquire a first image based on a first exposure value and a second image based on a second exposure value. For example, the processor (210) may acquire the first image and the second image while a screen (e.g., a preview image or a camera application) is displayed through the display (230). For example, the first image may be acquired based on a first exposure value. The second image may be acquired based on a second exposure value.

[0198] In operation 1192, the processor (210) may identify first information regarding the first duty ratio using the first exposure value and the second exposure value. For example, the processor (210) may identify a first illuminance level corresponding to the first exposure value and a second illuminance level corresponding to the second exposure value.

[0199] For example, the illuminance level corresponding to the exposure value can be identified based on the table below.

[0200]

[0201] Referring to Table 2, EV represents the exposure value. Lux represents the illuminance level. The processor (210) can identify the illuminance level according to the exposure value according to Table 2. Table 2 is exemplary and may be modified according to embodiments.

[0202] According to one embodiment, the processor (210) may identify first information about the first duty ratio based on the first exposure value and the second exposure value. The processor (210) may identify first information about the first duty ratio based on the first illuminance level corresponding to the first exposure value and the second illuminance level corresponding to the second exposure value. The operation of identifying the first information about the first duty ratio using the first illuminance level and the second illuminance level may be related to operation 502 of FIG. 5.

[0203] In operation 1193, the processor (210) may identify second information regarding a second duty ratio of a pulse signal corresponding to brightness setting information of the display (230). Operation 1193 may correspond to operation 503 of FIG. 5.

[0204] In operation 1194, the processor (210) may identify whether the second information is within a reference range with respect to the first information. Operation 1194 may correspond to operation 504 of FIG. 5.

[0205] In operation 1195, the processor (210) may determine that the external object is not adjacent to the electronic device (200) if the second information is not within a reference range with respect to the first information. Operation 1195 may correspond to operation 505 of FIG. 5.

[0206]

[0207] In operation 1197, the processor (210) may identify second data regarding the amount of light corresponding to the color information of the sensing area. Operation 1197 may correspond to operation 507 of FIG. 5.

[0208] In operation 1198, the processor (210) may identify whether the first data corresponds to the second data. Operation 1198 may correspond to operation 508 of FIG. 5.

[0209] In operation 1199, the processor (210) may determine that an external object is adjacent to the electronic device (200) if the first data does not correspond to the second data. Operation 1199 may correspond to operation 509 of FIG. 5.

[0210] In operation 1200, the processor (210) may determine that the ambient illumination level of the electronic device (200) is a reference level if the first data corresponds to the second data. Operation 1200 may correspond to operation 510 of FIG. 5.

[0211] According to the above-described embodiments, the processor (210) can identify whether an external object is adjacent to the electronic device (200) based on light in the visible light range emitted from the display (230) using the light sensor (220). Since it is identified whether an external object is adjacent to the electronic device (200) based on the reflected light from the light emitted from the display (230), there may be no impact on the display (230). In other words, when it is identified whether an external object is adjacent to the electronic device (200) through a proximity sensor disposed under the display panel, light may be emitted through the display (230) due to the photoelectric effect. On the other hand, when it is identified whether an external object is adjacent to the electronic device (200) through the light sensor (220), light may not be emitted through the display (230). Therefore, user convenience may be increased because light is not emitted through the display (230).

[0212] According to the above-described embodiment, the power consumption of the proximity sensor is greater than that of the light sensor (220). Therefore, when the light sensor (220) is used to identify whether an external object is adjacent to the electronic device (200), the power consumption can be reduced.

[0213] According to the above-described embodiment, if the electronic device (200) does not include a proximity sensor, the electronic device (200) can deactivate the display (230) of the electronic device (200) based on identifying that an external object is in proximity to the electronic device (200) using the light sensor (220). As the display (230) is deactivated, mistouch can be prevented.

[0214] According to the above-described embodiment, when a designated application (e.g., a call application) is executed in the electronic device (200), it is possible to identify whether an external object is adjacent to the electronic device (200) through the light sensor (220) rather than the proximity sensor. When it is identified whether an external object is adjacent to the electronic device (200) through the light sensor (220) rather than the proximity sensor, the photoelectric effect does not occur, and thus light can be prevented from being emitted from at least a portion of the display (230).

[0215] According to the above-described embodiment, based on light in the visible light range, it can be identified whether an external object is adjacent to the electronic device (200) through the light sensor (220). Accordingly, it can be identified whether an object transmitting light in the infrared range is adjacent to the electronic device (200). In addition, even in a situation where light in the infrared range is generated (e.g., a situation where an infrared remote control is operated), the electronic device (200) can identify whether an external object is adjacent to the electronic device (200) through the light sensor (220).

[0216] According to one embodiment, an electronic device (e.g., electronic device (200)) may include a display (e.g., display (230)) configured to change brightness in accordance with a pulse signal for pulse width modulation (PWM) technique, the display including a display area, an ambient light sensor (e.g., ambient light sensor (220)) disposed below the display area, a memory (e.g., memory (240)) storing instructions and including one or more storage media, and at least one processor (e.g., processor (210)) including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a set of sensing data regarding an ambient light level in the electronic device's surroundings using the ambient light sensor while displaying an image on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify first information regarding a first duty ratio of the pulse signal using the set of sensed data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the display.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: identify, using the set of sensing data, first data about an amount of light received by the light sensor while the image is displayed on the display; identify second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; and determine, based on the second data being different from the first data, that an external object is adjacent to the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the second information about the second duty ratio being outside the reference range with respect to the first information about the first duty ratio, that an external object is not adjacent to the electronic device.

[0217] According to one embodiment, the display may include a display panel including a front surface including the display area and a rear surface opposite the front surface, and a display driving circuit. The light sensor may be disposed under the display panel, facing the rear surface of the display panel.

[0218] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain color data relating to the image displayed on the display area from the display driving circuit.

[0219] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify color information of the display area and color information of the sensing area based on color data about the image. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second data about an amount of light corresponding to the color information of the sensing area based on the color information of the display area and the color information of the sensing area.

[0220] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: acquire first sensing data included in the set of sensing data based on a first exposure time while the image is displayed on the display; acquire second sensing data included in the set of sensing data based on a second exposure time shorter than the first exposure time; and identify first information regarding the first duty ratio based on identifying a ratio of a first value regarding the first sensing data to a second value regarding the second sensing data.

[0221] According to one embodiment, the first value may correspond to a minimum value among the values ​​relating to the first sensing data. The second value may correspond to a maximum value among the values ​​relating to the second sensing data.

[0222] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify the first data about the amount of light received by the light sensor while the image is displayed on the display, based on the first information about the first duty ratio and the second sensing data.

[0223] According to one embodiment, the second data may correspond to data on the amount of light measured by the light sensor when the level of light around the electronic device is a reference level.

[0224] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine that the illuminance level is the reference level based on the second data corresponding to the first data.

[0225] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify execution of an application within a set of applications determined based on configuration information of the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to stop displaying a screen through the display based on determining that an external object is in proximity to the electronic device while the application is executing.

[0226] According to one embodiment, the electronic device may include a proximity sensor and a battery. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify that the remaining capacity of the battery is within a reference range. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to deactivate the proximity sensor and, using the light sensor, determine whether an external object is adjacent to the electronic device while the remaining capacity of the battery is within the reference range.

[0227] According to one embodiment, a foldable electronic device (e.g., electronic device (200)) may include a first housing, a second housing, a hinge structure rotatably connecting the first housing to the second housing with respect to a folding axis, a flexible display including a display area including a first display area corresponding to one side of the first housing and a second display area corresponding to one side of the second housing divided with respect to the folding axis, and configured to change brightness according to a pulse signal for a pulse width modulation (PWM) technique, an illumination sensor (e.g., illumination sensor (220)) disposed below the first display area, a memory (e.g., memory (240)) storing instructions and including one or more storage media, and at least one processor (e.g., processor (210)) including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may be configured to: determine, by using the illumination sensor, an illumination level around the electronic device while displaying an image on the flexible display; The electronic device may be caused to obtain a set of sensing data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify first information regarding a first duty ratio of the pulse signal using the set of sensing data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the flexible display.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: identify, using the set of sensing data, first data about an amount of light received by the light sensor while the image is displayed on the display; identify second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; and identify, based on the second data being different from the first data, a folding state of the foldable electronic device.

[0228] According to one embodiment, an electronic device (e.g., electronic device (200)) may include a display (e.g., display (230)) configured to change brightness in response to a pulse signal and including a display area, an ambient light sensor (e.g., ambient light sensor (220)) disposed below the display area, a memory (e.g., memory (240)) storing instructions and including one or more storage media, and at least one processor (e.g., processor (210)) including a processing circuit. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain a set of sensed data regarding an ambient light level around the electronic device using the ambient light sensor while displaying an image on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify first luminance data using the sensed data. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to identify second luminance data corresponding to brightness setting information of the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: identify, using the sensing data, first data regarding an amount of light received by the light sensor while the image is displayed on the display; identify second data regarding an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; and determine, based on the second data being different from the first data, that an external object is adjacent to the electronic device.

[0229] According to one embodiment, a method performed in an electronic device (e.g., electronic device (200)) may include an operation of obtaining a set of sensing data regarding an illumination level around the electronic device using an illumination sensor (e.g., illumination sensor (220)) of the electronic device while displaying an image on a display (e.g., display (230)) of the electronic device. The method may include an operation of identifying, using the set of sensing data, first information regarding a first duty ratio of a pulse signal for changing a luminance of a display area of ​​the display. The method may include an operation of identifying second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the display. The method may include: identifying, using the set of sensing data, first data about an amount of light received by the light sensor while displaying the image based on the second information about the second duty ratio that is within a reference range with respect to the first information about the first duty ratio; identifying second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; determining, based on the second data that is different from the first data, that an external object is adjacent to the electronic device; and determining, based on the second information about the second duty ratio that is outside a reference range with respect to the first information about the first duty ratio, that an external object is not adjacent to the electronic device.

[0230] In one embodiment, the method may include: while the image is displayed on the display, acquiring first sensing data included in the set of sensing data based on a first exposure time; acquiring second sensing data included in the set of sensing data based on a second exposure time shorter than the first exposure time; and identifying first information about the first duty ratio based on identifying a ratio of a first value about the first sensing data to a second value about the second sensing data.

[0231] According to one embodiment, the first value may correspond to a minimum value among the values ​​relating to the first sensing data. The second value may correspond to a maximum value among the values ​​relating to the second sensing data.

[0232] According to one embodiment, the method may include an operation of identifying the first data on the amount of light received by the light sensor while displaying the image, based on the first information about the first duty ratio and the second sensing data.

[0233] According to one embodiment, the second data may correspond to data on the amount of light measured by the light sensor when the level of light around the electronic device is a reference level.

[0234] According to one embodiment, the method may include an operation of determining that the illuminance level is the reference level based on the second data corresponding to the first data.

[0235] According to one embodiment, the method may include an operation of identifying the execution of one application within a set of applications determined based on configuration information of the electronic device. The method may include an operation of stopping displaying a screen through the display based on determining that an external object is in proximity to the electronic device while the application is executing.

[0236] According to one embodiment, the method may include an operation of identifying that the remaining battery capacity of the electronic device is within a reference range. The method may include an operation of deactivating a proximity sensor of the electronic device while the remaining battery capacity is within the reference range, and using the light sensor, determining whether an external object is adjacent to the electronic device.

[0237] According to one embodiment, a non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by a processor of an electronic device having a display configured to change brightness in accordance with a pulse signal for a pulse width modulation (PWM) technique, the display including a display area, and an ambient light sensor disposed below the display area, cause the electronic device to obtain, using the ambient light sensor, a set of sensed data regarding an ambient light level around the electronic device while displaying an image on the display. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to identify, using the set of sensed data, first information regarding a first duty ratio of the pulse signal. The one or more programs may include instructions that, when executed by the processor, cause the electronic device to identify, using the set of sensed data, second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the display.The one or more programs may include instructions that, when executed by the processor, cause the electronic device to: identify, using the set of sensing data, first data about an amount of light received by the light sensor while displaying the image; identify second data about an amount of light corresponding to color information of a sensing area positioned above the light sensor in the display area; determine, based on the second data being different from the first data, that an external object is adjacent to the electronic device; and determine, based on the second information about the second duty ratio being outside the reference range with respect to the first information about the first duty ratio, that an external object is not adjacent to the electronic device.

[0238] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0239] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0240] In one embodiment of this document, the term "module" used may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0241] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0242] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0243] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, A display configured to change brightness according to a pulse signal for PWM (pulse width modulation) technique, and including a display area; A light sensor positioned below the above display area; A memory storing instructions and including one or more storage media; and At least one processor comprising a processing circuit, The above instructions, when individually or collectively executed by the at least one processor, While displaying an image on the display, a set of sensing data on the illumination level around the electronic device is obtained using the illumination sensor, Using the set of sensing data, first information about a first duty ratio of the pulse signal is identified, Identify second information about a second duty ratio of the pulse signal corresponding to the brightness setting information of the display, Based on the second information about the second duty ratio that is within the reference range with respect to the first information about the first duty ratio: Using the set of sensing data, identifying first data about the amount of light received by the light sensor while the image is displayed on the display, Identifying second data on the amount of light corresponding to the color information of the sensing area located above the light sensor among the above display areas, Based on the second data that is different from the first data, determining that an external object is adjacent to the electronic device, Causing the electronic device to determine that an external object is not adjacent to the electronic device based on the second information about the second duty ratio that is outside a reference range with respect to the first information about the first duty ratio. Electronic devices.

2. In the first paragraph, the display, A display panel including a front surface including the display area and a rear surface opposite to the front surface, and a display driving circuit, The above light sensor, Positioned below the display panel, toward the rear side of the display panel, Electronic devices.

3. In the second paragraph, when the instructions are individually or collectively executed by the at least one processor, Causing the electronic device to obtain color data regarding the image displayed on the display area from the display driving circuit; Electronic devices.

4. In the third paragraph, when the instructions are individually or collectively executed by the at least one processor, Based on the color data regarding the image, color information of the display area and color information of the sensing area are identified, Causing the electronic device to identify the second data for the amount of light corresponding to the color information of the sensing area based on the color information of the display area and the color information of the sensing area. Electronic devices.

5. In the first paragraph, when the instructions are individually or collectively executed by the at least one processor, While the above image is displayed on the above display: Based on the first exposure time, first sensing data included in the set of sensing data is acquired, Based on a second exposure time shorter than the first exposure time, second sensing data included in the set of sensing data is acquired, Causing the electronic device to identify first information about the first duty ratio based on identifying a ratio of a first value about the first sensing data to a second value about the second sensing data. Electronic devices.

6. In the fifth paragraph, the first value is, Corresponds to the minimum value among the values ​​of the above first sensing data, The above second value is, Corresponding to the maximum value among the values ​​of the above second sensing data, Electronic devices.

7. In the fifth paragraph, when the instructions are individually or collectively executed by the at least one processor, Causing the electronic device to identify the first data on the amount of light received by the light sensor while the image is displayed on the display based on the first information about the first duty ratio and the second sensing data. Electronic devices.

8. In the first paragraph, the second data is, Corresponding to the data on the amount of light measured by the light sensor when the level of illumination around the electronic device is a reference level, Electronic devices.

9. In the 8th paragraph, when the instructions are individually or collectively executed by the at least one processor, Causing the electronic device to determine that the illuminance level is the reference level based on the second data corresponding to the first data; Electronic devices.

10. In the first paragraph, when the instructions are individually or collectively executed by the at least one processor, Identifying the execution of one application within a set of applications determined based on the configuration information of the electronic device; While the application is running, causing the electronic device to stop displaying the screen through the display based on determining that an external object is adjacent to the electronic device. Electronic devices.

11. In the first paragraph, the electronic device, Proximity sensor; and Including more batteries, The above instructions, when individually or collectively executed by the at least one processor, Identify that the remaining capacity of the above battery is within the standard range, While the remaining amount of the battery is within the reference range, the proximity sensor is disabled and the electronic device is caused to determine whether an external object is adjacent to the electronic device using the light sensor. Electronic devices.

12. In a method performed in an electronic device, An operation of obtaining a set of sensing data on an illuminance level around the electronic device using an illuminance sensor of the electronic device while displaying an image on the display of the electronic device; An operation of identifying first information regarding a first duty ratio of a pulse signal for changing the brightness of a display area of ​​the display using the set of the sensing data; An operation of identifying second information regarding a second duty ratio of the pulse signal corresponding to brightness setting information of the display; Based on the second information about the second duty ratio that is within the reference range with respect to the first information about the first duty ratio: An operation of identifying first data on the amount of light received by the light sensor while displaying the image using the set of the sensing data; An operation of identifying second data on the amount of light corresponding to color information of a sensing area located above the light sensor among the above display areas; An operation of determining that an external object is adjacent to the electronic device based on the second data that is different from the first data; and An operation of determining that an external object is not adjacent to the electronic device based on the second information about the second duty ratio that is outside a reference range with respect to the first information about the first duty ratio, method.

13. In the 12th paragraph, the method, While the above image is displayed on the above display: An operation of acquiring first sensing data included in the set of sensing data based on a first exposure time; An operation of acquiring second sensing data included in the set of sensing data based on a second exposure time shorter than the first exposure time; and An operation of identifying first information about the first duty ratio based on identifying a ratio of a first value about the first sensing data to a second value about the second sensing data, method.

14. In the 13th paragraph, the first value is, Corresponds to the minimum value among the values ​​of the above first sensing data, The above second value is, Corresponding to the maximum value among the values ​​of the above second sensing data, method.

15. In a non-transitory computer-readable storage medium storing one or more programs, the one or more programs are configured to change brightness according to a pulse signal for a PWM (pulse width modulation) technique, and when executed by a processor of an electronic device having a display including a display area, and a light sensor disposed under the display area, While displaying an image on the display, a set of sensing data on the illumination level around the electronic device is obtained using the illumination sensor, Using the set of sensing data, first information about a first duty ratio of the pulse signal is identified, Identify second information about a second duty ratio of the pulse signal corresponding to the brightness setting information of the display, Based on the second information about the second duty ratio that is within the reference range with respect to the first information about the first duty ratio: Using the set of sensing data, identifying first data on the amount of light received by the light sensor while displaying the image, Identifying second data on the amount of light corresponding to the color information of the sensing area located above the light sensor among the above display areas, Based on the second data that is different from the first data, determining that an external object is adjacent to the electronic device, Including instructions for causing the electronic device to determine that an external object is not adjacent to the electronic device based on the second information about the second duty ratio that is outside a reference range with respect to the first information about the first duty ratio. Non-transitory computer-readable storage medium.

Images