Method for providing color information, and electronic device for supporting same
Patent Information
- Application Number
- PCT/KR2024/010458
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-27
- Filing Date
- 2024-07-19
- Publication Date
- 2025-03-13
Smart Images

Figure KR2024010458_13032025_PF_FP_ABST
Abstract
Description
Method for providing color information and electronic devices supporting the same
[0001] The present disclosure relates to a method for providing color information and an electronic device supporting the same.
[0002] An electronic device can measure the illuminance of the environment in which the electronic device is located (e.g., the illuminance value of external light) through a light sensor. The electronic device can adjust the brightness of the display based on the illuminance measured through the light sensor.
[0003] The light sensor may be positioned below the display (e.g., the back surface of the display) when looking at the front surface of the electronic device (e.g., the surface of the electronic device where the display is exposed). Therefore, the light value measured by the light sensor may include, in addition to the light value affected by external light incident from outside the electronic device (hereinafter referred to as “external light”), an illuminance value affected by light emitted from the display (hereinafter referred to as “display light”) (also referred to as “estimated display light value”). Accordingly, the electronic device may perform an operation (also referred to as “an operation of compensating for an illuminance value”) of obtaining (e.g., calculating) an illuminance value affected by external light incident from outside the electronic device by subtracting the illuminance value affected by the display light from the illuminance value measured by the light sensor.
[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.
[0005] The display light estimation value affected by the display light can be obtained (e.g., calculated) based on the color information (e.g., color on pixel ratio (COPR) information) of the image displayed through the display. The color information of the image can be obtained from a display driver integrated circuit (DDI) for controlling the display.
[0006] An electronic device may include a plurality of displays and a plurality of DDIs for controlling each of the plurality of displays. In addition, the electronic device may include a plurality of light sensors for controlling the brightness of each of the plurality of displays. Each of the plurality of DDIs may perform a function (hereinafter referred to as a "COPR function") of obtaining (e.g., calculating) color information (e.g., COPR information) of an image displayed through the display. For example, the electronic device may include a first display, a second display, a first DDI for controlling the first display, a second DDI for controlling the second display, a first light sensor disposed on a back surface of the first display, and a second light sensor disposed on a back surface of the second display. By having the first DDI perform a COPR function of obtaining color information of an image displayed through the first display, an operation of compensating for the light value obtained through the first light sensor may be performed. Additionally, by performing a COPR function in which the second DDI acquires color information of an image displayed through the second display, an operation of compensating for the illuminance value acquired through the second illuminance sensor can be performed.
[0007] In order for a DDI to perform a COPR function, the DDI may further include components for performing the COPR function (e.g., hardware and / or software for performing the COPR function). In addition, a user may have to pay a usage fee (e.g., an IP (Intellectual Property) usage fee) to another user when purchasing a DDI (or a display module including a DDI) to utilize the COPR function using the DDI. Accordingly, when an electronic device includes multiple DDIs, each of the multiple DDIs may further include components for performing the COPR function, and a user of the electronic device may have to pay a usage fee for the multiple DDIs.
[0008] The present disclosure relates to a method for providing color information, in an electronic device including a DDI supporting a COPR function and a DDI not supporting a COPR function, capable of obtaining color information of an image displayed through a display controlled by a DDI not supporting a COPR function using a DDI supporting a COPR function, and an electronic device supporting the same.
[0009] The technical problems to be solved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field related to this document from the description below.
[0010] An electronic device according to one embodiment may include a first display and a first DDI configured to control the first display and capable of acquiring color information, a second display and a second DDI configured to control the second display, a first light sensor disposed under a first area of the first display and a second light sensor disposed under a second area of the second display, and at least one processor operatively connected to the first display, the first DDI, the second display, the second DDI, the first light sensor, and the second light sensor. The first DDI may be configured to acquire information about an image from the second DDI based on an input for displaying an image through the second display being acquired. The first DDI may be configured to acquire color information about a portion corresponding to the second area of the second display within the image based on the acquired information about the image. The first DDI may be configured to provide the acquired color information to the at least one processor, such that the at least one processor adjusts the brightness of the second display based on the acquired color information and the illuminance value acquired through the second illuminance sensor when displaying the image through the second display.
[0011] In one embodiment, a method for providing color information in an electronic device may include an operation of acquiring information about an image from a second DDI based on an input for displaying an image through the second display, based on information about the acquired image, by the first DDI. The method may include an operation of acquiring color information of a portion corresponding to the second area of the second display within the image, based on information about the acquired image, by the first DDI. The method may include an operation of providing the acquired color information to the at least one processor, such that the at least one processor adjusts brightness of the second display based on the acquired color information and an illuminance value acquired through the second illuminance sensor when displaying the image through the second display.
[0012] In one embodiment, a non-transitory computer-readable storage medium having recorded thereon computer-executable instructions, wherein the computer-executable instructions, when executed, cause an electronic device including at least one processor to obtain information about an image from a second DDI based on an input for displaying an image through the second display being obtained by the first DDI. The computer-executable instructions, when executed, cause the electronic device including at least one processor to obtain, by the first DDI, color information of a portion corresponding to the second area of the second display within the image based on the information about the acquired image. The computer-executable instructions, when executed, cause the electronic device including at least one processor to provide, by the first DDI, the acquired color information to the at least one processor, such that the at least one processor adjusts the luminance of the second display based on the acquired color information and an illuminance value acquired by the second illuminance sensor when displaying the image through the second display.
[0013] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.
[0014] FIG. 2 is a block diagram of a display module according to one embodiment.
[0015] FIG. 3A is a diagram illustrating an unfolded state of an electronic device according to one embodiment.
[0016] FIG. 3b is a diagram illustrating a folded state of an electronic device according to one embodiment.
[0017] FIG. 4 is a cross-sectional view of an electronic device according to one embodiment.
[0018] FIG. 5 is a block diagram of an electronic device according to one embodiment.
[0019] FIG. 6 is a flowchart illustrating a method for providing color information according to one embodiment.
[0020] FIG. 7 is a flowchart illustrating a method for controlling the brightness of a second display according to one embodiment.
[0021] FIG. 8 is a flowchart illustrating a method for providing color information according to one embodiment.
[0022] FIG. 9 is a diagram for explaining a method for providing color information according to one embodiment.
[0023] FIG. 10 is a flowchart illustrating a method for providing color information according to one embodiment.
[0024] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0025] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment.
[0026] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0027] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0028] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0029] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0030] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0031] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0032] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0033] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0034] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0035] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0036] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0037] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0038] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0039] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0040] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0041] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0042] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0044] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0045] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0046] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0048] FIG. 2 is a block diagram (200) of a display module (160) according to one embodiment.
[0049] Referring to FIG. 2, the display module (160) may include a display (210) and a display driver integrated circuit (DDI) (230) for controlling the display (210). The DDI (230) may include an interface module (231), a memory (233) (e.g., a buffer memory), an image processing module (235), or a mapping module (237). The DDI (230) may receive, for example, image information including image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device (101) through the interface module (231). For example, image information may be received from a processor (e.g., processor (120) of FIG. 1) (e.g., main processor (121) of FIG. 1 (e.g., application processor)) or an auxiliary processor (e.g., auxiliary processor (123) of FIG. 1) (e.g., graphic processing unit) that operates independently of the function of the main processor (121). The DDI (230) may communicate with the touch circuit (250) or the sensor module (176) through the interface module (231). In addition, the DDI (230) may store at least some of the received image information in the memory (233), for example, in units of frames. The image processing module (235) may, for example, perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least some of the image data based on at least the characteristics of the image data or the characteristics of the display (210). The mapping module (237) may output a voltage corresponding to the image data preprocessed or postprocessed through the image processing module (135). A voltage or current value can be generated. In one embodiment, the generation of the voltage or current value can be performed based at least in part on the properties of the pixels of the display (210), for example, the arrangement of the pixels (e.g., an RGB stripe or pentile structure), or the size of each sub-pixel.At least some pixels of the display (210) may be driven based at least in part on, for example, the voltage value or current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed through the display (210).
[0050] According to one embodiment, the display module (160) may further include a touch circuit (250). The touch circuit (250) may include a touch sensor (251) and a touch sensor IC (253) for controlling the same. The touch sensor IC (253) may control the touch sensor (251) to detect, for example, a touch input or a hovering input for a specific location of the display (210). For example, the touch sensor IC (253) may detect the touch input or the hovering input by measuring a change in a signal (e.g., voltage, light quantity, resistance, or charge quantity) for a specific location of the display (210). The touch sensor IC (253) may provide information (e.g., location, area, pressure, or time) regarding the detected touch input or hovering input to the processor (120). According to one embodiment, at least a portion of the touch circuit (250) (e.g., touch sensor IC (253)) may be included as part of the display driver IC (230), or as part of the display (210), or as part of another component (e.g., auxiliary processor (123)) disposed external to the display module (160).
[0051] According to one embodiment, the display module (160) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (176), or a control circuit therefor. In this case, the at least one sensor or the control circuit therefor may be embedded in a part of the display module (160) (e.g., the display (210) or the DDI (230)) or a part of the touch circuit (250). For example, if the sensor module (176) embedded in the display module (160) includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) associated with a touch input through a part of the display (210). As another example, if the sensor module (176) embedded in the display module (160) includes a pressure sensor, the pressure sensor may obtain pressure information associated with a touch input through a part or the entire area of the display (210). According to one embodiment, the touch sensor (251) or sensor module (176) may be positioned between pixels of a pixel layer of the display (210), or above or below the pixel layer.
[0052] FIG. 3A is a diagram illustrating an unfolded state of an electronic device according to one embodiment.
[0053] FIG. 3b is a diagram illustrating a folded state of an electronic device according to one embodiment.
[0054] Referring to FIGS. 3A and 3B , the electronic device (301) may include a housing (302) and a flexible display (e.g., a front display (330)) positioned within a space formed by the housing (302). In one embodiment, the housing (302) may be referred to as a foldable housing. In one embodiment, the front display (330) may be referred to as a foldable display.
[0055] According to one embodiment, the housing (302) may include a first housing (310) and a second housing (320) configured to rotate relative to the first housing (310).
[0056] According to one embodiment, the first housing (310) and / or the second housing (320) may form at least a portion of the exterior of the electronic device (301). According to one embodiment, the surface on which the front display (330) is visually exposed is defined as the front surface (e.g., the first front surface (310a) and the second front surface (320a)) of the electronic device (301) and / or the housing (302). The surface opposite the front surface is defined as the back surface (e.g., the first back surface (310b) and the second back surface (320b)) of the electronic device (301). The surface surrounding at least a portion of the space between the front surface and the back surface is defined as the side surface (e.g., the first side surface (310c) and the second side surface (320c)) of the electronic device (301).
[0057] According to one embodiment, the first housing (310) may be rotatably connected to the second housing (320) using a hinge structure (also referred to as a “hinge” or a “hinge portion”). For example, the first housing (310) and the second housing (320) may each be rotatably connected to the hinge structure. Accordingly, the electronic device (301) may be variable between a fully folded state (e.g., FIG. 3b) and a fully unfolded state (e.g., FIG. 3a). In the fully folded state, the first front surface (310a) may face the second front surface (320a), and in the fully unfolded state, the direction in which the first front surface (310a) faces may be substantially the same as the direction in which the second front surface (320a) faces. For example, in a fully unfolded state, the first front surface (310a) may be positioned substantially on the same plane as the second front surface (320a). In one embodiment, the second housing (320) may provide relative motion with respect to the first housing (310).
[0058] According to one embodiment, the first housing (310) and the second housing (320) are arranged on both sides with respect to the folding axis (A) as the center, and may have a shape that is overall symmetrical with respect to the folding axis (A). The angle (hereinafter also referred to as the “folding angle”) between the first housing (310) and the second housing (320) may be changed depending on whether the state of the electronic device (301) is a fully unfolded state, a fully folded state, or an intermediate state between the fully unfolded state and the fully folded state (hereinafter referred to as the “intermediate state”).
[0059] According to one embodiment, the electronic device (301) may include a hinge cover (340). At least a portion of the hinge cover (340) may be disposed between the first housing (310) and the second housing (320). According to one embodiment, the hinge cover (340) may be covered by a portion of the first housing (310) and the second housing (320) or may be exposed to the outside of the electronic device (301) depending on the state of the electronic device (301). According to one embodiment, the hinge cover (340) may protect a hinge structure (not shown) from an external impact of the electronic device (301). According to one embodiment, the hinge cover (340) may be interpreted as a hinge housing for protecting the hinge structure.
[0060] According to one embodiment, as illustrated in FIG. 3A, when the electronic device (301) is in a fully unfolded state, the hinge cover (340) may be covered by the first housing (310) and the second housing (320) and may not be exposed. As another example, as illustrated in FIG. 3B, when the electronic device (301) is in a folded state (e.g., a fully folded state), the hinge cover (340) may be exposed to the outside between the first housing (310) and the second housing (320). As another example, when the first housing (310) and the second housing (320) are in an intermediate state where they are folded at a certain angle, the hinge cover (340) may be partially exposed to the outside between the first housing (310) and the second housing (320). However, in this case, the exposed area may be less than in the fully folded state. In one embodiment, the hinge cover (340) may include a curved surface.
[0061] In one embodiment, the front display (330) may be disposed in a first housing (310) (e.g., a first front (310a)) and a second housing (320) (e.g., a second front (320a)). For example, the front display (330) may be disposed in the first housing (310) and the second housing (320) across a hinge portion.
[0062] In one embodiment, the front display (330) can visually provide information to an external party (e.g., a user) of the electronic device (301). The front display (330) can include, for example, a holographic device or a projector and a control circuit for controlling the device. In one embodiment, the front display (330) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the strength of a force generated by the touch.
[0063] According to one embodiment, the front display (330) may be a display in which at least a portion of the display can be transformed into a flat or curved surface. For example, the front display (330) may be formed to vary in response to the relative movement of the second housing (320) with respect to the first housing (310). According to one embodiment, the front display (330) may include a folding area (333), a first display area (331) positioned on one side (e.g., above (in the +Y direction)) of the folding area (333), and a second display area (332) positioned on the other side (e.g., below (in the -Y direction)). According to one embodiment, the folding area (333) may be positioned above the hinge structure. For example, at least a portion of the folding area (333) may face the hinge structure. According to one embodiment, the first display area (331) may be disposed on the first housing (310), and the second display area (332) may be disposed on the second housing (320). According to one embodiment, the front display (330) may be accommodated in the first housing (310) and the second housing (320).
[0064] However, the division of the areas of the front display (330) illustrated in the above-described FIG. 3a is exemplary, and the front display (330) may be divided into multiple areas (for example, four or more or two) depending on the structure or function.
[0065] Also, in the embodiment illustrated in FIG. 3A, the front display (330) may be divided into regions by a folding region (333) extending parallel to the X-axis or a folding axis (A-axis), but in other embodiments, the front display (330) may be divided into regions based on another folding region (e.g., a folding region parallel to the Y-axis) or another folding axis (e.g., a folding axis parallel to the Y-axis). According to one embodiment, the front display (330) may be coupled to or disposed adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer configured to detect a magnetic field-type stylus pen.
[0066] According to one embodiment, the electronic device (301) may include a rear display (334). The rear display (334) may be arranged to face a different direction than the front display (330). For example, the front display (330) may be visually exposed through the front side of the electronic device (301) (e.g., the first front side (310a) and / or the second front side (320a)), and the rear display (334) may be visually exposed through the rear side of the electronic device (301) (e.g., the first rear side (310b)).
[0067] According to one embodiment, the electronic device (301) may include at least one camera module (304, 306) and a flash (308). According to one embodiment, the electronic device (301) may include a front camera module (304) exposed through a front side (e.g., a first front side (310a)) and / or a rear camera module (306) exposed through a rear side (e.g., a first rear side (310b)). The camera modules (304, 306) may include one or more lenses, an image sensor, a flash, and / or an image signal processor. The flash (308) may include a light emitting diode or a xenon lamp. According to one embodiment, two or more lenses (an infrared camera, a wide-angle lens, and a telephoto lens) and image sensors may be arranged on one side of the electronic device (301). The configuration of the front camera module (304) and / or the rear camera module (306) may be partially or entirely identical to the configuration of the camera module (180) of FIGS. 1 and 2.
[0068] In one embodiment, a first light sensor (351) may be positioned under the front display (330), and a second light sensor (352) may be positioned under the rear display (334).
[0069] In one embodiment, the front display (330) may be controlled by the first DDI (361), and the rear display (334) may be controlled by the second DDI (362).
[0070] In one embodiment, the electronic device (301) may include an application processor (371) and a sensor hub processor (372).
[0071] FIG. 4 is a cross-sectional view of an electronic device (401) according to one embodiment.
[0072] Referring to FIG. 4, in one embodiment, the electronic device (401) may include glass (411), a display panel (412), a cover panel (413), a printed circuit board (PCB) (414), and / or a light sensor (415).
[0073] In one embodiment, the glass (411) is attached to the front of the display panel (412) and may be implemented with a flexible and transparent material (e.g., colorless polyimide (CPI)).
[0074] In one embodiment, the display panel (412) may be placed on at least a portion of the lower portion of the glass (411). The display panel (412) may display a screen through the glass (411) made of a transparent material.
[0075] In one embodiment, the display panel (412) may include a light-transmitting area (412-1) such that the light sensor (415) measures the intensity of light. In one embodiment, the light sensor (415) may be positioned under the area (412-1) of the display panel (412). The position and / or size of the area (412-1) of the display panel (412) may be determined based on the position and / or size of the light sensor (415). For example, the position and / or size of the area (412-1) of the display panel (412) may be determined based on a field of view (FOV) of the light sensor (415).
[0076] In one embodiment, a region (412-1) of the display panel (412) may be implemented to have a lower pixel density (e.g., pixels per inch (PPI)) and / or lower wiring density compared to other regions of the display panel (412) to improve light transmittance.
[0077] In one embodiment, the cover panel (413) may be a layer that protects one side of the display panel (412). The cover panel (413) may include a metal layer (e.g., a copper sheet) and / or a light-shielding layer (e.g., a black emboss layer). In one embodiment, the cover panel (413) may be disposed at the bottom of the display panel (412).
[0078] In one embodiment, the light sensor (415) may be mounted on the PCB (414). In one embodiment, the light sensor (415) may measure external illuminance by detecting external light passing through the glass (411) and the display panel (412). In one embodiment, the cover panel (413) may include a light-blocking layer, so that the cover panel (413) may not allow external light to pass through. In order for the light sensor (415) to detect external light, an opening (416) may be formed in at least a portion of the cover panel (413). The opening (416) of the cover panel (413) may be formed at a position and / or size corresponding to a viewing angle (θ) of the light sensor (415).
[0079] In one embodiment, the light sensor (415) may be implemented in the form of a package that further includes a light emitting unit. For example, if the light sensor (415) further includes a light emitting unit, the light sensor (415) may operate as a proximity sensor.
[0080] In one embodiment, the light sensor (415) may be included in the display panel (412). For example, at least some of the pixels included in the display panel (412) may include a light-receiving portion to measure light. In such a case, the opening (416) may not be formed.
[0081] FIG. 5 is a block diagram of an electronic device (501) according to one embodiment.
[0082] Referring to FIG. 5, in one embodiment, the electronic device (501) may be the electronic device (101) of FIG. 1, the electronic device (301) of FIGS. 3A and 3B, or the electronic device (401) of FIG. 4.
[0083] In one embodiment, the electronic device (501) may be an electronic device (501) including a plurality of displays, a plurality of DDIs controlling each of the plurality of displays, and a plurality of light sensors disposed under the plurality of displays. For example, the electronic device (501) may be a foldable electronic device including a front display (330), a rear display (334), a first DDI (361), a second DDI (362), a first light sensor (351), and a second light sensor (352), as illustrated in FIGS. 3A and 3B . However, although FIGS. 3A and 3B illustrate a foldable electronic device (501) including a first housing (310) and a second housing (320) rotatable by a single hinge, the present invention is not limited thereto. For example, the electronic device (501) may include an electronic device (e.g., a multi-foldable electronic device) that includes a plurality of hinge parts and includes three or more housings that are rotatable by the plurality of hinge parts. For example, the electronic device (501) may include all electronic devices that include a plurality of displays, a plurality of DDIs that control each of the plurality of displays, and a plurality of light sensors arranged under the plurality of displays, regardless of whether the electronic device (501) includes a flexible display.
[0084] In one embodiment, the electronic device (501) may include a first display module (510), a second display module (520), a first light sensor (530), a second light sensor (540), a memory (550), and / or a processor (560).
[0085] In one embodiment, the first display module (510) may be the display module (160) of FIGS. 1 and 2.
[0086] In one embodiment, the first display module (510) may include a first display (511) and a first DDI (512).
[0087] In one embodiment, the first display (511) may be the display (210) of FIG. 2, the front display (330) of FIG. 3a, or the display panel (412) of FIG. 4.
[0088] In one embodiment, the first display (511) may include a region through which light passes (hereinafter referred to as “the first region of the first display,” “region of interest (ROI) of the first display,” or “sensor region of the first display”) (e.g., region (412-1) of FIG. 4) through which the first light sensor (530) measures the intensity of light.
[0089] In one embodiment, a first light sensor (530) may be positioned below a first area of a first display (511). In one embodiment, the first area of the first display (511) may be implemented to have a lower pixel density (e.g., pixels per inch (PPI)) and / or lower wiring density compared to other areas of the first display (511) to improve light transmittance.
[0090] In one embodiment, the first DDI (512) may be the display driver IC (230) of FIG. 2, or the first DDI (361) of FIG. 3A. In one embodiment, the first DDI (512) may be a DDI for controlling the first display (511).
[0091] In one embodiment, the first DDI (512) may be a DDI capable of performing a function (e.g., supporting a COPR function) of obtaining (e.g., calculating) color information (e.g., color on pixel ratio (COPR) information) of an image displayed through a display (hereinafter referred to as a “COPR function”). For example, the first DDI (512) may be a DDI including a configuration (e.g., hardware and / or software) capable of performing a function of obtaining color information of an image displayed through the first display (511). For example, the first DDI (512) may be a DDI capable of performing a function of obtaining color information of an image displayed through the second display (521) (or to be displayed through the second display (521)). The COPR function performed by the first DDI (512) will be described in detail below.
[0092] In one embodiment, the second display module (520) may be the display module (160) of FIGS. 1 and 2.
[0093] In one embodiment, the second display module (520) may include a second display (521) and a second DDI (522).
[0094] In one embodiment, the second display (521) may be the display (210) of FIG. 2, the rear display (334) of FIG. 3A, or the display panel (412) of FIG. 4.
[0095] In one embodiment, the second display (521) may include a light-transmitting area (hereinafter referred to as “the second area of the second display,” “the region of interest (ROI) of the second display,” or “the sensor area of the second display”) (e.g., area (412-1) of FIG. 4 ) through which the second light sensor (540) measures the intensity of light.
[0096] In one embodiment, a second light sensor (540) may be positioned below a second area of the second display (521). In one embodiment, the second area of the second display (521) may be implemented to have a lower pixel density and / or lower wiring density compared to other areas of the second display (521) to improve light transmittance.
[0097] In one embodiment, the second DDI (522) may be the display driver IC (230) of FIG. 2, or the second DDI (362) of FIGS. 3A and 3B. In one embodiment, the second DDI (522) may be a DDI for controlling the second display (521).
[0098] In one embodiment, the second DDI (522) may be a DDI that cannot perform the COPR function (e.g., does not support the COPR function). For example, the second DDI (522) may be a DDI that cannot perform a function of acquiring color information of an image displayed through the second display (521). However, the present invention is not limited thereto, and the second DDI (522) may also be a DDI that supports the COPR function.
[0099] In one embodiment, the first display (511) and / or the second display (521) may be various types of displays, such as a liquid crystal display (LCD) including a back light, an organic light emitting diode (OLED) display in which each pixel individually emits light, or a quantum dot light emitting diode (QLED) display.
[0100] In FIG. 5, the electronic device (501) is exemplified as including two display modules, such as a first display module (510) and a second display module (520), but is not limited thereto. For example, the electronic device (501) may include three or more display modules. For example, the electronic device (501) may include at least one display module including a DDI that supports a COPR function and at least one display module including a DDI that does not support a COPR function.
[0101] In one embodiment, the first light sensor (530) may be the first light sensor (351) of FIG. 3A or the light sensor (415) of FIG. 4.
[0102] In one embodiment, the first illuminance sensor (530) may be a illuminance sensor positioned below the first area of the first display (511). In one embodiment, the first illuminance sensor (530) may measure external illuminance by detecting external light passing through the first display (511).
[0103] In one embodiment, the second light sensor (540) may be the second light sensor (352) of FIGS. 3A and 3B or the light sensor (415) of FIG. 4.
[0104] In one embodiment, the second light sensor (540) may be a light sensor (e.g., the light sensor (415) of FIG. 4) positioned below the second area of the second display (521). In one embodiment, the second light sensor (540) may measure external illuminance by detecting external light passing through the second display (521).
[0105] In one embodiment, the first illuminance sensor (530) and / or the second illuminance sensor (540) may include a sensor that utilizes the intensity of externally incident light, such as a visible light sensor, a proximity illuminance sensor (also referred to as a “near-illuminance sensor”), a spectrometer sensor, an ultraviolet sensor, or a color sensor. In one embodiment, the first illuminance sensor (530) and / or the second illuminance sensor (540) may include a light-receiving element, such as a photodiode, that can receive externally incident light.
[0106] In one embodiment, the first illuminance sensor (530) and / or the second illuminance sensor (540) may be influenced in illuminance measurement by the transmittance of external light by the first display (511) and / or the second display (521) and / or by the screen displayed on the first display (511) and / or the second display (521). For example, if the first display (511) and / or the second display (521) is an OLED display or a QLED display in which each pixel individually emits light, the illuminance value measured by the first illuminance sensor (530) and / or the second illuminance sensor (540) may be increased by the light emitted from the pixels.
[0107] In FIG. 5, the electronic device (501) is exemplified as including two light sensors, such as a first light sensor (530) and a second light sensor (540), but is not limited thereto. For example, the electronic device (501) may include three or more light sensors. For example, when the electronic device (501) includes three or more display modules, at least one light sensor may be arranged on the back surface of each of the three or more display modules.
[0108] In one embodiment, the memory (550) may be the memory (130) of FIG. 1.
[0109] In one embodiment, the memory (550) may store information for performing an operation that provides color information.
[0110] In one embodiment, the processor (560) may be the processor (120) of FIG. 1.
[0111] In one embodiment, the processor (560) may perform an operation of obtaining (e.g., calculating) an illuminance value affected by external light incident from outside the electronic device (501) by subtracting an illuminance value affected by display light from an illuminance value measured by the illuminance sensor and / or the illuminance sensor (hereinafter also referred to as an “operation of compensating for an illuminance value”) and / or an operation of controlling (e.g., setting or adjusting) the brightness of the display based on the obtained illuminance value.
[0112] In one embodiment, the processor (560) may include one or more processors (560) (e.g., a main processor (561) and a secondary processor (562)) for controlling operations for compensating illuminance values and / or controlling the brightness of the display.
[0113] In one embodiment, the main processor (561) may be an application processor. In one embodiment, the auxiliary processor (562) may be a sensor hub processor. The operations performed by the main processor (561) and the auxiliary processor (562) will be described in detail below. In FIG. 5, the processor (560) is illustrated as including a main processor (561) and an auxiliary processor (562) implemented independently of each other, but is not limited thereto. For example, the processor (560) may not include the auxiliary processor (562), or may be implemented in an integrated form with the main processor (561) and the auxiliary processor (562).
[0114] In FIG. 5, the electronic device (501) is illustrated as including, but not limited to, a first display module (510), a second display module (520), a first light sensor (530), a second light sensor (540), a memory (550), and / or a processor (560). For example, the electronic device (501) may further include one or more components included in the electronic device (101) of FIG. 1, the electronic device (301) of FIGS. 3A and 3B, or the electronic device (401) of FIG. 4.
[0115] FIG. 6 is a flowchart (600) for explaining a method for providing color information according to one embodiment.
[0116] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0117] According to one embodiment, operations 601 to 605 may be understood to be performed in a first DDI (e.g., the first DDI (512) of FIG. 5) of an electronic device (e.g., the electronic device (501) of FIG. 5).
[0118] Referring to FIG. 6, in operation 601, in one embodiment, the first DDI (512) may obtain information about the image from the second DDI (522) based on an input for displaying the image through the second display (521).
[0119] In one embodiment, a processor (560) (e.g., a main processor (561)) may obtain an input for displaying an image (e.g., a screen including text, objects, and / or images) through a second display (521). The processor (560) may provide an image (hereinafter, also referred to as a “first image”) to be displayed through the second display (521) to a second DDI (522) for controlling the second display (521).
[0120] In one embodiment, the second DDI (522) (e.g., a DDI that does not support COPR functionality) may provide information about the first image to the first DDI (512) via the processor (560) (e.g., the main processor (561)) after displaying the first image through the second display (521) (or when the first image is displayed through the second display (521)) or before displaying the first image through the second display (521).
[0121] In one embodiment, the first DDI (512) (e.g., a DDI supporting a COPR function) may obtain information about the first image from the second DDI (522) via the processor (560) (e.g., the main processor (561)). However, this is not limited thereto. For example, the first DDI (512) may obtain information about the first image obtained by the processor (560) from the memory (550) from the processor (560) (e.g., the main processor (561)).
[0122] In one embodiment, the information about the first image may include pixel values of a portion (hereinafter referred to as “the first portion of the first image” or “the first portion”) corresponding to a second region of the second display (521) (e.g., a ROI of the second display (521), a sensor region of the second display (521)) within the first image (e.g., a portion displayed through the second region of the second display (521) within the first image). For example, the information about the first image may include RGB (red, green, and blue) values for each coordinate of the first portion of the first image. However, the present invention is not limited thereto, and the information about the first image may also include pixel values for the first portion among pixel values (e.g., pixel values of a Bayer pattern) before performing interpolation on the first image.
[0123] In one embodiment, information about the first image may include pixel values of the first image (e.g., pixel values of an entire area of the first image) and a location of the first portion (e.g., coordinates of the first portion within the first image).
[0124] In one embodiment, information about the first image may be obtained (e.g., generated) from the second DDI (522) and provided to the first DDI (512) via the main processor (561) (e.g., an application processor).
[0125] In operation 603, in one embodiment, the first DDI (512) may obtain color information of a portion corresponding to a second area of the second display (521) within the image based on information about the image.
[0126] In one embodiment, the first DDI (512) may obtain color information of a first portion corresponding to a second area of the second display (521) within the first image (e.g., a first portion displayed through the second area of the second display (521) within the first image) based on information about the first image.
[0127] In one embodiment, the first DDI (512) can obtain color information of the first portion based on information about the first image without displaying the first portion of the first image (or the first image) through the first display (511).
[0128] In one embodiment, the first DDI (512) may obtain (e.g., calculate) pixel values of the first portion (e.g., RGB values of the first portion) based on the pixel values of the first image and the position of the first portion, when the information about the first image includes pixel values of the first image (e.g., pixel values of an entire area of the first image) and a position of the first portion (e.g., coordinates of the first portion within the first image).
[0129] In one embodiment, the color information of the first portion may include COPR information of the first portion.
[0130] In one embodiment, the COPR information of the first portion may be information for obtaining (e.g., calculating) a display light estimation value affected by light of the second display (521), which is included in the illuminance value measured by the second illuminance sensor (540) while the second display (521) displays the first image.
[0131] In one embodiment, the COPR information of the first part can be defined by [Mathematical Formula 1] to [Mathematical Formula 3] below.
[0132]
[0133]
[0134]
[0135] [Mathematical formula 1] to [Mathematical formula 3] are merely examples to aid understanding and are not limited thereto, and can be modified, applied, or expanded in various ways.
[0136] In one embodiment, in [Mathematical Formula 1] to [Mathematical Formula 3], n may represent the number of pixels of the first portion (e.g., the number of pixels constituting the first portion). In one embodiment, in [Mathematical Formula 1] to [Mathematical Formula 3], Ri, Gi, and Bi may represent the R value, G value, and B value of each of the pixels of the first portion. For example, Rm (when i=m), Gm, and Bm may represent the R value, G value, and B value of the m-th pixel among the pixels of the first portion, respectively. In one embodiment, in [Mathematical Formula 1] to [Mathematical Formula 3], Cr, Cg, and Cb may represent W, respectively. R , W G , and W B , may represent a coefficient (e.g., 256) for normalizing to values in a specified range (e.g., 0 to 256). In one embodiment, in [Mathematical Expressions 1] to [Mathematical Expressions 3], α may include 1 or 2.2 as a gamma value of the first display (511). In one embodiment, in [Mathematical Expressions 1] to [Mathematical Expressions 3], 255 may represent a maximum value of a pixel value (e.g., 255 as a maximum value when the range of pixel values is 0 to 255).
[0137] In one embodiment, the COPR information of the first part is W, which is calculated through [Mathematical Formula 1] to [Mathematical Formula 3]. R , W G , and W B It could be.
[0138] In one embodiment, the first DDI (512) can obtain (e.g., calculate) the COPR W of the first part by replacing the COPR information of the first part. For example, the first DDI (512) can obtain the COPR W of the first part by using [Mathematical Formula 4] below.
[0139]
[0140] [Mathematical formula 4] is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.
[0141] In one embodiment, in [Mathematical Equation 4], n may represent the number of pixels of the first portion (e.g., the number of pixels constituting the first portion). In one embodiment, in [Mathematical Equation 4], Ri, Gi, and Bi may represent the R value, G value, and B value of each of the pixels of the first portion. In one embodiment, in [Mathematical Equation 4], Cr, Cg, and Cb may each represent a coefficient (e.g., 256) for normalizing W to values in a specified range (e.g., 0 to 256). In one embodiment, in [Mathematical Equations 4] to [Mathematical Equations 3], α may include 2.2 (or 1) as a gamma value of the first display (511). In one embodiment, in [Mathematical Equation 4], 255 may represent the maximum value of the pixel value. In one embodiment, in [Mathematical Equation 4], W may represent COPR W.
[0142] In one embodiment, the first DDI (512) may perform an operation of acquiring color information of a first portion of a first image displayed through the second display (521) at a cycle that is the same as a cycle corresponding to a refresh rate of the second display (521). For example, when the refresh rate of the second display (521) is 60 Hz, the first DDI (512) may perform an operation of acquiring color information of the first portion at a cycle of about 16.6 ms corresponding to 60 Hz.
[0143] In operation 605, in one embodiment, the first DDI (512) may provide the acquired color information to the processor (560).
[0144] In one embodiment, the first DDI (512) is configured to obtain the color information (e.g., W calculated through [Equation 1] to [Equation 3]). R , W G , and W B , or COPR W) calculated through [Mathematical Formula 4] can be transmitted to the processor (560) (e.g., auxiliary processor (562)).
[0145] In one embodiment, although not illustrated in FIG. 6, the auxiliary processor (562) may measure an illuminance value via the second illuminance sensor (540) while performing at least a portion of operations 601 to 605 (or after the first image is displayed via the second display (521). The auxiliary processor (562) may determine a final illuminance value (hereinafter also referred to as “final illuminance value”) (e.g., an illuminance value affected by external light incident from outside the electronic device (501) by subtracting an illuminance value affected by display light from an illuminance value measured via the illuminance sensor) based on the measured illuminance value and the color information of the first portion obtained from the first DDI (512).
[0146] In one embodiment, the processor (560) (e.g., the main processor (561)) may set (e.g., adjust) the brightness of the second display (521) to a brightness (e.g., a brightness level) corresponding to a final illuminance value determined by the processor (560) (e.g., the auxiliary processor (562)).
[0147] Hereinafter, with reference to FIG. 7, the operation of the processor (560) (e.g., auxiliary processor (562) and main processor (561)) performed after the color information of the first part is acquired will be described in more detail.
[0148] In one embodiment, although not illustrated in FIG. 6, the second DDI (522) may display the first image through the second display (521). For example, the second DDI (522) may display the first image through the second display (521) before performing at least some of the operations described through FIG. 6 (e.g., in response to obtaining an input for displaying an image through the second display (521), while performing at least some of the operations described through FIG. 6 (e.g., while performing operations 601 to 605), or after performing at least some of the operations described through FIG. 6 (e.g., after the luminance of the second display (521) is set to a luminance corresponding to a final illuminance value).
[0149] FIG. 7 is a flowchart (700) for explaining a method of controlling the brightness of a second display (521) according to one embodiment.
[0150] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0151] According to one embodiment, operations 701 to 707 may be understood to be performed in a processor (e.g., processor (560) of FIG. 5) of an electronic device (e.g., electronic device (501) of FIG. 5).
[0152] In one embodiment, the operations of FIG. 7 may be performed after performing the operations of FIG. 6 and / or while performing the operations of FIG. 6.
[0153] Referring to FIG. 7, in operation 701, in one embodiment, the processor (560) (e.g., the auxiliary processor (562)) may obtain a display light estimation value (e.g., a display light estimation value of the second display (521)) based on the color information of the first portion obtained from the first DDI (512).
[0154] In one embodiment, the processor (560) (e.g., the auxiliary processor (562)) may obtain color information of a first portion of a first image displayed through a second display (521) from the first DDI (512).
[0155] In one embodiment, the processor (560) (e.g., the auxiliary processor (562)) can obtain (e.g., calculate) the COPR W of the first portion based on the color information of the first portion.
[0156] In one embodiment, the processor (560) calculates the color information of the first part using W calculated through [Mathematical Equation 1] to [Mathematical Equation 3]. R , W G , and W B And, in case 2.2 is used as the gamma value (α) of the second display (521) in [Mathematical Formula 1] to [Mathematical Formula 3], as in [Mathematical Formula 5] below, W R , W G , and W B By dividing the sum by 3, we can obtain the COPR W of the first part.
[0157]
[0158] [Mathematical formula 5] is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.
[0159] In one embodiment, when W (e.g., COPR W) calculated through [Mathematical Formula 4] is obtained from the first DDI (512) by replacing the color information of the first part, the processor (560) can confirm the W obtained from the first DDI (512) as COPR W without performing an operation of calculating COPR W of the first part.
[0160] In one embodiment, the processor (560) calculates the color information of the first part using W calculated through [Mathematical Equation 1] to [Mathematical Equation 3]. R , W G , and W B And, when 1 is used as the gamma value (α) of the second display (521) in [Mathematical Formula 1] to [Mathematical Formula 3], the COPR W of the first part can be obtained using [Mathematical Formula 6] below.
[0161]
[0162] [Mathematical formula 6] is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.
[0163] In one embodiment, in [Equation 6], W R , W G , and W B W is calculated through [Mathematical Formula 1] to [Mathematical Formula 3] in which the gamma value (α) of the second display (521) is set to 1. R , W G , and W B In one embodiment, in [Mathematical Formula 6], 2.2 may represent the gamma value (α) of the second display (521). In one embodiment, in [Mathematical Formula 6], a, b, and c may be coefficients for calculating COPR W.
[0164] In one embodiment, the processor (560) (e.g., the auxiliary processor (562)) may obtain a display light estimation value (also referred to as “COPR Lux”) of the second display (521) using [Equation 7] and [Equation 8] after the COPR W of the first part is obtained.
[0165]
[0166] [Mathematical formula 7] is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.
[0167] In one embodiment, in [Mathematical Expression 7], the luminance code may be a value corresponding to the current luminance value of the second display (521). For example, the luminance from the minimum luminance to the maximum luminance of the second display (521) may be classified into a plurality of luminance ranges of a specified number (e.g., 256) according to the magnitude of the luminance. The luminance codes may be set to correspond to each of the classified luminance ranges. In one embodiment, in [Mathematical Expression 7], d, e, and f may be coefficients for calculating a brightness coefficient. In [Mathematical Expression 7], the brightness coefficient is expressed as a quadratic equation for the luminance code, but is not limited thereto.
[0168]
[0169] [Mathematical formula 8] is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.
[0170] In one embodiment, as shown in [Mathematical Formula 8], the display light estimation value of the second display (521) can be calculated by multiplying the COPR W of the first part and the brightness coefficient calculated using [Mathematical Formula 7].
[0171] In operation 703, in one embodiment, the processor (560) (e.g., the auxiliary processor (562)) may obtain an illuminance value through the second illuminance sensor (540). For example, the processor (560) may measure the illuminance value through the second illuminance sensor (540) while the first image is displayed through the second display (521).
[0172] In operation 705, in one embodiment, the processor (560) (e.g., the auxiliary processor (562)) may obtain (e.g., calculate) a final illuminance value based on the display illuminance estimate value and the illuminance value obtained through the second illuminance sensor (540). For example, the processor (560) may obtain (e.g., calculate) a final illuminance value based on the display illuminance estimate value obtained through operation 701 and the illuminance value obtained through operation 703.
[0173] In one embodiment, the processor (560) may obtain (e.g., calculate) a final illuminance value (e.g., a final illuminance value of the second illuminance sensor (540)) using [Mathematical Formula 9] below, based on the display light estimation value and the illuminance value obtained through the second illuminance sensor (540).
[0174]
[0175] [Mathematical formula 9] is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.
[0176] In one embodiment, in [Mathematical Formula 9], the calibration constant may be a value calculated by calibration performed in a process step of mounting a display and an illuminance sensor in an electronic device, and may be a value for correcting an illuminance value measured through a second illuminance sensor (540). In one embodiment, in [Mathematical Formula 9], the display light estimation value may represent a display light estimation value of the second display (521).
[0177] In operation 707, in one embodiment, the processor (560) (e.g., the main processor (561)) may set (or control) the brightness of the second display (521) based on the final illuminance value.
[0178] In one embodiment, the processor (560) may determine a luminance (e.g., luminance level) corresponding to a final illuminance value (e.g., a final illuminance value of the second illuminance sensor (540) acquired through operation 705). For example, the processor (560) may determine a luminance level corresponding to the final illuminance value within a luminance look-up table to which illuminance values and luminance levels (or luminance codes) are mapped.
[0179] In one embodiment, the processor (560) may set (e.g., adjust) the identified brightness level to the brightness level of the second display (521).
[0180] FIG. 8 is a flowchart (800) for explaining a method of providing color information according to one embodiment.
[0181] FIG. 9 is a diagram for explaining a method for providing color information according to one embodiment.
[0182] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0183] According to one embodiment, operations 801 to 807 may be understood to be performed in a first DDI (e.g., the first DDI (512) of FIG. 5) of an electronic device (e.g., the electronic device (501) of FIG. 5).
[0184] Referring to FIGS. 8 and 9, in operation 801, in one embodiment, the first DDI (512) may obtain information about the image from the second DDI (522) based on an input for displaying the image through the second display (521).
[0185] Since operation 801 is at least partially identical or similar to operation 601 of FIG. 6, a detailed description thereof will be omitted.
[0186] In operation 803, in one embodiment, the first DDI (512) can display a portion corresponding to a second area of the second display (521) within the image through the first display (511).
[0187] In one embodiment, the first DDI (512) may display the first portion of the first image through the first display (511) before acquiring color information of the first portion of the first image based on acquiring information about the first image from the second DDI (522). For example, the first DDI (512) may be a DDI configured to perform a COPR function while displaying the image through the first display (511) (or after displaying the image through the first display (511)). In this case, the first DDI (512) may perform an operation of acquiring color information of the first portion of the first image after displaying the first portion of the first image through the first display (511).
[0188] In one embodiment, the first DDI (512) may display a first portion of the first image through the first display (511). For example, reference numeral 901 in FIG. 9 may represent a foldable electronic device (910) in a fully folded state, and reference numeral 903 in FIG. 9 may represent a foldable electronic device (910) in a fully unfolded state. The foldable electronic device (910) may be a foldable electronic device that can be folded or unfolded based on the folding axis (B). A foldable electronic device (910) may include a first display (511) (e.g., a first display (921)), a second display (521) (e.g., a second display (911)), a first DDI (512) for supporting a COPR function and controlling the first display (511), a second DDI (522) for controlling the second display (521) without supporting the COPR function, a first light sensor (530) disposed under the first display (511), and a second light sensor (540) disposed under the second display (521). In reference numeral 901, the second DDI (522) may display a first image (930) (e.g., a lock screen) through the second display (911). The second DDI (522) can provide the first DDI (512) with information about the first portion (931) (or the first image (930)) displayed in the second area (912) of the second display (911) within the first image (930). In reference numeral 902, the first DDI (512) can display the first portion (931) (e.g., the same image (941) as the first portion (931)) displayed in the second area (912) of the second display (911) through a designated area of the first display (921).
[0189] In one embodiment, the first DDI (512) may display a black image through the remaining area of the first display (511), excluding the area displaying the first portion of the first image, as illustrated in reference numeral 902, when displaying the first portion of the first image through the first display (511).
[0190] In one embodiment, the first DDI (512) can display a first portion of the first image through the first display (511) at the minimum brightness of the first display (511). For example, the first DDI (512) can display a first portion of the first image through the first display (511) after setting the brightness of the first display (511) to a settable minimum brightness.
[0191] In one embodiment, the first DDI (512) may control the electronic device (501) to operate in a low power mode while displaying a first portion of a first image through the first display (511).
[0192] In one embodiment, the first DDI (512) may set (e.g., adjust) the refresh rate at which the first portion of the first image is displayed through the first display (511) to a lower refresh rate while the first portion of the first image is displayed through the first display (511). For example, if the refresh rate at which the first display (511) displays the image is currently set to 60 Hz, the first DDI (512) may set the refresh rate at which the first display (511) displays the first image to a refresh rate lower than 60 Hz (e.g., 48 Hz, 30 Hz, 24 Hz, 10 Hz, or 1 Hz) while displaying the first portion of the first image through the first display (511).
[0193] In one embodiment, the first DDI (512) may set a refresh rate at which the first portion of the first image is displayed through the first display (511) to a lowest refresh rate that the first display (511) can set, while displaying the first portion of the first image through the first display (511). For example, when the refresh rate at which the first display (511) displays the image is currently set to 60 Hz, the first DDI (512) may set the refresh rate at which the first display (511) displays the first image to a lowest refresh rate (e.g., 1 Hz) among refresh rates (e.g., 120 Hz, 96 Hz, 60 Hz, 30 Hz, 24 Hz, 10 Hz, and 1 Hz) that the first display (511) can set, while displaying the first portion of the first image through the first display (511).
[0194] In one embodiment, the first DDI (512) may display the first portion of the first image through the first display (511) using the same number of pixels as the number of pixels of the first portion of the first image. For example, the first DDI (512) may set the number of pixels of the first portion displayed through the first display (511) so that the number of pixels constituting the first portion (e.g., the first portion (931) of FIG. 9) when the first portion is displayed through the second display (521) is the same as the number of pixels constituting the first portion (e.g., the image (941) of FIG. 9) when the first portion is displayed through the first display (511). For example, the first DDI (512) may set the resolution of the first portion displayed through the first display (511) so that the resolution of the first portion (e.g., the first portion (931) of FIG. 9) when the first portion is displayed through the second display (521) is the same as the resolution of the first portion (e.g., the image (941) of FIG. 9) when the first portion is displayed through the first display (511). However, the present invention is not limited thereto. For example, the first DDI (512) may display the first portion of the first image through the first display (511) using a smaller number of pixels than the number of pixels of the first portion of the first image. In this case, the color information of the first portion to be acquired by the first DDI (512) may not be accurate compared to the case where the first portion of the first image is displayed through the first display (511) using the same number of pixels as the number of pixels of the first portion of the first image. For example, the first DDI (512) may display the first portion of the first image through the first display (511) using a greater number of pixels than the number of pixels of the first portion of the first image.In this case, the color information of the first part to be acquired by the first DDI (512) may consume more power than when the first part of the first image is displayed through the first display (511) using the same number of pixels as the number of pixels of the first part of the first image.
[0195] In one embodiment, when the first DDI (512) displays the first portion of the first image through the first display (511) using the same number of pixels as the number of pixels of the first portion of the first image, the shape (e.g., size and / or width and height ratio) of the first portion (e.g., first portion (931) of FIG. 9) displayed through the second display (521) and the shape (e.g., size and / or width and height ratio) of the first portion (e.g., image (941)) displayed through the first display (511) may be the same or different.
[0196] Although the operation 803 has been described as displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511), it is not limited thereto. For example, the first DDI (512) may display the entire first image through the first display (511).
[0197] In operation 805, in one embodiment, the first DDI (512) may obtain color information of a portion corresponding to a second area of the second display (521) within the image based on information about the image. For example, the first DDI (512) may obtain color information of a portion corresponding to a second area of the second display (521) within the image based on information about the image while the first portion of the first image is displayed through the first display (511).
[0198] Since operation 805 is at least partially identical or similar to operation 603 of FIG. 6, a detailed description thereof will be omitted.
[0199] In operation 807, in one embodiment, the first DDI (512) may provide the acquired color information to the processor (560).
[0200] Since operation 807 is at least partially identical or similar to operation 605 of FIG. 6, a detailed description thereof will be omitted.
[0201] FIG. 10 is a flowchart (1000) for explaining a method for providing color information according to one embodiment.
[0202] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.
[0203] According to one embodiment, operations 601 to 605 may be understood to be performed in a first DDI (e.g., the first DDI (512) of FIG. 5) of an electronic device (e.g., the electronic device (501) of FIG. 5).
[0204] Referring to FIG. 10, in operation 1001, in one embodiment, the first DDI (512) may obtain information about the image based on an input for displaying the image through the first display (511).
[0205] In one embodiment, a processor (560) (e.g., a main processor (561)) may obtain an input for displaying an image (e.g., a screen including text, objects, and / or images) through a first display (511). The processor (560) may provide the image to be displayed through the first display (511) (hereinafter, also referred to as a “second image”) to a first DDI (512).
[0206] In one embodiment, the first DDI (512) may obtain a second image from the processor (560).
[0207] In one embodiment, the first DDI (512) can display the second image through the first display (511) based on the acquisition of the second image.
[0208] In one embodiment, the first DDI (512) may acquire information about a portion corresponding to a first area of the first display (511) within the second image (hereinafter referred to as “the second portion of the second image” or “the second portion”) (e.g., a portion displayed through the first area of the first display (511) within the second image) based on acquiring the second image. For example, the first DDI (512) may acquire information about the second portion, including RGB values for each coordinate of the second portion of the second image.
[0209] In operation 1003, in one embodiment, the first DDI (512) may obtain color information of a portion corresponding to a first area of the first display (511) within the image based on information about the image.
[0210] In one embodiment, the first DDI (512) may obtain color information of a second portion of the second image (e.g., COPR information of the second portion) based on information about the first portion of the second image.
[0211] In one embodiment, the operation of the first DDI (512) acquiring COPR information of the second part is at least partially identical or similar to the operation of the first DDI (512) acquiring COPR information of the first part in operation 603 of FIG. 6, so a detailed description thereof will be omitted.
[0212] In operation 1005, in one embodiment, the first DDI (512) may provide the acquired color information to the processor (560). For example, the first DDI (512) may provide the color information of the second portion to the processor (560) (e.g., the auxiliary processor (562)).
[0213] In one embodiment, although not illustrated in FIG. 10, the auxiliary processor (562) may measure an illuminance value via the first illuminance sensor (530) while performing at least a portion of operations 1001 through 1005 (or after the second image is displayed via the first display (511). The auxiliary processor (562) may determine a final illuminance value of the first illuminance sensor (530) based on the measured illuminance value and the color information of the first portion obtained from the first DDI (512).
[0214] In one embodiment, the processor (560) (e.g., the main processor (561)) may set (e.g., adjust) the brightness of the first display (511) to a brightness (e.g., a brightness level) corresponding to a final illuminance value determined by the processor (560) (e.g., the auxiliary processor (562)).
[0215] An electronic device (501) according to one embodiment may include a first display (511) and a first DDI (512) configured to control the first display (511) and capable of acquiring color information, a second display (521) and a second DDI (522) configured to control the second display (521), a first light sensor (530) disposed under a first area of the first display (511) and a second light sensor (540) disposed under a second area of the second display (521), and at least one processor (560) operatively connected to the first display (511), the first DDI (512), the second display (521), the second DDI (522), the first light sensor (530), and the second light sensor (540). The first DDI (512) may be configured to obtain information about an image from the second DDI (522) based on an input for displaying an image through the second display (521). The first DDI (512) may be configured to obtain color information of a portion corresponding to the second area of the second display (521) within the image based on the information about the obtained image. The first DDI (512) may be configured to provide the obtained color information to the at least one processor (560) so that the at least one processor (560) adjusts the brightness of the second display (521) based on the obtained color information and the illuminance value obtained through the second illuminance sensor (540) when displaying the image through the second display (521).
[0216] In one embodiment, the second DDI (522) may include a DDI that is unable to obtain color information related to the second region.
[0217] In one embodiment, the first DDI (512) may be configured to obtain information about an image displayed through the second display (521) from the second DDI (522) when the image is displayed through the second display (521).
[0218] In one embodiment, the information about the image may include values of pixels of a portion of the image corresponding to the second area of the second display (521), or values of pixels of the image and positions of the portion within the image.
[0219] In one embodiment, the color information of the portion may include color on pixel ratio (COPR) information of the portion.
[0220] In one embodiment, the at least one processor (560) may determine, based on the acquired color information, an illuminance value acquired by the second illuminance sensor (540) by light of the second display (521) when the image is displayed through the second display (521). The at least one processor (560) may be configured to acquire the illuminance value through the second illuminance sensor (540) based on displaying the image through the second display (521). The at least one processor (560) may be configured to acquire a final illuminance value based on the determined illuminance value and the acquired illuminance value. The at least one processor (560) may be configured to set a luminance corresponding to the final illuminance value as the luminance of the second display (521).
[0221] In one embodiment, the first DDI (512) may be configured to display, through the first display (511), a portion corresponding to the second area of the second display (521) within the image.
[0222] In one embodiment, the first DDI (512) may be configured to display, through the first display (511), a portion corresponding to the second area of the second display (521) within the image at the minimum brightness of the first display (511).
[0223] In one embodiment, the at least one processor (560) may be configured to control the electronic device (501) to operate in a low power mode while displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511).
[0224] In one embodiment, the first DDI (512) may be configured to display the portion through the first display (511) using the same number of pixels as the number of pixels of the portion displayed through the second display (521).
[0225] In one embodiment, a method for providing color information in an electronic device (501) may include an operation of acquiring information about an image from the second DDI (522) based on an input for displaying an image through the second display (521) based on information about the acquired image by the first DDI (512). The method may include an operation of acquiring color information of a portion corresponding to the second area of the second display (521) within the image based on information about the acquired image by the first DDI (512). The method may include an operation of providing the acquired color information to the at least one processor (560) so that the at least one processor (560) adjusts the brightness of the second display (521) based on the acquired color information and an illuminance value acquired through the second illuminance sensor (540) when displaying the image through the second display (521).
[0226] In one embodiment, the second DDI (522) may include a DDI that is unable to obtain color information related to the second region.
[0227] In one embodiment, the operation of obtaining information about the image from the second DDI (522) may include an operation of obtaining information about the image displayed through the second display (521) from the second DDI (522) when the image is displayed through the second display (521) by the first DDI (512).
[0228] In one embodiment, the information about the image may include values of pixels of a portion of the image corresponding to the second area of the second display (521), or values of pixels of the image and positions of the portion within the image.
[0229] In one embodiment, the color information of the portion may include COPR information of the portion.
[0230] In one embodiment, the method may further include an operation of determining, by the at least one processor (560), an illuminance value acquired by the second illuminance sensor (540) by light of the second display (521) when the image is displayed through the second display (521) based on the acquired color information. The method may further include an operation of acquiring, by the at least one processor (560), the illuminance value through the second illuminance sensor (540) based on displaying the image through the second display (521). The method may further include an operation of acquiring, by the at least one processor (560), a final illuminance value based on the determined illuminance value and the acquired illuminance value. The method may further include an operation of setting, by the at least one processor (560), a luminance corresponding to the final illuminance value as the luminance of the second display (521).
[0231] In one embodiment, the method may further include an operation of displaying, by the first DDI (512), a portion corresponding to the second area of the second display (521) within the image through the first display (511).
[0232] In one embodiment, the operation of displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511) may include an operation of displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511) at the minimum brightness of the first display (511), by the first DDI (512).
[0233] In one embodiment, the operation of displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511) may include an operation of controlling the electronic device (501) to operate in a low power mode while displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511), by the at least one processor (560).
[0234] In one embodiment, a non-transitory computer-readable medium having computer-executable instructions recorded thereon may cause an electronic device (501) including at least one processor (560) to obtain information about an image from a second DDI (522) based on an input for displaying an image through the second display (521) obtained by the first DDI (512). The computer-executable instructions may cause an electronic device (501) including at least one processor (560) to obtain color information about a portion corresponding to the second area of the second display (521) within the image based on the information about the obtained image. The computer-executable instructions, when executed, may cause an electronic device (501) including at least one processor (560) to provide the acquired color information to the at least one processor (560) by the first DDI (512), such that the at least one processor (560) adjusts the brightness of the second display (521) based on the acquired color information and the acquired illuminance value through the second illuminance sensor (540) when displaying the image through the second display (521).
[0235] Additionally, the structure of the data used in the embodiments of the present document described above can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).
[0236] An electronic device according to an embodiment disclosed in this document may take various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to an embodiment of this document is not limited to the aforementioned devices.
[0237] It should be understood that the embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0238] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0239] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0240] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0241] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (501), A first display (511) and a first DDI (512) (display driver integrated circuit) configured to control the first display (511) and capable of acquiring color information; A second display (521) and a second DDI (522) configured to control the second display (521); A first illuminance sensor (530) positioned under the first area of the first display (511) and a second illuminance sensor (540) positioned under the second area of the second display (521); At least one processor (560) operatively connected to the first display (511), the first DDI (512), the second display (521), the second DDI (522), the first light sensor (530), and the second light sensor (540), The above first DDI (512) is Based on the acquisition of input for displaying an image through the second display (521), information about the image is acquired from the second DDI (522), Based on the information about the acquired image, color information of a portion corresponding to the second area of the second display (521) within the image is acquired, and An electronic device (501) configured to provide the acquired color information to the at least one processor (560) so that the at least one processor (560) adjusts the brightness of the second display (521) based on the acquired color information and the illuminance value acquired through the second illuminance sensor (540) when displaying the image through the second display (521).
2. In paragraph 1, An electronic device (501) including a DDI (522) that is unable to obtain color information related to the second area.
3. In paragraph 1 or 2, The above first DDI (512) is An electronic device (501) configured to obtain information about an image displayed through the second display (521) from the second DDI (522) when the image is displayed through the second display (521).
4. In any one of paragraphs 1 to 3, Information about the image, an electronic device (501) including values of pixels of a portion corresponding to the second area of the second display (521) within the image, or values of pixels of the image and positions of the portion within the image.
5. In any one of paragraphs 1 to 4, An electronic device (501) including the color information of the above part and COPR (color on pixel ratio) information of the above part.
6. In any one of paragraphs 1 to 5, At least one processor (560) above, Based on the acquired color information, when displaying the image through the second display (521), the illuminance value acquired from the second illuminance sensor (540) by the light of the second display (521) is determined, Based on displaying the image through the second display (521), the illuminance value is obtained through the second illuminance sensor (540). Based on the above determined illuminance value and the above acquired illuminance value, the final illuminance value is acquired, and An electronic device (501) configured to set the luminance corresponding to the final illuminance value as the luminance of the second display (521).
7. In any one of paragraphs 1 to 6, An electronic device (501) configured to display a portion corresponding to the second area of the second display (521) within the image through the first display (511), wherein the first DDI (512) is configured to display the portion corresponding to the second area of the second display (521).
8. In any one of paragraphs 1 to 7, An electronic device (501) configured to display a portion corresponding to the second area of the second display (521) within the image through the first display (511) at the minimum brightness of the first display (511).
9. In any one of paragraphs 1 to 8, At least one processor (560) above, An electronic device (501) configured to control the electronic device (501) to operate in a low power mode while displaying a portion corresponding to the second area of the second display (521) within the image through the first display (511).
10. In any one of paragraphs 1 to 9, An electronic device (501) configured to display the portion through the first display (511) using the same number of pixels as the number of pixels of the portion displayed through the second display (521), wherein the first DDI (512) is configured to display the portion through the first display (511).
11. A method for providing color information in an electronic device (501), An operation of acquiring information about an image from the second DDI (522) based on an input for displaying an image through the second display (521) by the first DDI (512) of the electronic device (501), the electronic device including a first display (511) and a first DDI (512) configured to control the first display (511) and capable of acquiring color information, a second display (521) and a second DDI (522) configured to control the second display (521), a first illuminance sensor (530) arranged under a first area of the first display (511) and a second illuminance sensor (540) arranged under a second area of the second display (521), and at least one processor (560); An operation of acquiring color information of a portion corresponding to the second area of the second display (521) within the image based on information about the acquired image by the first DDI (512); and A method including an operation of providing the acquired color information to the at least one processor (560) so that the at least one processor (560) adjusts the brightness of the second display (521) based on the acquired color information and the illuminance value acquired through the second illuminance sensor (540) when displaying the image through the second display (521).
12. In paragraph 11, A method wherein the second DDI (522) includes a DDI that cannot obtain color information related to the second area.
13. In clause 11 or 12, The operation of obtaining information about the image from the second DDI (522) is as follows: A method including an operation of obtaining information about an image displayed through the second display (521) from the second DDI (522) when the image is displayed through the second display (521) by the first DDI (512).
14. In any one of paragraphs 11 to 13, A method wherein the information about the image includes values of pixels of a portion corresponding to the second area of the second display (521) within the image, or values of pixels of the image and positions of the portion within the image.
15. A non-transitory computer-readable storage medium having computer-executable instructions recorded thereon, wherein the computer-executable instructions, when executed, cause an electronic device (501) including at least one processor (560) to: An electronic device (501) including a first display (511) and a first DDI (512) configured to control the first display (511) and capable of acquiring color information, a second display (521) and a second DDI (522) configured to control the second display (521), a first illuminance sensor (530) arranged under a first area of the first display (511) and a second illuminance sensor (540) arranged under a second area of the second display (521), and at least one processor (560), wherein, based on an input for displaying an image through the second display (521) is acquired by the first DDI (512), information about the image is acquired from the second DDI (522), By the first DDI (512), based on the information about the acquired image, color information of a portion corresponding to the second area of the second display (521) within the image is acquired, and A computer-readable storage medium that provides the acquired color information to the at least one processor (560) by the first DDI (512), so that the at least one processor (560) adjusts the brightness of the second display (521) based on the acquired color information and the acquired illuminance value through the second illuminance sensor (540) when displaying the image through the second display (521).
Citation Information
Patent Citations
Ambient light detection method and device, electronic equipment and storage medium
CN113539192A
Screen brightness adjustment method and device and terminal equipment
CN113707062A
Shared Signboard Service System for selectively providing advertisement campaigns of local stores and enterprises
KR1020230013897A
Method of guiding wash course and device of guiding thereof
KR1020230119498A
Method and apparatus for non-contact oxygen saturation measurement
KR102411622B1