Electronic device, method, and non-transitory computer-readable storage medium for adjusting color temperature of screen

WO2025048191A1PCT designated stage expired Publication Date: 2025-03-06SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/008796
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-10-10
Filing Date
2024-06-25
Publication Date
2025-03-06

Smart Images

  • Figure KR2024008796_06032025_PF_FP_ABST
    Figure KR2024008796_06032025_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device is provided. The electronic device may comprise a memory configured to store instructions. The electronic device may comprise at least one camera. The electronic device may comprise an ambient light sensor. The electronic device may comprise a display. The electronic device may comprise a processor. The processor may be configured to: while a screen is displayed on the display and the at least one camera is deactivated, identify a level of change in the brightness of an environment around the electronic device on the basis of sensing data acquired using the ambient light sensor; activate the at least one camera on the basis of the level higher than a reference level; and adjust the color temperature of the screen displayed on the display, depending on the color temperature of the environment, recognized using the activated at least one camera.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device, method, and non-transitory computer-readable storage medium for adjusting the color temperature of a screen

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable storage media for adjusting the color temperature of a screen.

[0002] An electronic device may include a display. The display may be used to display an image. The display may include a display panel and a display driving circuit. The display driving circuit may be operatively coupled to the display panel. The display driving circuit may be configured to display the image acquired from a processor of the electronic device on the display panel.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] An electronic device is provided. The electronic device may include a memory configured to store instructions. The electronic device may include at least one camera. The electronic device may include an ambient light sensor. The electronic device may include a display. The electronic device may include a processor. The processor may be configured to determine a level of change in brightness of an environment surrounding the electronic device based on sensed data acquired using the ambient light sensor while a screen is displayed on the display and the at least one camera is deactivated. The processor may be configured to keep the at least one camera deactivated based on the level being lower than a reference level. The processor may be configured to activate the at least one camera based on the level being higher than or equal to the reference level, and to adjust a color temperature of the screen displayed on the display based on a color temperature of the environment recognized using the activated at least one camera.

[0005] A method is provided. The method can be executed in an electronic device having at least one camera, an ambient light sensor, and a display. The method can include an operation of determining a level of change in brightness of an environment surrounding the electronic device based on sensed data acquired using the ambient light sensor while a screen is displayed on the display and the at least one camera is deactivated. The method can include an operation of maintaining the at least one camera deactivated based on the level being lower than a reference level. The method can include an operation of activating the at least one camera based on the level being higher than or equal to the reference level, and adjusting a color temperature of the screen displayed on the display based on a color temperature of the environment recognized using the activated at least one camera.

[0006] A non-transitory computer-readable storage medium is provided. The non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by an electronic device having at least one camera, an ambient light sensor, and a display, cause the electronic device to determine a level of change in brightness of an environment surrounding the electronic device based on sensed data acquired using the ambient light sensor while a screen is displayed on the display and the at least one camera is deactivated. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to maintain the deactivation of the at least one camera based on the level being lower than a reference level. The one or more programs may include instructions that, when executed by the electronic device, cause the electronic device to activate the at least one camera based on the level being higher than or equal to the reference level, and to adjust the color temperature of the screen displayed on the display according to the color temperature of the environment recognized using the activated at least one camera.

[0007] FIG. 1 illustrates an example of changing the color temperature of a screen displayed on a display of an electronic device based on the color temperature of the environment surrounding the electronic device.

[0008] Figure 2 is a simplified block diagram of an exemplary electronic device.

[0009] FIG. 3 illustrates an example of at least one camera, a light sensor, and a display.

[0010] FIG. 4 is a flowchart illustrating an exemplary method for activating at least one camera to adjust the color temperature of a screen based on the color temperature of an environment.

[0011] FIG. 5 is a flowchart illustrating an exemplary method for setting a time for activating at least one camera depending on the brightness of the environment.

[0012] Figure 6 is a chart showing changes in color temperature measured using at least one camera.

[0013] FIG. 7 is a flowchart illustrating an exemplary method for setting a time for activating at least one camera based on different color temperatures.

[0014] Figure 8 is a chart showing the distribution of colors according to color temperature.

[0015] FIG. 9 is a flowchart illustrating an exemplary method for selecting a camera used to adjust the color temperature of a screen depending on the brightness of the environment.

[0016] FIG. 10 is a flowchart illustrating an exemplary method of activating at least one camera to adjust the color temperature of a screen according to the color temperature of an environment, based on brightness and other color temperatures.

[0017] FIG. 11 is a block diagram of an electronic device within a network environment according to various embodiments.

[0018] FIG. 12 is a block diagram of a display module according to various embodiments.

[0019] An electronic device may include a display. The display may be used to display a screen. For example, since the display is exposed to the environment surrounding the electronic device, the visual quality of the screen may vary depending on changes in the environment. For example, the screen may appear differently depending on the color temperature of the environment. For example, since the screen appears differently depending on the color temperature of the environment, the electronic device may set the color temperature of the screen based on the color temperature of the environment. For example, the electronic device may change the color temperature of the screen based on changes in the color temperature of the environment. Changing the color temperature of the screen is exemplified in the description of FIG. 1.

[0020] FIG. 1 illustrates an example of changing the color temperature of a screen displayed on a display of an electronic device based on a change in the color temperature of the environment surrounding the electronic device.

[0021] Referring to FIG. 1, the electronic device (100) can display a screen (140) having a first color temperature (131) on the display (120), such as in a state (191). For example, the first color temperature (131) of the screen (140) can be set, identified, or provided based on the color temperature (181) of the environment around the electronic device (100).

[0022] For example, the color temperature of the environment can be changed. For example, the color temperature of the environment can be changed from color temperature (181) to color temperature (182). Maintaining the color temperature of the screen (140) at the first color temperature (131) corresponding to the color temperature (181) within the environment having the color temperature (182) can reduce the visual quality of the screen (140). For example, the electronic device (100) can change the state (191) to the state (192) according to the change from the color temperature (181) to the color temperature (182) for the visual quality of the screen (140). For example, as in state (192), the electronic device (100) can display a screen (140) having a second color temperature (132) changed from a first color temperature (131) on the display (120) according to a color temperature (182) changed from a color temperature (181) for the visual quality of the screen (140). For example, the second color temperature (132) of the screen (140) can be set, identified, or provided based on the color temperature (182) of the environment.

[0023] As described above, the electronic device (100) can perform operations to recognize, identify, or measure a change from a color temperature (181) to a color temperature (182) in order to change from a first color temperature (131) to a second color temperature (132). The electronic device (100) can include components for the above operations. The components are exemplified in the description of FIG. 2.

[0024] Figure 2 is a simplified block diagram of an exemplary electronic device.

[0025] Referring to FIG. 2, the electronic device (100) may include at least a portion of the electronic device (1101) of FIG. 11 or may correspond to at least a portion of the electronic device (1101) of FIG. 11. The electronic device (100) may include a display (120), a processor (201), a memory (202), at least one camera (203), and a light sensor (204).

[0026] The processor (201) may include at least a portion of the processor (1120) of FIG. 11, or may correspond to at least a portion of the processor (1120) of FIG. 11. The processor (201) may be used to control the display (120), the memory (202), at least one camera (203), and the light sensor (204). The processor (201) may be configured to cause the electronic device (100) to perform at least some of the operations exemplified in the descriptions of FIGS. 4 to 10 below.

[0027] For example, the processor (201) may include a central processing unit (CPU) (or central processing circuit). For example, the processor (201) may include a display processing unit (DPU) (or display control circuit) for the display (120). For example, the processor (201) may include a memory controller for the memory (202) (e.g., volatile memory) and / or a storage controller for the memory (202) (e.g., non-volatile memory). For example, the processor (201) may include an image signal processor (ISP) (or camera control circuit) (or image sensor control circuit) for at least one camera (203). For example, the processor (201) may include a sensor interface (or sensor hub) (or sensor control circuit) for the light sensor (204).

[0028] The display (120) may include at least a portion of the display module (1160) of FIGS. 11 and 12 or correspond to at least a portion of the display module (1160) of FIGS. 11 and 12. The display (120) may be used to display a screen (e.g., visual information, visual data, and / or images). For example, the display (120) may be used to display the screen obtained (or generated) (or rendered) by the processor (201). For example, the display (120) may be used to display the screen provided from the processor (201).

[0029] Although not illustrated in FIG. 2, the display (120) may include a display driving circuit (e.g., a display driver IC (DDI) (1230) of FIG. 12) and a display panel (e.g., a display (1210) of FIG. 12). For example, the display driving circuit may be used to display the screen on the display panel. As a non-limiting example, the display driver circuit may include a memory (e.g., a graphic random access memory (GRAM)) configured to store information about at least a portion of the screen. As a non-limiting example, the display driver circuit may not include the memory. As a non-limiting example, the display driver circuit may be configured to operate for a command mode of a display serial interface (DSI) and / or a video mode of the DSI. As a non-limiting example, the display driver circuit may be configured to perform at least some of the operations exemplified in the descriptions of FIGS. 4 to 10 below. For example, some of the operations of the processor (201) exemplified in the descriptions of FIGS. 4 to 10 may be replaced with at least one operation of the display driver circuit. For example, the display driver circuit may adjust, set, or provide a color temperature of a screen displayed on the display panel based on control data (e.g., a control command) from the processor (201).

[0030] The memory (202) may include at least a portion of the memory (1130) of FIG. 11 or may correspond to at least a portion of the memory (1130) of FIG. 11. The memory (202) may be configured to store instructions that cause the electronic device (100) to execute at least a portion of the operations illustrated in the descriptions of FIGS. 4 through 10 below.

[0031] The memory (202) may include non-volatile memory (e.g., non-volatile memory (1134) of FIG. 11). As a non-limiting example, the memory (202) may further include volatile memory (e.g., volatile memory (1132) of FIG. 11).

[0032] At least one camera (203) may include at least a portion of the camera module (1180) of FIG. 11 or may correspond to at least a portion of the camera module (1180) of FIG. 11.

[0033] At least one camera (203) may be used to capture images (e.g., still images and / or moving images or videos). As a non-limiting example, the at least one camera (203) may include a camera including a telephoto lens and / or a camera including a wide-angle lens. As a non-limiting example, the at least one camera (203) may include a camera (e.g., a selfie camera) among a plurality of cameras included in the electronic device (100) that faces the direction in which the display (120) (or the display panel) faces. The camera facing the direction in which the display (120) faces will be exemplified within the description of FIG. 3.

[0034] For example, at least one camera (203) may be used to recognize, measure, or identify the color temperature of the environment around the electronic device (100).

[0035] The light sensor (204) may include at least a portion of the sensor module (1176) of FIG. 11 or may correspond to at least a portion of the sensor module (1176) of FIG. 11.

[0036] The light sensor (204) may be used to obtain sensing data on the brightness (or illuminance) of the environment around the electronic device (100). As a non-limiting example, the light sensor (204) may be a sensor that does not have the ability to obtain sensing data on the color temperature of the environment. As a non-limiting example, the quality (or accuracy) of the sensing data on the color temperature of the environment obtained by the light sensor (204) may be lower than the quality (or accuracy) of the sensing data on the color temperature of the environment obtained by at least one camera (203). For example, the light sensor (204) may be positioned under the active area of ​​the display (120) (or the display panel). The light sensor (204) positioned (or arranged) under the active area is exemplified in the description of FIG. 3.

[0037] FIG. 3 illustrates an example of at least one camera, a light sensor, and a display.

[0038] Referring to FIG. 3, the electronic device (100) may include a display (120) having an active area including pixels available for displaying a screen. For example, at least a portion (300) of the active area may be visible from the front side of the electronic device (100).

[0039] For example, the light sensor (204) may be positioned or arranged below at least a portion (300) of the active area. For example, the light sensor (204) below at least a portion (300) of the active area may be configured to obtain sensing data about the brightness of the environment based on light from the outside.

[0040] As a non-limiting example, the display (120) may include a non-active area (301) that is visible from the front side of the electronic device (100). For example, the non-active area (301) may include pixels that are disabled from emitting light.

[0041] As a non-limiting example, at least one camera (203) may be aligned in the non-active area (301). As a non-limiting example, at least one camera (203) may be positioned beneath an opening (not shown in FIG. 3) positioned within the non-active area (301).

[0042] Although FIG. 3 illustrates at least one camera (203) aligned in the non-active area (301), this is merely exemplary. The at least one camera (203) may be positioned or arranged below at least a portion (300) of the active area, such as a light sensor (204), unlike the illustration in FIG. 3. As a non-limiting example, the density of pixels positioned above the at least one camera (203) may be relatively low for the quality of the image acquired through the at least one camera (203).

[0043] The arrangement of at least one camera (203) and a light sensor (204) exemplified in FIG. 3 can be applied not only to a bar-type smartphone (e.g., the electronic device (100) of FIG. 3), but also to other types of mobile devices. For example, the other types of mobile devices can include a foldable type device (e.g., a foldable smartphone (391-1), a multi-foldable smartphone (391-2), or a multi-foldable smartphone (391-3)), a sliderable (or rollable) type device (392), a tablet (393), and / or a laptop computer (394).

[0044] For example, the electronic device (100) can adaptively adjust the color temperature of a screen displayed on the display (120) in response to a change in the color temperature of the environment surrounding the electronic device (100) using the components exemplified in the description of FIG. 2. For example, activating at least one camera (203) can be performed within the electronic device (100) to adjust the color temperature of the screen according to the color temperature of the environment. Activating at least one camera (203) to adjust the color temperature of the screen according to the color temperature of the environment is exemplified in the description of FIG. 4.

[0045] FIG. 4 is a flowchart illustrating an exemplary method for activating at least one camera to adjust the color temperature of a screen based on the color temperature of an environment.

[0046] Referring to FIG. 4, in operation 401, the processor (201) can identify, recognize, measure, or obtain a level of change in brightness of an environment around the electronic device (100) based on sensing data acquired using a light sensor (204) while a screen (e.g., screen (140)) is displayed on the display (120) and at least one camera (203) is deactivated.

[0047] For example, disabling at least one camera (203) may include disabling (or stopping) image acquisition via the at least one camera (203). For example, disabling at least one camera (203) may include not executing image acquisition via the at least one camera (203) within the electronic device (100). For example, disabling at least one camera (203) may include disabling receiving external light via the at least one camera (203). For example, disabling at least one camera (203) may include disabling a service provided using the at least one camera (203) within the electronic device (100). As a non-limiting example, displaying a screen while the at least one camera (203) is disabled may include displaying a screen acquired without the use of the at least one camera (203).

[0048] For example, the sensing data may represent the brightness (or illuminance) of the environment. As a non-limiting example, the level of change in brightness may represent the difference between first sensing data received through the illuminance sensor (204) within a first time interval and second sensing data received through the illuminance sensor (204) within a second time interval prior to the first time interval.

[0049] In operation 402, the processor (201) can check, determine, or identify whether the level identified in operation 401 is lower than a reference level.

[0050] For example, the processor (201) can determine whether the determined level is lower than the reference level by comparing the reference level with the determined level. For example, since the color temperature of the environment may change depending on a rapid change in the brightness of the environment, the processor (201) can determine whether the determined level is lower than the reference level.

[0051] For example, the processor (201) may execute operation 403 on the condition that the confirmed level is lower than the reference level, and otherwise execute operation 404.

[0052] Operation 402 of FIG. 4 is merely exemplary. For example, operation 402 may be replaced with another operation for determining whether the brightness of the environment changes abruptly.

[0053] In operation 403, the processor (201) may maintain at least one camera (203) disabled based on the level being lower than the reference level. For example, since the level being lower than the reference level may indicate that the color temperature of the environment is maintained, the processor (201) may maintain at least one camera (203) disabled. As a non-limiting example, maintaining at least one camera (203) disabled may be performed to reduce power consumption for adaptively adjusting the color temperature of the screen displayed on the display (120).

[0054] For example, the processor (201) may execute operations 401 and 402 while maintaining at least one camera (203) disabled. For example, the processor (201) may continue to check the level and determine whether the level is lower than the reference level while maintaining at least one camera (203) disabled.

[0055] The processor (201) may activate at least one camera (203) in operation 404 based on the level being higher than or equal to the reference level. For example, the at least one camera (203) may be activated to recognize, measure, identify, or obtain a color temperature of the environment.

[0056] For example, since activating at least one camera (203) in operation 404 is performed to recognize (or measure) a color temperature of the environment around the electronic device (100), displaying a preview image based on at least a portion of the images acquired through the at least one camera (203) while activating the at least one camera (203) in operation 404 may be bypassed, omitted, avoided, or not provided. As a non-limiting example, activating the at least one camera (203) in operation 404 may be unnoticeable or transparent to the user. As a non-limiting example, activating the at least one camera (203) in operation 404 may also be indicated by an indication (e.g., a circle having a designated (or predetermined) color) within an indicator area displayed together with the screen.

[0057] In operation 405, the processor (201) can adjust the color temperature of the screen displayed on the display (120) according to the color temperature of the environment recognized using at least one camera (203) activated according to operation 404.

[0058] For example, the processor (201) may obtain data on the color temperature of the environment through at least one camera (203) activated according to operation 404. For example, the data may be obtained by a component of at least one camera (203) used for AWB (auto white balance) and / or a component of the processor (201) (e.g., an ISP as exemplified in the description of FIG. 2). For example, the processor (201) may adjust the color temperature of the screen based on the obtained data.

[0059] For example, the processor (201) may disable at least one camera (203) after executing operation 405. For example, the processor (201) may disable at least one camera (203) after obtaining the color temperature of the environment according to operation 404. For example, the processor (201) may execute operations 401 and 402 after executing operation 404 (and / or operation 405). For example, the processor (201) may disable at least one camera (203) after executing operation 404 (and / or operation 405) while maintaining checking the level and checking whether the level is lower than the reference level.

[0060] Although operation 405 of FIG. 4 illustrates adjusting the color temperature of the screen according to the color temperature of the environment, this is merely exemplary. For example, the processor (201) may set the color temperature of the screen according to the color temperature of the environment. For example, if the color temperature of the environment is maintained (or not changed) despite a rapid change in the brightness of the environment, the processor (201) may maintain the color temperature of the screen.

[0061] As a non-limiting example, the processor (201) may set a time to activate at least one camera (203) to adjust the color temperature of the screen according to a change in the color temperature of the environment, in order to reduce power consumption of the electronic device (100) including a rechargeable battery.

[0062] For example, the processor (201) may set a time for activating at least one camera (203) to adjust the color temperature of the screen according to the color temperature of the environment, at least in part based on the brightness of the environment represented by the sensing data acquired through the light sensor (204). Setting a time for activating at least one camera (203) at least in part based on the brightness of the environment is exemplified within the description of FIG. 5.

[0063] FIG. 5 is a flowchart illustrating an exemplary method for setting a time for activating at least one camera depending on the brightness of the environment.

[0064] Referring to FIG. 5, in operation 501, the processor (201) can check the brightness of the environment represented by the sensing data acquired using the light sensor (204). For example, the sensing data may correspond to the sensing data exemplified in operation 401. For example, the sensing data may be different from the sensing data exemplified in operation 401. For example, the sensing data may be sensing data acquired using the light sensor (204) after operation 401 or operation 402 is executed.

[0065] In operation 502, the processor (201) can identify a time corresponding to the brightness identified in operation 501 as a time to activate at least one camera (203) to adjust the color temperature of the screen according to the color temperature of the environment.

[0066] For example, measuring color temperature using at least one camera (203) may be inaccurate or unstable until a reference time (or certain time) has elapsed from the timing of activating at least one camera (203) according to operation 404. For example, a color temperature recognized or measured during the reference time (or certain time) from the timing of activating at least one camera (203) according to operation 404 may change even though the color temperature of the environment is maintained. For example, a color temperature recognized or measured during the reference time from the timing of activating at least one camera (203) according to operation 404 may not reflect the color temperature of the environment. For example, a color temperature recognized or measured using at least one camera (203) may converge after the reference time has elapsed from the timing of activating at least one camera (203) according to operation 404.

[0067] For example, the above reference time may vary depending on the brightness of the environment surrounding the electronic device (100). The above reference time varying depending on the brightness is exemplified in the description of Fig. 6.

[0068] Figure 6 is a chart showing changes in color temperature measured using at least one camera.

[0069] Referring to FIG. 6, the horizontal axis of each of the charts (600) and (650) represents time, and the vertical axis of each of the charts (600) and (650) represents color temperature.

[0070] Each of lines (601) to (605) in the chart (600) represents a change in color temperature measured (or perceived) using at least one camera (203) within a condition where the brightness of the environment is A (e.g., 800 (lux)). For example, measuring color temperature using at least one camera (203) during a reference time (610) from a timing (620) at which at least one camera (203) is activated may be unstable, as represented by lines (601) to (605). For example, measuring color temperature using at least one camera (203) after the reference time (610) has elapsed from the timing (620) may be stable, as represented by lines (601) to (605). For example, the color temperature measured using at least one camera (203) within a condition where the brightness is A may converge from timing (630).

[0071] Each of lines (651) to (655) in the chart (650) represents a change in color temperature measured (or perceived) using at least one camera (203) within a condition where the brightness of the environment is B (e.g., 100 (lux)). For example, measuring color temperature using at least one camera (203) during a reference time (660) from a timing (670) at which at least one camera (203) is activated may be unstable, as represented by lines (651) to (655). For example, measuring color temperature using at least one camera (203) after the reference time (660) has elapsed from the timing (670) may be stable, as represented by lines (651) to (655). For example, the color temperature measured using at least one camera (203) within a condition where the brightness is B may converge from timing (680). For example, the reference time at which the color temperature measured using at least one camera (203) converges may vary depending on the brightness (e.g., A or B), as indicated by the reference time (610) and the reference time (660) which is longer than the reference time (610).

[0072] Referring again to FIG. 5, since the reference time varies depending on the brightness of the environment, the processor (201) may set a time for activating at least one camera (203) to adjust the color temperature of the screen according to the color temperature of the environment, at least in part based on the brightness. For example, the processor (201) may set the time to a first time based on the brightness within a first reference range, and may set the time to a second time different from the first time based on the brightness within a second reference range that does not overlap with the first reference range.

[0073] As a non-limiting example, the electronic device (100) may store reference data including the first time defined for the brightness within the first reference range and the second time defined for the brightness within the second reference range in the non-volatile memory exemplified in the description of FIG. 2. For example, the processor (201) may identify a time corresponding to the brightness identified in operation 501 from the reference data, and set the identified time as a time for activating at least one camera (203).

[0074] In operation 503, the processor (201) may activate at least one camera (203) for the time identified in operation 502 to adjust the color temperature of the screen according to the color temperature of the environment.

[0075] For example, the processor (201) may activate at least one camera (203) for a first time to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within the first reference range. For example, the processor (201) may activate at least one camera (203) for a second time to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within the second reference range. For example, the processor (201) may set a timing for acquiring data on the color temperature of the environment available for adjusting the color temperature of the screen based at least in part on the brightness represented by the sensing data exemplified in operation 501.

[0076] As described above, the electronic device (100) can reduce power consumed to adjust the color temperature of the screen according to the color temperature of the environment by setting the time for activating at least one camera (203) based on the brightness.

[0077] Referring again to FIG. 4, the processor (201) may recognize or measure another color temperature of the environment before recognizing (or measuring) the color temperature of the environment to adjust the color temperature of the screen. For example, the other color temperature of the environment may be recognized or measured to set a time for activating at least one camera (203) to adjust the color temperature of the screen. Setting a time for activating at least one camera (203) based on the other color temperature is exemplified in the description of FIG. 7.

[0078] FIG. 7 is a flowchart illustrating an exemplary method for setting a time for activating at least one camera based on different color temperatures.

[0079] Referring to FIG. 7, in operation 701, the processor (201) may recognize, measure, or obtain the different color temperature of the environment using at least one camera (203) activated according to operation 404. For example, the different color temperature of the environment may be recognized before recognizing the color temperature of the screen. For example, the different color temperature of the environment may be recognized after a predetermined time has elapsed from the timing of activating the at least one camera (203). For example, the different color temperature of the environment may be the same as the color temperature of the screen, or may be different from the color temperature of the screen.

[0080] In operation 702, the processor (201) can identify a time corresponding to the different color temperature recognized in operation 701 as a time to activate at least one camera (203) to adjust the color temperature of the screen according to the color temperature of the environment.

[0081] For example, the time it takes for the color temperature measured using at least one camera (203) to converge may vary depending on the distribution of the power spectrum of light from the environment (or the (actual) color temperature of the environment). The distribution of the power spectrum is exemplified in the description of FIG. 8.

[0082] Figure 8 is a chart showing the distribution of colors according to color temperature.

[0083] Referring to FIG. 8, the horizontal axis of each of chart (820), chart (840), chart (860), and chart (880) represents wavelength, and the vertical axis of each of chart (820), chart (840), chart (860), and chart (880) represents relative density.

[0084] For example, a line (821) in a chart (820) represents a wavelength-wise distribution of light (e.g., light from a white LED (light emitting diode)) from an environment whose color temperature (or actual color temperature) is A (e.g., 2700 (K) (kelvin)), a line (841) in a chart (840) represents a wavelength-wise distribution of light (e.g., light from a white LED) from an environment whose color temperature (or actual color temperature) is B (e.g., 3000 (K)), a line (861) in a chart (860) represents a wavelength-wise distribution of light (e.g., light from a white LED) from an environment whose color temperature (or actual color temperature) is C (e.g., 4000 (K)), and a line (881) in a chart (880) represents a wavelength-wise distribution of light (e.g., light from a white LED) from an environment whose color temperature (or actual color temperature) is D (e.g., 5000 (K)).

[0085] For example, since at least one camera (203) includes a color filter having a Bayer pattern, a Tetra pattern, or a Nona pattern, a first sensitivity of at least one camera (203) for a green light component may be higher than a second sensitivity of at least one camera (203) for each of the other light components (e.g., a red light component and a blue light component). For example, when the color temperature (or actual color temperature) of the environment is C, the time for the color temperature measured using at least one camera (203) to converge may be shorter than the time for the color temperature measured using at least one camera (203) to converge when the color temperature (or actual color temperature) of the environment is A, B, or D, due to the first sensitivity being higher than the second sensitivity.

[0086] Referring again to FIG. 7, since the time for the color temperature measured using at least one camera (203) to converge varies depending on the distribution of the power spectrum of light from the environment (or the (actual) color temperature of the environment), the processor (201) may set a time for activating at least one camera (203) based at least in part on the different color temperatures. For example, the processor (201) may set a first time for activating at least one camera (203) to adjust the color temperature of the screen based on the different color temperatures within a first reference range, and may set a second time for activating at least one camera (203) to adjust the color temperature of the screen based on the different color temperatures within a second reference range that does not overlap with the first reference range.

[0087] As a non-limiting example, the electronic device (100) may store reference data including the first time defined for the different color temperature within the first reference range and the second time defined for the different color temperature within the second reference range in the non-volatile memory illustrated in the description of FIG. 2. For example, the processor (201) may identify a time corresponding to the different color temperature recognized in operation 701 from the reference data, and set the identified time as a time for activating at least one camera (203).

[0088] In operation 703, the processor (201) may activate at least one camera (203) for the time identified in operation 702 to adjust the color temperature of the screen.

[0089] For example, the processor (201) may activate at least one camera (203) for a first time period to adjust the color temperature of the screen based on the other color temperature within the first reference range. For example, the processor (201) may activate at least one camera (203) for a second time period to adjust the color temperature of the screen based on the other color temperature within the second reference range. For example, the processor (201) may set a timing for acquiring data about the color temperature of the environment based at least in part on the other color temperature.

[0090] As described above, the electronic device (100) can reduce power consumed to adjust the color temperature of the screen by setting a time for activating at least one camera (203) based on the different color temperatures.

[0091] Referring again to FIG. 4, at least one camera (203) may include a first camera and a second camera having an angle of view (AOV) different from that of the first camera. For example, the processor (201) may select, identify, or determine which camera is activated to adjust the color temperature of the screen, based at least in part on the brightness of the environment represented by the sensing data from the light sensor (204). Selecting a camera to be activated to adjust the color temperature of the screen is exemplified within the description of FIG. 9.

[0092] FIG. 9 is a flowchart illustrating an exemplary method for selecting a camera used to adjust the color temperature of a screen depending on the brightness of the environment.

[0093] Referring to FIG. 9, in operation 901, the processor (201) can check the brightness indicated by the sensing data acquired using the light sensor (204). For example, operation 901 may correspond to operation 501 of FIG. 5.

[0094] In operation 902, the processor (201) can select a camera corresponding to the brightness identified in operation 901 from among the first camera and the second camera.

[0095] For example, the angle of view of the first camera may be wider than the angle of view of the second camera. For example, the F-number of the first camera may be smaller than the F-number of the second camera. For example, the number of pixels of the image sensor in the first camera may be greater than the number of pixels of the image sensor in the second camera. For example, the power consumed per unit time by activating the first camera may be greater than the power consumed per unit time by activating the second camera due to the difference between the number of pixels of the image sensor in the first camera and the number of pixels of the image sensor in the second camera.

[0096] For example, the power consumed by activating the first camera to adjust the color temperature of the screen under the condition that the brightness is higher than the reference brightness (or constant brightness) may be greater than the power consumed by activating the second camera to adjust the color temperature of the screen under the condition that the brightness is higher than the reference brightness. For example, since the brightness being higher than the reference brightness (or constant brightness) indicates that a sufficient amount of light can be received through the second camera despite the F-number of the second camera being greater than the F-number of the first camera, the processor (201) may select the second camera among the first camera and the second camera as the camera for adjusting the color temperature of the screen under the condition that the brightness is higher than the reference brightness in order to reduce power consumption.

[0097] For another example, since the F-number of the first camera is smaller than the F-number of the second camera, the time it takes for the color temperature measured (or recognized) using the first camera to converge may be shorter than the time it takes for the color temperature measured (or recognized) using the second camera to converge. For example, since the brightness being lower than the reference brightness (or constant brightness) indicates that a sufficient amount of light cannot be received through the second camera due to the F-number of the second camera being larger than the F-number of the first camera, the processor (201) may select the first camera among the first camera and the second camera as the camera for adjusting the color temperature of the screen in order to reduce the time it takes to activate the camera under the condition that the brightness is lower than the reference brightness.

[0098] As described above, since activating the first camera to adjust the color temperature of the screen and activating the second camera to adjust the color temperature of the screen may vary depending on the brightness, the processor (201) may select the camera used to adjust the color temperature of the screen based at least in part on the brightness. For example, the selection may be performed based on the F-number of the camera. For example, the selection may be performed based on the angle of view of the camera.

[0099] For example, the processor (201) may select the first camera among the first camera and the second camera as the camera for adjusting the color temperature of the screen based on the brightness within the first reference range. For example, the processor (201) may select the second camera among the first camera and the second camera as the camera for adjusting the color temperature of the screen based on the brightness within a second reference range that does not overlap with the first reference range (e.g., a minimum brightness value of the second reference range is higher than a maximum brightness value of the first reference range).

[0100] In operation 903, the processor (201) may activate the camera selected in operation 902 to adjust the color temperature of the screen. For example, the processor (201) may activate the first camera among the first camera and the second camera to adjust the color temperature of the screen based on the brightness within the first reference range. For example, the processor (201) may activate the second camera among the first camera and the second camera to adjust the color temperature of the screen based on the brightness within the second reference range.

[0101] As described above, the electronic device (100) can reduce power consumed to adjust the color temperature of the screen by selecting a camera based on the brightness.

[0102] For example, the operations illustrated in the descriptions of FIGS. 5 to 9 may be combined with each other. A combination of the above operations is illustrated in the description of FIG. 10.

[0103] FIG. 10 is a flowchart illustrating an exemplary method of activating at least one camera to adjust the color temperature of a screen according to the color temperature of an environment, based on brightness and other color temperatures.

[0104] Referring to FIG. 10, in operation 1001, the processor (201) can check the brightness indicated by the sensing data acquired through the light sensor (204). For example, operation 1001 may correspond to operation 501 of FIG. 5 or operation 901 of FIG. 9.

[0105] In operation 1002, the processor (201) may activate the selected camera based on the brightness identified in operation 1001. For example, operation 1002 may correspond to operations 902 and 903 of FIG. 9.

[0106] In operation 1003, the processor (201) can recognize different color temperatures of the environment around the electronic device (100) by activating the camera selected in operation 1002. For example, operation 1003 may correspond to operation 701 of FIG. 7.

[0107] In operation 1004, the processor (201) may set a time for activating the camera selected in operation 1002 based on the different color temperature recognized in operation 1003 and the brightness confirmed in operation 1001. For example, the time may be set according to the methods exemplified in the description of operation 502 of FIG. 5 and operation 702 of FIG. 7.

[0108] In operation 1005, the processor (201) may activate the camera selected in operation 1002 for a period of time set in operation 1004 to adjust the color temperature of the screen.

[0109] As described above, the electronic device (100) can reduce power consumed to adjust the color temperature of the screen by selecting a camera based on the brightness and setting a time to activate the selected camera based on the brightness and the other color temperature.

[0110] The above-exemplified operations may be caused by the electronic device (1101) illustrated in the description of FIG. 11. For example, the electronic device (1101) may include the display module (1160) illustrated in the description of FIG. 12.

[0111] FIG. 11 is a block diagram of an electronic device (1101) within a network environment (1100) according to various embodiments. Referring to FIG. 11, in the network environment (1100), the electronic device (1101) may communicate with the electronic device (1102) via a first network (1198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1104) or the server (1108) via a second network (1199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1101) may communicate with the electronic device (1104) via the server (1108). According to one embodiment, the electronic device (1101) may include a processor (1120), a memory (1130), an input module (1150), an audio output module (1155), a display module (1160), an audio module (1170), a sensor module (1176), an interface (1177), a connection terminal (1178), a haptic module (1179), a camera module (1180), a power management module (1188), a battery (1189), a communication module (1190), a subscriber identification module (1196), or an antenna module (1197). In some embodiments, the electronic device (1101) may omit at least one of these components (e.g., the connection terminal (1178)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1176), camera module (1180), or antenna module (1197)) may be integrated into a single component (e.g., display module (1160)).

[0112] The processor (1120) may, for example, execute software (e.g., a program (1140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (1101) connected to the processor (1120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1120) may store commands or data received from other components (e.g., a sensor module (1176) or a communication module (1190)) in a volatile memory (1132), process the commands or data stored in the volatile memory (1132), and store result data in a non-volatile memory (1134). According to one embodiment, the processor (1120) may include a main processor (1121) (e.g., a central processing unit or an application processor) or an auxiliary processor (1123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1121). For example, when the electronic device (1101) includes the main processor (1121) and the auxiliary processor (1123), the auxiliary processor (1123) may be configured to use less power than the main processor (1121) or to be specialized for a given function. The auxiliary processor (1123) may be implemented separately from the main processor (1121) or as a part thereof.

[0113] The auxiliary processor (1123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (1160), a sensor module (1176), or a communication module (1190)) of the electronic device (1101), for example, on behalf of the main processor (1121) while the main processor (1121) is in an inactive (e.g., sleep) state, or together with the main processor (1121) while the main processor (1121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1180) or a communication module (1190)). In one embodiment, the auxiliary processor (1123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0114] The memory (1130) can store various data used by at least one component (e.g., the processor (1120) or the sensor module (1176)) of the electronic device (1101). The data can include, for example, software (e.g., the program (1140)) and input data or output data for commands related thereto. The memory (1130) can include a volatile memory (1132) or a non-volatile memory (1134).

[0115] The program (1140) may be stored as software in memory (1130) and may include, for example, an operating system (1142), middleware (1144), or an application (1146).

[0116] The input module (1150) can receive commands or data to be used in a component of the electronic device (1101) (e.g., a processor (1120)) from an external source (e.g., a user) of the electronic device (1101). The input module (1150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0117] The audio output module (1155) can output audio signals to the outside of the electronic device (1101). The audio output module (1155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0118] The display module (1160) can visually provide information to an external party (e.g., a user) of the electronic device (1101). The display module (1160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0119] The audio module (1170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1170) can acquire sound through the input module (1150), output sound through the sound output module (1155), or an external electronic device (e.g., electronic device (1102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1101).

[0120] The sensor module (1176) can detect the operating status (e.g., power or temperature) of the electronic device (1101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0121] The interface (1177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1101) with an external electronic device (e.g., the electronic device (1102)). In one embodiment, the interface (1177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0122] The connection terminal (1178) may include a connector through which the electronic device (1101) may be physically connected to an external electronic device (e.g., the electronic device (1102)). In one embodiment, the connection terminal (1178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0123] The haptic module (1179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1179) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0124] The camera module (1180) can capture still images and videos. In one embodiment, the camera module (1180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0125] The power management module (1188) can manage the power supplied to the electronic device (1101). According to one embodiment, the power management module (1188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0126] A battery (1189) may power at least one component of the electronic device (1101). In one embodiment, the battery (1189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0127] The communication module (1190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1101) and an external electronic device (e.g., electronic device (1102), electronic device (1104), or server (1108)), and the performance of communication through the established communication channel. The communication module (1190) may operate independently from the processor (1120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1190) may include a wireless communication module (1192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1194) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1104) via a first network (1198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1192) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1196) to verify or authenticate the electronic device (1101) within a communication network such as the first network (1198) or the second network (1199).

[0128] The wireless communication module (1192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1192) may support various requirements specified in the electronic device (1101), an external electronic device (e.g., the electronic device (1104)), or a network system (e.g., the second network (1199)). According to one embodiment, the wireless communication module (1192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0129] The antenna module (1197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1198) or the second network (1199), may be selected from the plurality of antennas by, for example, the communication module (1190). A signal or power may be transmitted or received between the communication module (1190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1197).

[0130] According to various embodiments, the antenna module (1197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0131] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0132] According to one embodiment, commands or data may be transmitted or received between the electronic device (1101) and an external electronic device (1104) via a server (1108) connected to a second network (1199). Each of the external electronic devices (1102 or 1104) may be the same or a different type of device as the electronic device (1101). According to one embodiment, all or part of the operations executed in the electronic device (1101) may be executed in one or more of the external electronic devices (1102, 1104, or 1108). For example, when the electronic device (1101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1101). The electronic device (1101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (1104) may include an Internet of Things (IoT) device. The server (1108) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1104) or server (1108) may be included within the second network (1199). The electronic device (1101) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0133] FIG. 12 is a block diagram (1200) of a display module (1160) according to various embodiments.

[0134] Referring to FIG. 12, the display module (1160) may include a display (1210) and a display driver IC (DDI) (1230) for controlling the display (1210). The DDI (1230) may include an interface module (1231), a memory (1233) (e.g., a buffer memory), an image processing module (1235), or a mapping module (1237). The DDI (1230) may receive, for example, image information including image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device (1101) through the interface module (1231). For example, according to one embodiment, image information may be received from a processor (1120) (e.g., a main processor (1121) (e.g., an application processor) or an auxiliary processor (1123) (e.g., a graphics processing unit) that operates independently of the function of the main processor (1121). The DDI (1230) may communicate with a touch circuit (1250) or a sensor module (1176) through the interface module (1231). In addition, the DDI (1230) may store at least a part of the received image information in the memory (1233), for example, in units of frames. The image processing module (1235) may, for example, perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a part of the image data based on at least a characteristic of the image data or a characteristic of the display (1210). The mapping module (1237) may output a voltage value or a value corresponding to the image data preprocessed or postprocessed through the image processing module (1235). A current value can be generated. In one embodiment, the generation of the voltage value or current value can be performed at least in part based on the properties of the pixels of the display (1210), for example, the arrangement of the pixels (e.g., an RGB stripe or pentile structure), or the size of each sub-pixel.At least some pixels of the display (1210) may be driven based at least in part on, for example, the voltage value or current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed through the display (1210).

[0135] According to one embodiment, the display module (1160) may further include a touch circuit (1250). The touch circuit (1250) may include a touch sensor (1251) and a touch sensor IC (1253) for controlling the touch sensor (1251). The touch sensor IC (1253) may control the touch sensor (1251) to detect, for example, a touch input or a hovering input for a specific location of the display (1210). For example, the touch sensor IC (1253) may detect a touch input or a hovering input by measuring a change in a signal (e.g., voltage, light quantity, resistance, or charge quantity) for a specific location of the display (1210). The touch sensor IC (1253) may provide information (e.g., location, area, pressure, or time) regarding the detected touch input or hovering input to the processor (1120). According to one embodiment, at least a portion of the touch circuit (1250) (e.g., touch sensor IC (1253)) may be included as part of the display driver IC (1230), or as part of the display (1210), or as part of another component (e.g., auxiliary processor (1123)) disposed external to the display module (1160).

[0136] According to one embodiment, the display module (1160) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (1176), or a control circuit therefor. In this case, the at least one sensor or the control circuit therefor may be embedded in a part of the display module (1160) (e.g., the display (1210) or the DDI (1230)) or a part of the touch circuit (1250). For example, when the sensor module (1176) embedded in the display module (1160) includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) associated with a touch input through a part of the display (1210). For another example, if the sensor module (1176) embedded in the display module (1160) includes a pressure sensor, the pressure sensor may obtain pressure information associated with a touch input through a portion or the entire area of ​​the display (1210). According to one embodiment, the touch sensor (1251) or the sensor module (1176) may be disposed between pixels of a pixel layer of the display (1210), or above or below the pixel layer.

[0137] As described above, an electronic device (e.g., electronic device (100)) may include a memory (e.g., memory (202)) configured to store instructions, at least one camera (e.g., at least one camera (203)), an illumination sensor (e.g., illumination sensor (204)), a display (e.g., display (120)), and a processor (e.g., processor (201)). The processor may be configured to execute the instructions to cause the electronic device to determine a level of change in brightness of an environment around the electronic device based on sensing data acquired using the light sensor while a screen is displayed on the display and the at least one camera is deactivated, to keep the at least one camera deactivated based on the level being lower than a reference level, and to activate the at least one camera based on the level being higher than or equal to the reference level and to adjust a color temperature of the screen displayed on the display according to a color temperature of the environment recognized using the activated at least one camera.

[0138] For example, the light sensor may be located below the active area of ​​the display.

[0139] For example, the at least one camera may be oriented in the direction in which the display faces.

[0140] For example, the processor may be configured to execute the instructions to cause the electronic device to determine whether the level is lower than the reference level while the screen is displayed on the display and the at least one camera is deactivated.

[0141] For example, the processor may be configured to execute the instructions to cause the electronic device to set a time to activate the at least one camera to adjust the color temperature of the screen according to the color temperature of the environment, based at least in part on the brightness represented by the sensing data.

[0142] For example, the processor may be configured to execute the instructions to cause the electronic device to: determine the brightness represented by the sensing data; activate the at least one camera for a first time to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within a first reference range; and activate the at least one camera for a second time different from the first time to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within a second reference range that does not overlap with the first reference range.

[0143] For example, the processor may be configured to execute the instructions to cause the electronic device to recognize another color temperature of the environment using the at least one activated camera before the color temperature of the environment used to adjust the color temperature of the screen is recognized, and to set a time for activating the at least one camera to recognize the color temperature of the environment, based at least in part on the other color temperature.

[0144] For example, the processor may be configured to execute the instructions to cause the electronic device to recognize another color temperature of the environment using the at least one activated camera before the color temperature of the environment used to adjust the color temperature of the screen is recognized, activate the at least one camera for a first time to adjust the color temperature of the screen according to the color temperature of the environment based on the other color temperature within a first reference range, and activate the at least one camera for a second time different from the first time to adjust the color temperature of the screen according to the color temperature of the environment based on the other color temperature within a second reference range that does not overlap with the first reference range.

[0145] For example, the at least one camera may include a first camera and a second camera having an angle of view (AOV) different from that of the first camera. For example, the processor may be configured to execute the instructions to cause the electronic device to select a camera among the first camera and the second camera to be activated to adjust the color temperature of the screen according to the color temperature of the environment, based at least in part on the brightness indicated by the sensing data.

[0146] For example, the processor may be configured to execute the instructions to cause the electronic device to check the brightness represented by the sensing data, activate the first camera among the first camera and the second camera to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within a first reference range, and activate the second camera among the first camera and the second camera to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within a second reference range that does not overlap with the first reference range.

[0147] For example, the color temperature of the environment can be recognized by a component of at least one camera used for AWB (auto white balance) and a component of the processor.

[0148] For example, the processor may be configured to execute the instructions to cause the electronic device to set a timing for acquiring data about the color temperature of the environment based at least in part on the brightness represented by the sensing data.

[0149] For example, the processor may be configured to execute the instructions to cause the electronic device to recognize another color temperature of the environment using the at least one activated camera before the color temperature of the environment used to adjust the color temperature of the screen is recognized, and to set a timing for acquiring data about the color temperature of the environment based at least in part on the other color temperature.

[0150] As described above, a method can be executed in an electronic device having at least one camera, an illumination sensor, and a display. The method can include: while a screen is displayed on the display and the at least one camera is deactivated, determining a level of change in brightness of an environment around the electronic device based on sensed data acquired using the illumination sensor; maintaining the at least one camera deactivated based on the level being lower than a reference level; and activating the at least one camera based on the level being higher than or equal to the reference level and adjusting a color temperature of the screen displayed on the display based on a color temperature of the environment recognized using the activated at least one camera.

[0151] For example, the method may include an action of determining whether the level is lower than the reference level while the screen is displayed on the display and the at least one camera is deactivated.

[0152] For example, the method may include setting a time for activating the at least one camera to adjust the color temperature of the screen according to the color temperature of the environment, based at least in part on the brightness represented by the sensing data.

[0153] For example, the method may include an operation of recognizing another color temperature of the environment using the at least one activated camera before the color temperature of the environment is recognized, which is used to adjust the color temperature of the screen, and an operation of setting a time for activating the at least one camera to recognize the color temperature of the environment, based at least in part on the other color temperature.

[0154] For example, the method may include an action of setting a timing for acquiring data about the color temperature of the environment based at least in part on the brightness represented by the sensing data.

[0155] For example, the method may include, before the color temperature of the environment is recognized, using the at least one activated camera to adjust the color temperature of the screen, recognizing another color temperature of the environment, and setting a timing for acquiring data about the color temperature of the environment based at least in part on the other color temperature.

[0156] As described above, the non-transitory computer-readable storage medium may store one or more programs. For example, the one or more programs may include instructions that, when executed by an electronic device having at least one camera, an illumination sensor, and a display, cause the electronic device to determine a level of change in brightness of an environment around the electronic device based on sensed data acquired using the illumination sensor while a screen is displayed on the display and the at least one camera is deactivated, and to maintain deactivation of the at least one camera based on the level being lower than a reference level, and to activate the at least one camera based on the level being higher than or equal to the reference level, and to adjust a color temperature of the screen displayed on the display according to a color temperature of the environment recognized using the activated at least one camera.

[0157] The technical tasks to be achieved in this document are not limited to the technical tasks mentioned above, and other technical tasks not mentioned will be clearly understood by those with ordinary knowledge in the technical field to which this document pertains.

[0158] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.

[0159] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0160] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0161] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0162] Various embodiments of the present document may be implemented as software (e.g., a program (1140)) including one or more instructions stored in a storage medium (e.g., an internal memory (1136) or an external memory (1138)) readable by a machine (e.g., an electronic device (1101)). For example, a processor (e.g., a processor (1120)) of the machine (e.g., an electronic device (1101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0163] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0164] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, A memory that stores instructions and includes one or more storage media; At least one camera; light sensor; display; and comprising at least one processor including a processing circuit; When executed individually or collectively by at least one processor, the instructions: While the screen is displayed on the display and the at least one camera is deactivated, the level of change in brightness of the environment around the electronic device is determined based on sensing data acquired using the light sensor, based on said level being lower than the reference level, maintaining said at least one camera disabled, and Based on the above level being higher than or equal to the above reference level: Activating at least one camera; and Adjust the color temperature of the screen displayed on the display according to the color temperature of the environment recognized using at least one of the activated cameras. causing said electronic device, Electronic devices.

2. In claim 1, the light sensor, located below the active area of ​​the above display, Electronic devices.

3. In claim 1, at least one camera, Facing the direction in which the above display is facing, Electronic devices.

4. In claim 1, when individually or collectively executed by at least one processor, the instructions: While the above screen is displayed on the above display and the at least one camera is deactivated, to determine whether the level is lower than the reference level; To execute said instructions to cause said electronic device to do so; More structured, Electronic devices.

5. In claim 1, when individually or collectively executed by said at least one processor, said instructions: Setting a time for activating said at least one camera to adjust said color temperature of said screen according to said color temperature of said environment, based at least in part on said brightness represented by said sensing data; causing said electronic device, Electronic devices.

6. In claim 1, when individually or collectively executed by at least one processor, the instructions: Check the brightness indicated by the above sensing data, Activating said at least one camera for a first time to adjust said color temperature of said screen according to said color temperature of said environment, based on said brightness within said first reference range; To activate the at least one camera for a second time different from the first time to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within the second reference range that does not overlap with the first reference range; causing said electronic device, Electronic devices.

7. In claim 1, when individually or collectively executed by said at least one processor, said instructions: Before the color temperature of the environment is recognized, which is used to adjust the color temperature of the screen, another color temperature of the environment is recognized using at least one activated camera, Setting a time for activating said at least one camera to recognize said color temperature of said environment, based at least in part on said other color temperature; causing said electronic device, Electronic devices.

8. In claim 1, when individually or collectively executed by said at least one processor, said instructions: Before the color temperature of the environment is recognized, which is used to adjust the color temperature of the screen, another color temperature of the environment is recognized using at least one activated camera, Activating said at least one camera for a first time to adjust said color temperature of said screen according to said color temperature of said environment, based on said other color temperature within said first reference range; Based on the other color temperature within the second reference range that does not overlap with the first reference range, activate the at least one camera for a second time different from the first time to adjust the color temperature of the screen according to the color temperature of the environment. causing said electronic device, Electronic devices.

9. In claim 1, at least one camera, It comprises a first camera and a second camera having a different angle of view from that of the first camera, When executed individually or collectively by at least one processor, the instructions: Selecting a camera among the first camera and the second camera to be activated to adjust the color temperature of the screen according to the color temperature of the environment, based at least in part on the brightness represented by the sensing data; causing said electronic device, Electronic devices.

10. In claim 1, the at least one camera, It comprises a first camera and a second camera having a different angle of view from that of the first camera, When executed individually or collectively by at least one processor, the instructions: Check the brightness indicated by the above sensing data, Based on the brightness within the first reference range, activating the first camera among the first camera and the second camera to adjust the color temperature of the screen according to the color temperature of the environment; To activate the second camera among the first camera and the second camera to adjust the color temperature of the screen according to the color temperature of the environment based on the brightness within the second reference range that does not overlap with the first reference range. causing said electronic device, Electronic devices.

11. In claim 1, the color temperature of the environment is Recognized by a component of at least one camera used for AWB (auto white balance) and a component of the processor, Electronic devices.

12. In claim 1, when individually or collectively executed by said at least one processor, said instructions: Setting the timing for acquiring data on the color temperature of the environment based at least in part on the brightness represented by the sensing data; causing said electronic device, Electronic devices.

13. In claim 1, when individually or collectively executed by said at least one processor, said instructions: Before the color temperature of the environment is recognized, which is used to adjust the color temperature of the screen, another color temperature of the environment is recognized using at least one activated camera, To set the timing for acquiring data about said color temperature of said environment, based at least in part on said other color temperature; causing said electronic device, Electronic devices.

14. A method implemented in an electronic device having at least one camera, a light sensor, and a display, An operation of determining a level of change in brightness of an environment around the electronic device based on sensing data acquired using the light sensor while the screen is displayed on the display and the at least one camera is deactivated; An action to keep said at least one camera disabled based on said level being lower than the reference level, and Based on the above level being higher than or equal to the above reference level: an action of activating at least one camera; and An operation of adjusting the color temperature of the screen displayed on the display according to the color temperature of the environment recognized using at least one activated camera, method.

15. In a non-transitory computer-readable storage medium storing one or more programs, said one or more programs: When executed by an electronic device having at least one camera, a light sensor, and a display, While the screen is displayed on the display and the at least one camera is deactivated, the level of change in brightness of the environment around the electronic device is determined based on sensing data acquired using the light sensor, based on said level being lower than the reference level, maintaining said at least one camera disabled, and Based on the above level being higher than or equal to the above reference level: Activating at least one camera; and Adjust the color temperature of the screen displayed on the display according to the color temperature of the environment recognized using at least one of the activated cameras. comprising instructions causing said electronic device to operate; A non-transitory computer-readable storage medium.

Citation Information

Patent Citations

  • Display device, control method of display device, and control program of display device

    JP2014216963A

  • Mobile phone with camera

    JP3788426B2

  • COLOR CONTROL METHOD, COMMUNICATION DEVICE, COMPUTER-READABLE PROGRAM AND STORAGE MEDIUM

    JP5958538B2

  • Electronic Device which operates a plurality of cameras based on Outside illuminance

    KR102544709B1

  • Image display device

    US20170169749A1