Electronic device and operation method therefor

Abstract

According to one aspect of the present disclosure, a method for operating an electronic device may comprise a step of obtaining reference environment information. The method may comprise a step of obtaining user environment information. The method may comprise a step of determining whether to apply calibration to an input image. The method may comprise a step of acquiring a first dithered image obtained by performing first dithering on the input image or a second dithered image obtained by performing second dithering applying calibration to the input image. The method may comprise a step of outputting one of the first dithered image or the second dithered image.

Description

Electronic device and method of operation thereof

[0001] The present disclosure relates to an electronic device for performing dithering and a method of operating the same.

[0002] Users may use electronic devices in various environments. Visibility can vary significantly depending on changes in the environment in which the device is used. Various factors, such as different lighting conditions, can affect the user experience. For example, under strong external lighting, the visibility of electronic devices may decrease due to the influence of the lighting. This degrades the user experience and causes discomfort.

[0003] Accordingly, technological development is necessary to enable electronic devices to maintain optimal visibility in various environments. If visibility can be maintained in diverse environments, a better user experience can be provided.

[0004] According to one aspect of the present disclosure, a method for operating an electronic device is provided. The method may include the step of obtaining reference environment information that serves as a reference for performing a first dithering on an input image. The method may include the step of obtaining user environment information that includes at least one of a color temperature value or a brightness value measured in a user environment where the electronic device is located. The method may include the step of comparing the user environment information and the reference environment information to determine whether to apply calibration to the input image so that the image shown in the user environment is shown in the color of the image shown in the reference environment. Based on whether to apply calibration, the method may include the step of obtaining a first dithered image obtained by performing the first dithering on the input image or a second dithered image obtained by performing the second dithering to apply the calibration on the input image. The method may include the step of outputting one of the first dithered image or the second dithered image.

[0005] According to one aspect of the present disclosure, an electronic device is provided. The electronic device comprises at least one processor including processing circuitry; a memory for storing instructions; and a display, wherein the instructions may be executed individually or collectively by the at least one processor. The electronic device may acquire reference environment information that serves as a reference for performing a first dithering on an input image. The electronic device may acquire user environment information including at least one of a color temperature value or a brightness value measured in a user environment where the electronic device is located. The electronic device may compare the user environment information and the reference environment information to determine whether to apply calibration to the input image so that the image shown in the user environment is displayed in the color of the image shown in the reference environment. The electronic device may acquire a first dithered image obtained by performing the first dithering on the input image or a second dithered image obtained by performing the second dithering to apply the calibration on the input image, based on whether the calibration is applied. The electronic device may output one of the first dithered image or the second dithered image.

[0006] According to one aspect of the present disclosure, a computer-readable recording medium may be provided having a program recorded thereon for operating an electronic device and / or any one of the methods described above and below.

[0007] FIG. 1a is a diagram schematically illustrating the operation of an electronic device according to one embodiment of the present disclosure to calibrate the distortion of an image output by the electronic device according to a user environment.

[0008] FIG. 1b is a diagram schematically illustrating the operation of an electronic device according to one embodiment of the present disclosure to calibrate zone-specific distortion of an image output by the electronic device according to a user environment zone.

[0009] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0010] FIG. 3 is a flowchart illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure to calibrate distortion of the electronic device according to a user environment.

[0011] FIG. 4 is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure performing a first dithering on an input image.

[0012] FIG. 5 is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure to calibrate distortion of the electronic device according to the user environment.

[0013] FIG. 6 is a diagram illustrating, by way of example, an operation in which an electronic device according to one embodiment of the present disclosure performs a second dithering on an input image.

[0014] FIG. 7a is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure performing a second dithering using a color temperature level table.

[0015] FIG. 7b is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure performing a second dithering using a brightness level table.

[0016] FIG. 8 is a drawing for exemplarily illustrating the operation of combining electronic ink particles in an electronic device according to one embodiment of the present disclosure.

[0017] FIG. 9 is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure to calibrate distortion of the electronic device according to the user environment.

[0018] FIG. 10 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0019] The terms used in this specification will be briefly explained, and the present disclosure will be described in detail. In the present disclosure, the expression "at least one of a, b, or c" may refer to "a," "b," "c," "a and b," "a and c," "b and c," "all of a, b, and c," or variations thereof.

[0020] The terms used in this disclosure have been selected to be as widely used and general as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant explanatory sections. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.

[0021] Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art as described in this specification. Additionally, terms including ordinal numbers, such as "first" or "second," used in this specification may be used to describe various components, but said components should not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another.

[0022] When a part of a specification is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components. Furthermore, terms such as "part" or "module" as used in the specification refer to a unit that processes at least one function or operation, and this may be implemented in hardware or software, or as a combination of hardware and software.

[0023] All functions or operations described in this document may be processed by a single processor or a combination of processors. A single processor or a combination of processors is a circuitry that performs processing and may include circuitry such as an AP (Application Processor), CP (Communication Processor), GPU (Graphical Processing Unit), NPU (Neural Processing Unit), MPU (Microprocessor Unit), SoC (System on Chip), IC (Integrated Chip), etc.

[0024] The embodiments of the present disclosure relate to a method and an electronic device for performing dithering. Before describing specific embodiments, the meanings of terms frequently used in the present disclosure are defined.

[0025] In the present disclosure, the user environment may refer to an environment outside the electronic device where the electronic device is located. The environment in which the electronic device is located may include elements that can affect the visibility of the electronic device. The visibility of the electronic device may refer to a state in which the electronic device or the output of the electronic device can be visually perceived.

[0026] For example, the user environment may include the lighting environment of the surrounding space where the electronic device is located. More specifically, the user environment may include elements such as color temperature or brightness that may affect the visibility of the electronic device, but is not limited to the examples described above.

[0027] In the present disclosure, dithering is a method of expressing various colors in an image or video using a limited number of colors. For example, an electronic device may display a first color and a second color at adjacent positions. An operation to perform dithering may include an operation to express colors as if the first color and the second color are mixed together overall. To perform dithering, the electronic device may add a plurality of colors in the form of noise to the image or video.

[0028] In the present disclosure, color may refer to a combination of various visually perceptible hue and brightness. In the present disclosure, color temperature is a numerical representation of the color of a light source using absolute temperature.

[0029] According to one embodiment of the present disclosure, when the color expression that a display can output is limited, dithering can be performed to express various colors through the limited colors. For example, when an electronic device performs dithering to output an image on a display with low color depth, the limited colors may appear to be harmoniously mixed. Additionally, for example, to display an image on a 4-color e-Paper display, the electronic device performs dithering to produce four or more colors.

[0030] Embodiments of the present disclosure are described below with reference to the attached drawings so that those skilled in the art can easily implement the invention. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0031] The present disclosure will be described below with reference to the attached drawings.

[0032] FIG. 1a is a diagram schematically illustrating the operation of an electronic device according to one embodiment of the present disclosure to calibrate the distortion of an image output by the electronic device according to a user environment.

[0033] According to one embodiment of the present disclosure, an electronic device (2000) can output an image (10). The electronic device (2000) can output the image (10) so that the intended color is expressed in a reference environment (110). Additionally, for example, the electronic device (2000) can output the image (10) so that the intended color is expressed at the color temperature of the reference environment (110). That is, since the image (10) has a color that can be expressed at the color temperature of the reference environment (110), if the color temperature changes, the image (10) may not appear as intended and may appear differently. For example, the electronic device (2000) can output the image (10) so that the intended color is expressed at the brightness of the reference environment (110). That is, since the image (10) has a color that can be expressed at the brightness of the reference environment (110), if the brightness changes, the image (10) may not appear as intended and may appear differently.

[0034] According to one embodiment of the present disclosure, the electronic device (2000) may be a display that does not include a backlight unit (BLU). For example, the electronic device (2000) may be a reflective display such as electronic paper. A display that does not include a backlight unit may display an image by reflecting light or illumination from the surrounding environment. Therefore, a display that does not include a backlight unit may be affected by external lighting. For example, when the surrounding environment is bright, the screen of the display may appear bright. When the surrounding environment is dark, the screen of the display may appear dark. Therefore, when the electronic device (2000) is placed in a user environment (120) different from the reference environment (110), the image (12) output by the electronic device (2000) may be seen differently from the image (10) output by the electronic device (2000) in the reference environment (110). Referring to FIG. 1, the surrounding user environment (120) where the electronic device (2000) is located may include, for example, a red light (20). When the electronic device (2000) displays an image, it may reflect red light from the red light (20). Due to the red light (20), the visibility of the electronic device (2000) or the visibility of the image (12) output by the electronic device (2000) may be reduced. Due to the red light (20), the image (12) output by the electronic device (2000) may appear distorted, unlike the originally intended image (10). For example, the image (12) output by the electronic device (2000) may appear redder than the originally intended image (10) due to the influence of the red light (20). Therefore, it may be desirable to perform image processing so that even if the electronic device (2000) is placed in a user environment (120) different from the reference environment (110), it can be seen as the image (10) intended in the reference environment (110).

[0035] According to one embodiment of the present disclosure, an electronic device (2000) may perform calibration (130) on an image (10) to prevent the image from appearing distorted due to a user environment (120). For example, the electronic device (2000) may provide an effect as if the intended image were being displayed in a reference environment (110) by outputting an image (14) that cancels out distortion even in a user environment (120) including red lighting (20). The electronic device (2000) may perform calibration (130) to minimize the influence of the external environment on the electronic device (2000).

[0036] According to one embodiment of the present disclosure, an electronic device (2000) can perform calibration (130) on an image so that the color perceived by the user for an image (14) output in a user environment (120) becomes identical or similar to the color perceived by the user for an image (10) output in a reference environment, or so that the difference cannot be perceived. That is, the electronic device (2000) can perform calibration (130) on an image so that the color perceived by the user for an image displayed in the current user environment becomes similar to the color perceived by the user for an image when displayed in a reference environment.

[0037] FIG. 1b is a diagram schematically illustrating the operation of an electronic device according to one embodiment of the present disclosure to calibrate zone-specific distortion of an image output by the electronic device according to a user environment zone.

[0038] In the present disclosure, a user environment zone may refer to a spatially or positionally separated range within a user environment for measuring factors that may affect the visibility of an electronic device, such as the color temperature or brightness of the user environment.

[0039] Referring to FIG. 1b, the user environment (120) may be divided into multiple zones. For example, in order to measure elements such as color temperature or brightness of the user environment (120), the user environment (120) may be divided into a first user environment zone (120a), a second user environment zone (120b), a third user environment zone (120c), and a fourth user environment zone (120d).

[0040] According to one embodiment of the present disclosure, the surrounding user environment (120) where the electronic device (2000) is located may include, for example, a plurality of lights (20, 22, 24). Since there may be differences in the color temperature or brightness of the light emitted from each light, the color temperature or brightness may vary depending on the user environment area.

[0041] In the present disclosure, an image zone may refer to a part of an image that is affected by a zone of the user environment. For example, an image zone may be determined according to a zone of the user environment. An image zone may be divided into multiple zones, and each zone may not overlap.

[0042] Referring to FIG. 1b, the image (12) output by the electronic device (2000) can be divided into multiple regions. For example, the image (12) output by the electronic device (2000) can be divided into a first image region (12a), a second image region (12b), a third image region (12c), and a fourth image region (12d).

[0043] According to one embodiment of the present disclosure, image zones may be divided according to user environment zones that affect the visibility of each part of an image (12) output by an electronic device (2000). For example, a first image zone (12a) may be a part of the image (12) affected by a first user environment zone (120a). A second image zone (12b) may be a part of the image (12) affected by a second user environment zone (120b). A third image zone (12c) may be a part of the image (12) affected by a third user environment zone (120c). A fourth image zone (12d) may be a part of the image (12) affected by a fourth user environment zone (120d).

[0044] According to one embodiment of the present disclosure, an electronic device (2000) may perform zone-specific calibration (130) on an image (10) to prevent each area (12a-12d) of the image from appearing distorted due to each user environment area (120a-120d). For example, the electronic device (2000) may provide an effect as if the intended image were being displayed in a reference environment (110) by outputting an image (14) that offsets distortions according to a plurality of user environment areas (120a-120d). The electronic device (2000) may perform calibration (130) to minimize the influence of the external environment on the electronic device (2000).

[0045] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0046] According to one embodiment of the present disclosure, the electronic device (2000) may include at least one processor (2100), memory (2200), and display (2300).

[0047] According to one embodiment of the present disclosure, the electronic device (2000) may include devices of a type that include a display (2300). For example, the electronic device (2000) may include electronic paper (e-Paper), electrophoretic display (EPD), electronic book reader (e-Book reader), TV, smart monitor, tablet PC, laptop PC, digital signage, large display, etc., that include a display (2300), but is not limited thereto.

[0048] Additionally, according to one embodiment of the present disclosure, the electronic device (2000) may include various types of devices that can be connected to a display. For example, the electronic device (2000) may include a set-top box, a desktop PC, etc. that can be connected to a display existing externally without including a display (2300) internally, but is not limited thereto.

[0049] A display (2300) according to one embodiment of the present disclosure may be a type of display that does not include a backlight unit (BLU). For example, the display (2300) may be a reflective display that operates by utilizing external light without a separate light source. A backlight unit may refer to a unit that evenly illuminates light so that the display screen can be lit. If the display (2300) does not include a backlight unit, the power consumed by the electronic device including the display (2300) may be reduced.

[0050] According to one embodiment of the present disclosure, the display (2300) may be a display with a limited number of colors that can be expressed. For example, the display (2300) may express a limited number of gradation steps. According to one embodiment of the present disclosure, the display (2300) may have relatively fewer gradation steps compared to an emitting display. Gradation may refer to the stepwise expression of gradual changes through differences in brightness in a display. That is, it may represent the degree of expression in which the density from the brightest part to the darkest part of the display is divided sequentially.

[0051] Additionally, for example, the display (2300) may express a limited color depth. According to one embodiment of the present disclosure, the display (2300) may have a relatively smaller color depth compared to an emitting display. Color depth may refer to a numerical value indicating the number of colors that the display can express.

[0052] The processor (2100) can control the overall operations of the electronic device (2000). The processor (2100) may include a processing circuit. For example, the processor (2100) can control the overall operations of the electronic device (2000) calibrating distortion according to the user environment by executing one or more instructions of a program stored in memory (2200). There may be one or more processors (2100).

[0053] The processor (2100) may be composed of at least one of, for example, a Central Processing Unit (CPU), a Microprocessor, a Graphic Processing Unit (GPU), ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), an Application Processor (AP), a Neural Processing Unit (NPU), or an AI-dedicated processor designed with a hardware structure specialized for processing AI models, but is not limited thereto.

[0054] According to one embodiment of the present disclosure, there may be one or more processors (2100). If there is one or more processors (2100), the operations of the present disclosure may be performed by one or more processors by executing instructions and / or programs stored in memory (2200) individually or collectively. If the method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor (2100) or by a plurality of processors (2100).

[0055] One or more processors according to the present disclosure may be implemented as a single-core processor or as a multi-core processor. When a method according to one embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single core or by a plurality of cores included in one or more processors.

[0056] For example, when the first, second, and third operations are performed by a method according to one embodiment, the first, second, and third operations may all be performed by a first processor, or some of the first to third operations may be performed by a first processor (e.g., a general-purpose processor) and the remaining operations may be performed by a second processor (e.g., an AI-dedicated processor). Here, operations for training / inference of an AI model may be performed by an AI-dedicated processor, which is an example of a second processor. However, the embodiments of the present disclosure are not limited thereto.

[0057] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can obtain reference environment information that serves as a reference for performing a first dithering on an input image.

[0058] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can obtain user environment information including at least one of a color temperature value or a brightness value measured in the user environment where the electronic device (2000) is located.

[0059] According to one embodiment of the present disclosure, by executing instructions included in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can compare the user environment information and the reference environment information to determine whether to apply calibration to the input image so that the image shown in the user environment is shown in the color of the image shown in the reference environment.

[0060] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can obtain a first dithered image in which the first dithering is performed on the input image or a second dithered image in which the second dithering is performed to apply the calibration to the input image, based on whether the calibration is applied.

[0061] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can output one of the first dithered image or the second dithered image.

[0062] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can obtain a first dithered image in which a first dithering is performed on an input image based on the determination not to apply calibration.

[0063] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can obtain a second dithered image (50) in which a second dithering is performed to apply calibration to an input image based on a determination to apply calibration.

[0064] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can measure the color temperature of the user environment where the electronic device (2000) is located using a color sensor.

[0065] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can measure the brightness of the user environment where the electronic device (2000) is located using a brightness sensor.

[0066] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can receive at least one of a color temperature value or a brightness value measured in a user environment where the electronic device (2000) is located from an external device.

[0067] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can monitor at least one of the color temperature value or brightness value of the user environment where the electronic device (2000) is located in real time.

[0068] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can calculate the difference between the color temperature value of the reference environment information and the color temperature value measured in the user environment.

[0069] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) may determine to apply the calibration that compensates for the difference in the calculated color temperature values ​​based on the difference in the calculated color temperature values ​​being greater than or equal to a threshold value.

[0070] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can calculate the difference between the color temperature value of the reference environment information and the color temperature value measured in each zone of the user environment.

[0071] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) may determine to apply the calibration that compensates for the difference in the calculated color temperature value to each area of ​​the input image corresponding to each area of ​​the user environment, based on the difference in the calculated color temperature value being greater than or equal to a threshold value.

[0072] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can calculate the difference between the brightness value of the reference environment information and the brightness value measured in the user environment.

[0073] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) may determine to apply the calibration that compensates for the difference in the calculated brightness value when the difference in the calculated brightness value is greater than or equal to a threshold value.

[0074] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can calculate the difference between the brightness value of the reference environment information and the brightness value measured in each zone of the user environment.

[0075] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) may determine to apply the calibration that compensates for the difference in the calculated brightness value to each area of ​​the input image corresponding to each area of ​​the user environment, based on the difference in the calculated brightness value being greater than or equal to a threshold value.

[0076] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can identify a color required for compensating for at least one difference between a color temperature value or a brightness value in the reference environment and the user environment, based on what is determined to apply the calibration.

[0077] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can combine electronic ink particles of the electronic device (2000) to produce the identified color.

[0078] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can perform the second dithering, which performs the difference compensation using the combined electronic ink particles, on the input image.

[0079] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can determine a weight for the color temperature based on the magnitude of the color temperature required for the difference compensation.

[0080] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can determine a weight for the brightness based on the magnitude of the brightness required for the difference compensation.

[0081] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can combine the electronic ink particles to preferentially compensate the element with the higher weight among the color temperature or the brightness, based on the weight for the determined color temperature and the weight for the determined brightness.

[0082] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can identify a flat region in the input image based on what is determined to apply the calibration.

[0083] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can perform the second dithering that applies the calibration to the identified flat surface.

[0084] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can display the first dithered image based on the determination not to apply the calibration.

[0085] According to one embodiment of the present disclosure, by executing instructions contained in memory (2200) individually or collectively by at least one processor (2100), the electronic device (2000) can display the second dithered image based on the determination to apply the calibration.

[0086] The memory (2200) stores various information, data, instructions, programs, etc., necessary for the operation of the electronic device (2000). The memory (2200) may include at least one of volatile memory or non-volatile memory, or a combination thereof. The memory (2200) may include at least one type of storage medium among flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk. Additionally, the memory (2200) may correspond to a web storage or cloud server that performs storage functions over the internet.

[0087] The memory (2200) may store one or more instructions and one or more programs that allow the electronic device (2000) to calibrate the distortion of the electronic device according to the user environment. For example, the memory (2200) may store instructions and programs for implementing the functions of the first dithering module (510), the monitoring module (520), the calibration determination module (530), the second dithering module (540), and the output module (550), which are exemplarily illustrated in FIG. 5. Meanwhile, the modules stored in the memory (2200) are for convenience of explanation and are not necessarily limited thereto. Other modules may be added to implement the aforementioned embodiments, and some modules may be omitted. Additionally, one module may be divided into a plurality of modules distinguished by detailed functions, and some of the aforementioned modules may be combined to be implemented as a single module.

[0088] FIG. 3 is a flowchart illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure to calibrate distortion of the electronic device according to a user environment.

[0089] With reference to FIG. 3, the overall operation of the electronic device (2000) of the present disclosure will be described. Additionally, with reference to the following drawings, specific details of the operation of the electronic device (2000) will be described.

[0090] In operation S310, the electronic device (2000) can obtain reference environment information that serves as a reference for performing a first dithering on an input image.

[0091] In the present disclosure, the input image may refer to original digital image data or original image data that is dithered to overcome limitations in color representation on a display.

[0092] In the present disclosure, the first dithering may represent dithering performed by an electronic device (2000) to express various colors using a limited color or a limited color palette on a display (2300) of the electronic device (2000) based on a reference environment. For example, the first dithering may mean dithering processing so that an input image can be expressed as intended at the color temperature of the reference environment. For example, the first dithering may mean dithering processing an input image so that an input image can be expressed as intended at the brightness of the reference environment. The first dithering may be performed independently of the external environment or user environment of the electronic device (2000). Since the first dithering is performed independently of the external environment or user environment, it may be dithering to which calibration is not applied. According to one embodiment of the present disclosure, the electronic device (2000) may perform the first dithering assuming that a first dithered image is output in the reference environment.

[0093] According to one embodiment of the present disclosure, an electronic device (2000) can perform a first dithering on an input image. The electronic device (2000) can analyze the input image to identify color information of the input image. The electronic device (2000) can convert the color information of the input image into a color representation range that the display (2300) can express. The electronic device (2000) can express the input image within the limited color representation range of the display (2300) by performing a first dithering on the input image.

[0094] In the present disclosure, reference environment information represents information about a reference environment, and the reference environment may represent an environment in which an image output to a display (2300) of an electronic device (2000) can be displayed without distortion. In other words, the reference environment may represent an environment that serves as a standard for whether calibration is applied. According to one embodiment of the present disclosure, the reference environment information may include color temperature information about the reference environment or brightness information about the reference environment.

[0095] According to one embodiment of the present disclosure, an electronic device (2000) can obtain reference environment information. For example, the electronic device (2000) can access reference environment information that is stored in advance in a memory (2200). According to one embodiment of the present disclosure, the electronic device (2000) can change the setting of the color temperature value of the reference environment or the brightness value of the reference environment. For example, the electronic device (2000) can adjust the reference environment information based on user input.

[0096] In operation S320, the electronic device (2000) can obtain user environment information including at least one of a color temperature value or a brightness value measured in the user environment where the electronic device (2000) is located.

[0097] According to one embodiment of the present disclosure, an electronic device (2000) can monitor user environment information of a user environment in which the electronic device (2000) is located. In the present disclosure, user environment information may represent information about an external environment in which the electronic device (2000) is located. The electronic device (2000) can monitor at least one of color temperature information or brightness information outside the electronic device (2000). The electronic device (2000) can acquire at least one of color temperature information or brightness information of the user environment. Color temperature information may include a color temperature value. Brightness information may include a brightness value.

[0098] According to one embodiment of the present disclosure, an electronic device (2000) may measure hue or brightness information of light in a user environment using one or more sensors included in the electronic device (2000). Alternatively, the electronic device (2000) may receive hue or brightness information of light in a user environment measured through an external device. The electronic device (2000) may calculate the color temperature of the user environment using the acquired hue information of light.

[0099] In operation S330, the electronic device (2000) can compare the user environment information and the reference environment information to determine whether to apply calibration to the input image so that the image shown in the user environment is shown in the color of the image shown in the reference environment.

[0100] According to one embodiment of the present disclosure, the electronic device (2000) may determine whether to calibrate distortion occurring in the user environment. Based on the acquired user environment information, the electronic device (2000) may predict the distortion caused by the acquired user environment in the first dithered image. According to one embodiment of the present disclosure, the electronic device (2000) may predict whether distortion occurs in the image shown in the user environment by comparing reference environment information with the acquired user environment information.

[0101] According to one embodiment of the present disclosure, image distortion may exhibit a phenomenon in which there is a difference in how a user perceives the color of an image output in a user environment and the color of an image output in a reference environment. For example, it may exhibit a phenomenon in which the color perceived by a user for a first dithered image displayed in a user environment appears different from the color perceived by a user for a first dithered image displayed in a reference environment.

[0102] According to one embodiment of the present disclosure, an electronic device (2000) can calibrate image distortion so that the color perceived by the user for an image output in a user environment is seen as the color perceived by the user for an image output in a reference environment.

[0103] According to one embodiment of the present disclosure, an electronic device (2000) can determine whether to apply calibration to an input image. The electronic device (2000) can determine whether to apply calibration by comparing user environment information and reference environment information. The electronic device (2000) can identify the color temperature of the user environment and the color temperature of the reference environment in order to compare the color temperature of the user environment and the color temperature of the reference environment. In addition, the electronic device (2000) can identify the brightness of the user environment and the brightness of the reference environment in order to compare the brightness of the user environment and the brightness of the reference environment.

[0104] The electronic device (2000) can calculate the difference in color temperature or brightness between a reference environment and a user environment. According to one embodiment of the present disclosure, the electronic device (2000) can calculate the difference in color temperature or brightness by comparing reference environment information and user environment information. Additionally, according to one embodiment of the present disclosure, the electronic device (2000) can compare a first dithered image in a reference environment and a first dithered image in a user environment to calculate the difference in color temperature or brightness.

[0105] According to one embodiment of the present disclosure, the electronic device (2000) may determine to perform a calibration that compensates for the calculated color temperature difference when the calculated color temperature difference is greater than or equal to a threshold value. Additionally, according to one embodiment of the present disclosure, the electronic device (2000) may determine to perform a calibration that compensates for the calculated brightness difference when the calculated brightness difference is greater than or equal to a threshold value.

[0106] In operation S340, the electronic device (2000) can obtain a first dithered image in which the first dithering is performed on the input image or a second dithered image in which the second dithering is performed to apply the calibration to the input image, based on whether the calibration is applied.

[0107] According to one embodiment of the present disclosure, the electronic device (2000) can obtain a first dithered image by performing a first dithering on an input image based on the determination not to apply calibration. The electronic device (2000) can obtain a first dithered image, which is an image by performing a first dithering on an input image without applying calibration.

[0108] According to one embodiment of the present disclosure, the electronic device (2000) can obtain a second dithered image by performing a second dithering on an input image based on a determination to apply calibration.

[0109] In the present disclosure, the second dithering may represent dithering performed by the electronic device (2000) to calibrate distortion occurring in an image due to the user environment. For example, it may represent dithering for anti-compensation of an image output from the user environment according to the difference between the user environment and the reference environment of the electronic device (2000). When the electronic device (2000) performs the second dithering on the input image, a second dithered image capable of offsetting distortion caused by the user environment can be obtained.

[0110] According to one embodiment of the present disclosure, an electronic device (2000) can identify distortion occurring in an image due to a user environment. The electronic device (2000) can identify distortion by comparing reference environment information and user environment information. The electronic device (2000) can identify at least one of a color temperature difference or a brightness difference when the dithered image is output in a reference environment and when the dithered image is output in a user environment. The electronic device (2000) can generate a color necessary to compensate for the color temperature difference or the brightness difference within the limited color expression range of the display (2300). The electronic device (2000) can perform a second dithering that applies calibration within the limited color expression range of the display (2300).

[0111] According to one embodiment of the present disclosure, an electronic device (2000) may use a weight for color temperature and a weight for brightness to perform a second dithering. In the present disclosure, the weight for color temperature may be a numerical value expressed as a ratio by standardizing the difference between the color temperature when the image is output in a reference environment and the color temperature when the image is output in a user environment. The weight for brightness may be a numerical value expressed as a ratio by standardizing the difference between the brightness when the image is output in a reference environment and the brightness when the image is output in a user environment.

[0112] The electronic device (2000) can determine a weight for color temperature based on the magnitude of the identified color temperature difference. The electronic device (2000) can determine a weight for brightness based on the magnitude of the identified brightness difference. Based on the determined weight for color temperature and the weight for brightness, the electronic device (2000) can preferentially compensate for the color temperature or brightness with the higher weight.

[0113] According to one embodiment of the present disclosure, an electronic device (2000) can identify an edge region and a flat region in an input image and perform a first dithering on the flat region. Additionally, according to one embodiment of the present disclosure, an electronic device (2000) can identify an edge region and a flat region in an input image and perform a second dithering on the flat region.

[0114] A flat region may represent a part within an image or video where visual elements, such as color or brightness, remain constant. An edge region may represent a part within an image or video where visual elements, such as color or brightness, change abruptly. If the electronic device (2000) performs dithering on the edge region, it may cause unnecessary visual distortion in the image. Therefore, the electronic device (2000) may perform dithering on the flat region.

[0115] In operation S350, the electronic device (2000) can output one of the first dithered image (40) or the second dithered image (50).

[0116] According to one embodiment of the present disclosure, the electronic device (2000) may output a first dithered image based on the determination not to apply calibration. Additionally, the electronic device (2000) may output a first dithered image based on the determination not to perform a second dithering. The electronic device (2000) may display the first dithered image through a display (2300). Alternatively, according to one embodiment of the present disclosure, the electronic device (2000) may transmit the first dithered image to a display device or a server.

[0117] According to one embodiment of the present disclosure, based on the determination to apply calibration, the electronic device (2000) may output a second dithered image. Additionally, based on the performance of the second dithering, the electronic device (2000) may output a second dithered image. The electronic device (2000) may display the second dithered image through a display (2300). Alternatively, according to one embodiment of the present disclosure, the electronic device (2000) may transmit the second dithered image to a display device or a server.

[0118] FIG. 4 is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure performing a first dithering on an input image.

[0119] According to one embodiment of the present disclosure, an electronic device (2000) can perform a first dithering on an input image (30) to display an image on a display (2300) with limited color representation.

[0120] According to one embodiment of the present disclosure, an electronic device (2000) can analyze an input image (30). The electronic device (2000) can identify color information of the input image (30). For example, the electronic device (2000) can identify the color space of the input image (30). The color space may represent a standard that expresses a color display system in three dimensions. For example, the color space may represent a model such as RGB (Red, Green, Blue) or CMYK (Cyan, Magenta, Yellow, Key / Black), but is not limited to the examples described above.

[0121] According to one embodiment of the present disclosure, an electronic device (2000) can identify the color space used by the input image (30) through the metadata of the input image (30). Alternatively, the electronic device (2000) can identify the color space used by the input image (30) through the color profile of the color space. The electronic device (2000) can identify the color distribution or color representation frequency by analyzing the color data of the input image (30).

[0122] Referring to FIG. 4, the electronic device (2000) can analyze color data in each region of the input image (30). For example, the electronic device (2000) can analyze color data in a first region (32) of the input image (30). The electronic device (2000) can identify color information in the first region (32). Each region of the image may represent a region where the same color or brightness is maintained, divided based on a boundary surface.

[0123] According to one embodiment of the present disclosure, an electronic device (2000) can convert the color representation of an input image (30) to represent the input image (30) within a limited color representation range of a display (2300). The electronic device (2000) can analyze the color palette of the display (2300) to represent the input image (30) within the color representation range of the display (2300). For example, the electronic device (2000) can identify the colors of electronic ink particles that can be used in the display (2300).

[0124] The electronic ink particle may refer to a fine particle that displays a specific color according to an electrical signal within a limited color palette of the display (2300). For example, the electronic ink particle may include a microcapsule that displays a predetermined color according to an electrical signal within a limited color expression range due to the characteristics of the reflective display (2300). The electronic device (2000) can control the position or direction of the electronic ink particle by adjusting the voltage at the electrode of the display (2300).

[0125] Referring to FIG. 4, the electronic device (2000) may include a plurality of electronic ink particles (441 to 446) inside the display (2300). The electronic device (2000) may display the color of a dithered image on the display (2300) using the plurality of electronic ink particles (441 to 446). For example, the display (2300) may include first electronic ink particles (441, 442), second electronic ink particles (443, 444), and third electronic ink particles (445, 446). If the first electronic ink particles (441, 442) are red electronic ink particles, the electronic device (2000) may display red in each area of ​​the display where the first electronic ink particles (441, 442) are located.

[0126] According to one embodiment of the present disclosure, an electronic device (2000) can control the position of each of the electronic ink particles (441 to 446). When the electronic ink particles are positioned toward the positive electrode of the display (2300), the electronic ink particles can display color on the display (2300). The electronic device (2000) can control the voltage to move the electronic ink particles toward the positive electrode or the negative electrode of the display.

[0127] Alternatively, according to one embodiment of the present disclosure, the electronic device (2000) can control the direction of each of the electronic ink particles (441 to 446). When the electronic ink particles are oriented toward the positive electrode of the display (2300), the electronic ink particles can express color on the display (2300). The electronic device (2000) can control the voltage to rotate the electronic ink particles toward the positive electrode or the negative electrode of the display.

[0128] According to one embodiment of the present disclosure, an electronic device (2000) can express color on a display by controlling the position or direction of electronic ink particles in each region of an image. For example, the electronic device (2000) can control the position or direction of the electronic ink particles by adjusting the voltage for each region of the display (2300) to express color. The electronic device (2000) can express color differently depending on the ratio in which the electronic ink particles are expressed. The electronic device (2000) can express color by controlling the ratio in which the first electronic ink particles, the second electronic ink particles, and the third electronic ink particles are located on the positive electrode of the display. For example, the second electronic ink particles (443, 444) may be red electronic ink particles, and the third electronic ink particles (445, 446) may be blue electronic ink particles. When the electronic device (2000) displays purple, the electronic device (2000) can control the second electronic ink particles (443, 444) and the third electronic ink particles (445, 446) to be positioned at the positive electrode of the display in a 1:1 ratio.

[0129] According to one embodiment of the present disclosure, an electronic device (2000) can identify the color depth of a display (2300). The electronic device (2000) can identify the color depth and sort the color areas of an input image so as to represent the input image (30) as a color representation range of the display (2300). The electronic device (2000) can map the grouped color areas to the color representation range of the display (2300).

[0130] According to one embodiment of the present disclosure, an electronic device (2000) can perform a first dithering (410) on an input image (30) by combining electronic ink particles (441 to 446). The electronic device (2000) can perform the first dithering (410) using the results of analyzing color data in each region of the input image (30).

[0131] The electronic device (2000) can express the color of the first region (32) of the first dithered image (40) corresponding to the first region (32) of the input image (30). The electronic device (2000) can express the color of the first region (32) using the color palette of the display (2300). The electronic device (2000) can express the first dithered image (40) by dithering the input image with electronic ink particles (441 to 446) each representing a different color. The electronic device (2000) can arrange the electronic ink particles (441 to 446) each representing a different color at adjacent positions. When a portion (420) of the first region of the first dithered image (40) is magnified (430), it can be confirmed that electronic ink particles (441 to 446) are combined to represent the first dithered image (40).

[0132] FIG. 5 is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure to calibrate distortion of the electronic device according to the user environment.

[0133] Referring to FIG. 5, the electronic device (2000) may include a first dithering module (510), a monitoring module (520), a calibration determination module (530), a second dithering module (540), and an output module (550).

[0134] FIG. 5 is a drawing for explaining detailed configurations classified based on function or role, included in an electronic device according to one embodiment of the present disclosure.

[0135] The detailed configurations (510 to 550) of the electronic device (2000) illustrated in FIG. 5 may include appropriate logic, circuits, interfaces, and / or code that can be operated to perform functions corresponding to each detailed configuration.

[0136] According to one embodiment, the detailed configurations (510 to 550) of the electronic device (2000) illustrated in FIG. 5 may be software configurations implemented by the processor (2100) of the electronic device (2000) executing a program stored in memory (2200), and may also be virtual configurations for which no actual matching hardware device exists. In other words, the operations performed by the processor (2100) of the electronic device (2000) by executing a program stored in memory (2200) may be classified into multiple groups according to function or purpose, and the entities performing the operations included in each classified group may be represented as the detailed configurations (510 to 550) of FIG. 5. Accordingly, the operations described as being performed by the detailed configurations (510 to 550) illustrated in FIG. 5 can actually be seen as being performed by the processor (2100) of the electronic device (2000) executing a program stored in memory (2200).

[0137] According to one embodiment of the present disclosure, a first dithering module (510) can generate a first dithered image (40) by performing first dithering (410) on an input image (30). The first dithering module (510) can analyze color information of the input image (30). The first dithering module (510) can determine whether the input image (30) can be represented within the limited color representation range of the display (2300). The first dithering module (510) can compare the color representation range of the display (2300) with the color data of the input image (30).

[0138] According to one embodiment of the present disclosure, when a specific color of an input image (30) exceeds the color expression range of a display (2300), a first dithering module (510) can map a color close to the specific color of the input image (30) using the color palette of the display (2300). The first dithering module (510) can combine electronic ink particles that can be used in the display (2300). The first dithering module (510) can express a specific color of the input image (30). The first dithering module (510) can change the strength of the electric field by adjusting the voltage. The first dithering module (510) can adjust the position or direction of the electronic ink particles according to the strength of the electric field. The first dithering module (510) can obtain a first dithered image (40) by adjusting the electronic ink particles.

[0139] According to one embodiment of the present disclosure, a monitoring module (520) can measure the color temperature of a user environment in which the electronic device (2000) is located by using one or more color sensors of the electronic device (2000). For example, the monitoring module (520) can detect the color of light or the intensity of light by using one or more RGB sensors. The monitoring module (520) can calculate the color temperature of the user environment using the measured color or intensity value of the light.

[0140] According to one embodiment of the present disclosure, a monitoring module (520) may measure the color temperature of the user environment at a specific point on the display of the electronic device (2000) using one or more color sensors. Alternatively, according to one embodiment of the present disclosure, the monitoring module (520) may measure the color temperature of each point at a plurality of points on the display using a plurality of color sensors. The monitoring module (520) may obtain color temperature information for each zone of the user environment by measuring the color temperature at a plurality of points. According to one embodiment of the present disclosure, the monitoring module (520) may calculate the average value of the color temperature values ​​for each zone of the user environment measured at a plurality of points. The monitoring module (520) may determine the average color temperature value as the color temperature value of the user environment.

[0141] According to one embodiment of the present disclosure, a monitoring module (520) can determine the color temperature value of a specific zone among the zone-specific color temperature values ​​of the user environment measured at a plurality of points as the color temperature value of the user environment. Which zone among the plurality of zones of the user environment is used as the specific zone may be pre-set at the time of manufacturing the electronic device (2000). Additionally, according to one embodiment of the present disclosure, the specific zone determining the color temperature value of the user environment can be changed according to user input.

[0142] According to one embodiment of the present disclosure, a monitoring module (520) can measure the brightness of a user environment where the electronic device (2000) is located using one or more brightness sensors of the electronic device (2000). For example, the monitoring module (520) can detect the intensity of light reaching a point where the sensor is located using one or more photodiode sensors or phototransistor sensors.

[0143] According to one embodiment of the present disclosure, a monitoring module (520) may measure the brightness of the user environment at a specific point on the display of the electronic device (2000) using one or more brightness sensors. Alternatively, according to one embodiment of the present disclosure, the monitoring module (520) may measure the brightness of each point at a plurality of points on the display using a plurality of brightness sensors. The monitoring module (520) may obtain brightness information for each zone of the user environment by measuring the brightness at a plurality of points. According to one embodiment of the present disclosure, the monitoring module (520) may calculate the average value of the brightness values ​​for each zone of the user environment measured at a plurality of points. The monitoring module (520) may determine the average brightness value as the brightness value of the user environment.

[0144] According to one embodiment of the present disclosure, the monitoring module (520) can determine the brightness value of a specific zone among the zone-specific brightness values ​​of the user environment measured at a plurality of points as the brightness value of the user environment. Which zone among the plurality of zones of the user environment is used as the specific zone may be pre-set at the time of manufacturing the electronic device (2000). In addition, according to one embodiment of the present disclosure, the specific zone determining the brightness value of the user environment can be changed according to user input.

[0145] Additionally, according to one embodiment of the present disclosure, the monitoring module (520) may receive at least one of color temperature information or brightness information measured in the user environment from an external device. The monitoring module (520) may receive user environment information measured through an external device using a communication interface. The monitoring module (520) may receive user environment information from an external device or receive user environment information from a server.

[0146] According to one embodiment of the present disclosure, the monitoring module (520) can monitor the user environment in real time. The monitoring module (520) can measure at least one of the color temperature or brightness of the user environment in real time. Alternatively, the monitoring module (520) can receive color temperature or brightness information of the user environment in real time from an external device or server.

[0147] According to one embodiment of the present disclosure, the monitoring module (520) can continuously collect at least one of color temperature or brightness data. The monitoring module (520) can acquire user environment information at intervals where the user does not perceive a change (e.g., 16ms or less) or at time intervals where the user perceives a small change (e.g., 33ms to 100ms).

[0148] According to one embodiment of the present disclosure, the calibration determination module (530) can determine a reference environment. For example, the calibration determination module (530) can set reference color temperature information or reference brightness information. According to one embodiment of the present disclosure, the calibration determination module (530) can determine the reference environment by obtaining information about a reference environment that is pre-set during the manufacture of an electronic device. According to one embodiment of the present disclosure, the calibration determination module (530) can change the reference environment according to user input (532). The calibration determination module (530) can set the reference color temperature or reference brightness to a specific value according to user input (532).

[0149] According to one embodiment of the present disclosure, the calibration decision module (530) may determine whether to perform a second dithering to apply calibration based on user environment information obtained by the monitoring module (520). The calibration decision module (530) may determine whether to apply calibration to the input image by comparing the obtained user environment with the reference environment.

[0150] For example, the calibration decision module (530) can calculate the difference between the color temperature in the reference environment and the color temperature in the user environment. Additionally, for example, the calibration decision module (530) can calculate the difference between the color temperature when outputting the first dithered image in the reference environment and the color temperature when outputting the first dithered image in the user environment. If the calculated difference is greater than or equal to a threshold value, the calibration decision module (530) can decide to apply calibration to compensate for the color temperature difference to the input image.

[0151] Additionally, for example, the calibration decision module (530) can calculate the difference between the brightness in the reference environment and the brightness in the user environment. Additionally, for example, the calibration decision module (530) can calculate the difference between the brightness when outputting the first dithered image in the reference environment and the brightness when outputting the first dithered image in the user environment. If the calculated difference is greater than or equal to a threshold value, the calibration decision module (530) can decide to apply calibration to compensate for the brightness difference to the first dithered image.

[0152] According to one embodiment of the present disclosure, the calibration decision module (530) can determine whether to perform a second dithering by applying a calibration by zone of an input image based on zone-specific user environment information obtained by the monitoring module (520). The calibration decision module (530) can determine whether to apply calibration to each zone of the input image by comparing the obtained zone-specific user environment with the reference environment. For example, in the example illustrated in FIG. 1b, it can determine whether to perform a second dithering by the first image zone (12a), the second image zone (12b), the third image zone (12c), and the fourth image zone (12d) of the image. In the example shown in FIG. 1b, the calibration decision module (530) may determine, for example, that the first image zone (12a) and the second image zone (12b) perform second dithering, and that the third image zone (12c) and the fourth image zone (12d) do not perform second dithering.

[0153] According to one embodiment of the present disclosure, when it is decided to apply calibration, the second dithering module (540) can perform second dithering on the input image. The second dithering module (540) can analyze the color difference of the input image in a reference environment and a user environment. For example, the second dithering module (540) can identify at least one of the color temperature difference or brightness difference when the input image is output in a reference environment and when the input image is output in a user environment. Additionally, the second dithering module (540) can analyze the difference between the first dithered image in a reference environment and the first dithered image in a user environment. For example, the second dithering module (540) can identify at least one of the color temperature difference or brightness difference when the first dithered image is output in a reference environment and when the first dithered image is output in a user environment.

[0154] According to one embodiment of the present disclosure, when it is decided to apply calibration to a region of an input image, the second dithering module (540) can perform second dithering on the region of the input image. The second dithering module (540) can analyze the difference in color temperature in each region of the reference environment and the user environment. The second dithering module (540) can analyze the difference in brightness in each region of the reference environment and the user environment.

[0155] According to one embodiment of the present disclosure, the second dithering module (540) may identify a color necessary to compensate for an identified color temperature difference. Alternatively, the second dithering module (540) may identify a color necessary to offset an identified brightness difference.

[0156] According to one embodiment of the present disclosure, the second dithering module (540) can generate a color necessary to compensate for a color temperature difference or a brightness difference within a limited color expression range of the display (2300). For example, the second dithering module (540) can express a color necessary for difference compensation by combining a limited color palette of the display (2300). The second dithering module (540) can blend electronic ink particles. For example, the second dithering module (540) can blend electronic ink particles by controlling the position of each electronic ink particle. The second dithering module (540) can adjust the voltage applied to the electrodes of the display for blending the electronic ink particles.

[0157] According to one embodiment of the present disclosure, the second dithering module (540) can calculate a weight for color temperature based on the magnitude of the identified color temperature difference. The second dithering module (540) can calculate a weight for brightness based on the magnitude of the identified brightness difference. The second dithering module (540) can perform second dithering to preferentially compensate for the difference between the weight for color temperature and the weight for brightness, wherein the weight is relatively higher.

[0158] According to one embodiment of the present disclosure, the second dithering module (540) can distinguish between a boundary surface and a flat surface in an input image. The second dithering module (540) can perform second dithering on the flat surface.

[0159] According to one embodiment of the present disclosure, the output module (550) may display the second dithered image through the display (2300). Alternatively, the output module (550) may transmit the second dithered image to an external device.

[0160] FIG. 6 is a diagram illustrating, by way of example, an operation in which an electronic device according to one embodiment of the present disclosure performs a second dithering on an input image.

[0161] According to one embodiment of the present disclosure, an electronic device (2000) can perform a first dithering (410) on an input image (30). The electronic device (2000) can obtain a first dithered image (40) by performing the first dithering (410) on the input image (30). Since an exemplary operation for performing the first dithering (410) has been described in FIG. 4, a repetitive description is omitted.

[0162] According to one embodiment of the present disclosure, when the first dithered image (40) is output, the first dithered image (40) may be affected by the user environment. For example, the first dithered image (40) may appear distorted in at least one of color temperature or brightness due to the user environment. The first dithered image (42) displayed in the user environment may be an image in which the color temperature or brightness of the first dithered image (40) appears distorted.

[0163] According to one embodiment of the present disclosure, an electronic device (2000) may apply a second dithering, which is a calibration that offsets distortion of color temperature or brightness of a first dithered image (40), to an input image (30). The electronic device (2000) may perform a second dithering (610) on the input image (30) to calibrate distortion of color temperature or brightness caused by the user environment. According to one embodiment of the present disclosure, the electronic device (2000) may generate a second dithered image (50) that can compensate for distortion occurring in the first dithered image (40) due to the user environment.

[0164] According to one embodiment of the present disclosure, an electronic device (2000) can identify a color difference between a first dithered image (40) shown in a reference environment and a first dithered image (42) shown in a user environment. For example, the electronic device (2000) can identify the color difference between the reference environment and the user environment and predict the color difference between the first dithered image (40) shown in the reference environment and the first dithered image (42) shown in the user environment. The electronic device (2000) can calculate a hue difference or brightness difference between the first dithered image (40) in the reference environment and the first dithered image (42) in the user environment.

[0165] According to one embodiment of the present disclosure, an electronic device (2000) can compare the color difference of each pixel at the same location of a first dithered image (40) in a reference environment and a first dithered image (42) in a user environment. For example, the electronic device (2000) can calculate the color difference by comparing the difference in Red (R), Green (G), and Blue (B) values ​​or the difference in Cyan (C), Magenta (M), Yellow (Y), and Black (K) values, but is not limited to the examples described above.

[0166] According to one embodiment of the present disclosure, an electronic device (2000) can generate a color necessary to compensate for the color difference between a first dithered image (40) in a reference environment and a first dithered image (42) in a user environment. The electronic device (2000) can identify the color of the electronic ink particles included in the display (2300). The electronic device (2000) can combine the color necessary for color difference compensation. The electronic device (2000) can combine the necessary color using the electronic ink particles included in the display (2300). The electronic device (2000) can combine the color by adjusting the ratio at which the electronic ink particles appear on the display (2300). The electronic device (2000) can control the position or direction of the electronic ink particles so that the electronic ink particles express color on the display (2300). The electronic device (2000) can control the position or direction of the electronic ink particles by adjusting the voltage.

[0167] The electronic device (2000) may preferentially calibrate one of the elements of color difference or brightness difference. The electronic device (2000) may determine a weight for color temperature and a weight for brightness. The electronic device (2000) may compare the determined weight for color temperature and the determined weight for brightness. The electronic device (2000) may preferentially compensate for the element with the relatively higher weight. The electronic device (2000) may perform a second dithering to compensate for the difference of the element with the relatively higher weight. A description of the weights is provided in detail in FIGS. 7a and 7b.

[0168] According to one embodiment of the present disclosure, an electronic device (2000) can distinguish between a boundary surface and a flat surface in an input image (30). The electronic device (2000) can identify pixels or regions in the input image (30) where color or brightness is consistently maintained. The electronic device (2000) can determine a point where color or brightness changes abruptly as a boundary surface. If dithering is performed on the boundary surface, the electronic device (2000) can degrade the information of the image. If dithering is performed on the boundary surface, the boundary surface may become blurry, and the electronic device (2000) may distort the image. The electronic device (2000) can perform a second dithering on the flat surface.

[0169] The electronic device (2000) can generate a second dithered image (50) that can compensate for distortion occurring in the first dithered image (40) due to the user environment. The second dithered image (52) shown in the user environment may be the same image as the first dithered image (40) shown in the reference environment.

[0170] FIG. 7a is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure performing a second dithering using a color temperature level table.

[0171] According to one embodiment of the present disclosure, an electronic device (2000) can perform a second dithering using a color temperature level table (710). The electronic device (2000) can calculate the color difference between the user environment and the reference environment using the color temperature level table (710). Additionally, the electronic device (2000) can calculate a weight for the color temperature using the color temperature level table (710) and use it to perform the second dithering.

[0172] The color temperature level (712) is a value that classifies the numerical value of the color temperature according to the color temperature range (714). The electronic device (2000) can classify the color temperature into multiple levels. For example, referring to FIG. 7a, the electronic device (2000) can classify the color temperature by dividing the color temperature level (712) into 13 levels.

[0173] According to one embodiment of the present disclosure, an electronic device (2000) can determine a representative R, G, B value (716) according to a color temperature range (714). The representative R, G, B value (716) may be one reference value among the R, G, B values ​​that can calculate color temperature values ​​belonging to the color temperature range (714).

[0174] According to one embodiment of the present disclosure, an electronic device (2000) can compare the R, G, and B values ​​of a user environment with the representative R, G, and B values ​​of a reference environment. The electronic device (2000) can calculate the difference between each R, G, and B value of the user environment and the representative R, G, and B value of the reference environment. The electronic device (2000) can formulate electronic ink particles to express the difference between each calculated R, G, and B value.

[0175] According to one embodiment of the present disclosure, an example of calculating the difference between the R, G, and B values ​​of a user environment and a reference environment has been disclosed, but the color difference may also be calculated by calculating the difference between CMYK values.

[0176] According to one embodiment of the present disclosure, an electronic device (2000) can classify the color temperature level (712) of a user environment. The electronic device (2000) can determine the color temperature level (712) of the user environment to a color temperature range (714) to which the acquired color temperature of the user environment belongs. For example, if the color temperature information of the user environment acquired by the electronic device (2000) is 6200K, the electronic device (2000) can map the color temperature of the user environment to level 12 (732).

[0177] According to one embodiment of the present disclosure, the electronic device (2000) can set the color temperature level of a reference environment. For example, the electronic device (2000) can determine the color temperature of the reference environment to level 10 (718). The electronic device (2000) can determine the color temperature level of the reference environment according to a preset.

[0178] According to one embodiment of the present disclosure, an electronic device (2000) can compare the color temperature levels of a user environment and a reference environment. The electronic device (2000) can determine a weight for color using the color temperature levels. The electronic device (2000) can determine the ratio of the difference in color temperature levels between the user environment and the reference environment to the total number of color temperature levels as a weight for color temperature.

[0179] For example, by referring to mathematical formula 1, weights for color temperature can be obtained. The total number of color temperature levels may be 13, the color temperature level of the user environment may be 12, and the color temperature level of the reference environment may be 10.

[0180]

[0181] FIG. 7b is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure performing a second dithering using a brightness level table.

[0182] According to one embodiment of the present disclosure, an electronic device (2000) can perform a second dithering using a brightness level table (720). The electronic device (2000) can calculate the difference in brightness between the user environment and the reference environment using the brightness level table (720). Additionally, the electronic device (2000) can calculate a weight for brightness using the brightness level table (720) and use it to perform the second dithering.

[0183] The brightness level (722) is a value classifying the relative intensity of brightness according to the brightness range (724). The electronic device (2000) can classify the relative intensity of brightness into multiple levels. For example, referring to FIG. 7b, the electronic device (2000) can classify the relative intensity of brightness by dividing the brightness level (722) into 13 levels.

[0184] According to one embodiment of the present disclosure, the electronic device (2000) may determine a representative brightness value (726) according to a brightness range (724). The representative brightness value (726) may be one reference value among the brightness values ​​belonging to the brightness range (724).

[0185] For example, the representative brightness value (726) may be determined as the arithmetic mean of the maximum threshold and the minimum threshold of the brightness range (724). Or, for example, the representative brightness value (726) may be determined as a threshold. For example, referring to FIG. 7b, the maximum value of the brightness range for brightness level 10 (728) is 300 lux, and the minimum value of the brightness range is 270 lux. Thus, the representative brightness value for brightness level 10 (728) may be set to 285 lux. The threshold of the brightness range for brightness level 12 (734) is 330 lux. Thus, the representative brightness value for brightness level 12 (734) may be set to 330 lux.

[0186] According to one embodiment of the present disclosure, an electronic device (2000) can compare a brightness value of a user environment with a representative brightness value of a reference environment. The electronic device (2000) can mix electronic ink particles to express the calculated brightness value.

[0187] According to one embodiment of the present disclosure, an electronic device (2000) can classify the brightness level (722) of a user environment. The electronic device (2000) can determine the brightness level of the user environment to a brightness range (724) to which the brightness intensity of the acquired user environment belongs. For example, if the brightness information of the user environment acquired by the electronic device (2000) is 350 lux, the electronic device (2000) can map the brightness of the user environment to level 12 (734).

[0188] According to one embodiment of the present disclosure, the electronic device (2000) can set the brightness level of a reference environment. For example, the electronic device (2000) can determine the brightness of the reference environment to level 10 (728). The electronic device (2000) can determine the brightness level of the reference environment according to a preset.

[0189] According to one embodiment of the present disclosure, an electronic device (2000) can compare the brightness levels of a user environment and a reference environment. The electronic device (2000) can determine a weight for brightness using the brightness levels. The electronic device (2000) can determine the ratio of the difference in brightness levels between the user environment and the reference environment to the total number of levels as the weight for brightness.

[0190] For example, by referring to mathematical formula 2, weights for brightness can be obtained. The total number of brightness levels may be 13, the brightness level of the user environment may be 12, and the brightness level of the reference environment may be 10.

[0191]

[0192] FIG. 8 is a drawing for exemplarily illustrating the operation of combining electronic ink particles in an electronic device according to one embodiment of the present disclosure.

[0193] According to one embodiment of the present disclosure, an electronic device (2000) can display an image within a limited color palette of a display (2300). The color palette may consist of colors of electronic ink particles that can be used in the display (2300). The electronic device (2000) can display colors in the display (2300) by combining electronic ink particles.

[0194] According to one embodiment of the present disclosure, an electronic device (2000) can uniformly arrange pixels containing electronic ink particles in an area that displays the same color. Referring to FIG. 8, the first area (430) may be an area that displays the same color. The electronic device (2000) can spatially uniformly arrange pixels (440) and pixels (450) in the first area (430) that displays the same color.

[0195] According to one embodiment of the present disclosure, each of the pixel (440) and pixel (450) may include a plurality of electronic ink particles. The electronic ink particles may display a color determined according to an electrical signal. For example, the first electronic ink particles (441, 442, 451, 452) may display black. The second electronic ink particles (443, 444, 453, 454) may display red. The third electronic ink particles (445, 446, 455, 456) may display blue. The fourth electronic ink particles (447, 448, 457, 458) may display yellow. The fifth electronic ink particles (449, 459) may display white. The color of the electronic ink particles may be a predetermined color and is not limited to the examples described above.

[0196] The electronic device (2000) can change the strength of the electric field by adjusting the voltage. The electronic device (2000) can control the position or direction of the electronic ink particles according to the strength of the electric field. For example, the electronic device (2000) can control the strength of the positive electrode (810) or the negative electrode (820) of the display (2300). The electronic device (2000) can change the strength of the electric field to move the position of the electronic ink particles toward the positive electrode (810).

[0197] The electronic device (2000) can display electronic ink particles on the positive electrode (810) side of the display (2300) on the display (2300). For example, electronic ink particles (441 to 446, 451 to 456) on the positive electrode (810) side of pixels (440, 450) can be output on the display (2300).

[0198] According to one embodiment of the present disclosure, the electronic device (2000) can randomly arrange electronic ink particles within a pixel at the positive electrode of the display (2300). Additionally, the electronic device (2000) can randomly arrange electronic ink particles within a pixel at the negative electrode of the display (2300). Referring to FIG. 8, pixels (440) and pixels (450) can express the same color. The electronic ink particles (441 to 446) of the pixel (440) may have a different arrangement from the electronic ink particles (451 to 456) of the pixel (450).

[0199] FIG. 9 is a diagram illustrating, in an exemplary manner, the operation of an electronic device according to one embodiment of the present disclosure to calibrate distortion of the electronic device according to the user environment.

[0200] According to one embodiment of the present disclosure, an electronic device (2000) can perform a first dithering (410) on an input image (30). The electronic device (2000) can set reference environment information (910). For example, the electronic device (2000) can set the color temperature level of the reference environment to 10. Or, the electronic device (2000) can set the brightness level of the reference environment to 10.

[0201] According to one embodiment of the present disclosure, an electronic device (2000) can acquire user environment information (920). The electronic device (2000) can acquire at least one of the color temperature or brightness of the user environment in real time. The electronic device (2000) can map the acquired color temperature to a color temperature level. The electronic device (2000) can map the acquired brightness to a brightness level. For example, the electronic device (2000) can classify the user environment (924) measured at a first time point as level 10 using a color temperature level table (710) or a brightness level table (720).

[0202] The electronic device (2000) can identify whether the color temperature level of the user environment is the same as the color temperature level of the reference environment. If the color temperature levels of the user environment and the reference environment are the same, the electronic device (2000) can determine that there is no difference in color temperature between the first dithered image in the user environment and the first dithered image in the reference environment. If the electronic device (2000) determines that there is no difference in color temperature, it may not perform the second dithering.

[0203] For example, the color temperature level of the user environment (924) at the first time may be classified as 10. The color temperature level of the reference environment may be set to 10. The electronic device (2000) may compare (914) the color temperature level of the user environment (924) at the first time and the color temperature level (912) of the reference environment. Based on the fact that there is no color temperature difference, the electronic device (2000) may not perform a second dithering (610) to compensate for the color temperature difference.

[0204] If the electronic device (2000) determines that it will not perform second dithering, it can output an image in which first dithering has been performed on the input image (30). For example, it can output a first dithered image in which the color temperature difference between the user environment and the reference environment is not compensated.

[0205] The electronic device (2000) can calculate the difference in color temperature between the user environment and the reference environment if the color temperature levels of the user environment and the reference environment are different. Additionally, the electronic device (2000) can predict the difference in color temperature between the first dithered image in the user environment and the first dithered image in the reference environment. The electronic device (2000) can perform a second dithering to compensate for the color temperature difference.

[0206] For example, the color temperature level of the user environment (926) of the second time may be classified as 12. The color temperature level of the reference environment may be set to 10. The electronic device (2000) can compare (916) the color temperature level of the user environment (926) of the second time and the color temperature level (912) of the reference environment. The electronic device (2000) can identify the color temperature difference as level 2 and perform a second dithering (610) that compensates (930) for the color temperature difference of level 2.

[0207] For example, if the electronic device (2000) is equipped with a plurality of color sensors and can acquire the color temperature of the user environment corresponding to a plurality of areas of an image, the electronic device (2000) can identify a color temperature difference corresponding to each area of ​​the image and perform a second dithering that compensates for the identified color temperature difference for each area of ​​the image. For example, in the example illustrated in FIG. 1b, the electronic device (2000) can identify the color temperature difference as 0 for the first image area (12a) and the second image area (12b), and identify the color temperature difference as Level 2 and Level 3 for the third image area (12c) and the fourth image area (12d), respectively. In this case, the electronic device (2000) may decide not to perform second dithering for the first image area (12a) and the second image area (12b) as there is no difference in color temperature, perform second dithering to compensate for a color temperature difference of level 2 for the third image area (12c), and perform second dithering to compensate for a color temperature difference of level 3 for the fourth image area (12d). When the electronic device (2000) decides to perform second dithering, it may output an image in which second dithering has been performed on the input image (30). For example, it may output a second dithered image in which the difference in color temperature between the user environment and the reference environment is compensated.

[0208] The electronic device (2000) can identify whether the brightness level of the user environment is the same as the brightness level of the reference environment. If the brightness levels of the user environment and the reference environment are the same, the electronic device (2000) can determine that there is no difference in brightness between the first dithered image in the user environment and the first dithered image in the reference environment. If the electronic device (2000) determines that there is no difference in brightness, it may not perform the second dithering (610).

[0209] For example, the brightness level of the user environment (924) at the first time can be classified as 10. The brightness level of the reference environment can be set to 10. The electronic device (2000) can compare (914) the brightness level of the user environment (924) at the first time and the brightness level (912) of the reference environment. Based on the fact that there is no difference in brightness, the electronic device (2000) may not perform a second dithering (610) to compensate for the difference in brightness.

[0210] If the electronic device (2000) determines that it will not perform second dithering, it may output an image in which first dithering has been performed on the input image (30). For example, it may output a first dithered image in which the brightness difference between the user environment and the reference environment is not compensated. If the brightness levels of the user environment and the reference environment are different, the electronic device (2000) may calculate the brightness difference between the user environment and the reference environment. Additionally, the electronic device (2000) may predict the brightness difference between the first dithered image in the user environment and the first dithered image in the reference environment. The electronic device (2000) may perform second dithering (610) to compensate for the brightness difference.

[0211] For example, the brightness level of the user environment (926) of the second time can be classified as 12. The brightness level of the reference environment can be set to 10. The electronic device (2000) can compare (916) the brightness level of the user environment (926) of the second time and the brightness level (912) of the reference environment. The electronic device (2000) can identify the brightness difference as level 2 and perform a second dithering (610) that compensates (930) for the brightness difference of level 2.

[0212] For example, if the electronic device (2000) is equipped with a plurality of brightness sensors to obtain the brightness of the user environment corresponding to a plurality of areas of an image, the electronic device (2000) may identify a brightness difference corresponding to each area of ​​the image and perform a second dithering that compensates for the identified brightness difference for each area of ​​the image. For example, in the example illustrated in FIG. 1b, the electronic device (2000) may identify the brightness difference as 0 for the first image area (12a) and the second image area (12b), and identify the brightness difference as Level 2 and Level 3 for the third image area (12c) and the fourth image area (12d), respectively. In this case, the electronic device (2000) may decide not to perform second dithering because there is no difference in brightness for the first image area (12a) and the second image area (12b), perform second dithering to compensate for a brightness difference of level 2 for the third image area (12c), and perform second dithering to compensate for a brightness difference of level 3 for the fourth image area (12d).

[0213] When the electronic device (2000) determines to perform second dithering, it can output an image in which second dithering has been performed on the input image (30). For example, it can output a second dithered image in which the brightness difference between the user environment and the reference environment is compensated.

[0214] FIG. 10 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0215] In one embodiment, the electronic device (2000) may include a processor (2100), a memory (2200), a communication interface (2400), a display unit (2300), and one or more sensors (2500).

[0216] The processor (2100) can control the overall operations of the electronic device (2000). The processor (2100) may include processing circuits. For example, the processor (2100) can control the overall operations of the electronic device (2000) to calibrate the distortion of the electronic device according to the user environment by executing one or more instructions of a program stored in memory (2200). There may be one or more processors (2100).

[0217] The processor (2100) may be composed of at least one of, for example, a Central Processing Unit (CPU), a Microprocessor, a Graphic Processing Unit (GPU), ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), an Application Processor (AP), a Neural Processing Unit (NPU), or an AI-dedicated processor designed with a hardware structure specialized for processing AI models, but is not limited thereto.

[0218] Since the description of the operations of the processor (2100) has already been described in the description of the previous drawings, a repetitive description is omitted.

[0219] The memory (2200) may include various types of memory. The memory (2200) may include flash memory type, hard disk type, multimedia card micro type, card type memory (e.g., SD or XD memory, etc.), non-volatile memory including at least one of ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, and optical disk, and volatile memory such as RAM (Random Access Memory) or SRAM (Static Random Access Memory).

[0220] The memory (2200) can store one or more instructions and one or more programs that allow the electronic device (2000) to calibrate the distortion of the electronic device according to the user environment.

[0221] The display unit (2300) may include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a 3D display, and an electrophoretic display. Additionally, depending on the implementation form of the display unit (2300), the display unit (2300) may include two or more. When the display unit (2300) is implemented as a touch screen, the display unit (2300) may be used as an input device, such as a user interface, in addition to an output device.

[0222] The communication interface (2400) can perform data communication with other electronic devices under the control of the processor (2100). The communication interface (2400) may include a communication circuit.

[0223] The communication interface (2400) can perform data communication between an electronic device (2000) and another electronic device (e.g., user device, server, etc.) by using at least one of the data communication methods including, for example, wired LAN (e.g., Ethernet), wireless LAN (e.g., Wi-Fi), cellular network (e.g., 4G, 5G, etc.), Bluetooth, BLE (Bluetooth Low Energy), ZigBee, infrared communication (IrDA, infrared Data Association), NFC (Near Field Communication), RF communication, and various other types of known wireless / wired communication technologies.

[0224] The electronic device (2000) can transmit and receive input images, user environment information, or dithered image data to and from another electronic device (e.g., an external device, or a server, etc.) using a communication interface (2400).

[0225] The sensor (2500) may include, but is not limited to, a color sensor or a brightness sensor. Since the function of each sensor can be intuitively inferred by a person skilled in the art from its name, a detailed description will be omitted.

[0226] According to one embodiment of the present disclosure, an electronic device (2000) may include one or more color sensors. One or more color sensors may be mounted on a display structure of the electronic device (2000). For example, one or more color sensors may be mounted on an external frame of the display. According to one embodiment of the present disclosure, color sensors may be arranged at regular intervals on the external frame of the display. The spacing at which color sensors are arranged may vary depending on the aspect ratio of the display. According to one embodiment of the present disclosure, when a plurality of color sensors are included in the electronic device (2000), each color sensor may measure the color temperature of the user environment in the zone where the sensor is placed. The plurality of color sensors may divide the user environment into zones and measure the color temperature of each different zone. The electronic device (2000) may measure the color temperature of a plurality of zones using a plurality of color sensors.

[0227] According to one embodiment of the present disclosure, the electronic device (2000) may include one or more brightness sensors. One or more brightness sensors may be mounted on the display structure of the electronic device (2000). For example, one or more brightness sensors may be mounted on the outer frame of the display. According to one embodiment of the present disclosure, the brightness sensors may be arranged at regular intervals on the outer frame of the display. The spacing at which the brightness sensors are arranged may vary depending on the aspect ratio of the display. According to one embodiment of the present disclosure, when the electronic device (2000) includes a plurality of brightness sensors, each brightness sensor may measure the brightness of the user environment in the zone where the sensor is placed. The plurality of brightness sensors may divide the user environment into zones and measure the brightness of each different zone. The electronic device (2000) may measure the brightness of a plurality of zones using the plurality of brightness sensors.

[0228] Meanwhile, the electronic device (2000) may further include additional components to perform the operations described in the above-described embodiment. For example, the electronic device (2000) may further include a video processing module (2600), an audio processing module (2700), a power module (2800), or an input / output interface (2900), etc.

[0229] According to one aspect of the present disclosure, a method for operating an electronic device is provided.

[0230] The above method may include the step of performing a first dithering on an input image.

[0231] The above method may include the step of obtaining user environment information including at least one of a color temperature value or a brightness value measured in the user environment where the electronic device is located.

[0232] The above method may include a step of determining whether to apply calibration to the input image by comparing the user environment information and the reference environment information so that the image shown in the user environment is displayed in the color of the image shown in the reference environment.

[0233] The above method may include the step of obtaining a first dithered image obtained by performing the first dithering on the input image or a second dithered image obtained by performing the second dithering to apply the calibration on the input image, based on whether the calibration is applied.

[0234] The above method may include the step of outputting one of the first dithered image or the second dithered image.

[0235] Based on whether the calibration is applied, the step of acquiring the first dithered image or the second dithered image may include the step of acquiring the first dithered image by performing the first dithering on the input image based on the determination that the calibration is not applied. Based on whether the calibration is applied, the step of acquiring the first dithered image or the second dithered image may include the step of acquiring the second dithered image by performing second dithering applying the calibration on the input image based on the determination that the calibration is applied.

[0236] The step of acquiring user environment information including at least one of the above color temperature value or brightness value may include the step of measuring the color temperature of the user environment where the electronic device is located using a color sensor.

[0237] The step of obtaining user environment information including at least one of the color temperature value or brightness value may include the step of measuring the brightness of the user environment where the electronic device is located using a brightness sensor.

[0238] The step of acquiring user environment information including at least one of the color temperature value or brightness value may include receiving at least one of the color temperature value or brightness value measured in the user environment where the electronic device is located from an external device.

[0239] The step of acquiring user environment information including at least one of the color temperature value or brightness value may include the step of monitoring in real time at least one of the color temperature value or brightness value of the user environment where the electronic device is located.

[0240] The step of determining whether to apply calibration to the input image may include the step of calculating the difference between the color temperature value of the reference environment information and the color temperature value measured in the user environment.

[0241] The step of determining whether to apply calibration to the input image may include the step of determining to apply the calibration that compensates for the difference in the calculated color temperature values ​​based on the fact that the difference in the calculated color temperature values ​​is greater than or equal to a threshold value.

[0242] The step of calculating the difference between the color temperature value of the reference environment information and the color temperature value measured in the user environment may include the step of calculating the difference between the color temperature value of the reference environment information and the color temperature value measured in each zone of the user environment.

[0243] The step of deciding to apply the calibration that compensates for the difference in the calculated color temperature values ​​may include the step of deciding to apply the calibration that compensates for the difference in the calculated color temperature values ​​to each area of ​​the input image corresponding to each area of ​​the user environment, based on the fact that the difference in the calculated color temperature values ​​is greater than or equal to a threshold value.

[0244] The step of determining whether to apply calibration to the input image may include the step of calculating the difference between the brightness value of the reference environment information and the brightness value measured in the user environment.

[0245] The step of determining whether to apply calibration to the input image may include the step of determining to apply the calibration that compensates for the difference in the calculated brightness values ​​when the difference in the calculated brightness values ​​is greater than or equal to a threshold value.

[0246] The step of calculating the difference between the brightness value of the reference environment information and the brightness value measured in the user environment may include the step of calculating the difference between the brightness value of the reference environment information and the brightness value measured in each zone of the user environment.

[0247] The step of deciding to apply the calibration that compensates for the difference in the calculated brightness values ​​may include the step of deciding to apply the calibration that compensates for the difference in the calculated brightness values ​​to each area of ​​the input image corresponding to each area of ​​the user environment, based on the fact that the difference in the calculated brightness values ​​is greater than or equal to a threshold value.

[0248] The step of obtaining a second dithered image by performing a second dithering that applies the calibration to the input image may include a step of identifying a color required for compensation for the difference between at least one of the color temperature value or brightness value in the reference environment and the user environment, based on the determination to apply the calibration.

[0249] The step of obtaining a second dithered image by performing a second dithering that applies the calibration to the input image may include the step of combining electronic ink particles of the electronic device to generate the identified color.

[0250] The step of obtaining a second dithered image by performing a second dithering that applies the calibration to the input image may include the step of performing the second dithering on the input image to perform the difference compensation using the combined electronic ink particles.

[0251] The step of combining electronic ink particles of the electronic device to generate the identified color may include the step of determining a weight for the color temperature based on the magnitude of the color temperature required for the difference compensation.

[0252] The step of combining the electronic ink particles of the electronic device to generate the identified color may include the step of determining a weight for the brightness based on the magnitude of the brightness required for the difference compensation.

[0253] The step of combining the electronic ink particles of the electronic device to generate the identified color may include combining the electronic ink particles to preferentially compensate for the element with the higher weight among the color temperature or the brightness, based on the weight for the determined color temperature and the weight for the determined brightness.

[0254] The step of obtaining a second dithered image by performing a second dithering that applies the calibration to the input image may include the step of identifying a flat region in the input image based on the determination to apply the calibration.

[0255] The step of obtaining a second dithered image by performing a second dithering that applies the calibration to the input image may include the step of performing the second dithering that applies the calibration to the identified flat surface.

[0256] The step of outputting one of the first dithered image or the second dithered image may include the step of displaying the first dithered image based on the determination not to apply the calibration.

[0257] The step of outputting one of the first dithered image or the second dithered image may include the step of displaying the second dithered image based on the determination to apply the calibration.

[0258] According to one aspect of the present disclosure, an electronic device is provided.

[0259] The electronic device comprises at least one processor including processing circuitry; a memory for storing instructions; and a display, wherein the instructions can be executed individually or collectively by the at least one processor.

[0260] The above at least one processor can acquire reference environment information that serves as a reference for performing a first dithering on an input image.

[0261] The above at least one processor can acquire user environment information including at least one of a color temperature value or a brightness value measured in the user environment where the electronic device is located.

[0262] The above at least one processor can compare the user environment information and the reference environment information to determine whether to apply calibration to the input image so that the image shown in the user environment is displayed in the color of the image shown in the reference environment.

[0263] The above at least one processor can obtain a first dithered image in which the first dithering is performed on the input image or a second dithered image in which the second dithering is performed to apply the calibration to the input image, based on whether the calibration is applied.

[0264] The above at least one processor can output one of the first dithered image or the second dithered image.

[0265] The above at least one processor can obtain a first dithered image by performing the first dithering on the input image based on the determination not to apply the calibration.

[0266] The above at least one processor can obtain a second dithered image by performing a second dithering that applies the calibration to the input image based on the determination to apply the calibration.

[0267] The above electronic device may further include at least one sensor.

[0268] The above at least one processor can measure the color temperature of the user environment where the electronic device is located using a color sensor.

[0269] The above at least one processor can measure the brightness of the user environment where the electronic device is located using a brightness sensor.

[0270] The above electronic device may further include a communication interface.

[0271] The above at least one processor can receive at least one of a color temperature value or a brightness value measured in the user environment where the electronic device is located from an external device.

[0272] The above at least one processor can monitor in real time at least one of the color temperature value or brightness value of the user environment where the electronic device is located.

[0273] The above at least one processor can calculate the difference between the color temperature value of the reference environment information and the color temperature value measured in the user environment.

[0274] The above at least one processor may decide to apply the calibration that compensates for the difference in the calculated color temperature values ​​based on the fact that the difference in the calculated color temperature values ​​is greater than or equal to a threshold value.

[0275] The above at least one processor can calculate the difference between the color temperature value of the reference environment information and the color temperature value measured in each zone of the user environment.

[0276] The above at least one processor may determine to apply the calibration that compensates for the difference in the calculated color temperature value to each area of ​​the input image corresponding to each area of ​​the user environment, based on the fact that the difference in the calculated color temperature value is greater than or equal to a threshold value.

[0277] The above at least one processor can calculate the difference between the brightness value of the reference environment information and the brightness value measured in the user environment.

[0278] The above at least one processor may decide to apply the calibration that compensates for the difference in the calculated brightness value when the difference in the calculated brightness value is greater than or equal to a threshold value.

[0279] The above at least one processor can calculate the difference between the brightness value of the reference environment information and the brightness value measured in each zone of the user environment.

[0280] The above at least one processor may determine to apply the calibration that compensates for the difference in the calculated brightness value to each area of ​​the input image corresponding to each area of ​​the user environment, based on the fact that the difference in the calculated brightness value is greater than or equal to a threshold value.

[0281] The above at least one processor can identify a color required for compensating for the difference between at least one of the color temperature value or brightness value in the reference environment and the user environment, based on what is determined to apply the calibration.

[0282] The above at least one processor can combine electronic ink particles of the electronic device to generate the identified color.

[0283] The above at least one processor can perform the second dithering, which performs the difference compensation using the above combined electronic ink particles, on the input image.

[0284] The above at least one processor can determine a weight for the color temperature based on the magnitude of the color temperature required for the difference compensation.

[0285] The above at least one processor can determine a weight for the brightness based on the magnitude of the brightness required for the difference compensation.

[0286] The above at least one processor can combine the electronic ink particles to preferentially compensate the element with the higher weight among the color temperature or the brightness, based on the weight for the determined color temperature and the weight for the determined brightness.

[0287] The above at least one processor can identify a flat region in the input image based on the determination to apply the calibration.

[0288] The above at least one processor can perform the second dithering of applying the calibration to the identified flat surface.

[0289] The above at least one processor can display the first dithered image based on the determination not to apply the calibration.

[0290] The above at least one processor can display the second dithered image based on the determination to apply the calibration.

[0291] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0292] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

Claims

1. In an electronic device (2000), At least one processor (2100) including processing circuitry; Memory for storing instructions (2200); and Includes a display (2300), By executing the above instructions individually or collectively by the at least one processor (2100), the electronic device (2000) For the performance of the first dithering (410) on the input image (30), reference environment information that serves as a reference is obtained, and Acquiring user environment information including at least one of a color temperature value or a brightness value measured in the user environment where the above electronic device (2000) is located, and By comparing the above user environment information and the above reference environment information, a determination is made as to whether to apply calibration to the input image (30) so that the image shown in the above user environment is shown in the color of the image shown in the above reference environment, and Based on whether the above calibration is applied, a first dithered image (40) in which the first dithering is performed on the input image (30) or a second dithered image (50) in which the second dithering (610) (dithering) to which the calibration is applied is performed on the input image (30) is obtained, and An electronic device (2000) that outputs one of the first dithered image (40) or the second dithered image (50).

2. In Paragraph 1, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Based on the decision not to apply the above calibration, a first dithered image (40) is obtained by performing the first dithering on the input image (30), and An electronic device (2000) that obtains a second dithered image (50) by performing a second dithering (610) on the input image (30) based on the decision to apply the above calibration.

3. In either Paragraph 1 or Paragraph 2, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Based on the decision not to apply the above calibration, the first dithered image (40) is displayed, and An electronic device (2000) that displays the second dithered image (50) based on the determination to apply the above calibration.

4. In any one of paragraphs 1 through 3, The above electronic device (2000) further includes at least one sensor (2500), and By executing the above instructions by the at least one processor (2100), the electronic device (2000) Using a color sensor, the color temperature of the user environment where the electronic device (2000) is located is measured, and An electronic device (2000) that measures the brightness of the user environment where the electronic device (2000) is located using a brightness sensor.

5. In any one of paragraphs 1 through 4, By executing the above instructions by the at least one processor (2100), the electronic device (2000) An electronic device (2000) that receives at least one of a color temperature value or a brightness value measured in the user environment where the electronic device (2000) is located from an external device.

6. In any one of paragraphs 1 through 5, By executing the above instructions by the at least one processor (2100), the electronic device (2000) An electronic device (2000) that monitors in real time at least one of the color temperature value or brightness value of the user environment in which the electronic device (2000) is located.

7. In any one of paragraphs 1 through 6, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Calculate the difference between the color temperature value of the above reference environment information and the color temperature value measured in the above user environment, and An electronic device (2000) that determines to apply the calibration that compensates for the difference in the calculated color temperature values ​​based on the fact that the difference in the calculated color temperature values ​​is greater than or equal to a threshold value.

8. In Paragraph 7, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Calculate the difference between the color temperature value of the above reference environment information and the color temperature value measured in each zone of the above user environment, and An electronic device (2000) that determines to apply the calibration that compensates for the difference in the calculated color temperature values ​​to each area of ​​the input image corresponding to each area of ​​the user environment, based on the difference in the calculated color temperature values ​​being greater than or equal to a threshold value.

9. In any one of claims 1 to 8, by executing the instructions by the at least one processor (2100), the electronic device (2000), Calculate the difference between the brightness value of the above reference environment information and the brightness value measured in the above user environment, and An electronic device (2000) that determines to apply the calibration that compensates for the difference in the calculated brightness values ​​when the difference in the calculated brightness values ​​is greater than or equal to a threshold value.

10. In Paragraph 9, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Calculate the difference between the brightness value of the above reference environment information and the brightness value measured in each zone of the above user environment, and An electronic device (2000) that determines to apply the calibration that compensates for the difference in the calculated brightness value to each area of ​​the input image corresponding to each area of ​​the user environment, based on the difference in the calculated brightness value being greater than or equal to a threshold value.

11. In any one of paragraphs 1 through 10, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Based on the determination to apply the above calibration, the color required for compensation for the difference between at least one of the color temperature value or brightness value in the reference environment and the user environment is identified, and To generate the identified color, the electronic ink particles of the electronic device (2000) are combined, and An electronic device (2000) that performs the second dithering (610) for the input image (30) using the combined electronic ink particles to perform the difference compensation.

12. In Paragraph 11, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Based on the magnitude of the color temperature required for the above difference compensation, a weight for the color temperature is determined, and Based on the magnitude of brightness required for the above difference compensation, a weight for the brightness is determined, and An electronic device (2000) that combines the electronic ink particles to preferentially compensate for the element with the higher weight among the color temperature or the brightness, based on the weight for the determined color temperature and the weight for the determined brightness.

13. In any one of paragraphs 1 through 12, By executing the above instructions by the at least one processor (2100), the electronic device (2000) Based on the decision to apply the above calibration, a flat region is identified in the input image (30), and An electronic device (2000) that performs the second dithering (610) of applying the calibration to the identified flat surface.

14. A method for operating an electronic device (2000), A step of obtaining reference environment information that serves as a reference for performing a first dithering (410) on an input image (30); A step of obtaining user environment information including at least one of a color temperature value or a brightness value measured in the user environment where the electronic device (2000) is located; A step of determining whether to apply calibration to the input image (30) by comparing the above user environment information and the above reference environment information so that the image shown in the above user environment is shown in the color of the image shown in the above reference environment; A step of obtaining a first dithered image (40) in which the first dithering is performed on the input image (30) based on whether the above calibration is applied, or a second dithered image (50) in which the second dithering (610) (dithering) to which the above calibration is applied is performed on the input image (30); and A step of outputting one of the first dithered image (40) or the second dithered image (50); A method including 15. A computer-readable recording medium having a program recorded thereon for performing the method of paragraph 14 on a computer.

Images