System and method for enhancing display contour emphasis for low-vision person

Abstract

An electronic device is disclosed. The electronic device includes: a display including a self-luminous element; a memory storing one or more instructions; and one or more processors, wherein the one or more processors execute the one or more instructions to: identify a contour region in an input image when a low-vision person mode is activated; identify a contour emphasis region in the input image and expand the contour region by a preset thickness in the contour emphasis region; process the input image so that a first region corresponding to one direction with respect to the contour region in the contour emphasis region includes a first color and a second region corresponding to the opposite direction to the one direction includes a second color; and provide the processed input image through a display. The first color may be a preset color, and the second color may be a color in which a color corresponding to the contour region in the input image and the preset color are blended.

Description

System and method for enhancing display outline emphasis for low vision users

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more particularly, to an electronic device providing a viewing mode for a person with low vision and a method for controlling the same.

[0002] Advances in electronic technology have led to the development and proliferation of various types of electronic devices. In particular, display devices such as TVs and laptops are being developed in various forms.

[0003] Display devices such as TVs typically provide a low vision mode (or relumino mode) to assist visually impaired people with low vision.

[0004] One example of a low-vision mode is highlighting outline areas with a specific color. The highlighting feature can help low-vision users better perceive the shape and movement of objects by highlighting the edges of the image. However, this can also place excessive stress on certain pixels, increasing the likelihood of burn-in.

[0005] An electronic device according to one or more embodiments includes a display including a self-luminous element; a memory storing one or more commands; and one or more processors, wherein the one or more processors execute the one or more commands to, when a low vision mode is activated, identify an outline region in an input image, identify an outline highlight region in the input image, expand the outline region in the outline highlight region by a preset thickness, process the input image such that, in the outline highlight region, a first region corresponding to one direction based on the outline region includes a first color and a second region corresponding to a direction opposite to the one direction includes a second color, and provide the processed input image through the display. The first color may be a preset color, and the second color may be a color blended between a color corresponding to the outline region in the input image and the preset color.

[0006] According to one or more embodiments, a control method of an electronic device includes the steps of: identifying an outline region in an input image when a low vision mode is activated; identifying an outline highlight region in the input image and expanding the outline region in the outline highlight region by a preset thickness; processing the input image such that, in the outline highlight region, a first region corresponding to one direction based on the outline region includes a first color and a second region corresponding to a direction opposite to the one direction includes a second color; and displaying the processed input image. The first color may be a preset color, and the second color may be a color obtained by blending a color corresponding to the outline region in the input image and the preset color.

[0007] According to one or more embodiments, a non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device, cause the electronic device to perform an operation, the operation includes: when a low vision mode is activated, identifying an outline region in an input image; identifying an outline highlight region in the input image and expanding the outline region in the outline highlight region by a preset thickness; processing the input image such that, in the outline highlight region, a first region corresponding to one direction based on the outline region includes a first color and a second region corresponding to a direction opposite to the one direction includes a second color; and displaying the processed input image. The first color may be a preset color, and the second color may be a color obtained by blending a color corresponding to the outline region in the input image and the preset color.

[0008] The above and other aspects and features of specific embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0009] FIGS. 1A to 1F are drawings illustrating a low vision mode according to one or more embodiments.

[0010] FIG. 2A is a block diagram showing the configuration of an electronic device according to one embodiment.

[0011] FIG. 2b is a block diagram specifically illustrating a configuration of an electronic device according to one or more embodiments.

[0012] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0013] FIG. 4 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0014] FIG. 5 is a drawing for explaining a contour detection method according to one or more embodiments.

[0015] FIGS. 6A to 6C are drawings for explaining a method for expanding an outline area according to one or more embodiments.

[0016] FIG. 7 is a drawing for explaining a method for processing an outline highlight area according to one or more embodiments.

[0017] FIG. 8 is a diagram illustrating a method for obtaining local contrast information according to one or more embodiments.

[0018] FIGS. 9A and 9B are drawings for explaining a method for obtaining local contrast information of an outline highlight area according to one or more embodiments.

[0019] FIGS. 10A and 10B are drawings for explaining an outline highlighting method according to one or more embodiments.

[0020] FIG. 11 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0021] FIGS. 12A and 12B are drawings for explaining a method of highlighting an outline according to an outline thickness according to one or more embodiments.

[0022] FIG. 13 is a drawing for explaining a method for identifying a color of an outline highlight area according to one or more embodiments.

[0023] FIG. 14 is a drawing for explaining a method for identifying a color of an outline highlight area according to one or more embodiments.

[0024] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions or cases of those skilled in the art, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0025] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0026] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to cases where (1) only A is included, (2) only B is included, or (3) both A and B are included.

[0027] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0028] When it is said that a component (e.g., a first component) is “operatively or communicatively coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0029] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0030] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0031] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0032] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor, excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0033] The various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacings drawn in the attached drawings.

[0034] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0035] FIGS. 1A to 1F are drawings illustrating a low vision mode according to one or more embodiments.

[0036] According to one embodiment, the electronic device (100) can provide a low vision mode (or illumino mode).

[0037] Low vision mode may be a special feature designed for users with visual difficulties. Low vision mode may provide various assistive functions, such as outline highlighting (or outline highlighting), text size and font adjustment, brightness and contrast adjustment, color adjustment, and voice guidance and commentary. Low vision mode may also include a user-defined function that allows the user to save and manage preferred settings. Generally, low vision users tend to prefer images in which the detailed expression within an object is omitted and the object's outline is more clearly emphasized. Accordingly, the electronic device (100) may perform outline highlighting processing (10) to emphasize the outline of an object included in an input image, as illustrated in FIG. 1A.

[0038] For example, as illustrated in FIG. 1B, the electronic device (100) may utilize a black outline (20), a green outline (30), and a yellow outline (40) for outline emphasis. Generally, individuals with low vision have a high sensitivity to green or yellow colors when their contrast perception ability is reduced, so any one of black, green, or yellow may be used as the outline emphasis color.

[0039] As an example, when a 3-pixel outline (51) of an input image is emphasized with a 7-pixel black outline (61) as shown in FIG. 1c, the gray code value of the pixel corresponding to the extended outline as shown below can be replaced with a 0 value as shown in the left graph (62) from the value shown in the right graph (52).

[0040] For example, when a black outline (20) is used for outline emphasis as shown in FIG. 1d, the stress of the pixels around the outline where burn-in is strongly visible can be reduced by turning off the pixels around the outline (e.g., CV = 0).

[0041] Burn-in occurs when a specific image or icon remains on the screen, either temporarily or permanently, as a shadow after being displayed for an extended period of time. Burn-in can often be caused by pixel deterioration (e.g., increased consumption of organic light-emitting diodes) when the same screen element is displayed for an extended period of time.

[0042] For example, when using the green outline (30) as illustrated in Fig. 1d for outline emphasis, there is a problem that only green pixels are driven (e.g., CV = 255), and thus only green pixels may be deteriorated.

[0043] For example, when a yellow outline (40) is used for outline emphasis as shown in FIG. 1d, only red pixels and green pixels are driven (e.g., CV = 255), so the red pixels and green pixels are deteriorated and only the stress of the blue pixels can be reduced.

[0044] For example, when a black outline (20) is used for outline emphasis as illustrated in FIG. 1e, red pixels, green pixels, and blue pixels are not driven in the outline area, so pixel degradation does not occur in the outline area. Accordingly, color deviation (or color distortion) does not occur in the outline as illustrated in FIG. 1f.

[0045] For example, when green is used for outline enhancement as illustrated in Fig. 1e, only green pixels in the outline area deteriorate. Consequently, color deviation occurs in the outline as illustrated in Fig. 1f.

[0046] For example, when a yellow outline (40) is used for outline enhancement as illustrated in FIG. 1e, red and green pixels in the outline area deteriorate. Consequently, color deviation occurs in the outline as illustrated in FIG. 1f.

[0047] Accordingly, the following describes various embodiments for reducing the burn-in risk that may occur when providing a low vision mode in a display including a self-luminous element.

[0048] FIG. 2A is a block diagram showing the configuration of an electronic device according to one embodiment.

[0049] According to FIG. 2a, the electronic device (100) includes a memory (110), a display (120), and one or more processors (130).

[0050] The electronic device (100) may be implemented as various types of display devices such as a TV, monitor, PC, kiosk, tablet PC, electronic picture frame, mobile phone, HMD (Head mounted Display), NED (Near Eye Display), LFD (Large format display), Digital Signage (digital signage), DID (Digital Information Display), video wall, projector display, etc., or as an image processing device (e.g., set-top box, one connected box) that provides images to the display device.

[0051] The memory (110) can store data required for various embodiments. The memory (110) may be implemented in the form of memory embedded in the electronic device (100') or in the form of memory that can be detachably attached to the electronic device (100) depending on the purpose of data storage. For example, data for driving the electronic device (100) may be stored in a memory embedded in the electronic device (100'), and data for expanding the functions of the electronic device (100) may be stored in a memory that can be detachably attached to the electronic device (100). Meanwhile, in the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD). In addition, in the case of memory that can be attached or detached to the electronic device (100'), it may be implemented as at least one of memory cards (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. It can be implemented in the form of.

[0052] In one example, the memory (110) may store a computer program including at least one instruction or instructions for controlling the electronic device (100).

[0053] In another example, the memory (110) may store an image received from an external device (e.g., a source device), an external storage medium (e.g., USB), an external server (e.g., a web hard drive), or the like, i.e., an input image. Alternatively, the memory (110) may store an image acquired through a camera provided in the electronic device (100). Here, the image may be a 2D video, but is not limited thereto.

[0054] As another example, the memory (110) may store various information required for image quality processing, such as information, algorithms, image quality parameters, etc. for performing at least one of Noise Reduction, Detail Enhancement, Tone Mapping, Contrast Enhancement, Color Enhancement, or Frame Rate Conversion. In addition, the memory (110) may also store an intermediate image generated by image processing and an image generated based on depth information.

[0055] According to one embodiment, the memory (110) may be implemented as a single memory that stores data generated from various operations according to the present disclosure. However, according to another embodiment, the memory (110) may be implemented to include multiple memories that each store different types of data or each store data generated at different stages.

[0056] In the above-described embodiment, it has been described that various data are stored in the external memory (110) of the processor (130), but at least some of the above-described data may be stored in the internal memory of the processor (130) according to an implementation example of at least one of the electronic device (100) or the processor (130).

[0057] The display (120) may be implemented as a display including a display that includes a self-luminous element. For example, the display (120) may be implemented as a display in various forms such as an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (120) may also include a driving circuit, a backlight unit, etc., which may be implemented in a form such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc. According to an example, a touch sensor that detects a touch operation in the form of a touch film, a touch sheet, a touch pad, etc. may be disposed on the front of the display (120) so as to be implemented so as to detect various types of touch inputs. For example, the display (120) can detect various types of touch inputs, such as a touch input by a user's hand, a touch input by an input device such as a stylus pen, and a touch input by a specific electrostatic material. Here, the input device can be implemented as a pen-type input device that can be referred to by various terms such as an electronic pen, a stylus pen, an S-pen, etc. According to an example, the display (120) can be implemented as a flat display, a curved display, a flexible display that can be folded or / and rolled, etc.

[0058] For example, if the display (120) is implemented as an OLED display, it may be implemented as an RGB OLED or a WRGB OLED. RGB OLED has an advantage in that each pixel has an independent organic light-emitting diode and expresses all three colors of red, green, and blue, and this structure allows for high color reproducibility and deep black color expression. On the other hand, WRGB OLED has an advantage in that each pixel is composed of four sub-pixels, one of which can be implemented as an organic light-emitting diode that emits white light. WRGB OLED has an advantage in that it provides more options for adjusting the luminance, which can increase screen brightness, but it also has a disadvantage in that the color reproducibility may be relatively low. Burn-in issues mainly occur when the same image or scene is continuously displayed on an OLED display for a long period of time, and this can occur because each pixel is continuously active. In this case, a difference in burn-in speed may occur between RGB OLED and WRGB OLED due to the pixel structure. For example, WRGB OLEDs use white sub-pixels to adjust brightness, so burn-in may be less likely to occur than RGB OLEDs.

[0059] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be operatively connected to the memory (110) to control the overall operation of the electronic device (100). One or more processors (130) may be configured as one or more processors.

[0060] One or more processors (130) may perform operations of the electronic device (100) according to various embodiments by executing at least one instruction stored in the memory (110).

[0061] The one or more processors (130) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (130) may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The one or more processors (130) may execute one or more programs or instructions stored in a memory. For example, the one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in a memory.

[0062] When a method according to one or more embodiments of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0063] One or more processors (130) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (130) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to one or more embodiments of the present disclosure.

[0064] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0065] In the embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. Hereinafter, for the convenience of explanation, one or more processors (130) will be referred to as a processor (130).

[0066] According to one embodiment, the electronic device (100) can receive various compressed images or images of various resolutions. For example, the electronic device (100) can receive images in a compressed form such as MPEG (Moving Picture Experts Group) (e.g., MP2, MP4, MP7, etc.), JPEG (joint photographic coding experts group), AVC (Advanced Video Coding), H.264, H.265, HEVC (High Efficiency Video Codec), etc. Alternatively, the electronic device (100) can receive any one of SD (Standard Definition), HD (High Definition), Full HD, and Ultra HD images.

[0067] For example, the processor (130) may process an input image and then acquire depth information based on the processed image. Here, the image processing may be digital image processing including at least one of image enhancement, image restoration, image transformation, image analysis, image understanding, image compression, image decoding, or scaling.

[0068] For example, various preprocessing may be performed on an input image, but for convenience of explanation, the input image and the preprocessed image will not be distinguished and will be referred to as an input image.

[0069] In this specification, "region" is a term referring to a portion of an image, and means at least one pixel block or a set of pixel blocks. In addition, a pixel block means a set of adjacent pixels that include at least one pixel.

[0070] According to one embodiment, the processor (130) can identify an outline region in an input image when the low vision mode is executed. The processor (130) can identify an outline highlight region in which the outline region is expanded by a preset thickness.

[0071] The processor (130) can process the input image so that a first area included in the outline highlight area includes a first color and a second area of ​​the outline highlight area includes a second color.

[0072] For example, the first region and the second region may be regions identified based on an outline included in the outline highlight region. For example, the first region may be a region in one direction based on the outline, and the second region may be a region in one direction and an opposite direction based on the outline.

[0073] For example, the first color may be a preset color. For example, the second color may be a color obtained by blending a color corresponding to the outline area in the input image and the preset color.

[0074] According to one embodiment, local contrast information corresponding to an outline highlight area may be identified, and a weight may be identified based on the local contrast information. According to one example, the processor (130) may identify local contrast information corresponding to a second area. According to one example, the processor (130) may identify a first weight based on the local contrast information, apply the first weight to a preset color, and apply the second weight identified based on the first weight to the color corresponding to the outline highlight area to identify the second color. For example, the processor (130) may identify a local contrast value corresponding to each pixel included in the outline highlight area, identify a first weight corresponding to each pixel based on the local contrast value, and apply the identified first weight to a preset color. The processor (130) can apply the second weight identified based on the first weight to the input color corresponding to each pixel, and identify the second color corresponding to each pixel by blending the preset color to which the first weight is applied and the input color to which the second weight is applied.

[0075] According to one embodiment, the processor (130) can identify an outline highlight area that is extended to a preset thickness on one side when one side of the outline area is a black area (or an area close to black) and the other side is a white area (or an area close to white).

[0076] According to one embodiment, the processor (130) can identify an outline highlight area expanded by a preset thickness by expanding the outline area by the same thickness on both sides when both sides are white areas (or areas close to white) based on the outline area.

[0077] FIG. 2b is a block diagram specifically illustrating a configuration of an electronic device according to one or more embodiments.

[0078] According to FIG. 2b, the electronic device (100') may include a memory (110), a display (120), one or more processors (130), a user interface (140), a communication interface (150), a speaker (160), and a camera (170). Among the configurations illustrated in FIG. 2b, a detailed description of configurations that overlap with those illustrated in FIG. 2a will be omitted.

[0079] The user interface (140) may be implemented as a device such as a button, a touch pad, a mouse, and a keyboard, or as a touch screen that can also perform the display function and operation input function described above.

[0080] For example, the user interface (140) may receive user commands for selecting a low vision mode, user commands for selecting the thickness and / or color of an outline (or edge) in the low vision mode, etc.

[0081] It goes without saying that the communication interface (150) can be implemented as various interfaces depending on the implementation example of the electronic device (100'). For example, the communication interface (140) can communicate with an external device, an external storage medium (e.g., a USB memory), an external server (e.g., a web hard drive), etc. through a communication method such as Bluetooth, AP-based Wi-Fi (Wireless LAN network), Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), MHL (Mobile High-Definition Link), AES / EBU (Audio Engineering Society / European Broadcasting Union), optical, coaxial, etc. In one example, the communication interface (150) can communicate with another electronic device, an external server, and / or a remote control device.

[0082] The speaker (160) may be configured to output various audio data as well as various notification sounds or voice messages. The processor (130) may control the speaker (160) to output feedback or various notifications in audio format according to various embodiments of the present disclosure.

[0083] The camera (170) can be turned on and perform shooting based on a preset event. The camera (170) can convert captured images into electrical signals and generate image data based on the converted signals. For example, the camera (170) can include at least one of a standard (or basic) camera and an ultra-wide-angle camera.

[0084] In addition, the electronic device (100') may include sensors, microphones, etc., depending on the implementation example.

[0085] Sensors may include various types of sensors, such as touch sensors, proximity sensors, acceleration sensors (or gravity sensors), geomagnetic sensors, gyro sensors, pressure sensors, position sensors, distance sensors, light sensors, etc.

[0086] A microphone is a device configured to receive user voice or other sounds and convert them into audio data. However, according to another embodiment, the electronic device (100') may receive user voice input via an external device through a communication interface (160).

[0087] FIG. 3 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0088] According to FIG. 3, in operation 310, the electronic device (100) can identify whether the low vision mode is running.

[0089] When the low vision mode is activated (S310:Y), in operation 320, the electronic device (100) can identify an outline area (or outline area) in the input image. The outline of the image is a line indicating the boundary of an object or pattern, and can be formed mainly due to changes in brightness or color.

[0090] For example, the electronic device (100) can detect an outline area in an image based on edge detection, Hough transform, contour extraction, etc.

[0091] Edge detection is a technique for finding areas in an image where brightness or color changes rapidly. It can detect distinct outlines in an image using filters such as the Sobel filter, Canny filter, and Laplacian filter.

[0092] Hough Transform is a technique for detecting the outline of geometric shapes such as straight lines or circles. It can detect the outline by converting the equation of the straight line or circle in image space into parameter space.

[0093] Contour Extraction is a technology that detects the contours that represent the outer edges of objects in an image. After detecting the outline, it can be approximated to detect the outer edges of an object.

[0094] In operation 330, the electronic device (100) can identify an outline highlight area in which the outline area is extended by a preset thickness.

[0095] Outline emphasis is a technique for clearly emphasizing outlines in an image. According to one embodiment, the electronic device (100) can provide an expanded outline area for outline emphasis.

[0096] For example, the electronic device (100) may expand the detected outline area by a preset thickness so that the outline can be emphasized. For example, the preset thickness may be determined based on user selection, but is not limited thereto. For example, the expanded outline thickness may be automatically determined based on user profile information, or the expanded outline thickness may be automatically determined based on the characteristics of the image.

[0097] In operation 340, the electronic device (100) can process the input image so that an area included in the outline highlight area includes a first color and the remaining area of ​​the outline highlight area includes a second color.

[0098] For example, the first color may be a preset color. For example, the preset color may include any one of black, green, or yellow. Generally, people with low vision have a high sensitivity to green or yellow due to their reduced contrast perception ability, so any one of black, green, or yellow may be used as the outline highlight color. For example, the preset color may be determined based on user selection, but is not limited thereto. For example, the outline highlight color may be automatically determined based on user profile information, or the outline highlight color may be automatically determined based on the characteristics of the image.

[0099] For example, the second color may be a color that is a blend of a color corresponding to the outline area in the input image and a preset color.

[0100] For example, the electronic device (100) may apply a first weight to a preset color, apply a second weight identified based on the first weight to a color corresponding to an outline highlight area, and then blend the weighted colors to identify the second color. For example, the sum of the first weight and the second weight may be 1, and when the first weight is identified, the second weight may be calculated as "1 - the first weight."

[0101] In operation 350, the electronic device (100) can display the processed input image.

[0102] As described above, in the low vision mode according to one embodiment, it is possible to assist low vision users in viewing images by emphasizing outlines.

[0103] In Fig. 3, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0104] FIG. 4 is a flowchart illustrating a method for controlling an electronic device according to one or more embodiments.

[0105] Among the operations illustrated in Fig. 4, detailed descriptions of operations that overlap with those illustrated in Fig. 3 will be omitted.

[0106] According to FIG. 4, in operation 410, the electronic device (100) can identify whether the low vision mode is running.

[0107] When the low vision mode is executed (S410:Y), in operation 420, the electronic device (100) can obtain a local contrast map based on the input image.

[0108] Local contrast refers to information indicating the brightness difference between pixels locally in an image. Local contrast can indicate how sharp the contrast is in each part of the image. The higher the local contrast, the greater the brightness difference between adjacent pixels.

[0109] For example, the electronic device (100) can define a window around each pixel of an image and obtain a local contrast map by calculating the brightness difference between pixels within the window.

[0110] In operation 430, the electronic device (100) can identify an outline area in the input image.

[0111] In operation 440, the electronic device (100) can identify an outline highlight area in which the outline area is extended by a preset thickness.

[0112] For example, the electronic device (100) may identify an outline highlight area by expanding an outline area using a dilation filter. For example, the thickness by which the outline area is expanded may vary depending on the size of the dilation filter. For example, the outline highlight thickness may be determined based on a user selection, and the electronic device (100) may apply dilation filters of different sizes to the outline area based on the determined outline highlight thickness.

[0113] In operation 450, the electronic device (100) can identify local contrast information corresponding to the outline highlight area based on the local contrast map.

[0114] In operation 460, the electronic device (100) may identify a weight based on local contrast information. In one example, the electronic device (100) may identify a weight corresponding to local contrast information corresponding to the outline highlight area, i.e., the extended outline area. For example, a local contrast value may be high at the outline, and the local contrast value may decrease as one moves away from the outline. Accordingly, a weight may be high at the outline, and the weight may decrease as one moves away from the outline.

[0115] In operation 470, the electronic device (100) can identify a second color by blending a color corresponding to the outline highlight area and a preset first color based on the identified weight.

[0116] In one example, a first weight corresponding to local contrast information corresponding to an outline highlight area may be applied to a preset first color, and a second weight identified based on the first weight may be applied to a color corresponding to the outline highlight area to identify a second color. For example, the electronic device (100) may identify a local contrast value corresponding to each pixel included in the outline highlight area, and identify a first weight corresponding to each pixel based on the local contrast value. For example, the electronic device (100) may apply the second weight identified based on the first weight to an input color corresponding to each pixel, and identify the second color by blending the preset first color to which the first weight is applied and the input color to which the second weight is applied. For example, since a weight corresponding to a local contrast value is high and may decrease as it moves away from the outline, the first weight may decrease as it moves away from the outline, and the second weight may increase as it moves away from the outline.

[0117] In operation 480, the electronic device (100) can process the input image so that an area included in the outline highlight area includes a preset first color and the remaining area of ​​the outline highlight area includes a second color.

[0118] In operation 490, the electronic device (100) can display the processed input image.

[0119] According to one embodiment, the electronic device (100) may perform the above-described outline emphasis processing when the local contrast value of the outline area is equal to or greater than a preset value, i.e., when the difference in brightness between two areas based on the outline area is equal to or greater than a preset value, but is not necessarily limited thereto.

[0120] In Fig. 4, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0121] FIG. 5 is a drawing for explaining a contour detection method according to one or more embodiments.

[0122] According to FIG. 5, the electronic device (100) can detect an outline based on a blurred image (510). However, in some cases, it may also be possible to detect an outline based on an unblurred image. According to one example, the electronic device (100) can convert an RGB domain image into a YUV domain and perform outline detection based on a Y value image in the YUV domain.

[0123] The electronic device (100) can obtain first values, for example, Gh[x][y] and Gv[x][y], by applying a first filter (521) and a second filter (522) to the blurred image (510). For example, the first filter (521) may be a vertical Sobel filter, and the second filter (522) may be a horizontal Sobel filter, but is not limited thereto. For example, the first filter (521) and the second filter (522) may be 3*3 or 5*5 filters, but are not limited thereto.

[0124] The electronic device (100) can obtain a second value, Gmag[x][y], based on first values, for example, Gh[x][y] and Gv[x][y]. For example, the electronic device (100) can obtain Gmag[x][y] based on the mathematical expression (530) illustrated in FIG. 5. For example, Gmag[x][y] can be a magnitude value of a gradient.

[0125] The electronic device (100) can obtain an outline intensity value, for example, e[x][y], based on the second value. For example, the electronic device (100) can obtain an outline intensity value, for example, e, by applying a threshold value to Gmag[x][y] based on the relational expression (540) illustrated in FIG. 5 (550). For example, the threshold values ​​T1 and T2 can be adjustable parameters by H / W registers.

[0126] FIGS. 6A to 6C are drawings for explaining a method for expanding an outline area according to one or more embodiments.

[0127] Contour Expansion is a process that expands contours detected in an image according to certain rules. For example, the electronic device (100) may expand the contour area using a filter. For example, the electronic device (100) may expand the contour area using a dilation filter. Generally, contours represent strong boundaries between pixels in an image, so using a dilation filter can increase local features around the contour, thereby expanding the contour area.

[0128] As an example, the electronic device (100) can adjust the outline thickness to a desired thickness using a dilation filter as illustrated in FIGS. 6A and 6B . For example, it is assumed that the outline thickness can be adjusted to three levels: weak, medium, and strong.

[0129] For example, when a 1*1 ilation filter is applied to the edge strength e[x][y] located at the center of the image (610) as illustrated in FIG. 6a, the outline thickness can become a weak level (611). For example, the weak level can be a level that maintains the original thickness.

[0130] For example, when a 3*3 ilation filter is applied to the edge strength e[x][y] located at the center of the image (620) as illustrated in FIG. 6b, the outline thickness can become a medium level (621). For example, the medium level can be expanded by a certain amount compared to the original thickness.

[0131] For example, when a 5*5 ilation filter is applied to the edge strength e[x][y] located at the center of the image (620) as illustrated in FIG. 6c, the outline thickness can become a strong level (631). For example, the strong level can be extended by a certain amount more than the thickness of the medium level.

[0132] FIGS. 7A to 7C are drawings for explaining a method for processing an outline highlight area according to one or more embodiments.

[0133] According to one embodiment, the electronic device (100) may process an outline highlight area by blending pixel values ​​of an input image and a preset first color. For example, the preset first color may be a color selected for outline highlighting in a low vision mode. For example, the first color may be, but is not limited to, one of black, yellow, or green.

[0134] According to FIG. 7, the electronic device (100) can perform highlight processing (720) on an outline area in an input image (710). According to one example, the electronic device (100) can process an outline highlight area by blending pixel values ​​of the input image and a preset first color based on a blending weight.

[0135] For example, the electronic device (100) can process an outline highlight area (732) in which an outline area (731) is extended by applying a weight of 1 to the first color when the blending weight is 1 and applying a weight of 0 to the pixel value of the input image.

[0136] For example, the electronic device (100) may process the outline highlight area (733) by applying a weight of 0.5 to the first color when the blending weight is 0.5 and by applying a weight of 0.5 to the pixel value of the input image.

[0137] For example, the electronic device (100) may process the outline highlight area (734) by applying a weight of 0.3 to the first color and a weight of 0.7 to the pixel value of the input image when the blending weight is 0.3.

[0138] According to one embodiment, the electronic device can calculate Y, U, and V values ​​for outline enhancement processing based on the following mathematical expression 1.

[0139]

[0140]

[0141]

[0142] Y in [x][y] is the pixel value of the input pixel, Y edge may be a preset first color for outline highlighting.

[0143] However, according to one embodiment, a fixed weight W for the outline highlight area as in Fig. 7 Y Instead of applying the weights, different weights can be applied to each region based on local contrast information.

[0144] FIG. 8 is a diagram illustrating a method for obtaining local contrast information according to one or more embodiments.

[0145] According to FIG. 8, the electronic device (100) can obtain a down-sampled image (820) by down-sampling (or down-scaling) an input image (810), and obtain a first local contrast map (830) by measuring a local contrast value based on the down-sampled image (820).

[0146] The electronic device (100) can upsample (or upscale) the first local contrast map (830) to obtain a second local contrast map (840) of the original size. For example, the second local contrast map (840) can be a smoothed map.

[0147] In one example, the electronic device (100) can calculate the color of the outline highlight area based on the second local contrast map (840). For example, the electronic device (100) can determine a weight for calculating the color of the outline highlight area based on the second local contrast map (840).

[0148] However, although the above-described embodiment describes a case where the input image (810) is down-sampled to obtain a local contrast map in order to reduce the amount of computation, it is not limited thereto. For example, a third local contrast map (850) can be obtained by measuring a local contrast value based on the input image (810), and the color of the outline highlight area can be calculated based on the third local contrast map (850).

[0149] FIGS. 9A and 9B are drawings for explaining a method for obtaining local contrast information of an outline highlight area according to one or more embodiments.

[0150] According to FIG. 9a, when a local area (911) including an outline is identified in an input image (910), the electronic device (100) can obtain an outline map based on an image (920) corresponding to the local area (911) (930).

[0151] An edge map is an image that visually represents the contours of an image. It is generated by edge detection algorithms and can be visually expressed by highlighting points where brightness and darkness change significantly. Edge detection algorithms detect changes in brightness or color between pixels in an image to detect contours, visualizing the results as an edge map. Edge maps are typically expressed as black-and-white or grayscale images, with outlined areas displayed as white or light colors, and non-outlined areas displayed as black or dark colors.

[0152] For example, the electronic device (100) may distinguish between two regions based on an edge region based on an edge threshold value in an edge map. For example, in order to identify an edge, the brightness or pixel intensity of a pixel corresponding to the edge must exceed a specific threshold value, and this threshold value may be referred to as an "edge threshold value." The edge threshold value may be set by the user or determined automatically. For example, the user may manually adjust the threshold value to determine which intensity change is considered an edge. For example, when the edge threshold value is determined automatically, the optimal threshold value may be determined based on the characteristics of the image or an algorithm.

[0153] According to one example, the electronic device (100) can perform contour expansion processing on a contour area included in the contour map (940).

[0154] According to one example, the electronic device (100) can measure a local contrast value corresponding to the expanded contour highlight area (950).

[0155] For example, according to FIG. 9b, a local contrast value corresponding to an outline highlight area in an input image (910) can be measured to obtain a local contrast value (920) corresponding to an outline highlight area.

[0156] FIGS. 10A and 10B are drawings for explaining an outline highlighting method according to one or more embodiments.

[0157] According to FIG. 10a, the electronic device (100) can identify the color of the outline area (1010) based on the local contrast value corresponding to the outline area (1010) identified in the input image (1000).

[0158] For example, the electronic device (100) may perform outline highlight processing by applying different colors to a first area (1011) corresponding to a relatively dark area in an outline area (1010) and a second area (1012) corresponding to a relatively bright area.

[0159] For example, the electronic device (100) may process outline emphasis with a preset first color for a first area (1011) corresponding to a dark area. For example, the preset first color may include either yellow or green.

[0160] For example, the electronic device (100) can process outline emphasis for a second area (1012) corresponding to a bright area using a preset first color applied to the first area (1011) and a second color determined based on the color of the input image corresponding to the second area (1012).

[0161] In one example, the electronic device (100) may identify (1020) a first weight based on a local contrast value corresponding to a second region (1010) and identify a second weight based on the first weight. For example, the sum of the first weight and the second weight may be 1.

[0162] For example, the electronic device (100) may identify a second color by applying a first weight to a preset first color and a second weight to a color of an input image corresponding to a second region (1012). For example, the electronic device (100) may identify a second color corresponding to each pixel included in the second region (1012). For example, the second color may be a color obtained by blending the preset first color and the color of the input image for each pixel based on the first weight and the second weight.

[0163] For example, the electronic device (100) can identify a second color by converting the R, G, B domains of the input image into Y, U, V domains, and applying weights corresponding to the Y, U, and V values ​​in the Y, U, and V domains. For example, the electronic device (100) can convert the color of the input image corresponding to the second area (1012) into the Y, U, and V domains, and then convert the first color into the Y, U, and V domains, and then apply weights W to each of the Y, U, and V values ​​of the first color. Y , W U , W V Apply and weight 1-W to each of the Y, U, and V values ​​of the color of the input image Y , 1-W U , 1-W V By applying the weighted values ​​and blending them in the same manner as mathematical expression 1, the second color corresponding to each pixel included in the second area (1012) can be identified.

[0164] According to FIG. 10b, the electronic device (100) can divide the outline highlight area (1030) into multiple areas (1031, 1012) and apply different highlight processing methods. The outline highlight area (1010) may be an area where the outline area has been expanded.

[0165] For example, the electronic device (100) may perform outline highlight processing on a first area (1031) among the outline highlight areas (1030) using a preset first color. For example, the preset first color may include any one of black, yellow, or green. For example, the first area (1031) may be an outline highlight area included in a relatively dark area based on the outline.

[0166] For example, the electronic device (100) may perform outline highlight processing for a second region (1032) among the outline highlight regions (1030) by blending a color (e.g., green) applied to the first region (1032) and a corresponding color (e.g., red) of the input image. For example, the second region (1032) may be an outline highlight region included in a relatively bright region based on the outline.

[0167] In one example, the electronic device (100) sets a first weight W based on a local contrast value corresponding to the second area (1032). Y,U,V Identify and weight the second weight based on the first weight 1- W Y,U,V can be identified. For example, the sum of the first weight and the second weight may be 1.

[0168] In one example, the electronic device (100) has a first weight W Y,U,V Apply the second weight 1- W to the Y, U, and V values ​​of the first color that is set Y,U,V The second color can be identified by applying the Y value, U value, and V value of the input color corresponding to the second area (1032). For example, the electronic device (100) can identify the second color corresponding to each pixel included in the second area (1032). For example, the second color is a preset first color and the color of the input image is a first weight W Y,U,V and the second weight 1- W Y,U,VIt can be a blended color for each pixel based on .

[0169] FIG. 11 is a flowchart illustrating a method of controlling an electronic device according to one or more embodiments.

[0170] Among the operations illustrated in Fig. 11, detailed descriptions of operations that overlap with those illustrated in Figs. 3 and 4 will be omitted.

[0171] According to FIG. 11, in operation 1110, the electronic device (100) can identify whether the low vision mode is running.

[0172] When the low vision mode is executed (S1110:Y), in operation 1120, the electronic device (100) can obtain a local contrast map based on the input image.

[0173] In operation 1130, the electronic device (100) can identify an outline area in the input image.

[0174] In operation 1140, the electronic device (100) can identify an outline highlight area in which the outline area is extended by a preset thickness.

[0175] In operation 1150, the electronic device (100) can identify local contrast information corresponding to the outline highlight area based on the local contrast map.

[0176] At operation 1160, the electronic device (100) can identify weights based on local contrast information and pixel shift information.

[0177] Pixel shift is a technique to alleviate burn-in, which can occur when static images or the same image are displayed on the screen for a long time, by moving the pixels of an image by a certain distance or direction.

[0178] Typically, displays output data from fixed pixel locations. Pixel shifting can prevent excessive current concentration in specific locations by periodically changing these locations. This can evenly distribute the electrical load between pixels, reducing the possibility of burn-in. Furthermore, pixel shifting can be used to improve screen refresh rates. As pixels slightly shift from their original positions, the human eye perceives moving images more smoothly, resulting in a better viewing experience for games and video content.

[0179] For example, the electronic device (100) may determine the lower bound of the weight by comparing the pixel shift distance and the thickness of the outline highlight region according to the pixel shift. For example, if the thickness of the outline highlight region is included within the pixel shift distance, the electronic device (100) may maintain the lower bound of the weight at a preset value. For example, if the thickness of the outline highlight region is not included within the pixel shift distance, the electronic device (100) may adjust the minimum value of the weight to a value lower than the preset value. This is to prevent the possibility of pixel deterioration by reducing the weight applied to the preset color since there is a high possibility of pixel deterioration when a preset color is applied to the outline highlight region when the thickness of the outline highlight region is thicker than the pixel shift distance.

[0180] In operation 1170, the electronic device (100) can identify a second color by blending a color corresponding to the outline highlight area and a preset first color based on the identified weight.

[0181] In operation 1180, the electronic device (100) can process the input image so that an area included in the outline highlight area includes a preset first color and the remaining area of ​​the outline highlight area includes a second color.

[0182] In operation 1190, the electronic device (100) can display the processed input image.

[0183] Meanwhile, in Fig. 11, the order is mapped for all steps for convenience of explanation, but it is of course not necessarily limited to the order of steps that are not related to the order or can be performed in parallel.

[0184] FIGS. 12A and 12B are drawings for explaining a method of highlighting an outline according to an outline thickness according to one or more embodiments.

[0185] According to one embodiment, the electronic device (100) can adjust a weight for determining a highlight color according to the thickness of the outline highlight area.

[0186] For example, if the thickness of the outline highlight region is less than a threshold value, the electronic device (100) can maintain the minimum value of the weight applied to the preset highlight color among the blending color, i.e., the color applied to the second region described above, at the preset value. This is to ensure that the highlight effect is maintained even when the highlight outline is thin and moves away from the center.

[0187] For example, if the thickness of the outline highlight area is set to be less than a threshold value (e.g., "weak" among strong / mediun / weak) as shown in Fig. 12a, a relatively small value can be applied to the Dilation Factor of the Dilation Filter. The Dilation Factor can be a multiplier factor of how many pixel edges a 1-pixel edge becomes after dilation. In this case, the preset value LB_weak can be set as the lower bound value.

[0188] For example, if the thickness of the outline highlight region is greater than or equal to a threshold value, the electronic device (100) may adjust the minimum value of the weight applied to the preset highlight color among the blending color, i.e., the color applied to the second region described above, to a value lower than the preset value. This is to set the weight for the pixels of the input image relatively high when the outline highlight region is thick.

[0189] For example, if the thickness of the highlighted outline area is set to be less than a threshold value (e.g., “strong” among strong / medium / weak) as shown in Fig. 12b, a relatively large value can be applied to the Dilation Factor of the Dilation Filter. In this case, the Lower bound value of the weight can be adjusted to a value smaller than that in Fig. 12a, for example, 0. This is to further reduce pixel degradation because, when the highlighted outline is thick, the highlighting effect is prominent even if the highlighted outline is not processed with a specific color.

[0190] As an example, the electronic device (100) can calculate the weight w and the lower bound of the weight based on the following mathematical expressions 2 and 3.

[0191]

[0192] Here, Pixel_Shift[1 / n*(4-direction Distance)] can be the up / down / left / right movement distance according to pixel shift, and Dilation_Distance[1 / n*(4-direction Distance)] can be the outline expansion thickness according to the application of the Dilation Filter.

[0193]

[0194] Here, round() can be a round function, LB_init can be an initial weight value, and LB_weak can be a preset weight value applied to the "weak" level.

[0195] FIG. 13 is a drawing for explaining a method for identifying a color of an outline highlight area according to one or more embodiments.

[0196] According to FIG. 13, the electronic device (100) can process a first area (1311) corresponding to a relatively dark area based on the outline in the outline highlight area (1310) with a preset color (e.g., one of black, yellow, and green). Accordingly, as in the lower graph, w=1 is applied (1321) to the preset color, and the weight 1-w=0 is not applied to the color corresponding to the input image of the corresponding area (1322).

[0197] For example, the electronic device (100) may process a second area (1312) corresponding to a relatively bright area based on the outline in the outline highlight area (1310) as a color that is a blend of a preset color applied to the first area and a color of the input image. For example, a weight w may be applied to the preset color applied to the first area, and a weight 1-w may be applied to the color of the input image. For example, assuming that the local contrast information corresponding to the second area (1312) decreases toward the right with respect to the outline as illustrated in FIG. 9, the local contrast information corresponding to the second area (1312) decreases toward the outside of the second area (1312), so the weight w applied to the preset color gradually decreases (1331-1, 1331-2), and the weight 1-w applied to the color of the input image gradually increases (1332). Accordingly, different weights are applied to horizontal pixels included in the second region (1312), and accordingly, the input color becomes more dominant as it goes outward in the horizontal direction. In one example, the blending gradient of the preset color applied to the second region (1312) may be different depending on the minimum value (or lower bound) of the weight w (1331-1, 1331-2).

[0198] For example, the weight w applied to the second region (1312) may decrease continuously as it moves outward, but this is not necessarily limited to this. For example, it is also possible to divide the second region (1312) into multiple blocks in the horizontal direction and apply the same weight to each block so that the weight w decreases in a stepwise manner.

[0199] FIG. 14 is a drawing for explaining a method for identifying a color of an outline highlight area according to one or more embodiments.

[0200] According to FIG. 14, the electronic device (100) can process a first area (1411) corresponding to a relatively dark area based on the outline in the outline highlight area (1410) with a preset color (e.g., one of black, yellow, and green). Accordingly, as in the lower graph, w=1 is applied (1421) to the preset color, and the weight 1-w=0 is not applied to the color corresponding to the input image of the corresponding area (1422).

[0201] For example, the electronic device (100) may perform outline highlight processing using only a preset color for a second region (1412) corresponding to a relatively bright region based on the outline in the outline highlight region (1410) and without using the color of the input image. For example, the electronic device (100) may process the second region (1412) by applying only a weight w to the preset color. For example, the weight w may be applied to the preset color and the weight 0 may be applied to the color of the input image. Accordingly, as in the lower graph, the weight w may be applied (1431) to the preset color, and the weight 0 may be applied (1432) to the color corresponding to the input image of the corresponding region.

[0202] According to the various embodiments described above, it is possible to reduce burn-in and color distortion caused by the outline enhancement function provided in the low vision mode.

[0203] The methods according to the various embodiments of the present disclosure described above can be implemented only with a software upgrade or a hardware upgrade for existing electronic devices and / or servers.

[0204] Additionally, the various embodiments of the present disclosure described above can also be performed through an embedded server provided in an electronic device, or an external server of the electronic device.

[0205] According to an example embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device may include an electronic device (e.g., electronic device A) according to the disclosed embodiments, which is a device that can call instructions stored in the storage medium and operate according to the called instructions. When an instruction is executed by a processor, the processor may directly or under the control of the processor perform a function corresponding to the instruction using other components. The instruction may include code generated or executed by a compiler or interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' means that the storage medium does not contain a signal and is tangible, but does not distinguish between data being stored semi-permanently or temporarily in the storage medium.

[0206] Furthermore, according to one embodiment of the present disclosure, the method according to the various embodiments described above may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0207] In addition, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single or multiple entities, and some of the corresponding sub-components described above may be omitted, or other sub-components may be further included in various embodiments. Alternatively or additionally, some components (e.g., modules or programs) may be integrated into a single entity, which may perform the same or similar functions as those performed by each of the corresponding components prior to integration. Operations performed by modules, programs or other components according to various embodiments may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0208] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, A display comprising a self-luminous element; memory for storing one or more instructions; and comprising one or more processors; The one or more processors, by executing the one or more instructions, When low vision mode is activated, the contour area is identified in the input image, Identifying an outline highlight area in the input image and expanding the outline area in the outline highlight area by a preset thickness, In the above outline highlight area, the input image is processed so that a first area corresponding to one direction based on the outline area includes a first color and a second area corresponding to a direction opposite to the one direction includes a second color, The processed input image is provided through the display, The above first color is a preset color, An electronic device wherein the second color is a color obtained by blending the color corresponding to the outline area in the input image and the preset color.

2. In paragraph 1, The one or more processors, by executing the one or more instructions, Identify local contrast information corresponding to the above outline highlight area, Identifying the weight based on the local contrast information, An electronic device that identifies the second color by blending the color corresponding to the outline highlight area and the preset color based on the identified weight.

3. In paragraph 1, The one or more processors, by executing the one or more instructions, Identify local contrast information corresponding to the second region, Identifying a first weight based on the above local contrast information, Identifying a second weight based on the first weight, An electronic device that applies the first weight to the preset color and applies the second weight identified based on the first weight to the color corresponding to the outline highlight area to identify the second color.

4. In paragraph 1, The one or more processors, by executing the one or more instructions, Identifying a local contrast value corresponding to each pixel included in the above outline highlight area, Identifying a first weight corresponding to each pixel based on the local contrast value corresponding to each pixel, Applying the identified first weight to the preset color, Applying the second weight identified based on the first weight corresponding to each of the pixels to the input color corresponding to each of the pixels, An electronic device that identifies the second color by blending the preset color to which the first weight is applied and the input color to which the second weight is applied.

5. In paragraph 4, The one or more processors, by executing the one or more instructions, If the thickness of the above outline highlight area is less than the threshold value, the minimum value of the first weight is maintained as the preset value, An electronic device that adjusts the minimum value of the first weight to a value lower than the preset value when the thickness of the outline highlight area is greater than or equal to the threshold value.

6. In paragraph 4, The one or more processors, by executing the one or more instructions, An electronic device that identifies the minimum value of the first weight by comparing the pixel movement distance according to the pixel shift and the thickness of the outline highlight area.

7. In paragraph 6, The one or more processors, by executing the one or more instructions, If the thickness of the above outline highlight area is included within the pixel movement distance, the minimum value of the first weight is maintained at a preset value, An electronic device that adjusts the minimum value of the first weight to a value lower than the preset value if the thickness of the outline highlight area is not included within the pixel movement distance.

8. In paragraph 1, The one or more processors, by executing the one or more instructions, Identify local contrast information corresponding to the second region, Identifying a first weight based on the above local contrast information, An electronic device that identifies the second color by applying the first weight to the preset color and applying a weight of 0 to the color corresponding to the outline highlight area.

9. In paragraph 1, The one or more processors, by executing the one or more instructions, When one side of the above outline area is a black area and the other side is a white area, the outline highlight area extended to the one side by the preset thickness is identified, An electronic device that identifies the outline highlight area expanded by the preset thickness by expanding the outline area to the same thickness on both sides when both sides are white areas based on the outline area.

10. In a method for controlling an electronic device, Step of identifying the outline area in the input image when the low vision mode is activated; A step of identifying a contour highlight area in the input image and expanding the contour area in the contour highlight area by a preset thickness; In the above outline highlight area, a step of processing the input image so that a first area corresponding to one direction based on the outline area includes a first color and a second area corresponding to a direction opposite to the one direction includes a second color; A step of displaying the processed input image; The above first color is a preset color, A control method wherein the second color is a color obtained by blending the color corresponding to the outline area in the input image and the preset color.

11. In paragraph 10, The step of processing the above input image is: A step of identifying local contrast information corresponding to the above outline highlight area; A step of identifying the weight based on the local contrast information; and A control method comprising: a step of identifying the second color by blending the color corresponding to the outline highlight area and the preset color based on the identified weight; 12. In paragraph 10, The step of processing the above input image is: A step of identifying local contrast information corresponding to the second region; A step of identifying a first weight based on the local contrast information; a step of identifying a second weight based on the first weight; and A control method comprising: a step of applying the first weight to the preset color and applying the second weight identified based on the first weight to the color corresponding to the outline highlight area to identify the second color.

13. In paragraph 11, The step of processing the above input image is: A step of identifying a local contrast value corresponding to each pixel included in the above outline highlight area; A step of identifying a first weight corresponding to each of the pixels based on the local contrast value corresponding to each of the pixels; A step of applying the identified first weight to the preset color; A step of applying the second weight identified based on the first weight corresponding to each of the pixels to the input color corresponding to each of the pixels; A control method comprising: a step of identifying the second color by blending the preset color to which the first weight is applied and the input color to which the second weight is applied.

14. In paragraph 13, The step of identifying the first weight is: If the thickness of the above outline highlight area is less than a threshold value, a step of maintaining the minimum value of the first weight as a preset value; and A control method, comprising: a step of adjusting the minimum value of the first weight to a value lower than the preset value when the thickness of the outline highlight area is greater than or equal to the threshold value.

15. A non-transitory computer-readable medium storing computer instructions that, when executed by a processor of an electronic device, cause the electronic device to perform an operation, The above action is, Step of identifying the outline area in the input image when the low vision mode is activated; A step of identifying a contour highlight area in the input image and expanding the contour area in the contour highlight area by a preset thickness; In the above outline highlight area, a step of processing the input image so that a first area corresponding to one direction based on the outline area includes a first color and a second area corresponding to a direction opposite to the one direction includes a second color; A step of displaying the processed input image; The above first color is a preset color, A non-transitory computer-readable medium wherein the second color is a color obtained by blending the color corresponding to the outline area in the input image and the preset color.

Images