Display device supporting image adjustment and control method therefor
The display device addresses the challenge of enhancing image visibility for low vision users by using processor-driven adjustments to edge thickness, contrast, and color, optimizing image quality through personalized settings and AI enhancements, thereby improving accessibility.
Patent Information
- Application Number
- PCT/KR2024/095386
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-25
- Filing Date
- 2024-02-19
- Publication Date
- 2024-11-28
AI Technical Summary
Current display devices lack a flexible and effective method to enhance image visibility and accessibility for users with low vision, as they do not adequately support personalized image processing based on user preferences for intensity and color adjustments.
A display device equipped with a processor and memory that identifies user preference intensities and adjusts image processing settings, including edge thickness, contrast, dynamic contrast ratio, sharpness, and color, to optimize image quality for low vision users, using a combination of hardware and AI upscaling to improve visibility.
The solution significantly enhances image visibility and accessibility for low vision users by tailoring image processing settings to individual preferences, improving the overall image quality and user experience.
Smart Images

Figure KR2024095386_28112024_PF_FP_ABST
Abstract
Description
Display device supporting image adjustment and control method thereof
[0001] The present disclosure relates to a display device and a method for controlling the same, and for example, to a display device supporting image adjustment and a method for controlling the same.
[0002] Recently, various types of display devices supporting assistive viewing features have been developed and distributed. Assistive viewing features may include, for example, image processing for viewers with vision impairment or low vision.
[0003] Viewing assistance features for viewers with low vision only support video processing functions such as providing video magnification mode and video color inversion mode, but do not support flexible video processing functions that take into account factors such as video characteristics or user characteristics / preferences.
[0004] Therefore, there is a need for a flexible image processing method to improve the visibility and accessibility of images to viewers with low vision.
[0005] According to one embodiment of the present disclosure, a display device may include at least one processor, including a memory storing a program including at least one command; and a processing circuit connected to the memory and executing at least one command of the program stored in the memory. The at least one processor is individually and / or collectively configured to: identify, based on an input, preference intensity information indicating a first preference intensity among a plurality of preference intensities associated with image processing based on a low vision mode; obtain edge thickness setting information corresponding to the first preference intensity from the memory; perform edge thickness adjustment processing for an input image based on the obtained edge thickness setting information; obtain image quality adjustment setting information corresponding to the first preference intensity from the memory; and perform image quality adjustment processing for an image on which the edge thickness adjustment has been performed based on the obtained image quality adjustment setting information; wherein the memory includes edge thickness setting information corresponding to each of the plurality of preference intensities and image quality adjustment setting information corresponding to each of the plurality of preference intensities, and each image quality adjustment setting information may include setting information for adjusting at least one of contrast, dynamic contrast ratio, sharpness, or color for the image according to the corresponding preference intensity.
[0006] According to one embodiment of the present disclosure, a method of operating a display device includes at least one operation. The at least one operation may include identifying, based on an input, preference intensity information indicating a first preference intensity among a plurality of preference intensities associated with image processing based on a low vision mode. The at least one operation may include obtaining edge thickness setting information corresponding to the first preference intensity from the memory. The at least one operation may include performing an edge thickness adjustment process for an input image based on the obtained edge thickness setting information. The at least one operation may include obtaining image quality adjustment setting information corresponding to the first preference intensity from the memory. The at least one operation may include performing an image quality adjustment process for an image on which the edge thickness has been adjusted based on the obtained image quality adjustment setting information. The memory may include edge thickness setting information corresponding to each of the plurality of preference intensities and image quality adjustment setting information corresponding to each of the plurality of preference intensities, and each image quality adjustment setting information may include setting information for adjusting at least one of contrast, dynamic contrast ratio, sharpness, or color for the image according to the corresponding preference intensity.
[0007] FIG. 1 is a block diagram showing an exemplary configuration of an image processing device according to one embodiment of the present disclosure.
[0008] FIG. 2 is a block diagram showing an exemplary configuration of a display device according to one embodiment of the present disclosure.
[0009] FIG. 3 is a drawing for explaining an exemplary image processing method according to one embodiment of the present disclosure.
[0010] FIG. 4A is a diagram illustrating adjustment of the preferred intensity for the low vision mode according to one embodiment of the present disclosure.
[0011] FIG. 4b is a diagram illustrating adjustment of preferred color for low vision mode according to one embodiment of the present disclosure.
[0012] FIG. 4c is a diagram illustrating the use of a simultaneous viewing mode according to one embodiment of the present disclosure.
[0013] FIG. 5 is a block diagram showing an exemplary configuration of an outline adjustment processing unit according to one embodiment of the present disclosure.
[0014] FIG. 6 is a drawing for explaining outline adjustment processing according to one embodiment of the present disclosure.
[0015] FIG. 7 is a block diagram showing an exemplary configuration of a picture quality adjustment processing unit according to one embodiment of the present disclosure.
[0016] FIG. 8 is a diagram for explaining exemplary image quality adjustment processing according to one embodiment of the present disclosure.
[0017] FIG. 9 is a diagram illustrating exemplary brightness-related adjustment processing according to one embodiment of the present disclosure.
[0018] FIG. 10 is a diagram for explaining an exemplary image quality adjustment process according to one embodiment of the present disclosure.
[0019] FIG. 11A is a flowchart illustrating an exemplary contrast adjustment operation according to one embodiment of the present disclosure.
[0020] FIG. 11b is a graph illustrating an exemplary contrast adjustment curve used for contrast adjustment according to one embodiment of the present disclosure.
[0021] FIG. 12A is a flowchart illustrating an exemplary dynamic contrast ratio adjustment operation according to one embodiment of the present disclosure.
[0022] FIG. 12b are graphs illustrating exemplary dynamic contrast ratio adjustment curves used for dynamic contrast ratio adjustment according to one embodiment of the present disclosure.
[0023] FIG. 13A is a flowchart illustrating an exemplary sharpness adjustment operation according to one embodiment of the present disclosure.
[0024] FIG. 13b are graphs illustrating an exemplary sharpness adjustment method according to one embodiment of the present disclosure.
[0025] FIG. 13c is a drawing for explaining the effect of sharpness adjustment according to one embodiment of the present disclosure.
[0026] FIG. 14 is a flowchart illustrating an exemplary sharpness adjustment operation according to one embodiment of the present disclosure.
[0027] FIG. 15 is a flowchart illustrating an exemplary sharpness adjustment operation according to one embodiment of the present disclosure.
[0028] FIG. 16 is a drawing for explaining an exemplary effect of image processing according to one embodiment of the present disclosure.
[0029] FIG. 17 is a flowchart illustrating an exemplary method of operating a display device according to one embodiment of the present disclosure.
[0030] Below, various examples of the present disclosure are described in detail with reference to the drawings. However, the present disclosure may be implemented in various different forms and is not limited to the exemplary embodiments described herein. Throughout the present disclosure and drawings, the same or similar reference numerals may be used to refer to the same or similar components. Furthermore, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0031] At this time, it will be understood that each block of the processing flow diagrams and combinations of the flow diagrams can be performed by computer program instructions.
[0032] Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for performing a specific logical function(s). It should also be noted that in some embodiments, the functions described in the blocks may occur out of order. For example, two blocks depicted in succession may actually be executed substantially concurrently, or the blocks may sometimes be executed in reverse order, depending on their respective functions.
[0033] Here, the term '~ part' used in this embodiment means software and / or hardware components such as FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit), and the '~ part' performs certain roles. However, the '~ part' is not limited to software or hardware. The '~ part' may be configured to be on an addressable storage medium and may be configured to reproduce one or more packet processing devices. Therefore, as an example, the '~ part' includes components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and '~ parts' may be combined into a smaller number of components and '~ parts' or further separated into additional components and '~ parts'. In addition, the components and '~parts' may be implemented to play one or more central processing units (CPUs) within the device or secure multimedia card. In addition, in the embodiment, the '~parts' may include one or more packet processing devices.
[0034] FIG. 1 is a block diagram showing an exemplary configuration of an image processing device according to one embodiment of the present disclosure.
[0035] An image processing device (1) may support at least one image processing function for providing images for users with visual impairment and / or low vision (low vision users). For example, the image processing device (1) may be a device that supports at least one image processing function for improving the visibility and / or accessibility of images for users with low vision (low vision users). In the present disclosure, a low vision user may also be referred to as a low vision person or a low vision viewer.
[0036] Referring to FIG. 1, an image processing device (1) may include a memory (10) and / or an image processor (100) (e.g., including a processing circuit).
[0037] According to one embodiment, the memory (10) can store information on settings for image processing of the image processing device (1) (image processing setting information). The image processing setting information may include, but is not limited to, setting information used for preprocessing, edge adjustment setting information including setting information used for image processing for edge adjustment, and / or image quality adjustment setting information including setting information used for image processing for image quality adjustment.
[0038] In the present disclosure, an edge may include, for example, a portion where pixel values change abruptly within an image, a boundary between dark and light pixels, a boundary between objects, or a boundary between an object and a background.
[0039] According to one embodiment, the image processor (100) may include various processing circuits and / or multiple processors. For example, the terms "processor," "image processor," and the like, as used in this disclosure, including the claims, may include various processing circuits including at least one processor, wherein one or more of the at least one processors may be configured to perform the various functions described in this disclosure individually and / or collectively in a distributed manner. As used herein, when "processor," "at least one processor," and "one or more processors" are described as being configured to perform numerous functions, these terms encompass, for example, but are not limited to, a situation where one processor performs some of the recited functions and other processor(s) perform other parts of the recited functions, and also encompass a situation where a single processor can perform all of the recited functions. Additionally, at least one processor may comprise a combination of processors that perform various functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions. The image processor (100) may perform image processing on an input image based on image processing configuration information stored in the memory (10), for example, to obtain an output image.
[0040] According to one embodiment, the image processor (100) may include an outline adjustment processing unit (110) (e.g., including various processing circuits and / or executable program instructions) and an image quality adjustment processing unit (120) (e.g., including various processing circuits and / or executable program instructions).
[0041] According to one embodiment, the outline adjustment processing unit (110) may perform image processing for outline adjustment on an input image based on outline adjustment setting information stored in the memory (10), thereby obtaining an output image. The operation of the outline adjustment processing unit (110) is described in more detail below with reference to FIGS. 3 and 5 to 7.
[0042] According to one embodiment, the image quality adjustment processing unit (120) may perform image processing for image quality adjustment on an input image based on image quality adjustment setting information stored in the memory (10), thereby obtaining an output image. The operation of the image quality adjustment processing unit (120) is described in more detail below with reference to FIGS. 3 and 7 to 15.
[0043] For example, the operation of the outline adjustment processing unit (110) may be performed before the operation of the image quality adjustment processing unit (120). In this case, the image quality adjustment processing unit (120) can perform image quality improvement processing centered on the adjusted outline. For example, the brightness or contrast sensitivity around or at the center of the outline may be maximized and / or increased compared to the original image. However, the embodiment is not limited thereto. For example, the operation of the image quality adjustment processing unit (120) may be performed before the operation of the outline adjustment processing unit (110), or the operation of the image quality adjustment processing unit (120) may be performed together with the operation of the outline adjustment processing unit (110) (e.g., performed in parallel).
[0044] FIG. 2 is a block diagram showing an exemplary configuration of a display device according to one embodiment of the present disclosure.
[0045] Referring to FIG. 2, a display device (200) may include a display (210), a memory (220), and one or more processors (230) (e.g., including a processing circuit).
[0046] According to one embodiment, the display (210) may be implemented as a display in various forms, such as, but not limited to, an LCD (liquid crystal display), an OLED (organic light-emitting diode), an LCoS (Liquid Crystal on Silicon), a DLP (Digital Light Processing), a QD (quantum dot) display panel, a QLED (quantum dot light-emitting diodes), a μLED (Micro light-emitting diodes), a Mini LED, etc.
[0047] According to one embodiment, the display device (200) may be implemented as, for example, a touch screen combined with a touch sensor, a flexible display, a rollable display, a 3D display, a display in which a plurality of display modules are physically connected, etc.
[0048] According to one embodiment, the memory (220) can store data required for various embodiments of the present disclosure. The memory (220) may be implemented in the form of memory embedded in the display device (200) or in the form of memory detachable from the display device (200) depending on the purpose of data storage. For example, data for driving the display device (200) may be stored in a memory embedded in the display device (200), and data for expanded functions of the display device (200) may be stored in a memory detachable from the display device (200). In the case of memory embedded in the display device (200), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)). In addition, in the case of memory that can be detachably attached to the display device (200), it may be implemented in the form of a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc.
[0049] As an example, the memory (220) may store a computer program including at least one instruction or instructions for controlling the display device (200).
[0050] In one embodiment, various data may be stored in the external memory of the processor (230), or some of the data may be stored in the internal memory of the processor (230) and the rest may be stored in the external memory.
[0051] According to one embodiment, at least one processor (230) may include various processing circuits and / or multiple processors. For example, the terms “processor,” “image processor,” and the like, as used in this disclosure, including the claims, may include various processing circuits including at least one processor, wherein one or more of the at least one processors may be configured to perform the various functions described in this disclosure in an individually and / or collectively distributed manner. As used herein, when “processor,” “at least one processor,” and “one or more processors” are described as being configured to perform numerous functions, these terms encompass, for example, but are not limited to, a situation where one processor performs some of the recited functions and other processor(s) perform other parts of the recited functions, and also encompass a situation where a single processor can perform all of the recited functions. Additionally, at least one processor may comprise a combination of processors that perform various functions, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions. At least one processor (230) may control the overall operation of the display device (200).
[0052] According to one embodiment, the processor (230) may be implemented as a digital signal processor (DSP), a microprocessor, or a timing controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a communication processor (CP), an ARM processor, or an artificial intelligence (AI) processor, or may be defined by the relevant terms. The processor (230) may be implemented as a system on chip (SoC) having a built-in processing algorithm, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA). The processor (230) may perform various functions by executing computer executable instructions stored in a memory.
[0053] The processor (230) may include one or more of a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a many integrated core (MIC), a digital signal processor (DSP), a neural processing unit (NPU), a hardware accelerator, or a machine learning accelerator. The processor (230) may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The processor (230) may execute one or more programs or instructions stored in a memory. For example, the processor (230) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in a memory.
[0054] In an embodiment, when a method includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an AI-dedicated processor).
[0055] The processor (230) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When the processor (230) is implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.
[0056] When a method according to an embodiment includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in a multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.
[0057] In various embodiments of the present disclosure, the processor (230) may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.
[0058] According to one embodiment, the image processing device (1) of FIG. 1 may be included in the display device (100) of FIG. 2, may be the display device (100), or may include the display device (100). For example, when the image processing device (1) of FIG. 1 is included in the display device (100) of FIG. 2, the memory (10) of the image processing device (1) of FIG. 1 may be included in the memory (210) of the display device (100) of FIG. 2, and the image processor (100) of the image processing device (1) of FIG. 1 may be included in at least one processor (230) of the display device (100) of FIG. 2.
[0059] FIG. 3 is a drawing for explaining an exemplary image processing method according to one embodiment of the present disclosure.
[0060] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) may support a normal mode that provides image processing for general users, or a low vision mode that provides image processing for users with vision impairments and / or low vision. The low vision mode may be, for example, a mode that provides at least one image processing function to improve visibility and / or accessibility to images for low vision users. In the present disclosure, the low vision mode may also be referred to as a low vision viewing mode.
[0061] According to one embodiment, when the low vision mode is applied, the electronic device may perform at least one of an image processing operation for adjusting the outline of an image (hereinafter, “outline adjustment processing operation”) (310) or an image processing operation for adjusting the image quality (hereinafter, “image quality adjustment processing operation”) (320).
[0062] The outline adjustment processing operation (310) may be performed, for example, by the outline adjustment processing unit (110) of FIG. 1, the image processor (100) of FIG. 1, and / or at least one processor (230) of FIG. 2. The image quality adjustment processing operation (320) may be performed, for example, by the image quality adjustment processing unit (120) of FIG. 1, the image processor (100) of FIG. 1, and / or at least one processor (230) of FIG. 2.
[0063] Referring to FIG. 3, in the outline adjustment processing operation (310), the electronic device may perform image processing for outline adjustment on an input image to obtain an output image (a first output image). For example, the electronic device may perform image processing for outline adjustment on an input image based on outline adjustment setting information stored in a memory (10,220) to obtain a first output image.
[0064] Image processing for contour adjustment may include, but is not limited to, at least one of the following image processing operations.
[0065] - At least one operation for preprocessing an image (e.g., an input image);
[0066] - At least one operation for detecting contours for an image or a preprocessed input image;
[0067] - At least one operation for adjusting the detected contour. The adjustment of the detected contour may include, for example, at least one of adjusting the thickness of the detected contour or adjusting the color of the detected contour; and / or
[0068] - At least one operation for obtaining an output image by combining an image including an adjusted outline (an outline image) and an input image (or a preprocessed input image). The combination of images may be based on at least one of an overlay function or a blending function, for example.
[0069] The outline adjustment setting information may include, for example, setting information for at least one parameter required to adjust the outline for an image. For example, the outline adjustment setting information may include setting information for a parameter for adjusting the thickness of the outline (an outline thickness adjustment parameter) and / or setting information for a parameter for adjusting the color of the outline (an outline color adjustment parameter).
[0070] The configuration information for the outline thickness parameter may include, for example, information on thickness values corresponding to each preferred intensity of the low vision mode. The preferred intensity may correspond to the intensity of a preferred image adjustment (e.g., outline adjustment and / or image quality adjustment) when processing an image according to the low vision mode. The low vision mode may use a preset number of preferred intensities (e.g., three).
[0071] The configuration information for the outline color parameter may include, for example, information about the color values corresponding to each preferred color in the low vision mode. The preferred color may correspond to the preferred outline color when processing images in the low vision mode. The low vision mode may use a preset number of preferred colors (e.g., two).
[0072] In the image quality adjustment processing operation (320), the electronic device may perform image processing for image quality adjustment on an input image to obtain an output image. For example, the electronic device may perform image processing for image quality adjustment on an input image (e.g., a first output image) based on image quality adjustment setting information stored in the memory (10,220) to obtain an output image (e.g., a second output image). The image output in this way may have an effect of improving visibility and image quality. The output image may be provided through a display (e.g., the display (210) of FIG. 2). The image processing for image quality adjustment may include, but is not limited to, at least one of the following image processing operations.
[0073] - At least one operation for adjusting contrast or dynamic range of an image (e.g., a first output image);
[0074] - At least one operation for adjusting the dynamic contrast of the image;
[0075] - At least one operation for adjusting the sharpness or detail enhancement of the image;
[0076] - At least one operation for color adjustment of the image;
[0077] - At least one operation for AI upscaling of the video;
[0078] - At least one operation for frame rate conversion (FRC) of the video;
[0079] - at least one action for adjusting the brightness of the image; and / or
[0080] - At least one operation to adjust the color specification for the image (e.g., standard dynamic range (SDR) or high dynamic range (HDR)).
[0081] The image quality adjustment setting information may include, for example, setting information for at least one parameter necessary for adjusting the image quality of an image. For example, the image quality adjustment setting information may include, but is not limited to, setting information for a parameter for adjusting contrast (contrast adjustment parameter), setting information for a parameter for adjusting dynamic contrast (dynamic contrast adjustment parameter), setting information for a parameter for adjusting sharpness (sharpness adjustment parameter), setting information for a parameter for adjusting color (color adjustment parameter), setting information for a parameter for AI upscaling, and / or setting information for a parameter for frame rate conversion.
[0082] FIG. 4A is a diagram illustrating adjustment of the preferred intensity for low vision mode according to one embodiment of the present disclosure. FIG. 4B is a diagram illustrating adjustment of the preferred color for low vision mode according to one embodiment of the present disclosure. FIG. 4C is a diagram illustrating use of the simultaneous viewing mode according to one embodiment of the present disclosure.
[0083] Referring to FIGS. 4a, 4b and 4c, an electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can display a screen (400) on a display for adjusting the settings of a low vision mode.
[0084] The screen (400) may include an item (410) corresponding to a low vision mode. A user may apply the low vision mode to an image by selecting the item (410). The electronic device may identify the user's selection of the item (410) based on an input, e.g., a user input.
[0085] The screen (400) may include at least one of an item (420) corresponding to a preferred intensity of the low vision mode, an item (430) corresponding to a preferred color for the low vision mode, and an item (440) corresponding to a simultaneous viewing mode. For example, when an item (410) corresponding to the low vision mode is selected, the electronic device may display at least one of an item (420) corresponding to a preferred intensity of the low vision mode, an item (430) corresponding to a preferred color for the low vision mode, and / or an item (440) corresponding to a simultaneous viewing mode on the screen (400).
[0086] The preferred intensity of the low vision mode may correspond to the intensity of the preferred image adjustment (e.g., edge adjustment and / or image quality adjustment) during image processing according to the low vision mode. The electronic device may determine the intensity of the image processing for edge adjustment and / or image quality adjustment, for example, based on the preferred intensity selected by the user. The low vision mode may use a preset number of preferred intensities (e.g., three, but not limited thereto).
[0087] The screen (400) may include at least one selection option associated with the item (420). For example, when the item (420) is selected, the electronic device may display at least one selection option associated with the item (420) on the screen (400). For example, when the number of preferred intensities is set to three, as illustrated in FIG. 4A, the electronic device may display at least one of a selection option (421) indicating that the preferred intensity of the low vision mode corresponds to weak, a selection option (422) indicating that the preferred intensity of the low vision mode corresponds to medium, or a selection option (422) indicating that the preferred intensity of the low vision mode corresponds to strong, but is not limited thereto. The user may select the preferred intensity of the low vision mode by selecting one of the selection options corresponding to each preferred intensity of the low vision mode displayed on the screen (400). The electronic device may identify the preferred intensity of the low vision mode to be used based on the user input.
[0088] The preferred color for low vision mode can correspond to the preferred color of the outline when processing images in low vision mode. The electronic device can, for example, determine the outline color based on the preferred color selected by the user. Low vision mode can use a preset number of preferred colors (e.g., two, but not limited thereto).
[0089] The screen (400) may include at least one selection option associated with the item (430). For example, when the item (430) is selected, the electronic device may display at least one selection option associated with the item (430) on the screen (400). For example, when the number of preferred colors is set to two, as illustrated in FIG. 4B, the electronic device may display at least one of a selection option (431) indicating that the preferred color of the low vision mode corresponds to black, or a selection option (432) indicating that the preferred color of the low vision mode corresponds to green, but is not limited thereto. The user may select a preferred color of the low vision mode to be used by selecting one of the selection options corresponding to each preferred color of the low vision mode displayed on the screen (400). The electronic device may identify the preferred color of the low vision mode to be used based on the user input, and may identify the color of the outline of the input image based on the preferred color.
[0090] The simultaneous viewing mode may be a mode that simultaneously displays images processed according to the low vision mode and images processed according to the normal mode on the screen (400). For example, as illustrated in FIG. 4c, when an item (440) is selected, the electronic device may apply the simultaneous viewing mode.
[0091] Since low vision users have lower visual cognitive abilities than normal users, if the number of selection items / options associated with the low vision mode is provided on the screen in a detailed manner, it may be difficult for low vision users to identify and / or recognize the selection items / options. Therefore, it may be more advantageous for low vision users to provide a simplified selection item / options associated with the low vision mode rather than providing them in a detailed manner. For example, as illustrated in FIG. 4a, providing a simplified selection option for the preferred intensity of the low vision mode, such as weak / medium / strong, in three or fewer levels may be advantageous and more efficient for low vision users. For example, as illustrated in FIG. 4b, providing a simplified selection option for the preferred color of the low vision mode, such as black / green, in two options may be advantageous and helpful for low vision users. For example, as illustrated in FIGS. 4A to 4C , it may be advantageous for low vision users to simplify the number of selection items associated with low vision mode to three (e.g., item (420), item (430), and item (440)) or fewer and present them on one screen.
[0092] FIG. 5 is a block diagram showing an exemplary configuration of an outline adjustment processing unit according to one embodiment of the present disclosure.
[0093] Referring to FIG. 5, the contour adjustment processing unit (110) (e.g., including a processing circuit) may include, for example, a preprocessing component (111), a contour detection component (112), a contour adjustment component (113), and / or an image combination component (114). The preprocessing component (110) and / or the image combination component (114) are optional components of the contour adjustment processing unit (110) and may be omitted or included in a component other than the contour adjustment processing unit (110). Each component may include various circuits and / or executable program instructions.
[0094] The preprocessing component (111) can perform preprocessing on the input image.
[0095] The preprocessing component (111) can perform preprocessing on an input image when a preset condition is satisfied. The preset condition may include, for example, a case where noise (e.g., detail texture) is detected in the input image.
[0096] The preprocessing component (111) can perform preprocessing on an input image using a preset preprocessing method. The preset preprocessing method may include, but is not limited to, a blurring method, capturing, and / or de-noising method.
[0097] In one embodiment, the blurring method may utilize sub-sampling and interpolation. For example, the preprocessing component (111) may reduce the size of an input image using sub-sampling and then increase the size of the image back to the size of the original input image using interpolation, thereby achieving a blurring effect. Through this, noise contained in the input image may be removed.
[0098] According to one embodiment, the blurring method may be a method using filtering. For example, the preprocessing component (111) may have a blurring effect by adjusting a filter coefficient when filtering an input image using a convolution kernel / filter. For example, the preprocessing component (111) may perform texture filtering on the input image. Texture filtering may include, but is not limited to, Gaussian smoothing, edge-preserving & smoothing, or edge-preserving filtering.
[0099] According to one embodiment, the capturing method may utilize a method of performing capturing on a down-sampled input image. For example, the preprocessing component (111) may down-sample the input image to reduce the size of the image, perform capturing on the down-sampled image, and up-sample the captured image to increase the size of the image to the size of the original input image, thereby removing noise.
[0100] According to one embodiment, the denoising method may be a method using a denoising filter. For example, the preprocessing component (111) may perform processing to remove noise included in the input image by applying a denoising filter to the input image.
[0101] The edge detection component (112) can detect (or identify) an edge included in an image (e.g., an input image or a preprocessed image). For example, the edge detection component (112) can detect an edge for at least one object included in the image. For example, the edge detection component (112) can detect an edge corresponding to an object that is meaningful (e.g., useful, efficient) to a low vision user among a plurality of objects included in the image (e.g., a text object, a human object, an object larger than a threshold size, an object located in an area within the screen (e.g., an object located in a central area within the screen)). For example, the electronic device can detect an edge by performing image binarization (or image thresholding) on the image. The image binarization can be, for example, image segmentation or image classification. Through image binarization processing, for example, pixels corresponding to an outline can be set to a first value (e.g., 1), and pixels not corresponding to an outline can be set to a second value (e.g., 0).
[0102] The output image of the contour detection component (112) may be referred to as a contour image.
[0103] The outline adjustment component (113) can adjust at least one outline included in an image (e.g., an outline image). For example, the outline adjustment component (113) can adjust at least one of the thickness or color of at least one outline included in the image.
[0104] In one embodiment, the contour adjustment component (113) can adjust the thickness of at least one contour included in an image based on preferred intensity information of a low vision mode. The preferred intensity information can indicate one of at least one preferred intensity.
[0105] For example, if the preferred intensity of the low vision mode is a first intensity (e.g., strong), the outline adjustment component (113) can adjust the thickness of at least one outline included in the edge image to a first thickness corresponding to the first intensity. As the preferred intensity of the low vision mode becomes stronger, the thickness of the outline corresponding to the preferred intensity can become thicker. For example, the thickness of the outline corresponding to the preferred intensity of the low vision mode corresponding to strong can be thicker than the thickness of the outline corresponding to the preferred intensity of the low vision mode corresponding to medium (or weak).
[0106] According to one embodiment, the outline adjustment component (113) may perform image processing to adjust the outline corresponding to at least one object that satisfies a preset condition among a plurality of objects to a relatively thicker thickness than the outlines corresponding to the remaining objects. For example, the outline adjustment component (113) may adjust the thickness of the outline corresponding to at least one object that satisfies the preset condition to a thickness of the outline corresponding to a preferred intensity of the low vision mode, and may adjust the thickness of the outline corresponding to the remaining objects to a relatively thinner thickness than the thickness of the outline corresponding to the preferred intensity of the low vision mode. The preset condition may include, but is not limited to, a condition for identifying a meaningful object (e.g., a text object, a human object, an object larger than a threshold size, an object located in an area within the screen (e.g., an object located in a central area within the screen)) within an input image.
[0107] In one embodiment, the outline adjustment component (113) may adjust the color of at least one outline included in the outline image based on a preferred color of the low vision mode. The preferred color information may indicate one of the at least one preferred color (e.g., black).
[0108] The output image of the outline adjustment component (113) may be referred to as an outline adjustment image.
[0109] The image combination component (114) can combine an input image (or a preprocessed image) and an outline adjustment image.
[0110] According to one embodiment, the image combination component (114) can obtain an output image (first output image) by combining the contour adjustment image and the input image (or, preprocessed image).
[0111] According to one embodiment, the image combination component (114) can combine the contour adjustment image and the input image (or the preprocessed image) using an overlay method or a blending method. For example, the image combination component (114) can obtain an output image by overlaying the contour adjustment image on the input image (or the preprocessed image). For example, the image combination component (114) can obtain an output image by blending the contour adjustment image on the input image (or the preprocessed image).
[0112] The output image obtained in this way corresponds to an image that is a combination of the input image (or preprocessed image) and an image in which at least one of the thickness or color of the outline is adjusted, and therefore corresponds to an image with improved visibility.
[0113] FIG. 6 is a diagram for explaining an exemplary outline adjustment process according to one embodiment of the present disclosure.
[0114] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can perform an image processing operation for outline adjustment (e.g., an outline adjustment processing operation (310) of FIG. 3).
[0115] Referring to FIG. 6, the image processing operation for contour adjustment may include a preprocessing operation (311), a contour detection operation (312), a contour adjustment operation (313), and / or an image combination operation (314). The contour adjustment operation (313a) may include a contour thickness adjustment operation (314) and / or a contour color adjustment operation (313b).
[0116] In the example of Fig. 6, it is assumed that the preprocessing condition is satisfied and preprocessing is performed.
[0117] In the preprocessing operation (311), the electronic device may perform preprocessing on the input image and output the preprocessed image. The preprocessed image may have reduced image quality but noise removed. The preprocessing operation (311) may be performed, for example, by the preprocessing component (111) of FIG. 5. For a description of the preprocessing operation by the preprocessing component (111), reference may be made to the description of FIG. 5.
[0118] In the contour detection operation (311), the electronic device may perform contour detection on the preprocessed image and output a contour image including the detected contour. The contour detection operation (311) may be performed, for example, by the contour detection component (112) of FIG. 1. For a description of the contour detection operation by the contour detection component (112), reference may be made to the description of FIG. 5.
[0119] In the outline adjustment operation (313), the electronic device can adjust at least one outline included in the outline image and output an outline adjustment image including the adjusted outline. The outline adjustment operation (313) can be performed, for example, by the outline adjustment component (112) of FIG. 1. For a description of the outline adjustment operation by the outline adjustment component (112), reference may be made to the description of FIG. 5.
[0120] In one embodiment, the electronic device may adjust the thickness of at least one contour included in an outline image based on a preferred intensity of the low vision mode. The preferred intensity of the low vision mode may be identified based on user input (e.g., user input for item (420) and selection options (421, 422, 423) of FIG. 4A ).
[0121] In one embodiment, the electronic device may adjust the color of at least one outline included in an outline image based on a preferred color of the low vision mode. The preferred color of the low vision mode may be identified based on user input (e.g., user input for item (430) and selection options (431, 432) of FIG. 4B ).
[0122] In the image combination operation (314), the electronic device can obtain a first output image by combining the contour-adjusted image and the preprocessed image. The image combination operation (314) can be performed, for example, by the image combination component (114) of FIG. 1. For a description of the image combination operation by the image combination component (114), refer to the description of FIG. 5.
[0123] The first output image obtained through the above-described outline adjustment process corresponds to an image with adjusted outline thickness and / or color, and thus may have improved visibility compared to the input image. However, outline adjustment alone may result in a low degree of visibility improvement or poor image quality. Therefore, further image processing for image quality adjustment is required to provide improved visibility and accessibility for low-vision users. This will be described in more detail below.
[0124] FIG. 7 is a block diagram showing an exemplary configuration of a picture quality adjustment processing unit according to one embodiment of the present disclosure.
[0125] Referring to FIG. 7, the image quality adjustment processing unit (120) (e.g., including a processing circuit) may include, for example, a contrast adjustment component (121), a dynamic contrast ratio adjustment component (122), a sharpness adjustment component (123), a color adjustment component (124), an AI upscaling component (125), and a frame rate conversion component (126). Each of the various components may include various circuits and / or executable program instructions.
[0126] The contrast adjustment component (121) can adjust the contrast of an image (e.g., a first output image). In one embodiment, the contrast adjustment component (121) can adjust the contrast of the image based on the preferred intensity information of the low vision mode. For example, the contrast adjustment component (121) can identify the contrast adjustment setting information based on the preferred intensity information of the low vision mode, and can adjust the contrast of the image based on the contrast adjustment setting information. The contrast adjustment component (121) can output the image with the adjusted contrast. The operation of the contrast adjustment component (121) is described in more detail below with reference to FIGS. 11A and 11B .
[0127] The dynamic contrast ratio adjustment component (122) can adjust the dynamic contrast ratio for an image (e.g., a first output image). In one embodiment, the dynamic contrast ratio adjustment component (122) can adjust the dynamic contrast ratio for the image based on the preferred intensity information of the low vision mode. For example, the dynamic contrast ratio adjustment component (122) can identify dynamic contrast ratio adjustment setting information based on the preferred intensity information of the low vision mode, and can adjust the dynamic contrast ratio for the image based on the dynamic contrast ratio adjustment setting information. The dynamic contrast ratio adjustment component (122) can output an image with adjusted dynamic contrast ratio. The operation of the dynamic contrast ratio adjustment component (122) is described in more detail below with reference to FIGS. 12A and 12B .
[0128] The sharpness adjustment component (123) can adjust the sharpness of an image (e.g., a first output image). In one embodiment, the sharpness adjustment component (123) can adjust the sharpness around an outline of the image based on the preferred intensity information of the low vision mode. For example, the sharpness adjustment component (123) can identify sharpness adjustment setting information based on the preferred intensity information of the low vision mode, and can adjust the sharpness by adjusting the brightness difference between adjacent pixels around an outline in the image based on the sharpness adjustment setting information. The sharpness adjustment component (123) can output an image with adjusted sharpness. The operation of the sharpness adjustment component (123) is described in more detail below with reference to FIGS. 13A, 13B, and 13C.
[0129] The color adjustment component (124) can adjust the color of an image (e.g., a first output image). In one embodiment, the color adjustment component (124) can adjust the color of the image based on the preferred intensity information of the low vision mode. For example, the color adjustment component (124) can identify the color adjustment setting information based on at least one of the preferred intensity information of the low vision mode or a preset look-up table, and perform color adjustment on at least a portion of the image based on the color adjustment setting information. The color adjustment component (124) can output the color-adjusted image. The operation of the color adjustment component (124) is described in more detail below with reference to FIGS. 14 and 15 .
[0130] The AI upscaling component (125) can remove artifacts (e.g., jagging artifacts) included in an image (e.g., a first output image) using a learned AI model. The AI upscaling component (125) can smoothly adjust outlines included in an image (e.g., a first output image) using a learned AI model.
[0131] The AI model may include, but is not limited to, a convolutional neural network (CNN), a recurrent neural network (RNN), a generative adversarial network (GN), reinforcement learning (RL), and a transformer, for example. In one embodiment, the AI model may be learned based on image characteristic information and user information of a low vision user (e.g., vision, preferred intensity, preferred color), thereby generating a personalized model.
[0132] When the outline of an image is adjusted based on the preferred intensity, jagging artifacts may be strongly visible in the adjusted image depending on the direction of the outline. In this case, an AI upscaling component (125) may be used to remove the jagging artifacts.
[0133] In one embodiment, the AI upscaling component (125) may use the learned first AI model to remove artifacts included in an image in which at least one of the thickness or color of the outline has been adjusted according to a preferred intensity. The learned first AI model may be trained to reduce artifacts included in an image in which the thickness of the outline has been adjusted according to each preferred intensity, for example.
[0134] According to one embodiment, the AI upscaling component (125) may perform upscaling to generate a high-resolution image from an image in which at least one of the outline thickness or color has been adjusted according to a preferred intensity using a pre-trained second AI model. The trained second AI model may be trained to, for example, perform upscaling from an image in which the outline thickness has been adjusted according to each preferred intensity to generate a high-resolution image.
[0135] According to one embodiment, the AI upscaling component (125) may perform upscaling to remove artifacts included in an image in which at least one of the thickness or color of the outline has been adjusted according to a preferred intensity using the learned third AI model, and generate a high-resolution image. The learned third AI model may be trained to, for example, reduce artifacts included in an image in which the thickness of the outline has been adjusted according to each preferred intensity, and perform upscaling on the image to generate a high-resolution image.
[0136] The frame rate conversion component (126) can adjust the frame rate of an image (e.g., a first output image). For example, when an input image is set to a low frame rate, or when an input image is set to a high frame rate but is processed at a low frame rate during processing, for example, to reduce system load, there may be cases where the frame rate needs to be converted to a high frame rate to suit the display output. For example, a frame rate conversion operation needs to be performed for an input source of 24 Hz to output at least 60 Hz or higher.
[0137] For example, when the low vision mode is applied to a VRR (variable refresh rate) source, such as a game source, where the frame rate of the input frame is variable, the display device may perform frame sampling (or frame selection) to process at a fixed frame rate. In this case, the frame rate conversion component (126) may perform frame rate conversion to provide an image processed according to the low vision mode as an output suitable for the input.
[0138] FIG. 8 is a diagram illustrating exemplary image quality adjustment processing according to one embodiment of the present disclosure. FIG. 9 is a diagram illustrating exemplary brightness-related adjustment processing of an electronic device according to one embodiment of the present disclosure.
[0139] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can perform an image processing operation for image quality adjustment (e.g., an image quality adjustment processing operation (320) of FIG. 3).
[0140] Referring to FIG. 8, the image processing operation for image quality adjustment may include a brightness-related adjustment processing operation (810) and / or a color-related adjustment processing operation (820).
[0141] In the brightness-related adjustment processing operation (810), the electronic device may perform at least one operation for brightness-related adjustment of the first output image. The brightness-related adjustment may include, for example, contrast adjustment, dynamic contrast ratio adjustment, and / or sharpness adjustment.
[0142] According to one embodiment, the electronic device may perform at least one operation (a contrast adjustment operation) for adjusting the contrast of a first output image. The contrast adjustment operation may be performed, for example, by the contrast adjustment component (121) of FIG. 7 . For a description of the contrast adjustment operation by the contrast adjustment component (121), reference may be made to the description of FIG. 7 .
[0143] According to one embodiment, the electronic device may perform at least one operation (dynamic contrast adjustment operation) for dynamic contrast adjustment for a first output image. The dynamic contrast adjustment operation may be performed, for example, by the dynamic contrast adjustment component (122) of FIG. 7. For a description of the dynamic contrast adjustment operation by the dynamic contrast adjustment component (122), reference may be made to the description of FIG. 7.
[0144] According to one embodiment, the electronic device may perform at least one operation (a sharpness adjustment operation) for adjusting the sharpness of a first output image. The sharpness adjustment operation may be performed, for example, by the sharpness adjustment component (123) of FIG. 7 , but is not limited thereto. For a description of the sharpness adjustment operation by the sharpness adjustment component (123), reference may be made to the description of FIG. 7 .
[0145] According to one embodiment, the contrast adjustment operation (811) may be performed prior to the dynamic contrast adjustment operation (812) or the sharpness adjustment operation (813), as illustrated in FIG. 9. In this case, the contrast-adjusted image may be used for dynamic contrast adjustment or sharpness adjustment.
[0146] According to one embodiment, the dynamic contrast adjustment operation (812) may be performed prior to the sharpness adjustment operation (813), as illustrated in FIG. 9. In this case, the dynamic contrast adjusted image may be used for sharpness adjustment.
[0147] Through the processing of the brightness-related adjustment processing operation (810) described above, a first output image subjected to brightness adjustment processing can be output.
[0148] In the color-related adjustment processing operation (820), the electronic device may perform at least one operation for color-related adjustment on the first output image subjected to brightness adjustment processing. The color-related adjustment may include, for example, color adjustment.
[0149] According to one embodiment, the electronic device may perform at least one operation for color adjustment on a first output image that has undergone brightness adjustment processing. The at least one operation for color adjustment may be performed, for example, by the color adjustment component (124) of FIG. 7. For a description of the color adjustment operation by the color adjustment component (124), reference may be made to the description of FIG. 7.
[0150] As illustrated in FIG. 8, when the brightness-related adjustment processing operation (810) is performed before the color-related adjustment processing operation (820), the color adjustment processing can be performed by performing a single color conversion after completing various brightness-related adjustment processing without a color conversion process for the color space, thereby improving the efficiency of image processing for low vision users.
[0151] The AI upscaling operation may be performed before, after, or together with the brightness-related adjustment processing operation (810). The AI upscaling operation may be performed before, after, or together with the color-related adjustment processing operation (820).
[0152] FIG. 10 is a diagram for explaining an exemplary image quality adjustment process according to one embodiment of the present disclosure.
[0153] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can perform an image processing operation for image quality adjustment (e.g., an image quality adjustment processing operation (320) of FIG. 3).
[0154] Referring to FIG. 10, the image processing operation for image quality adjustment may include a brightness-related adjustment processing operation (810), a color-related adjustment processing operation (820), and / or a frame rate conversion operation (830). For a description of the brightness-related adjustment processing operation (810) and the color-related adjustment processing operation (820), reference may be made to the descriptions of FIGS. 8 and 9.
[0155] In the example of FIG. 10, the frame rate conversion operation (830) may be performed between the brightness-related adjustment processing operation (810) and the color-related adjustment processing operation (820).
[0156] In the frame rate conversion operation (830), the electronic device may perform at least one operation for adjusting the frame rate for the first output image whose brightness has been adjusted. The frame rate conversion operation (830) may be performed, for example, by the frame rate conversion component (126) of FIG. 7. For a description of the frame rate conversion operation by the frame rate conversion component (126), reference may be made to the description of FIG. 7.
[0157] Through the processing of the frame rate conversion operation (830) described above, the first output image with the frame rate converted is output and can be used for the color-related adjustment processing operation (820).
[0158] FIG. 11A is a flowchart illustrating an exemplary contrast adjustment operation according to one embodiment of the present disclosure. FIG. 11B is a graph illustrating an exemplary contrast adjustment curve used for contrast adjustment according to one embodiment of the present disclosure.
[0159] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can adjust the contrast of an image (e.g., a first output image). The contrast adjustment can be based on, for example, a brightness component (e.g., luminance or luma (e.g., Y component of a YUV or YCbCr color space)) of a plurality of pixels (e.g., all or some pixels in the image) within the image.
[0160] Referring to FIG. 11A, the electronic device can identify contrast adjustment setting information based on preferred intensity information of the low vision mode (11010). The preferred intensity information can indicate one of the preferred intensities of the low vision mode. The preferred intensity of the low vision mode can be identified, for example, based on user input (e.g., user input for item (420) and selection options (421, 422, 423) of FIG. 4A).
[0161] Referring to Fig. 11b, a contrast adjustment curve used for contrast adjustment expresses a corresponding relationship between gain and brightness. As illustrated in Fig. 11b, for a single contrast adjustment curve (e.g., contrast adjustment curve (1101)), as the gain increases, the brightness increases. Therefore, when a single contrast adjustment curve is used to adjust contrast and the gain value of the contrast adjustment curve is set as a parameter for contrast adjustment, the contrast can be adjusted according to the setting of the gain value according to the preferred intensity of the low vision mode.
[0162] According to one embodiment, the memory (10,220) may include gain values corresponding to each preferred intensity of the low vision mode. For example, the memory (10,230) may include a gain value (first gain value) corresponding to a first preferred intensity of the low vision mode (e.g., weak), a gain value (second gain value) corresponding to a second preferred intensity of the low vision mode (e.g., medium), and a gain value (third gain value) corresponding to a third preferred intensity of the low vision mode (e.g., strong). In this case, the gain values may be set to have larger values as the preferred intensity of the low vision mode becomes stronger (e.g., from weak to strong). For example, the third gain value may be set to a value greater than the first gain value and the second gain value, and the second gain value may be set to a value greater than the first gain value. Through this, as the preferred intensity becomes stronger, it may be adjusted to have a brighter contrast value.
[0163] In one embodiment, the electronic device may identify, based on the preferred intensity information, contrast adjustment setting information including a gain value corresponding to the preferred intensity indicated by the preferred intensity information from the memory (10,220). For example, if the preferred intensity of the low vision mode is a second preferred intensity (e.g., medium), the electronic device may identify contrast adjustment setting information including a second gain value corresponding to the second preferred intensity.
[0164] The electronic device can adjust the contrast for the image based on the contrast adjustment setting information (11020).
[0165] In one embodiment, the electronic device may adjust the contrast of an image based on a gain value corresponding to a preferred intensity of a low vision mode included in the contrast adjustment setting information. For example, the electronic device may adjust the brightness of all or part of the pixels included in the image to a brightness (e.g., a value of the Y component) corresponding to the gain value included in the contrast adjustment setting information.
[0166] In the above-described embodiment, the contrast is described as being adjusted using a single contrast adjustment curve, but this is not limited thereto. For example, different contrast adjustment curves may be used for each preferred intensity of the low vision mode. For example, the contrast adjustment curve (1101) may be used for contrast adjustment for a third preferred intensity (e.g., strong), the contrast adjustment curve (1102) may be used for contrast adjustment for a second preferred intensity (e.g., medium), and the contrast adjustment curve (1103) may be used for contrast adjustment for a first preferred intensity (e.g., weak). In this case, the gain value may be set to be the same for each preferred intensity, and the contrast adjustment setting information may include information on the contrast adjustment curve corresponding to the preferred intensity (e.g., identification information of the contrast adjustment curve).
[0167] FIG. 12A is a flowchart illustrating an exemplary dynamic contrast ratio adjustment operation according to one embodiment of the present disclosure. FIG. 12B is a graph illustrating an exemplary dynamic contrast ratio adjustment curve used for dynamic contrast ratio adjustment according to one embodiment of the present disclosure.
[0168] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can adjust a dynamic contrast ratio for an image (e.g., a first output image). Adjusting the dynamic contrast ratio can be based on, for example, adjusting the value of a brightness component (e.g., luminance or luma (e.g., Y component of a YUV or YCbCr color space)) for a plurality of pixels (e.g., all or some pixels in the image) within the image.
[0169] Referring to FIG. 12A, the electronic device can identify dynamic contrast ratio adjustment setting information based on at least one of the preferred intensity information of the low vision mode or at least one additional information (12010).
[0170] The preferred intensity information may indicate one of the preferred intensities of the low vision mode. The preferred intensity of the low vision mode may be identified based on user input (e.g., user input for item (420) and selection options (421, 422, 423) of FIG. 4A).
[0171] At least one additional piece of information may include, for example, information about a color standard (e.g., SDR or HDR), and / or information about a variable representing a tonal characteristic of the image. The variable representing a tonal characteristic of the image may include, for example, at least one of an average pixel level (APL), a maximum pixel value, a minimum pixel value, or a histogram of the image.
[0172] Referring to FIG. 12b, a dynamic contrast ratio adjustment curve (e.g., an S-shaped curve) used for dynamic contrast adjustment expresses a correspondence between input brightness and output brightness. As illustrated in FIG. 12b, the dynamic contrast ratio adjustment curve may be associated with two parameters, Gain_H (1210) and Gain_L (1220). In the present disclosure, Gain_H (1210) may be referred to as a first gain parameter, and Gain_L (1220) may be referred to as a second gain parameter.
[0173] Referring to FIG. 12B, as Gain_H (1210) and Gain_L (1220) increase, the pixel values of pixels having a pixel value (or brightness value) greater than the average pixel level (APL) become larger, and the pixel values of pixels having a pixel value less than the APL become smaller, thereby improving the contrast ratio. For example, a dynamic contrast ratio adjustment curve (1201) having larger Gain_H (1210) and Gain_L (1220) than a dynamic contrast ratio adjustment curve (1202) can have a greater effect of improving the contrast ratio. Therefore, when Gain_H (1210) and Gain_L (1220) of the dynamic contrast ratio adjustment curve are set as parameters for contrast adjustment, the dynamic contrast ratio can be adjusted according to the settings of Gain_H (1210) and Gain_L (1220) according to the preferred intensity of the low vision mode.
[0174] According to one embodiment, the memory (10,220) may include values of Gain_H (1210) and Gain_L (1220) corresponding to each preferred intensity of the low vision mode. For example, the memory (10,230) may include values of Gain_H (1210) and Gain_L (1220) corresponding to a first preferred intensity of the low vision mode (e.g., weak), values of Gain_H (1210) and Gain_L (1220) corresponding to a second preferred intensity of the low vision mode (e.g., medium), and values of Gain_H (1210) and Gain_L (1220) corresponding to a third preferred intensity of the low vision mode (e.g., strong). In this case, the values of Gain_H (1210) and Gain_L (1220) may be set to have larger values as the preferred intensity of the low vision mode becomes stronger (e.g., from weak to strong). For example, the values of Gain_H(1210) and Gain_L(1220) corresponding to the third preferred intensity can be set to values greater than the values of Gain_H(1210) and Gain_L(1220) corresponding to the first or second preferred intensity, and the values of Gain_H(1210) and Gain_L(1220) corresponding to the second preferred intensity can be set to values greater than the values of Gain_H(1210) and Gain_L(1220) corresponding to the first preferred intensity. Through this, as the preferred intensity becomes stronger, it can be adjusted to have a greater contrast ratio.
[0175] In one embodiment, the electronic device may identify, from the memory (10,220), dynamic contrast adjustment setting information including values of Gain_H (1210) and Gain_L (1220) based on the preferred intensity information. For example, if the preferred intensity of the low vision mode is a second preferred intensity (e.g., medium), the electronic device may identify dynamic contrast adjustment setting information including values of Gain_H (1210) and Gain_L (1220) corresponding to the second preferred intensity.
[0176] According to one embodiment, the electronic device can identify contrast adjustment setting information including values of Gain_H (1210) and Gain_L (1220) from the memory (10,220) based on information about a color standard (e.g., SDR or HDR). For example, the values of Gain_H (1210) and Gain_L (1220) applied to an HDR image can be set to be greater than the values of Gain_H (1210) and Gain_L (1220) applied to an SDR image. This is because an HDR image generally has a wider grayscale range than an SDR image.
[0177] According to one embodiment, the values of Gain_H and Gain_L may be fixed values (e.g., fixed values in table form) or functions of variables expressing the grayscale characteristics of the image. The variables expressing the grayscale characteristics of the image may include, for example, at least one of the APL, the maximum pixel value, the minimum pixel value, or the histogram of the image. When a function expressed as a function of dynamic variables is used for dynamic contrast ratio adjustment, it may cause visual fatigue to the user. For example, when the difference in contrast ratio is large for each frame or scene, dynamic contrast ratio adjustment using the function may cause visual fatigue to the user. To prevent and / or reduce this, the IIR (infinite impulse response) method may be used. The IIR method corresponds to a method that calculates and uses a weighted sum of variable values used in the previous frame or previous scene and variable values used in the current frame or current scene.
[0178] Depending on the embodiment, the values of Gain_H (1210) and Gain_L (1220) may be set to the same value.
[0179] The electronic device can adjust the contrast for the image based on the dynamic contrast ratio adjustment setting information (12020).
[0180] According to one embodiment, the electronic device can adjust the dynamic contrast ratio for the image based on the values of Gain_H (1210) and Gain_L (1220) corresponding to the preferred intensity of the low vision mode included in the dynamic contrast ratio adjustment setting information. For example, the electronic device can adjust the pixel value (or brightness) of each pixel based on a dynamic contrast ratio adjustment curve corresponding to the values of Gain_H (1210) and Gain_L (1220) included in the dynamic contrast ratio adjustment setting information.
[0181] In the above-described embodiment, Gain_H (1210) and Gain_L (1220) are described as being set as parameters for dynamic contrast ratio adjustment, but are not limited thereto.
[0182] For example, identification information for a dynamic contrast ratio adjustment curve (e.g., curve (1201, 1202, 1203)) may be set as a parameter for dynamic contrast ratio adjustment. In this case, the dynamic contrast ratio adjustment setting information may include identification information for identifying a dynamic contrast ratio adjustment curve corresponding to the preferred intensity. In this case, the electronic device may adjust a pixel value (or brightness) based on a dynamic contrast ratio adjustment curve corresponding to the preferred intensity of the low vision mode included in the dynamic contrast ratio adjustment setting information.
[0183] FIG. 13a is a flowchart illustrating an exemplary sharpness adjustment operation according to one embodiment of the present disclosure. FIG. 13b is a graph illustrating an exemplary sharpness adjustment method according to one embodiment of the present disclosure. FIG. 13c is a diagram illustrating the effect of sharpness adjustment according to one embodiment of the present disclosure.
[0184] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can adjust the contrast of an image (e.g., a first output image). The contrast adjustment can be based, for example, on a brightness component (e.g., luminance or luma (e.g., Y component of a YUV or YCbCr color space)) of a plurality of pixels adjacent to an outline within the image (e.g., a preset number of pixels adjacent to the outline).
[0185] Referring to FIG. 13A, the electronic device can identify sharpness adjustment setting information based on preferred intensity information of the low vision mode (13010). The preferred intensity information can indicate one of the preferred intensities of the low vision mode. The preferred intensity of the low vision mode can be identified based on user input (e.g., user input for item (420) and selection options (421, 422, 423) of FIG. 4A).
[0186] Referring to Fig. 13b, the sharpness adjustment around the outline is ideally adjusted using a step function, for example, as in 1301. However, since such adjustment is generally difficult to achieve, an overshoot / undershoot method may be used, as in 1302. When the overshoot / undershoot method is applied, as exemplified in 1302, the electronic device may apply overshooting to increase the pixel value (or brightness) of pixels adjacent to the outline that belong to or are associated with a first region (e.g., pixels belonging to the inside of the object), and may apply undershooting to decrease the pixel value (or brightness) of pixels belonging to or are associated with a second region (e.g., pixels belonging to the outside of the object (e.g., background)). Through this, the sharpness around the outline may be increased. For example, as illustrated in FIG. 13c, the sharpness of the outline portion (1321) of the image (1310) to which the sharpness adjustment is applied may be higher than the sharpness of the outline portion (1311) of the image (1310) before the sharpness adjustment is applied. The number of pixels adjacent to the outline may be preset. For example, 10 pixels including 5 pixels belonging to the first area and 5 pixels belonging to the second area in one axis parallel to the x-axis of the pixel area may be set as pixels adjacent to the outline.
[0187] Therefore, if you set the intensity (or degree) of overshooting / undershooting as a parameter for adjusting sharpness, you can adjust the sharpness according to the preferred intensity of the low vision mode.
[0188] According to one embodiment, the memory (10,220) may include information about the intensity of overshooting / undershooting corresponding to each preferred intensity of the low vision mode. For example, the memory (10,230) may include an intensity (first intensity) of overshooting / undershooting corresponding to a first preferred intensity (e.g., weak) of the low vision mode, an intensity (second intensity) of overshooting / undershooting corresponding to a second preferred intensity (e.g., medium) of the low vision mode, and an intensity (third intensity) of overshooting / undershooting corresponding to a third preferred intensity (e.g., strong) of the low vision mode. In this case, the intensity values may be set to have a larger value as the preferred intensity of the low vision mode becomes stronger (e.g., from weak to strong). For example, the third intensity value may be set to a value greater than the first intensity value and the second intensity value, and the second intensity value may be set to a value greater than the first intensity value. Through this, the stronger the preference intensity, the greater the sharpness value can be adjusted. Depending on the embodiment, the intensity of overshooting and undershooting can be set differently.
[0189] In one embodiment, the electronic device may identify, based on the preferred intensity information, sharpness adjustment setting information including an intensity value of overshooting / undershooting corresponding to the preferred intensity indicated by the preferred intensity information from the memory (10,220). For example, if the preferred intensity of the low vision mode is the second preferred intensity, the electronic device may identify sharpness adjustment setting information including a second intensity value corresponding to the second preferred intensity.
[0190] The electronic device can adjust the sharpness of the image based on the sharpness adjustment setting information (11020).
[0191] According to one embodiment, the electronic device can adjust the contrast of the brightness difference between adjacent pixels around an outline in an image based on an intensity value of overshooting / undershooting corresponding to a preferred intensity of a low vision mode included in the sharpness adjustment setting information.
[0192] In the above-described embodiment, the intensity value of overshooting / undershooting is described as a setting value for sharpness adjustment, but is not limited thereto.
[0193] For example, the electronic device may adjust the sharpness of an image using at least one image / video enhancement technique. The image / video enhancement technique may be classified into a method for pixel domain processing or a method for frequency domain processing. The image / video enhancement method may include, but is not limited to, denoising, sharpening, unsharp masking, contrast-based enhancement, HDR-based enhancement, edge aware / preserving filtering, multiscale image decomposition, and / or contrast expansion / compression.
[0194] FIG. 14 is a flowchart illustrating an exemplary color adjustment operation according to one embodiment of the present disclosure.
[0195] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can adjust colors for an image (e.g., a first output image). The color adjustment can be based on, for example, adjusting color components (e.g., a saturation component of a HSV (hue, saturation, value) or HSL (hue, saturation, lightness) color space) for a plurality of pixels included in the image (e.g., pixels included in the entire image or a part of the image).
[0196] Referring to FIG. 14, an electronic device may perform color conversion to convert a first color space into a second color space (14010). According to one embodiment, if the color space of an image is a first color space that does not include a saturation component, the electronic device may perform color conversion to convert the first color space into a second color space that includes a saturation component. The first color space that does not include a saturation component may be, for example, an RGB, YUV, or YCbCr color space. The second color space that includes a saturation component may be, for example, an HSV or HSL color space.
[0197] Color conversion can be performed based on a standardized conversion technique. For example, color conversion from the RGB color space to the HSV color space can be performed using the following mathematical formula.
[0198] [Mathematical Formula 1]
[0199]
[0200] The electronic device can identify color adjustment setting information based on at least one of the preferred intensity information of the low vision mode or a preset look-up table (14020). The electronic device can perform color adjustment on at least a portion of the image based on the color adjustment setting information (14030).
[0201] For example, the electronic device may identify color adjustment setting information including weight values corresponding to the preferred intensities indicated by the preferred intensity information based on the preferred intensity information of the low vision mode. According to one embodiment, the memory (10,220) may include weight values corresponding to each preferred intensity of the low vision mode. The electronic device may obtain an adjusted saturation value by multiplying, dividing, adding, or subtracting the weight value included in the color adjustment setting information from the saturation value of each pixel. Each weight value may be set to be adjusted to have a higher saturation value as the preferred intensity becomes stronger (e.g., from weak to strong).
[0202] For example, an electronic device may identify color adjustment setting information based on a preset lookup table. The lookup table may include preset setting values according to external conditions. The external conditions may include, for example, screen mode, viewing brightness, and / or user selection information. The electronic device may identify the external conditions and identify color adjustment setting information including setting values corresponding to the external conditions identified from the lookup table. The electronic device may obtain an adjusted saturation value using the setting values included in the color adjustment setting information.
[0203] For example, the electronic device may identify color adjustment setting information including weight values corresponding to the preferred intensity indicated by the preferred intensity information and setting values corresponding to external conditions identified from the look-up table based on the preferred intensity of the low vision mode and a preset look-up table. For example, the electronic device may change the saturation value of each pixel using the setting values obtained from the look-up table, and obtain a new saturation value by applying the weight values to the changed saturation value.
[0204] In one embodiment, the electronic device may apply the same color adjustment settings (e.g., weighting values based on the preferred intensity of the low-vision mode or settings based on a look-up table) to the entire image (e.g., each pixel included in the entire image). This may change the saturation of the entire image, thereby improving readability.
[0205] However, increasing the saturation of a specific object in an image in the same manner as other parts of the image may actually reduce visibility for users with low vision. For example, increasing the saturation of an object such as a face may cause the skin color to become redder, which may actually reduce visibility. Therefore, a method of applying different saturation adjustment settings to different parts of the image needs to be considered. This allows for selective saturation adjustment for specific objects (e.g., faces) within the image. This will be described in more detail below with reference to Figure 15.
[0206] The electronic device can perform a color conversion that converts a second color space into a first color space (14040). For example, if color conversion from an RGB color space to an HSV color space and saturation adjustment is performed, the electronic device can convert the HSV color space back into an RGB color space. This allows the color space to be converted back to the original color space. Thereafter, the electronic device can perform subsequent processing in the original color space.
[0207] FIG. 15 is a flowchart illustrating an exemplary color adjustment operation according to one embodiment of the present disclosure.
[0208] An electronic device (e.g., an image processing device (1) of FIG. 1 or a display device (200) of FIG. 2) can adjust colors for an image (e.g., a first output image). The color adjustment can be based on, for example, adjusting color components (e.g., a saturation component of a HSV (hue, saturation, value) or HSL (hue, saturation, lightness) color space) for a plurality of pixels included in the image (e.g., pixels included in the entire image or a part of the image).
[0209] Referring to FIG. 15, an electronic device can identify whether a specific object specified in an image is included (15010). The specific object specified may be, for example, a face or text.
[0210] If a specific object specified in the image is not included, the electronic device may perform color adjustment on the entire image based on the first color adjustment setting information (15020). For example, the electronic device may perform saturation adjustment on each pixel included in the entire image based on the first color adjustment setting information. For a description of saturation adjustment, please refer to the description in FIG. 14.
[0211] The electronic device may perform color adjustment on a portion of the image associated with the specific object based on second color adjustment setting information, and may perform color adjustment on a portion of the image not associated with the specific object based on first color adjustment setting information, if the image includes a specific object (15030). For example, the electronic device may perform saturation adjustment on each pixel included in a portion of the image associated with the specific object based on second color adjustment setting information, and may perform color adjustment on each pixel included in a portion of the image not associated with the specific object based on first color adjustment setting information.
[0212] According to one embodiment, the first color adjustment setting information may be color adjustment setting information (e.g., color adjustment setting information stored in the memory (10,220)) configured based on at least one of a preferred intensity of the low vision mode or a look-up table. The second color adjustment setting information may be color adjustment setting information different from the first saturation adjustment setting information, and may include, for example, a color adjustment setting for setting a saturation adjustment value lower than a saturation adjustment value according to the first color adjustment setting information.
[0213] FIG. 16 is a diagram for explaining the effect of exemplary image processing according to one embodiment of the present disclosure.
[0214] Referring to FIG. 16, it can be confirmed that the output image (16020) by sequentially performing the outline adjustment processing operation of the present disclosure (e.g., the outline adjustment processing operation (310) of FIG. 3) and the image quality adjustment processing operation (e.g., the image quality adjustment processing operation (310) of FIG. 3) has improved visibility compared to the input image (16010). In addition, it can be confirmed that the output image (16020) also has the effect of improving the image quality centered on the outline compared to the input image (16010).
[0215] FIG. 17 is a flowchart illustrating an operation method of an exemplary display device according to one embodiment of the present disclosure.
[0216] Referring to FIG. 17, a display device (e.g., display device (200) of FIG. 2) may identify preferred intensity information for a low vision mode (17010). According to one embodiment, the display device may identify, based on a user input, preferred intensity information indicating a first preferred intensity among a plurality of preferred intensities associated with image processing based on a low vision mode for a user with low vision.
[0217] The display device can obtain a first output image by performing contour adjustment on an input image based on contour adjustment setting information obtained from preferred intensity information (17020). According to one embodiment, the display device can obtain contour thickness setting information corresponding to the first preferred intensity from a memory, and perform contour thickness adjustment on the input image based on the obtained contour thickness setting information.
[0218] The display device can obtain a second output image by performing image quality adjustment on the first output image based on image quality adjustment setting information acquired based on preferred intensity information (17030). According to one embodiment, the display device can obtain image quality adjustment setting information corresponding to the first preferred intensity from a memory, and perform image quality adjustment (image quality adjustment processing) on the image for which the outline thickness has been adjusted based on the acquired image quality adjustment setting information. The image for which image quality adjustment has been performed can then be displayed through the display.
[0219] According to one embodiment, the memory may include outline thickness setting information corresponding to each of a plurality of preferred intensities and image quality adjustment setting information corresponding to each of the plurality of preferred intensities. According to one embodiment, each image quality adjustment setting information may include setting information for adjusting at least one of contrast, dynamic contrast ratio, sharpness, or color for the image according to the corresponding preferred intensities.
[0220] According to one embodiment, a display device may identify, based on a user input, preferred color information indicating a first color among a plurality of preferred colors associated with image processing based on a low vision mode, obtain outline color setting information corresponding to the first preferred color from a memory, and perform color adjustment (color adjustment processing) of an outline for the input image based on the obtained outline color setting information. According to one embodiment, the memory may further include outline color setting information corresponding to each of the plurality of preferred intensities.
[0221] According to one embodiment, the display device can adjust the sharpness of an image by applying overshoot to pixels belonging to a first region among pixels adjacent to an outline to increase brightness, and applying undershoot to pixels belonging to a second region different from the first region to decrease brightness, based on setting information for adjusting sharpness according to a first preferred intensity included in acquired image quality adjustment setting information. According to one embodiment, the first region may correspond to an inner region of an object associated with the outline, and the second region may correspond to an outer region of the object.
[0222] According to one embodiment, the display device can adjust the dynamic contrast ratio for the image based on setting information for adjusting the dynamic contrast ratio according to a first preferred intensity included in acquired image quality adjustment setting information. According to one embodiment, the setting information is associated with an S-shaped curve expressing a correspondence between an input brightness and an output brightness, and can include a first setting value for adjusting pixel values for pixels having a pixel value greater than an average pixel level of the input image, and a second setting value for adjusting pixel values for pixels having a pixel value less than the average pixel level. According to one embodiment, the first setting value and the second setting value can be set based on at least one of the first preferred intensity, information about a color specification, a minimum pixel value, a maximum pixel value, or a histogram.
[0223] According to one embodiment, the display device can adjust the contrast for each pixel included in the image based on setting information for adjusting the contrast according to a first preferred intensity included in the acquired image quality adjustment setting information.
[0224] According to one embodiment, the display device may perform color conversion for converting a first color space into a second color space including a saturation component after adjusting the sharpness of the image, and may perform color adjustment for at least a portion of the image based on setting information for adjusting the color according to a first preferred intensity included in acquired image quality adjustment setting information, and may perform color conversion for converting the second color space into the first color space.
[0225] According to one embodiment, the display device may identify whether a specified object is included in an image, and if the specified object is not included in the image, the display device may not perform color adjustment on each pixel included in the entire image based on setting information for adjusting colors according to a first preferred intensity. If the specified object is included in the image, the display device may perform color adjustment on each pixel included in a portion of the image not associated with the specified object based on the setting information for adjusting colors according to the first preferred intensity, and may perform color adjustment on each pixel included in a portion of the image associated with the specific object based on second setting information for adjusting a color different from the setting information for adjusting colors according to the first preferred intensity.
[0226] As described above, the display device of the present disclosure can simultaneously perform multiple image quality adjustments (e.g., sharpness, dynamic contrast ratio, contrast ratio, and color adjustment) along with outline thickness adjustment according to the preference intensity based on user input, thereby providing a visibility and image quality improvement effect (composite effect) tailored to the user's preference with only a simple user selection.
[0227] In one embodiment, the display device can use the learned AI model to remove artifacts included in an image in which the outline thickness has been adjusted according to the first preferred intensity. In one embodiment, the AI model can be learned to reduce artifacts included in an image in which the outline thickness has been adjusted according to each preferred intensity.
[0228] According to one embodiment, the display device may display selection information guiding a user to select one of a plurality of preferred intensities.
[0229] In the specific embodiments of the present disclosure described above, components included in the present disclosure are expressed in the singular or plural form, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in the plural form may be composed of singular elements, or components expressed in the singular form may be composed of plural elements.
[0230] While the present disclosure has been illustrated and described with reference to various exemplary embodiments, it is to be understood that the various exemplary embodiments are illustrative and not limiting. Those skilled in the art will further appreciate that various modifications are possible within the scope of the present disclosure, including the appended claims and their equivalents. It is also to be understood that any embodiment(s) described in the present disclosure may be used in conjunction with other embodiments described in the present disclosure.
Claims
1. In the display device, A memory storing a program containing at least one instruction; and At least one processor, comprising a processing circuit coupled to said memory and executing at least one instruction of a program stored in said memory; At least one processor, individually and / or collectively: Based on the input, preference intensity information indicating a first preference intensity among a plurality of preference intensities associated with image processing based on a low vision mode is identified, Performs contour thickness adjustment processing for an input image based on contour thickness setting information corresponding to the first preferred intensity, It is set to perform image quality adjustment processing on an image for which the outline thickness adjustment processing has been performed based on image quality adjustment setting information corresponding to the first preferred intensity. The above memory includes outline thickness setting information corresponding to each of the plurality of preferred intensities and image quality adjustment setting information corresponding to each of the plurality of preferred intensities, A display device, wherein each image quality adjustment setting information includes setting information for adjusting at least one of contrast, dynamic contrast ratio, sharpness, or color for the image according to the preferred intensity.
2. In paragraph 1, At least one processor, individually and / or collectively: Based on the input, preferred color information indicating a first color among a plurality of preferred colors associated with image processing based on the low vision mode is identified, It is set to obtain outline color setting information corresponding to the first preferred color from the above memory, and perform color adjustment processing of the outline for the input image based on the obtained outline color setting information. A display device, wherein the memory further includes outline color setting information corresponding to each of the plurality of preferred intensities.
3. In paragraph 2, At least one processor, individually and / or collectively: Based on the setting information for adjusting the sharpness according to the first preferred intensity included in the acquired image quality adjustment setting information, overshoot is applied to pixels belonging to a first area among pixels adjacent to the outline to increase the brightness, and undershoot is applied to pixels belonging to a second area different from the first area to decrease the brightness, thereby adjusting the sharpness of the image. A display device, wherein the first region corresponds to an inner region of the object associated with the outline, and the second region corresponds to an outer region of the object.
4. In paragraph 2 or 3, At least one processor, individually and / or collectively: Based on the setting information for adjusting the dynamic contrast ratio according to the first preferred intensity included in the acquired image quality adjustment setting information, the dynamic contrast ratio for the image is set to be adjusted. A display device, wherein the above setting information is associated with an S-type curve expressing a correspondence between input brightness and output brightness, and includes a first setting value for adjusting pixel values for pixels having a pixel value greater than an average pixel level of the input image, and a second setting value for adjusting pixel values for pixels having a pixel value less than the average pixel level.
5. In paragraph 4, A display device, wherein the first setting value and the second setting value are set based on at least one of the first preferred intensity, information about color specifications, a minimum pixel value, a maximum pixel value, or a histogram.
6. In any one of paragraphs 2 to 5, At least one processor, individually and / or collectively: A display device further configured to adjust the contrast for each pixel included in the image based on setting information for adjusting the contrast according to the first preferred intensity included in the acquired image quality adjustment setting information.
7. In any one of paragraphs 3 to 6, At least one processor, individually and / or collectively: Based on the adjustment of the sharpness of the above image, a color transformation is performed to transform the first color space into a second color space including a saturation component, Performing color adjustment for at least a portion of the image based on setting information for adjusting the color according to the first preferred intensity included in the acquired image quality adjustment setting information, A display device set to perform color conversion that converts the second color space into the first color space.
8. In paragraph 7, At least one processor, individually and / or collectively: Identify whether the above image contains a specific object specified in the image, Based on the fact that a specific object specified in the image is not included, color adjustment processing is performed for each pixel included in the entire image based on the setting information for adjusting the color according to the 1st preference intensity, A display device, wherein the display device is configured to perform color adjustment for each pixel included in a portion of the image that is not associated with the specific object based on setting information for adjusting a color according to the first preferred intensity, based on the inclusion of a specific object predefined in the image, and to perform color adjustment processing for each pixel included in a portion of the image associated with the specific object based on second setting information for adjusting the color that is different from the setting information for adjusting a color according to the first preferred intensity.
9. In paragraph 2, At least one processor, individually and / or collectively: It is further set to remove artifacts included in the image in which the thickness of the outline is adjusted according to the first preferred intensity using a pre-learned artificial intelligence model. A display device in which the above artificial intelligence model is trained to reduce artifacts included in an image in which the thickness of the outline is adjusted according to each preferred intensity.
10. In paragraph 2, At least one processor, individually and / or collectively: A display device configured to display selection information guiding selection of one of the above multiple preferred intensities.
11. In the method of operating the display device, An operation for identifying, based on an input, preference intensity information indicating a first preference intensity among a plurality of preference intensities associated with image processing based on a low vision mode; An operation for performing a thickness adjustment process of an outline for an input image based on outline thickness setting information corresponding to the first preferred intensity; and An operation for performing image quality adjustment processing on an image in which the thickness of the outline has been adjusted based on image quality adjustment setting information corresponding to the first preferred intensity, The above memory includes outline thickness setting information corresponding to each of the plurality of preferred intensities and image quality adjustment setting information corresponding to each of the plurality of preferred intensities, A method of operation, wherein each image quality adjustment setting information includes setting information for adjusting at least one of contrast, dynamic contrast ratio, sharpness or color for the image according to a corresponding preferred intensity.
12. In paragraph 11, the method: An operation of identifying, based on the input, preferred color information indicating a first color among a plurality of preferred colors associated with image processing based on the low vision mode; and Further comprising an operation of obtaining outline color setting information corresponding to the first preferred color from the memory, and performing color adjustment of an outline for the input image based on the obtained outline color setting information. A method of operation, wherein the memory further includes outline color setting information corresponding to each of the plurality of preferred intensities.
13. In paragraph 12, The actions for performing the above image quality adjustment processing are: The method further includes an operation of adjusting the sharpness of the image by applying overshoot to pixels belonging to a first region among pixels adjacent to the outline to increase brightness, and applying undershoot to pixels belonging to a second region different from the first region to decrease brightness, based on the setting information for adjusting the sharpness according to the first preferred intensity included in the acquired image quality adjustment setting information. A method of operation, wherein the first region corresponds to an inner region of the object associated with the outline, and the second region corresponds to an outer region of the object.
14. In paragraph 12 or 13, The actions for performing the above image quality adjustment processing are: Further comprising an operation of adjusting the dynamic contrast ratio for the image based on setting information for adjusting the dynamic contrast ratio according to the first preferred intensity included in the acquired image quality adjustment setting information, An operating method, wherein the above setting information is associated with an S-type curve expressing a correspondence between input brightness and output brightness, and includes a first setting value for adjusting pixel values for pixels having a pixel value greater than an average pixel level of the input image, and a second setting value for adjusting pixel values for pixels having a pixel value less than the average pixel level.
15. In paragraph 14, An operating method, wherein the first setting value and the second setting value are set based on at least one of the first preferred intensity, information about the color specification, a minimum pixel value, a maximum pixel value, or a histogram.
Citation Information
Patent Citations
Information processing apparatus, information processing method, and program
JP2021197018A
Display device and operating method thereof for the same
KR1020180052501A
Honeycomb core inner cutout bevel processing method and processing device
KR1020200099017A
System and Method for operating and analysing of Mission Equipmen
KR102648005B1
System and method for improved display
US20170360295A1
