Electronic device and control method therefor

Abstract

Disclosed is an electronic device. One or more processors, when instructions are individually or collectively executed, cause the electronic device to: control a display to display a multi-view image including a plurality of images when a user input for viewing the plurality of images is received while one image is displayed via the display; when a user input for selecting one image from among the plurality of images and viewing the selected image in a low vision mode is received, acquire a first image in which an outline of an object included in the selected image is emphasized; acquire an output image which includes the first image and the remaining images other than the first image among the plurality of images and in which an edge of the first image is emphasized; and control the display to display the output image thereon.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device and a method for controlling the same, and more specifically, to an electronic device that provides a viewing mode for people with low vision and a method for controlling the same.

[0002] Driven by advancements in electronic technology, various types of electronic devices are being developed and distributed. In particular, display devices such as TVs and laptops are being developed in diverse forms.

[0003] Generally, display devices such as TVs provide a low-vision mode (or relumino mode) to help visually impaired people with low vision.

[0004] According to one example of the low-vision mode, outline areas can be highlighted in a specific color. The outline highlighting feature emphasizes the boundaries of an image, helping people with low vision to better perceive the shape and movement of objects.

[0005] An electronic device according to one or more embodiments of the present disclosure comprises one or more processors including a display, a memory for storing instructions, and processing circuitry.

[0006] According to one or more embodiments, when the instructions are executed individually or collectively, the electronic device controls the display to display a multi-view image including the plurality of images when user input for viewing a plurality of images is received while a single image is displayed through the display, and when user input for selecting one of the plurality of images to view in low-vision mode is received, the electronic device controls the display to obtain a first image in which the outline of an object included in the selected image is highlighted, obtains the remaining images among the plurality of images excluding the first image, and an output image including the first image in which the border of the first image is highlighted, and controls the display to display the output image on the display.

[0007] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the electronic device identifies highlighting processing information for highlighting the outline of the object in the first image and highlights the border of the first image based on the highlighting processing information.

[0008] According to one or more embodiments, the highlighting information is information including at least one of the color, thickness, and style of the outline.

[0009] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the electronic device highlights the border of the first image based on at least one of a preset color, a preset thickness, and a preset style to highlight the border.

[0010] According to one or more embodiments, when the instructions are executed individually or collectively by one or more processors, the electronic device mixes the first image, the second image including the remaining image, and the third image including the border information of the first image to obtain the output image.

[0011] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device identifies highlighting processing information for highlighting the outline of the object in the first image, identifies location information corresponding to the selected image in the multi-view image, and acquires the third image based on the highlighting processing information and the location information corresponding to the selected image.

[0012] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device controls the display to display the first image on the full screen when user input for viewing the first image on the full screen is received, and controls the display to display a multi-view image with a low-vision mode applied when user input for selecting a multi-view mode is received, wherein in the low-vision mode, the multi-view image has the outlines of objects included in each of the plurality of images and the borders of each of the plurality of images highlighted.

[0013] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device controls the display to display a Picture-in-Picture (PIP) image including a window of a preset size in a portion of the display screen, and when user input for viewing in low-vision mode is received, the border of the window of the preset size is highlighted.

[0014] According to one or more embodiments, when the instructions are executed individually or collectively by the one or more processors, the electronic device displays a UI for border settings on the display when a low-vision mode is executed while a multi-view image is provided, and the UI (user interface) includes a menu for setting at least one of whether to highlight the border, border color, border thickness, and border style.

[0015] A control method for an electronic device according to one or more embodiments of the present disclosure comprises: an operation of displaying a multi-view image including a plurality of images when a user input for viewing a plurality of images is received while a single image is being displayed; an operation of acquiring a first image in which the outline of an object included in the selected image is highlighted when a user input for viewing one of the plurality of images in a low-vision mode is received; an operation of acquiring the remaining images among the plurality of images excluding the first image, an output image including the first image in which the border of the first image is highlighted, and an operation of displaying the output image.

[0016] A non-transient computer-readable storage medium storing computer instructions that cause the electronic device to perform an operation when executed by a processor of an electronic device according to one or more embodiments of the present disclosure, wherein the operation comprises: an operation of displaying a multi-view image including a plurality of images when a user input for viewing a plurality of images is received while a single image is being displayed; an operation of acquiring a first image in which the outline of an object included in the selected image is highlighted when a user input for viewing one of the plurality of images in a low-vision mode is received; an operation of acquiring the remaining images among the plurality of images excluding the first image, an output image including the first image and in which the border of the first image is highlighted, and an operation of displaying the output image.

[0017] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0018] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0019] FIG. 3 is a block diagram illustrating the detailed configuration of an electronic device according to one or more embodiments.

[0020] FIG. 4 is a diagram illustrating a first image acquisition process of an electronic device according to one or more embodiments.

[0021] FIG. 5 is a diagram illustrating a first image processing process of an electronic device according to one or more embodiments.

[0022] FIG. 6 is a diagram illustrating the process of edge enhancement processing of an image with a low-vision mode applied according to one or more embodiments.

[0023] FIG. 7 is a diagram for explaining a third image acquisition process including edge information of a first image according to one or more embodiments.

[0024] FIG. 8 is a diagram illustrating the process of acquiring an output image of an electronic device according to one or more embodiments.

[0025] FIG. 9 is a diagram illustrating the process of displaying a multi-view image of an image with a low-vision mode applied according to one or more embodiments.

[0026] FIGS. 10 and FIGS. 11 are drawings for explaining the PIP image display process of an electronic device according to one or more embodiments.

[0027] FIG. 12 is a drawing for explaining a border setting UI of an electronic device according to one or more embodiments.

[0028] FIG. 13 is a drawing for explaining the operation process of an electronic device according to one or more embodiments.

[0029] FIG. 14 is a drawing for explaining the overall operation process of an electronic device according to one or more embodiments.

[0030] The terms used in the various embodiments of this Disclosure have been selected to be as widely used and general as possible, taking into account their functions within this Disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant description section of this Disclosure. Therefore, terms used in this Disclosure should be defined not merely by their names, but based on their meanings and the overall content of this Disclosure.

[0031] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components such as parts) and do not exclude the presence of additional features.

[0032] The expression "at least one of A or / and B" should be understood as representing either "A" or "B" or "A and B".

[0033] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0034] Where it is stated that a component (e.g., Component 1) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., Component 2), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., Component 3).

[0035] The singular expression includes the plural expression unless the context clearly indicates otherwise. In this disclosure, terms such as “comprising” or “consisting of” are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not precluding the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0036] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor (not shown), except for a "module" or "part" that needs to be implemented in specific hardware.

[0037] In the present disclosure, the term "user" may refer to a person using an electronic device or a device used by such person.

[0038] One or more embodiments of the present disclosure will be described in more detail below with reference to the attached drawings.

[0039] FIG. 1 is a drawing for explaining the operation of an electronic device according to one or more embodiments.

[0040] According to one or more embodiments, the electronic device (100) may provide an image with a low-vision mode (or relumino mode) applied. Here, the electronic device (100) may be implemented as various types of electronic devices such as a smart TV, monitor, kiosk, tablet PC, digital photo frame, mobile phone, LFD (large format display), Digital Signage, DID (Digital Information Display), video wall, projector display, etc. However, in some cases, it may be implemented as an image processing device (e.g., set-top box, one connected box) that is connected to the electronic device to provide an image.

[0041] Low vision mode can be a special feature designed for users who have difficulty enjoying visual content. In low vision mode, various assistive functions may be provided, such as highlighting the outlines of objects included in the video, adjusting text size and font, adjusting brightness and contrast, adjusting colors, and providing voice guidance and narration.

[0042] In low vision mode, user customization features may generally be included to save and manage settings preferred by the user. Generally, low vision users tend to prefer images in which detailed representations within an object are omitted and the outlines of the object are more clearly emphasized. Accordingly, the electronic device (100) can perform outline enhancement processing (20) to emphasize the outlines of the object included in the input image (10) as illustrated in FIG. 1.

[0043] According to one or more embodiments, the electronic device (100) receives a plurality of images from at least one input device and can provide a multi-view image including a plurality of images.

[0044] For example, while the electronic device (100) is displaying a single image through a display, if a user input corresponding to a multi-view mode for viewing multiple images is received from a user, the device may provide a multi-view image including multiple images.

[0045] A multi-view video may be a video that provides multiple videos simultaneously on a single screen. A multi-view video may be a video that provides multiple videos simultaneously by displaying one video in each of multiple areas divided into pre-set sizes.

[0046] For example, when four images are received from at least one input device, as illustrated in FIG. 1, the electronic device (100) can provide multiple images simultaneously by displaying one of the multiple images in each of four equally divided areas. Multi-view images are not limited thereto and may be referred to in various ways, such as multi-screen images, split-screen images, or simultaneous screen playback images, but in the present disclosure, they are collectively referred to as multi-view images.

[0047] According to one or more embodiments, the electronic device (100) may set at least one of a plurality of images displayed as a multi-view image to a low-vision mode and provide the image set to the low-vision mode and the remaining images simultaneously.

[0048] Referring to FIG. 1, an electronic device (100) can provide a plurality of images including an input image (10) as a multi-view image (30). The electronic device (100) can receive user input from a user to apply a low-vision mode to an image selected by the user among the plurality of images. The electronic device (100) can provide an image (40) with a low-vision mode applied by performing contour highlighting processing (20) of an object included in the selected image.

[0049] However, users watching multi-view videos that include videos set to low-vision mode may experience a problem with reduced visibility because the boundaries of each video are not clearly displayed.

[0050] Video visibility refers to the degree to which a user viewing multiple videos can clearly perceive them, and it can be influenced by various visual elements such as color, contrast, and brightness. If the background color, brightness, etc., of a video set to low-vision mode is similar to that of a video placed side-by-side, a user with low vision watching the video set to low-vision mode may experience difficulty viewing that video.

[0051] Hereinafter, with reference to the drawings, various embodiments will be described in which an electronic device (100) enhances the visibility of an image by highlighting the border of an image set to a low-vision mode among a plurality of images displayed in a multi-view.

[0052] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one or more embodiments.

[0053] According to FIG. 2, the electronic device (100) includes a display (110), a memory (120), and one or more processors (130). However, it is not limited thereto, and the electronic device (100) may be implemented with some components excluded or with other components included.

[0054] The display (110) is configured to provide a plurality of input images received from an input device to a user. The display (110) may be implemented as a display including a self-emissive element or as a display including a non-emissive element and a backlight. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (110) may also include a driving circuit, a backlight unit, etc., which can be implemented in the form of an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc.

[0055] The memory (120) can store at least one instruction, data, program, etc. required for the operation of the electronic device (100). For example, the memory (120) can store contour highlighting processing information and location information corresponding to a selected image.

[0056] The memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory detachable from the electronic device (100), depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in a memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in a memory detachable from the electronic device (100).

[0057] In the case of memory embedded in the electronic device (100), it may be implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD).

[0058] The memory (120) may be implemented as a single memory that stores data generated in various operations according to the present disclosure, but is not limited thereto, and the memory (120) may be implemented to include a plurality of memories that each store different types of data or each store data generated in different stages.

[0059] One or more processors (130) control the overall operation of the electronic device (100). Specifically, one or more processors (130) may be connected to each component of the electronic device (100) to control the overall operation of the electronic device (100). For example, one or more processors (130) may be electrically connected to the display (110) and memory (120) to control the overall operation of the electronic device (100). One or more processors (130) may include processing circuits and may be composed of one or more processors.

[0060] One or more processors (130) can perform the operation of an electronic device (100) according to various embodiments by executing one or more instructions stored in memory (120).

[0061] One or more processors (130) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator. One or more processors (130) may control one or any combination of other components of an electronic device and may perform operations or data processing related to communication. One or more processors (130) may execute one or more programs or instructions stored in memory. For example, one or more processors may perform a method according to one or more embodiments of the present disclosure by executing one or more instructions stored in memory.

[0062] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first processor, or the first operation and the second operation may be performed by a first processor (e.g., a general-purpose processor) and the third operation may be performed by a second processor (e.g., an artificial intelligence dedicated processor).

[0063] One or more processors (130) may be implemented as a single-core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as multicore processors, each of the multiple cores included in the multicore processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multicore processor. Additionally, each of the multiple cores included in the multicore processor (or some of the multiple cores) may independently read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure, or all (or some) of the multiple cores may be linked together to read and execute program instructions for implementing a method according to one or more embodiments of the present disclosure.

[0064] When a method according to one or more embodiments of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one of the plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by a first core included in a multi-core processor, or the first operation and the second operation may be performed by a first core included in a multi-core processor and the third operation may be performed by a second core included in a multi-core processor.

[0065] In the embodiments of the present disclosure, a processor may refer to a system-on-chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, GPU, APU, MIC, DSP, NPU, hardware accelerator, or machine learning accelerator, but the embodiments of the present disclosure are not limited thereto. For convenience of explanation, one or more processors (130) will be referred to as processors (130) below.

[0066] According to one or more embodiments, the processor (130) may control the display (110) to display a multi-view image including multiple images when user input for viewing multiple images is received while one image is being displayed through the display (110).

[0067] According to one or more embodiments, when a user input is received for selecting one of a plurality of images to view in a low-vision mode, the processor (130) can obtain a first image in which the outline of an object included in the selected image is highlighted.

[0068] According to one example, the processor (130) may receive user input for selecting one of a multi-view video including a plurality of videos from a controller or mobile device connected to the electronic device (100) via wired or wireless connection. The processor (130) may receive user input for viewing the selected video in a low-vision mode.

[0069] The first image may be an image in which the outlines of objects included in the image are highlighted according to user settings based on user input for viewing in low-vision mode. For example, the first image may be an image in which the outlines of all objects in all images included in a multi-view image containing multiple images are highlighted. For example, the first image may be an image in which the outlines of objects are highlighted only for the image selected by the user among the multiple images.

[0070] According to one or more embodiments, the processor (130) may obtain an output image including the first image and the remaining images among the plurality of images excluding the first image, and the first image in which the border of the first image is highlighted.

[0071] The output image may include both the image with low vision mode applied and the image without low vision mode applied. The image with low vision mode applied may be an image in which the outlines of objects included in the image are highlighted. The output image may be an image in which only the borders of the image with low vision mode applied are highlighted.

[0072] According to one or more embodiments, the processor (130) can control the display to display the output image on the display.

[0073] FIG. 3 is a block diagram illustrating the detailed configuration of an electronic device according to one or more embodiments.

[0074] According to FIG. 3, the electronic device (100) includes a display (110), memory (120), one or more processors (130), a speaker (140), a communication circuit (150), a user interface (160), and an input / output interface (170). A detailed description of the configurations shown in FIG. 3 that overlap with the configuration shown in FIG. 2 will be omitted.

[0075] The speaker (140) can convert and amplify a digital audio signal processed by the processor (130) into an analog audio signal and output it. For example, the speaker (140) may include at least one speaker unit, a D / A converter, an audio amplifier, etc., capable of outputting at least one channel. For example, the speaker (140) may output various notifications, messages, information, etc. related to feedback from the processor (130).

[0076] The communication circuit (150) may include wired or wireless input / output interfaces (or input / output terminals) according to various standards. The communication circuit (150) may be configured to communicate with various types of external devices according to various types of communication methods. The communication circuit (150) may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

[0077] The communication circuit (150) may include various interfaces such as HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), Bluetooth, Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, AES / EBU (Audio Engineering Society / European Broadcasting Union), Optical, Coaxial, etc.

[0078] The user interface (160) may be implemented as a device such as a button, touchpad, mouse, and keyboard, or as a touch screen capable of performing the aforementioned display function and operation input function.

[0079] According to one example, the user interface (160) may receive a user command for selecting a low-vision mode, a user command for selecting the thickness and / or color of the contour (or edge) in the low-vision mode, etc.

[0080] The input / output interface (170) may be any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface). The input / output interface (170) may input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (170) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals.

[0081] FIG. 4 is a diagram illustrating a first image acquisition process of an electronic device according to one or more embodiments.

[0082] According to one or more embodiments, the electronic device (100) can acquire a first image (410) in which the outline of an object included in the image is highlighted. The electronic device (100) can acquire a first image in which a low-vision mode is applied to a selected image or the entire image among a plurality of images.

[0083] According to one or more embodiments, the electronic device (100) may set a multi-view image containing a plurality of images into a single frame. The electronic device (100) may adjust the scale of each of the plurality of images to place the plurality of images in each of the divided areas. Here, a single frame may be a frame in which the plurality of images are placed in each of the divided areas and displayed as a single image overall. For example, the electronic device (100) may place four images in each of the four divided areas to obtain a single multi-view image containing all four images.

[0084] According to one or more embodiments, the electronic device (100) can acquire a first image (410) by applying a low-vision mode to the entire multi-view image (420). The electronic device (100) can acquire a first image (410) in which the contours of each of the plurality of objects included in the multi-view image (420) are highlighted.

[0085] According to one example, the electronic device (100) can identify a plurality of objects included in a multi-view image (420) and obtain a first image (410) by highlighting the contours of the identified objects. For example, the electronic device (100) can perform contour highlighting by recognizing the contours of objects and the boundaries between objects through computer vision technology or an artificial intelligence model.

[0086] According to one example, the electronic device (100) can obtain a first image through an overlay method that mixes an image showing only the outline of an object with a multi-view image (420). That is, the first image can be obtained by mixing an image layer containing the multi-view image (420) and an image layer in which the outline of an object is highlighted at the same position.

[0087] In FIG. 4, multiple images are assumed to be four in number for explanation. Referring to FIG. 4, an electronic device (100) can acquire a multi-view image (420) in which multiple images received from at least one input device are set as one frame. The electronic device (100) can identify multiple objects included in the multi-view image (420) and enhance the outlines of the objects to acquire a first image (410) to which a low-vision mode is applied.

[0088] FIG. 5 is a diagram illustrating a first image processing process of an electronic device according to one or more embodiments.

[0089] According to one or more embodiments, when a user input for selecting one of a plurality of images is received, the electronic device (100) can acquire a first image in which the outline of an object included in the selected image is highlighted.

[0090] According to one example, the electronic device (100) can identify location information corresponding to a selected image in a multi-view image (420). For example, the electronic device (100) can identify pixel locations corresponding to each vertex of the selected image. For example, pixel coordinates corresponding to each vertex of the selected image can be identified with the center of the multi-view image (420) as the origin.

[0091] Referring to FIG. 5, when the electronic device (100) receives user input for selecting one of a plurality of images, it can identify pixel coordinates (520-1 to 520-4) corresponding to each vertex of the selected image (510). The electronic device (100) can identify the selected image (510) and the region corresponding to the selected image by connecting each of the identified pixel coordinates.

[0092] According to one or more embodiments, the electronic device (100) can perform contour highlighting processing only on the selected image (510) based on pixel coordinates (520-1, 520-2, 520-3, 520-4) corresponding to each vertex of the selected image (510).

[0093] Referring to FIG. 5, the electronic device (100) can identify the location of the selected image (510) based on pixel coordinates (520-1 to 520-4) corresponding to each vertex of the selected image (510). The electronic device (100) can perform contour highlighting processing only on the selected image (510) from the first image (410). The first image (550) may be an image in which the contours of an object included in a plurality of images are highlighted as described in FIG. 4, but may also be an image in which the contours of an object are highlighted only on the selected image as in FIG. 5. For convenience of explanation, the first image (550) will be described below as an image in which the contours of an object are highlighted only on the selected image (510). Accordingly, the first image (550) may include a first region (530) containing the selected image (510) and a second region (540) that is empty or transparent, corresponding to an image other than the selected image (510).

[0094] FIG. 6 is a diagram illustrating the process of edge enhancement processing of an image with a low-vision mode applied according to one or more embodiments.

[0095] According to one or more embodiments, the electronic device (100) identifies contour processing information for an object in a first image and can highlight the border of the first image based on the identified highlight processing information.

[0096] The outline highlighting information may be information including at least one of the outline's color, thickness, and style. For example, the outline highlighting information may include information regarding the line style, such as the color based on the outline's pixel information, the line thickness, or a solid or dotted line.

[0097] According to one example, the electronic device (100) can identify contour highlighting processing information based on pixel information of a first image. For example, color and thickness information of the contour can be identified based on the R, G, and B pixel values ​​of the contour displayed in the first image.

[0098] According to one example, the electronic device (100) can identify contour highlighting processing information based on received user input. For example, if the user inputs a green color, 5 mm thickness, and solid line style to apply a low-vision mode to an image selected based on a controller or mobile device, the electronic device (100) can identify contour highlighting processing information based on user input.

[0099] According to one example, the electronic device (100) can highlight the border of the first image with the same color, thickness, and style as the contour applied to the first image based on identified highlighting information.

[0100] Referring to FIG. 6, the electronic device (100) can identify contour highlighting information (620) in a first image (610) to which a low-vision mode is applied. The electronic device (100) can identify color, thickness, or style information of the contour based on the contour highlighting information (620). The electronic device (100) can highlight the border of the first image (610) (630) based on the identified highlighting information (620).

[0101] FIG. 7 is a diagram for explaining a third image acquisition process including edge information of a first image according to one or more embodiments.

[0102] According to one or more embodiments, the electronic device (100) may identify highlight processing information for the contour of an object in a first image, identify location information corresponding to a selected image in a multi-view image, and acquire a third image based on the highlight processing information of the identified contour and the location information corresponding to the selected image.

[0103] According to one example, the third image may be an image containing border information corresponding to a selected image included in the first image. The third image may be an image in which a border surrounding the selected image is displayed based on pixel locations corresponding to the selected image. The border information may include information regarding border color, thickness, style, and location based on highlight processing information for the outline of an object included in the first image and location information corresponding to the selected image.

[0104] Referring to FIG. 7, the electronic device (100) can identify color, thickness, and style information of a line to be displayed on a border based on highlight processing information (710) for a contour. The electronic device (100) can identify location information (720) where the border is to be displayed based on pixel locations for each vertex of a selected image. The electronic device (100) can obtain a third image (730) with the border displayed based on the identified highlight processing information of the contour and the location information of the selected image.

[0105] FIG. 8 is a diagram illustrating the process of acquiring an output image of an electronic device according to one or more embodiments.

[0106] According to one or more embodiments, the electronic device (100) may obtain an output image by mixing a first image (550), a second image (810) including the remaining image excluding the first image, and a third image (730) including the border information of the first image.

[0107] According to one or more embodiments, the electronic device (100) may obtain an output image by mixing a first image (550), a second image (810) including the remaining image excluding the first image, and a third image (730) including the border information of the first image.

[0108] According to one example, the electronic device (100) may mix the first image (550), the second image (810), and the third image (730) using alpha blending. Mixing may be a technique for combining two or more different frames into one frame. Mixing may be referred to in various ways, such as frame mixing or layer mixing, but in this disclosure, it will be referred to as mixing.

[0109] For example, the electronic device (100) can obtain one output image based on an alpha blending image (or alpha map) corresponding to a first image (550), a second image (810), and a third image (730).

[0110] Here, alpha blending refers to a method of displaying an image by mixing the background RGB values ​​with the RGB values ​​on top of it. This is done by assigning a new value called A (Alpha) to the RGB color values ​​to create a transparent effect when overlaying another image. For example, Alpha values ​​are categorized from 0 to 255 or from 0.0 to 1.0; 0 represents completely transparent, while the opposite—255 (or the highest value like 1.0)—represents completely opaque. Alternatively, 0 represents completely opaque, and 255 (or the highest value like 1.0) represents completely transparent. For instance, assuming 8 bits are allocated to the Alpha value to represent values ​​from 0 to 255, a higher value indicates a higher proportion of the corresponding pixel, while a lower value indicates a lower proportion. For example, when mixing video (V) and graphics (G), the mixing operation can be expressed by a formula such as V*Alpha + G*(1-Alpha) or V*(1-Alapha)+G*alpha or V*Alpha+G.

[0111] According to one example, the mixing operation may be performed through at least one mixer, and at least one mixer may be implemented in software and / or hardware. For example, at least one mixer may include a first mixer that mixes the first image (550) and the second image (810), and a second mixer that mixes the output of the first mixer and the third image (730). The output of the first mixer may be an image in which the first image (550) and the second image (810) are mixed. However, the mixing order is not necessarily limited to this. For example, the first image (550) and the third image (730) may be mixed first, and then the second image (810) may be mixed. For example, the first image (550), the second image (810), and the third image (730) may be mixed at once using a single mixer.

[0112] According to one or more embodiments, the electronic device (100) can perform image processing on the first image (550), the second image (810), and the third image (730) all at the same scale. The electronic device (100) can identify each image layer containing each image and mix each image layer into one image.

[0113] Referring to FIG. 8, the electronic device (100) can mix the first image (550), the second image (810), and the third image (730) into a single image such that each vertex of each image is located on the same line. The electronic device (100) can obtain an output image (820) in which the contours of the selected image are highlighted only for the selected image in the multi-view image, and the border surrounding the selected image is highlighted.

[0114] According to one or more embodiments, the electronic device (100) can display an output image (820) through a display (110).

[0115] FIG. 9 is a diagram illustrating the process of displaying a multi-view image of an image with a low-vision mode applied according to one or more embodiments.

[0116] According to one or more embodiments, when the electronic device (100) receives user input to view the image (910) with the low-vision mode applied in full screen, the display (110) can be controlled to display the image (910) with the low-vision mode applied in full screen.

[0117] According to one or more embodiments, when the electronic device (100) receives a user input selecting a multi-view mode, it can control the display (110) to display a multi-view image (920) with a low-vision mode applied.

[0118] A multi-view video with low vision mode applied may be a video in which the outlines of objects included in each of the multiple videos are highlighted, and the edges of each of the multiple videos are highlighted.

[0119] Referring to FIG. 9, the electronic device (100) can provide a video (910) with a low-vision mode applied in full screen. When user input for viewing in multi-view mode is received from a user, the electronic device (100) can display multiple videos as multi-view videos and display multiple videos with a low-vision mode applied through the display (110). At this time, the electronic device (100) can display through the display (110) an image in which an object (940) included in each of the multiple videos and a border (930) surrounding each of the multiple videos are highlighted.

[0120] FIGS. 10 and FIGS. 11 are drawings for explaining the PIP image display process of an electronic device according to one or more embodiments.

[0121] According to one or more embodiments, the electronic device (100) can control the display (110) to display a Picture in Picture (PIP) image including a window of a preset size in a portion of the display screen.

[0122] According to one or more embodiments, when a user input for viewing in low-vision mode is received, the electronic device (100) can highlight the border of a window of a preset size.

[0123] A PIP video may be a video that provides both the entire video and the video contained within a window of a preset size by displaying a video of a preset size in a part of the display screen through a window while the video is displayed in full screen. A PIP video may be a video that displays a video of a size smaller than the video displayed in full screen in a part of the display screen.

[0124] According to one or more embodiments, the electronic device (100) can control the display (110) to display a PIP video in a window of a preset size while displaying a video with the low-vision mode applied in full screen, while displaying a video with the low-vision mode applied in full screen.

[0125] Referring to FIG. 10, the electronic device (100) can provide multiple images by displaying a PIP image including a window of a preset size. The electronic device (100) can display an image (1010) with a low-vision mode applied in a window of a preset size. In this case, the electronic device (100) can highlight the border of the window of a preset size based on contour highlighting processing information.

[0126] According to one or more embodiments, the electronic device (100) can control the display (110) to display a PIP image that displays an image that is not in a low-vision mode in a window of a preset size while displaying an image (1110) with a low-vision mode applied in full screen.

[0127] Referring to FIG. 11, the electronic device (100) can display an image (1110) with a low-vision mode applied in full screen and an image without a low-vision mode applied in a window of a preset size. In this case, the electronic device (100) can highlight the border of the window of a preset size based on contour highlighting information, as shown in FIG. 10.

[0128] FIG. 12 is a drawing for explaining a border setting UI of an electronic device according to one or more embodiments.

[0129] According to one or more embodiments, the electronic device (100) can highlight the border of a first image based on at least one of a preset color, thickness, and style to highlight the border. The electronic device (100) can highlight the border of a first image based on a color, a preset thickness, and a preset style that are different from the color, thickness, and style of the contour applied to an object of the first image.

[0130] According to one or more embodiments, the electronic device (100) may display a UI (User Interface) (1210) for border settings through a display (110) when a low-vision mode is executed while a multi-view image is provided.

[0131]

[0132] *131 The UI (1210) for setting borders may be a UI that includes a menu for setting at least one of whether to emphasize the border, the border thickness, the border color, and the border style.

[0133] Referring to FIG. 12, the electronic device (100) can display a border setting UI (1210) through a display (110) that includes a text phrase for whether to set the border, such as "Do you want to set the border? Y / N", and a setting menu for setting the color, thickness, and style.

[0134] The text phrase and border setting UI (1210) for border emphasis is merely one example of a setting menu, and may be displayed with different phrases or different layouts depending on user settings.

[0135] FIG. 13 is a drawing for explaining the operation process of an electronic device according to one or more embodiments.

[0136] Referring to FIG. 13, in operation 1310, the electronic device (100) can receive user input to select one of a plurality of images from a user to view in low-vision mode.

[0137] In operation 1320, the electronic device (100) can identify the location of the image with the low-vision mode applied based on the pixel location corresponding to the image with the low-vision mode applied.

[0138] In operation 1330, the electronic device (100) can identify contour highlighting processing information based on the contours displayed on the objects of the image to which the low-vision mode is applied.

[0139] In operation 1340, the electronic device (100) can generate the border of the first image based on contour highlighting processing information and position information.

[0140] In operation 1350, the electronic device (100) can identify RGB pixels corresponding to border positions.

[0141] In operation 1360, the electronic device (100) can mix the generated border and RGB pixel values ​​to highlight the border of the first image.

[0142] In operation 1370, the electronic device (100) can acquire a first image in which the edges of the first image are highlighted.

[0143] FIG. 14 is a drawing for explaining the overall operation process of an electronic device according to one or more embodiments.

[0144] Referring to FIG. 14, in operation 1410, the electronic device (100) can display a multi-view image including a plurality of images.

[0145] In operation 1420, when the electronic device (100) receives user input to select one of a plurality of images to view in low-vision mode, it can obtain a first image in which the outline of an object included in the selected image is highlighted.

[0146] In operation 1430, the electronic device (100) can obtain an output image that includes the first image and the remaining images among the plurality of images excluding the first image, and the first image, with the border of the first image highlighted.

[0147] In operation 1440, the electronic device (100) can display the output image through the display (110).

[0148] As the specific method for acquiring a first image and acquiring an output image in which the edges of the first image are highlighted has been specifically explained through the embodiments described above, a detailed explanation thereof will be omitted.

[0149] The control method described in FIG. 14 can be performed by an electronic device (100) having the configuration of FIG. 2 described above, but is not necessarily limited thereto and can be performed by an electronic device having various configurations.

[0150] The various embodiments described above may be implemented as individual embodiments, or at least one embodiment may be combined with one another, either wholly or partially, to be implemented together in a single device.

[0151] According to the various embodiments described above, the electronic device (100) can provide a more visible image to a person with low vision watching a multi-view image by highlighting the borders on the image to which the low-vision mode is applied.

[0152] Meanwhile, the various embodiments described above may be applied to a product as embodiments alone, but at least some of their contents may be combined with other embodiments of the present disclosure to be implemented together.

[0153] The various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., computer). The machine may include an electronic device (e.g., electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory computer-readable storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0154] In addition, according to one or more embodiments of the present disclosure, the method according to the various embodiments described above may be provided by being included in a computer program product.

[0155] Specifically, a non-transient readable storage medium or computer program product may be provided that stores computer commands to perform operations such as displaying a multi-view image containing multiple images, acquiring a first image in which the outline of an object included in the selected image is highlighted when user input is received for selecting one of the multiple images to view in low-vision mode, acquiring the remaining images among the multiple images excluding the first image, acquiring an output image including the first image and having the border of the first image highlighted, and displaying the output image.

[0156] Computer program products may be distributed in the form of device-readable storage media (e.g., compact disc read-only memory (CD-ROM)) or online through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0157] In addition, computer instructions or programs for performing control methods of electronic devices according to the various embodiments described above may be stored on a non-transitory computer-readable medium. When computer instructions stored on such a non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations according to the various embodiments described above. A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and is readable by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of a non-transitory computer-readable medium may include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, ROMs, etc.

[0158] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device, display; Memory for storing instructions; and One or more processors including processing circuitry; and The above one or more processors, When the above instructions are executed individually or collectively, the electronic device, While a single image is being displayed through the above display, if user input for viewing multiple images is received, the display is controlled to display a multi-view image including the multiple images. When user input is received to select one of the plurality of images to view in low-vision mode, a first image is obtained in which the outline of an object included in the selected image is highlighted. Among the plurality of images above, the remaining images excluding the first image and the first image are obtained, and an output image including the first image and having the border of the first image highlighted, and An electronic device that controls the display to display the output image on the display.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Identifying emphasis processing information for emphasizing the outline of the object in the first image above, and An electronic device that highlights the edges of the first image based on the above-mentioned highlighting processing information.

3. In Paragraph 2, The above emphasis processing information is, An electronic device comprising information including at least one of the color, thickness, and style of the above-mentioned contour.

4. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device that highlights the border of the first image based on at least one of a preset color, a preset thickness, and a preset style to highlight the border.

5. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, An electronic device for obtaining an output image by mixing the first image, a second image including the remaining image, and the third image including the border information of the first image.

6. In Paragraph 5, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Identifying emphasis processing information for emphasizing the outline of the object in the first image above, and Identifying location information corresponding to the selected image in the above multi-view image, and An electronic device that acquires the third image based on the above-mentioned emphasis processing information and the above-mentioned position information corresponding to the selected image.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, When user input for viewing the first video in full screen is received, the display is controlled to display the first video on the full screen, and When user input selecting a multi-view mode is received, the display is controlled to display a multi-view video with a low-vision mode applied, and In the above low-vision mode, the multi-view image is, An electronic device in which the outline of an object included in each of the plurality of images and the border of each of the plurality of images are highlighted.

8. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, Control the display to display a Picture in Picture (PIP) image including a window of a preset size in a portion of the display screen, and An electronic device that highlights the border of a window of the above-mentioned preset size when user input for viewing in low-vision mode is received.

9. In Paragraph 1, When the above instructions are executed individually or collectively by the one or more processors, the electronic device, When a low-vision mode is executed while a multi-view video is provided, a UI (user interface) for setting the border is displayed on the display, and The above UI is, An electronic device comprising a menu for setting at least one of whether to emphasize the border, border color, border thickness, and border style.

10. In a method for controlling an electronic device, When user input for viewing multiple videos is received while a single video is being displayed, an operation to display a multi-view video including the multiple videos; When user input is received to select one of the plurality of images and view it in low-vision mode, the operation of acquiring a first image in which the outline of an object included in the selected image is highlighted; The operation of obtaining the remaining images among the plurality of images excluding the first image, and an output image including the first image and having the border of the first image highlighted; and A control method comprising the operation of displaying the above output image.

11. In Paragraph 10, An operation to identify emphasis processing information for emphasizing the outline of the object in the first image; and A control method comprising: an operation to highlight the border of the first image based on the above-mentioned highlighting processing information.

12. In Paragraph 11, The above emphasis processing information is, A control method comprising information including at least one of the color, thickness, and style of the above-mentioned contour.

13. In Paragraph 10, A control method comprising: an operation to highlight the border of the first image based on at least one of a preset color, a preset thickness, and a preset style to highlight the border.

14. In Paragraph 10, A control method comprising: an operation of mixing the first image, the second image including the remaining image, and the third image including the edge information of the first image to obtain the output image.

15. A non-transient computer-readable storage medium storing computer instructions that cause said electronic device to perform an operation when executed by a processor of said electronic device, wherein said operation is, When user input for viewing multiple videos is received while a single video is being displayed, an operation to display a multi-view video including the multiple videos; When user input is received to select one of the plurality of images and view it in low-vision mode, the operation of acquiring a first image in which the outline of an object included in the selected image is highlighted; The operation of obtaining the remaining images among the plurality of images excluding the first image, and an output image including the first image and having the border of the first image highlighted; and A non-transient computer-readable storage medium comprising an operation of displaying the above-mentioned output image.

Images