Electronic device, method, and storage medium for displaying image for vision adjustment

The electronic device addresses visual discomfort by differentially blurring image colors or parts based on user vision, enhancing comfort and clarity without physical corrective devices.

WO2026155359A1PCT designated stage Publication Date: 2026-07-23SAMSUNG ELECTRONICS CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
SAMSUNG ELECTRONICS CO LTD
Filing Date
2025-11-27
Publication Date
2026-07-23

AI Technical Summary

Technical Problem

Existing electronic devices do not effectively alleviate visual discomfort caused by abnormal vision conditions like hyperopia or myopia while maintaining image quality, as traditional methods like wearing corrective lenses or glasses are inconvenient and may reduce viewing experience.

Method used

The electronic device employs differential blurring techniques to adjust image display by selectively blurring specific colors or parts of the image based on the user's vision condition, using a combination of hardware and software to simulate the defocusing effect of corrective lenses without the need for physical devices.

Benefits of technology

This approach reduces visual discomfort associated with abnormal vision by simulating the defocusing effect of corrective lenses, while maintaining image clarity and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2025019998_23072026_PF_FP_ABST
    Figure KR2025019998_23072026_PF_FP_ABST
Patent Text Reader

Abstract

This electronic device may comprise a memory for storing instructions, at least one processor, and a display. The instructions, when executed individually or collectively by the at least one processor, may instruct the electronic device to: identify at least one color among the colors in an image to be displayed on the display; determine, within the image, a first portion, a second portion surrounding the first portion, and a third portion surrounding the second portion; and display, on the display, the image comprising the first portion, the second portion, and the third portion by blurring, with a first strength, the at least one color among the colors in the second portion and blurring, with a second strength which is higher than the first strength, the at least one color among the colors in the third portion.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device, method, and storage medium for displaying an image for adjusting vision

[0001] The following descriptions relate to an electronic device, method, and storage medium for displaying an image for adjusting vision.

[0002] The electronic device may include a display. The display may be used to display visual information. For example, the visual information may be referred to as an image or a screen. The display may include a display panel and a display driving circuit. The display driving circuit may be operably or operatively coupled with the display panel.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0004] The electronic device may include a memory that stores instructions and includes one or more storage media. The electronic device may include at least one processor that includes a processing circuit. The electronic device may include a display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to identify at least one color of an image to be displayed through the display. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause the electronic device to determine a first part of the image, a second part surrounding the first part, and a third part surrounding the second part. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause the image including the first part, the second part, and the third part to be displayed through the display by blurring the at least one color among the colors of the second part with a first intensity and blurring the at least one color among the colors of the third part with a second intensity higher than the first intensity.

[0005] A method performed by an electronic device having a display may include an operation of identifying at least one color among the colors of an image to be displayed through the display. The method may include an operation of determining a first part of the image, a second part surrounding the first part, and a third part surrounding the second part. The method may include an operation of displaying the image including the first part, the second part, and the third part through the display by blurring the at least one color among the colors of the second part with a first intensity and blurring the at least one color among the colors of the third part with a second intensity higher than the first intensity.

[0006] A non-transient computer-readable storage medium may store one or more programs including instructions that cause the electronic device to identify at least one color of an image to be displayed through the display when executed individually or collectively by at least one processor of the electronic device having a display. The non-transient computer-readable storage medium may store one or more programs including instructions that cause the electronic device to determine a first part of the image, a second part surrounding the first part, and a third part surrounding the second part when executed individually or collectively by the at least one processor. The above non-transient computer-readable storage medium may store one or more programs comprising instructions that, when executed individually or collectively by the at least one processor, cause the electronic device to display the image including the first part, the second part, and the third part through the display by blurring the at least one color of the colors of the second part with a first intensity and blurring the at least one color of the colors of the third part with a second intensity higher than the first intensity.

[0007] Figure 1a illustrates examples of types of vision defined for the human eye.

[0008] FIG. 1b illustrates examples of defocusing caused by a lens.

[0009] FIG. 1c illustrates examples of defocusing caused by a lens and defocusing caused by blur.

[0010] Figure 2a illustrates an example of chromatic aberration caused by the characteristics of light passing through the eye.

[0011] FIG. 2b illustrates an example in which the position where light is focused inside the eye is changed by performing blurring on some of the colors of the image.

[0012] FIG. 2c illustrates examples of an image in which some of the colors have been blurred and an image in which all of the colors have been blurred.

[0013] Figure 3 is a schematic view of an exemplary electronic device.

[0014] Figure 4 illustrates an example of an image in which differential blurring is performed on parts of the image.

[0015] FIG. 5 illustrates an example of a flow of operations for identifying at least one color to be blurred and performing differential blurring on at least one color identified in parts of an image.

[0016] FIGS. 6a and FIGS. 6b illustrate an example of a method for identifying at least one color to be blurred.

[0017] Figure 7 illustrates an example of a method for determining parts of an image.

[0018] FIG. 8a illustrates an example of a method for determining the size of a pixel window for blurring performed within a part of an image and the intensity of the blur.

[0019] FIG. 8b illustrates an example of a method for performing blur on specific pixels within a part of an image.

[0020] FIG. 9 illustrates an example of a flow of operation for adjusting the intensity of a blur based on usage information for a user's electronic device.

[0021] FIG. 10 is a block diagram of an electronic device in a network environment according to various embodiments.

[0022] FIG. 11 is a block diagram of a display module according to various embodiments.

[0023] FIG. 12a illustrates an example of a perspective view of an electronic device. FIG. 12b illustrates an example of one or more hardware components arranged within the electronic device.

[0024] FIGS. 13a and FIGS. 13b illustrate an example of the appearance of an electronic device.

[0025] Figure 14 is a schematic diagram of an exemplary artificial intelligence (AI) system.

[0026] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of this disclosure. A singular expression may include a plural expression unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art described in this disclosure. Terms used in this disclosure that are defined in a general dictionary may be interpreted as having the same or similar meaning as they have in the context of the relevant technology, and are not to be interpreted in an ideal or overly formal sense unless explicitly defined in this disclosure. In some cases, even terms defined in this disclosure are not to be interpreted to exclude the embodiments of this disclosure.

[0027] In the various embodiments of the present disclosure described below, a hardware-based approach is described as an example. However, since the various embodiments of the present disclosure include techniques using both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0028] Additionally, in this disclosure, expressions of "greater than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled; however, this is merely for the purpose of expressing an example and does not exclude descriptions of "greater than" or "less than." Conditions described as "greater than" may be replaced with "greater than," conditions described as "less than" may be replaced with "less than," and conditions described as "greater than and less than" may be replaced with "greater than and less than." Furthermore, "A" to "B" below refer to at least one of the elements from A (including A) to B (including B).

[0029] Figure 1a illustrates examples of types of vision defined for the human eye.

[0030] Referring to FIG. 1a, examples (101, 102, 103) of types of visual acuity defined for the human eye are illustrated. For example, the types of visual acuity defined for the human eye may be determined by the position where light entering the human eye is focused (or, the position of the light's focal point). For example, the types of visual acuity defined for the human eye may include emmetropia, hyperopia, and myopia. Example (101) in FIG. 1a represents emmetropia, example (102) represents hyperopia, and example (103) represents myopia.

[0031] Referring to FIG. 1a, light (100) may enter the eye (110). By example, without limitation, the light (100) may be white light. For example, the light (100) may pass through the crystalline lens (111) of the eye (110). For example, the light (100) may be refracted as it passes through the crystalline lens (111). In other words, the path of the light (100) may be changed as it passes through the crystalline lens (111). By example, without limitation, the degree to which the light (100) is refracted may be determined by the condition of the crystalline lens (111). For example, the condition of the crystalline lens (111) may be determined by a ciliary body (113) connected to the crystalline lens (111). For example, the ciliary body (113) can control the state (or movement) of the lens (111). For example, light (100) can reach a region of the retina (112) after passing through the lens (111). For example, the region may include a phobia. For example, a person can perceive the light (100) that has reached the retina (112) of the eye (110). For example, the size of the eye (110) can be defined by its length (119). The length (119) can be referenced as the length of the axial length of the eye.

[0032] Referring to the example (101) of FIG. 1a, in the case of an eye (110) of emmetropic vision, the location (115) where light (100) passing through the lens (111) is focused may be located within a region of the retina (112) of the eye (110). For example, the location (115) may be referred to as the focus. The location (115) being located within a region of the retina (112) may indicate that the light (100) is focused within a region of the retina (112). When the location (115) is located within the said region of the retina (112), the type of vision may be defined as emmetropic. An emmetropic eye (110) can clearly perceive external objects without any abnormalities in the refraction of light.

[0033] Referring to the example (102) of FIG. 1a, in the case of an eye (110) of hyperopia, the position (116) where light (100) passing through the lens (111) is focused may be located behind the retina (112) of the eye (110). That the position (116) is located behind the retina (112) may indicate that the light (100) is focused behind (or inside) the retina (112). When the position (116) is located behind the retina (112), the type of vision may be defined as hyperopia. The eye (110) of a person with hyperopia may perceive relatively close objects blurry due to an abnormality in the refraction of light.

[0034] Referring to the example (103) of FIG. 1a, in the case of an eye (110) with myopic vision, the position (117) where light (100) passing through the lens (111) is focused may be located in front of the retina (112) of the eye (110). That the position (117) is located in front of the retina (112) may indicate that the light (100) is focused in front of (or outside) the retina (112). When the position (117) is located in front of the retina (112), the type of vision may be defined as myopic. The eye (110) of a person with myopic vision may perceive relatively distant objects blurry due to an abnormality in the refraction of light.

[0035] As in example (102) and example (103), what is not focused on the retina (112) (or, the area of ​​the retina (112)) may be referred to as being defocused.

[0036] As a person grows, the size of the eye (110) may increase. For example, the length (119) of the eye (110) may increase. In the case of a person with myopia, such as in example (103), the increased length (119) may worsen the myopia. In other words, as a person with myopia grows, defocusing may become more severe and myopia may worsen. To reduce the worsening of myopia, induced defocusing may be used. Specific examples of induced defocusing may be referenced below in FIGS. 1b and FIGS. 1c.

[0037] FIG. 1b illustrates examples of defocusing caused by a lens.

[0038] FIG. 1b illustrates examples (121, 122) of defocusing caused by a lens (120). For example, the defocusing caused by the lens (120) may be induced defocusing. For example, induced defocusing may involve intentionally refracting light (100) so that the position of the focus is located in front of (or behind) the retina (112). Depending on the induced defocusing, the growth of the eye (110) may be inhibited. For example, depending on the induced defocusing, a neurotransmitter (e.g., dopamine) may be released, and the growth of the eye (110) may be inhibited by the neurotransmitter. As an example without limitation, the lens (120) may be a lens of eyeglasses or a contact lens that comes into contact with the eye (110).

[0039] Referring to example (121), light (100) may pass through a lens (120) before entering the eye (110). As a non-limiting example, the lens (120) may be a convex lens. The light (100) passing through the lens (120) and the eye (110) may be focused in front of the retina (112) of the eye (110). For example, the location (125) where the light (100) is focused may be located in front of the retina (112). For example, if the location (125) is located in front of the retina (112), a neurotransmitter that induces a reduction in the size of the eye (110) may be secreted. Accordingly, myopia may be alleviated.

[0040] Referring to example (122), light (100) may pass through a lens (120) before entering the eye (110). As a non-limiting example, the lens (120) may be a concave lens. Light (100) passing through the lens (120) and the eye (110) may be focused behind the retina (112) of the eye (110). For example, the location (126) where the light (100) is focused may be located behind the retina (112). For example, if the location (126) is located behind the retina (112), a neurotransmitter that induces an increase in the size of the eye (110) may be secreted. Accordingly, hyperopia may be alleviated.

[0041] Although not illustrated in FIG. 1b, a multi-focus lens may be used for the lens (120). Accordingly, light (100) passing through the central region of the lens (120) may be focused on the retina (112), and light (100) passing through the peripheral region surrounding the central region of the lens (120) may be focused in front of (or behind) the retina (112). Because light (100) passing through the central region is focused in one region of the retina (112) (e.g., phobia), the user can clearly perceive external objects, such as in the emmetropia of example (101), and because light (100) passing through the peripheral region is focused in front of (or behind) the retina (112), the growth of the human eye (110) can be inhibited in a way that alleviates myopia or hyperopia.

[0042] Without the use of a corrective structure such as the lens (120) of FIG. 1b, a person with hyperopic or myopic eyes (110) may try to focus by moving the muscles of the eye (110) (e.g., the ciliary body (113) of FIG. 1a) because external objects are not clearly perceived due to hyperopic or myopic vision. However, as the muscles of the eye (110) are intentionally moved to focus, the secretion of neurotransmitters in a direction that inhibits eye growth may not be performed. In other words, a person with hyperopic or myopic eyes (110) is also defocused, but due to an action (or intention) to relieve visual discomfort, the growth-inhibiting effect of the eye (110) caused by defocusing is reduced, and myopic or hyperopic vision may worsen.

[0043] As shown in FIG. 1b, when using a lens (120), myopia or hyperopia may be alleviated, but a person needs to wear contact lenses or glasses that come into direct contact with the eye (110). Also, if contact lenses or glasses are not worn, the alleviating effect of myopia or hyperopia may be reduced. In modern society, people may use electronic devices (e.g., the electronic device (300) of FIG. 3) that include a display (e.g., the display (320) of FIG. 3) for a long time. When processing an image displayed through the display, an effect similar to wearing lenses (120) may be produced. The processing of the image may include blur (or a blur effect). Specific details regarding defocusing caused by blur may be referenced below in FIG. 1c.

[0044] FIG. 1c illustrates examples of defocusing caused by a lens and defocusing caused by blur.

[0045] FIG. 1c illustrates an example (140) of defocusing caused by a lens (120) and an example (150) of defocusing caused by blur. The eye (110) in FIG. 1c may be an example of the eye (110) in FIG. 1a. The lens (120) in FIG. 1c may be an example of the lens (120) in FIG. 1b. For example, the lens (120) in FIG. 1c may be a lens (120) which is a convex lens of example (121) for alleviating myopia.

[0046] Referring to example (140), an image (141) may be displayed. In FIG. 1c, for convenience of explanation, an electronic device is not illustrated, but the present disclosure is not limited thereto. For example, the image (141) may be displayed through a display of an electronic device. For example, the image (141) may include a portion (142). As a non-limiting example, the portion (142) may be one of the pixels constituting (or included) the image (141). However, the present disclosure is not limited thereto. For example, a human eye (110) may perceive light (143) emitted from the portion (142). For example, the light (143) may pass through a lens (120) and the crystalline lens (111) of the eye (110) after being emitted from the portion (142). For example, the light (143) may be focused in front of the retina (112). For example, the position (145) where the light (143) is focused may be located in front of the retina (112). This may be to utilize the defocusing induced by the lens (120).

[0047] Referring to Example (150), an image (151) may be displayed. For convenience of explanation, an electronic device is not illustrated in FIG. 1c, but the present disclosure is not limited thereto. For example, the image (151) may be displayed through a display of an electronic device. Unlike the image (141) of Example (140), the image (151) of Example (150) may be a blurred image. In the present disclosure, blurring an image may include processing it so that it appears blurry when viewed from the outside. As a non-limiting example, the image (151) may be blurred by determining the value of a specific pixel of the image using the values ​​of the surrounding pixels of said specific pixel. Specific details regarding this may be referenced below in FIG. 8b. For example, the image (151) may include a portion (152). As a non-limiting example, the portion (152) may be one of the pixels constituting (or included in) the image (151). However, the present disclosure is not limited thereto. In example (150), the part (152) may correspond to the part (142) in example (140). For example, a human eye (110) may perceive light (153) emitted from the part (152). For example, after the light (153) is emitted from the part (152), it may pass through the lens (120) and the crystalline lens (111) of the eye (110). For example, the light (153) may be focused in front of the retina (112). For example, the position (155) where the light (153) is focused may be located in front of the retina (112).

[0048] Referring to FIG. 1c, the position (155) of the example (150) may be substantially the same as (or correspond to) the position (145) of the example (140). In other words, the defocusing effect caused when a clearly displayed image is perceived while wearing the lens (120) may be substantially the same as the defocusing effect caused when a blurry displayed image is perceived without the lens (120). The blurred image (151) in the example (150) of FIG. 1c may be an image in which blurring has been performed on all the colors of the image (151). In the present disclosure, the colors of the image may represent color components or color channels that constitute the image. For example, the colors of the image may correspond to the colors of light used when displaying the image. By example, without limitation, the colors of the image may include red, green, and blue colors. However, the present disclosure is not limited thereto. For example, the blurred image (151) may be an image in which blur has been performed on all three colors used to compose the image (151).

[0049] When a blurred image (151) is used as in the example (150) of FIG. 1c, abnormal vision (e.g., hyperopia or myopia) of a user viewing an electronic device may be alleviated, but the quality of the user's viewing experience (or image quality) may be reduced. To minimize the reduction in the quality of the viewing experience and alleviate abnormal vision, blurring may be performed on at least one color among the colors of the image. Specific details regarding this may be referenced below in FIG. 2a to FIG. 2c.

[0050] Figure 2a illustrates an example of chromatic aberration caused by the characteristics of light passing through the eye.

[0051] FIG. 2a illustrates an example of chromatic aberration caused by the optical properties of light (200) passing through the eye (110). The eye (110) in FIG. 2a may be an example of the eye (110) in FIG. 1a.

[0052] Referring to FIG. 2a, the light (200) may be white light. The light (200) may include a first color light (201), a second color light (202), and a third color light (203). For example, the first color may include a red color. For example, the second color may include a green color. For example, the third color may include a blue color. However, the present disclosure is not limited thereto.

[0053] Referring to FIG. 2a, light (200) including the first color light (201), the second color light (202), and the third color light (203) can enter the eye (110). For example, light (200) including the first color light (201), the second color light (202), and the third color light (203) can be refracted by the lens (111) of the eye (110). For example, the first color light (201) can be refracted by a first angle. For example, the second color light (202) can be refracted by a second angle greater than the first angle. For example, the third color light (203) can be refracted by a third angle greater than the second angle. In other words, light (200) can be refracted at different angles depending on the color (or wavelength). The fact that light (200) is refracted differently by color can be referred to as chromatic aberration (or, LCA (longitudinal chromatic aberration)) of light (200).

[0054] Referring to FIG. 2a, due to the chromatic aberration of the light (200), the positions where the lights (201, 202, 203) included in the light (200) are focused may differ from one another. For example, the light of the first color (201) may be focused at position (205). For example, position (205) may be located behind the retina (112) of the eye (110). For example, the light of the second color (202) may be focused at position (206). For example, position (206) may be located in front of the retina (112) of the eye (110). For example, the light of the third color (203) may be focused at position (207). For example, position (207) may be located in front of the retina (112) of the eye (110). For example, position (207) may be located further ahead of the retina (112) than position (206).

[0055] Referring to FIG. 1c, when an image is blurred, the position where light is focused within the eye may change. For example, in an image where a specific color of light (or a specific color among the colors of the image) that causes chromatic aberration is blurred, the position where light having said specific color is focused may change. Specific details regarding this may be referenced in FIG. 2b below.

[0056] FIG. 2b illustrates an example in which the position where light is focused inside the eye is changed by performing blurring on some of the colors of the image.

[0057] FIG. 2b illustrates an example (210) of a position where light is focused to recognize the image when an image without blurring is displayed, and an example (220) of a position where light is focused to recognize the image when an image with blurring for the third color (or blue color) is displayed.

[0058] Referring to FIG. 2b, the retina (299) may be an example of the retina (112) of the eye (110) of FIG. 1a. As an example without limitation, the area (299a) of the retina (299) may be a phobia.

[0059] Referring to example (210), when an image that has not been blurred is displayed, light for perceiving the image may enter the eye. For example, the light may include light of the first color (or red color) (211), light of the second color (or green color) (212), and light of the third color (213). Due to chromatic aberration, the positions where the lights (211, 212, 213) included in the light are focused may differ from one another. For example, the light of the first color (211) may be focused at position (215). For example, position (215) may be located in the region (299a) of the retina (299). For example, the light of the second color (212) may be focused at position (216). For example, position (216) may be located in front of the retina (299). For example, the light of the third color (213) can be focused at position (217). For example, position (217) can be located in front of the retina (299). For example, position (217) can be located further in front of the retina (299) than position (216). The example (210) of FIG. 2b can illustrate an example of myopia, unlike the emmetropic case illustrated in the example of FIG. 2a.

[0060] Referring to example (220), when an image with a blur of the third color (or blue color) is displayed, light for recognizing the image may enter the eye. For example, the light may include light of the first color (or red color) (211), light of the second color (or green color) (212), and light of the third color (223). Due to chromatic aberration, the positions where the lights (211, 212, 223) included in the light are focused may differ from each other.

[0061] Referring to examples (210) and (220), the position (227) at which the third color light (223) is focused may differ from the position (217) at which the third color light (213) of example (210) is focused. In other words, the position (227) at which the third color light (223) is focused may be shifted from the position (217) at which the third color light (213) is focused. As a non-limiting example, the position (227) may be located in front of the retina (299). For example, the position (227) may be located further in front of the retina (299) than the position (217).

[0062] FIG. 2c illustrates examples of an image in which some of the colors have been blurred and an image in which all of the colors have been blurred.

[0063] FIG. 2c illustrates an example of an image (230) with the third color blurred and an image (240) with the colors all blurred. In FIG. 2c, for convenience of explanation, it is assumed that the contents in image (230) and the contents in image (240) are identical.

[0064] For example, the image (230) may be an image in which the third color among the first color, the second color, and the third color constituting the image (230) is blurred. For example, the image (240) may be an image in which all of the first color, the second color, and the third color constituting the image (240) are blurred.

[0065] Referring to FIG. 2c, the image (230) may be relatively clear compared to the image (240). For example, when the image (230) or the image (240) is displayed through the display of an electronic device, the user may perceive the image (230) as relatively clear because it is less blurred than the image (240).

[0066] Referring to the foregoing, the present disclosure may perform blurring on some colors (or some color channels, some color components) among the colors (or color channels, color components) of an image and display (or use) the blurred image. For example, the present disclosure may identify the condition of the user's eye (or type of vision) and identify the said some colors according to the identified condition. For example, the present disclosure may perform differential blurring on parts of the image when displaying the image. By example, without limitation, said parts of the image may correspond to regions of the user's eye (e.g., fovea centralis region, paracentral region, or macula region). For example, the present disclosure may perform (or apply) blurring with different intensities on parts of the image. The present disclosure, by using differential blur, can reduce visual discomfort caused by the display of an image while reducing the degradation of the image quality of the displayed image, and can alleviate abnormal vision (e.g., hyperopia or myopia).

[0067] Figure 3 is a schematic view of an exemplary electronic device.

[0068] Referring to FIG. 3, the electronic device (300) may include at least one processor (310) including a processing circuit, a display (320), and a memory (330). The electronic device (300) may include at least a part of the electronic device (1001) of FIG. 10 or correspond to at least a part of the electronic device (1001) of FIG. 10. By example, without limitation, the electronic device (300) may be a smartphone, a user terminal, a tablet PC, or a wearable device. For example, the wearable device may include a head-worn electronic device. For example, specific details regarding the head-worn electronic device may be referenced below in FIG. 12a to FIG. 13b.

[0069] At least one processor (310) may include at least a part of the processor (1020) of FIG. 10 or correspond to at least a part of the processor (1020) of FIG. 10. At least one processor (310) may include a central processing unit (e.g., including a processing circuit) and a display processing unit (DPU) (e.g., including a processing circuit). As an example without limitation, at least one processor (310) may further include a graphic processing unit (e.g., including a processing circuit). At least one processor (310) may be configured to execute instructions stored in memory (330). For example, at least one processor (310) may further include other components (e.g., a memory controller (or memory control circuit) for memory (330) and a storage controller (or storage control circuit) for memory (330).

[0070] At least one processor (310) may be implemented as one or more integrated circuitry (IC) chips and may perform various data processing operations. At least one processor (310) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory (330) individually or collectively in a distributed manner. At least one processor (310) may include a processor assembly including one or more processing circuits. At least one processor (310) may include any processing circuit that is operational to control the performance and operations of one or more components of the electronic device (300) (e.g., memory (330) and / or display (320)). For example, at least one processor (310) (e.g., application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or a set of chips). For example, at least one processor (310) may be implemented with multiple cores (or multiple core circuits), multiple chips, or multiple sets of chips. For example, at least one processor (310) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively.

[0071] Although not illustrated in FIG. 3, at least one processor (310) may perform at least some of the operations described below using a trained model (e.g., the generative AI (artificial intelligence) model (1430) of FIG. 14). For example, at least one processor (310) may use the trained model to identify at least one color to be blurred in an image to be displayed, determine parts of the image to be displayed, or determine the intensity of the blur of parts of the image to be displayed.

[0072] The display (320) may be used for displaying an image. The display (320) may include a display driver circuitry (321) and a display panel (322). The display (320) may include at least a part of the display module (1060) of FIG. 10 or correspond to at least a part of the display module (1060) of FIG. 10.

[0073] The display driving circuit (321) can receive data for an image from at least one processor (310). The data can be transmitted from at least one processor (310) to the display driving circuit (321) via an interface. For example, the interface (e.g., including at least one circuit) may include a mobile industry processor interface (MIPI) (or may support MIPI). As an example, but not limited to, the interface may include a serial peripheral interface (SPI), a universal asynchronous receiver / transmitter (UART), an inter-integrated circuit (I2C), or an improved inter-integrated circuit (I3C). The display driving circuit (321) may be an example of the display driver IC (integrated circuitry) (1130) of FIG. 11. For example, the display driving circuit (325) may include at least a part of the display driver IC (1130) of FIG. 11 or correspond to at least a part of the display driver IC (1130) of FIG. 11. As an example without limitation, the display driving circuit (321) may perform at least some of the operations described below using a trained model (e.g., the generative AI (artificial intelligence) model (1430) of FIG. 14). For example, the display driving circuit (321) may use the trained model to identify at least one color to be blurred in an image to be displayed, determine parts of the image to be displayed, or determine the intensity of the blur of parts of the image to be displayed.

[0074] The display panel (322) can display an image under the control of the display driving circuit (321). For example, the display panel (322) may include pixels within a display area. For example, each of the pixels may include subpixels. For example, each of the subpixels may include a driving transistor and a light-emitting element. For example, the display panel (322) can display an image according to the gate voltage and source voltage from the display driving circuit (321). For example, the display panel (322) may include at least a part of the display panel (1110) of FIG. 11 or correspond to at least a part of the display panel (1110) of FIG. 11.

[0075] The memory (330) may include one or more storage media. For example, the one or more storage media may include a hard drive, flash memory, permanent memory such as ROM (read-only memory), semi-permanent memory such as RAM (random access memory), any other suitable type of storage assembly, or any combination thereof. The memory (330) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (300). The memory (330) may be fixedly embedded in the electronic device (300) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) memory card) that can be repeatedly inserted into and removed from the electronic device (300). For example, the memory (330) may include at least a portion of the memory (1030) of FIG. 10 or correspond to at least a portion of the memory (1030) of FIG. 10.

[0076] The memory (330) can store one or more programs. For example, the one or more programs may include instructions that are executable by at least a part of at least one processor (310).

[0077] For example, at least one processor (310) can generate an image. As an example without limitation, at least one processor (310) can generate the image based on information obtained from a software application that provides the image. For example, at least one processor (310) can identify at least one color among the colors (or color channels, color components) of the image. For example, the at least one color may be a color to be blurred among the colors of the image. Specific details regarding the method of identifying the at least one color may be referenced below in FIGS. 5, FIGS. 6a, and FIGS. 6b.

[0078] For example, at least one processor (310) can determine (or distinguish, define) parts of the image. For example, parts of the image may correspond to regions of the eye. By example, without limitation, the parts of the image may include a first part, a second part surrounding the first part, and a third part surrounding the second part. For example, the first part may correspond to the foveal region of the eye (or the field of view (FoV) of the foveal region). For example, the second part may correspond to the peripheral region of the eye (or the FoV of the peripheral region). For example, the third part may correspond to the macular region of the eye (or the FoV of the macular region). Specific details regarding the method of determining the parts of the image may be referenced below in FIGS. 5 and FIGS. 7.

[0079] For example, at least one processor (310) can blur the at least one color of the image. For example, when generating the image based on information obtained from the software application, at least one processor (310) can generate the image by blurring the at least one color of the image. As a non-limiting example, at least one processor (310) can blur the at least one color of the image by applying a blur filter to a specific color (or the at least one color) in the UI (user interface) layer of the software application. As a non-limiting example, when compositing at least one image received from at least one software application in a framework (e.g., surface flinger), at least one processor (310) can blur the at least one color of the image by compositing an original image (or original image layer) for generating the image and an additional image (or blur mask layer) for blurring the at least one color. In the above example, the GPU of at least one processor (310) can composite the original image and the additional image.

[0080] In the above example, a blur performed by at least one processor (310) is exemplified, but the present disclosure is not limited thereto. For example, the blur may be performed by a display (320) (or a display driving circuit (321)). For example, the display (320) (or a display driving circuit (321)) may receive data for the image from at least one processor (310) and perform processing on the at least one color of the image (or color data for the at least one color). For example, the processing on the at least one color may include an algorithm for blurring. For example, the display (320) (or, display driving circuit (321)) may include an image processing (IP) circuit for processing the at least one color. For example, the IP circuit may be used to perform processing (or blurring) on ​​the color data for the at least one color among the color data for each of the pixels of the image. In an example, without limitation, the IP circuit may include a memory (or frame memory) for processing the processing of the pixels of the image in real time. Or, in one example, the IP circuit may be implemented as a separate circuit within or outside of at least one processor (310). In an example, without limitation, the IP circuit may be implemented within a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC).

[0081] In the following, for convenience of explanation, blurring is exemplified as being performed by at least one processor (310). However, the present disclosure is not to be interpreted as being limited thereto.

[0082] For example, at least one processor (310) may perform (or apply, use) differential blur in the portions of the image. In a non-limiting example, in the first portion of the image, at least one processor (310) may not perform blur (or may refrain from, or bypass). In a non-limiting example, in the second portion of the image, at least one processor (310) may perform blur with a first intensity. In a non-limiting example, in the third portion of the image, at least one processor (310) may perform blur with a second intensity different from the first intensity. For example, techniques for blur may be used. In a non-limiting example, techniques for blur may include averaging blur, Gaussian blur, median filtering, or bilateral filtering. However, the present disclosure is not limited to these examples. For the parameters for the above blur and specific examples of how the blur is performed, refer to FIGS. 8a and FIGS. 8b below.

[0083] For example, at least one processor (310) may adjust the intensity of the blur based on usage information regarding the user's display (320) (or display panel (322)) of the electronic device (300). By example, without limitation, the usage information may include the display time of the display (320) (or display panel (322)). By example, without limitation, the usage information may include the distance (or viewing distance) from the display (320) (or display panel (322), electronic device (300)) to the user (or the user's eye). For example, at least one processor (310) may adjust or maintain the intensity of the blur by comparing a value determined according to the usage information with a reference value. Specific details regarding the method of adjusting the intensity of the blur may be referenced below in FIG. 9.

[0084] According to the present disclosure, an image in which differential blurring is performed on parts of the image is referred to and described with reference to FIG. 4.

[0085] Figure 4 illustrates an example of an image in which differential blurring is performed on parts of the image.

[0086] FIG. 4 illustrates an example of an image (400) in which differential blurring is performed on parts of the image (400). For example, an electronic device (300) can display the image (400) through a display panel (322) (or a display (320)).

[0087] Referring to FIG. 4, the image (400) may include a plurality of parts. For example, the image (400) may include a first part (410), a second part (420), and a third part (430). In the example of FIG. 4, the image (400) is shown to include three parts, but the present disclosure is not limited thereto. For example, the image (400) may include four or more parts.

[0088] For example, the first part (410) may include a reference position (409). As a non-limiting example, the reference position (409) may indicate the center position of the image (400). As a non-limiting example, the reference position (409) may indicate the direction of a user's gaze looking at the display panel (322) (or the display (320)). For example, the electronic device (300) may identify the direction of the gaze based on sensing data obtained using at least one sensor or camera. For example, the electronic device (300) may identify the position of the image (400) corresponding to the direction of the gaze as the reference position (409).

[0089] For example, the second part (420) may surround the first part (410). For example, the second part (420) may be a part of the image (400) extended from the first part (410). For example, the first part (410) and the second part (420) may be distinguished by a first reference range (401). For example, the first reference range (401) may be defined as a FoV corresponding to the foveal region of the eye (or the FoV of the foveal region), as described later in FIG. 7.

[0090] For example, the third part (430) may surround the second part (420). For example, the third part (430) may be a part of the image (400) that extends from the second part (420). By example, without limitation, the third part (430) may be defined as the remaining part of the image (400) excluding the first part (410) and the second part (420). For example, the second part (420) and the third part (430) may be distinguished by a second reference range (402). For example, the second reference range (402) may be defined as an FoV corresponding to the peripheral area of ​​the eye (or, the FoV of the peripheral area), as described later in FIG. 7.

[0091] In FIG. 4, for convenience of explanation, the first reference range (401) and the second reference range (402) are shown as forming concentric circles around the reference position (409), but the present disclosure is not limited thereto. For example, the shape of each of the first reference range (401) and the second reference range (402) may be formed as an ellipse.

[0092] Referring to the above description, the first part (410) may correspond to the foveal region of the eye (or the FoV of the foveal region), the second part (420) may correspond to the peripheral region of the eye (or the FoV of the peripheral region), and the third part (430) may correspond to the macular region of the eye (or the FoV of the macular region).

[0093] Referring to FIG. 4, the first part (410) of the image (400) may be relatively clear compared to the second part (420) and the third part (430). For example, the electronic device (300) may display the first part (410) of the image (400) by bypassing the blurring of at least one color of the first part (410).

[0094] Referring to FIG. 4, the second part (420) of the image (400) may be relatively less sharp compared to the first part (410) and relatively sharp compared to the third part (430). For example, the electronic device (300) may display the second part (420) of the image (400) by performing a blur of at least one color of the second part (420) with a first intensity. For example, in the second part (420), the at least one color of the second part (420) may be blurred.

[0095] Referring to FIG. 4, the third part (430) of the image (400) may be relatively less sharp compared to the first part (410) and the second part (420). For example, the electronic device (300) may display the third part (430) of the image (400) by performing a blur of at least one color of the third part (430) with a second intensity. For example, in the third part (430), the at least one color of the third part (430) may be blurred.

[0096] For example, the at least one color of the third part (430) may be the same as the at least one color of the second part (420). For example, the second intensity may be higher than the first intensity. In other words, the third part (430) may appear fainter than the second part (420).

[0097] Referring to the above description, the electronic device (300) may display an image (400) comprising a first part (410), a second part (420), and a third part (430). A user looking at the electronic device (300) may primarily perceive the first part (410), which includes a central area (or reference position (409)) of the image (400). In the above example, the first part (410) may be perceived through the foveal region of the user's eye, the second part (420) may be perceived through the peripheral region of the user's eye, and the third part (430) may be perceived through the macular region of the user's eye. Because the relatively clear first part (410) is perceived through the foveal region, the user may not perceive the degradation of image quality (or blur) caused in the second part (420) and the third part (430) of the image (400). Additionally, since the second part (420) and the third part (430), in which at least one color is blurred, are perceived through the peripheral area and the macular area, the user's eye can be suppressed in a way that alleviates abnormal vision (e.g., hyperopia or myopia). More specifically, since the second intensity of the blur in the third part (430) is higher than the first intensity of the blur in the second part (420), the user perceives less degradation of image quality (400) and abnormal vision (e.g., hyperopia or myopia) can be further alleviated.

[0098] To display the image (400) exemplified in FIG. 4, the electronic device (300) may identify at least one color to be blurred and perform differential blurring. Specific details regarding this are described below with reference to FIGS. 5 to 9.

[0099] FIG. 5 illustrates an example of a flow of operations for identifying at least one color to be blurred and performing differential blurring on at least one color identified in parts of an image.

[0100] At least some of the above methods of FIG. 5 may be performed by the electronic device (300) of FIG. 3. For example, at least some of the above methods may be configured to be performed (or controlled) by at least one processor (310) of the electronic device (300). In the following embodiments, each operation may be performed sequentially, but not necessarily sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. Also, for example, at least some of the above methods may be configured to be performed by at least one processor (310) of the electronic device (300), and at least other parts of the above methods may be configured to be performed by the display (320) (or display driving circuit (321)) of the electronic device (300).

[0101] In operation (510), the electronic device (300) can identify at least one color among the colors of an image. For example, the electronic device (300) can identify the at least one color among the colors of the image to be displayed through a display (320) (or a display panel (322)). For example, the colors of the image may be referred to as color channels or color components. By example, without limitation, the colors may include red, green, and blue colors.

[0102] For example, the electronic device (300) can identify the type of vision of a user looking at the display (320) (or display panel (322)). As an example, without limitation, the electronic device (300) can display a test image for identifying the type of vision. For example, the test image may be displayed based on the execution of a software application for vision protection. For example, the test image may be referred to as a red-green test image. For example, the test image may include a first part having a red color as a background color and a second part having a green color as a background color. For example, each of the first part and the second part may include a plurality of characters. For example, the electronic device (300) can identify the type of vision of the user based on receiving input regarding the test image. Specific details regarding this may be referenced below in FIG. 6a. Alternatively, as a non-limiting example, the electronic device (300) may identify the type of vision based on at least one input from the user.

[0103] For example, if the type of vision of the user is myopic, the electronic device (300) may identify the blue and green colors among the colors as the at least one color to be blurred. Or, as an example without limitation, if the type of vision of the user is myopic, the electronic device (300) may identify the blue color among the colors as the at least one color to be blurred. For example, if the type of vision is myopic, the position where the blue light and green light passing through the user's eye are focused is already located in front of the retina, so the electronic device (300) may blur the blue and / or green colors among the colors of the image. Accordingly, the position where the blue light and green light are focused may be located further in front of the retina, and the induced defocusing effect may be increased. Additionally, the electronic device (300) may maintain the quality of the image (or minimize quality degradation) by bypassing the blurring of the red color among the colors of the image.

[0104] For example, if the type of vision of the user is hyperopic, the electronic device (300) may identify the red color among the colors as the at least one color to be blurred. Or, as an example without limitation, if the type of vision of the user is hyperopic, the electronic device (300) may identify the red and green colors among the colors as the at least one color to be blurred. For example, if the type of vision is hyperopic, the electronic device (300) may blur the red color among the colors of the image because the location where the red light passing through the user's eye is focused is already located behind the retina. Accordingly, the location where the red light is focused may be located further behind the retina, and the induced defocusing effect may be increased. Additionally, the electronic device (300) may maintain the quality of the image (or minimize quality degradation) by bypassing the blurring of the blue and green colors among the colors of the image.

[0105] A specific example of a method for identifying at least one color to be blurred according to the type of vision, as in the examples above, may be referenced in FIG. 6b below.

[0106] In operation (520), the electronic device (300) can determine a first part, a second part, and a third part of the image. For example, the electronic device (300) can determine the first part of the image, the second part surrounding the first part, and the third part surrounding the second part. For example, the first part may correspond to the foveal region of the eye (or the FoV of the foveal region), the second part may correspond to the peripheral region of the eye (or the FoV of the peripheral region), and the third part may correspond to the macular region of the eye (or the FoV of the macular region). Specific examples of the relationship between the parts of the image and the regions of the eye may be referenced below in FIG. 7.

[0107] In operation (530), the electronic device (300) can blur the at least one color of the second part with a first intensity and the at least one color of the third part with a second intensity. For example, the electronic device (300) can bypass blurring the colors (e.g., red, green, and blue) of the first part of the image. For example, the electronic device (300) can bypass blurring at least one other color that is different from the at least one color among the colors of the second part of the image and can blur the at least one color among the colors of the second part. For example, the electronic device (300) can bypass blurring at least one other color that is different from the at least one color among the colors of the third part of the image and can blur the at least one color among the colors of the third part.

[0108] For example, the electronic device (300) may perform (or apply, use) differential blur (or, progressive blur) on the portions of the image. For example, the electronic device (300) may blur the at least one color of the second portion of the image to the first intensity. For example, the electronic device (300) may blur the at least one color of the third portion of the image to the second intensity. For example, the second intensity may be higher than the first intensity. In the present disclosure, a higher intensity of blur may indicate that the image appears blurrier when displayed.

[0109] For example, the electronic device (300) may use techniques for blurring. Examples, without limitation, include averaging blur, Gaussian blur, median filtering, or bilateral filtering. Specific examples of parameters for blurring and blurring performed in the second and third parts may be referenced below in FIGS. 8a and 8b.

[0110] In operation (540), the electronic device (300) may display an image including the first part, the second part, and the third part. For example, the electronic device (300) may display the image including the first part, the second part, and the third part through a display (320) (or a display panel (320)) by blurring at least one color among the colors of the second part with the first intensity and blurring at least one color among the colors of the third part with the second intensity. An example of the image displayed through the display (320) (or a display panel (320)) may be referenced in the image (400) of FIG. 4.

[0111] FIGS. 6a and FIGS. 6b illustrate an example of a method for identifying at least one color to be blurred.

[0112] FIG. 6a illustrates an example of a method for identifying the type of vision of a user. FIG. 6a illustrates an example of a test image (600) for identifying the type of vision, an example of a position where light is focused when the type of vision is myopia (630), and an example of a position where light is focused when the type of vision is hyperopia (640).

[0113] For example, an electronic device (300) may display a test image (600) for identifying the type of vision through a display (320) (or a display panel (322)) based on the execution of a software application for vision protection. For example, the test image (600) may include a first part (610) having a red color as the background color and a second part (620) having a green color as the background color. For example, the first part (610) may include at least one character (611). As a non-limiting example, at least one character (611) may include 'P' or 'T'. For example, the second part (620) may include at least one character (621). As a non-limiting example, at least one character (621) may include 'P' or 'T'.

[0114] If the type of vision of the user recognizing the test image (600) is myopic, the focused location of the light entering the user's eye may be referenced in Example (630). Referring to Example (630), the red light entering the user's eye may be focused on the retina (699) (or a region of the retina (699)). For example, the location (631) where the red light is focused may be located on the retina (699) (or a region of the retina (699)). Additionally, the green light entering the user's eye may be focused in front of the retina (699). For example, the location (632) where the green light is focused may be located in front of the retina (699).

[0115] If the type of vision of the user recognizing the test image (600) is hyperopia, the focused location of the light entering the user's eye may be referenced in example (640). Referring to example (640), the red light entering the user's eye may be focused behind the retina (699). For example, the location (641) where the red light is focused may be located behind the retina (699). Additionally, the green light entering the user's eye may be focused in front of the retina (699). For example, the location (642) where the green light is focused may be located on the retina (699) (or a region of the retina (699)).

[0116] Referring to examples (630) and (640), if the user is nearsighted, they can perceive the red color more clearly and thus perceive at least one character (611) more clearly than at least one character (621). Conversely, if the user is farsighted, they can perceive the green color more clearly and thus perceive at least one character (621) more clearly than at least one character (611).

[0117] For example, the electronic device (300) may receive input regarding a test image (600). For example, the input may indicate at least one character among at least one character (611) and at least one character (621) of the test image (600) that is clearly recognized by the user. For example, if the user recognizes at least one character (611) more clearly than at least one character (621), the user may perform input regarding the first part (610). Alternatively, if the user recognizes at least one character (621) more clearly than at least one character (611), the user may perform input regarding the second part (620). For example, the electronic device (300) may identify the type of the user's vision as myopia based on receiving input regarding the first part (610). For example, the electronic device (300) can identify the type of the user's vision as far-sighted based on receiving input for the second part (620).

[0118] As a non-limiting example, if the electronic device (300) is a user terminal such as a smartphone, the electronic device (300) may execute a software application for eye protection or display a test image (600) based on receiving input for executing a software application for eye protection. Alternatively, for example, the electronic device (300) may execute a software application for eye protection or display a test image (600) based on receiving user input to a settings menu of the electronic device (300) or a physical button of the electronic device (300).

[0119] As a non-limiting example, if the electronic device (300) is a head-worn electronic device (e.g., the electronic device (300) of FIG. 12a to FIG. 13b), the electronic device (300) may execute a software application for eye protection or display a visual object (or menu) indicating a request for displaying a test image (600) based on detecting that a user is wearing the electronic device (300). For example, the electronic device (300) may display the test image (600) based on receiving user input regarding the visual object. Or, for example, the electronic device (300) may execute a software application for eye protection or display the test image (600) based on receiving user input regarding the settings menu of the electronic device (300) or a physical button of the electronic device (300).

[0120] FIG. 6b illustrates examples of at least one color to be blurred depending on the type of vision of the user. FIG. 6b illustrates an example (650) of a position where light is focused to recognize an image with blue and green colors blurred when the type of vision is myopia, and an example (660) of a position where light is focused to recognize an image with red colors blurred when the type of vision is hyperopia. In FIG. 6b, for convenience of explanation, an example is provided where the blue and green colors among the colors of an image are blurred based on the electronic device (300) identifying that the type of vision is myopia, but the present disclosure is not limited thereto. For example, the blue color among the colors of an image may be blurred based on the electronic device (300) identifying that the type of vision is myopia.

[0121] Referring to example (650), light for recognizing an image in which blue and green colors are blurred may enter the eye. For example, the light may include light of the first color (or red color) (651), light of the second color (or green color) (654), and light of the third color (or blue color) (655). For example, light for recognizing an image in which blue and green colors are not blurred (or an image in which all colors are not blurred) may include light of the first color (651), light of the second color (652), and light of the third color (653).

[0122] The position (658) at which the second color light (654) is focused may be different from the position (656) at which the second color light (652) is focused. In other words, the position (658) at which the second color light (654) is focused may be shifted from the position (656) at which the second color light (652) is focused. For example, the position (656) may be located in front of the retina (699). For example, the position (658) may be located further in front of the retina (699) than the position (656).

[0123] The position (659) at which the third color light (655) is focused may be different from the position (657) at which the third color light (653) is focused. In other words, the position (659) at which the third color light (655) is focused may be shifted from the position (657) at which the third color light (653) is focused. For example, the position (657) may be located in front of the retina (699). For example, the position (659) may be located further in front of the retina (699) than the position (657).

[0124] Referring to example (660), light for recognizing an image in which the red color is blurred may enter the eye. For example, the light may include light of the first color (or red color) (664), light of the second color (or green color) (662), and light of the third color (or blue color) (663). For example, light for recognizing an image in which the red color is not blurred (or an image in which all colors are not blurred) may include light of the first color (661), light of the second color (662), and light of the third color (663).

[0125] The position (666) at which the first color light (664) is focused may be different from the position (665) at which the first color light (661) is focused. In other words, the position (666) at which the first color light (664) is focused may be shifted from the position (665) at which the first color light (661) is focused. For example, the position (665) may be located on the retina (699) (or a region of the retina (699)). For example, the position (666) may be located behind the retina (699).

[0126] Figure 7 illustrates an example of a method for determining parts of an image.

[0127] FIG. 7 illustrates an example of a method for determining parts (710, 720, 730) of an image (700) displayed on an electronic device (300). By example, without limitation, the electronic device (300) may be a tablet PC. A tablet PC may include a display larger in size compared to a smartphone. For convenience of explanation, the electronic device (300) which is a tablet PC is assumed to have a viewing distance of approximately 50 cm. For example, the viewing distance may represent the distance from the electronic device (300) (or display (320), display panel (322)) to the user (or user's eyes) looking at the electronic device (300).

[0128] For example, the electronic device (300) can determine a first part (710), a second part (720), and a third part (730) of an image (700). For example, the electronic device (300) can determine a part within a first reference range (701) as the first part (710). For example, the first reference range (701) can be defined as a FoV corresponding to the foveal region (760) (or the FoV of the foveal region (760)) of the example (750) illustrating regions of the eye. By example, without limitation, the FoV of the foveal region (760) can be about 5°. For example, the electronic device (300) can determine a part between the first reference range (701) and the second reference range (702) as the second part (720). For example, the second reference range (702) may be defined as the FoV corresponding to the peripheral region (770) (or the FoV of the peripheral region (770)) of the example (750) illustrating regions of the eye. By example, without limitation, the FoV of the peripheral region (770) may be about 8°. For example, the electronic device (300) may determine the portion between the second reference range (702) and the third reference range (703) as the third portion (730). For example, the third reference range (703) may be defined as the FoV corresponding to the macular region (780) (or the FoV of the macular region (780)) of the example (750) illustrating regions of the eye. By example, without limitation, the FoV of the macular region (780) may be about 18°.

[0129] Referring to FIG. 7, the first part (710) may include a reference position (709). In a non-limiting example, the reference position (709) may indicate the center position of the image (700). In a non-limiting example, the reference position (709) may indicate the direction of gaze of a user looking at the display panel (322) (or the display (320)). For example, the electronic device (300) may identify the direction of gaze based on sensing data acquired using at least one sensor or camera. For example, the electronic device (300) may identify the position of the image (700) corresponding to the direction of gaze as the reference position (709). In one example, the electronic device (300) may be a head-worn electronic device that provides a VR (virtual reality), AR (augmented reality), or XR (extended reality) environment. In a non-limiting example, the head-worn electronic device may include a VST (video see-through) device. For example, the electronic device (300) can identify the direction of gaze of a user wearing the electronic device (300) and identify said direction of gaze as a reference position (709). As an example without limitation, the first part (710), the second part (720), and the third part (730) can form concentric circles around the reference position (709).

[0130] In example (750), the foveal region (760) may be an area where the clearest vision of the eye can be perceived. For example, in the foveal region (760), relatively high-resolution visual processing may be performed. Accordingly, the first part (710) corresponding to the foveal region (760) may be a part of the image (700) displayed without blurring of color.

[0131] In example (750), the peripheral area (770) may be an area surrounding the foveal area (760) (or extending from the foveal area (760)). For example, high-resolution visual processing may be performed, although relatively lower than that of the peripheral area (770). The peripheral area (770) may be an area suitable for relieving visual fatigue according to the defocus effect. Accordingly, the second part (720) corresponding to the peripheral area (770) may be a part of the image (700) displayed by performing a relatively low-intensity blur on some colors.

[0132] In example (750), the macular region (780) may be an area surrounding (or extending from) the peripheral region (770). For example, high-resolution visual processing may be performed over a relatively wide range in the macular region (780). The high-resolution visual processing in the macular region (780) may be of lower resolution than the high-resolution visual processing in the foveal region (760) and the peripheral region (770). The macular region (780) may be an area suitable for alleviating abnormal vision according to the defocus effect. Accordingly, the third part (730) corresponding to the macular region (780) may be a part of the image (700) displayed by performing a relatively high-intensity blur on some colors.

[0133] In example (750), the outer region (790) extending beyond the macular region (780) may have a FoV between about 18° and about 110°. The outer region (790) may be referred to as a peripheral region. Although not shown in FIG. 7, the outer region (790) may be distinguished into sub-regions. For example, the sub-regions may include a near edge region, a mid edge region, and a far edge region.

[0134] In FIG. 7, the case where the viewing distance is 50 cm is exemplified, but the present disclosure is not limited thereto. For example, as the viewing distance becomes shorter, the size of each of the first part (710), the second part (720), and the third part (730) may increase. Or, for example, as the viewing distance becomes longer, the size of each of the first part (710), the second part (720), and the third part (730) may decrease.

[0135] FIG. 8a illustrates an example of a method for determining the size of a pixel window for blurring performed within a part of an image and the intensity of the blur.

[0136] FIG. 8a illustrates an example (800) of a method for an electronic device (300) to determine parameters for a blur performed on a portion of an image. For example, the parameters may include the size of a pixel window for the blur and the intensity of the blur.

[0137] Referring to example (800), the lens (810) and retina (820) of the eye are illustrated. For example, the first distance (811) between the lens (810) and the retina (820) may be referred to as the size of the eye or the length of the axial length of the eye. Referring to example (800), a first pixel (801) and a second pixel (802) are illustrated. For example, each of the first pixel (801) and the second pixel (802) may emit light. For example, the first pixel (801) and the second pixel (802) may be examples of pixels included in the display (320) (or display panel (322)) of the electronic device (300). In the present disclosure, each of the pixels included in the display (320) (or display pixels) may correspond to each of the pixels included in (or constituting the image) of the image. In other words, when the electronic device (300) generates an image, it may define color data for each of the pixels of the image (or image pixels), and the color data for each of the pixels of the image may be input (or provided) to the corresponding pixel of the display (320). The corresponding pixel of the display (320) may emit light based on the color data. The user may recognize the corresponding pixel of the image as the light emitted from the pixel enters the user's eye.

[0138] In FIG. 8a, for convenience of explanation, it is assumed that a first pixel (801) is located at a position spaced a second distance (812) from the lens (810), and a second pixel (802) is located at a position spaced a third distance (813) from the first pixel (801).

[0139] For example, light emitted from the first pixel (801) can pass through the lens (810) and reach the retina (820). In the example (830) representing an object recognized by the light reaching the retina (820), the first pixel (801) can be recognized as the first object (831) on the retina (820) (or by the user). For example, the size (834) of the first object (831) can be calculated according to the following mathematical formula.

[0140]

[0141] Referring to mathematical formula 1, c1 may represent the size (834) of the first object (831), s may represent the actual size of a specific pixel (e.g., the first pixel (801)), d1 may represent the first distance (811), and d2 may represent the second distance (812).

[0142] Additionally, for example, light emitted from the second pixel (802) may pass through the lens (810) and reach the retina (820). In the example (830) representing an object recognized by the light reaching the retina (820), the second pixel (802) may be recognized as a second object (832) on the retina (820) (or to the user). Assuming the first pixel (801) is located at the focal point of the lens (810), the second object (832) by the second pixel (802) may be referred to as a circle of confusion. For example, the size (835) of the second object (832) may be calculated according to the following mathematical formula.

[0143]

[0144] Referring to mathematical formula 2, c2 may represent the size (835) of the second object (832) (or circle of confusion), N may represent the size of the pupil of the eye, d1 may represent the first distance (811), d2 may represent the second distance (812), and d3 may represent the third distance (813).

[0145] In the example (800) of FIG. 8a, it is assumed that the first pixel (801) and the second pixel (802) are spaced apart from each other, but since the pixels are placed on the same surface of the display (320) (or display panel (322)), the distance from the lens (810) to the pixels (801, 802) can be substantially the same. Therefore, when some of the colors of light emitted from pixels located at the same distance from the eye are blurred, the light may be perceived as in the example (830) of FIG. 8a when it enters the eye. Referring to the above, the size of the pixel window of the blur can be calculated as follows:

[0146]

[0147] Referring to Equation 3, w may represent the size of the pixel window, c2 may represent the size (835) of the second object (832) (or circle of confusion), and s may represent the actual size of a specific pixel (e.g., the first pixel (801)). For example, the pixel window may represent a virtual area for defining pixels to be used for blurring. For example, the pixel window may be referred to as a kernel.

[0148] For example, the blur intensity (i) can be calculated as the product of the pixel window size (w) and the coefficient (k). In other words, the blur intensity (i) can be increased as the pixel window size increases and as the coefficient (k) increases. As a non-limiting example, the coefficient (k) can be defined as the distance from the center position of the image (e.g., reference position (709) in FIG. 7) to the position of the pixel to be blurred.

[0149] Specific details regarding the blur performed based on the size (w) of the pixel window and the intensity (i) of the blur can be referenced in FIG. 8b below.

[0150] FIG. 8b illustrates an example of a method for performing blur on specific pixels within a part of an image.

[0151] FIG. 8b illustrates an example of a method for performing blurring on specific pixels within the second part (720) and the third part (730) of an image (700). The image (700) of FIG. 8b may be an example of the image (700) of FIG. 7.

[0152] Referring to FIG. 8b, the electronic device (300) can perform a blur on the color data of a pixel (851) of the second part (720). For example, the pixel (851) may represent a pixel (or image pixel) that is a component of the image (700). As an example without limitation, the pixel (851) may be displayed according to light emitted through a pixel of the display (320) (or display panel (322)) (e.g., the first pixel (801) or the second pixel (802) of FIG. 8a). For example, to perform a blur on the color data of the pixel (851), the electronic device (300) may identify the color data of pixels (852) within the pixel window (890). For example, the pixels (852) may be pixels surrounding the pixel (851). For example, the electronic device (300) can calculate the color data of a pixel (851) based on the color data of pixels (852). In this case, the color data of the pixel (851) may be calculated differently from the color data of pixels (852) according to a blurring technique. As a non-limiting example, if the technique is an average blur, the color data of the pixel (851) may be calculated as the average value of the color data of the pixel (851) and pixels (852).

[0153] Referring to FIG. 8b, the electronic device (300) can perform a blur on the color data of a pixel (861) of the third part (730). For example, the pixel (861) may represent a pixel (or image pixel) that is a component of the image (700). As an example without limitation, the pixel (861) may be displayed according to light emitted through a pixel of the display (320) (or display panel (322)) (e.g., the first pixel (801) or the second pixel (802) of FIG. 8a). For example, to perform a blur on the color data of the pixel (861), the electronic device (300) may identify the color data of the pixels (862) within the pixel window (890). The size (w) of the pixel window (890) used in the third part (730) may be the same as the size (w) of the pixel window (890) used in the second part (720). For example, the pixels (862) may be pixels surrounding the pixel (861). For example, the electronic device (300) may calculate the color data of the pixel (861) based on the color data of the pixels (862). In this case, the color data of the pixel (861) may be calculated differently from the color data of the pixels (862) according to a blurring technique. As a non-limiting example, if the technique is average blur, the color data of the pixel (861) may be calculated as the average value of the color data of the pixel (861) and the pixels (862).

[0154] For example, the electronic device (300) may set the blur intensity (i) such that when calculating the color data of pixel (851) (or pixel (861)) from the color data of pixels (852) (or pixels (862)), a higher weight is applied to the color data of pixels (852) and a lower weight is applied to pixel (851). For example, as the blur intensity (i) increases, the color data of pixels (852) may be used at a higher rate to determine the color data of pixel (851). As an example without limitation, if the technique is a Gaussian blur, the blur intensity (i) may be adjusted according to the standard deviation (σ) of the Gaussian blur.

[0155] Alternatively, for example, the blur intensity (i) may be determined according to the distance from the reference position (709) to the pixel to be blurred. For example, the greater the distance from the reference position (709) to the pixel to be blurred, the greater the blur intensity (i). For example, the blur intensity (i) of pixel (861) may be higher than the blur intensity (i) of pixel (851).

[0156] FIG. 9 illustrates an example of a flow of operation for adjusting the intensity of a blur based on usage information for a user's electronic device.

[0157] At least some of the above methods of FIG. 9 may be performed by the electronic device (300) of FIG. 3. For example, at least some of the above methods may be configured to be performed (or controlled) by at least one processor (310) of the electronic device (300). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0158] In operation (910), the electronic device (300) can identify usage information. For example, the usage information may include information related to the use of the user's display (320) (or display panel (322)) of the electronic device (300). As an example without limitation, the usage information may include the display time of the display (320) (or display panel (322)). For example, the display time may indicate the time that the display (320) (or display panel (322)) has been continuously displayed since the time it was activated. As an example without limitation, the usage information may include the distance (or viewing distance) from the display (320) (or display panel (322), electronic device (300)) to the user (or the user's eyes). As an example without limitation, the usage information may include the accumulated viewing time of the display (320) (or display panel (322)) on a daily basis.

[0159] In operation (920), the electronic device (300) can identify whether the value according to the usage information exceeds a reference value. For example, the electronic device (300) can identify the value according to the usage information. For example, the value according to the usage information may represent the length of the display time if the usage information is a display time. For example, the value according to the usage information may represent the length of the distance if the usage information is a distance. For example, the reference value may represent a threshold length for the length of the display time or a threshold length for the length of the distance. For example, the value according to the usage information may represent the length of the accumulated viewing time if the usage information is accumulated viewing time.

[0160] In operation (920), the electronic device (300) may perform operation (930) when the value is less than or equal to the reference value. Alternatively, in operation (920), the electronic device (300) may perform operation (940) when the value exceeds the reference value.

[0161] In operation (930), the electronic device (300) may maintain a blur intensity (i). For example, the electronic device (300) may maintain a blur intensity (i) used to blur at least one color of parts of the image to be displayed (e.g., a second part and a third part). This may be because the user's usage time of the electronic device (300) is still short, or the user is using the electronic device (300) from a location far from the electronic device (300). In other words, the user's eye strain may be low.

[0162] In operation (940), the electronic device (300) can adjust the intensity of the blur (i). For example, the electronic device (300) can increase the intensity of the blur (i) used to blur at least one color of parts of the image to be displayed (e.g., a second part and a third part). This may be because the user's usage time of the electronic device (300) is long, or the user is using the electronic device (300) at a close location. In other words, the user's eye strain may be high.

[0163] Referring to FIG. 9, the electronic device (300) can gradually increase the intensity of the blur according to the usage state of the user utilizing the electronic device (300) (or display (320), display panel (322)). By dynamically adjusting the intensity of the blur according to the user's usage state or by using a blur intensity that is personalized (or optimized) to the user, the defocusing effect for alleviating the user's abnormal vision can be enhanced. FIG. 9 illustrates the adjustment of the intensity of the blur based on the usage information, but the present disclosure is not limited thereto. For example, the electronic device (300) can enlarge or reduce the size of each part of the image to be displayed based on the usage information. For example, if the display time of the usage information exceeds the reference value, the electronic device (300) can reduce the size of the first part of the image and enlarge the size of the second part and the third part.

[0164] Referring to the above description, the electronic device (300) is exemplified as determining parts of an image to correspond to the areas of the user's eyes and determining the intensity of the blur according to the user's usage information, but the present disclosure is not limited thereto. For example, the electronic device (300) may determine parts of the image and the intensity of the blur according to the content of the image to be displayed. For example, if the content of the image to be displayed is dynamic content (e.g., video), the electronic device (300) may reduce the size of a first part of the image and enlarge the size of a second part and a third part. In other words, in the case of dynamic content, the size of the second part and the third part of the image may be reduced because there is a high probability that the direction of the user's gaze will be located in the central area of ​​the display (320). Additionally, for example, the electronic device (300) can increase the blur intensity of the second part and the blur intensity of the third part when the content of the image to be displayed is dynamic content (e.g., video) compared to when the content of the image to be displayed is static content (e.g., text, or still image). In other words, when the content of the image to be displayed is static content (e.g., text, or still image), the electronic device (300) can reduce the size of the second part and the third part among the parts of the image, or relatively lower the blur intensity of the second part and the third part.

[0165] Alternatively, for example, the electronic device (300) may perform differential blurring on at least one color of the present disclosure based on the execution of a specific software application or the execution of a specific function. As an example without limitation, if the specific software application is a navigation application (or a map application), the electronic device (300) may refrain from performing differential blurring according to the present disclosure. As an example without limitation, if the specific software application is a gallery application (or a photo application), the electronic device (300) may refrain from performing differential blurring according to the present disclosure. Alternatively, for example, the electronic device (300) may automatically perform differential blurring according to the present disclosure with or without user selection when executing a function such as a BLF (blue light filter) function. Alternatively, for example, the electronic device (300) may determine whether to perform differential blur according to the present disclosure based on a flag included in the control information (e.g., header information) of the image to be displayed. As an example without limitation, the electronic device (300) may perform differential blur according to the present disclosure if the value of the flag of the image to be displayed allows blur. As an example without limitation, the electronic device (300) may not perform differential blur according to the present disclosure if the value of the flag of the image to be displayed allows blur. As an example without limitation, the value of the flag may be determined when the image to be displayed is generated or may be set by the user of the electronic device (300).

[0166] Alternatively, for example, the electronic device (300) may determine parts of an image and the intensity of a blur based on a user recognized using the sensor and / or camera of the electronic device (300). For example, if the user recognized using the sensor and / or camera is a user of the electronic device (300), the electronic device (300) may identify at least one color according to said user, determine parts of an image, and determine the intensity of a blur. Alternatively, if the user recognized using the sensor and / or camera is different from the user of the electronic device (300), the electronic device (300) may display the test image exemplified in FIG. 6a again to identify at least one color according to the newly recognized user. Or, the electronic device (300) may determine parts of an image and determine the intensity of a blur according to the newly recognized user.

[0167] FIG. 10 is a block diagram of an electronic device in a network environment according to various embodiments.

[0168] Referring to FIG. 10, in a network environment (1000), an electronic device (1001) may communicate with an electronic device (1002) through a first network (1098) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1004) or a server (1008) through a second network (1099) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1001) may communicate with the electronic device (1004) through a server (1008). According to one embodiment, the electronic device (1001) may include a processor (1020), memory (1030), input module (1050), sound output module (1055), display module (1060), audio module (1070), sensor module (1076), interface (1077), connection terminal (1078), haptic module (1079), camera module (1080), power management module (1088), battery (1089), communication module (1090), subscriber identification module (1096), or antenna module (1097). In some embodiments, at least one of these components (e.g., connection terminal (1078)) may be omitted from the electronic device (1001), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1076), camera module (1080), or antenna module (1097)) may be integrated into a single component (e.g., display module (1060)).

[0169] The processor (1020) can, for example, execute software (e.g., program (1040)) to control at least one other component (e.g., hardware or software component) of the electronic device (1001) connected to the processor (1020) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1020) can store commands or data received from other components (e.g., sensor module (1076) or communication module (1090)) in volatile memory (1032), process the commands or data stored in volatile memory (1032), and store the resulting data in non-volatile memory (1034). According to one embodiment, the processor (1020) may include a main processor (1021) (e.g., a central processing unit or an application processor) or an auxiliary processor (1023) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1001) includes a main processor (1021) and an auxiliary processor (1023), the auxiliary processor (1023) may be configured to use less power than the main processor (1021) or to be specialized for a designated function. The auxiliary processor (1023) may be implemented separately from the main processor (1021) or as part thereof.

[0170] The auxiliary processor (1023) may control at least some of the functions or states associated with at least one component of the electronic device (1001) (e.g., display module (1060), sensor module (1076), or communication module (1090)) on behalf of the main processor (1021) while the main processor (1021) is in an inactive (e.g., sleep) state, or together with the main processor (1021) while the main processor (1021) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1023) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1080) or communication module (1090)). According to one embodiment, the auxiliary processor (1023) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1001) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1008)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0171] The memory (1030) can store various data used by at least one component of the electronic device (1001) (e.g., processor (1020) or sensor module (1076)). The data may include, for example, input data or output data for software (e.g., program (1040)) and related commands. The memory (1030) may include volatile memory (1032) or non-volatile memory (1034).

[0172] The program (1040) may be stored as software in memory (1030) and may include, for example, an operating system (1042), middleware (1044), or an application (1046).

[0173] The input module (1050) can receive commands or data to be used for a component of the electronic device (1001) (e.g., processor (1020)) from outside the electronic device (1001) (e.g., user). The input module (1050) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0174] The sound output module (1055) can output a sound signal to the outside of the electronic device (1001). The sound output module (1055) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0175] The display module (1060) can visually provide information to an external (e.g., user) of the electronic device (1001). The display module (1060) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1060) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0176] The audio module (1070) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1070) can acquire sound through an input module (1050) or output sound through an audio output module (1055) or an external electronic device (e.g., electronic device (1002)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1001).

[0177] The sensor module (1076) can detect the operating state of the electronic device (1001) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1076) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0178] The interface (1077) may support one or more specified protocols that can be used for the electronic device (1001) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1002)). According to one embodiment, the interface (1077) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0179] The connection terminal (1078) may include a connector through which the electronic device (1001) can be physically connected to an external electronic device (e.g., electronic device (1002)). According to one embodiment, the connection terminal (1078) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0180] The haptic module (1079) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (1079) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0181] The camera module (1080) can capture still images and video. According to one embodiment, the camera module (1080) may include one or more lenses, image sensors, image signal processors, or flashes.

[0182] The power management module (1088) can manage power supplied to the electronic device (1001). According to one embodiment, the power management module (1088) may be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0183] The battery (1089) can supply power to at least one component of the electronic device (1001). According to one embodiment, the battery (1089) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0184] The communication module (1090) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1001) and an external electronic device (e.g., electronic device (1002), electronic device (1004), or server (1008)), and the performance of communication through the established communication channel. The communication module (1090) may include one or more communication processors that operate independently of the processor (1020) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1090) may include a wireless communication module (1092) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1094) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1004) through a first network (1098) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1099) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1092) can identify or authenticate the electronic device (1001) within a communication network such as the first network (1098) or the second network (1099) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1096).

[0185] The wireless communication module (1092) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1092) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1092) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1092) can support various requirements specified in the electronic device (1001), external electronic device (e.g., electronic device (1004)), or network system (e.g., second network (1099)). According to one embodiment, the wireless communication module (1092) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0186] An antenna module (1097) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1097) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1097) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1098) or a second network (1099), may be selected from the plurality of antennas, for example, by a communication module (1090). A signal or power may be transmitted or received between the communication module (1090) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1097).

[0187] According to various embodiments, the antenna module (1097) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0188] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0189] According to one embodiment, commands or data may be transmitted or received between an electronic device (1001) and an external electronic device (1004) through a server (1008) connected to a second network (1099). Each of the external electronic devices (1002, or 1004) may be the same or a different type of device as the electronic device (1001). According to one embodiment, all or part of the operations performed on the electronic device (1001) may be performed on one or more of the external electronic devices (1002, 1004, or 1008). For example, if the electronic device (1001) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1001) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1001). The electronic device (1001) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1001) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1004) may include an Internet of Things (IoT) device. The server (1008) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1004) or server (1008) may be included within the second network (1099). The electronic device (1001) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0190] For example, an external electronic device (1002) renders content data executed in an application and transmits it to an electronic device (1001), and the electronic device (1001) that receives the data can output the content data to a display module. If the electronic device (1001) detects user movement through an IMU sensor or the like, the processor of the electronic device (1001) can correct the rendering data received from the external electronic device (1002) based on the movement information and output it to the display module. Alternatively, the external electronic device (1002) can transmit the movement information to request rendering so that the screen data is updated accordingly. Depending on various embodiments, the external electronic device (1002) may be a device of various forms, such as a case device capable of storing and charging a smartphone or an electronic device (101).

[0191] FIG. 11 is a block diagram of a display module according to various embodiments.

[0192] Referring to FIG. 11, the display module (1060) may include a display panel (1110) and a display driver IC (DDI) (1130) for controlling it. The DDI (1130) may include an interface module (1131), a memory (1133) (e.g., a buffer memory), an image processing module (1135), or a mapping module (1137). The DDI (1130) may receive image information, including, for example, image data or an image control signal corresponding to a command for controlling said image data, from another component of the electronic device (1001) through the interface module (1131). For example, according to one embodiment, image information may be received from a processor (1020) (e.g., main processor (1021) (e.g., application processor)) or an auxiliary processor (1023) (e.g., graphics processing unit) that operates independently of the functions of the main processor (1021). The DDI (1130) may communicate with the touch circuit (1150) or sensor module (1076), etc., through the interface module (1131). Additionally, the DDI (1130) may store at least a portion of the received image information in memory (1133), for example, in frame units. The image processing module (1135) may perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a portion of the image data based at least on the characteristics of the image data or the characteristics of the display panel (1110), for example. The mapping module (1137) may obtain voltage values ​​or current values ​​corresponding to the image data preprocessed or postprocessed through the image processing module (1135). It can be generated. According to one embodiment, the generation of a voltage value or a current value can be performed, for example, based at least in part on the properties of the pixels of the display panel (1110) (e.g., array of pixels (RGB stripe or pentile structure), or the size of each of the subpixels).At least some pixels of the display panel (1110) are driven, for example, based on at least some of the voltage value or current value, so that visual information (e.g., text, image, or icon) corresponding to the image data can be displayed through the display panel (1110).

[0193] According to one embodiment, the display module (1060) may further include a touch circuit (1150). The touch circuit (1150) may include a touch sensor (1151) and a touch sensor IC (1153) for controlling the same. The touch sensor IC (1153) may control the touch sensor (1151) to detect a touch input or hovering input for a specific location on the display panel (1110), for example. For example, the touch sensor IC (1153) may detect a touch input or hovering input by measuring a change in a signal (e.g., voltage, light intensity, resistance, or charge) for a specific location on the display panel (1110). The touch sensor IC (1153) may provide information regarding the detected touch input or hovering input (e.g., location, area, pressure, or time) to the processor (1020). According to one embodiment, at least a part of the touch circuit (1150) (e.g., touch sensor IC (1153)) may be included as part of the display driver IC (1130) or the display panel (1110), or as part of another component (e.g., auxiliary processor (1023)) placed outside the display module (1060).

[0194] According to one embodiment, the display module (1060) may further include at least one sensor (e.g., fingerprint sensor, iris sensor, pressure sensor, or light sensor) of the sensor module (1076) or a control circuit for the same. In this case, the at least one sensor or the control circuit for the same may be embedded in a part of the display module (1060) (e.g., display panel (1110) or DDI (1130)) or a part of the touch circuit (1150). For example, if the sensor module (1076) embedded in the display module (1060) includes a biometric sensor (e.g., fingerprint sensor), the biometric sensor may acquire biometric information (e.g., fingerprint image) associated with a touch input through a part of the display panel (1110). As another example, if the sensor module (1076) embedded in the display module (1060) includes a pressure sensor, the pressure sensor can obtain pressure information associated with a touch input through a part or the entire area of ​​the display panel (1110). According to one embodiment, the touch sensor (1151) or the sensor module (1076) may be placed between pixels of a pixel layer of the display panel (1110), or above or below the pixel layer.

[0195] In embodiments of the present disclosure, an electronic device for displaying an image in a virtual space (e.g., the electronic device (300) of FIG. 3, the electronic device (1001) of FIG. 10) may be a wearable device. The wearable device may include a head-mounted display (HMD) that is wearable on a user's head. The wearable device may be referred to as a head-mount device (HMD), a headgear electronic device, a glasses-type electronic device, a video see-through (VST) or visible see-through (VST) device, an extended reality (XR) device, a virtual reality (VR) device, and / or an augmented reality (AR) device. An example of a hardware configuration included within the wearable device is described exemplarily with reference to FIG. 12b. An example of the structure of a wearable device that is wearable on a user's head is described with reference to FIG. 12a through 13b. The wearable device may be referred to as an electronic device (400). For example, the electronic device may be combined with an accessory (e.g., a strap) to be attached to the user's head to form an HMD.

[0196] According to one embodiment, a wearable device can perform functions related to augmented reality (AR) and / or mixed reality (MR). For example, while a user is wearing the wearable device, the wearable device may include at least one lens positioned adjacent to the user's eye. The wearable device may combine light emitted from a display of the wearable device with ambient light passing through the lens. The display area of ​​the display may be formed within the lens through which the ambient light passes. Because the wearable device combines the ambient light and the light emitted from the display, the user may see a mixed image of a real object (or physical object) perceived by the ambient light and a virtual object formed by the light emitted from the display. The augmented reality, mixed reality, and / or virtual reality described above may be referred to as extended reality (XR).

[0197] According to one embodiment, a wearable device may perform functions related to VST (video see-through or visible see-through) and / or virtual reality (VR). For example, while a user is wearing the wearable device, the wearable device may include a housing that covers the user's eyes. The wearable device may include a display disposed on a first surface of the housing facing the eyes while in the state. The wearable device may include a camera disposed on a second surface opposite to the first surface. Using the camera, the wearable device may acquire an image and / or video representing ambient light. The wearable device may output the image and / or video within the display disposed on the first surface so that the user perceives the ambient light through the display. A displaying area (or displaying region) (or active area or active region) of the display disposed on the first surface may be formed by one or more pixels included in the display. The wearable device can composite a virtual object with an image and / or video output through the display, thereby allowing the user to perceive the virtual object along with a real object perceived by ambient light.

[0198] According to one embodiment, a wearable device can identify or recognize the position or location and / or direction or orientation of the wearable device based on an image (and / or video) obtained or acquired using a camera. The wearable device can acquire information about the external space using one or more cameras and / or one or more sensors. The information may include a geographic location of the external space (e.g., Global Positioning System (GPS) coordinates) identified by one or more sensors. The information may include an image and / or video of the external space identified by one or more cameras. The wearable device can perform object recognition on the image and / or video to identify external objects contained in the external space from the image and / or video.

[0199] Hereinafter, an example of a hardware configuration of a wearable device is described with reference to FIGS. 12a, FIGS. 12b, FIGS. 13a, and FIGS. 13b.

[0200] FIG. 12a illustrates an example of a perspective view of an electronic device. FIG. 12b illustrates an example of one or more hardware components arranged within the electronic device.

[0201] According to one embodiment, the electronic device (300) may have the form of glasses that are wearable on a part of a user's body (e.g., head). The electronic device (300) of FIGS. 12a and FIGS. 12b may be an example of the electronic device (300) of FIGS. 3. For example, the electronic device (300) of FIGS. 12a and FIGS. 12b may be an example of the electronic device (1001) of FIGS. 10. The electronic device (300) may include a head-mounted display (HMD). For example, the electronic device (300) of FIGS. 12a and FIGS. 12b may be referred to as a wearable device, a head-mounted electronic device, an HMD device, or an AR / VR device.

[0202] For example, the housing of the electronic device (300) may include a flexible material such as rubber and / or silicone having a shape that adheres to a part of the user's head (e.g., a part of the face covering both eyes). For example, the housing of the electronic device (300) may include one or more straps that can be twined around the user's head and / or one or more temples that are attachable to the ears of the head.

[0203] Referring to FIG. 12a, an electronic device (300) according to one embodiment may include at least one display (1250) and a frame (1200) supporting at least one display (1250).

[0204] According to one embodiment, the electronic device (300) may be worn on a part of the user's body. The electronic device (300) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the electronic device (300). For example, the electronic device (300) may display a virtual reality image provided by at least one optical device (1282, 1284) of FIG. 12b on at least one display (1250) in response to a designated gesture of the user obtained through the motion recognition camera (1260-2, 1260-3) of FIG. 12b.

[0205] According to one embodiment, at least one display (1250) can provide visual information to a user. For example, at least one display (1250) may include a transparent or translucent lens. At least one display (1250) may include a first display (1250-1) and / or a second display (1250-2) spaced apart from the first display (1250-1). For example, the first display (1250-1) and the second display (1250-2) may be positioned at locations corresponding to the user's left eye and right eye, respectively.

[0206] Referring to FIG. 12b, at least one display (1250) may provide visual information transmitted from external light to a user through a lens included in at least one display (1250) and other visual information distinct from said visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (1250) may include a first surface (1231) and a second surface (1232) opposite to the first surface (1231). A display area may be formed on the second surface (1232) of at least one display (1250). When a user wears the electronic device (300), external light may be transmitted to the user by being incident on the first surface (1231) and transmitted through the second surface (1232). As another example, at least one display (1250) can display an augmented reality image combined with a virtual reality image provided by at least one optical device (1282, 1284) on a real screen transmitted through external light in a display area formed on a second surface (1232).

[0207] In one embodiment, at least one display (1250) may include at least one waveguide (1233, 1234) that diffracts light emitted from at least one optical device (1282, 284) and transmits it to a user. At least one waveguide (1233, 1234) may be formed based on at least one of glass, plastic, or polymer. A nano pattern may be formed on the exterior or at least a portion of the interior of at least one waveguide (1233, 1234). The nano pattern may be formed based on a polygonal and / or curved grating structure. Light incident on one end of at least one waveguide (1233, 1234) may be propagated to the other end of at least one waveguide (1233, 1234) by the nano pattern. At least one waveguide (1233, 1234) may include at least one diffractive element (e.g., DOE (diffractive optical element), HOE (holographic optical element)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (1233, 1234) may be placed within an electronic device (300) to guide a screen displayed by at least one display (1250) to the user's eye. For example, the screen may be transmitted to the user's eye based on total internal reflection (TIR) ​​occurring within at least one waveguide (1233, 1234).

[0208] The electronic device (300) can analyze an object included in a real-world image collected through a camera (1260-4), combine a virtual object corresponding to an object among the analyzed objects that is the target of augmented reality provision, and display it on at least one display (1250). The virtual object may include at least one of text and an image regarding various information related to the object included in the real-world image. The electronic device (300) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the electronic device (300) can perform spatial recognition (e.g., SLAM (simultaneous localization and mapping)) using a multi-camera and / or time-of-flight (ToF). A user wearing the electronic device (300) can view the image displayed on at least one display (1250).

[0209] According to one embodiment, the frame (1200) may be formed as a physical structure that allows the electronic device (300) to be worn on the user's body. According to one embodiment, the frame (1200) may be configured such that when the user wears the electronic device (300), the first display (1250-1) and the second display (1250-2) can be positioned corresponding to the user's left and right eyes. The frame (1200) may support at least one display (1250). For example, the frame (1200) may support the first display (1250-1) and the second display (1250-2) so that they are positioned corresponding to the user's left and right eyes.

[0210] Referring to FIG. 12a, the frame (1200) may include an area (1220) in which at least a portion of the frame contacts a part of the user's body when the user wears the electronic device (300). For example, the area (1220) of the frame (1200) in contact with a part of the user's body may include an area in contact with a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the electronic device (300) contacts. According to one embodiment, the frame (1200) may include a nose pad (1210) that contacts a part of the user's body. When the electronic device (300) is worn by the user, the nose pad (1210) may contact a part of the user's nose. The frame (1200) may include a first temple (1204) and a second temple (1205) that contact a different part of the user's body distinct from the part of the user's body.

[0211] For example, the frame (1200) may include a first rim (1201) covering at least a portion of a first display (1250-1), a second rim (1202) covering at least a portion of a second display (1250-2), a bridge (1203) positioned between the first rim (1201) and the second rim (1202), a first pad (1211) positioned along a portion of the edge of the first rim (1201) from one end of the bridge (1203), a second pad (1212) positioned along a portion of the edge of the second rim (1202) from the other end of the bridge (1203), a first temple (1204) extending from the first rim (1201) and fixed to a portion of the wearer's ear, and a second temple (1205) extending from the second rim (1202) and fixed to a portion of the ear opposite to the ear. The first pad (1211) and the second pad (1212) may come into contact with a part of the user's nose, and the first temple (1204) and the second temple (1205) may come into contact with a part of the user's face and a part of the ear. The temples (1204, 1205) may be rotatably connected to the rim through the hinge units (1206, 207) of FIG. 12b. The first temple (1204) may be rotatably connected to the first rim (1201) through a first hinge unit (1206) positioned between the first rim (1201) and the first temple (1204). The second temple (1205) may be rotatably connected to the second rim (1202) through a second hinge unit (1207) disposed between the second rim (1202) and the second temple (1205). According to one embodiment, the electronic device (300) may identify an external object touching the frame (1200) (e.g., a user's fingertip) and / or a gesture performed by said external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of the surface of the frame (1200).

[0212] According to one embodiment, the electronic device (300) may include hardware that performs various functions (e.g., processor, memory). For example, the hardware may include a battery module (1270), an antenna module (1275), at least one optical device (1282, 1284), speakers (e.g., speakers (1255-1, 1255-2)), a microphone (e.g., microphones (1265-1, 1265-2, 1265-3)), a light-emitting module (not shown), and / or a PCB (printed circuit board) (1290) (e.g., a printed circuit board). The various hardware may be placed within a frame (1200).

[0213] According to one embodiment, a microphone (e.g., microphones (1265-1, 1265-2, 1265-3)) of an electronic device (300) is positioned on at least a portion of a frame (1200) to acquire a sound signal. A first microphone (1265-1) positioned on a bridge (1203), a second microphone (1265-2) positioned on a second rim (1202), and a third microphone (1265-3) positioned on a first rim (1201) are shown in FIG. 12b, but the number and position of the microphones (1265) are not limited to the embodiment of FIG. 12b. If there are two or more microphones (1265) included in the electronic device (300), the electronic device (300) can identify the direction of the sound signal by using a plurality of microphones positioned on different portions of the frame (1200).

[0214] According to one embodiment, at least one optical device (1282, 1284) may project a virtual object onto at least one display (1250) to provide various image information to a user. For example, at least one optical device (1282, 1284) may be a projector. At least one optical device (1282, 1284) may be disposed adjacent to at least one display (1250) or included within at least one display (1250) as part of at least one display (1250). According to one embodiment, an electronic device (300) may include a first optical device (1282) corresponding to a first display (1250-1) and a second optical device (1284) corresponding to a second display (1250-2). For example, at least one optical device (1282, 1284) may include a first optical device (1282) positioned at the edge of a first display (1250-1) and a second optical device (1284) positioned at the edge of a second display (1250-2). The first optical device (1282) may transmit light to a first waveguide (1233) positioned on the first display (1250-1), and the second optical device (1284) may transmit light to a second waveguide (1234) positioned on the second display (1250-2).

[0215] In one embodiment, the camera (1260) may include a shooting camera (1260-4), an eye tracking camera (ET CAM) (1260-1), and / or a motion recognition camera (1260-2, 1260-3). The shooting camera (1260-4), the eye tracking camera (1260-1), and the motion recognition camera (1260-2, 1260-3) may be positioned at different locations on the frame (1200) and may perform different functions. The eye tracking camera (1260-1) may output data indicating the position of the eyes or the gaze of a user wearing the electronic device (300). For example, the electronic device (300) may detect the gaze from an image containing the user's pupils obtained through the eye tracking camera (1260-1). The electronic device (300) can identify an object focused by the user (e.g., a real object, and / or a virtual object) by using the user's gaze acquired through the gaze tracking camera (1260-1). The electronic device (300), having identified the focused object, can execute a function for interaction between the user and the focused object (e.g., gaze interaction). The electronic device (300) can represent a portion corresponding to the eyes of an avatar representing the user in a virtual space by using the user's gaze acquired through the gaze tracking camera (1260-1). The electronic device (300) can render an image (or screen) displayed on at least one display (1250) based on the position of the user's eyes. For example, the visual quality of a first region associated with the gaze within the image and the visual quality of a second region distinct from the first region (e.g., resolution, brightness, saturation, grayscale, PPI (pixels per inch)) may differ from each other. In the present disclosure, the term “resolution” is used to refer to the density of pixels of an image and / or display (1250).The density and / or resolution of the pixels may be measured based on units of PPI and / or dpi (dots per inch) or may be parameterized. The electronic device (300) may acquire an image having a visual quality of a first region and a visual quality of a second region that matches the user's gaze by using foveated rendering. For example, if the electronic device (300) supports an iris recognition function, user authentication may be performed based on iris information acquired using an eye-tracking camera (1260-1). An example in which the eye-tracking camera (1260-1) is positioned toward the user's right eye is illustrated in FIG. 12b, but the embodiment is not limited thereto, and the eye-tracking camera (1260-1) may be positioned solely toward the user's left eye or toward both eyes.

[0216] In one embodiment, the camera (1260-4) can capture a real image or background to be matched with a virtual image in order to implement augmented reality or mixed reality content. The camera (1260-4) can be used to acquire high-resolution images based on HR (high resolution) or PV (photo video). The camera (1260-4) can capture an image of a specific object located at the position viewed by the user and provide the image to at least one display (1250). The at least one display (1250) can display a single image in which information regarding a real image or background including the image of the specific object acquired using the camera (1260-4) and a virtual image provided through at least one optical device (1282, 1284) are superimposed. The electronic device (300) can compensate for depth information (e.g., the distance between the electronic device (300) and an external object acquired through a depth sensor) using the image acquired through the camera (1260-4). The electronic device (300) can perform object recognition through an image acquired using a shooting camera (1260-4). The electronic device (300) can perform a function of focusing on an object (or subject) in an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the shooting camera (1260-4). The electronic device (300) can perform a pass-through function to superimpose an image acquired through the shooting camera (1260-4) onto at least a portion of a screen representing a virtual space while displaying the screen representing a virtual space on at least one display (1250). In one embodiment, the shooting camera (1260-4) may be placed on a bridge (1203) positioned between a first rim (1201) and a second rim (1202).

[0217] The eye tracking camera (1260-1) can achieve more realistic augmented reality by tracking the gaze of a user wearing the electronic device (300), thereby matching the user's gaze with visual information provided to at least one display (1250). For example, when the user looks straight ahead, the electronic device (300) can naturally display environmental information related to the user's front on at least one display (1250) at the location where the user is situated. The eye tracking camera (1260-1) may be configured to capture an image of the user's pupil to determine the user's gaze. For example, the eye tracking camera (1260-1) may receive a gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the eye tracking camera (1260-1) may be positioned at locations corresponding to the user's left and right eyes. For example, the eye-tracking camera (1260-1) may be positioned within the first rim (1201) and / or the second rim (1202) to face the direction in which the user wearing the electronic device (300) is located.

[0218] A motion recognition camera (1260-2, 1260-3) can provide a specific event to a screen provided on at least one display (1250) by recognizing the movement of the user's entire body or part thereof, such as the user's torso, hands, or face. A motion recognition camera (1260-2, 1260-3) can recognize the user's gesture, acquire a signal corresponding to the gesture, and provide a display corresponding to the signal to at least one display (1250). A processor can identify the signal corresponding to the gesture and, based on the identification, perform a designated function. A motion recognition camera (1260-2, 1260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for a 6-degrees-of-freedom pose (6 dof pose). A processor can use the motion recognition camera (1260-2, 1260-3) to perform a gesture recognition function and / or an object tracking function. In one embodiment, a motion recognition camera (1260-2, 1260-3) may be placed on the first rim (1201) and / or the second rim (1202).

[0219] The camera (1260) included in the electronic device (300) is not limited to the eye-tracking camera (1260-1) and motion recognition camera (1260-2, 1260-3) described above. For example, the electronic device (300) can identify external objects included within the field of view (FoV) by using a camera positioned toward the user's field of view (FoV). The identification of external objects by the electronic device (300) can be performed based on a sensor for identifying the distance between the electronic device (300) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (1260) positioned toward the FoV can support an autofocus (AF) function and / or an optical image stabilization (OIS) function. For example, the electronic device (300) may include a camera (1260) (e.g., a face tracking camera) positioned toward the face to acquire an image including the face of a user wearing the electronic device (300).

[0220] Although not illustrated, according to one embodiment, the electronic device (300) may further include a light source (e.g., LED) that emits light toward a subject (e.g., user's eye, face, and / or an object outside the FoV) being photographed using a camera (1260). The light source may include an LED of infrared wavelength. The light source may be placed in at least one of the frame (1200) and hinge units (1206, 1207).

[0221] According to one embodiment, the battery module (1270) can supply power to the electronic components of the electronic device (300). In one embodiment, the battery module (1270) may be placed within the first temple (1204) and / or the second temple (1205). For example, the battery module (1270) may be a plurality of battery modules (1270). The plurality of battery modules (1270) may each be placed in the first temple (1204) and the second temple (1205), respectively. In one embodiment, the battery module (1270) may be placed at the end of the first temple (1204) and / or the second temple (1205).

[0222] The antenna module (1275) can transmit a signal or power to the outside of the electronic device (300) or receive a signal or power from the outside. In one embodiment, the antenna module (1275) may be placed within the first temple (1204) and / or the second temple (1205). For example, the antenna module (1275) may be placed close to one side of the first temple (1204) and / or the second temple (1205).

[0223] The speaker (1255) can output an acoustic signal to the outside of the electronic device (300). The acoustic output module may be referred to as the speaker. In one embodiment, the speaker (1255) may be placed within a first temple (1204) and / or a second temple (1205) to be positioned adjacent to the ear of a user wearing the electronic device (300). For example, the speaker (1255) may include a second speaker (1255-2) positioned adjacent to the user's left ear by being placed within the first temple (1204), and a first speaker (1255-1) positioned adjacent to the user's right ear by being placed within the second temple (1205).

[0224] A light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the electronic device (300) to the user. For example, when the electronic device (300) requires charging, it may emit red light at a constant frequency. In one embodiment, the light-emitting module may be placed on the first rim (1201) and / or the second rim (1202).

[0225] Referring to FIG. 12b, according to one embodiment, an electronic device (300) may include a printed circuit board (PCB) (1290). The PCB (1290) may be included in at least one of a first temple (1204) or a second temple (1205). The PCB (1290) may include an interposer disposed between at least two sub-PCBs. One or more hardware components (e.g., processor, memory) included in the electronic device (300) may be disposed on the PCB (1290). The electronic device (300) may include a flexible PCB (FPCB) for interconnecting the hardware components.

[0226] According to one embodiment, the electronic device (300) may include at least one of a gyroscope sensor, a gravity sensor, and / or an acceleration sensor for detecting the posture of the electronic device (300) and / or the posture of a body part (e.g., head) of a user wearing the electronic device (300). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyroscope sensor may measure the angular velocity of each of the designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyroscope sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the electronic device (300) may identify motions and / or gestures of a user performed to execute or interrupt specific functions of the electronic device (300) based on the IMU.

[0227] FIGS. 13a and FIGS. 13b illustrate an example of the appearance of an electronic device.

[0228] The electronic device (300) of FIGS. 13a and FIGS. 13b may be an example of the electronic device (300) of FIGS. 12a and FIGS. 12b. For example, the electronic device (300) of FIGS. 13a and FIGS. 13b may be an example of the electronic device (300) of FIGS. 3 or the electronic device (1001) of FIGS. 10. For example, the electronic device (300) of FIGS. 13a and FIGS. 13b may be referred to as a wearable device, a head-worn electronic device, an HMD device, or an AR / VR device. According to one embodiment, an example of the appearance of a first surface (1310) of the housing of the electronic device (300) may be shown in FIG. 13a, and an example of the appearance of a second surface (1320) opposite to the first surface (1310) may be shown in FIG. 13b.

[0229] Referring to FIG. 13a, according to one embodiment, a first surface (1310) of an electronic device (300) may have a shape that is attachable to a part of a user's body (e.g., the face of the user). Although not illustrated, the electronic device (300) may further include a strap for fixing to a part of the user's body and / or one or more temples (e.g., a first temple (1204) and / or a second temple (1205) of FIG. 12a and FIG. 12b). A first display (1250-1) for outputting an image to the left eye among the user's two eyes, and a second display (1250-2) for outputting an image to the right eye among the two eyes may be disposed on the first surface (1310). The electronic device (300) may further include a rubber or silicone packing formed on the first surface (1310) to prevent interference by light different from light emitted from the first display (1250-1) and the second display (1250-2) (e.g., ambient light).

[0230] According to one embodiment, the electronic device (300) may include cameras (1260-1) for photographing and / or tracking both eyes of a user adjacent to each of the first display (1250-1) and the second display (1250-2). The cameras (1260-1) may be referenced to the eye-tracking camera (1260-1) of FIG. 12b. According to one embodiment, the electronic device (300) may include cameras (1260-5, 1260-6) for photographing and / or recognizing a user's face. The cameras (1260-5, 1260-6) may be referenced to FT cameras. The electronic device (300) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (1260-5, 1260-6). For example, the electronic device (300) can change the texture and / or shape of a part of an avatar (e.g., a part of an avatar representing a human face) by using information obtained by cameras (1260-5, 1260-6) (e.g., FT cameras) and representing the facial expression of a user wearing the electronic device (300).

[0231] Referring to FIG. 13b, on a second surface (1320) opposite to the first surface (1310) of FIG. 13a, a camera (e.g., cameras (1260-7, 1260-8, 1260-9, 1260-10, 1260-11, 1260-12)), and / or a sensor (e.g., a depth sensor (1330)) may be placed to obtain information related to the external environment of the electronic device (300). For example, cameras (1260-7, 1260-8, 1260-9, 1260-10) may be placed on the second surface (1320) to recognize external objects. The cameras (1260-7, 1260-8, 1260-9, 1260-10) can be referenced to the motion recognition cameras (1260-2, 1260-3) of FIG. 12b.

[0232] For example, using cameras (1260-11, 1260-12), the electronic device (300) can acquire images and / or videos to be transmitted to each of the user's two eyes. Camera (1260-11) may be placed on a second surface (1320) of the electronic device (300) to acquire an image to be displayed through a second display (1250-2) corresponding to the right eye among the two eyes. Camera (1260-12) may be placed on a second surface (1320) of the electronic device (300) to acquire an image to be displayed through a first display (1250-1) corresponding to the left eye among the two eyes. Cameras (1260-11, 1260-12) may be referenced to the shooting camera (1260-4) of FIG. 12b.

[0233] According to one embodiment, the electronic device (300) may include a depth sensor (1330) disposed on a second surface (1320) to identify the distance between the electronic device (300) and an external object. Using the depth sensor (1330), the electronic device (300) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the electronic device (300). Although not illustrated, a microphone may be disposed on the second surface (1320) of the electronic device (300) to obtain sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0234] The components of the electronic device (300) illustrated in FIGS. 12a through 13b are merely exemplary and the present disclosure is not limited thereto. For example, the electronic device (300) may further include at least one of the components illustrated in FIGS. 12a through 13b or may not include at least one. For example, the electronic device (300) may include the components in a region (or arrangement) different from the region (or arrangement) where the components illustrated in FIGS. 12a through 13b are located. For example, the electronic device (300) may include a number of components different from the number of each of the components (e.g., cameras or sensors) illustrated in FIGS. 12a through 13b.

[0235] Figure 14 is a schematic diagram of an exemplary artificial intelligence (AI) system.

[0236] Referring to FIG. 14, the AI ​​system (1400) may include an input / output interface (1410), an AI (artificial intelligence) framework (1420), a generative AI model (1430), an application / service component (1480), and / or a knowledge repository (1490).

[0237] The input / output interface (1410) can receive input. The input may include user input and / or data acquired or generated by an electronic device (e.g., the electronic device (300) or electronic device (1001) described above). The data may include images, videos, and / or sensor data generated by at least one processor of the electronic device (e.g., at least one processor (310) or processor (1020)), such as illuminance data around the electronic device acquired from a sensor or sensor hub (e.g., auxiliary processor (1023), attitude data (or orientation data) of the electronic device, temperature inside the electronic device (e.g., display (320)), or temperature of at least one processor (310), size information of the display area of ​​the display (320), and / or images acquired through an image sensor of the electronic device (e.g., included in a camera module (1080)). The user input may include natural language, touch data obtained through a touch circuit included within the display panel (322) (e.g., used to identify input from a finger and / or stylus), an image displayed (and / or to be displayed) on the display panel (322), and / or video. By example, without limitation, the user input may be received by the input / output interface (1410) along with context information. The context information may be described as additional information obtained in relation to the user input. The context information may be related to the state at the time the user input is received (e.g., the state of the electronic device and / or the state around the electronic device (e.g., user state)). For example, the context information may include information about one or more software applications executed within the electronic device at the time the user input is received.For example, the above situation information may include information about the location of the electronic device (or the location of the user of the electronic device) when the user input is received. For example, the user input may be integrated with the situation information. For example, the user input with the situation information integrated as input may be received by the input / output interface (1410).

[0238] The input / output interface (1410) may transmit (or provide) an output. The output may include a result (or result information) generated or obtained by the AI ​​system (1400) based on at least part of the input. The format of the output may vary. For example, the output may include natural language. For example, the output may include content (e.g., media content and / or multimedia content). For example, the output may include actions related to the user of the electronic device. For example, the output may have a format according to the user settings of the electronic device.

[0239] The input / output interface (1410) can be described as a user question / response interface (1410).

[0240] The AI ​​framework (1420) can be used to obtain information (or data) about the input from the input / output interface (1410) and to control one or more components related to the AI ​​system (1400) using the obtained information.

[0241] For example, a prompt design component (1421) within an AI framework (1420) can generate or obtain prompts for a generative AI model (1430) (e.g., including a large language model (LLM) or a large multimodal model (LMM)) using the acquired information. For example, the prompt design component (1421) may be described as an AI component that uses a learning algorithm and / or a neural network to provide prompts that are enhanced over time. For example, the prompt design component (1421) can generate or obtain prompts by accessing a knowledge component (e.g., a knowledge repository (1490)) containing user preference data, a prompt library, and / or prompt examples using the acquired information. The generated prompts may be provided to the generative AI model (1430) (e.g., including an LLM or LMM).

[0242] For example, an API / plugin management component (1422) within the AI ​​framework (1420) may be used to support communication for additional information requested (or induced) in relation to the prompt provided (or to be provided) to the generative AI model (1430). For example, the API / plugin management component (1422) may be used to create or establish a channel for communication with various data sources (e.g., knowledge repository (1490)). For example, the API / plugin management component (1422) may support access to at least some of the data sources. For example, the API / plugin management component (1422) may be used to request another component (e.g., application / service component (1480)) that performs feedback (or response) according to the prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (1422) may be provided to the prompt design component (1421) for generating a prompt. As a non-limiting example, information obtained (or generated) through the API / plugin management component (1422) may be provided to the generative AI model (1430).

[0243] For example, an improvement component (1423) within the AI ​​framework (1420) can at least partially tune (or adjust) (or change) the result (e.g., content) obtained (or output) from the generative AI model (1430). For example, the improvement component (1423) can determine or verify whether the content obtained from the generative AI model (1430) is related to the input. For example, the improvement component (1423) can determine or verify whether the content obtained from the generative AI model (1430) contains biased content. For example, the improvement component (1423) can determine or verify whether the content obtained from the generative AI model (1430) contains harmful content. For example, the improvement component (1423) can support or assist in performing additional processing to improve the content obtained from the generative AI model (1430). For example, the improvement component (1423) may support providing a hint to the user to improve the content.

[0244] A generative AI model (1430) can be described as an artificial intelligence neural network that generates feedback in response to a prompt. For example, the feedback may include additional data and / or information relative to the prompt, but relative to the prompt. For example, the feedback may include new content relative to the prompt. For example, the generative AI model (1430) may include a model that generates images and / or a model that generates language. For example, the model that generates images may include a generative adversarial network (GAN) and / or a variational autoencoder (VAE). For example, the model that generates images may include a diffusion-based generative model (e.g., a transformer VAE). For example, the model that generates language may include CHAT-GPT 3 and / or CHAT-GPT 4. For example, the generative AI model (1430) may include an LMM that generates the feedback by recognizing text, images, and / or voice.

[0245] As an example without limitation, the AI ​​framework (1420) and / or generative AI model (1430) may be included within an AI module (e.g., including a processing circuit) within the electronic device. For example, the AI ​​module may be operatively coupled with at least one processor of the electronic device (e.g., at least one processor (310) or processor (1020)). For example, the AI ​​module may be operatively coupled with a display driving circuit of the electronic device (e.g., a display driving circuit (321) or a DDI (1130)). For example, the AI ​​module may be operatively coupled with a sensor hub of the electronic device for one or more sensors within the electronic device.

[0246] The present disclosure may display an image that includes a plurality of parts and is differentially blurred. For example, since a first part among the plurality of parts is perceived through the foveal region, the user may not perceive the degradation of image quality (or blurring) caused by a second part perceived through the peripheral region of the image and a third part perceived through the macular region. Additionally, since the second part and the third part, in which at least one color is blurred, are perceived through the peripheral region and the macular region, the user's eye may be restrained in a way that alleviates abnormal vision (e.g., hyperopia or myopia). For example, since the second intensity of the blurring of the third part is higher than the first intensity of the blurring of the second part, the user perceives the degradation of image quality less, and abnormal vision (e.g., hyperopia or myopia) may be more alleviated.

[0247] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.

[0248] As described above, the electronic device (300) may include a memory (330) that stores instructions and includes one or more storage media. The electronic device (300) may include at least one processor (310) that includes a processing circuit. The electronic device (300) may include a display (320). When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the electronic device (300) to identify at least one color of an image to be displayed through the display (320). When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the electronic device (300) to determine a first part of the image, a second part surrounding the first part, and a third part surrounding the second part. When the above instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the image including the first part, the second part, and the third part to be displayed through the display (320) by blurring the at least one color among the colors of the second part with a first intensity and blurring the at least one color among the colors of the third part with a second intensity higher than the first intensity.

[0249] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the image including the first part, the second part, and the third part to be displayed through the display (320) by bypassing the blurring of the colors of the first part, bypassing the blurring of at least one other color different from the at least one color of the colors of the second part, and bypassing the blurring of at least one other color of the colors of the third part.

[0250] According to one embodiment, the first portion of the image may correspond to a field of view (FoV) corresponding to the fovea centralis region of the user's eye looking at the display (320). The second portion of the image may correspond to a FoV corresponding to a paracentral region relative to the fovea centralis region of the user's eye. The third portion of the image may correspond to a FoV corresponding to the macula region of the user's eye.

[0251] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause a test image to identify the type of vision of a user to be displayed through the display (320). When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the at least one color among the colors to be identified as a first color and a second color based on receiving a first input regarding the test image. When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the at least one color among the colors to be identified as a third color different from the first color and the second color based on receiving a second input regarding the test image.

[0252] According to one embodiment, the colors may include red, green, and blue. The first color identified based on receiving the first input indicating that the type of vision of the user is myopia may be the blue color. The second color identified based on receiving the first input indicating that the type of vision of the user is myopia may be the green color. The third color identified based on receiving the second input indicating that the type of vision of the user is hyperopia may be the red color.

[0253] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may be caused to acquire data indicating the user's gaze direction. When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may be caused to identify the gaze direction identified based on the data. When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may be caused to determine the first part, the second part, and the third part using concentric circles formed with respect to a center position corresponding to the identified gaze direction.

[0254] According to one embodiment, the electronic device (300) may be a head-worn electronic device worn by the user. The data may be obtained from at least one sensor for eye-tracking (ET) of the head-worn electronic device.

[0255] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the at least one color among the colors of the second part to be blurred to the first intensity by determining color data for the at least one color among the colors of the first pixel of the second part based on color data for the at least one color among the colors of the second pixels within a pixel window defined for the first pixel. When the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may cause the at least one color among the colors of the third part to be blurred to the second intensity by determining color data for the at least one color among the colors of the third pixel of the third part based on color data for the at least one color among the colors of the fourth pixels within a pixel window defined for the third pixel.

[0256] According to one embodiment, the color data for the at least one color of the first pixel may be determined according to at least one of an average blur, a Gaussian blur, an intermediate filtering, or a bilateral filter regarding the color data for the at least one color of the second pixels.

[0257] According to one embodiment, the size of the pixel window defined with respect to the first pixel and the size of the pixel window defined with respect to the third pixel may be the same. The size of the pixel window may be determined based on the size of the user's eye, the size of the pupil of the eye, and the distance from the eye to the display (320).

[0258] According to one embodiment, the first intensity may be determined based on the size of the pixel window and a first coefficient for blurring. The second intensity may be determined based on the size of the pixel window and a second coefficient greater than the first coefficient for blurring.

[0259] According to one embodiment, the first coefficient may be determined based on the distance from the center position of the first part to the first pixel. The second coefficient may be determined based on the distance from the center position of the first part to the third pixel.

[0260] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor (310), the electronic device (300) may be caused to execute a mode for alleviating the user's myopia. When the instructions are executed individually or collectively by the at least one processor (310), based on the executed mode, the image may be displayed through the display (320) by blurring the at least one color of the second part with the first intensity and blurring the at least one color of the third part with the second intensity. Each of the first intensity and the second intensity may be adjusted based on at least one of the display time of the display (320) or the distance from the user's eye to the display (320).

[0261] According to one embodiment, the image may be an image in which the second part and the third part of the image are blurred, or an image generated by combining an additional image superimposed on the original image and in which parts corresponding to the second part and the third part are blurred, and the original image.

[0262] A method performed by an electronic device (300) having a display (320) as described above may include an operation of identifying at least one color among the colors of an image to be displayed through the display (320). The method may include an operation of determining a first part of the image, a second part surrounding the first part, and a third part surrounding the second part. The method may include an operation of displaying the image including the first part, the second part, and the third part through the display (320) by blurring the at least one color among the colors of the second part with a first intensity and blurring the at least one color among the colors of the third part with a second intensity higher than the first intensity.

[0263] According to one embodiment, the method may include the operation of displaying the image including the first part, the second part, and the third part through the display (320) by bypassing the blurring of the colors of the first part, bypassing the blurring of at least one other color different from at least one color among the colors of the second part, and bypassing the blurring of at least one other color among the colors of the third part.

[0264] According to one embodiment, the first portion of the image may correspond to a field of view (FoV) corresponding to the fovea centralis region of the user's eye looking at the display (320). The second portion of the image may correspond to a FoV corresponding to a paracentral region relative to the fovea centralis region of the user's eye. The third portion of the image may correspond to a FoV corresponding to the macula region of the user's eye.

[0265] According to one embodiment, the method may include an operation of displaying a test image for identifying a user's type of vision through the display (320). The method may include an operation of identifying at least one color among the colors as a first color and a second color based on receiving a first input regarding the test image. The method may include an operation of identifying at least one color among the colors as a third color different from the first color and the second color based on receiving a second input regarding the test image.

[0266] According to one embodiment, the colors may include red, green, and blue. The first color identified based on receiving the first input indicating that the type of vision of the user is myopia may be the blue color. The second color identified based on receiving the first input indicating that the type of vision of the user is myopia may be the green color. The third color identified based on receiving the second input indicating that the type of vision of the user is hyperopia may be the red color.

[0267] As described above, a non-transient computer-readable storage medium may store one or more programs including instructions that cause the electronic device (300) to identify at least one color of an image to be displayed through the display (320) when executed individually or collectively by at least one processor (310) of the electronic device (300) having a display (320). The non-transient computer-readable storage medium may store one or more programs including instructions that cause the electronic device (300) to determine a first part of the image, a second part surrounding the first part, and a third part surrounding the second part when executed individually or collectively by the at least one processor (310). The above non-transient computer-readable storage medium may store one or more programs including instructions that, when executed individually or collectively by the at least one processor (310), cause the electronic device (300) to display the image including the first part, the second part, and the third part through the display (320) by blurring the at least one color of the colors of the second part with a first intensity and blurring the at least one color of the colors of the third part with a second intensity higher than the first intensity.

[0268] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0269] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0270] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0271] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0272] Various embodiments of the present document may be implemented as software (e.g., program (1040)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1036) or external memory (1038)) readable by a machine (e.g., electronic device (1001)). For example, a processor (e.g., processor (1020)) of the machine (e.g., electronic device (1001)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0273] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0274] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device, Memory that stores instructions and includes one or more storage media; At least one processor including a processing circuit; and Includes a display, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Identifying at least one color among the colors of an image to be displayed through the above display; Determining a first part of the above image, a second part surrounding the first part, and a third part surrounding the second part; and By blurring at least one color among the colors of the second part with a first intensity and blurring at least one color among the colors of the third part with a second intensity higher than the first intensity, the image including the first part, the second part, and the third part is caused to be displayed through the display. Electronic device.

2. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: By bypassing blurring the colors of the first part, bypassing blurring at least one other color different from at least one color among the colors of the second part, and bypassing blurring at least one other color among the colors of the third part, thereby causing the image including the first part, the second part, and the third part to be displayed through the display. Electronic device.

3. In Claim 1, The first portion of the above image corresponds to the field of view (FoV) according to the fovea centralis region of the user's eye looking at the display, and The second portion of the above image corresponds to the FoV according to the paracentral region relative to the foveal region of the user's eye, and The third part of the above image corresponds to the FoV according to the macula region of the user's eye, Electronic device.

4. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: A test image for identifying the user's type of vision is displayed through the display; Based on receiving a first input regarding the above test image, at least one color among the colors is identified as a first color and a second color; and Based on receiving a second input regarding the above test image, causing at least one color among the colors to be identified as a third color different from the first color and the second color, Electronic device.

5. In Claim 4, The above colors include red, green, and blue, The first color identified based on receiving the first input indicating that the type of vision of the user is myopia is the blue color, and The second color identified based on receiving the first input indicating that the type of vision of the user is myopia is the green color, and The third color identified based on receiving the second input indicating that the type of vision of the user is hyperopia is the red color, Electronic device.

6. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Acquire data indicating the user's gaze direction; Identifying the line of sight identified based on the above data; and Causing to determine the first part, the second part, and the third part using concentric circles formed with respect to a central position corresponding to the identified line of sight direction, Electronic device.

7. In Claim 6, The electronic device is a head-worn electronic device worn by the user, and The above data is obtained from at least one sensor for ET (eye-tracking) of the head-worn electronic device, Electronic device.

8. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: By determining color data for at least one color among the colors of the first pixel of the second part based on color data for at least one color among the colors of the second pixels within a pixel window defined with respect to the first pixel, the at least one color among the colors of the second part is blurred with the first intensity; and By determining color data for at least one color among the colors of the third pixel of the third part based on color data for at least one color among the colors of the fourth pixels within the pixel window defined with respect to the third pixel, thereby causing at least one color among the colors of the third part to be blurred to the second intensity. Electronic device.

9. In Claim 8, The color data for the at least one color of the first pixel is determined according to at least one of an average blur, a Gaussian blur, an intermediate filtering, or a bilateral filter regarding the color data for the at least one color of the second pixels. Electronic device.

10. In claim 8, The size of the pixel window defined with respect to the first pixel and the size of the pixel window defined with respect to the third pixel are identical to each other, and The size of the pixel window is determined based on the size of the user's eye, the size of the pupil of the eye, and the distance from the eye to the display. Electronic device.

11. In Claim 10, The first intensity is determined based on the size of the pixel window and a first coefficient for blurring, and The second intensity is determined based on a second coefficient greater than the first coefficient for the size of the pixel window and blur, Electronic device.

12. In Claim 11, The first coefficient is determined based on the distance from the center position of the first part to the first pixel, and The second coefficient is determined based on the distance from the center position of the first part to the third pixel, Electronic device.

13. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device: Execute a mode to alleviate the user's myopia; and Based on the above-executed mode, by blurring the at least one color of the second part with the first intensity and blurring the at least one color of the third part with the second intensity, the image is caused to be displayed through the display, Each of the first intensity and the second intensity is adjusted based on at least one of the display time of the display or the distance from the user's eye to the display. Electronic device.

14. In Claim 1, The image above is: The second and third parts of the above image are blurred images, or An image generated by the synthesis of an additional image superimposed on the original image, wherein the portions corresponding to the second portion and the third portion are blurred, and the original image. Electronic device.

15. A method performed by an electronic device having a display, An operation to identify at least one color among the colors of an image to be displayed through the above display; An operation to determine a first part of the above image, a second part surrounding the first part, and a third part surrounding the second part; and The method comprises the operation of displaying the image including the first part, the second part, and the third part through the display by blurring at least one color among the colors of the second part with a first intensity and blurring at least one color among the colors of the third part with a second intensity higher than the first intensity. method.