Electronic device, method, and non-transitory computer-readable storage medium for displaying image on basis of foveated rendering

Abstract

A head wearable electronic device may comprise: a memory storing instructions; at least one processor including processing circuitry; and a display including a display area. The instructions, when individually or collectively executed by the at least one processor, may cause the head wearable electronic device to: identify text information of an image to be displayed on the display area of the display; determine, according to the text information, the size of a central portion of the image to be displayed at a first resolution; render, at the first resolution, the central portion of the image having the size determined according to the text information; and render, at a second resolution that is lower than the first resolution, a peripheral portion of the image surrounding the central portion of the image, thereby displaying the image on the display area on the basis of executed foveated rendering.

Description

Electronic device, method, and non-transient computer-readable storage medium for displaying an image based on foveated rendering

[0001] The following descriptions relate to an electronic device, a method, and a non-transient computer-readable storage medium for displaying an image based on foveated rendering.

[0002] The electronic device may include a display. For example, the electronic device may include a wearable device worn on a part of a user's body. For example, the part of the body may include a head. For example, the wearable device may include a head-wearable electronic device.

[0003] The above display may be used to display an image. The display may include a display panel and a display driving circuit. For example, light emitted from the display (or the display panel) may be provided to the user (or the user's eyes).

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] A head-worn electronic device may include a memory that stores instructions and includes one or more storage media. The head-worn electronic device may include at least one processor that includes a processing circuit. The head-worn electronic device may include a display that includes a display area. The instructions may cause the head-worn electronic device to identify text information of an image to be displayed on the display area of ​​the display when the at least one processor is executed individually or collectively. The instructions may cause the head-worn electronic device to determine the size of a central portion of the image to be displayed at a first resolution according to the text information when the at least one processor is executed individually or collectively. The above instructions may cause the head-worn electronic device to display the image on the display area based on a foveated rendering executed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution.

[0006] A method performed by a head-worn electronic device may include an operation of identifying text information of an image to be displayed on a display area of ​​a display of the head-worn electronic device. The method may include an operation of determining the size of a central portion of the image to be displayed at a first resolution according to the text information. The method may include an operation of displaying the image on the display area based on a foveated rendering performed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering a peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution.

[0007] A non-transient computer-readable storage medium may store one or more programs including instructions that cause the head-wearing electronic device to identify text information of an image to be displayed on the display area of ​​the display when executed individually or collectively by at least one processor of the head-wearing electronic device having a display including a display area. The non-transient computer-readable storage medium may store one or more programs including instructions that cause the head-wearing electronic device to determine the size of a central portion of the image to be displayed at a first resolution according to the text information when executed individually or collectively by the at least one processor. The above non-transient computer-readable storage medium may store one or more programs comprising instructions that, when executed individually or collectively by the at least one processor, cause the head-worn electronic device to display the image on the display area based on a foveated rendering executed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution.

[0008] A head-worn electronic device may include a memory that stores instructions and includes one or more storage media. The head-worn electronic device may include at least one processor that includes a processing circuit. The head-worn electronic device may include a display that includes a display area. The instructions may cause the head-worn electronic device to identify the number of characters in an image to be displayed on the display area of ​​the display, based on the execution of foveated rendering, when the at least one processor is executed individually or collectively. The instructions may cause the head-worn electronic device to determine the size of the central portion of the image to be displayed at a first resolution as a first size, based on the number of characters less than a reference number, when the at least one processor is executed individually or collectively. The above instructions may cause the head-worn electronic device to display the image on the display area by rendering the central part of the image having the first size at the first resolution according to the number of characters less than the reference number, and rendering the peripheral part of the image surrounding the central part of the image having the first size at a second resolution lower than the first resolution, when the at least one processor is executed individually or collectively. The above instructions may cause the head-worn electronic device to determine the size of the central part of the image to be displayed at the first resolution as a second size larger than the first size according to the number of characters greater than or equal to the reference number.The above instructions may cause the head-worn electronic device to display the image on the display area by rendering the central part of the image having the second size at the first resolution and the peripheral part of the image surrounding the central part of the image having the second size at the second resolution, depending on the number of characters having more than the reference number, when the at least one processor is executed individually or collectively.

[0009] Figure 1 illustrates an example of a head-worn electronic device worn by a user.

[0010] Figure 2a illustrates an example of foveated rendering based on eye tracking.

[0011] FIG. 2b illustrates an example of foveated rendering based on a fixed position.

[0012] Figure 3 is a schematic view of an exemplary head-worn electronic device.

[0013] FIG. 4 illustrates an example of a flow of operations for determining the size of the central part of an image and the resolution of the peripheral part of an image, and performing foveated rendering using the determined size and resolution.

[0014] Figure 5 illustrates an example of an image in which foveated rendering was not performed.

[0015] FIG. 6 illustrates an example of an image based on foveated rendering using a predetermined size and a predetermined resolution.

[0016] FIG. 7a illustrates an example of an image based on foveated rendering using a size determined by text information.

[0017] FIG. 7b illustrates an example of a method for determining the size of the central part of an image based on text information.

[0018] FIG. 8 illustrates an example of an image based on foveated rendering that uses a resolution determined by a spatial information value or a deviation value for the grayscale levels of the image.

[0019] FIG. 9 illustrates an example of a method for performing foveated rendering using a size and resolution determined by the speed of movement of a head-worn electronic device.

[0020] FIG. 10 is a block diagram of an electronic device in a network environment according to various embodiments.

[0021] FIG. 11 is a block diagram of a display module according to various embodiments.

[0022] FIG. 12a illustrates an example of a perspective view of an electronic device. FIG. 12b illustrates an example of one or more hardware components arranged within the electronic device.

[0023] FIGS. 13a and FIGS. 13b illustrate an example of the appearance of an electronic device.

[0024] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of this disclosure. A singular expression may include a plural expression unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art described in this disclosure. Terms used in this disclosure that are defined in a general dictionary may be interpreted as having the same or similar meaning as they have in the context of the relevant technology, and are not to be interpreted in an ideal or overly formal sense unless explicitly defined in this disclosure. In some cases, even terms defined in this disclosure are not to be interpreted to exclude the embodiments of this disclosure.

[0025] In the various embodiments of the present disclosure described below, a hardware-based approach is described as an example. However, since the various embodiments of the present disclosure include techniques using both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0026] Additionally, in this disclosure, expressions of "greater than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled; however, this is merely for the purpose of expressing an example and does not exclude descriptions of "greater than" or "less than." Conditions described as "greater than" may be replaced with "greater than," conditions described as "less than" may be replaced with "less than," and conditions described as "greater than and less than" may be replaced with "greater than and less than." Furthermore, "A" to "B" below refer to at least one of the elements from A (including A) to B (including B).

[0027] Figure 1 illustrates an example of a head-worn electronic device worn by a user.

[0028] FIG. 1 illustrates an example of a head-wearing electronic device (101) worn by a user (100). For example, the head-wearing electronic device (101) may be worn on a part of the user's body. For example, said part of the body may include the user's head. By example, without limitation, the head-wearing electronic device (101) may have the form of glasses that are wearable on the user's head. For example, the head-wearing electronic device (101) may be an example of the electronic device (1001) of FIG. 10. The head-wearing electronic device (101) may include at least some of the components of the electronic device (1001) of FIG. 10. For example, the head-wearing electronic device (101) may be an example of the electronic device (101) of FIG. 12a through FIG. 13b.

[0029] For example, a head-worn electronic device (101) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to a user wearing the head-worn electronic device (101). For example, an image (or visual object, visual effect, virtual object) representing augmented reality, virtual reality, or mixed reality may be displayed through a display panel (110) of the head-worn electronic device (101). For example, the display panel (110) may include pixels. Each of the pixels may include subpixels. The subpixels may include a first subpixel configured to emit light in a first color (e.g., green), a second subpixel configured to emit light in a second color (e.g., blue), and a third subpixel configured to emit light in a third color (e.g., red). As a non-limiting example, the above subpixels may further include a fourth subpixel configured to emit light in a fourth color (e.g., white).

[0030] For example, light emitted from a display panel (110) to display the image may be transmitted toward a lens (105) of a head-worn electronic device (101). For example, the lens (105) may be referred to as an imaging lens. For example, the lens (105) may be positioned within the head-worn electronic device (101) in the path of the light emitted from the display panel (110). For example, the lens (105) may be spaced apart from the display panel (110). For example, the display panel (110) and the lens (105) may be referred to as a display device.

[0031] For example, the lens (105) may be positioned in front of the eye (100a) of a user (100) wearing the head-worn electronic device (101). For example, the lens (105) may be configured to transmit light emitted from the display panel (110) toward the user's (100) eye (100a) by refracting it. For example, the display panel (110) may be positioned with respect to (or corresponding to) the eye (100a) of the user (100) wearing the head-worn electronic device (101).

[0032] In FIG. 1, for convenience of explanation, one eye (100a) of the user (100), one lens (105) corresponding to the eye (100a), and one display panel (110) corresponding to the lens (105) are shown, but the present disclosure is not limited thereto. For example, a head-worn electronic device (101) may include lenses (e.g., two lenses) corresponding to each of the user's (100) eyes, and display panels (e.g., two display panels) configured to emit light toward each of the lenses. Hereinafter, for convenience of explanation, one display panel (110) and a lens (105) are described.

[0033] For example, a display panel (110) may include a display area (120). For example, the display area (120) may be an area of ​​the display panel (110) on which an image rendered from a head-worn electronic device (101) is displayed. For example, the display area (120) may include a center area (121) and a peripheral area (122). For example, the center area (121) may be a part of the display area (121) that includes a center point (or center position) of the display area (120). The center area (121) may be referred to as a foveated area. For example, the peripheral area (122) may be a part of the display area (121) that surrounds (or is located around) the center area (121) of the display area (120). In FIG. 1, for convenience of explanation, a display area (120) including one surrounding area (122) is illustrated, but the present disclosure is not limited thereto. For example, the display area (120) may include a plurality of surrounding areas.

[0034] Referring to FIG. 1, the central area (121) and the peripheral area (122) of the display area (120) are illustrated as being fixed, but the present disclosure is not limited thereto. For example, the size of the central area (121) of the display area (120) may be adjusted according to the size of the part of the image (or, the rendered image) to be displayed in the central area (121) (hereinafter, the central part). In other words, the size of the central area (121) may correspond to the size of the central part of the image. For example, the size of the peripheral area (122) of the display area (120) may be adjusted according to the size of the part of the image (or, the rendered image) to be displayed in the peripheral area (122) (hereinafter, the peripheral part) (or the size of the central part of the image to be displayed in the central area (121)). In other words, the size of the peripheral area (122) may correspond to the size of the peripheral part of the image.

[0035] As a non-limiting example, at least one processor of the head-worn electronic device (101) (e.g., at least one processor (310) of FIG. 3) may generate the rendered image. As a non-limiting example, a display driving circuit of the head-worn electronic device (101) (e.g., a display driving circuit (320) of FIG. 3) may generate the rendered image. As a non-limiting example, a display of the head-worn electronic device (101) (e.g., a display (330) of FIG. 3) may generate the rendered image.

[0036] As exemplified in FIG. 1, the central portion of the rendered image to be displayed on the central area (121) and the peripheral area (122) of the display panel (110) may be rendered at a high resolution, and the peripheral portion of the rendered image may be rendered at a low resolution. A technique of rendering with different resolutions within a single image in this way may be referred to as foveated rendering. For example, the foveated rendering may be a technique that utilizes the low recognition ability of the user (100)'s eye (100a) to an area (e.g., peripheral area (122)) other than the area where the eye's gaze direction is located (e.g., central area (121)). When the head-worn electronic device (101) renders an image using the foveated rendering, efficient computation (or reduction in power consumption) can be performed while maintaining the user experience level of the user (100).

[0037] For example, in foveated rendering, the central part (or the central area (121) of the display area (120)) may be determined according to the direction of gaze of the user's (100) eye (100a). Foveated rendering in which the central part is determined according to the direction of gaze may be referred to as dynamic foveated rendering, recognition-based foveated rendering, or eye-tracking foveated rendering. An example of dynamic foveated rendering may be referred to in FIG. 2a below.

[0038] Alternatively, for example, in foveated rendering, the central part (or the central area (121) of the display area (120)) may be fixed regardless of the gaze direction of the user's (100) eye (100a). Foveated rendering in which the central part is fixed may be referred to as static foveated rendering or fixed foveated rendering. An example of static foveated rendering may be referred to in FIG. 2b below.

[0039] Figure 2a illustrates an example of foveated rendering based on eye tracking.

[0040] FIG. 2a illustrates an example of dynamic foveated rendering based on eye tracking. Referring to FIG. 2a, an image (200) rendered based on foveated rendering when the user's gaze direction (210) is at a first position and an image (205) rendered based on foveated rendering when the user's gaze direction (210) is at a second position different from the first position are shown. For example, the gaze direction (210) may be the direction in which the user's (100) eye (100a) (or pupil) points. As an example without limitation, the gaze direction (210) may be identified based on sensing data obtained using a camera (or at least one sensor) of a head-worn electronic device (101).

[0041] For example, when the viewing direction (210) is the first position, the image (200) may include a central part (221) and a peripheral part (222). For example, a head-worn electronic device (101) may render the central part (221) at a first resolution and render the peripheral part (222) at a second resolution lower than the first resolution. For example, the head-worn electronic device (101) may display the image (200) including the central part (221) rendered at the first resolution and the peripheral part (222) rendered at the second resolution on a display area of ​​a display panel (110) (e.g., the display area (120) of FIG. 1). For example, the central part (221) may be displayed on the central area (121) of the display area (120). For example, the surrounding portion (222) can be displayed on the surrounding area (122) of the display area (120).

[0042] For example, the first resolution may indicate that the number of pixels used to represent (or display) the unit area of ​​the image (200) is a first number. Alternatively, the second resolution may indicate that the number of pixels used to represent (or display) the unit area of ​​the image (200) is a second number, which is higher than the first number. As a non-limiting example, the first resolution may represent the unit area using 16 pixels, and the second resolution may represent the unit area using 32 pixels. Since the number of pixels of the display panel (110) used to represent the first resolution and the second resolution is the same (or fixed, maintained), the number of pixels used to represent (or display) the unit area of ​​the image (200) may decrease as the resolution increases.

[0043] In the above example, the resolution is defined using the number of pixels used to represent a unit area, but the present disclosure is not limited thereto. For example, the resolution may be defined using the compression rate of the data used to generate the image (200). For example, the first resolution may indicate that the compression rate of the data used to generate the image (200) is the first compression rate. Alternatively, the second resolution may indicate that the compression rate of the data used to generate the image (200) is the second compression rate, which is higher than the first compression rate. Alternatively, the resolution may be defined through the difference in color difference (U, V in YUV) compression (or chroma subsampling). For example, the first resolution may have a color difference compression difference of 4:4:4. Alternatively, the second resolution may have a color difference compression difference of 4:2:0. Alternatively, the resolution may be defined through the difference in color gamut. For example, the first resolution can be expressed through a color space based on BT.2020. Alternatively, the second resolution can be expressed through a color space based on REC.709. Or, the resolution can be defined through a difference in dynamic range (DR). For example, the first resolution can be expressed through HDR (high dynamic range). For example, the second resolution can be expressed through SDR (static dynamic range).

[0044] Referring to the above description, the central part (221) of the image (200) can be perceived more clearly by the user (100) as it is rendered at the first resolution which is relatively high. In contrast, the peripheral part (222) of the image (200) can be perceived more blurry by the user (100) as it is rendered at the second resolution which is relatively low. In the above example as well, the user (100) may not perceive the low resolution of the peripheral part (222) due to dynamic foveated rendering performed based on eye tracking.

[0045] For example, when the line of sight (210) is the second position, the image (205) may include a central part (231) and a peripheral part (232). By example, without limitation, the second position may be a position moved to the right from the first position. For example, the head-worn electronic device (101) may render the central part (231) at the first resolution and render the peripheral part (232) at the second resolution. For example, the head-worn electronic device (101) may display the image (205) including the central part (231) rendered at the first resolution and the peripheral part (232) rendered at the second resolution on a display area of ​​the display panel (110) (e.g., the display area (120) of FIG. 1). For example, the central part (231) may be displayed on the central area (121) of the display area (120). For example, the peripheral area (232) may be displayed on the peripheral area (122) of the display area (120). The location of the central area (121) and peripheral area (122) of the display area (120) when displaying the image (205) may be different from the location of the central area (121) and peripheral area (122) of the display area (120) when displaying the image (200).

[0046] As described above, when using foveated rendering based on eye tracking (or dynamic foveated rendering), the head-worn electronic device (101) may acquire data using a camera (or at least one sensor) to continuously track the gaze of the user (100). The head-worn electronic device (101) may track the direction in which the user (100) gazes (or gaze direction) by processing the acquired data, and render an image according to the result of the tracking. In one example, the head-worn electronic device (101) may distinguish the image to be displayed into multiple parts based on the user's (100) gaze direction and render each distinguished part at a different resolution. In the above example, the distinguished parts of the image may be distinguished according to the optical characteristics of the lens (105) of the head-worn electronic device (101). As an example without limitation, the optical characteristics may include a modulation transfer function (MTF). As the user (100) tracks the direction of their gaze and performs further actions to process images based on the tracking results, the power consumption of the head-worn electronic device (101) may increase. For more efficient operation in terms of power consumption of the head-worn electronic device (101), the head-worn electronic device (101) may perform static foveated rendering and display images.

[0047] FIG. 2b illustrates an example of foveated rendering based on a fixed position.

[0048] FIG. 2b illustrates an example of static foveated rendering based on a fixed position. Referring to FIG. 2b, an image (250) is shown that includes a central part (261) having a fixed position and a peripheral part (262) surrounding the central part, regardless of the user's viewing direction, with reference to FIG. 2a.

[0049] For example, the image (250) may include a central portion (261) and a peripheral portion (262). For example, the head-worn electronic device (101) may render the central portion (261) at the first resolution and render the peripheral portion (262) at the second resolution. At this time, the central portion (261) may be fixed within the image (250) regardless of the user's (100) gaze direction. For example, the central portion (261) may be a part of the image (250) that includes the central point (or central location) of the image (250). Hereinafter, the central portion of the image is exemplified as a part of the image that includes the central point (or central location) of the image, but the present disclosure is not limited thereto. For example, the central portion of the image may be a part of the image that includes a point other than the central point (or central location) of the image. For example, the aforementioned points other than the center point (or center location) of the image may be biased in a specific direction (e.g., up, down, left, right) within the image. The central part of the image containing the aforementioned points may be referred to as the main portion of the image. In this case, the peripheral part of the image may be referred to as the sub portion of the image.

[0050] For example, a head-worn electronic device (101) may display an image (250) comprising a central portion (261) rendered at the first resolution and a peripheral portion (262) rendered at the second resolution on a display area of ​​a display panel (110) (e.g., a display area (120) of FIG. 1). For example, the central portion (261) may be displayed on the central area (121) of the display area (120). For example, the peripheral portion (262) may be displayed on the peripheral area (122) of the display area (120).

[0051] Referring to FIGS. 2a and 2b, a head-worn electronic device (101) can perform static foveated rendering for low power consumption and display a rendered image. Hereinafter, the present disclosure may adjust the size of the central part of the image and adjust the resolution of the peripheral part of the image by using information of the image to be displayed when performing static foveated rendering. For example, the information of the image may include information about text included in the image (hereinafter, text information). For example, the information of the image may include spatial information values ​​representing the amount of change of brightness values ​​for displaying the image. For example, the information of the image may include edge information within the image. For example, the information of the image may include high-frequency object density within the image. For example, the information of the image may include deviation values ​​of grayscale levels for displaying the image. For example, the information of the image may include deviation values ​​of data voltages for displaying the image. Accordingly, the present disclosure can reduce the power consumption of the head-worn electronic device (101) while providing the user with substantially the same user experience as displaying an image in which foveated rendering has not been performed.

[0052] Figure 3 is a schematic view of an exemplary head-worn electronic device.

[0053] FIG. 3 illustrates an example of a head-worn electronic device (101). The head-worn electronic device (101) of FIG. 3 may be an example of the electronic device (1001) of FIG. 10. For example, the head-worn electronic device (101) may include at least a part of the electronic device (1001) or correspond to at least a part of it. The head-worn electronic device (101) of FIG. 3 may be an example of the electronic device (101) of FIG. 12a to FIG. 13b.

[0054] For example, the head-wearable electronic device (101) may be implemented in various form factors. For example, the head-wearable electronic device (101) may include a wearable device (or, HMD (head mounted display), head-wearable electronic device) that is worn on the user's head. For example, the wearable device may include an AR (augmented reality) device or a VR (virtual reality) device. However, the present disclosure is not limited thereto.

[0055] The head-worn electronic device (101) may include at least one processor (310), a display driving circuit (320), a display panel (110), a lens (105), and a memory (340). The components (e.g., at least one processor (310), a display driving circuit (320), a display panel (110), a lens (105), and a memory (340)) are merely exemplary. For example, the head-worn electronic device (101) may include other components (e.g., a power management integrated circuitry (PMIC), or a rechargeable battery). For example, some components may be omitted from the head-worn electronic device (101). For example, some components may be integrated into a single component.

[0056] At least one processor (310) may be implemented as one or more integrated circuitry (IC) chips and may perform various data processing operations. At least one processor (310) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory (340) individually or collectively in a distributed manner. At least one processor (310) may include a processor assembly including one or more processing circuits. At least one processor (310) may include any processing circuit that is operational to control the performance and operations of one or more components of the head-worn electronic device (101) (e.g., memory (340) and / or display (330)). For example, at least one processor (310) (e.g., application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or a set of chips). For example, at least one processor (310) may be implemented with multiple cores (or multiple core circuits), multiple chips, or multiple sets of chips. For example, at least one processor (310) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively.

[0057] For example, at least one processor (310) may include a central processing unit (e.g., including processing circuits) and a display processing unit (DPU) (e.g., including processing circuits). The components of at least one processor (310) (e.g., CPU and DPU) are merely exemplary. For example, at least one processor (310) may further include other components (e.g., a memory controller (or memory control circuit) for memory (340) and a storage controller (or storage control circuit) for memory (340). For example, some of the components of at least one processor (310) (e.g., DPU) may be omitted from at least one processor (310). For example, at least one processor (310) may further include a graphic processing unit (e.g., including processing circuits).

[0058] At least one processor (310) may cause other components of the head-worn electronic device (101) to perform various operations by executing instructions stored in memory (340). For example, a CPU (or central processing circuit) may be configured to control other components of at least one processor (310) (e.g., DPU) based on the execution of instructions stored in memory (340). For example, at least one processor (310) may include at least a part of the processor (1020) of FIG. 10 or correspond to at least a part of the processor (1020) of FIG. 10.

[0059] Memory (340) may include one or more storage media (or one or more storage devices). For example, memory (340) may include a memory assembly comprising one or more storage media. For example, the one or more storage media may include a hard drive, flash memory, permanent memory such as ROM (read-only memory), semi-permanent memory such as RAM (random access memory), any other suitable type of storage (or storage assembly), or any combination thereof. Memory (340) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the head-worn electronic device (101). As an example, but not limited to, the cache memory may be included within at least one processor (310). The memory (340) may be fixedly embedded within the head-worn electronic device (101) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) card) that can be repeatedly inserted into and removed from the head-worn electronic device (101). For example, the memory (340) may include at least a portion of the memory (1030) of FIG. 10 or correspond to at least a portion of the memory (1030) of FIG. 10.

[0060] For example, memory (340) may store one or more software applications, such as an operating system (or system software application), a firmware software application, a driver software application, a plugin (e.g., add-in, add-on, and / or applet) software application, and / or any other suitable software application. For example, the one or more software applications may include instructions executable by at least one processor (310). For example, memory (340) may store instructions that can be called by an application programming interface (API). For example, memory (340) may store instructions within a library.

[0061] A display (330) may be used for displaying an image. By example, without limitation, the display (330) may include a display driving circuit (320) and a display panel (110) for displaying an image. By example, without limitation, the display (330) may include a display driving circuit (320), a display panel (110), and a lens (105). In the example of FIG. 3, a head-worn electronic device (101) comprising one display panel (110) and one lens (105) is shown, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may include lenses (or two lenses) positioned respectively with respect to the user's eyes. The head-worn electronic device (101) may include display panels (or two display panels) configured to emit light toward the lenses respectively. Each of the display panels may include a display area. The above display area may include a plurality of pixels (each pixel includes subpixels).

[0062] The display driving circuit (320) may receive data for an image from at least one processor (310). The data may be transmitted from at least one processor (310) to the display driving circuit (320) via an interface. For example, the interface (e.g., including at least one circuit) may include a mobile industry processor interface (MIPI) (or may support MIPI). As an example, but not limited to, the interface may include a serial peripheral interface (SPI), a universal asynchronous receiver / transmitter (UART), an inter-integrated circuit (I2C), or an improved inter-integrated circuit (I3C). The display driving circuit (320) may be an example of the display driver IC (integrated circuitry) (1130) of FIG. 11. For example, the display driving circuit (320) may include at least a part of the display driver IC (1130) of FIG. 11 or correspond to at least a part of the display driver IC (1130) of FIG. 11.

[0063] The display panel (110) can display an image under the control of the display driving circuit (320). For example, the display panel (110) may include pixels within a display area. For example, each of the pixels may include subpixels. For example, each of the subpixels may include a driving transistor and a light-emitting element. For example, the display panel (110) can display an image according to the gate voltage and source voltage from the display driving circuit (320). For example, the display panel (110) may include at least a part of the display panel (1110) of FIG. 11 or correspond to at least a part of the display panel (1110) of FIG. 11.

[0064] The lens (105) can allow light emitted from the display panel (110) to pass through. The lens (105) can be used to provide said light to each of the user's eyes by passing the light emitted from the display panel (110). The lens (105) may be referred to as an optical element. As an example without limitation, the lens (105) may be formed in a circular shape.

[0065] For example, the head-worn electronic device (101) can perform foveated rendering (or static foveated rendering). For example, to perform foveated rendering, the head-worn electronic device (101) can determine the size of the central part of the image. As a non-limiting example, at least one processor (310) can determine the size of the central part of the image. As a non-limiting example, the display (330) (or display driving circuit (320)) can determine the size of the central part of the image. For example, to perform foveated rendering, the head-worn electronic device (101) can determine the resolution of the peripheral part of the image. As a non-limiting example, at least one processor (310) can determine the resolution of the peripheral part of the image. As a non-limiting example, the display (330) (or display driving circuit (320)) can determine the resolution of the peripheral part of the image. The head-worn electronic device (101) can render a central portion of an image having a determined size at a specific resolution and render a peripheral portion of the image at a determined resolution. For example, the specific resolution of the central portion of the image may be higher than the determined resolution of the peripheral portion. As an example without limitation, at least one processor (310) may perform the rendering of the central portion and the peripheral portion. As an example without limitation, a display (330) (or a display driving circuit (320)) may perform the rendering of the central portion and the peripheral portion. The head-worn electronic device (101) may display the rendered central portion and the rendered peripheral portion on a display area (e.g., a display area (120) of FIG. 1) of the display (330) (or a display panel (110)).

[0066] For example, at least one processor (310) can identify the display mode of the head-worn electronic device (101) (or display (330)). For example, if the display mode is the default display mode (or normal display mode), at least one processor (310) can refrain from (or stop, interrupt, bypass, or skip) performing foveated rendering. For example, if the display mode is the default display mode (or normal display mode), at least one processor (310) can render all areas within the image at the same resolution and display the rendered image. Specific details regarding this may be referenced below in FIGS. 4 and FIGS. 5. Alternatively, if the display mode is the foveated display mode (or foveated rendering mode), at least one processor (310) can perform foveated rendering. For example, at least one processor (310) can identify whether it is a first mode within foveated rendering or a second mode within foveated rendering. For example, the first mode may be a mode that renders a central part having a size determined according to text information of the image to be displayed and a peripheral part having a resolution determined according to information related to the image to be displayed. The first mode may be referred to as AM (advanced mode). For example, specific details regarding the first mode may be referenced below in FIGS. 4, 7a, 7b, and 8. For example, the second mode may be a mode that renders a central part having a predetermined size and a peripheral part having a predetermined resolution. The second mode may be referred to as DSM (developer setting mode). For example, specific details regarding the second mode may be referenced below in FIGS. 4 and 6.

[0067] For example, at least one processor (310) can identify text information of an image to be displayed on a display area of ​​a display (330) (or a display panel (110)). For example, the text information may include the number of characters (or texts) within the image to be displayed. The number of characters may be referred to as text density. As a non-limiting example, at least one processor (310) may perform optical character recognition (OCR) on the image to be displayed. For example, at least one processor (310) may identify the number of characters (and arrangement information of the characters) within the image based on the result of the OCR. Specific details regarding this may be referenced below in FIG. 7b. In the above example, at least one processor (310) is described as identifying the number of characters based on OCR, but the present disclosure is not limited thereto. For example, at least one processor (310) may identify the number of characters (and arrangement information of the characters) in the image by providing the image as input to a learned model (e.g., artificial intelligence model, statistical model) that is stored in memory (340). For example, at least one processor (310) may determine the size of the central part of the image according to the text information (or the number of characters). Specific details related to this may be referenced in FIG. 7a below.

[0068] For example, at least one processor (310) can identify spatial information values ​​of an image to be displayed on a display area of ​​a display (330) (or a display panel (110)). For example, the spatial information values ​​may represent values ​​indicating changes in brightness values ​​for displaying the image. For example, the spatial information values ​​may represent spatial information defined within the ITU-T (International Telecommunication Union Telecommunication Standardization Sector) P.910 standard. For example, at least one processor (310) may determine the resolution of a peripheral part of the image according to the spatial information values. Specific details regarding this may be referenced below in FIG. 8. In the above example, it is described as identifying spatial information values ​​of an image, but the present disclosure is not limited thereto. For example, at least one processor (310) may identify spatial information values ​​of the peripheral part of the image.

[0069] For example, at least one processor (310) can identify deviation values ​​for grayscale levels for displaying an image to be displayed on a display area of ​​a display (330) (or a display panel (110)). For example, the grayscale levels for displaying an image may represent the grayscale levels of lines constituting the image. For example, among the pixels constituting the image, pixels in a specific direction (e.g., horizontal direction) may be defined as a line (hereinafter, a first line). For example, a second line following the first line may be a line located after the first line with respect to a direction perpendicular to the specific direction (e.g., a vertical direction). For example, the second line may be defined by pixels in the specific direction in the same way as the first line. For example, at least one processor (310) can identify deviation values ​​for grayscale levels regarding the pixels of the first line and deviation values ​​for grayscale levels regarding the pixels of the second line. For example, at least one processor (310) can identify grayscale levels for pixels of the first line and grayscale levels for pixels of the second line. For example, at least one processor (310) can identify the difference between the grayscale levels for pixels of the first line and the grayscale levels for pixels of the second line (or the deviation value between the grayscale levels for pixels of the first line and the grayscale levels for pixels of the second line). For example, at least one processor (310) can determine the resolution of a peripheral part of an image according to the deviation value of the grayscale levels for displaying the image. For example, the deviation value of the grayscale levels for displaying the image may include a set of deviation values ​​for grayscale levels per line or a set of deviation values ​​between two lines.Specific details regarding this may be referenced in FIG. 8 below. In the above example, it is described as identifying deviation values ​​of the grayscale levels of an image, but the present disclosure is not limited thereto. For example, at least one processor (310) may identify deviation values ​​of the grayscale levels of the surrounding portion of the image.

[0070] In the above example, an example is described in which at least one processor (310) identifies deviation values ​​for grayscale levels for displaying an image to be displayed on a display area of ​​a display (330) (or, display panel (110)), and accordingly determines the resolution of a peripheral part of the image, but the present disclosure is not limited thereto. For example, the display (330) (or, display driving circuit (320)) may obtain grayscale data for grayscale levels for displaying an image from at least one processor (310). For example, the display (330) (or the display driving circuit (320)) can identify data voltages for displaying an image based on the grayscale data. For example, the display (330) (or the display driving circuit (320)) can identify deviation values ​​for the data voltages for displaying an image. For example, the data voltages for displaying an image may represent data voltages to be applied to pixel lines constituting the display panel (110). For example, among the plurality of pixels (or subpixels) included in the display panel (110), pixels in the specific direction (e.g., horizontal direction) may be defined as a single pixel line (hereinafter, the first pixel line). In the above example, the pixel line may be referred to as the H (horizontal) line. For example, the second pixel line following the first pixel line may be a pixel line located after the first pixel line with respect to a direction perpendicular to the specific direction (e.g., vertical direction). For example, The second pixel line may be defined by pixels of the display panel (110) in the same way as the first pixel line (e.g., horizontal direction). As a non-limiting example, the pixels of the image to be displayed may correspond to the pixels of the display panel (110) to display the image.In other words, a line containing pixels constituting an image (e.g., a first line) may correspond to a pixel line containing pixels constituting a display panel (110) (e.g., a first pixel line). However, the present disclosure is not limited thereto. For example, the display (330) (or, display driving circuit (320)) can identify the deviation values ​​of the data voltages for the pixels of the first pixel line and the deviation values ​​of the data voltages for the pixels of the second pixel line. For example, the display (330) (or, display driving circuit (320)) can identify the data voltages for the pixels of the first pixel line and the data voltages for the pixels of the second pixel line. For example, the display (330) (or, display driving circuit (320)) can identify the difference between the data voltages for the pixels of the first pixel line and the data voltages for the pixels of the second pixel line (or the deviation values ​​of the data voltages for the pixels of the first pixel line and the data voltages for the pixels of the second pixel line). For example, the display (330) (or, display driving circuit (320)) can determine the resolution of the peripheral portion of the image according to the deviation values ​​of the data voltages for displaying the image. For example, to display the image The deviation values ​​of the data voltages for this purpose may include a set of deviation values ​​of the data voltages per pixel line or a set of deviation values ​​between two pixel lines. Specific details regarding this may be referenced in FIG. 8 below. In the above example, the deviation values ​​of the data voltages of an image are described as being identified, but the present disclosure is not limited thereto. For example, the display (330) (or, the display driving circuit (320)) may identify the deviation values ​​of the data voltages of the surrounding portion of the image.

[0071] For example, at least one processor (310) (or, GPU (graphic processing unit), DPU (display processing unit)) can identify the edge density of an image. For example, the edge density may represent the density of edges contained within the image. For example, if visual objects (e.g., people, things, text) are contained within the image, the edges may represent the boundaries (or boundary lines) of the visual objects. For example, at least one processor (310) may determine the resolution of the peripheral portion of the image based on the edge density. In the above example, it is described as identifying the edge density of the image, but the present disclosure is not limited thereto. For example, at least one processor (310) may identify the edge density of the peripheral portion of the image. Additionally, at least one processor (310) may determine the size of the central portion of the image based on the edge density. As a non-limiting example, at least one processor (310) may increase the size of the central part of the image when the edge density is greater than or equal to a first reference value. As a non-limiting example, at least one processor (310) may increase the resolution of the peripheral part of the image when the edge density is greater than or equal to a second reference value. As a non-limiting example, at least one processor (310) may increase the size of the central part of the image and increase the resolution of the peripheral part of the image when the edge density is greater than or equal to a third reference value. In the above example, the first reference value, the second reference value, and the third reference value may be set to different values ​​or at least partially identical values.

[0072] For example, at least one processor (310) can identify the high-frequency object density of an image. For example, the high-frequency object density may represent the density of high-frequency objects contained within the image. For example, high-frequency objects may represent objects formed by high frequencies greater than a reference frequency contained within the image. As an example without limitation, the high-frequency objects may include text having a small font size contained within the image. For example, at least one processor (310) may determine the resolution of a peripheral portion of the image according to the high-frequency object density. In the above example, it is described as identifying the high-frequency object density of the image, but the present disclosure is not limited thereto. For example, at least one processor (310) may identify the high-frequency object density of the peripheral portion of the image. Additionally, at least one processor (310) may determine the size of a central portion of the image according to the high-frequency object density. As a non-limiting example, at least one processor (310) may increase the size of the central portion of the image when the high-frequency object density is greater than or equal to a first reference value. As a non-limiting example, at least one processor (310) may increase the resolution of the peripheral portion of the image when the high-frequency object density is greater than or equal to a second reference value. As a non-limiting example, at least one processor (310) may increase the size of the central portion of the image and increase the resolution of the peripheral portion of the image when the high-frequency object density is greater than or equal to a third reference value. In the above example, the first reference value, the second reference value, and the third reference value may be set to different values ​​or at least partially identical values.

[0073] For example, at least one processor (310) can identify the speed of movement of the head-worn electronic device (101). For example, at least one processor (310) can identify the speed of movement of the head-worn electronic device (101) (or the head portion of the user (100) wearing the head-worn electronic device (101)) by using at least one sensor (e.g., an accelerometer or a gyroscope) included in the head-worn electronic device (101). Examples, without limitation, include rotational movement or linear movement of the head-worn electronic device (101). For example, at least one processor (310) can determine the resolution of the peripheral portion of the image according to the speed of movement of the head-worn electronic device (101). Additionally, at least one processor (310) can determine the size of the central portion of the image according to the speed of movement of the head-worn electronic device (101). As a non-limiting example, at least one processor (310) may reduce the size of the central part of the image when the speed of movement of the head-worn electronic device (101) is greater than or equal to a first reference value. However, the present disclosure is not limited thereto. As a non-limiting example, at least one processor (310) may increase the size of the central part of the image when the speed of movement of the head-worn electronic device (101) is greater than or equal to a first reference value in order to increase the probability of user recognition. As a non-limiting example, at least one processor (310) may reduce the resolution of the peripheral part of the image when the speed of movement of the head-worn electronic device (101) is greater than or equal to a second reference value. As a non-limiting example, at least one processor (310) may reduce the size of the central part of the image and reduce the resolution of the peripheral part of the image when the speed of movement of the head-worn electronic device (101) is greater than or equal to a third reference value.In the above example, the first reference value, the second reference value, and the third reference value may be set to different values ​​or at least partially identical values. Specific details regarding the method of changing the size of the central part of the image according to the speed of movement of the head-worn electronic device (101) may be referenced below in FIG. 9.

[0074] As described above, at least one processor (310) can control a display (330) (or a display driving circuit (320)) to determine the size of the central part of an image and the resolution of the peripheral part, and then render the central part according to the determined size and render the peripheral part with the determined resolution. For example, the display (330) (or a display driving circuit (320)) can render the central part and the peripheral part and display the rendered image. The display (330) (or a display driving circuit (320)) can transmit (or provide) information about the rendered image (e.g., the size of the rendered central part and the resolution of the rendered peripheral part) to at least one processor (310). In one example, instead of at least one processor (310) determining the size of the central part of the image and the resolution of the peripheral part, the display (330) (or a display driving circuit (320)) may directly determine the size of the central part of the image and the resolution of the peripheral part. In this case as well, the display (330) (or the display driving circuit (320)) may transmit (or provide) information about the rendered image (e.g., the size of the rendered central part and the resolution of the rendered peripheral part) to at least one processor (310) in order to inform at least one processor of information about the foveated rendering.

[0075] Referring to the above description, the head-worn electronic device (101) can determine the size of the central part of the image to be displayed and the resolution of the peripheral part in static foveated rendering, render the image to be displayed based on the determined size and the determined resolution, and display the rendered image. Specific examples of how the head-worn electronic device (101) displays an image depending on whether foveated rendering is performed and the mode of foveated rendering may be referenced in FIGS. 4 to 9 below.

[0076] FIG. 4 illustrates an example of a flow of operations for determining the size of the central part of an image and the resolution of the peripheral part of an image, and performing foveated rendering using the determined size and resolution.

[0077] At least some of the above methods of FIG. 4 may be performed by the head-wearing electronic device (101) of FIG. 3. For example, at least some of the above methods may be configured to be performed (or controlled) by at least one processor (310) of the head-wearing electronic device (101). In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel. Also, for example, at least some of the above methods may be configured to be performed by at least one processor (310) of the head-wearing electronic device (101), and at least other parts of the above methods may be configured to be performed by the display (330) (or display driving circuit (320)) of the head-wearing electronic device (101).

[0078] Referring to FIG. 4, in operation (400), the head-worn electronic device (101) may generate an image. For example, the image may be an image to be displayed on a display area of ​​the display (330) (or display panel (110)) of the head-worn electronic device (101). In an example, without limitation, the head-worn electronic device (101) may receive data for an image from a software application and generate an image based on the received data. In an example, without limitation, the head-worn electronic device (101) may identify an image (or data for a stored image) stored in the head-worn electronic device (101) (or memory (340)) and generate an image. For example, in the present disclosure, an image may be referred to as a frame, a frame image, or a video frame.

[0079] In operation (405), the head-worn electronic device (101) can determine whether foveated rendering is executed. For example, the head-worn electronic device (101) can identify whether the foveated rendering function is enabled. As an example without limitation, the foveated rendering function may be enabled according to user input for setting the head-worn electronic device (101). As an example without limitation, the user input may include input regarding a screen displayed through the head-worn electronic device (101), or a gesture of a user wearing the head-worn electronic device (101). For example, the head-worn electronic device (101) may determine that foveated rendering is executed when the foveated rendering function is enabled. For example, the head-worn electronic device (101) may determine that foveated rendering is not executed when the foveated rendering function is disabled. Alternatively, the foveated rendering function may be enabled according to the contents within the generated image. For example, if a portion of the content within the image is expected to be primarily perceived by a user wearing the head-worn electronic device (101) (e.g., a game screen, a web page screen, a book screen), the foveated rendering function may be activated. In other words, the head-worn electronic device (101) can activate or deactivate the foveated rendering function without user input (or automatically).

[0080] In operation (405), the head-worn electronic device (101) can perform operation (410) if the foveated rendering is not performed. In operation (405), the head-worn electronic device (101) can perform operation (415) if the foveated rendering is performed.

[0081] Referring to FIG. 4, the head-worn electronic device (101) is shown to determine whether foveated rendering is performed in operation (405) after generating an image in operation (400), but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may perform operation (400) after performing operation (405), or may perform operation (400) and operation (405) substantially simultaneously.

[0082] In operation (410), the head-worn electronic device (101) may display an image at a first resolution. For example, the head-worn electronic device (101) may display an image at the first resolution based on determining that foveated rendering has not been performed. For example, based on determining that foveated rendering has not been performed, the head-worn electronic device (101) may display an image at the first resolution within a normal display mode. For example, displaying an image at the first resolution may include displaying an image having the same first resolution regardless of parts of the image. The first resolution is merely illustrative for convenience of explanation and is not limited thereto. In other words, an image displayed within the normal display mode may have the same resolution regardless of parts of the image. For example, an example of an image having the same resolution regardless of parts of the image is illustrated and described with reference to FIG. 5.

[0083] Figure 5 illustrates an example of an image in which foveated rendering was not performed.

[0084] FIG. 5 illustrates an example of an image (500) for which foveated rendering has not been performed. For example, the image (500) may be an image that is displayed on a head-worn electronic device (101) (or a display (330), display panel (110)) when foveated rendering is not performed. For example, the image (500) may be displayed within the normal display mode. The image (500) may be referred to as a base image or a normal image.

[0085] Referring to FIG. 5, the image (500) may include a first part (501) and a second part (502). For example, the first part (501) may be included in the central part of the image (500). By example, without limitation, the first part (501) may be an example of the central part that includes a central point (or, central location) of the image (500). For example, the second part (502) may be included in the peripheral part of the image (500). For example, the second part (502) may be an example of the peripheral part that is spaced apart from (or located around) the central part of the image (500).

[0086] Referring to FIG. 5, the first part (501) may be represented by the first resolution. For example, the first part (501) may have the first resolution. For example, the second part (502) may be represented by the first resolution. For example, the second part (502) may have the first resolution. Referring to FIG. 5, the image (500) may have the first resolution, which is the same resolution, regardless of the parts (501, 502) within the image (500). In other words, the image (500) may not be rendered foveatedly, but may be rendered (or normally rendered) to have the same resolution throughout the entire image (500). As described above, the first part (501) and the second part (502) having the first resolution is merely illustrative for convenience of explanation and is not limited thereto. The resolution of the first part (501) may correspond to (or be substantially the same as) the resolution of the second part (502).

[0087] Referring again to FIG. 4, in operation (415), the head-worn electronic device (101) can determine whether the mode of the foveated rendering is a first mode. For example, the head-worn electronic device (101) can determine whether the mode of the executed foveated rendering is the first mode or a second mode different from the first mode, based on determining that the foveated rendering has been executed. For example, the first mode may be referred to as an AM mode. For example, the second mode may be referred to as a DSM mode. In the above example, it is described that the head-worn electronic device (101) determines whether the first mode or the second mode is, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may support three or more modes for foveated rendering and may determine whether the mode of the executed foveated rendering among the three or more modes is the first mode. Hereinafter, for convenience of explanation, the present disclosure describes the head-worn electronic device (101) based on determining whether it is in the first mode or the second mode.

[0088] In operation (415), the head-worn electronic device (101) can perform operation (425) if the mode of the executed foveated rendering is the first mode. In operation (415), the head-worn electronic device (101) can perform operation (420) if the mode of the executed foveated rendering is the second mode.

[0089] In operation (420), the head-worn electronic device (101) may display an image based on a predetermined size and a predetermined resolution. For example, the head-worn electronic device (101) may display an image based on a predetermined size and a predetermined resolution when the mode of the executed foveated rendering is the second mode. For example, the predetermined size may be the size of the central part of the image. For example, the predetermined resolution may be the resolution of the peripheral part of the image. In the above example, the predetermined size may be referred to as a preset size or a specified size. Also, in the above example, the predetermined resolution may be referred to as a preset resolution or a specified resolution. For example, an example of an image including a central part having a predetermined size and a peripheral part having a predetermined resolution is illustrated and described with reference to FIG. 6.

[0090] FIG. 6 illustrates an example of an image based on foveated rendering using a predetermined size and a predetermined resolution.

[0091] FIG. 6 illustrates examples of images (601, 602) based on foveated rendering according to the second mode. For example, the images (601, 602) may be images displayed on a head-worn electronic device (101) (or a display (330), a display panel (110)) when the mode of the foveated rendering executed is the second mode.

[0092] Referring to FIG. 6, the image (601) may be an image associated with a first software application. By example, without limitation, the image associated with the first software application may include an image generated based on data received (or acquired, provided) from the first software application, or an image stored for the first software application. In one example, the first software application may include a game application. For example, the image (601) may include a central part (611) and a peripheral part (612). For example, the central part (611) may be a part including a central point (or central location) of the image (601). In FIG. 6, a central part (611) including a central point and a peripheral part (612) are illustrated, but the present disclosure is not limited thereto. For example, the central part (611) may include a different point distinct from the central point (or central location) of the image (601). For example, the other point may be a location within the image (601) that is biased in a specific direction from the center point (or center location).

[0093] For example, a head-worn electronic device (101) may render a central part (611) of an image (601) at a first resolution and a peripheral part (612) of an image (601) at a second resolution lower than the first resolution, based on foveated rendering according to the second mode. At this time, the size of the central part (611) may have the first size. In the above example, the first size may be a size predetermined for foveated rendering according to the second mode. In the above example, the second resolution may be a resolution predetermined for foveated rendering according to the second mode. For example, the first size and the second resolution may be a predetermined size and a predetermined resolution defined (or set) with respect to the first software application.

[0094] Referring to FIG. 6, the image (602) may be an image associated with a second software application. By example, without limitation, the image associated with the second software application may include an image generated based on data received (or acquired, provided) from the second software application, or an image stored for the second software application. In one example, the second software application may include a web application. For example, the image (602) may include a central part (621) and a peripheral part (622). For example, the central part (621) may be a part that includes a central point (or central location) of the image (602). In FIG. 6, a central part (621) and a peripheral part (622) that include a central point are illustrated, but the present disclosure is not limited thereto. For example, the central part (621) may include a different point that is different from the central point (or central location) of the image (602). For example, the other point may be a location within the image (602) that is biased in a specific direction from the center point (or center location).

[0095] For example, the head-worn electronic device (101) may render the central part (621) of the image (602) at the first resolution and render the peripheral part (622) of the image (602) at a third resolution that is higher than the second resolution and lower than the first resolution, based on the foveated rendering according to the second mode. In this case, the size of the central part (621) may have a second size that is larger than the first size. Compared to the image (601), the second size of the central part (621) of the image (602) may be larger than the first size of the central part (611) of the image (601), and the third resolution of the peripheral part (622) of the image (602) may be higher than the second resolution of the peripheral part (612) of the image (601). In the above example, the second size may be a size predetermined for the foveated rendering according to the second mode. In the above example, the third resolution may be a resolution predetermined for foveated rendering according to the second mode. For example, the second size and the third resolution may be a predetermined size and a predetermined resolution defined (or set) with respect to the second software application.

[0096] Referring to FIG. 6, in the foveated rendering according to the second mode, the predetermined size of the central part of the image and the predetermined resolution of the peripheral part of the image may be defined (or set) according to the software application providing the image. However, the present disclosure is not limited thereto. For example, the foveated rendering according to the second mode may use a predetermined size of the same size and a predetermined resolution of the same resolution regardless of the software applications.

[0097] Referring again to FIG. 4, in operation (420), the head-worn electronic device (101) can display an image by rendering a central part having a predetermined size and a peripheral part having a predetermined resolution. Foveated rendering according to the second mode can reduce the power consumption of the head-worn electronic device (101) in that it does not require calculations to determine the size of the central part and calculations to determine the resolution of the peripheral part. In this regard, even if the size of the central area is varied, the level of perception (or possibility) of the resolution of the peripheral area acceptable to a person (e.g., user (100)) can be maintained. In other words, even if the size of the central area is changed from a first size to a second size smaller than the first size, the resolution of the peripheral area acceptable to a person (e.g., user (100)) can be substantially similar. That is, when the size of the central area changes from a first size to a second size smaller than the first size, even if the resolution of the surrounding area changes from a first resolution to a second resolution, a person may not perceive the changed resolution. Therefore, in foveated rendering according to the second mode, the head-worn electronic device (101) may use a predetermined size and a predetermined resolution to reduce power consumption.

[0098] However, to provide a higher quality user experience, the head-worn electronic device (101) may utilize foveated rendering according to the first mode. In this regard, users of the head-worn electronic device (101) may prefer different resolutions of the surrounding area depending on the usage scenario. For example, in a usage scenario containing many complex objects such as text (e.g., execution of an application providing a web page), a high resolution of the surrounding area may be preferred, and in a usage scenario requiring a high level of concentration, such as when simple and large objects are included (or when the density of objects in the central area is higher than the density of objects in the surrounding area) or when the user's gaze direction is generally located within the central area (e.g., execution of a racing game application), a relatively low resolution of the surrounding area may not be an issue. A method by which the head-worn electronic device (101) performs foveated rendering according to the first mode is exemplified below.

[0099] In operation (425), the head-worn electronic device (101) can determine the size of the central part of the image according to text information. For example, the head-worn electronic device (101) can determine the size of the central part of the image according to the text information of the image when the mode of the executed foveated rendering is the first mode. By example, without limitation, the text information may include the number of characters (or texts) in the image to be displayed. The number of characters may be referred to as text density. A specific example of how the head-worn electronic device (101) determines the size of the central part of the image according to text information is illustrated and described with reference to FIG. 7a.

[0100] FIG. 7a illustrates an example of an image based on foveated rendering using a size determined by text information.

[0101] FIG. 7a illustrates an example of images (701, 702) based on foveated rendering according to the first mode. For example, the images (701, 702) may be images displayed on a head-worn electronic device (101) (or a display (330), a display panel (110)) when the mode of the foveated rendering executed is the first mode.

[0102] Referring to FIG. 7a, the image (701) may be an example of an image with low text density (or a small number of characters) within the image. As a non-limiting example, the image (701) may be an image of a game screen. For example, the image (701) may include a central part (711) and a peripheral part (712). For example, the central part (711) may be a part that includes a central point (or central location) of the image (701). In FIG. 7a, a central part (711) and a peripheral part (712) that include a central point are illustrated, but the present disclosure is not limited thereto. For example, the central part (711) may include a different point that is different from the central point (or central location) of the image (701). For example, the other point may be a location within the image (701) that is deflected in a specific direction from the central point (or central location).

[0103] For example, the head-worn electronic device (101) can determine the size of the central part (711) of the image (701) as a first size according to the text information of the image (701). For example, the head-worn electronic device (101) can identify text information regarding the image (701). As an example without limitation, the head-worn electronic device (101) can identify text information regarding the image (701) by performing OCR on the image (701). As an example without limitation, the head-worn electronic device (101) can receive text information regarding the image (701) from a software application related to the image (701). As an example without limitation, the head-worn electronic device (101) can identify text information regarding the image (701) by inputting the image (701) into a trained model. For example, the head-worn electronic device (101) can identify the number of characters (or text density) contained within the image (701) based on text information regarding the image (701). By example, without limitation, the characters may include numbers or letters. For example, the head-worn electronic device (101) can determine the size of the central part (711) of the image (701) as a first size when the number of characters contained within the image (701) is less than or equal to a reference number. For example, the head-worn electronic device (101) can render the central part (711) having the first size at a first resolution and render the peripheral part (712) of the image (701) at a second resolution lower than the first resolution.

[0104] Referring to FIG. 7a, the image (702) may be an example of an image with a high text density (or a large number of characters). As a non-limiting example, the image (702) may be an image of a web page screen. For example, the image (702) may include a central part (721) and a peripheral part (722). For example, the central part (721) may be a part that includes the center point (or center location) of the image (702).

[0105] For example, the head-worn electronic device (101) may determine the size of the central part (721) of the image (702) to be a second size larger than the first size according to the text information of the image (702). For example, the head-worn electronic device (101) may identify text information regarding the image (702). As a non-limiting example, the head-worn electronic device (101) may identify text information regarding the image (702) by performing OCR on the image (702). As a non-limiting example, the head-worn electronic device (101) may receive text information regarding the image (702) from a software application related to the image (702). As a non-limiting example, the head-worn electronic device (101) may identify text information regarding the image (702) by inputting the image (702) into a trained model. For example, the head-worn electronic device (101) can identify the number of characters (or text density) contained within the image (702) based on text information regarding the image (702). By example, without limitation, the characters may include numbers or letters. For example, the head-worn electronic device (101) may determine the size of the central part (721) of the image (702) as the second size if the number of characters contained within the image (702) exceeds a reference number. By example, without limitation, the second size may increase as the number of characters contained within the image (702) and exceeding the reference number increases. For example, the head-worn electronic device (101) may render the central part (721) having the second size at the first resolution and render the peripheral part (722) of the image (702) at the second resolution, which is lower than the first resolution.As a non-limiting example, the second resolution of the peripheral portion (722) of the image (702) may be a lower resolution than the third resolution of the peripheral portion (622) of the image (602) of FIG. 6. In other words, the first resolution of the central portion (721) (or, central portion (621)) may be referred to as high quality, the second resolution of the peripheral portion (722) may be referred to as low quality, and the third resolution of the peripheral portion (622) may be referred to as medium quality. The first resolution, the second resolution, and the third resolution are merely exemplary for convenience of explanation and the present disclosure is not limited thereto.

[0106] Referring to FIG. 7a, the head-worn electronic device (101) can identify text information of an image to be displayed. As an example of a method for identifying text information of an image, the head-worn electronic device (101) can perform optical character recognition (OCR) of the image to be displayed. For example, the head-worn electronic device (101) can identify the number of characters (and arrangement information of the characters) within the image based on the result of the OCR. Specific details related to this may be referenced in FIG. 7b below.

[0107] FIG. 7b illustrates an example of a method for determining the size of the central part of an image based on text information.

[0108] FIG. 7b illustrates an example of a method for determining a central portion of images (750, 770) based on the results of OCR. For example, the OCR may be referred to as object segmentation / detection. In FIG. 7b, a central portion including a central point and a peripheral portion are illustrated, but the present disclosure is not limited thereto. For example, the central portion may include a different point distinct from the central point (or central location) of the image. For example, the different point may be a location within the image that is biased in a specific direction from the central point (or central location).

[0109] For example, a head-worn electronic device (101) can perform OCR on an image (750). For example, the head-worn electronic device (101) can identify (or recognize, acquire) characters (e.g., A, B, C, D, E, F, G) within the image (750) as a result of the OCR. As an example, without limitation, the head-worn electronic device (101) can identify (or recognize, acquire) placement information for each of the characters within the image (750) as a result of the OCR. For example, the placement information may include the location (or coordinates) of the character within the image (750). For example, the head-worn electronic device (101) can identify the number of characters within the image (750) as 7 based on the result of the OCR.

[0110] For example, a head-worn electronic device (101) can identify the number and location of characters for each of the parts (761, 762, 763, 764) within the image (750) based on the result of the OCR. For example, the parts (761, 762, 763, 764) can be distinguished according to the field of view (FoV) of the image (750). For example, each of the parts (761, 762, 763, 764) can be referenced as a FoV part. For example, a first part (761) can represent a part within a first angle (e.g., 10°) (or a first distance) from the center point (760) (or center position) of the image (750). For example, the second part (762) may represent the portion between the first angle (e.g., 10°) (or, first distance) and the second angle (e.g., 30°) (or, second distance) from the center point (760) of the image (750). For example, the second part (762) may surround the first part (761). For example, the third part (763) may represent the portion between the second angle (e.g., 30°) (or, second distance) and the third angle (e.g., 50°) (or, third distance) from the center point (760) of the image (750). For example, the third part (763) may surround the second part (762). For example, the fourth part (764) may represent a portion that extends beyond the third angle (e.g., 50°) (or third distance) from the center point (760) of the image (750). The method of distinguishing the portions (761, 762, 763, 764) is merely exemplary and is not limited thereto.For example, the head-worn electronic device (101) can identify that three characters (e.g., A, B, C) are located within the first part (761), that two characters (e.g., D, E) are located within the second part (762), that one character (e.g., F) is located within the third part (763), and that one character (e.g., G) is located within the fourth part (764).

[0111] For example, the head-worn electronic device (101) can identify that the number of characters (e.g., 7) included in the image (750) is less than or equal to a reference number (e.g., 8). Accordingly, the head-worn electronic device (101) can determine that the central part of the image (750) corresponds to the first part (761). In the above example, the case where the reference number is 8 is described, but the present disclosure is not limited thereto. For example, the reference number may be 0.

[0112] For example, a head-worn electronic device (101) can perform OCR on an image (770). For example, the head-worn electronic device (101) can identify (or recognize, acquire) characters (e.g., A, B, C, D, E, F, G, H, I, J, K, L, M, N) within the image (770) as a result of the OCR. As an example, without limitation, the head-worn electronic device (101) can identify (or recognize, acquire) placement information for each of the characters within the image (770) as a result of the OCR. For example, the placement information may include the location (or coordinates) of the character within the image (770). For example, the head-worn electronic device (101) can identify the number of characters within the image (770) as 14 based on the result of the OCR.

[0113] For example, a head-worn electronic device (101) can identify the number and location of characters for each of the parts (781, 782, 783, 784) within the image (770) based on the result of the OCR. For example, the parts (781, 782, 783, 784) can be distinguished according to the field of view (FoV) of the image (750). For example, each of the parts (781, 782, 783, 784) can be referenced as a FoV part. For example, a first part (781) can represent a part within a first angle (e.g., 10°) (or a first distance) from the center point (780) (or center position) of the image (770). For example, the second part (782) may represent the portion between the first angle (e.g., 10°) (or, first distance) and the second angle (e.g., 30°) (or, second distance) from the center point (780) of the image (770). For example, the second part (782) may surround the first part (781). For example, the third part (783) may represent the portion between the second angle (e.g., 30°) (or, second distance) and the third angle (e.g., 50°) (or, third distance) from the center point (780) of the image (770). For example, the third part (783) may surround the second part (782). For example, the fourth part (784) may represent a portion that extends beyond the third angle (e.g., 50°) (or third distance) from the center point (780) of the image (770). The method of distinguishing the portions (781, 782, 783, 784) is merely exemplary and is not limited thereto.For example, the head-worn electronic device (101) can identify that four characters (e.g., A, B, C, D) are located within the first part (781), can identify that six characters (e.g., E, F, G, H, I, J) are located within the second part (782), can identify that three characters (e.g., K, L, M) are located within the third part (783), and can identify that one character (e.g., N) is located within the fourth part (784).

[0114] For example, the head-worn electronic device (101) can identify that the number of characters (e.g., 14) included in the image (770) exceeds a reference number (e.g., 8). Accordingly, the head-worn electronic device (101) can determine that the central part of the image (770) corresponds to the first part (781) and the second part (782). In other words, the size of the central part of the image (770) may be larger than the size of the central part of the image (750). In one example, if the number of characters included in the image (770) is greater (e.g., 20), the central part of the image (770) may be determined to correspond to the first part (781), the second part (782), and the third part (783).

[0115] In the above example, the size of the central part of the image (770) is exemplified as being determined based on parts (781, 782, 783, 784) of the image (770) in FIG. 7b, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may determine the central part of the image (770) to include a number of parts of the image (770) that exceed the reference number (e.g., 8) (e.g., between the first part (781) and the second part (782)).

[0116] Referring again to FIG. 4, in operation (425), the head-worn electronic device (101) can determine the size of the central part of the image according to text information. Accordingly, the head-worn electronic device (101) can determine the size of the peripheral part of the image. The size of the peripheral part of the image can represent the size of the remaining part of the image excluding the size of the central part of the image.

[0117] In operation (430), the head-worn electronic device (101) can determine the resolution of the peripheral portion of the image. For example, the head-worn electronic device (101) can determine the resolution of the peripheral portion of the image according to information related to the image. By example, without limitation, the information related to the image may include information related to the spatial frequency of the image. For example, the spatial frequency of the image may define the degree to which contrasting portions of the image are repeated within the image. By example, without limitation, the information related to the spatial frequency may include spatial information values ​​and deviation values ​​for grayscale levels for displaying the image. Specific details regarding how the head-worn electronic device (101) determines the resolution of the peripheral area of ​​the image using the information related to the spatial frequency are illustrated and described with reference to FIG. 8.

[0118] FIG. 8 illustrates an example of an image based on foveated rendering that uses a resolution determined by a spatial information value or a deviation value for the grayscale levels of the image.

[0119] FIG. 8 illustrates examples of images (801, 802) based on foveated rendering according to the first mode. For example, the images (801, 802) may be images displayed on a head-worn electronic device (101) (or a display (330), a display panel (110)) when the mode of the foveated rendering executed is the first mode.

[0120] Referring to FIG. 8, the image (801) may be an example of an image with a small spatial information value. As a non-limiting example, the image (801) may be an image of a game screen. For example, the image (801) may include a central part (811) and a peripheral part (812). For example, the central part (811) may be a part that includes the center point (or center location) of the image (801). In FIG. 8, the central part (811) and the peripheral part (812) that include the center point are illustrated, but the present disclosure is not limited thereto. For example, the central part (811) may include a different point that is different from the center point (or center location) of the image (801). For example, the other point may be a location within the image (801) that is biased in a specific direction from the center point (or center location).

[0121] For example, the head-worn electronic device (101) can determine the size of the central part (811) of the image (801) as a first size according to the text information of the image (801). For example, specific details regarding the method of determining the size of the central part (811) may be referenced in FIG. 7a and FIG. 7b described above. For example, the head-worn electronic device (101) can render the central part (811) at a first resolution. For example, the head-worn electronic device (101) can render the peripheral part (812) at a second resolution lower than the first resolution. For example, to determine the second resolution, the head-worn electronic device (101) can identify the spatial information value of the image (801).

[0122] As a non-limiting example, the above spatial information value may represent spatial information defined within the ITU-T (International Telecommunication Union Telecommunication Standardization Sector) P.910 standard. For example, the above spatial information may be determined according to the following mathematical formula.

[0123]

[0124] The above SIn provides spatial information of the nth image (or frame), the above ...the luminance values ​​(or luminance map) of the nth image, the Sobel above has a function for extracting edge information within the image, the can represent the deviation of edge information of an image. Referring to the mathematical formula described above, the spatial information value of a specific image can represent the deviation value of luminance values ​​for displaying the specific image. For example, the higher the spatial information value, the higher the complexity of the image (or the higher the spatial frequency).

[0125] For example, the head-worn electronic device (101) can increase the resolution of the surrounding part (812) of the image (801) as the spatial information value of the image (801) increases. In other words, the spatial information value may be proportional (or linearly proportional) to the resolution of the surrounding part (812). For example, the head-worn electronic device (101) may identify the spatial information value of the image (801) as a first value. For example, since the image (801) is a game screen that includes a relatively large object or is simply depicted, the spatial information value of the image (801) may be a relatively low first value. For example, the head-worn electronic device (101) may determine the second resolution of the surrounding part (812) of the image (801) according to the first value as the first resolution value.

[0126] In the above example, the spatial information value is described as being a value of the image (801), but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may identify a spatial information value for a part of the image (801) rather than the whole. As a non-limiting example, the head-worn electronic device (101) may identify a spatial information value for a part of the peripheral part (812) within a certain angle (or distance) from the central part (811) (e.g., if the FoV of the central part (811) is 40°, the FoV of said part of the peripheral part (812) is 40° to 50°).

[0127] Referring to FIG. 8, the image (802) may be an example of an image with a large spatial information value. As a non-limiting example, the image (802) may be an image of a web page screen. For example, the image (802) may include a central part (821) and a peripheral part (822). For example, the central part (821) may be a part that includes the center point (or center location) of the image (802).

[0128] For example, the head-worn electronic device (101) may determine the size of the central part (821) of the image (802) to the first size according to the text information of the image (802). In FIG. 8, for convenience of explanation, it is assumed that the size of the central part (811) of the image (801) is the same as the size of the central part (821) of the image (802), but the present disclosure is not limited thereto. For example, specific details regarding the method of determining the size of the central part (821) may be referenced in FIG. 7a and FIG. 7b described above. For example, the head-worn electronic device (101) may render the central part (821) at the first resolution. For example, the first resolution of the central part (821) of the image (802) may be the same as the first resolution of the central part (812) of the image (801). For example, the head-worn electronic device (101) may render a peripheral portion (822) at a second resolution lower than the first resolution. For example, the second resolution of the peripheral portion (822) of the image (802) may differ from the second resolution of the peripheral portion (812) of the image (802). For example, to determine the second resolution of the peripheral portion (812) of the image (802), the head-worn electronic device (101) may identify a spatial information value of the image (802). For example, the head-worn electronic device (101) may identify the spatial information value of the image (802) as a second value. For example, the second value, which is the spatial information value of the image (802), may be higher than the first value, which is the spatial information value of the image (801). For example, the image (802) is a web page screen that includes a relatively small object or is complexly depicted, and the spatial information value of the image (802) may be the relatively high second value.For example, a head-worn electronic device (101) may determine the second resolution of the peripheral part (822) of the image (802) according to the second value as the second resolution value. For example, the second resolution value may be higher than the first resolution value. In other words, the resolution of the peripheral part of the image may be higher as the spatial information value increases.

[0129] As a non-limiting example, the first resolution of the central part (811) (or, central part (821)) may be referred to as high resolution. Additionally, as a non-limiting example, the second resolution of the peripheral part (812) of the image (801) having the first resolution value may be referred to as low resolution. Additionally, as a non-limiting example, the second resolution of the peripheral part (822) of the image (802) having the second resolution value may be referred to as medium resolution. The first resolution and the second resolution are merely exemplary for convenience of explanation and the present disclosure is not limited thereto.

[0130] In the above example, the spatial information value is described as being a value of the image (802), but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may identify a spatial information value for a part of the image (802) rather than the whole. As a non-limiting example, the head-worn electronic device (101) may identify a spatial information value for a part of the peripheral part (822) within a certain angle (or distance) from the central part (821) (e.g., if the FoV of the central part (821) is 40°, the FoV of said part of the peripheral part (822) is 40° to 50°).

[0131] Referring to the above description, the resolution of a peripheral part (812) (or peripheral part (822)) is described as being determined according to the spatial information value of an image (801) (or image (802)), but the present disclosure is not limited thereto. For example, a head-worn electronic device (101) may determine the resolution of a peripheral part of an image according to a deviation value for grayscale levels for displaying an image. For convenience of explanation, a method for determining the resolution of a peripheral part (812) of an image (801) according to a deviation value for grayscale levels for an image (801) is described below, but the present disclosure is not limited thereto.

[0132] For example, when generating an image (801), the head-worn electronic device (101) can identify grayscale levels for displaying the image (801). For example, the grayscale levels for displaying the image (801) may represent the grayscale levels of the lines constituting the image (801). For example, among the pixels constituting the image (801), pixels in a specific direction (e.g., horizontal direction) may be defined as a single line (hereinafter, the first line). For example, the second line following the first line may be a line located after the first line with respect to a direction perpendicular to the specific direction (e.g., vertical direction). For example, the second line may be defined by pixels in the specific direction (e.g., horizontal direction) in the same way as the first line. For example, the head-worn electronic device (101) can identify the deviation values ​​of the grayscale levels for the pixels of the first line and the deviation values ​​of the grayscale levels for the pixels of the second line. For example, the head-worn electronic device (101) can store the deviation values ​​of the grayscale levels for the pixels of each line in the first line memory. For example, the head-worn electronic device (101) can identify the grayscale levels for the pixels of the first line and the grayscale levels for the pixels of the second line. For example, the head-worn electronic device (101) can store the grayscale levels for the pixels of each line in the second line memory. For example, the head-worn electronic device (101) can identify the difference between the grayscale levels for the pixels of the first line and the grayscale levels for the pixels of the second line (or the deviation values ​​of the grayscale levels for the pixels of the first line and the grayscale levels for the pixels of the second line).For example, the difference between the grayscale levels of the pixels of the first line and the grayscale levels of the pixels of the second line (or the deviation value between the grayscale levels of the pixels of the first line and the grayscale levels of the pixels of the second line) can be identified (or calculated) based on the value stored in the second line memory. For example, the head-worn electronic device (101) can store the deviation value between the grayscale levels of two lines in the third line memory. The grayscale levels of the pixels of each line stored in the second line memory can be stored sequentially in the second line memory and removed sequentially. As a non-limiting example, if the second line memory can store grayscale levels of pixels of up to three lines, the second line memory can remove the grayscale levels of the pixels of the first line before storing the grayscale levels of the pixels of the fourth line. Afterwards, the second line memory can store grayscale levels regarding the pixels of the fourth line.

[0133] Examples of data stored in the first line memory, the second line memory, and the third line memory may be referenced in the following table.

[0134] Line 1 Memory DL1 DL2 DL3 Line 2 Memory V DL1 V DL2 V DL3 Line 3 Memory D 1 2 D 2 3...

[0135] The above DL1 may represent a deviation value between the grayscale levels of the first line, the above DL2 may represent a deviation value between the grayscale levels of the second line following the first line, the above DL3 may represent a deviation value between the grayscale levels of the third line following the second line, the above VDL1 may represent the grayscale levels of the first line, the above VDL2 may represent the grayscale levels of the second line, the above VDL3 may represent the grayscale levels of the third line, the above D12 may represent a deviation value between the grayscale levels of the first line and the grayscale levels of the second line, and the above D23 may represent a deviation value between the grayscale levels of the second line and the grayscale levels of the third line. The number of line memories shown in the above table (e.g., 3) is merely illustrative for convenience of explanation and the present disclosure is not limited thereto. Referring to the table described above, the value stored in the first line memory may indicate the degree of complexity of pixels in the specific direction (e.g., horizontal direction) when displaying the image (801). Additionally, the value stored in the third line memory may indicate the degree of complexity of pixels in the direction perpendicular to the specific direction (e.g., vertical direction) when displaying the image (801).

[0136] For example, the head-worn electronic device (101) can determine the second resolution of the peripheral portion (812) of the image (801) using at least one of the value stored in the first line memory or the value stored in the third line memory. In one example, if the value stored in the first line memory is the first value, the head-worn electronic device (101) can determine the second resolution of the peripheral portion (812) of the image (801) as the first resolution value. Alternatively, if the value stored in the first line memory is the second value which is higher than the first value, the head-worn electronic device (101) can determine the second resolution of the peripheral portion (812) of the image (801) as the second resolution value which is higher than the first resolution value. For example, the first resolution value and the second resolution value of the second resolution according to the deviation value may be determined according to a preset function or according to a look-up table (LUT).

[0137] In the above example, a method for determining the resolution of a peripheral portion according to the grayscale levels of an image identified by a head-worn electronic device (101) (or at least one processor (310)) is described, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) (or display (330), display driving circuit (320)) may determine the resolution of a peripheral portion of an image according to deviation values ​​for data voltages corresponding to the grayscale levels of the image. The deviation values ​​for the data voltages of the image may be applied substantially the same way as the deviation values ​​for the grayscale levels of the image.

[0138] Referring again to FIG. 4, in operation (435), the head-worn electronic device (101) can display an image based on a determined size and a determined resolution. For example, the head-worn electronic device (101) can display an image based on the size of the central part of the image determined according to text information and the resolution of the peripheral part of the image determined according to information regarding the image. For example, the head-worn electronic device (101) can render the central part of the image having a size determined according to text information at a first resolution and render the peripheral part of the image at a second resolution determined according to information regarding the image and lower than the first resolution. For example, the head-worn electronic device (101) can display the image on the display area of ​​the display (330) (or display panel (110)) by rendering the central part at the first resolution and rendering the peripheral part at the second resolution.

[0139] Referring to FIGS. 4 through 8, for example, a head-worn electronic device (101) may determine the size of the central part of an image based on text information and determine the resolution of the peripheral part of an image based on spatial information values ​​(or deviation values ​​for grayscale levels, deviation values ​​for data voltages). However, the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may determine the size of the central part of an image and determine the resolution of the peripheral part of an image based on other information. As a non-limiting example, the head-worn electronic device (101) may determine the size of the central part of an image and determine the resolution of the peripheral part of an image based on the speed of movement of the head-worn electronic device (101). Specific details related thereto are illustrated and explained with reference to FIG. 9.

[0140] FIG. 9 illustrates an example of a method for performing foveated rendering using a size and resolution determined by the speed of movement of a head-worn electronic device.

[0141] FIG. 9 illustrates examples (901, 902) of a method for determining the size of a central part of an image based on the speed of movement of a head-worn electronic device (101) and performing foveated rendering using the determined size.

[0142] For example, the head-worn electronic device (101) can identify the speed of the movement of the head-worn electronic device (101). For example, the head-worn electronic device (101) can identify the speed of the movement of the head-worn electronic device (101) (or the head portion of the user (100) wearing the head-worn electronic device (101)) by using at least one sensor (e.g., an accelerometer or a gyroscope) included in the head-worn electronic device (101). By example, without limitation, the movement of the head-worn electronic device (101) may include rotational movement or linear movement. For example, the movement of the head-worn electronic device (101) may be caused as the user wearing the head-worn electronic device (101) rotates their head. Alternatively, for example, the movement of the head-worn electronic device (101) may be caused by a user wearing the head-worn electronic device (101) moving in a horizontal direction (e.g., walking, or running) while keeping their head substantially fixed in an upward direction.

[0143] Referring to examples (901, 902), the head-worn electronic device (101) may determine the size of the center portion of an image according to the speed of movement of the head-worn electronic device (101). In example (901), the head-worn electronic device (101) may identify the speed of movement of the head-worn electronic device (101) as a first speed. In contrast, in example (902), the head-worn electronic device (101) may identify the speed of movement of the head-worn electronic device (101) as a second speed faster than the first speed. For convenience of explanation, it is assumed that the first speed is less than or equal to a reference speed and the second speed exceeds the reference speed. For example, the head-worn electronic device (101) may determine the size of the center portion of the image as a first size when the speed of movement of the head-worn electronic device (101) is the first speed. In contrast, the head-worn electronic device (101) can determine the size of the central part of the image to be a second size smaller than the first size when the speed of the movement of the head-worn electronic device (101) is the second speed. For example, the faster the second speed exceeding the reference speed, the smaller the second size may be. This may be because the field of view that the user (100) can perceive becomes narrower when the rotation speed of the user's (100) head is fast.

[0144] In the above example, the size of the central part of the image is described as decreasing as the speed of the movement of the head-worn electronic device (101) increases, but the present disclosure is not limited thereto. For example, when the speed of the movement of the head-worn electronic device (101) increases, the size of the central part of the image may be increased to increase the probability of recognition of the image of the user wearing the head-worn electronic device (101).

[0145] In the above example, an example of a method for a head-worn electronic device (101) to determine (or adjust) the size of the central part of an image according to the speed of the movement of the head-worn electronic device (101) is described, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may determine (or adjust) the resolution of the peripheral part of an image according to the speed of the movement of the head-worn electronic device (101). For example, the head-worn electronic device (101) may determine the resolution of the peripheral part of the image to a first resolution when the speed of the movement of the head-worn electronic device (101) is the first speed. Alternatively, the head-worn electronic device (101) may determine the resolution of the central part of the image to a second resolution lower than the first resolution when the speed of the movement of the head-worn electronic device (101) is the second speed. For example, the faster the second speed exceeding the reference speed, the lower the second resolution may be.

[0146] Additionally, for example, the head-worn electronic device (101) may determine (or adjust) both the size of the central part of the image and the resolution of the peripheral part of the image according to the speed of movement of the head-worn electronic device (101).

[0147] In FIG. 9, an example is described in which a head-worn electronic device (101) determines (or adjusts) at least one of the size of the central part of an image or the resolution of the peripheral part of an image according to the speed of movement of the head-worn electronic device (101), but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may determine (or adjust) at least one of the size of the central part of an image or the resolution of the peripheral part of an image by using the edge density or high-frequency object density of the image.

[0148] For example, a head-worn electronic device (101) (or at least one processor (310), GPU (graphic processing unit), DPU (display processing unit))) can identify the edge density of an image. For example, the edge density may represent the density of edges contained within the image. For example, if visual objects (e.g., people, things, text) are contained within the image, the edges may represent the boundaries (or boundary lines) of the visual objects. For example, the edge density may be included in the edge information of Equation 1. For example, the edge density may be the output according to the Sobel function. For example, the head-worn electronic device (101) can identify the edge density of an image. For example, the head-worn electronic device (101) may determine the size of the center part of the image as a first size when the edge density is a first density that is less than or equal to the reference density. Alternatively, the head-worn electronic device (101) may determine the size of the center part of the image as a second size that is larger than the first size when the edge density is a second density that is greater than the reference density. Or, for example, the head-worn electronic device (101) may determine the resolution of the peripheral part of the image as a first resolution when the edge density is a first density that is less than or equal to the reference density. Alternatively, the head-worn electronic device (101) may determine the resolution of the peripheral part of the image as a second resolution that is higher than the first resolution when the edge density is a second density that is greater than the reference density. Additionally, for example, a head-worn electronic device (101) may determine (or adjust) both the size of the central part of the image and the resolution of the peripheral part of the image according to the edge density.

[0149] For example, the head-worn electronic device (101) can identify the high-frequency object density of an image. For example, the high-frequency object density may represent the density of high-frequency objects included in the image. For example, high-frequency objects may represent objects formed by high frequencies greater than a reference frequency included in the image. As an example without limitation, the high-frequency objects may include text having a small font size included in the image. For example, the head-worn electronic device (101) may determine the size of the center part of the image as a first size when the high-frequency object density is a first density that is less than or equal to the reference density. Alternatively, the head-worn electronic device (101) may determine the size of the center part of the image as a second size larger than the first size when the high-frequency object density is a second density that is greater than the reference density. Or, for example, the head-worn electronic device (101) may determine the resolution of the peripheral part of the image as a first resolution when the high-frequency object density is a first density that is less than or equal to the reference density. In contrast, the head-worn electronic device (101) may determine the resolution of the peripheral part of the image to be a second resolution higher than the first resolution when the high-frequency object density is the second density which is greater than the reference density. Additionally, for example, the head-worn electronic device (101) may determine (or adjust) both the size of the central part of the image and the resolution of the peripheral part of the image according to the high-frequency object density.

[0150] Referring to FIGS. 4 through 9, the head-worn electronic device (101) can determine the size of the central part of an image based on text information as well as other information (e.g., speed of movement of the head-worn electronic device (101), edge density, high-frequency object density). Alternatively, for example, the head-worn electronic device (101) can determine the resolution of the peripheral part of an image based on the spatial frequency value of the image (or deviation value of grayscale levels, deviation value of data voltages) as well as other information (e.g., speed of movement of the head-worn electronic device (101), edge density, high-frequency object density). As an example without limitation, the head-worn electronic device (101) may set a priority between the text information and the other information and determine the size of the central part of the image according to the priority. As an example without limitation, the priority of the text information may be higher than the priority of the other information. For example, if the size of the central part of the image determined according to the text information is a first size, and the size of the central part of the image determined according to the other information is a second size different from the first size, the head-worn electronic device (101) can determine the size of the central part of the image to be the first size. Additionally, for example, the priority of the spatial frequency value may be higher than the priority of the other information. As a non-limiting example, if the resolution of the peripheral part of the image determined according to the spatial frequency value is a first resolution, and the resolution of the peripheral part of the image determined according to the other information is a second resolution different from the first resolution, the head-worn electronic device (101) can determine the resolution of the peripheral part of the image to be the first resolution.Additionally, for example, a head-worn electronic device (101) may determine the resolution of a peripheral part of an image as a representative value for the resolution of a peripheral part of an image determined according to the text information, the resolution of a peripheral part of an image determined according to the spatial frequency value, and the resolution of a peripheral part determined according to the other information. For example, the representative value may include at least one of a median value, an average value, a maximum value, or a minimum value.

[0151] Referring to FIGS. 4 through 9, the head-worn electronic device (101) is described as determining the size of the central part of an image according to text information, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) may determine the size of the central part of an image according to the mobility of content included in the image, or the mobility of the gaze of a user wearing the head-worn electronic device (101). For example, the head-worn electronic device (101) may identify the mobility of content between images within the video when a video containing an image to be displayed is played. For example, the head-worn electronic device (101) may reduce the size of the central part of the image to be displayed if the content between images within the video is relatively dynamic content. Or, for example, the head-worn electronic device (101) may increase the size of the central part of the image to be displayed if the content between images within the video is relatively static content. Alternatively, the head-worn electronic device (101) may identify the movement (or speed of movement) of the user's gaze while displaying an image. For example, the head-worn electronic device (101) may determine the size of the central part of the image to be displayed as a first size when the speed of movement of the gaze is a first speed. Or, for example, the head-worn electronic device (101) may determine the size of the central part of the image to be displayed as a second size smaller than the first size when the speed of movement of the gaze is a second speed faster than the first speed. In the above example, it is described that the size of the central part of the image decreases when the mobility of the content included in the image increases or when the mobility of the user's gaze wearing the head-worn electronic device (101) increases, but the present disclosure is not limited thereto.For example, the head-worn electronic device (101) may increase the size of the central area of ​​the image when the content of the image is dynamic content. Or, for example, the head-worn electronic device (101) may increase the size of the central area of ​​the image to be displayed when the speed of the user's gaze movement is the second speed, which is faster than the first speed.

[0152] Referring to the foregoing description, the present disclosure is described as performing static foveated rendering of an image in software, but the present disclosure is not limited thereto. For example, the head-worn electronic device (101) of the present disclosure may include a lens (105) capable of changing optical properties. For example, the head-worn electronic device (101) may change the optical properties of the lens (105) to display the image with the determined size of the central part of the image and the determined resolution of the peripheral part of the image, after determining the size of the central part of the image and the resolution of the peripheral part according to the foveated rendering of the first mode (or the second mode). For example, the optical properties of the lens (105) may change according to the gap (or distance) between the lens (105) and the display panel (110) or the focal length of the lens (105), which is a variable focal length lens. The head-worn electronic device (101) can display a central portion having a determined size at a specific resolution and a peripheral portion at a determined resolution lower than the specific resolution of the central portion by changing the optical properties of the lens (105).

[0153] FIG. 10 is a block diagram of an electronic device in a network environment according to various embodiments.

[0154] Referring to FIG. 10, in a network environment (1000), an electronic device (1001) may communicate with an electronic device (1002) through a first network (1098) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1004) or a server (1008) through a second network (1099) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1001) may communicate with the electronic device (1004) through a server (1008). According to one embodiment, the electronic device (1001) may include a processor (1020), memory (1030), input module (1050), sound output module (1055), display module (1060), audio module (1070), sensor module (1076), interface (1077), connection terminal (1078), haptic module (1079), camera module (1080), power management module (1088), battery (1089), communication module (1090), subscriber identification module (1096), or antenna module (1097). In some embodiments, at least one of these components (e.g., connection terminal (1078)) may be omitted from the electronic device (1001), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1076), camera module (1080), or antenna module (1097)) may be integrated into a single component (e.g., display module (1060)).

[0155] The processor (1020) can, for example, execute software (e.g., program (1040)) to control at least one other component (e.g., hardware or software component) of the electronic device (1001) connected to the processor (1020) and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1020) can store commands or data received from other components (e.g., sensor module (1076) or communication module (1090)) in volatile memory (1032), process the commands or data stored in volatile memory (1032), and store the resulting data in non-volatile memory (1034). According to one embodiment, the processor (1020) may include a main processor (1021) (e.g., a central processing unit or an application processor) or an auxiliary processor (1023) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1001) includes a main processor (1021) and an auxiliary processor (1023), the auxiliary processor (1023) may be configured to use less power than the main processor (1021) or to be specialized for a designated function. The auxiliary processor (1023) may be implemented separately from the main processor (1021) or as part thereof.

[0156] The auxiliary processor (1023) may control at least some of the functions or states associated with at least one component of the electronic device (1001) (e.g., display module (1060), sensor module (1076), or communication module (1090)) on behalf of the main processor (1021) while the main processor (1021) is in an inactive (e.g., sleep) state, or together with the main processor (1021) while the main processor (1021) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1023) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1080) or communication module (1090)). According to one embodiment, the auxiliary processor (1023) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1001) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1008)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0157] The memory (1030) can store various data used by at least one component of the electronic device (1001) (e.g., processor (1020) or sensor module (1076)). The data may include, for example, input data or output data for software (e.g., program (1040)) and related commands. The memory (1030) may include volatile memory (1032) or non-volatile memory (1034).

[0158] The program (1040) may be stored as software in memory (1030) and may include, for example, an operating system (1042), middleware (1044), or an application (1046).

[0159] The input module (1050) can receive commands or data to be used for a component of the electronic device (1001) (e.g., processor (1020)) from outside the electronic device (1001) (e.g., user). The input module (1050) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0160] The sound output module (1055) can output a sound signal to the outside of the electronic device (1001). The sound output module (1055) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0161] The display module (1060) can visually provide information to an external (e.g., user) of the electronic device (1001). The display module (1060) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1060) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0162] The audio module (1070) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1070) can acquire sound through an input module (1050) or output sound through an audio output module (1055) or an external electronic device (e.g., electronic device (1002)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1001).

[0163] The sensor module (1076) can detect the operating state of the electronic device (1001) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1076) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0164] The interface (1077) may support one or more specified protocols that can be used for the electronic device (1001) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1002)). According to one embodiment, the interface (1077) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0165] The connection terminal (1078) may include a connector through which the electronic device (1001) can be physically connected to an external electronic device (e.g., electronic device (1002)). According to one embodiment, the connection terminal (1078) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0166] The haptic module (1079) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (1079) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0167] The camera module (1080) can capture still images and video. According to one embodiment, the camera module (1080) may include one or more lenses, image sensors, image signal processors, or flashes.

[0168] The power management module (1088) can manage power supplied to the electronic device (1001). According to one embodiment, the power management module (1088) may be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0169] The battery (1089) can supply power to at least one component of the electronic device (1001). According to one embodiment, the battery (1089) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0170] The communication module (1090) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1001) and an external electronic device (e.g., electronic device (1002), electronic device (1004), or server (1008)), and the performance of communication through the established communication channel. The communication module (1090) may include one or more communication processors that operate independently of the processor (1020) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1090) may include a wireless communication module (1092) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1094) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1004) through a first network (1098) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1099) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1092) can identify or authenticate the electronic device (1001) within a communication network such as the first network (1098) or the second network (1099) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1096).

[0171] The wireless communication module (1092) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1092) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1092) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1092) can support various requirements specified in the electronic device (1001), external electronic device (e.g., electronic device (1004)), or network system (e.g., second network (1099)). According to one embodiment, the wireless communication module (1092) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0172] An antenna module (1097) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1097) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1097) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1098) or a second network (1099), may be selected from the plurality of antennas, for example, by a communication module (1090). A signal or power may be transmitted or received between the communication module (1090) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1097).

[0173] According to various embodiments, the antenna module (1097) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0174] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0175] According to one embodiment, commands or data may be transmitted or received between an electronic device (1001) and an external electronic device (1004) through a server (1008) connected to a second network (1099). Each of the external electronic devices (1002, or 1004) may be the same or a different type of device as the electronic device (1001). According to one embodiment, all or part of the operations performed on the electronic device (1001) may be performed on one or more of the external electronic devices (1002, 1004, or 1008). For example, if the electronic device (1001) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1001) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1001). The electronic device (1001) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1001) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (1004) may include an Internet of Things (IoT) device. The server (1008) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1004) or server (1008) may be included within the second network (1099). The electronic device (1001) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0176] For example, an external electronic device (1002) renders content data executed in an application and transmits it to an electronic device (1001), and the electronic device (1001) that receives the data can output the content data to a display module. If the electronic device (1001) detects user movement through an IMU sensor or the like, the processor of the electronic device (1001) can correct the rendering data received from the external electronic device (1002) based on the movement information and output it to the display module. Alternatively, the external electronic device (1002) can transmit the movement information to request rendering so that the screen data is updated accordingly. Depending on various embodiments, the external electronic device (1002) may be a device of various forms, such as a case device capable of storing and charging a smartphone or an electronic device (101).

[0177] FIG. 11 is a block diagram of a display module according to various embodiments.

[0178] Referring to FIG. 11, the display module (1060) may include a display panel (1110) and a display driver IC (DDI) (1130) (or a display driving circuit (1130)) for controlling the same. The DDI (1130) may include an interface module (1131), a memory (1133) (e.g., a buffer memory), an image processing module (1135), or a mapping module (1137). The DDI (1130) may receive image information, for example, image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device (1001) through the interface module (1131). For example, according to one embodiment, image information may be received from a processor (1020) (e.g., main processor (1021) (e.g., application processor)) or an auxiliary processor (1023) (e.g., graphics processing unit) that operates independently of the functions of the main processor (1021). The DDI (1130) may communicate with the touch circuit (1150) or sensor module (1076), etc., through the interface module (1131). Additionally, the DDI (1130) may store at least a portion of the received image information in memory (1133), for example, in frame units. The image processing module (1135) may perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a portion of the image data based at least on the characteristics of the image data or the characteristics of the display panel (1110), for example. The mapping module (1137) may obtain voltage values ​​or current values ​​corresponding to the image data preprocessed or postprocessed through the image processing module (1135). It can be generated. According to one embodiment, the generation of a voltage value or a current value can be performed, for example, based at least in part on the properties of the pixels of the display panel (1110) (e.g., array of pixels (RGB stripe or pentile structure), or the size of each subpixel).At least some pixels of the display panel (1110) are driven, for example, based on at least some of the voltage value or current value, so that visual information (e.g., text, image, or icon) corresponding to the image data can be displayed through the display panel (1110).

[0179] According to one embodiment, the display module (1060) may further include a touch circuit (1150). The touch circuit (1150) may include a touch sensor (1151) and a touch sensor IC (1153) for controlling the same. The touch sensor IC (1153) may control the touch sensor (1151) to detect a touch input or hovering input for a specific location on the display panel (1110), for example. For example, the touch sensor IC (1153) may detect a touch input or hovering input by measuring a change in a signal (e.g., voltage, light intensity, resistance, or charge) for a specific location on the display panel (1110). The touch sensor IC (1153) may provide information regarding the detected touch input or hovering input (e.g., location, area, pressure, or time) to the processor (1020). According to one embodiment, at least a part of the touch circuit (1150) (e.g., touch sensor IC (1153)) may be included as part of the display driver IC (1130) or the display panel (1110), or as part of another component (e.g., auxiliary processor (1023)) placed outside the display module (1060).

[0180] According to one embodiment, the display module (1060) may further include at least one sensor (e.g., fingerprint sensor, iris sensor, pressure sensor, or light sensor) of the sensor module (1076) or a control circuit for the same. In this case, the at least one sensor or the control circuit for the same may be embedded in a part of the display module (1060) (e.g., display panel (1110) or DDI (1130)) or a part of the touch circuit (1150). For example, if the sensor module (1076) embedded in the display module (1060) includes a biometric sensor (e.g., fingerprint sensor), the biometric sensor may acquire biometric information (e.g., fingerprint image) associated with a touch input through a part of the display panel (1110). As another example, if the sensor module (1076) embedded in the display module (1060) includes a pressure sensor, the pressure sensor can obtain pressure information associated with a touch input through a part or the entire area of ​​the display panel (1110). According to one embodiment, the touch sensor (1151) or the sensor module (1076) may be placed between pixels of a pixel layer of the display panel (1110), or above or below the pixel layer.

[0181] In embodiments of the present disclosure, an electronic device for displaying an image in a virtual space (e.g., the head-mounted electronic device (101) of FIG. 3, the electronic device (1001) of FIG. 10) may be a wearable device. The wearable device may include a head-mounted display (HMD) that is wearable on a user's head. The wearable device may be referred to as a head-mount device (HMD), a headgear electronic device, a glasses-type electronic device, a video see-through (VST) or visible see-through (VST) device, an extended reality (XR) device, a virtual reality (VR) device, and / or an augmented reality (AR) device. An example of a hardware configuration included within the wearable device is described exemplarily with reference to FIG. 12b. An example of the structure of a wearable device that is wearable on a user's head is described with reference to FIG. 12a through 13b. The wearable device may be referred to as an electronic device (400). For example, the electronic device may be combined with an accessory (e.g., a strap) to be attached to the user's head to form an HMD.

[0182] According to one embodiment, a wearable device can perform functions related to augmented reality (AR) and / or mixed reality (MR). For example, while a user is wearing the wearable device, the wearable device may include at least one lens positioned adjacent to the user's eye. The wearable device may combine light emitted from a display of the wearable device with ambient light passing through the lens. The display area of ​​the display may be formed within the lens through which the ambient light passes. Because the wearable device combines the ambient light and the light emitted from the display, the user may see a mixed image of a real object (or physical object) perceived by the ambient light and a virtual object formed by the light emitted from the display. The augmented reality, mixed reality, and / or virtual reality described above may be referred to as extended reality (XR).

[0183] According to one embodiment, a wearable device may perform functions related to VST (video see-through or visible see-through) and / or virtual reality (VR). For example, while a user is wearing the wearable device, the wearable device may include a housing that covers the user's eyes. The wearable device may include a display disposed on a first surface of the housing facing the eyes while in the state. The wearable device may include a camera disposed on a second surface opposite to the first surface. Using the camera, the wearable device may acquire an image and / or video representing ambient light. The wearable device may output the image and / or video within the display disposed on the first surface so that the user perceives the ambient light through the display. A displaying area (or displaying region) (or active area or active region) of the display disposed on the first surface may be formed by one or more pixels included in the display. The wearable device can composite a virtual object with an image and / or video output through the display, thereby allowing the user to perceive the virtual object along with a real object perceived by ambient light.

[0184] According to one embodiment, a wearable device can identify or recognize the position or location and / or direction or orientation of the wearable device based on an image (and / or video) obtained or acquired using a camera. The wearable device can acquire information about the external space using one or more cameras and / or one or more sensors. The information may include a geographic location of the external space (e.g., Global Positioning System (GPS) coordinates) identified by one or more sensors. The information may include an image and / or video of the external space identified by one or more cameras. The wearable device can perform object recognition on the image and / or video to identify external objects contained in the external space from the image and / or video.

[0185] Hereinafter, an example of a hardware configuration of a wearable device is described with reference to FIGS. 12a, FIGS. 12b, FIGS. 13a, and FIGS. 13b.

[0186] FIG. 12a illustrates an example of a perspective view of an electronic device. FIG. 12b illustrates an example of one or more hardware components arranged within the electronic device.

[0187] According to one embodiment, the electronic device (101) may have the form of glasses that are wearable on a part of a user's body (e.g., head). The electronic device (101) of FIGS. 12a and 12b may be an example of the head-wearing electronic device (101) of FIGS. 1a. For example, the electronic device (101) of FIGS. 12a and 12b may be an example of the electronic device (1001) of FIGS. 10. The electronic device (101) may include a head-mounted display (HMD). For example, the electronic device (101) of FIGS. 12a and 12b may be referred to as a wearable device, a head-wearing electronic device, an HMD device, or an AR / VR device.

[0188] For example, the housing of the electronic device (101) may include a flexible material such as rubber and / or silicone having a shape that adheres to a part of the user's head (e.g., a part of the face covering both eyes). For example, the housing of the electronic device (101) may include one or more straps that can be twined around the user's head and / or one or more temples that are attachable to the ears of the head.

[0189] Referring to FIG. 12a, an electronic device (101) according to one embodiment may include at least one display (1250) and a frame (1200) supporting at least one display (1250).

[0190] According to one embodiment, the electronic device (101) may be worn on a part of a user's body. The electronic device (101) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the electronic device (101). For example, the electronic device (101) may display a virtual reality image provided by at least one optical device (1282, 1284) of FIG. 12b on at least one display (1250) in response to a designated gesture of the user obtained through the motion recognition camera (1260-2, 1260-3) of FIG. 12b.

[0191] According to one embodiment, at least one display (1250) can provide visual information to a user. For example, at least one display (1250) may include a transparent or translucent lens. At least one display (1250) may include a first display (1250-1) and / or a second display (1250-2) spaced apart from the first display (1250-1). For example, the first display (1250-1) and the second display (1250-2) may be positioned at locations corresponding to the user's left eye and right eye, respectively.

[0192] Referring to FIG. 12b, at least one display (1250) may provide visual information transmitted from external light to a user through a lens included in at least one display (1250) and other visual information distinct from said visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, at least one display (1250) may include a first surface (1231) and a second surface (1232) opposite to the first surface (1231). A display area may be formed on the second surface (1232) of at least one display (1250). When a user wears the electronic device (101), external light may be transmitted to the user by being incident on the first surface (1231) and transmitted through the second surface (1232). As another example, at least one display (1250) can display an augmented reality image combined with a virtual reality image provided by at least one optical device (1282, 1284) on a real screen transmitted through external light in a display area formed on a second surface (1232).

[0193] In one embodiment, at least one display (1250) may include at least one waveguide (1233, 1234) that diffracts light emitted from at least one optical device (1282, 284) and transmits it to a user. At least one waveguide (1233, 1234) may be formed based on at least one of glass, plastic, or polymer. A nano pattern may be formed on the exterior or at least a portion of the interior of at least one waveguide (1233, 1234). The nano pattern may be formed based on a polygonal and / or curved grating structure. Light incident on one end of at least one waveguide (1233, 1234) may be propagated to the other end of at least one waveguide (1233, 1234) by the nano pattern. At least one waveguide (1233, 1234) may include at least one diffractive element (e.g., DOE (diffractive optical element), HOE (holographic optical element)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (1233, 1234) may be placed within an electronic device (101) to guide a screen displayed by at least one display (1250) to the user's eye. For example, the screen may be transmitted to the user's eye based on total internal reflection (TIR) ​​occurring within at least one waveguide (1233, 1234).

[0194] The electronic device (101) can analyze an object included in a real-world image collected through a camera (1260-4), combine a virtual object corresponding to an object among the analyzed objects that is the target of augmented reality provision, and display it on at least one display (1250). The virtual object may include at least one of text and an image regarding various information related to the object included in the real-world image. The electronic device (101) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the electronic device (101) can perform spatial recognition (e.g., SLAM (simultaneous localization and mapping)) using a multi-camera and / or time-of-flight (ToF). A user wearing the electronic device (101) can view the image displayed on at least one display (1250).

[0195] According to one embodiment, the frame (1200) may be formed as a physical structure that allows the electronic device (101) to be worn on the user's body. According to one embodiment, the frame (1200) may be configured so that when the user wears the electronic device (101), the first display (1250-1) and the second display (1250-2) can be positioned corresponding to the user's left and right eyes. The frame (1200) may support at least one display (1250). For example, the frame (1200) may support the first display (1250-1) and the second display (1250-2) so that they are positioned corresponding to the user's left and right eyes.

[0196] Referring to FIG. 12a, the frame (1200) may include an area (1220) in which at least a portion of the frame contacts a part of the user's body when the user wears the electronic device (101). For example, the area (1220) of the frame (1200) in contact with a part of the user's body may include an area in contact with a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the electronic device (101) contacts. According to one embodiment, the frame (1200) may include a nose pad (1210) that contacts a part of the user's body. When the electronic device (101) is worn by the user, the nose pad (1210) may contact a part of the user's nose. The frame (1200) may include a first temple (1204) and a second temple (1205) that contact a different part of the user's body distinct from the part of the user's body.

[0197] For example, the frame (1200) may include a first rim (1201) covering at least a portion of a first display (1250-1), a second rim (1202) covering at least a portion of a second display (1250-2), a bridge (1203) positioned between the first rim (1201) and the second rim (1202), a first pad (1211) positioned along a portion of the edge of the first rim (1201) from one end of the bridge (1203), a second pad (1212) positioned along a portion of the edge of the second rim (1202) from the other end of the bridge (1203), a first temple (1204) extending from the first rim (1201) and fixed to a portion of the wearer's ear, and a second temple (1205) extending from the second rim (1202) and fixed to a portion of the ear opposite to the ear. The first pad (1211) and the second pad (1212) may come into contact with a part of the user's nose, and the first temple (1204) and the second temple (1205) may come into contact with a part of the user's face and a part of the ear. The temples (1204, 1205) may be rotatably connected to the rim through the hinge units (1206, 207) of FIG. 12b. The first temple (1204) may be rotatably connected to the first rim (1201) through a first hinge unit (1206) positioned between the first rim (1201) and the first temple (1204). The second temple (1205) may be rotatably connected to the second rim (1202) through a second hinge unit (1207) disposed between the second rim (1202) and the second temple (1205). According to one embodiment, the electronic device (101) may identify an external object (e.g., a user's fingertip) touching the frame (1200) and / or a gesture performed by said external object by using a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of the surface of the frame (1200).

[0198] According to one embodiment, the electronic device (101) may include hardware that performs various functions (e.g., processor, memory). For example, the hardware may include a battery module (1270), an antenna module (1275), at least one optical device (1282, 1284), speakers (e.g., speakers (1255-1, 1255-2)), a microphone (e.g., microphones (1265-1, 1265-2, 1265-3)), a light-emitting module (not shown), and / or a PCB (printed circuit board) (1290) (e.g., a printed circuit board). The various hardware may be placed within a frame (1200).

[0199] According to one embodiment, a microphone (e.g., microphones (1265-1, 1265-2, 1265-3)) of an electronic device (101) is positioned on at least a portion of a frame (1200) to acquire a sound signal. A first microphone (1265-1) positioned on a bridge (1203), a second microphone (1265-2) positioned on a second rim (1202), and a third microphone (1265-3) positioned on a first rim (1201) are shown in FIG. 12b, but the number and position of the microphones (1265) are not limited to the embodiment of FIG. 12b. If there are two or more microphones (1265) included in the electronic device (101), the electronic device (101) can identify the direction of the sound signal by using a plurality of microphones positioned on different portions of the frame (1200).

[0200] According to one embodiment, at least one optical device (1282, 1284) may project a virtual object onto at least one display (1250) to provide various image information to a user. For example, at least one optical device (1282, 1284) may be a projector. At least one optical device (1282, 1284) may be disposed adjacent to at least one display (1250) or included within at least one display (1250) as part of at least one display (1250). According to one embodiment, an electronic device (101) may include a first optical device (1282) corresponding to a first display (1250-1) and a second optical device (1284) corresponding to a second display (1250-2). For example, at least one optical device (1282, 1284) may include a first optical device (1282) positioned at the edge of a first display (1250-1) and a second optical device (1284) positioned at the edge of a second display (1250-2). The first optical device (1282) may transmit light to a first waveguide (1233) positioned on the first display (1250-1), and the second optical device (1284) may transmit light to a second waveguide (1234) positioned on the second display (1250-2).

[0201] In one embodiment, the camera (1260) may include a shooting camera (1260-4), an eye tracking camera (ET CAM) (1260-1), and / or a motion recognition camera (1260-2, 1260-3). The shooting camera (1260-4), the eye tracking camera (1260-1), and the motion recognition camera (1260-2, 1260-3) may be positioned at different locations on the frame (1200) and may perform different functions. The eye tracking camera (1260-1) may output data indicating the position of the eyes or the gaze of a user wearing the electronic device (101). For example, the electronic device (101) may detect the gaze from an image containing the user's pupils obtained through the eye tracking camera (1260-1). The electronic device (101) can identify an object focused by the user (e.g., a real object, and / or a virtual object) by using the user's gaze obtained through the gaze tracking camera (1260-1). The electronic device (101), having identified the focused object, can execute a function for interaction between the user and the focused object (e.g., gaze interaction). The electronic device (101) can represent a portion corresponding to the eyes of an avatar representing the user in a virtual space by using the user's gaze obtained through the gaze tracking camera (1260-1). The electronic device (101) can render an image (or screen) displayed on at least one display (1250) based on the position of the user's eyes. For example, the visual quality of a first region associated with the gaze within the image and the visual quality of a second region distinct from the first region (e.g., resolution, brightness, saturation, grayscale, PPI (pixels per inch)) may differ from each other. In the present disclosure, the term “resolution” is used to refer to the density of pixels of an image and / or display (1250).The density and / or resolution of the pixels may be measured based on units of PPI and / or dpi (dots per inch) or may be parameterized. The electronic device (101) may acquire an image having a visual quality of a first region and a visual quality of a second region that matches the user's gaze by using foveated rendering. For example, if the electronic device (101) supports an iris recognition function, user authentication may be performed based on iris information acquired using an eye-tracking camera (1260-1). An example in which the eye-tracking camera (1260-1) is positioned toward the user's right eye is illustrated in FIG. 12b, but the embodiment is not limited thereto, and the eye-tracking camera (1260-1) may be positioned solely toward the user's left eye or toward both eyes.

[0202] In one embodiment, the camera (1260-4) can capture a real image or background to be matched with a virtual image in order to implement augmented reality or mixed reality content. The camera (1260-4) can be used to acquire high-resolution images based on HR (high resolution) or PV (photo video). The camera (1260-4) can capture an image of a specific object located at the position viewed by the user and provide the image to at least one display (1250). The at least one display (1250) can display a single image in which information regarding a real image or background including the image of the specific object acquired using the camera (1260-4) and a virtual image provided through at least one optical device (1282, 1284) are superimposed. The electronic device (101) can compensate for depth information (e.g., the distance between the electronic device (101) and an external object acquired through a depth sensor) using the image acquired through the camera (1260-4). The electronic device (101) can perform object recognition through an image acquired using a shooting camera (1260-4). The electronic device (101) can perform a function of focusing on an object (or subject) in an image (e.g., auto focus) and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the shooting camera (1260-4). The electronic device (101) can perform a pass-through function to superimpose an image acquired through the shooting camera (1260-4) onto at least a portion of a screen representing a virtual space while displaying the screen representing a virtual space on at least one display (1250). In one embodiment, the shooting camera (1260-4) may be placed on a bridge (1203) positioned between a first rim (1201) and a second rim (1202).

[0203] The eye tracking camera (1260-1) can achieve more realistic augmented reality by tracking the gaze of a user wearing the electronic device (101), thereby matching the user's gaze with visual information provided to at least one display (1250). For example, when the user looks straight ahead, the electronic device (101) can naturally display environmental information related to the user's front on at least one display (1250) at the location where the user is situated. The eye tracking camera (1260-1) may be configured to capture an image of the user's pupil to determine the user's gaze. For example, the eye tracking camera (1260-1) may receive a gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the eye tracking camera (1260-1) may be positioned at locations corresponding to the user's left and right eyes. For example, the eye-tracking camera (1260-1) may be positioned within the first rim (1201) and / or the second rim (1202) to face the direction in which the user wearing the electronic device (101) is located.

[0204] A motion recognition camera (1260-2, 1260-3) can provide a specific event to a screen provided on at least one display (1250) by recognizing the movement of the user's entire body or part thereof, such as the user's torso, hands, or face. A motion recognition camera (1260-2, 1260-3) can recognize the user's gesture, acquire a signal corresponding to the gesture, and provide a display corresponding to the signal to at least one display (1250). A processor can identify the signal corresponding to the gesture and, based on the identification, perform a designated function. A motion recognition camera (1260-2, 1260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for a 6-degrees-of-freedom pose (6 dof pose). A processor can use the motion recognition camera (1260-2, 1260-3) to perform a gesture recognition function and / or an object tracking function. In one embodiment, a motion recognition camera (1260-2, 1260-3) may be placed on the first rim (1201) and / or the second rim (1202).

[0205] The camera (1260) included in the electronic device (101) is not limited to the eye-tracking camera (1260-1) and motion recognition camera (1260-2, 1260-3) described above. For example, the electronic device (101) can identify external objects included within the field of view (FoV) by using a camera positioned toward the user's field of view (FoV). The identification of external objects by the electronic device (101) can be performed based on a sensor for identifying the distance between the electronic device (101) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (1260) positioned toward the FoV can support an autofocus (AF) function and / or an optical image stabilization (OIS) function. For example, the electronic device (101) may include a camera (1260) (e.g., a face tracking camera) positioned toward the face to acquire an image including the face of a user wearing the electronic device (101).

[0206] Although not illustrated, according to one embodiment, the electronic device (101) may further include a light source (e.g., LED) that emits light toward a subject (e.g., user's eye, face, and / or an object outside the FoV) being photographed using a camera (1260). The light source may include an LED of infrared wavelength. The light source may be placed in at least one of the frame (1200) and hinge units (1206, 1207).

[0207] According to one embodiment, the battery module (1270) can supply power to the electronic components of the electronic device (101). In one embodiment, the battery module (1270) may be placed within the first temple (1204) and / or the second temple (1205). For example, the battery module (1270) may be a plurality of battery modules (1270). The plurality of battery modules (1270) may each be placed in the first temple (1204) and the second temple (1205), respectively. In one embodiment, the battery module (1270) may be placed at the end of the first temple (1204) and / or the second temple (1205).

[0208] The antenna module (1275) can transmit a signal or power to the outside of the electronic device (101) or receive a signal or power from the outside. In one embodiment, the antenna module (1275) may be placed within the first temple (1204) and / or the second temple (1205). For example, the antenna module (1275) may be placed close to one side of the first temple (1204) and / or the second temple (1205).

[0209] The speaker (1255) can output an acoustic signal to the outside of the electronic device (101). The acoustic output module may be referred to as the speaker. In one embodiment, the speaker (1255) may be placed within a first temple (1204) and / or a second temple (1205) to be positioned adjacent to the ear of a user wearing the electronic device (101). For example, the speaker (1255) may include a second speaker (1255-2) positioned adjacent to the user's left ear by being placed within the first temple (1204), and a first speaker (1255-1) positioned adjacent to the user's right ear by being placed within the second temple (1205).

[0210] A light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an action corresponding to a specific state in order to visually provide information regarding a specific state of the electronic device (101) to the user. For example, if the electronic device (101) requires charging, it may emit red light at a constant frequency. In one embodiment, the light-emitting module may be placed on the first rim (1201) and / or the second rim (1202).

[0211] Referring to FIG. 12b, according to one embodiment, an electronic device (101) may include a printed circuit board (PCB) (1290). The PCB (1290) may be included in at least one of a first temple (1204) or a second temple (1205). The PCB (1290) may include an interposer disposed between at least two sub-PCBs. On the PCB (1290), one or more hardware components (e.g., a processor, memory) included in the electronic device (101) may be disposed. The electronic device (101) may include a flexible PCB (FPCB) for interconnecting the hardware components.

[0212] According to one embodiment, the electronic device (101) may include at least one of a gyroscope sensor, a gravity sensor, and / or an acceleration sensor for detecting the posture of the electronic device (101) and / or the posture of a body part (e.g., head) of a user wearing the electronic device (101). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyroscope sensor may measure the angular velocity of each of the designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyroscope sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the electronic device (101) may identify motions and / or gestures of a user performed to execute or interrupt specific functions of the electronic device (101) based on the IMU.

[0213] FIGS. 13a and FIGS. 13b illustrate an example of the appearance of an electronic device.

[0214] The electronic device (101) of FIGS. 13a and FIGS. 13b may be an example of the electronic device (101) of FIGS. 12a and FIGS. 12b. For example, the electronic device (101) of FIGS. 13a and FIGS. 13b may be an example of the head-worn electronic device (101) of FIGS. 1a or the electronic device (1001) of FIGS. 10. For example, the electronic device (101) of FIGS. 13a and FIGS. 13b may be referred to as a wearable device, a head-worn electronic device, an HMD device, or an AR / VR device. According to one embodiment, an example of the appearance of a first surface (1310) of the housing of the electronic device (101) may be shown in FIG. 13a, and an example of the appearance of a second surface (1320) opposite to the first surface (1310) may be shown in FIG. 13b.

[0215] Referring to FIG. 13a, according to one embodiment, a first surface (1310) of an electronic device (101) may have a shape that is attachable to a part of a user's body (e.g., the face of the user). Although not illustrated, the electronic device (101) may further include a strap for fixing to a part of the user's body and / or one or more temples (e.g., a first temple (1204) and / or a second temple (1205) of FIG. 12a and FIG. 12b). A first display (1250-1) for outputting an image to the left eye among the user's two eyes, and a second display (1250-2) for outputting an image to the right eye among the two eyes may be disposed on the first surface (1310). The electronic device (101) may further include a rubber or silicone packing formed on the first surface (1310) to prevent interference by light different from light emitted from the first display (1250-1) and the second display (1250-2) (e.g., ambient light).

[0216] According to one embodiment, the electronic device (101) may include cameras (1260-1) for photographing and / or tracking both eyes of a user adjacent to each of the first display (1250-1) and the second display (1250-2). The cameras (1260-1) may be referenced to the eye-tracking camera (1260-1) of FIG. 12b. According to one embodiment, the electronic device (101) may include cameras (1260-5, 1260-6) for photographing and / or recognizing a user's face. The cameras (1260-5, 1260-6) may be referenced to FT cameras. The electronic device (101) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (1260-5, 1260-6). For example, the electronic device (101) can change the texture and / or shape of a part of an avatar (e.g., a part of an avatar representing a human face) by using information obtained by cameras (1260-5, 1260-6) (e.g., FT cameras) and representing the facial expression of a user wearing the electronic device (101).

[0217] Referring to FIG. 13b, on a second surface (1320) opposite to the first surface (1310) of FIG. 13a, a camera (e.g., cameras (1260-7, 1260-8, 1260-9, 1260-10, 1260-11, 1260-12)), and / or a sensor (e.g., a depth sensor (1330)) may be placed to acquire information related to the external environment of the electronic device (101). For example, cameras (1260-7, 1260-8, 1260-9, 1260-10) may be placed on the second surface (1320) to recognize external objects. The cameras (1260-7, 1260-8, 1260-9, 1260-10) can be referenced to the motion recognition cameras (1260-2, 1260-3) of FIG. 12b.

[0218] For example, using cameras (1260-11, 1260-12), the electronic device (101) can acquire images and / or videos to be transmitted to each of the user's two eyes. Camera (1260-11) may be placed on a second surface (1320) of the electronic device (101) to acquire an image to be displayed through a second display (1250-2) corresponding to the right eye among the two eyes. Camera (1260-12) may be placed on a second surface (1320) of the electronic device (101) to acquire an image to be displayed through a first display (1250-1) corresponding to the left eye among the two eyes. Cameras (1260-11, 1260-12) may be referenced to the shooting camera (1260-4) of FIG. 12b.

[0219] According to one embodiment, the electronic device (101) may include a depth sensor (1330) disposed on a second surface (1320) to identify the distance between the electronic device (101) and an external object. Using the depth sensor (1330), the electronic device (101) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the electronic device (101). Although not illustrated, a microphone may be disposed on the second surface (1320) of the electronic device (101) to obtain sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0220] The components of the electronic device (101) illustrated in FIGS. 12a through 13b are merely exemplary and the present disclosure is not limited thereto. For example, the electronic device (101) may further include at least one of the components illustrated in FIGS. 12a through 13b or may not include at least one. For example, the electronic device (101) may include the components in a region (or arrangement) different from the region (or arrangement) where the components illustrated in FIGS. 12a through 13b are located. For example, the electronic device (101) may include a number of components different from the number of each of the components (e.g., cameras or sensors) illustrated in FIGS. 12a through 13b.

[0221] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0222] As described above, the head-worn electronic device (101) may include a memory (340) that stores instructions and includes one or more storage media. The head-worn electronic device (101) may include at least one processor (310) that includes a processing circuit. The head-worn electronic device (101) may include a display (330) that includes a display area. The instructions may cause the head-worn electronic device (101) to identify text information of an image to be displayed on the display area of ​​the display (330) when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to determine the size of a central portion of the image to be displayed at a first resolution according to the text information when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to display the image on the display area based on the executed foveated rendering by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution.

[0223] According to one embodiment, the text information may include the number of characters included in the image. The instructions may cause the head-worn electronic device (101), when executed individually or collectively by the at least one processor (310), to determine the size of the central part of the image as a first size based on the number of characters less than a reference number. The instructions may cause the head-worn electronic device (101), when executed individually or collectively by the at least one processor (310), to determine the size of the central part of the image as a second size larger than the first size based on the number of characters greater than or equal to the reference number.

[0224] According to one embodiment, the central portion of the image may include a reference position of the image. The instructions may cause the head-worn electronic device (101) to perform optical character recognition (OCR) of the image to be displayed on the display area when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to identify the number of characters within a first portion defined from the reference position of the image and first arrangement information of the characters within the first portion based on the result of the OCR. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to identify the number of characters in a second part distinguished from the first part of the image and the second arrangement information of the characters in the second part based on the result of the OCR. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine whether the sum of the number of characters in the first part and the number of characters in the second part exceeds the reference number. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine the size of the center part of the image as the first size as it determines that the sum is less than the reference number.The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine the size of the central part of the image as the second size based on the first batch information and the second batch information, as the sum is greater than or equal to the reference number.

[0225] According to one embodiment, the reference position of the image may be the center position of the image. The first portion may include a portion within a first distance from the reference position of the image. The second portion may include a portion within a second distance longer than the first distance from the reference position of the image, which surrounds the first portion.

[0226] According to one embodiment, the second resolution may be determined according to a spatial information value representing a change in brightness values ​​for displaying the surrounding portion of the image.

[0227] According to one embodiment, the instructions may cause the head-worn electronic device (101) to identify the peripheral portion of the image as it determines the size of the central portion of the image when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to identify the spatial information value regarding the identified peripheral portion when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to determine the second resolution as the first resolution value according to the spatial information value which is the first value when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101), when executed individually or collectively by at least one processor (310), to determine the second resolution as a second resolution value that exceeds the first resolution value, according to the spatial information value that is a second value that exceeds the first value.

[0228] According to one embodiment, the second resolution may be determined according to a deviation value for grayscale levels for displaying the peripheral portion of the image.

[0229] According to one embodiment, the instructions may cause the head-worn electronic device (101) to identify the peripheral portion of the image as the size of the central portion of the image is determined, when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to identify first grayscale levels for marking a first line of the identified peripheral portion and second grayscale levels for marking a second line following the first line of the identified peripheral portion. The instructions may cause the head-worn electronic device (101) to identify the deviation value between the first grayscale levels and the second grayscale levels when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101) to determine the second resolution as a first resolution value according to the deviation value, which is a first value, when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101) to determine the second resolution as a second resolution value exceeding the first resolution value according to the deviation value, which is a second value exceeding the first resolution value, when the at least one processor (310) is executed individually or collectively.

[0230] According to one embodiment, the instructions may cause the head-worn electronic device (101) to control the display (330) to identify first data voltages for indicating a first line of the peripheral portion and second data voltages for indicating a second line following the first line of the peripheral portion when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to control the display (330) to identify the deviation value between the first data voltages and the second data voltages when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101) to control the display (330) to determine the second resolution as a first resolution value according to the deviation value, which is a first value, when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101) to control the display (330) to determine the second resolution as a second resolution value exceeding the first resolution value according to the deviation value, which is a second value exceeding the first value, when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101), when executed individually or collectively by at least one processor (310), to control the display (330) to render the central portion of the image having the size determined according to the text information at the first resolution, and to render the peripheral portion of the image surrounding the central portion of the image at the second resolution.

[0231] According to one embodiment, the size of the central part of the image can be determined according to the speed of movement of the head-worn electronic device (101).

[0232] According to one embodiment, the second resolution can be determined according to the speed of movement of the head-worn electronic device (101).

[0233] According to one embodiment, the instructions may cause the head-worn electronic device (101) to generate another image to be displayed on the display area of ​​the display (330) before the execution of the foveated rendering, when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to display the other image on the display area by rendering the other image at the first resolution before the execution of the foveated rendering, when the at least one processor (310) is executed individually or collectively.

[0234] According to one embodiment, the instructions may cause the head-worn electronic device (101) to execute the foveated rendering when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to determine the size of the central part of the image according to the text information when the mode of the executed foveated rendering is a first mode when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to display the image on the display area by rendering the central part of the image having the size determined according to the text information at the first resolution, and rendering the peripheral part of the image surrounding the central part of the image at the second resolution, when the mode of the executed foveated rendering is the first mode. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine the size of the central part of the image to a predetermined size when the mode of the executed foveated rendering is different from the first mode and is the second mode for low power consumption.The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to display the image on the display area by rendering the central part of the image having the predetermined size at the first resolution and the peripheral part of the image surrounding the central part of the image having the predetermined size at the predetermined third resolution, when the mode of the executed foveated rendering is different from the first mode and is a second mode for low power consumption.

[0235] A method performed by a head-worn electronic device (101) as described above may include an operation of identifying text information of an image to be displayed on a display area of ​​a display (330) of the head-worn electronic device (101). The method may include an operation of determining the size of a central portion of the image to be displayed at a first resolution according to the text information. The method may include an operation of displaying the image on the display area based on a foveated rendering performed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering a peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution.

[0236] A non-transient computer-readable storage medium as described above may store one or more programs including instructions that cause the head-wearing electronic device (101) to identify text information of an image to be displayed on the display area of ​​the display (330) when executed individually or collectively by at least one processor (310) of the head-wearing electronic device (101) having a display (330) including a display area. The non-transient computer-readable storage medium may store one or more programs including instructions that cause the head-wearing electronic device (101) to determine the size of the central portion of the image to be displayed at a first resolution according to the text information when executed individually or collectively by the at least one processor (310). The above non-transient computer-readable storage medium may store one or more programs including instructions that, when executed individually or collectively by the at least one processor (310), cause the head-worn electronic device (101) to display the image on the display area based on a foveated rendering executed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution.

[0237] As described above, the head-worn electronic device (101) may include a memory (340) that stores instructions and includes one or more storage media. The head-worn electronic device (101) may include at least one processor (310) that includes a processing circuit. The head-worn electronic device (101) may include a display (330) that includes a display area. The instructions may cause the head-worn electronic device (101) to identify the number of characters in an image to be displayed on the display area of ​​the display (330) based on the execution of foveated rendering when the at least one processor (310) is executed individually or collectively. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine the size of the central portion of the image to be displayed at a first resolution as a first size according to the number of characters less than the reference number. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to render the central portion of the image having the first size at the first resolution according to the number of characters less than the reference number, and to display the image on the display area by rendering the peripheral portion of the image surrounding the central portion of the image having the first size at a second resolution lower than the first resolution.The above instructions may cause the head-worn electronic device (101), when executed individually or collectively by the at least one processor (310), to determine the size of the central part of the image to be displayed at the first resolution as a second size larger than the first size, according to the number of characters greater than the reference number. The above instructions may cause the head-worn electronic device (101), when executed individually or collectively by the at least one processor (310), to display the image on the display area by rendering the central part of the image having the second size at the first resolution, according to the number of characters greater than the reference number, and rendering the peripheral part of the image surrounding the central part of the image having the second size at the second resolution.

[0238] According to one embodiment, the central portion of the image may include a reference position of the image. The instructions may cause the head-worn electronic device (101) to perform optical character recognition (OCR) of the image to be displayed on the display area when the at least one processor (310) is executed individually or collectively. The instructions may cause the head-worn electronic device (101) to identify the number of characters within a first portion defined from the reference position of the image and first arrangement information of the characters within the first portion based on the result of the OCR. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to identify the number of characters in a second part distinguished from the first part of the image and the second arrangement information of the characters in the second part based on the result of the OCR. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine whether the sum of the number of characters in the first part and the number of characters in the second part exceeds the reference number. The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine the size of the center part of the image as the first size as it determines that the sum is less than the reference number.The above instructions may cause the head-worn electronic device (101), when the at least one processor (310) is executed individually or collectively, to determine the size of the central part of the image as the second size based on the first batch information and the second batch information, as the sum is greater than or equal to the reference number.

[0239] According to one embodiment, the reference position of the image may be the center position of the image. The first portion may include a portion within a first distance from the reference position of the image. The second portion may include a portion within a second distance longer than the first distance from the reference position of the image, which surrounds the first portion.

[0240] According to one embodiment, the second resolution may be determined according to a spatial information value representing a change in brightness values ​​for displaying the surrounding portion of the image.

[0241] According to one embodiment, the second resolution may be determined according to a deviation value for grayscale levels for displaying the peripheral portion of the image.

[0242] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0243] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0244] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0245] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0246] Various embodiments of the present document may be implemented as software (e.g., program (1040)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1036) or external memory (1038)) readable by a machine (e.g., electronic device (1001)). For example, a processor (e.g., processor (1020)) of the machine (e.g., electronic device (1001)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0247] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0248] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In a head-worn electronic device, Memory that stores instructions and includes one or more storage media; At least one processor including a processing circuit; Includes a display including a display area, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: Identifying text information of an image to be displayed on the display area of ​​the above display; Based on the text information above, determine the size of the central portion of the image to be displayed at the first resolution; and Causing to display the image on the display area based on foveated rendering executed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution. Head-worn electronic device.

2. In Claim 1, The above text information includes the number of characters included in the above image, and When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: Based on the number of the above characters less than the reference number, the size of the central part of the above image is determined as the first size; and Causing the size of the central part of the image to be determined as a second size larger than the first size, based on the number of the characters being greater than or equal to the above standard number. Head-worn electronic device.

3. In Claim 2, The central portion of the above image includes a reference position of the above image, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: Perform optical character recognition (OCR) on the image to be displayed on the above display area; Based on the results of the above OCR: Identifying the number of characters within a first portion defined from the reference position of the above image and first arrangement information of the characters within the first portion, and Identifying the number of characters within a second part of the image distinguished from the first part and second arrangement information of the characters within the second part; Determining whether the sum of the number of characters in the first part and the number of characters in the second part exceeds the reference number; As it is determined that the above sum is less than the above reference number, the size of the central part of the above image is determined to be the first size; and As it is determined that the above sum is greater than or equal to the above reference number, causing the size of the above central part of the image to be determined as the second size based on the above first batch information and the above second batch information, Head-worn electronic device.

4. In Claim 3, The reference position of the above image is the center position of the above image, and The first portion above includes a portion within a first distance from the reference position of the image, and The second portion above surrounds the first portion and includes a portion within a second distance longer than the first distance from the reference position of the image. Head-worn electronic device.

5. In Claim 1, The second resolution is determined according to a spatial information value representing a change in brightness values ​​for displaying the surrounding portion of the image. Head-worn electronic device.

6. In Claim 5, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: By determining the size of the central part of the above image, the surrounding part of the above image is identified; Identifying the spatial information value regarding the aforementioned identified surrounding part; Based on the spatial information value which is the first value, the second resolution is determined as the first resolution value; and Causing the second resolution to be determined as a second resolution value exceeding the first resolution value according to the spatial information value, which is a second value exceeding the first value. Head-worn electronic device.

7. In Claim 1, The second resolution is determined according to the deviation value for the grayscale levels for displaying the peripheral portion of the image. Head-worn electronic device.

8. In Claim 7, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: By determining the size of the central part of the above image, the surrounding part of the above image is identified; Identifying first grayscale levels for displaying a first line of the identified surrounding portion and second grayscale levels for displaying a second line following the first line of the identified surrounding portion; Identifying the deviation value between the first grayscale levels and the second grayscale levels; Based on the deviation value which is the first value, the second resolution is determined as the first resolution value; and Causing the second resolution to be determined as a second resolution value exceeding the first resolution value according to the deviation value, which is a second value exceeding the first value. Head-worn electronic device.

9. In Claim 7, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: Control the display to identify first data voltages for displaying a first line of the above-mentioned peripheral portion and second data voltages for displaying a second line following the first line of the above-mentioned peripheral portion; Control the display to identify the deviation value between the first data voltages and the second data voltages; Control the display to determine the second resolution as the first resolution value according to the deviation value, which is the first value; Control the display to determine the second resolution as a second resolution value exceeding the first resolution value according to the deviation value, which is a second value exceeding the first value; and Causing the display to render the central portion of the image having the size determined according to the text information at the first resolution, and to render the peripheral portion of the image surrounding the central portion of the image at the second resolution. Head-worn electronic device.

10. In Claim 1, The size of the central part of the above image is determined according to the speed of movement of the head-worn electronic device. Head-worn electronic device.

11. In Claim 1, The second resolution is determined according to the speed of movement of the head-worn electronic device. Head-worn electronic device.

12. In Claim 1, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: Before executing the above foveated rendering: Generating another image to be displayed on the display area of ​​the above display; and Causing to display the other image on the display area by rendering the other image at the first resolution, Head-worn electronic device.

13. In Claim 1, When the above instructions are executed individually or collectively by at least one processor, the head-worn electronic device: Execute the above foveated rendering; If the mode of the above-executed foveated rendering is the first mode: Based on the text information above, the size of the central part of the image above is determined, and Displaying the image on the display area by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at the second resolution; and If the mode of the foveated rendering executed above is different from the first mode and is a second mode for low power consumption: The size of the central part of the above image is determined to be a predetermined size, and Causing the image to be displayed on the display area by rendering the central portion of the image having the above-determined size at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image having the above-determined size at the third resolution. Head-worn electronic device.

14. A method performed by a head-worn electronic device, An operation to identify text information of an image to be displayed on a display area of ​​the display of the head-worn electronic device; An operation to determine the size of the central portion of the image to be displayed at a first resolution according to the above text information; and The operation of displaying the image on the display area based on foveated rendering executed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution. method.

15. In a non-transient computer-readable storage medium, when executed individually or collectively by at least one processor of a head-worn electronic device having a display including a display area, the head-worn electronic device: Identifying text information of an image to be displayed on the display area of ​​the above display; Based on the text information above, determine the size of the central portion of the image to be displayed at the first resolution; and Storing one or more programs comprising instructions that cause the image to be displayed on the display area based on a foveated rendering executed by rendering the central portion of the image having the size determined according to the text information at the first resolution, and rendering the peripheral portion of the image surrounding the central portion of the image at a second resolution lower than the first resolution. Non-transient computer-readable storage media.

Images