Electronic device, method, and non-transitory computer-readable storage medium for compensating for chromatic aberration of display

Abstract

This head-mounted electronic device may comprise: at least one processor including a processing circuit; lenses disposed respectively with respect to eyes of a user wearing the head-mounted electronic device; display panels configured to emit light respectively toward the lenses; and a display driving circuit. The display driving circuit may be configured to: receive an image including a first portion corresponding to a first position of a display area of each of the display panels and a second portion corresponding to a second position of the display area; change a position of the display area at which the first portion of the image is to be displayed from the first position to a third position of the display area, and change a position of the display area at which the second portion of the image is to be displayed from the second position to a fourth position of the display area, thereby compensating for chromatic aberration of the light; and display the image in the display area.

Description

Electronic device, method and non-transitory computer-readable storage medium for compensating for chromatic aberration of a display

[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable storage media for compensating for chromatic aberration of a display.

[0002] An electronic device may include a display. For example, the electronic device may include a wearable device worn on a user's body. The display may be used to display images. The display may include a display panel and a display driving circuit. For example, chromatic aberration may occur depending on the optical properties of light emitted from the display panel.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0004] A head-worn electronic device may include at least one processor including a processing circuit. The head-worn electronic device may include lenses, each positioned relative to the eyes of a user wearing the head-worn electronic device. The head-worn electronic device may include display panels configured to respectively emit light toward the lenses. Each of the display panels may include a display area. The head-worn electronic device may include a display driving circuit. The display driving circuit may be configured to receive, from the at least one processor, an image including a first portion corresponding to a first position of the display area and a second portion corresponding to a second position of the display area. A distance between the first position and a reference position of the display area may be different from a distance between the second position and the reference position. The display driving circuit may be configured to compensate for chromatic aberration of the light by, based on receiving the image, changing a position of the display area where the first portion of the image is to be displayed from the first position to a third position of the display area, and changing a position of the display area where the second portion of the image is to be displayed from the second position to a fourth position of the display area. The display driving circuit may be configured to display the image in the display area based on the compensation for the chromatic aberration. The third position may be spaced apart from the first position by a first distance. The fourth position may be spaced apart from the second position by a second distance different from the first distance.

[0005] A method performed by a head-worn electronic device, comprising at least one processor including a processing circuit, lenses each positioned with respect to the eyes of a user wearing the head-worn electronic device, display panels each configured to emit light toward the lenses, and a display driving circuit, may include an operation in which the display driving circuit receives, from the at least one processor, an image including a first portion corresponding to a first position of a display area of ​​each of the display panels and a second portion corresponding to a second position of the display area. A distance between the first position and a reference position of the display area may be different from a distance between the second position and the reference position. The method may include an operation in which the display driving circuit compensates for chromatic aberration of the light by changing a position of the display area where the first portion of the image is to be displayed from the first position to a third position of the display area, and changing a position of the display area where the second portion of the image is to be displayed from the second position to a fourth position of the display area, based on receiving the image. The method may include an operation in which the display driving circuit displays the image in the display area based on the compensation for the chromatic aberration. The third position may be spaced apart from the first position by a first distance. The fourth position may be spaced apart from the second position by a second distance different from the first distance.

[0006] A non-transitory computer-readable storage medium may store one or more programs. The one or more programs may include instructions that, when executed by a head-worn electronic device having at least one processor, lenses each positioned relative to the eyes of a user wearing the head-worn electronic device, display panels each configured to emit light toward the lenses, and a display driving circuit, cause the display driving circuit to receive, from the at least one processor, an image including a first portion corresponding to a first position of a display area of ​​each of the display panels and a second portion corresponding to a second position of the display area. A distance between the first position and a reference position of the display area may be different from a distance between the second position and the reference position. The one or more programs may include instructions that, when executed by the head-worn electronic device, cause the display driving circuit to perform compensation for chromatic aberration of the light by, based on receiving the image, changing a location of the display area where the first portion of the image is to be displayed from the first location to a third location of the display area, and changing a location of the display area where the second portion of the image is to be displayed from the second location to a fourth location of the display area. The one or more programs may include instructions that, when executed by the head-worn electronic device, cause the display driving circuit to display the image in the display area based on the compensation for the chromatic aberration. The third location may be spaced apart from the first location by a first distance. The fourth location may be spaced apart from the second location by a second distance different from the first distance.

[0007] Figure 1 illustrates an example of chromatic aberration caused by the optical properties of light.

[0008] FIG. 2 illustrates an example in which at least one processor adjusts the position at which an image is displayed to compensate for chromatic aberration of light.

[0009] Figure 3 shows an example of a graph showing the deviation between the actual chromatic aberration and the result of linear compensation for chromatic aberration, depending on the distance from the reference position.

[0010] Figure 4 is a schematic view of an exemplary electronic device.

[0011] Figure 5 illustrates an example of a method for performing compensation for chromatic aberration depending on the distance between a position where a portion of an image is to be displayed and a reference position.

[0012] Figure 6 shows an example of an offset for compensation of chromatic aberration, depending on the distance between the position where a portion of the image is to be displayed and the reference position.

[0013] Figure 7 illustrates examples of positions corresponding to portions of an image to be displayed at specific positions in the display area of ​​a display panel.

[0014] Figure 8 illustrates an example of an image displayed by performing compensation for chromatic aberration according to the distance between a position where a portion of the image is to be displayed and a reference position.

[0015] Figure 9 illustrates an example of an operational flow for how a display driving circuit performs compensation for chromatic aberration.

[0016] FIG. 10 is a block diagram of an electronic device within a network environment according to various embodiments.

[0017] FIG. 11 is a block diagram of a display module according to various embodiments.

[0018] Figure 12a illustrates an example of a perspective view of an electronic device.

[0019] FIG. 12b illustrates an example of one or more hardware elements arranged within an electronic device.

[0020] Figures 13a and 13b illustrate an example of the appearance of an electronic device.

[0021] The terms used in this disclosure are merely used to describe specific embodiments and may not be intended to limit the scope of the present disclosure. Singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.

[0022] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.

[0023] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled. However, this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." Conditions described as "more than" may be replaced with "more than," conditions described as "less than," and conditions described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of the elements from A (including A) to B (including B).

[0024] Figure 1 illustrates an example of chromatic aberration caused by the optical properties of light.

[0025] FIG. 1 illustrates an example (100) of chromatic aberration caused by the optical properties of light (120) as light (120) passes through a lens (110). Although not illustrated in the example (100) of FIG. 1, light (120) may be emitted from a display area (or a light-emitting portion, a light-emitting element, a display portion) of an electronic device.

[0026] Referring to example (100), light (120) may include light (121) of a first color, light (122) of a second color, and light (123) of a third color. For example, the first color may include green (G) color. For example, the second color may include red (R) color. For example, the third color may include blue (B) color. However, the present disclosure is not limited thereto. For example, light (120) may further include light of a fourth color (e.g., white).

[0027] As a non-limiting example, the first color light (121), the second color light (122), and the third color light (123) may be emitted, for example, within one pixel included in the light-emitting portion. For example, the one pixel may include a plurality of sub-pixels. For example, the plurality of sub-pixels may include a first sub-pixel that emits the first color light (121), a second sub-pixel that emits the second color light (122), and a third sub-pixel that emits the third color light (123).

[0028] Referring to example (100), light (120) including light (121) of the first color, light (122) of the second color, and light (123) of the third color may be incident on the lens (110). For example, light (120) including light (121) of the first color, light (122) of the second color, and light (123) of the third color may be incident on the same location (111) of the lens (110). For example, light (120) including light (121) of the first color, light (122) of the second color, and light (123) of the third color may be refracted according to the properties of the lens (110). For example, light (121) of the first color may be refracted by a first angle. For example, the light (122) of the second color can be refracted at a second angle that is lower than the first angle. For example, the light (123) of the third color can be refracted at a third angle that is greater than the first angle. In other words, the light (120) can be refracted at different angles depending on the color (or wavelength). For example, the properties of the lens (110) can include the material (or refractive index) that constitutes the lens (110), the shape of the lens (110), or the thickness of the lens (110).

[0029] In the above example, the refraction caused when light (120) enters the lens (110) through the location (111) is described, but the present disclosure is not limited thereto. For example, light (120) may be refracted again at the location where it exits the lens (110).

[0030] As described above, the lights (121, 122, 123) can be spatially separated (or distinguished, separated, identified) from the light (120) by being refracted differently by the lens (110) while passing through the lens (110). At this time, the difference in the path (or position, direction) between the lights (121, 122, 123) can be referred to as chromatic aberration. Chromatic aberration can indicate that the lights (121, 122, 123) of the light (120) incident on the lens (110) do not focus at the same position (or fail to form a focus).

[0031] FIG. 2 illustrates an example in which at least one processor adjusts the position at which an image is displayed to compensate for chromatic aberration of light.

[0032] FIG. 2 illustrates an example in which at least one processor of the electronic device adjusts the position at which an image is to be displayed to compensate for chromatic aberration. For example, the at least one processor may be an application processor (AP).

[0033] Referring to FIG. 2, the at least one processor may generate raw data (200) for displaying the image. For example, the raw data (200) may be data received (or acquired, downloaded) from outside the electronic device or stored within the electronic device. For example, the raw data (200) may include data for the first color (G), data for the second color (R), and data for the third color (B). In the raw data (200), the locations where the data for the first color (G), the data for the second color (R), and the data for the third color (B) are to be displayed may be the same. For example, data for the first color (G), data for the second color (R), and data for the third color (B) may all be displayed at the same location (210) (or location (220), location (230)). In other words, data for the first color (G), data for the second color (R), and data for the third color (B) may all be displayed at the same location. For example, each of location (210), location (220), and location (230) may represent a location on a display area (or display portion, pixel, subpixel, or light-emitting portion) of a display panel of the electronic device. Location (210) may be referred to as a reference location or a reference pixel. As a non-limiting example, location (210) may be a center pixel of the display area of ​​the display panel. For example, each of position (210), position (220), and position (230) may correspond to a portion of the image (or a pixel of the image) composed of raw data (200).

[0034] Referring to FIG. 2, the at least one processor may generate correction data (250). For example, the at least one processor may generate correction data (250) using raw data (200) (or from raw data (200)). For example, the correction data (250), unlike the raw data (200), may include data in which the location at which data is to be displayed is adjusted by color (or by wavelength). For example, data for the first color (G), data for the second color (R), and data for the third color (B) may all be displayed at the same location (260). For example, with respect to the location (270), data for the first color (G) may be displayed at the location (271), data for the second color (R) may be displayed at the location (272), and data for the third color (B) may be displayed at the location (273). The location (270) may be an area including locations (271, 272, 273). For example, with respect to the location (280), data for the first color (G) may be displayed at the location (281), data for the second color (R) may be displayed at the location (282), and data for the third color (B) may be displayed at the location (283). The location (280) may be an area including locations (281, 282, 283). Referring to the correction data (250), the further away from the reference location (260), the more the difference between the locations at which the data for the first color (G), the data for the second color (R), and the data for the third color (B) are displayed may increase. In other words, since the degree of compensation required (or the degree of distortion, the degree of error) increases as one moves from the center area of ​​the display area of ​​the display panel to the outer area, compensation can be performed to reduce chromatic aberration.

[0035] To reduce (or compensate for, eliminate, or prevent) chromatic aberration as described above, correction data (250) may be generated through processing. For example, the processing may include an operation using a regression model (hereinafter, a regression operation), an operation using a linear product (hereinafter, a linear operation), or an operation using a look-up table (LUT) (hereinafter, a LUT operation).

[0036] For example, the regression operation may utilize a polynomial for the difference between the coordinates before correction and the position (or coordinates) of a reference pixel for the position (or coordinates) of each pixel, a correction coefficient (K), and the size (or radius) (r) of the display area of ​​the display panel, in order to compensate for chromatic aberration. However, the regression operation may require a high amount of computation since it requires an operation based on a polynomial of multiple degrees. Accordingly, the at least one processor may use a relatively large amount of resources to perform the regression operation.

[0037] For example, the LUT operation may utilize a LUT including a compensation value specified according to the position of each pixel. The LUT operation may require less computation than the regression operation. However, the accuracy of chromatic aberration compensation may be low, and a LUT value corresponding to each of all pixels in the display area may be required. In addition, a separate LUT may be required for each of R data, G data, and B data. Accordingly, the at least one processor may need to store all LUTs having a relatively large size for the LUT operation, which may utilize a relatively large amount of resources.

[0038] For example, the linear operation may perform additional scaling for each color (e.g., the second color (R) or the third color (B)) from a position corrected based on a reference color (e.g., the first color (G)). For example, the linear association may be referred to by the following mathematical equation.

[0039]

[0040] For example, the above P red The location where the data of the second color is to be displayed is K red is a scaling value for the second color, and the P green The first color (or reference color) data may indicate a location where the data is to be displayed. In the above mathematical formula, an example of a linear operation for the second color is described, but the present disclosure is not limited thereto. For example, the linear operation for the second color may be applied substantially identically to the linear operation for the third color. For example, the scaling value (K) for the third color blue ) and the location where the data of the first color (or reference color) will be displayed (P green ), the location where the data of the third color will be displayed (P blue ) can be determined.

[0041] As mentioned above, the linear operation has the same scaling value (K) regardless of where the data is displayed. red ) can be applied. However, even if linear operations are performed, complete compensation for chromatic aberration may not be possible. Specific details regarding the deviation between compensation data (250) according to the linear operations and the chromatic aberration actually caused are exemplified and described below with reference to FIG. 3.

[0042] Figure 3 shows an example of a graph showing the deviation between the actual chromatic aberration and the result of linear compensation for chromatic aberration, depending on the distance from the reference position.

[0043] FIG. 3 illustrates a graph (300) representing a deviation between a result of compensation for chromatic aberration according to a linear operation and actual chromatic aberration according to a distance from a reference position (e.g., position (210) or position (260) of FIG. 2). For example, the horizontal axis of the graph (300) represents a normalized distance from the reference position to any position in the display area on the x-axis. The vertical axis of the graph (300) represents a deviation between the chromatic aberration caused by the result compensated for according to the linear operation and the chromatic aberration actually occurring. For example, the unit of the deviation may be mm (millimeter).

[0044] The graph (300) includes a first line (310) representing a deviation for positions on the x-axis having the same y-axis coordinate as the reference position (e.g., (0, 0)), for example, (a, 0), where a is an arbitrary value; a second line (320) representing a deviation for positions on the x-axis having y-axis coordinates spaced apart from the reference position by a specified distance on the y-axis (e.g., (a, 0.5), where a is an arbitrary value); and a third line (330) representing a deviation for positions on the x-axis having y-axis coordinates that are located farthest from the reference position on the y-axis within the display area.

[0045] Referring to the graph (300), the first line (310) may be 0 regardless of the position on the x-axis. In other words, positions on the x-axis may have substantially the same chromatic aberration compensated for by linear operation and actual chromatic aberration. The second line (320) may have the maximum deviation (e.g., about -0.018) when a is 0. The second line (320) may have a decreased deviation as a increases. The third line (330) may have a low level of deviation (e.g., about -0.001) when a is 0. The third line (330) may have a deviation that repeats increasing and decreasing as a increases. Considering the first line (310) to the third line (330), chromatic aberration may be caused even if compensation for chromatic aberration is performed by linear operation. Even if the deviation representing chromatic aberration is several micrometers to several tens of micrometers, the chromatic aberration caused by the deviation can be easily recognized in an electronic device having a display panel with a small display area. As a non-limiting example, an electronic device having a display panel (or microdisplay, e.g., organic light emitting diode on silicon (OLEDoS), LED on silicon (LEDoS)) with a small display area may include a head-worn electronic device, such as an AR device or a VR device.

[0046] Additionally, when the resolution of an image processed by at least one processor of the electronic device increases, the driving frequency of the at least one processor may be lowered. The resolution and the driving frequency may define a transmission bandwidth between a display driving circuit connected to the at least one processor and the at least one processor. Accordingly, in the limited transmission bandwidth, as the resolution increases, the driving frequency may be lowered. Accordingly, as the resolution of the image processed by the at least one processor increases, the processing time and resources for compensating for chromatic aberration increase, and the driving frequency of the at least one processor may be limited.

[0047] Hereinafter, the present disclosure can perform chromatic aberration compensation in the display driver circuit instead of performing it in at least one processor. By performing chromatic aberration compensation in the display driver circuit, the present disclosure can efficiently utilize the transmission bandwidth between the at least one processor and the display driver circuit. In addition, the present disclosure can accurately compensate for chromatic aberration according to the position within the display area of ​​the display panel by further utilizing an offset for accurately compensating for chromatic aberration according to the position at which data is to be displayed within the display area of ​​the display panel. At this time, by defining the offset for each section of the display area of ​​the display panel, the calculation for compensating for chromatic aberration can be simplified. In addition, the present disclosure can accurately compensate for chromatic aberration by utilizing compensation values ​​(including the offset value) for more accurate compensation using information about the position of the user's eyes. In addition, the present disclosure can accurately compensate for chromatic aberration by further utilizing information about additional lenses for vision correction of the user's eyes. Accordingly, the image quality of the image displayed to the user can be improved.

[0048] Figure 4 is a schematic view of an exemplary electronic device.

[0049] FIG. 4 illustrates an example of an electronic device (400) for performing chromatic aberration compensation. The electronic device (400) of FIG. 4 may be an example of the electronic device (1001) of FIG. 10. For example, the electronic device (400) may include at least a portion of the electronic device (1001) or correspond to at least a portion of the electronic device (1001).

[0050] For example, the electronic device (400) may be implemented in various form factors. For example, the electronic device (400) may include a wearable device (or, a head mounted display (HMD), a head-wearable electronic device) worn on the user's head. For example, the wearable device may include an augmented reality (AR) device or a virtual reality (VR) device. However, the present disclosure is not limited thereto. For example, the electronic device (400) may include not only an electronic device including the display of the bar type, but also an electronic device including the display that is a flexible display. For example, the flexible display may include a rollable display, a foldable display, or a multi-foldable display.

[0051] The electronic device (400) may include at least one processor (410), a display driving circuit (420), a display panel (430), and a lens (440). The components (e.g., at least one processor (410), the display driving circuit (420), the display panel (430), and the lens (440)) are merely exemplary. For example, the electronic device (400) may include other components (e.g., memory, power management integrated circuitry (PMIC), or a rechargeable battery). For example, some components may be omitted from the electronic device (400). For example, some components may be integrated into one component. The display driving circuit (420) and the display panel (430) (and / or the lens (440)) may be referred to as a display.

[0052] At least one processor (410) may be implemented as one or more integrated circuit (IC) chips and may perform various data processing operations. At least one processor (410) may include at least one electrical circuit and may individually or collectively perform distributed processing of instructions (or programs, data, etc.) stored in a memory. At least one processor (410) may include a processor assembly including one or more processing circuits. At least one processor (410) may include any processing circuit operative to control the performance and operations of one or more components (e.g., memory and / or display) of the electronic device (400). For example, at least one processor (410) (e.g., application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or a single chipset). For example, at least one processor (410) may be implemented with multiple cores (or multiple core circuits), multiple chips, or multiple chip sets. For example, at least one processor (410) may include one or more processing circuits configured to individually and / or collectively perform various functions of the present disclosure.

[0053] For example, at least one processor (410) may include a central processing unit (CPU) (e.g., including processing circuitry) and a display processing unit (DPU) (e.g., including processing circuitry). The components (e.g., the CPU and the DPU) of the at least one processor (410) are merely exemplary. For example, the at least one processor (410) may further include other components (e.g., a memory controller (or memory control circuit) for memory and a storage controller (or storage control circuit) for memory). For example, some of the components (e.g., the DPU) of the at least one processor (410) may be omitted from the at least one processor (410). For example, the at least one processor (410) may further include a graphics processing unit (GPU) (e.g., including processing circuitry).

[0054] At least one processor (410) may cause other components of the electronic device (400) to perform various operations by executing instructions stored in the memory. For example, the CPU (or central processing circuit) may be configured to control other components (e.g., a DPU) of the at least one processor (410) based on the execution of instructions stored in the memory. For example, the at least one processor (410) may include at least a portion of the processor (1020) of FIG. 10 or may correspond to at least a portion of the processor (1020) of FIG. 10.

[0055] The memory may include one or more storage media (or one or more storage devices). For example, the memory may include a memory assembly including one or more storage media. For example, the one or more storage media may include a hard drive, flash memory, permanent memory such as read-only memory (ROM), semi-permanent memory such as random access memory (RAM), any other suitable type of storage (or storage assembly), or any combination thereof. The memory may include cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (400). As a non-limiting example, the cache memory may be included within the processor (410). The memory may be fixedly embedded within the electronic device (400) or incorporated into one or more suitably types of components (e.g., a subscriber identity module (SIM) card and / or a secure digital (SD) card) that can be repeatedly inserted into and removed from the electronic device (400). For example, the memory may include at least a portion of the memory (1030) of FIG. 10 or correspond to at least a portion of the memory (1030) of FIG. 10.

[0056] For example, the memory may store one or more software applications, such as an operating system (or system software application), a firmware software application, a driver software application, a plug-in (e.g., add-in, add-on, and / or applet) software application, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by at least one processor (410). For example, the memory may store instructions callable by an application programming interface (API). For example, the memory may store instructions within a library.

[0057] The display may be used to display an image. As a non-limiting example, the display may include a display driving circuit (420) and a display panel (430) for displaying an image. As a non-limiting example, the display may include a display driving circuit (420), a display panel (430), and a lens (440). In the example of FIG. 4, an electronic device (400) including one display panel (430) and one lens (440) is illustrated, but the present disclosure is not limited thereto. For example, an electronic device (400) that is a wearable device (or a head-mounted electronic device) may include lenses (or two lenses) each positioned relative to a user's eyes. The electronic device (400) may include display panels (or two display panels) configured to respectively emit light toward the lenses. Each of the display panels may include a display area. The above display area may include a plurality of pixels (each of which includes sub-pixels).

[0058] The display driving circuit (420) can receive data regarding an image from at least one processor (410). The data can be transmitted from the at least one processor (410) to the display driving circuit (420) via an interface. For example, the interface (e.g., including at least one circuit) can include (or support) a mobile industry processor interface (MIPI). As a non-limiting example, the interface can include a serial peripheral interface (SPI), a universal asynchronous receiver / transmitter (UART), an inter-integrated circuit (I2C), or an improved inter-integrated circuit (I3C).

[0059] The display driving circuit (420) may include a GRAM (421), a register (423), and an IP (image processor) (425). The components included in the display driving circuit (420) (e.g., the GRAM (421), the register (423), and the IP (image processor) (425)) are merely exemplary. For example, the electronic device (400) may include other components (e.g., a gate driver circuit, a source driver circuit, and a light emitting driver circuit). For example, some components may be omitted from the electronic device (400). For example, some components may be integrated into a single component. For example, the GRAM (421) and the register (423) may be implemented as a single memory.

[0060] For example, the GRAM (421) may be used to store or record the image obtained from at least one processor (410). For example, the GRAM (421) may store data for the image obtained from at least one processor (410) (e.g., data for a first color (G) (or G data), data for a second color (R) (or R data), and data for a third color (B) (or B data)). The GRAM (421) may be included in the memory (1030) of FIG. 10. For example, the GRAM (421) may be referred to as a memory buffer, a buffer, or an image buffer.

[0061] For example, the register (423) can store compensation values ​​to be applied to data for the image. For example, the compensation values ​​can include values ​​for performing compensation for chromatic aberration. For example, the compensation values ​​can include a scaling value (e.g., K) to be applied to a location where data of a reference color (e.g., G) is to be displayed. red , K blue ) and may include offsets (e.g., αred, αblue) determined based on the distance for each color. For example, the compensation values ​​may be a pair of a scaling value and an offset. As a non-limiting example, the pairs of compensation values ​​may be implemented as LUTs. For example, the register (423) may store a plurality of LUTs. For example, the register (423) may be referred to as additional memory, side memory, side buffer, or compensation memory.

[0062] For example, each of the LUTs may be further defined using sensing data for the user's eyes. For example, the display driving circuit (420) may receive sensing data that measures (or tracks) the position and direction (or gaze direction) of the eyes obtained using at least one sensor included in the electronic device (400), and select one of the LUTs using the sensing data. As a non-limiting example, the LUTs may include a first LUT according to a first condition for the position and direction of the eyes (e.g., a direction in which the eyes are rotated by 10° with respect to the front), and a second LUT according to a second condition for the position and direction of the eyes (e.g., a direction in which the eyes are rotated by 15° with respect to the front). The display driving circuit (420) may use the first LUT to compensate for chromatic aberration when it is determined that the current direction of the eyes identified according to the sensing data is the first condition. The display driving circuit (420) may, after selecting the first LUT, use an LUT that has been changed (or optimized) from the first LUT using an algorithm such as an interpolation method or a maximum approximation method for more accurate compensation.

[0063] For example, each of the LUTs may be further defined using information of additional lenses for vision correction of the user's eyes. For example, the electronic device (400) may include additional lenses for vision correction in addition to the lens (440). For example, each of the additional lenses (e.g., two additional lenses) may be positioned with respect to each of the display panels. For example, the display driver circuit (420) may further compensate for chromatic aberration that may be caused by the additional lenses. For example, the display driver circuit (420) may store the LUTs defined according to the information of the additional lenses in the register (423). The display driver circuit (420) may perform compensation for chromatic aberration by selecting an LUT from among the stored LUTs upon detecting that the additional lenses are inserted. For example, the information of the additional lenses may include identification information of the additional lenses, the thickness and shape of the additional lenses, or vision correction information.

[0064] For example, the display driver circuit (420) may perform compensation for chromatic aberration using an LUT selected from among the plurality of LUTs of the register (423) based on receiving the image from at least one processor (410). However, the present disclosure is not limited thereto. For example, instead of selecting an LUT from among the plurality of LUTs, the display driver circuit (420) may identify (or calculate) compensation values ​​to be used for compensation for chromatic aberration based on the image, properties of the lens (440), and the display panel (430), and may use the identified compensation values. For example, compensation for chromatic aberration may be referred to as chromatic aberration compensation (CAC).

[0065] For example, the display driving circuit (420) may receive an image (or data for an image) on which chromatic aberration compensation for a reference color has been performed, from at least one processor (410). As a non-limiting example, the reference color may be a first color (G), and the colors may be a second color (R) and a third color (B). Since the wavelength of light of the first color (G) has a length between the wavelengths of light of the second color (R) and light of the third color (B), for convenience of description, the present disclosure describes the first color (G) (or color channel) as the reference color (or reference color channel), but is not limited thereto. In other words, compensation for chromatic aberration for the reference color may be performed by at least one processor (410). For example, at least one processor (410) may generate data for an image for which compensation for the reference color has been performed from raw data for the image using distortion information stored in advance according to the properties of the lens (440). For example, the distortion information may be defined to compensate for a position at which the first color (G) changes (or a position at which it will be refracted) as light passes through the lens (440). As a non-limiting example, the distortion information may include a value at which light of the first color (G) is refracted by the lens (440). For example, the distortion information may be actually measured or generated and stored based on a simulation.

[0066] For example, the distortion information may be stored within the electronic device (400) (or within at least one processor (410) and the display driving circuit (420)) before data for the image is transmitted from at least one processor (410) to the display driving circuit (420). For example, the distortion information may be stored within a register (423) of the display driving circuit (420) and the memory of at least one processor (410).

[0067] The display driving circuit (420) may decompress the compressed image (or data for the image) when the image (or data for the image) received from at least one processor (410) is compressed. For example, according to the decompression, the compressed image (or data for the image) may include a value corresponding to a position (or pixel) according to the coordinate system of the display area of ​​the display panel (430).

[0068] The display driving circuit (420) can store an image (or data for an image) received from at least one processor (410) in the GRAM (421). The display driving circuit (420) can compensate for chromatic aberration by applying the compensation values ​​to the image stored in the GRAM (421). The compensation for chromatic aberration performed in the display driving circuit (420) can represent compensation for colors different from a reference color. For example, the display driving circuit (420) can identify the compensation for chromatic aberration performed on the data of the first color (G) by the at least one processor (410) by loading the distortion information for the reference color stored in the register (423). For example, the display driving circuit (420) can, by using the distortion information, identify a location (P) where data for the first color (G) of the image is to be displayed. green) can be identified. In the above example, the distortion information is described as being stored in the register (423), but the present disclosure is not limited thereto. For example, the distortion information may be received from at least one processor (410).

[0069] The display driving circuit (420) positions (P) the scaling values ​​of each color different from the reference color. green ) can be applied. For example, the display driving circuit (420) can be applied to the position (P`) of the data of the second color (R). red ), a first scaling value (K) for the second color (R) is used to identify the red ) is located (P green ) can be applied to the first scaling value (K red ) is located (P green ) may involve a multiplication operation. For example, the position (P` red ) is the first scaling value (K red ) and location (P green ) can be calculated according to the multiplication operation between them. In addition, for example, the display driving circuit (420) can calculate the position (P`) of the data of the third color (B). blue ) to identify the second scaling value (K) for the third color (B). blue ) is located (P green ) can be applied to the second scaling value (K blue ) is located (P green ) may involve a multiplication operation. For example, the position (P` blue ) is the second scaling value (K blue ) and location (P green ) can be calculated according to the multiplication operation between them. As a non-limiting example, when the multiplication operation is performed, the positions may be calculated after being simplified to normalized positions.

[0070] The display driving circuit (420) sets the offset of each color different from the reference color at positions (P`) red , P` blue ) can be further applied. For example, the display driving circuit (420) can be further applied to the location (P) where data of the second color (R) is to be displayed. red ), a first offset (α) for the second color (R) is used to identify the red ) is located at position (P`) red ) can be applied to the first offset (α red ) is located at position (P`) red ) may include a sum operation. The location (P) where the data of the second color (R) will be displayed red ) is the location (P`) red ) and the first offset (α red ) can be calculated according to the sum of the three colors (B). For example, the display driving circuit (420) can be used to determine the location (P) where the data of the third color (B) will be displayed. blue ) to identify the second offset (α) for the third color (B). blue ) is located at position (P`) blue ) can be applied to the second offset (α blue ) is located at position (P`) blue ) may include a sum operation. The location (P) where the data of the third color (B) will be displayed blue ) is the location (P`) blue ) and the second offset (α blue ) can be calculated according to the sum of

[0071] Location where data of the second color (R) will be displayed (P) red ) and the location where the data of the third color (B) will be displayed (P blue ), the following mathematical formulas can be illustrated.

[0072]

[0073]

[0074] For example, the first scaling value (K red ), the second scaling value (K blue ), first offset (α red ), and the second offset (α blue ) can be referenced as compensation values. As a non-limiting example, the compensation values ​​can be implemented as a LUT. As a non-limiting example, the first offset (α red ), and the second offset (α blue ) each has a position (P) from the reference position (or reference pixel). green ) can be determined based on the distance between them. Alternatively, the first offset (α red ), and the second offset (α blue ) each, the location (P green ) can be defined by the first offset (α red ), and the second offset (α blue ) are exemplified and explained with reference to Fig. 6.

[0075] The display driving circuit (420) can repeatedly perform compensation for chromatic aberration for each of all pixels (or sub-pixels) within the display area of ​​the display panel (430). According to the compensation for chromatic aberration, the position (P) where data of the second color (R) is to be displayed red ) and the location where the data of the third color (B) will be displayed (P blue ) can be referred to as remapping for pixels. However, the present disclosure is not limited thereto. For example, the display driving circuit (420) may reduce the image using a ratio according to the resolution of the image stored in the GRAM (421), and then compensate for chromatic aberration on the reduced image.

[0076] The display driving circuit (420) can transmit an image on which chromatic aberration has been compensated to the IP (425). For example, the display driving circuit (420) can perform image processing, such as image quality compensation, on the image on which chromatic aberration has been compensated using (or by controlling) the IP (425). For example, the IP (425) can adjust the resolution, brightness, and / or size of the image. For example, the IP (425) can be included in the image processing module (1135) of FIG. 11.

[0077] The display driving circuit (420) can display the image on which chromatic aberration compensation and image quality compensation have been performed on the display panel (430). For example, the display driving circuit (420) can include at least a part of the display driver IC (1130) of FIG. 11 or correspond to at least a part of the display driver IC (1130) of FIG. 11.

[0078] The display panel (430) can display an image under the control of the display driving circuit (420). For example, the display panel (430) can include pixels within a display area. For example, each of the pixels can include sub-pixels. For example, each of the sub-pixels can include a driving transistor and a light-emitting element. For example, the display panel (430) can display an image according to a gate voltage and a source voltage from the display driving circuit (420). For example, the display panel (430) can include at least a portion of the display panel (1110) of FIG. 11 or correspond to at least a portion of the display panel (1110) of FIG. 11.

[0079] The lens (440) can pass light emitted from the display panel (430). The lens (440) can be used to provide the light to each of the user's eyes by passing the light emitted from the display panel (430). The lens (440) can be referred to as an optical element. As a non-limiting example, the lens (440) can be formed in a circular shape. Accordingly, the chromatic aberration can be formed in a circular symmetry. An electronic device (400) including a lens (440) formed in a circular shape can compensate for the chromatic aberration formed in a circular symmetry through a more simplified calculation. Since the chromatic aberration is formed symmetrically about a circle, an offset (e.g., a first offset (α)) can be calculated by using only the distance from a reference position (e.g., a center position). red ), and the second offset (α blue )) can be defined. Accordingly, the accuracy of compensation can be increased (or the error rate can be decreased) and the complexity of the operation can be reduced. In addition, the storage space required for compensation values ​​and LUTs can be reduced. For example, it can be an example of a lens included in at least one display (1250) of FIGS. 12A and 12B.

[0080] The display driving circuit (420) may determine whether to perform compensation for the chromatic aberration. For example, the display driving circuit (420) may refrain from performing (or stop, bypass) compensation for the chromatic aberration in order to prevent other types of image quality degradation caused by performing compensation for the chromatic aberration. As a non-limiting example, the display driving circuit (420) may refrain from performing (or stop, bypass) compensation for the chromatic aberration (or compensation for chromatic aberration for colors different from a reference color) performed within the display driving circuit (420) when performing additional image processing according to the IP (425). Accordingly, the compensation for the chromatic aberration performed in the display driving circuit (420) may be performed in at least one processor (410).

[0081] At least one processor (410) can perform both the compensation for chromatic aberration (or the compensation for chromatic aberration for colors different from a reference color) and the compensation for chromatic aberration for the reference color performed in the display driver circuit (420), depending on a computational amount of the at least one processor (410). As a non-limiting example, the at least one processor (410) can identify the computational amount of the at least one processor (410), and, if the identified computational amount exceeds a reference computational amount, control the display driver circuit (420) to perform the compensation for chromatic aberration (or the compensation for chromatic aberration for colors different from a reference color) (or, the display driver circuit (420) can keep performing the compensation for chromatic aberration (or the compensation for chromatic aberration for colors different from a reference color)). At least one processor (410) may perform both the compensation for chromatic aberration (or compensation for chromatic aberration for colors different from the reference color) and the compensation for chromatic aberration for the reference color, which are performed in the display driving circuit (420), when the identified amount of calculation is less than the reference amount of calculation. In this case, at least one processor (410) may transmit an image in which chromatic aberration compensation for all colors has been completed to the display driving circuit (420). In order to perform chromatic aberration compensation for all colors, at least one processor (410) may store compensation values ​​stored in the register (423) in the memory. For example, the amount of calculation may be calculated based on the remaining resources or the processing speed of at least one processor (410).

[0082] Figure 5 illustrates an example of a method for performing compensation for chromatic aberration depending on the distance between a position where a portion of an image is to be displayed and a reference position.

[0083] FIG. 5 illustrates an example of a method for performing compensation for chromatic aberration by changing the position at which an image is displayed in the display area of ​​a display panel (430).

[0084] Referring to FIG. 5, an example (501) illustrates locations (510, 520) at which an image received from at least one processor (410) is to be displayed in a display area of ​​a display panel (430). For example, the image may include data for which compensation has been performed for a first color (G), which is a reference color. For example, the first location (510) may indicate a location at which a first portion of the image is to be displayed, and the second location (520) may indicate a location at which a second portion of the image is to be displayed. For example, the first portion may include data for a first color (G), data for a second color (R), and data for a third color (B). For example, the second portion may include data for a first color (G), data for a second color (R), and data for a third color (B). For example, the first position (510) may be spaced apart from the reference position (550) by a first distance (551). The second position (520) may be spaced apart from the reference position (550) by a second distance (552). For example, the reference position (550) may include the center position (or center pixel) of the display area of ​​the display panel (430). In example (501), the second distance (552) may be longer than the first distance (551).

[0085] The display driving circuit (420) can perform primary compensation for chromatic aberration using the scaling values ​​of the second color (R) and the third color (B), which are different from the first color (G), which is the reference color, for the image of example (501). The result according to the primary compensation can be referred to example (502).

[0086] Referring to example (502), the display driving circuit (420) can change the position at which data for the second color (R) of the first part to be displayed at the first position (510) is to be displayed from the first position (510) to the position (511). The display driving circuit (420) can change the position at which data for the third color (B) of the first part to be displayed at the first position (510) to the position (512). Data for the first color (G) of the first part can be displayed at the first position (510) for which compensation has already been completed. The distance (531) between the first position (510) and the position (511) is a first scaling value (K) for the second color (R). red ) can be determined. The distance (532) between the first position (510) and the position (512) is determined by the second scaling value (K) for the third color (B). blue ) can be determined.

[0087] In addition, the display driving circuit (420) can change the position at which data for the second color (R) of the second part to be displayed at the second position (520) is to be displayed from the second position (520) to the position (521). The display driving circuit (420) can change the position at which data for the third color (B) of the second part to be displayed at the second position (520) to the position (522). Data for the first color (G) of the second part can be displayed at the second position (520) for which compensation has already been completed. The distance (531) between the second position (520) and the position (521) is a first scaling value (K) for the second color (R). red ) can be determined. The distance (532) between the second position (520) and the position (522) is determined by the second scaling value (K) for the third color (B). blue ) can be determined.

[0088] Referring to Example (502), regardless of the first distance (551) and the second distance (552), the distances (531, 532) from the first location (510) to the locations (511, 512) may be equal to (or correspond to) the distances (531, 532) from the second location (520) to the locations (521, 522). This may be because the scaling value according to color is applied equally regardless of the distance. In other words, Example (502) may represent a result according to a linear operation.

[0089] In the present disclosure, the display driving circuit (420) can further perform secondary compensation (or additional compensation) for chromatic aberration by further utilizing an offset in the result of linear operation. The result of secondary compensation may be referred to as example (503).

[0090] Referring to example (503), the display driving circuit (420) can change the position at which data for the second color (R) of the first part to be displayed at the first position (510) is to be displayed from the first position (510) to the position (511a). Alternatively, the display driving circuit (420) can change the position at which data for the second color (R) of the first part is to be displayed from the position (511) to the position (511a). The display driving circuit (420) can change the position at which data for the third color (B) of the first part to be displayed at the first position (510) to the position (512a). Alternatively, the display driving circuit (420) can change the position at which data for the third color (B) of the first part is to be displayed from the position (512) to the position (512a). Data for the first color (G) of the first part may be displayed at the first location (510) where compensation has already been completed. The distance (541a) between the first location (510) and the location (511a) may be a first scaling value (K) for the second color (R). red), and the first offset (αred) according to the second color (R) and the first distance (551). The distance (542a) between the first position (510) and the position (512a) may be determined by the first scaling value (K) for the third color (B). blue ), and a second offset (α) according to the third color (B) and the first distance (551) blue ) can be determined.

[0091] As a non-limiting example, distance (541a) may be different from distance (531), and distance (542a) may be different from distance (532). However, the present disclosure is not limited thereto. For example, the first offset (α) red ) and the second offset (α blue ) each is 0 (or 0 pixel (PXL)), distance (541a) may correspond to distance (531), and distance (542a) may correspond to distance (532).

[0092] In addition, the display driving circuit (420) can change the position at which data for the second color (R) of the second part to be displayed at the second position (520) is to be displayed from the second position (520) to the position (521b). Alternatively, the display driving circuit (420) can change the position at which data for the second color (R) of the second part is to be displayed from the position (521) to the position (521b). The display driving circuit (420) can change the position at which data for the third color (B) of the second part to be displayed at the second position (520) to the position (522b). Alternatively, the display driving circuit (420) can change the position at which data for the third color (B) of the second part is to be displayed from the position (522) to the position (522b). Data for the first color (G) of the second part may be displayed at the second location (520) where compensation has already been completed. The distance (541b) between the second location (520) and the location (521b) may be a first scaling value (K) for the second color (R). red ), and a first offset (α) according to the second color (R) and the second distance (552) red ) can be determined. The distance (542b) between the second position (520) and the position (522b) is determined by the first scaling value (K) for the third color (B). blue ), and a second offset (α) according to the third color (B) and the second distance (552) blue ) can be determined.

[0093] As a non-limiting example, distance (541b) may be different from distance (531) and distance (541a), and distance (542b) may be different from distance (532) and distance (542a). This is because a first offset (α) according to a first distance (551) red ) is the first offset (α) according to the second distance (552) red ) may be different from the first distance (551), and the second offset (α) according to the first distance (551) blue) is the second offset (α) according to the second distance (552) blue ) may be different from each other. However, the present disclosure is not limited thereto. For example, even if the first distance (551) and the second distance (552) are different, the first offset (α) may be different depending on the properties of the lens (440). red )(or, the second offset (α blue )) may be the same.

[0094] Referring to example (503), according to the first distance (551) and the second distance (552), the distances (541a, 542a) from the first position (510) to the positions (511a, 512a) may be different (or distinct) from the distances (541b, 542b) from the second position (520) to the positions (521b, 522b). This may be because different offsets are applied depending on the distance and color. In other words, example (503) may represent a result in which chromatic aberration compensation is performed differently depending on the distance between the position where the image is to be displayed and the reference position.

[0095] Figure 6 shows an example of an offset for compensation of chromatic aberration, depending on the distance between the position where a portion of the image is to be displayed and the reference position.

[0096] Figure 6 illustrates an example (600) of an offset for compensation of chromatic aberration determined according to the distance between a position where a portion of an image is to be displayed and a reference position. As a non-limiting example, the offset is a first offset (α red ) may be an example. However, the present disclosure is not limited thereto. The content of the offset described in the example (600) of FIG. 6 is a second offset (α blue ) can be applied substantially identically. However, the offset (e.g., the first offset (α) shown in example (600) red )) is the value of the second offset (α blue ) may differ from the value.

[0097] Example (600) illustrates pixels included in a display area of ​​a display panel (430). Referring to example (600), the offset value may be mapped on a pixel-by-pixel basis. The offset value of a first pixel (601) may be a first value (e.g., -3PXL). The offset value of a second pixel (602) may be a second value (e.g., -2PXL). The offset value of a third pixel (603) may be a third value (e.g., -1PXL). The offset value of a fourth pixel (604) may be a fourth value (e.g., 0 or 0PXL). The offset value of a fifth pixel (605) may be a fifth value (e.g., +1PXL). The offset value of a sixth pixel (606) may be a sixth value (e.g., +2PXL). In the example (600), the number (6) of the first to sixth values ​​is merely exemplary and the present disclosure is not limited thereto. In addition, in the example (600), the size (e.g., -3PXL to +2PXL) of each of the first to sixth values ​​is merely exemplary and the present disclosure is not limited thereto. For example, the number and the size may change depending on the properties of the lens (440). In the example (600), a case in which the value of the offset is mapped on a pixel basis is illustrated, but this is merely exemplary for the convenience of explanation and the present disclosure is not limited thereto. For example, the value of the offset may be mapped on a unit of each subpixel within a pixel.

[0098] The display driving circuit (420) may utilize the above offset value mapped according to the position of the pixel. In this case, the accuracy of chromatic aberration compensation may increase, and the complexity (or amount of calculation) of the operation for chromatic aberration compensation may increase.

[0099] In order to reduce the computational complexity of the display driving circuit (420), the offset value may be defined according to the distance from the reference position (550) (or the reference pixel (550)). As a non-limiting example, the display driving circuit (420) may define (or determine) the offset as the first value (e.g., -3PXL) for pixels (or positions) whose distance from the reference position (550) is less than the first reference distance (610). As a non-limiting example, the display driving circuit (420) may define (or determine) the offset as the third value (e.g., -1PXL) for pixels (or positions) whose distance from the reference position (550) is greater than the first reference distance (610) and less than the second reference distance (620). As a non-limiting example, the display driver circuit (420) may define (or determine) the offset as the fourth value (e.g., 0PXL) for pixels (or locations) whose distance from the reference position (550) exceeds the second reference distance (620) and is less than the third reference distance (630). As a non-limiting example, the display driver circuit (420) may define (or determine) the offset as the sixth value (e.g., +2PXL) for pixels (or locations) whose distance from the reference position (550) exceeds the third reference distance (630) and is less than the fourth reference distance (640).

[0100] The display driving circuit (420) can determine the value of the offset, which is determined by comparing the distance with reference distances (e.g., the first reference distance (610), the second reference distance (620), the third reference distance (630), and the fourth reference distance (640)), according to the properties of the lens (440). As a non-limiting example, the display driving circuit (420) can determine the value of the offset for a specific section (e.g., an area exceeding the first reference distance (610) and less than the second reference distance (620)) as a representative value (e.g., an average value, a median value) for the values ​​of the offset mapped to pixels within the specific section. The display driving circuit (420) can store the value of the offset according to the distance in the register (423). Compared to storing the value of the offset mapped on a pixel-by-pixel basis, storing the value of the offset according to the distance can utilize less storage space of the register (423). As described above, storing the value of the offset according to the distance may be more effective when the display panel (430) and / or the lens (440) are formed in a circular shape and the resulting chromatic aberration has circular symmetry.

[0101] As described above, by utilizing the values ​​of the offset defined according to the distance, the display driving circuit (420) can compensate for chromatic aberration with relatively high accuracy and relatively low computational complexity. As a non-limiting example, the higher the resolution of the image, the more effectively the compensation method described above can be utilized, with its low computational complexity and high accuracy.

[0102] Figure 7 illustrates examples of positions corresponding to portions of an image to be displayed at specific positions in the display area of ​​a display panel.

[0103] FIG. 7 illustrates examples of positions (701, 702, 703) corresponding to portions of an image to be displayed at a position (755) in the display area of ​​the display panel (430).

[0104] Referring to FIG. 7, the display driving circuit (420) may receive an image (700) from at least one processor (410). The image (700) may include data on which compensation has been performed for a first color (G), which is a reference color. In the example of FIG. 7, for convenience of explanation, a first location (701) (e.g., (P x , P y-3 )) data for the first color (G) of the first part corresponding to the second position (702) (e.g. (P x , P y-2 )) data for the second color (R) of the second part corresponding to the third position (703) (e.g. (P x , P y-4 )) is shown, but the present disclosure is not limited thereto. The image (700) may include data for the second color (R) and the third color (B) of the first portion corresponding to the first location (701). The first location (701) may be a location (755) (e.g., (P x , P y-3 )) can correspond to (or be identical to).

[0105] In the image (700), the first position (701) may be located between the second position (702) and the third position (703). The second position (702) may be closest to the reference position. The third position (703) may be farthest from the reference position. As a non-limiting example, the reference position may be a center position (e.g., (P x , P y ))(or, the center pixel).

[0106] In example (710), the display driving circuit (420) may refrain from performing chromatic aberration compensation for data of the first color (G). Accordingly, the display driving circuit (420) may control the display panel (430) to render (or emit) the data of the first color (G) at the first location (701), thereby displaying the first portion of the image (700) on the display area of ​​the display panel (430).

[0107] In example (720), the display driving circuit (420) can compensate for chromatic aberration for data of the second color (R). Accordingly, the display driving circuit (420) can change the location at which the data of the second color (R) is to be displayed from the second location (702) to the location (755). The display driving circuit (420) can display the second portion of the image (700) on the display area of ​​the display panel (430) by controlling the display panel (430) to render (or emit light) the data of the second color (R) at the location (755).

[0108] In example (730), the display driving circuit (420) can compensate for chromatic aberration for data of the third color (B). Accordingly, the display driving circuit (420) can change the location at which the data of the third color (B) is to be displayed from the third location (703) to the location (755). The display driving circuit (420) can display the third portion of the image (700) on the display area of ​​the display panel (430) by controlling the display panel (430) to render (or emit light) the data of the third color (B) at the location (755).

[0109] Referring to example (750), the display driving circuit (420) can display data of a first color (G) of the first part of the image (700), data of a second color (R) of the second part of the image (700), and data of a third color (B) of the third part of the image (700) at a location (755).

[0110] Figure 8 illustrates an example of an image displayed by performing compensation for chromatic aberration according to the distance between a position where a portion of the image is to be displayed and a reference position.

[0111] FIG. 8 illustrates an example of an image (800) before compensation for chromatic aberration is performed and an image (850) displayed by performing compensation for chromatic aberration according to the distance between a position where a portion (810) of the image (800) is to be displayed and a reference position.

[0112] Referring to FIG. 8, the display driving circuit (420) can display an image (800) on a display area of ​​the display panel (430) by controlling the display panel (430). The image (800) can include a portion (810). For example, distortion due to chromatic aberration can be recognized in a portion (810) of the image (800). For example, distortion due to chromatic aberration can indicate that an object is displayed separately by color.

[0113] According to the present disclosure, the display driving circuit (420) can compensate for chromatic aberration according to the distance between the portion (810) and the reference position. The display driving circuit (420) can display an image (850) by compensating for chromatic aberration. For example, the image (850) can include a portion (860) corresponding to the portion (810) of the image (800). In the portion (860) included in the image (850), distortion due to chromatic aberration may not be recognized. In other words, distortion due to chromatic aberration can be eliminated according to the compensation for chromatic aberration performed by the display driving circuit (420).

[0114] Figure 9 illustrates an example of an operational flow for how a display driving circuit performs compensation for chromatic aberration.

[0115] At least some of the methods of FIG. 9 may be performed by the electronic device (400) of FIG. 4. For example, at least some of the methods may be configured to be performed (or controlled) by the display driving circuit (420) of the electronic device (101). In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0116] For example, an electronic device (400), which is a wearable device (or head-mounted electronic device), may include lenses (or two lenses) each positioned relative to a user's eyes. The electronic device (400) may include display panels (or two display panels) configured to respectively emit light toward the lenses. Each of the display panels may include a display area. The display area may include a plurality of pixels (each pixel including sub-pixels). Each of the lenses may be an example of the lens (440) of FIG. 4. Each of the display panels may be an example of the display panel (430) of FIG. 4.

[0117] In operation (910), the display driving circuit (420) may receive an image from at least one processor (410). For example, the display driving circuit (420) may receive the image (or data for the image) from at least one processor (410). The image may include a first portion corresponding to a first position of the display area and a second portion corresponding to a second position of the display area. For example, a distance between the first position and a reference position may be different from a distance between the second position and the reference position.

[0118] For example, the image received from at least one processor (410) may be an image (or data for an image) on which chromatic aberration compensation has been performed for a reference color. As a non-limiting example, the reference color may be a first color (G), and the colors may be a second color (R) and a third color (B).

[0119] For example, compensation for chromatic aberration for the reference color may be performed by at least one processor (410). For example, the at least one processor (410) may generate data for the image on which compensation for the reference color has been performed from raw data for the image using distortion information stored in advance according to the properties of the lens (440). For example, the distortion information may be defined to compensate for a position at which the light of the first color (G) will change (or a position at which it will be refracted) as it passes through the lens (440). As a non-limiting example, the distortion information may include a value at which the light of the first color (G) is refracted by the lens (440). For example, the distortion information may be stored within the electronic device (400) (or within at least one processor (410) and the display driving circuit (420)) before data for the image is transmitted from the at least one processor (410) to the display driving circuit (420). For example, the distortion information may be stored in the register (423) of the display driving circuit (420) and the memory of at least one processor (410).

[0120] The display driving circuit (420) can store an image (or data for an image) received from at least one processor (410) in the GRAM (421).

[0121] In operation (920), the display driving circuit (420) can compensate for chromatic aberration of light. For example, the display driving circuit (420) can compensate for chromatic aberration of light emitted from the display panel (430).

[0122] For example, the display driving circuit (420) may perform compensation for chromatic aberration by applying compensation values ​​to the image received from at least one processor (410) and stored in the GRAM (421). The compensation for chromatic aberration performed in the display driving circuit (420) may represent compensation for colors different from a reference color.

[0123] For example, the display driving circuit (420) may change the position of the display area where the first portion of the image is to be displayed from the first position to a third position of the display area based on receiving the image from at least one processor (410). For example, the third position may be spaced apart from the first position by a first distance. For example, the display driving circuit (420) may change the position of the display area where the second portion of the image is to be displayed from the second position to a fourth position of the display area based on receiving the image from at least one processor (410). For example, the fourth position may be spaced apart from the second position by a second distance different from the first distance. The display driving circuit (420) may compensate for the chromatic aberration by changing the positions where each of the first portion and the second portion of the image is to be displayed. In the above example, for convenience of explanation, the third position where the first part is displayed and the fourth position where the second part is displayed may be positions where data for the second color (R) is displayed. However, the present disclosure is not limited thereto.

[0124] For example, the display driving circuit (420) can change the location at which data for the third color (B) of the first part is to be displayed from the first location to the fifth location, and can change the location at which data for the third color (B) of the second part is to be displayed from the second location to the sixth location. For example, the fifth location can be spaced apart from the first location by a third distance, and the sixth location can be spaced apart from the second location by a fourth distance that is different from the third distance.

[0125] For example, the third position is the first scaling value (K) for the second color (R). red ), and a first offset (α) according to the distance between the first position and the reference position red ) can be determined. For example, the fourth position may be determined based on the first scaling value (K) for the second color (R). red ), and a first offset (α) according to the distance between the second position and the reference position red ) can be determined.

[0126] For example, the fifth position is the second scaling value (K) for the third color (B). blue ), and a second offset (α) according to the distance between the first position and the reference position blue ) can be determined. For example, the sixth position may be determined based on the second scaling value (K) for the third color (B). blue ), and a second offset (α) according to the distance between the second position and the reference position blue ) can be determined.

[0127] For example, the display driving circuit (420) may be configured to calculate compensation values ​​(e.g., a first scaling value (K red ), the second scaling value (K blue ), first offset (α red ), second offset (α blue)) can be stored in the register (423). For example, the compensation values ​​may be a pair of a scaling value and an offset. As a non-limiting example, the pairs of compensation values ​​may be implemented as LUTs. For example, the register (423) may store a plurality of LUTs.

[0128] For example, each of the LUTs may be further defined using sensing data about the user's eyes. For example, the display driving circuit (420) may receive sensing data that measures (or tracks) the position and direction (or gaze direction) of the eyes, which is obtained using at least one sensor included in the electronic device (400), and may select one of the LUTs using the sensing data.

[0129] For example, each of the LUTs may be further defined using information of additional lenses for vision correction of the user's eyes. For example, the electronic device (400) may include additional lenses for vision correction in addition to the lens (440). For example, each of the additional lenses (e.g., two additional lenses) may be positioned with respect to each of the display panels. For example, the display driver circuit (420) may further compensate for chromatic aberration that may be caused by the additional lenses. For example, the display driver circuit (420) may store the LUTs defined according to the information of the additional lenses in the register (423). The display driver circuit (420) may perform compensation for chromatic aberration by selecting an LUT from among the stored LUTs upon detecting that the additional lenses are inserted. For example, the information of the additional lenses may include identification information of the additional lenses, the thickness and shape of the additional lenses, or vision correction information.

[0130] The display driving circuit (420) can identify the compensation values ​​determined according to color and distance within a LUT selected according to conditions among a plurality of LUTs stored within a register (423), and perform compensation for chromatic aberration for the image stored within a GRAM (421) using the compensation values.

[0131] Although not shown in FIG. 9, the display driving circuit (420) can perform additional image processing through IP (425) on an image for which chromatic aberration compensation has been performed.

[0132] In operation (930), the display driving circuit (420) can display an image based on compensation for chromatic aberration. For example, the display driving circuit (420) can display (or render) the first part of the image on the display area by displaying data for a first color (G) of the first part of the image received from at least one processor (410) at the first position, data for a second color (R) of the first part at the third position, and data for a third color (B) of the first part at the fifth position. Additionally, for example, the display driving circuit (420) can display the second portion of the image on the display area by displaying (or rendering) data for the first color (G) of the second portion of the image received from at least one processor (410) at the second position, data for the second color (R) of the second portion at the fourth position, and data for the third color (B) of the second portion at the sixth position.

[0133] Referring to FIGS. 1 to 9, the present disclosure can perform compensation for chromatic aberration in the display driver circuit (420) instead of performing it in at least one processor (410). By performing compensation for chromatic aberration in the display driver circuit (420), the present disclosure can efficiently use the transmission bandwidth between the at least one processor (410) and the display driver circuit (420). In addition, the present disclosure can accurately compensate for chromatic aberration according to the position within the display area of ​​the display panel (430) by further utilizing an offset for accurately compensating for chromatic aberration according to the position at which data is to be displayed. At this time, by defining the offset for each section of the display area of ​​the display panel (430), the operation for compensating for chromatic aberration can be simplified. In addition, the present disclosure can accurately compensate for chromatic aberration by utilizing compensation values ​​(including the offset value) for more accurate compensation by utilizing information on the position of the user's eyes. Additionally, the present disclosure can accurately compensate for chromatic aberration by utilizing additional information about additional lenses for vision correction in the user's eyes. Accordingly, the image quality of images displayed to the user can be improved.

[0134] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0135] FIG. 10 is a block diagram of an electronic device within a network environment according to various embodiments.

[0136] Referring to FIG. 10, in a network environment (1000), an electronic device (1001) may communicate with an electronic device (1002) via a first network (1098) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (1004) or a server (1008) via a second network (1099) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1001) may communicate with the electronic device (1004) via the server (1008). According to one embodiment, the electronic device (1001) may include a processor (1020), a memory (1030), an input module (1050), an audio output module (1055), a display module (1060), an audio module (1070), a sensor module (1076), an interface (1077), a connection terminal (1078), a haptic module (1079), a camera module (1080), a power management module (1088), a battery (1089), a communication module (1090), a subscriber identification module (1096), or an antenna module (1097). In some embodiments, the electronic device (1001) may omit at least one of these components (e.g., the connection terminal (1078)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1076), camera module (1080), or antenna module (1097)) may be integrated into a single component (e.g., display module (1060)).

[0137] The processor (1020) may, for example, execute software (e.g., a program (1040)) to control at least one other component (e.g., a hardware or software component) of the electronic device (1001) connected to the processor (1020) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1020) may store commands or data received from other components (e.g., a sensor module (1076) or a communication module (1090)) in the volatile memory (1032), process the commands or data stored in the volatile memory (1032), and store result data in the non-volatile memory (1034). According to one embodiment, the processor (1020) may include a main processor (1021) (e.g., a central processing unit or an application processor) or a secondary processor (1023) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1021). For example, when the electronic device (1001) includes the main processor (1021) and the secondary processor (1023), the secondary processor (1023) may be configured to use less power than the main processor (1021) or to be specialized for a given function. The secondary processor (1023) may be implemented separately from the main processor (1021) or as a part thereof.

[0138] The auxiliary processor (1023) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1060), the sensor module (1076), or the communication module (1090)) of the electronic device (1001), for example, on behalf of the main processor (1021) while the main processor (1021) is in an inactive (e.g., sleep) state, or together with the main processor (1021) while the main processor (1021) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1023) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1080) or a communication module (1090)). In one embodiment, the auxiliary processor (1023) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1001) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1008)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0139] The memory (1030) can store various data used by at least one component (e.g., the processor (1020) or the sensor module (1076)) of the electronic device (1001). The data can include, for example, software (e.g., the program (1040)) and input data or output data for commands related thereto. The memory (1030) can include volatile memory (1032) or non-volatile memory (1034).

[0140] The program (1040) may be stored as software in memory (1030) and may include, for example, an operating system (1042), middleware (1044), or an application (1046).

[0141] The input module (1050) can receive commands or data to be used in a component of the electronic device (1001) (e.g., a processor (1020)) from an external source (e.g., a user) of the electronic device (1001). The input module (1050) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0142] The audio output module (1055) can output audio signals to the outside of the electronic device (1001). The audio output module (1055) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0143] The display module (1060) can visually provide information to an external party (e.g., a user) of the electronic device (1001). The display module (1060) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1060) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0144] The audio module (1070) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1070) can acquire sound through the input module (1050), output sound through the sound output module (1055), or an external electronic device (e.g., electronic device (1002)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1001).

[0145] The sensor module (1076) can detect the operating status (e.g., power or temperature) of the electronic device (1001) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1076) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0146] The interface (1077) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1001) with an external electronic device (e.g., the electronic device (1002)). In one embodiment, the interface (1077) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0147] The connection terminal (1078) may include a connector through which the electronic device (1001) may be physically connected to an external electronic device (e.g., the electronic device (1002)). According to one embodiment, the connection terminal (1078) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0148] The haptic module (1079) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1079) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0149] The camera module (1080) can capture still images and videos. According to one embodiment, the camera module (1080) may include one or more lenses, image sensors, image signal processors, or flashes.

[0150] The power management module (1088) can manage power supplied to the electronic device (1001). According to one embodiment, the power management module (1088) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0151] A battery (1089) may power at least one component of the electronic device (1001). In one embodiment, the battery (1089) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0152] The communication module (1090) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1001) and an external electronic device (e.g., electronic device (1002), electronic device (1004), or server (1008)), and the performance of communication through the established communication channel. The communication module (1090) may operate independently from the processor (1020) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1090) may include a wireless communication module (1092) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1094) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module can communicate with an external electronic device (1004) via a first network (1098) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1099) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1092) can verify or authenticate the electronic device (1001) within a communication network such as the first network (1098) or the second network (1099) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1096).

[0153] The wireless communication module (1092) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1092) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1092) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1092) may support various requirements specified in the electronic device (1001), an external electronic device (e.g., the electronic device (1004)), or a network system (e.g., the second network (1099)). According to one embodiment, the wireless communication module (1092) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) each, or 1 ms or less for round trip) for URLLC realization.

[0154] The antenna module (1097) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1097) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1097) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1098) or the second network (1099), may be selected from the plurality of antennas by, for example, the communication module (1090). A signal or power may be transmitted or received between the communication module (1090) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1097).

[0155] According to various embodiments, the antenna module (1097) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0156] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0157] According to one embodiment, commands or data may be transmitted or received between the electronic device (1001) and an external electronic device (1004) via a server (1008) connected to a second network (1099). Each of the external electronic devices (1002 or 1004) may be the same or a different type of device as the electronic device (1001). According to one embodiment, all or part of the operations executed in the electronic device (1001) may be executed in one or more of the external electronic devices (1002, 1004, or 1008). For example, when the electronic device (1001) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1001) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1001). The electronic device (1001) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1001) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (1004) may include an Internet of Things (IoT) device. The server (1008) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1004) or server (1008) may be included in the second network (1099). The electronic device (1001) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0158] For example, an external electronic device (1002) can render content data executed in an application and transmit it to an electronic device (1001), and the electronic device (1001) that receives the data can output the content data to a display module. If the electronic device (1001) detects a user's movement through an IMU sensor or the like, the processor of the electronic device (1001) can correct the rendering data received from the external electronic device (1002) based on the movement information and output it to the display module. Alternatively, the processor can transmit the movement information to the external electronic device (1002) and request rendering so that the screen data is updated accordingly. According to various embodiments, the external electronic device (1002) may be a variety of devices, such as a smartphone or a case device that can store and charge the electronic device (101).

[0159] FIG. 11 is a block diagram of a display module according to various embodiments.

[0160] Referring to FIG. 11, a display module (1060) may include a display panel (1110) and a display driver IC (DDI) (1130) (or, a display driving circuit (1130)) for controlling the same. The DDI (1130) may include an interface module (1131), a memory (1133) (e.g., a buffer memory), an image processing module (1135), or a mapping module (1137). The DDI (1130) may receive, for example, image information including image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device (1001) through the interface module (1131). For example, according to one embodiment, image information may be received from a processor (1020) (e.g., a main processor (1021) (e.g., an application processor) or an auxiliary processor (1023) (e.g., a graphics processing unit) that operates independently of the function of the main processor (1021). The DDI (1130) may communicate with a touch circuit (1150) or a sensor module (1076) through the interface module (1131). In addition, the DDI (1130) may store at least a part of the received image information in the memory (1133), for example, in units of frames. The image processing module (1135) may, for example, perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a part of the image data based at least on the characteristics of the image data or the characteristics of the display panel (1110). The mapping module (1137) may output a voltage value corresponding to the image data preprocessed or postprocessed through the image processing module (1135). Alternatively, a current value may be generated. In one embodiment, the generation of the voltage value or current value may be performed at least in part based on, for example, the properties of the pixels of the display panel (1110), such as the arrangement of the pixels (RGB stripe or pentile structure), or the size of each sub-pixel.At least some pixels of the display panel (1110) may be driven based at least in part on, for example, the voltage value or current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed through the display panel (1110).

[0161] According to one embodiment, the display module (1060) may further include a touch circuit (1150). The touch circuit (1150) may include a touch sensor (1151) and a touch sensor IC (1153) for controlling the same. The touch sensor IC (1153) may control the touch sensor (1151) to detect, for example, a touch input or a hovering input for a specific location of the display panel (1110). For example, the touch sensor IC (1153) may detect a touch input or a hovering input by measuring a change in a signal (e.g., voltage, light quantity, resistance, or charge quantity) for a specific location of the display panel (1110). The touch sensor IC (1153) may provide information (e.g., location, area, pressure, or time) regarding the detected touch input or hovering input to the processor (1020). According to one embodiment, at least a portion of the touch circuit (1150) (e.g., touch sensor IC (1153)) may be included as part of the display driver IC (1130), or as part of the display panel (1110), or as part of another component (e.g., auxiliary processor (1023)) disposed external to the display module (1060).

[0162] According to one embodiment, the display module (1060) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (1076), or a control circuit therefor. In this case, the at least one sensor or the control circuit therefor may be embedded in a part of the display module (1060) (e.g., the display panel (1110) or the DDI (1130)) or a part of the touch circuit (1150). For example, when the sensor module (1076) embedded in the display module (1060) includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) associated with a touch input through a part of the display panel (1110). For another example, when the sensor module (1076) embedded in the display module (1060) includes a pressure sensor, the pressure sensor can obtain pressure information associated with a touch input through a part or the entire area of ​​the display panel (1110). According to one embodiment, the touch sensor (1151) or the sensor module (1076) can be placed between pixels of a pixel layer of the display panel (1110), or above or below the pixel layer.

[0163] In embodiments of the present disclosure, an electronic device for displaying an image in a virtual space (e.g., the electronic device (400) of FIG. 4, the electronic device (1001) of FIG. 10) may be a wearable device. The wearable device may include a head-mounted display (HMD) that is wearable on a user's head. The wearable device may be referred to as a head-mounted device (HMD), a headgear electronic device, a glasses-type electronic device, a video see-through (VST) device, an extended reality (XR) device, a virtual reality (VR) device, and / or an augmented reality (AR) device. An example of a hardware configuration included in a wearable device is exemplarily described with reference to FIG. 12B. An example of a structure of a wearable device that is wearable on a user's head is described with reference to FIGS. 12A to 13B. A wearable device may be referred to as an electronic device (400). For example, the electronic device may be combined with an accessory (e.g., a strap) to be attached to a user's head to form an HMD.

[0164] In one embodiment, a wearable device may perform functions related to augmented reality (AR) and / or mixed reality (MR). For example, while a user wears the wearable device, the wearable device may include at least one lens positioned adjacent to the user's eyes. The wearable device may combine ambient light passing through the lens with light emitted from a display of the wearable device. A display area of ​​the display may be formed within the lens through which the ambient light passes. Because the wearable device combines the ambient light and the light emitted from the display, the user may see an image that is a mixture of a real object (or physical object) recognized by the ambient light and a virtual object formed by the light emitted from the display. The augmented reality, mixed reality, and / or virtual reality described above may be referred to as extended reality (XR).

[0165] In one embodiment, a wearable device may perform functions related to video see-through (VST) and / or virtual reality (VR). For example, when a user wears the wearable device, the wearable device may include a housing that covers the user's eyes. The wearable device may include a display disposed on a first side of the housing facing the eyes. The wearable device may include a camera disposed on a second side opposite the first side. Using the camera, the wearable device may acquire images and / or videos representing ambient light. The wearable device may output the images and / or videos within the display disposed on the first side, thereby allowing the user to perceive the ambient light through the display. A displaying area (or displaying region) (or active area (or active region)) of the display disposed on the first side may be formed by one or more pixels included in the display. The wearable device can synthesize a virtual object into an image and / or video output through the display, thereby allowing the user to recognize the virtual object together with a real object recognized by ambient light.

[0166] In one embodiment, a wearable device can identify or recognize a position and / or direction or orientation of the wearable device based on an image (and / or video) obtained or acquired using a camera. The wearable device can obtain information about the external space using one or more cameras and / or one or more sensors. The information can include a geographic location (e.g., global positioning system (GPS) coordinates) of the external space identified from one or more sensors. The information can include images and / or videos of the external space identified from one or more cameras. The wearable device can perform object recognition on the images and / or videos to identify external objects included in the external space from the images and / or videos.

[0167] Below, an example of a hardware configuration of a wearable device is described with reference to FIGS. 12a, 12b, 13a, and 13b.

[0168] FIG. 12a illustrates an example of a perspective view of an electronic device. FIG. 12b illustrates an example of one or more hardware pieces arranged within the electronic device.

[0169] According to one embodiment, the electronic device (400) may have the form of glasses that can be worn on a body part of a user (e.g., head). The electronic device (400) of FIGS. 12A and 12B may be an example of the electronic device (400) of FIG. 4. For example, the electronic device (400) of FIGS. 12A and 12B may be an example of the electronic device (1001) of FIG. 10. The electronic device (400) may include a head-mounted display (HMD). For example, the electronic device (400) may be referred to as a wearable device, a head-mounted electronic device, an HMD device, or an AR / VR device.

[0170] For example, the housing of the electronic device (400) may include a flexible material, such as rubber and / or silicone, that is configured to fit snugly against a portion of the user's head (e.g., a portion of the face surrounding both eyes). For example, the housing of the electronic device (400) may include one or more straps that can be twined around the user's head, and / or one or more temples that can be attached to an ear of the head.

[0171] Referring to FIG. 12A, according to one embodiment, an electronic device (400) may include at least one display (1250) and a frame (1200) supporting at least one display (1250).

[0172] According to one embodiment, the electronic device (400) may be worn on a part of a user's body. The electronic device (400) may provide augmented reality (AR), virtual reality (VR), or mixed reality (MR) that combines augmented reality and virtual reality to the user wearing the electronic device (400). For example, the electronic device (400) may display a virtual reality image provided from at least one optical device (1282, 1284) of FIG. 12B on at least one display (1250) in response to a user's designated gesture acquired through the motion recognition cameras (1260-2, 1260-3) of FIG. 12B.

[0173] According to one embodiment, at least one display (1250) may provide visual information to a user. For example, at least one display (1250) may include a transparent or translucent lens. At least one display (1250) may include a first display (1250-1) and / or a second display (1250-2) spaced apart from the first display (1250-1). For example, the first display (1250-1) and the second display (1250-2) may be positioned at positions corresponding to the user's left and right eyes, respectively.

[0174] Referring to FIG. 12B, at least one display (1250) can provide the user with visual information transmitted from external light and other visual information distinct from the visual information through a lens included in the at least one display (1250). The lens can be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. For example, the at least one display (1250) can include a first surface (1231) and a second surface (1232) opposite to the first surface (1231). A display area can be formed on the second surface (1232) of the at least one display (1250). When the user wears the electronic device (400), external light can be transmitted to the user by being incident on the first surface (1231) and transmitted through the second surface (1232). As another example, at least one display (1250) can display an augmented reality image combined with a virtual reality image provided from at least one optical device (1282, 1284) on a real screen transmitted through external light, in a display area formed on the second surface (1232).

[0175] In one embodiment, at least one display (1250) may include at least one waveguide (1233, 1234) that diffracts light emitted from at least one optical device (1282, 284) and transmits the diffracted light to a user. The at least one waveguide (1233, 1234) may be formed based on at least one of glass, plastic, or polymer. A nano-pattern may be formed on at least a portion of the exterior or interior of the at least one waveguide (1233, 1234). The nano-pattern may be formed based on a grating structure having a polygonal and / or curved shape. Light incident on one end of the at least one waveguide (1233, 1234) may be propagated to the other end of the at least one waveguide (1233, 1234) by the nano-pattern. At least one waveguide (1233, 1234) may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) and at least one reflective element (e.g., a reflective mirror). For example, at least one waveguide (1233, 1234) may be arranged within the electronic device (400) to guide a screen displayed by at least one display (1250) to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) ​​occurring within the at least one waveguide (1233, 1234).

[0176] The electronic device (400) can analyze an object included in a real image collected through a shooting camera (1260-4), combine a virtual object corresponding to an object to be provided with augmented reality among the analyzed objects, and display the virtual object on at least one display (1250). The virtual object can include at least one of text and an image regarding various information related to the object included in the real image. The electronic device (400) can analyze the object based on a multi-camera such as a stereo camera. For the object analysis, the electronic device (400) can perform spatial recognition (e.g., simultaneous localization and mapping (SLAM)) using the multi-camera and / or time-of-flight (ToF). A user wearing the electronic device (400) can view an image displayed on at least one display (1250).

[0177] According to one embodiment, the frame (1200) may be configured as a physical structure that allows the electronic device (400) to be worn on the user's body. According to one embodiment, the frame (1200) may be configured so that, when the user wears the electronic device (400), the first display (1250-1) and the second display (1250-2) can be positioned corresponding to the user's left and right eyes. The frame (1200) may support at least one display (1250). For example, the frame (1200) may support the first display (1250-1) and the second display (1250-2) to be positioned corresponding to the user's left and right eyes.

[0178] Referring to FIG. 12A, the frame (1200) may include a region (1220) that at least partially contacts a part of the user's body when the user wears the electronic device (400). For example, the region (1220) of the frame (1200) that contacts a part of the user's body may include a region that contacts a part of the user's nose, a part of the user's ear, and a part of the side of the user's face that the electronic device (400) makes contact with. According to one embodiment, the frame (1200) may include a nose pad (1210) that contacts a part of the user's body. When the electronic device (400) is worn by the user, the nose pad (1210) may contact a part of the user's nose. The frame (1200) may include a first temple (1204) and a second temple (1205) that contact a part of the user's body that is distinct from the part of the user's body.

[0179] For example, the frame (1200) may include a first rim (1201) that surrounds at least a portion of the first display (1250-1), a second rim (1202) that surrounds at least a portion of the second display (1250-2), a bridge (1203) that is disposed between the first rim (1201) and the second rim (1202), a first pad (1211) that is disposed along a portion of the edge of the first rim (1201) from one end of the bridge (1203), a second pad (1212) that is disposed along a portion of the edge of the second rim (1202) from the other end of the bridge (1203), a first temple (1204) that extends from the first rim (1201) and is fixed to a portion of the ear of the wearer, and a second temple (1205) that extends from the second rim (1202) and is fixed to a portion of the ear opposite the ear. There are. The first pad (1211) and the second pad (1212) can be in contact with a part of the user's nose, and the first temple (1204) and the second temple (1205) can be in contact with a part of the user's face and a part of the user's ear. The temples (1204, 1205) can be rotatably connected to the rim through the hinge units (1206, 207) of FIG. 12B. The first temple (1204) can be rotatably connected to the first rim (1201) through the first hinge unit (1206) disposed between the first rim (1201) and the first temple (1204). The second temple (1205) may be rotatably connected to the second rim (1202) via a second hinge unit (1207) disposed between the second rim (1202) and the second temple (1205). In one embodiment, the electronic device (400) may use a touch sensor, a grip sensor, and / or a proximity sensor formed on at least a portion of a surface of the frame (1200) to identify an external object (e.g., a user's fingertip) touching the frame (1200) and / or a gesture performed by the external object.

[0180] According to one embodiment, the electronic device (400) may include hardwares (e.g., hardwares of FIG. 4) that perform various functions. For example, the hardwares may include a battery module (1270), an antenna module (1275), at least one optical device (1282, 1284), speakers (e.g., speakers 1255-1, 1255-2), a microphone (e.g., microphones 1265-1, 1265-2, 1265-3), a light-emitting module (not shown), and / or a printed circuit board (PCB) (1290) (e.g., a printed circuit board). The various hardwares may be arranged within the frame (1200).

[0181] According to one embodiment, a microphone (e.g., microphones 1265-1, 1265-2, 1265-3) of the electronic device (400) may be disposed on at least a portion of the frame (1200) to acquire a sound signal. A first microphone (1265-1) disposed on the bridge (1203), a second microphone (1265-2) disposed on the second rim (1202), and a third microphone (1265-3) disposed on the first rim (1201) are illustrated in FIG. 12B , but the number and arrangement of the microphones (1265) are not limited to the embodiment of FIG. 12B . When the number of microphones (1265) included in the electronic device (400) is two or more, the electronic device (400) may identify a direction of a sound signal by using a plurality of microphones disposed on different portions of the frame (1200).

[0182] According to one embodiment, at least one optical device (1282, 1284) may project a virtual object onto at least one display (1250) to provide various image information to a user. For example, at least one optical device (1282, 1284) may be a projector. At least one optical device (1282, 1284) may be disposed adjacent to at least one display (1250) or may be included within at least one display (1250) as a part of at least one display (1250). According to one embodiment, the electronic device (400) may include a first optical device (1282) corresponding to a first display (1250-1) and a second optical device (1284) corresponding to a second display (1250-2). For example, at least one optical device (1282, 1284) may include a first optical device (1282) disposed at an edge of a first display (1250-1) and a second optical device (1284) disposed at an edge of a second display (1250-2). The first optical device (1282) may transmit light to a first waveguide (1233) disposed on the first display (1250-1), and the second optical device (1284) may transmit light to a second waveguide (1234) disposed on the second display (1250-2).

[0183] In one embodiment, the camera (1260) may include a recording camera (1260-4), an eye tracking camera (ET CAM) (1260-1), and / or a motion recognition camera (1260-2, 1260-3). The recording camera (1260-4), the eye tracking camera (1260-1), and the motion recognition cameras (1260-2, 1260-3) may be positioned at different locations on the frame (1200) and may perform different functions. The eye tracking camera (1260-1) may output data indicating the position or gaze of the eyes of a user wearing the electronic device (400). For example, the electronic device (400) may detect the gaze from an image including the user's pupils obtained through the eye tracking camera (1260-1). The electronic device (400) can identify an object (e.g., a real object and / or a virtual object) focused on by the user using the user's gaze acquired through the gaze tracking camera (1260-1). The electronic device (400) that has identified the focused object can execute a function (e.g., gaze interaction) for interaction between the user and the focused object. The electronic device (400) can express a part corresponding to the eye of an avatar representing the user in a virtual space using the user's gaze acquired through the gaze tracking camera (1260-1). The electronic device (400) can render an image (or screen) displayed on at least one display (1250) based on the position of the user's eyes. For example, the visual quality of a first area related to the gaze within the image and the visual quality (e.g., resolution, brightness, saturation, grayscale, PPI (pixels per inch)) of a second area distinguished from the first area may be different from each other. In this disclosure, the term “resolution” is used to refer to the density of pixels of an image and / or display (1250).The density and / or resolution of pixels can be measured or parameterized based on units of PPI and / or dpi (dots per inch). The electronic device (400) can obtain an image having a visual quality of a first area matching the user's gaze and a visual quality of a second area using foveated rendering. For example, if the electronic device (400) supports an iris recognition function, user authentication can be performed based on iris information obtained using the gaze tracking camera (1260-1). Although an example in which the gaze tracking camera (1260-1) is positioned toward the user's right eye is illustrated in FIG. 12B, the embodiment is not limited thereto, and the gaze tracking camera (1260-1) can be positioned solely toward the user's left eye, or toward both eyes.

[0184] In one embodiment, the capturing camera (1260-4) can capture an actual image or background to be aligned with a virtual image to implement augmented reality or mixed reality content. The capturing camera (1260-4) can be used to acquire a high-resolution image based on HR (high resolution) or PV (photo video). The capturing camera (1260-4) can capture an image of a specific object existing at a location viewed by the user and provide the image to at least one display (1250). The at least one display (1250) can display a single image in which information about an actual image or background including the image of the specific object acquired using the capturing camera (1260-4) and a virtual image provided through at least one optical device (1282, 1284) are superimposed. The electronic device (400) can compensate for depth information (e.g., the distance between the electronic device (400) and an external object acquired through a depth sensor) using the image acquired through the capturing camera (1260-4). The electronic device (400) can perform object recognition through an image acquired using the camera (1260-4). The electronic device (400) can perform a function (e.g., auto focus (AF)) to focus on an object (or subject) in an image and / or an optical image stabilization (OIS) function (e.g., anti-shake function) using the camera (1260-4). The electronic device (400) can perform a pass-through function to display an image acquired through the camera (1260-4) by overlapping at least a portion of a screen representing a virtual space on at least one display (1250). In one embodiment, the camera (1260-4) can be disposed on a bridge (1203) disposed between the first rim (1201) and the second rim (1202).

[0185] The gaze tracking camera (1260-1) can implement more realistic augmented reality by tracking the gaze of a user wearing the electronic device (400) and matching the user's gaze with visual information provided to at least one display (1250). For example, when the electronic device (400) looks straight ahead, the electronic device (400) can naturally display environmental information related to the user's front at a location where the user is located on at least one display (1250). The gaze tracking camera (1260-1) can be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera (1260-1) can receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the gaze tracking camera (1260-1) can be positioned at positions corresponding to the user's left and right eyes. For example, the gaze tracking camera (1260-1) may be positioned within the first rim (1201) and / or the second rim (1202) to face the direction in which the user wearing the electronic device (400) is positioned.

[0186] The gesture recognition camera (1260-2, 1260-3) can recognize the movement of the user's entire body, such as the user's torso, hand, or face, or a part of the body, and thereby provide a specific event on a screen provided on at least one display (1250). The gesture recognition camera (1260-2, 1260-3) can recognize the user's gesture (gesture recognition), obtain a signal corresponding to the gesture, and provide a display corresponding to the signal on at least one display (1250). The processor can identify the signal corresponding to the gesture, and perform a designated function based on the identification. The gesture recognition camera (1260-2, 1260-3) can be used to perform a spatial recognition function using SLAM and / or a depth map for 6 degrees of freedom pose (6 dof pose). The processor may perform gesture recognition and / or object tracking functions using the motion recognition cameras (1260-2, 1260-3). In one embodiment, the motion recognition cameras (1260-2, 1260-3) may be positioned on the first rim (1201) and / or the second rim (1202).

[0187] The camera (1260) included in the electronic device (400) is not limited to the above-described gaze tracking camera (1260-1) and motion recognition cameras (1260-2, 1260-3). For example, the electronic device (400) may identify an external object included in the user's field of view (FoV) using a camera positioned toward the user's FoV. The electronic device (400) may identify the external object based on a sensor for identifying the distance between the electronic device (400) and the external object, such as a depth sensor and / or a time of flight (ToF) sensor. The camera (1260) positioned toward the FoV may support an autofocus (AF) function and / or an optical image stabilization (OIS) function. For example, the electronic device (400) may include a camera (1260) (e.g., a face tracking (FT) camera) positioned toward the face to obtain an image including the face of a user wearing the electronic device (400).

[0188] Although not shown, in one embodiment, the electronic device (400) may further include a light source (e.g., an LED) that emits light toward a subject (e.g., a user's eyes, face, and / or an external object within the FoV) being photographed using the camera (1260). The light source may include an infrared wavelength LED. The light source may be disposed in at least one of the frame (1200) and the hinge units (1206, 1207).

[0189] According to one embodiment, the battery module (1270) may supply power to electronic components of the electronic device (400). In one embodiment, the battery module (1270) may be disposed within the first temple (1204) and / or the second temple (1205). For example, the battery module (1270) may be a plurality of battery modules (1270). The plurality of battery modules (1270) may be disposed within each of the first temple (1204) and the second temple (1205). In one embodiment, the battery module (1270) may be disposed at an end of the first temple (1204) and / or the second temple (1205).

[0190] The antenna module (1275) can transmit signals or power to the outside of the electronic device (400), or receive signals or power from the outside. In one embodiment, the antenna module (1275) can be positioned within the first temple (1204) and / or the second temple (1205). For example, the antenna module (1275) can be positioned close to one surface of the first temple (1204) and / or the second temple (1205).

[0191] The speaker (1255) can output an acoustic signal to the outside of the electronic device (400). The acoustic output module may be referred to as a speaker. In one embodiment, the speaker (1255) may be positioned within the first temple (1204) and / or the second temple (1205) so as to be positioned adjacent to the ear of a user wearing the electronic device (400). For example, the speaker (1255) may include a second speaker (1255-2) positioned within the first temple (1204) and thus positioned adjacent to the user's left ear, and a first speaker (1255-1) positioned within the second temple (1205) and thus positioned adjacent to the user's right ear.

[0192] The light-emitting module (not shown) may include at least one light-emitting element. The light-emitting module may emit light of a color corresponding to a specific state or emit light with an operation corresponding to a specific state in order to visually provide a user with information regarding a specific state of the electronic device (400). For example, when the electronic device (400) requires charging, it may emit red light at a regular cycle. In one embodiment, the light-emitting module may be disposed on the first rim (1201) and / or the second rim (1202).

[0193] Referring to FIG. 12B, according to one embodiment, an electronic device (400) may include a printed circuit board (PCB) (1290). The PCB (1290) may be included in at least one of the first temple (1204) or the second temple (1205). The PCB (1290) may include an interposer positioned between at least two sub-PCBs. One or more hardwares included in the electronic device (400) (e.g., the hardwares of FIG. 4) may be positioned on the PCB (1290). The electronic device (400) may include a flexible PCB (FPCB) for interconnecting the hardwares.

[0194] According to one embodiment, the electronic device (400) may include at least one of a gyro sensor, a gravity sensor, and / or an acceleration sensor for detecting a posture of the electronic device (400) and / or a posture of a body part (e.g., a head) of a user wearing the electronic device (400). Each of the gravity sensor and the acceleration sensor may measure gravitational acceleration and / or acceleration based on mutually perpendicular designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). The gyro sensor may measure an angular velocity of each of the designated three-dimensional axes (e.g., an x-axis, a y-axis, and a z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the electronic device (400) may identify a motion and / or gesture of the user performed to execute or stop a specific function of the electronic device (400) based on the IMU.

[0195] Figures 13a and 13b illustrate an example of the appearance of an electronic device.

[0196] The electronic device (400) of FIGS. 13A and 13B may be an example of the electronic device (400) of FIGS. 12A and 12B. For example, the electronic device (400) of FIGS. 13A and 13B may be an example of the electronic device (400) of FIG. 4 or the electronic device (1001) of FIG. 10. According to one embodiment, an example of the appearance of a first side (1310) of a housing of the electronic device (400) is illustrated in FIG. 13A, and an example of the appearance of a second side (1320) opposite to the first side (1310) is illustrated in FIG. 13B.

[0197] Referring to FIG. 13A, according to one embodiment, a first surface (1310) of an electronic device (400) may have a form attachable on a body part of a user (e.g., the face of the user). Although not shown, the electronic device (400) may further include a strap for fixing on a body part of a user, and / or one or more temples (e.g., the first temple (1204) and / or the second temple (1205) of FIGS. 12A and 12B). A first display (1250-1) for outputting an image to a left eye among the user's two eyes, and a second display (1250-2) for outputting an image to a right eye among the user's two eyes may be disposed on the first surface (1310). The electronic device (400) is formed on the first surface (1310) and may further include a rubber or silicone packing to prevent interference by light (e.g., ambient light) different from the light radiated from the first display (1250-1) and the second display (1250-2).

[0198] According to one embodiment, the electronic device (400) may include cameras (1260-1) for photographing and / or tracking both eyes of the user adjacent to each of the first display (1250-1) and the second display (1250-2). The cameras (1260-1) may be referred to as the gaze tracking camera (1260-1) of FIG. 12B. According to one embodiment, the electronic device (400) may include cameras (1260-5, 1260-6) for photographing and / or recognizing the face of the user. The cameras (1260-5, 1260-6) may be referred to as FT cameras. The electronic device (400) may control an avatar representing the user in a virtual space based on the motion of the user's face identified using the cameras (1260-5, 1260-6). For example, the electronic device (400) may change the texture and / or shape of a portion of an avatar (e.g., a portion of an avatar representing a human face) using information obtained by cameras (1260-5, 1260-6) (e.g., FT cameras) and representing the facial expression of a user wearing the electronic device (400).

[0199] Referring to FIG. 13B, a camera (e.g., cameras 1260-7, 1260-8, 1260-9, 1260-10, 1260-11, 1260-12)) and / or a sensor (e.g., a depth sensor 1330) for obtaining information related to the external environment of the electronic device (400) may be disposed on a second surface (1320) opposite to the first surface (1310) of FIG. 13A. For example, the cameras (1260-7, 1260-8, 1260-9, 1260-10) may be disposed on the second surface (1320) for recognizing external objects. Cameras (1260-7, 1260-8, 1260-9, 1260-10) may be referenced to the motion recognition cameras (1260-2, 1260-3) of FIG. 12b.

[0200] For example, using cameras (1260-11, 1260-12), the electronic device (400) can obtain images and / or videos to be transmitted to each of the user's eyes. The camera (1260-11) can be placed on the second surface (1320) of the electronic device (400) to obtain an image to be displayed through the second display (1250-2) corresponding to the right eye among the two eyes. The camera (1260-12) can be placed on the second surface (1320) of the electronic device (400) to obtain an image to be displayed through the first display (1250-1) corresponding to the left eye among the two eyes. The cameras (1260-11, 1260-12) can be referred to as the shooting camera (1260-4) of FIG. 12B.

[0201] According to one embodiment, the electronic device (400) may include a depth sensor (1330) disposed on the second face (1320) to identify a distance between the electronic device (400) and an external object. Using the depth sensor (1330), the electronic device (400) may obtain spatial information (e.g., a depth map) for at least a portion of the FoV of a user wearing the electronic device (400). Although not illustrated, a microphone may be disposed on the second face (1320) of the electronic device (400) to obtain sound output from an external object. The number of microphones may be one or more, depending on the embodiment.

[0202] The components of the electronic device (400) illustrated in FIGS. 12A to 13B are merely exemplary and the present disclosure is not limited thereto. For example, the electronic device (400) may further include at least one of the components illustrated in FIGS. 12A to 13B or may not include at least one of the components. For example, the electronic device (400) may include the components in a different area (or arrangement) from the area (or arrangement) where the components illustrated in FIGS. 12A to 13B are located. For example, the electronic device (400) may include a different number of components than the number of each of the components (e.g., cameras or sensors) illustrated in FIGS. 12A to 13B.

[0203] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.

[0204] As described above, the head-worn electronic device (400) may include at least one processor (410) including a processing circuit. The head-worn electronic device (400) may include lenses (440) each positioned with respect to the eyes of a user wearing the head-worn electronic device (400). The head-worn electronic device (400) may include display panels (430) configured to respectively emit light toward the lenses (440). Each of the display panels (430) may include a display area. The head-worn electronic device (400) may include a display driving circuit (420). The display driving circuit (420) may be configured to receive, from the at least one processor (410), an image including a first portion corresponding to a first position of the display area and a second portion corresponding to a second position of the display area. The distance between the first position and the reference position of the display area may be different from the distance between the second position and the reference position. The display driving circuit (420) may be configured to compensate for chromatic aberration of the light by changing the position of the display area where the first portion of the image is to be displayed from the first position to a third position of the display area, and changing the position of the display area where the second portion of the image is to be displayed from the second position to a fourth position of the display area, based on receiving the image. The display driving circuit (420) may be configured to display the image in the display area based on the compensation for chromatic aberration. The third position may be spaced apart from the first position by a first distance. The fourth position may be spaced apart from the second position by a second distance different from the first distance.

[0205] According to one embodiment, the display driving circuit (420) may be configured to display the image on the display area by displaying data of a first color of the first part of the image at the first position, displaying data of the first color of the second part of the image through the second position, displaying data of a second color of the first part of the image at the third position, and displaying data of the second color of the second part of the image through the fourth position, based on the compensation of the chromatic aberration.

[0206] According to one embodiment, the display driving circuit (420) may be configured to further compensate for chromatic aberration of the light by, based on receiving the image, changing a position of the display area where the first portion of the image is to be displayed from the first position to a fifth position of the display area, and changing a position of the display area where the second portion of the image is to be displayed from the second position to a sixth position of the display area. The display driving circuit (420) may be configured to display the image on the display area by displaying data of a third color of the first portion of the image at the fifth position, and displaying data of the third color of the second portion of the image through the sixth position, based on the compensation for chromatic aberration. The fifth position may be spaced apart from the first position by a third distance. The sixth position may be spaced apart from the second position by a fourth distance different from the third distance.

[0207] In one embodiment, the first color may be green. The second color may be red. The third color may be blue.

[0208] In one embodiment, the third location may be closer to the reference location by the first distance than the first location. The fifth location may be farther from the reference location by the third distance than the first location. The fourth location may be closer to the reference location by the second distance than the second location. The sixth location may be farther from the reference location by the fourth distance than the second location.

[0209] According to one embodiment, the first position and the second position of the image received from the at least one processor (410) may be determined by the at least one processor (410) based on distortion information defined to compensate for a position to be changed as the light of the first color emitted from each of the display panels (430) passes through each of the lenses (440). The distortion information may include a value at which the light of the first color is refracted by the lens, and may be stored in the display driving circuit (420) before receiving the image from the at least one processor (410).

[0210] In one embodiment, the third location can be identified by applying a first offset corresponding to the first distance, determined based on a first scaling value for the second color and the distance between the first location and the reference location, with respect to the first location. The fourth location can be identified by applying a second offset corresponding to the second distance, determined based on a first scaling value for the second color and the distance between the second location and the reference location, with respect to the second location.

[0211] In one embodiment, the first offset may have a first value when the first distance is less than a first reference distance, and a second value different from the first value when the first distance is greater than the first reference distance and less than a second reference distance that exceeds the first reference distance.

[0212] According to one embodiment, the first scaling value, the first offset, and the second offset may be defined as a look-up table (LUT).

[0213] According to one embodiment, the display driving circuit (420) may include a graphic random access memory (GRAM) for storing the image received from the at least one processor (410) and a register for storing the LUT. The register may store a plurality of LUTs including the LUT.

[0214] According to one embodiment, the head-worn electronic device (400) may further include at least one sensor. The display driving circuit (420) may be configured to determine the LUT among the plurality of LUTs by using sensing data regarding the positions of the eyes of the user obtained through the at least one sensor. The display driving circuit (420) may be configured to determine the first scaling value according to the second color from the LUT, and determine the first offset according to the distance between the first position and the reference position, and determine the second offset according to the distance between the second position and the reference position.

[0215] According to one embodiment, the head-mounted electronic device (400) may further include additional lenses (440) for vision correction of the eyes of the user. Each of the additional lenses (440) may be positioned with respect to each of the display panels (430). The display driving circuit (420) may be configured to further use information indicating properties of the additional lenses (440) to determine the LUT among the plurality of LUTs.

[0216] According to one embodiment, the head-worn electronic device (400) may include a memory that includes one or more storage media and stores one or more programs configured to be individually or collectively executed by the at least one processor (410). The one or more programs may include instructions that cause the electronic device (400) to identify a computational amount of the at least one processor (410). The one or more programs may include instructions that cause the electronic device (400) to transmit the image to the display driving circuit (420) based on the computational amount exceeding a reference computational amount. The one or more programs may include instructions that cause the electronic device (400) to perform compensation for the chromatic aberration of the light with respect to the image, thereby transmitting a compensated image to the display driving circuit (420), based on the computational amount being less than the reference computational amount. The one or more programs may include instructions that cause the electronic device (400) to control the display driving circuit (420) to display the compensated image on the display area.

[0217] According to one embodiment, the reference position may include a central position of the display area.

[0218] A method performed by a head-worn electronic device (400) including at least one processor (410) including a processing circuit as described above, lenses (440) each positioned with respect to the eyes of a user wearing the head-worn electronic device (400), display panels (430) configured to respectively emit light toward the lenses (440), and a display driving circuit (420) may include an operation in which the display driving circuit (420) receives, from the at least one processor (410), an image including a first portion corresponding to a first position of a display area of ​​each of the display panels (430) and a second portion corresponding to a second position of the display area. A distance between the first position and a reference position of the display area may be different from a distance between the second position and the reference position. The method may include an operation in which the display driving circuit (420) compensates for chromatic aberration of the light by changing, based on receiving the image, a position of the display area where the first portion of the image is to be displayed from the first position to a third position of the display area, and by changing a position of the display area where the second portion of the image is to be displayed from the second position to a fourth position of the display area. The method may include an operation in which the display driving circuit (420) displays the image in the display area based on the compensation for the chromatic aberration. The third position may be spaced apart from the first position by a first distance. The fourth position may be spaced apart from the second position by a second distance different from the first distance.

[0219] According to one embodiment, the method may further include an operation in which the display driving circuit (420) displays the image on the display area by displaying data of a first color of the first part of the image at the first position, displaying data of the first color of the second part of the image through the second position, displaying data of a second color of the first part of the image at the third position, and displaying data of the second color of the second part of the image through the fourth position, based on the compensation of the chromatic aberration.

[0220] According to one embodiment, the method may include an operation in which the display driving circuit (420) compensates for chromatic aberration of the light by changing, based on receiving the image, a position of the display area in which the first portion of the image is to be displayed, from the first position to a fifth position of the display area, and by changing a position of the display area in which the second portion of the image is to be displayed, from the second position to a sixth position of the display area. The method may further include an operation in which the display driving circuit (420) displays the image on the display area by displaying data of a third color of the first portion of the image at the fifth position, and displaying data of the third color of the second portion of the image through the sixth position, based on the compensation for the chromatic aberration. The fifth position may be spaced apart from the first position by a third distance. The sixth position may be spaced apart from the second position by a fourth distance different from the third distance.

[0221] In one embodiment, the third location may be closer to the reference location by the first distance than the first location. The fifth location may be farther from the reference location by the third distance than the first location. The fourth location may be closer to the reference location by the second distance than the second location. The sixth location may be farther from the reference location by the fourth distance than the second location.

[0222] According to one embodiment, the first position and the second position of the image received from the at least one processor (410) may be determined by the at least one processor (410) based on distortion information defined to compensate for a position to be changed as the light of the first color emitted from each of the display panels (430) passes through each of the lenses (440). The distortion information may include a value at which the light of the first color is refracted by the lens, and may be stored in the display driving circuit (420) before receiving the image from the at least one processor (410).

[0223] In one embodiment, the third location can be identified by applying a first offset corresponding to the first distance, determined based on a first scaling value for the second color and the distance between the first location and the reference location, with respect to the first location. The fourth location can be identified by applying a second offset corresponding to the second distance, determined based on a first scaling value for the second color and the distance between the second location and the reference location, with respect to the second location.

[0224] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0225] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0226] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0227] Various embodiments of the present document may be implemented as software (e.g., a program (1040)) including one or more instructions stored in a storage medium (e.g., an internal memory (1036) or an external memory (1038)) readable by a machine (e.g., an electronic device (1001)). For example, a processor (e.g., a processor (1020)) of the machine (e.g., an electronic device (1001)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0228] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0229] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

In head-worn electronic devices, At least one processor comprising a processing circuit; Lenses each positioned relative to the eyes of a user wearing the head-worn electronic device; Display panels configured to respectively emit light toward the lenses, each of the display panels including a display area; and Includes a display driving circuit, The above display driving circuit: Receive an image from at least one processor, the image including a first portion corresponding to a first position of the display area and a second portion corresponding to a second position of the display area, wherein a distance between the first position and a reference position of the display area is different from a distance between the second position and the reference position; Based on receiving the above image: Changing the position of the display area where the first part of the image is to be displayed from the first position to the third position of the display area, and By changing the position of the display area where the second part of the image is to be displayed from the second position to the fourth position of the display area, Compensation for the chromatic aberration of the above light is performed; and Based on the above compensation of the above chromatic aberration, it is configured to display the image in the above display area, The third position is spaced apart from the first position by a first distance, and The fourth position is spaced apart from the second position by a second distance different from the first distance, Head-worn electronic devices. In claim 1, The above display driving circuit: Based on the above compensation of chromatic aberration: Displaying data of the first color of the first part of the image at the first location, and displaying data of the first color of the second part of the image at the second location, and By displaying the second color data of the first part of the image at the third position, and displaying the second color data of the second part of the image at the fourth position, configured to display the image on the above display area, Head-worn electronic devices. In claim 2, The above display driving circuit: Based on receiving the above image: Change the position of the display area where the first part of the image is to be displayed from the first position to the fifth position of the display area, and Further compensation for chromatic aberration of the light is performed by changing the position of the display area where the second part of the image is to be displayed from the second position to the sixth position of the display area; and Based on the compensation of the chromatic aberration, the image is displayed on the display area by displaying data of the third color of the first part of the image at the fifth position, and displaying data of the third color of the second part of the image at the sixth position. The fifth position is spaced a third distance from the first position, and The sixth position is spaced apart from the second position by a fourth distance different from the third distance, Head-worn electronic devices. In claim 3, The first color above is green, The second color is red, and The third color above is blue, Head-worn electronic devices. In claim 3, The third position is closer to the reference position by the first distance than the first position, The fifth position is further from the reference position by the third distance than the first position, The fourth position is closer to the reference position by the second distance than the second position, and The sixth position is further from the reference position by the fourth distance than the second position. Head-worn electronic devices. In claim 2, The first position and the second position of the image received from the at least one processor are determined by the at least one processor based on distortion information defined to compensate for a position that will change as the light of the first color emitted from each of the display panels passes through each of the lenses, and The distortion information includes a value at which the light of the first color is refracted by the lens, and is stored in the display driving circuit before receiving the image from the at least one processor. Head-worn electronic devices. In claim 6, The third position is determined based on the first scaling value for the second color and the distance between the first position and the reference position, and is identified by applying a first offset corresponding to the first distance, and The fourth position is determined based on the first scaling value for the second color and the distance between the second position and the reference position, and is identified by applying a second offset corresponding to the second distance. Head-worn electronic devices. In claim 7, The above first offset is: If the first distance is less than the first reference distance, then it has a first value, and If the first distance exceeds the first reference distance and is less than the second reference distance exceeding the first reference distance, a second value different from the first value is provided. Head-worn electronic devices. In claim 7, The first scaling value, the first offset, and the second offset are defined as a look-up table (LUT). Head-worn electronic devices. In claim 9, The display driving circuit includes a GRAM (graphic random access memory) for storing the image received from the at least one processor and a register for storing the LUT, and The above register stores a plurality of LUTs including the LUT. Head-worn electronic devices. In claim 10, The head-worn electronic device further comprises at least one sensor, The above display driving circuit: Using sensing data about the positions of the user's eyes obtained through at least one sensor, determining the LUT among the plurality of LUTs; and From the LUT, the first scaling value is determined according to the second color, and the first offset is determined according to the distance between the first position and the reference position, and the second offset is determined according to the distance between the second position and the reference position. Head-worn electronic devices. In claim 11, The head-worn electronic device further comprises additional lenses for vision correction of the user's eyes, Each of the above additional lenses is positioned with respect to each of the display panels, The above display driving circuit: further using information indicating the properties of the additional lenses, and configured to determine the LUT among the plurality of LUTs, Head-worn electronic devices. In claim 1, The head-worn electronic device comprises a memory, which comprises one or more storage media and stores one or more programs configured to be individually or collectively executed by the at least one processor, One or more of the above programs: Identifying the computational amount of at least one processor, transmitting the image to the display driving circuit based on the amount of operation exceeding the reference amount of operation; and Based on the above computation amount being less than the above reference computation amount: By performing the compensation for the chromatic aberration of the light with respect to the image, the compensated image is transmitted to the display driving circuit, and Control the display driving circuit to display the compensated image on the display area; Including instructions that cause the above electronic device to operate, Head-worn electronic devices. In claim 1, The above reference position includes the center position of the display area, Head-worn electronic devices. A method performed by a head-worn electronic device comprising at least one processor including a processing circuit, lenses each positioned relative to the eyes of a user wearing the head-worn electronic device, display panels each configured to emit light toward the lenses, and a display driving circuit, An operation in which the display driving circuit receives, from the at least one processor, an image including a first portion corresponding to a first position of a display area of ​​each of the display panels and a second portion corresponding to a second position of the display area, wherein a distance between the first position and a reference position of the display area is different from a distance between the second position and the reference position; Based on receiving the above image: Changing the position of the display area where the first part of the image is to be displayed from the first position to the third position of the display area, and By changing the position of the display area where the second part of the image is to be displayed from the second position to the fourth position of the display area, The operation performed by the display driving circuit to compensate for the chromatic aberration of the light; and Based on the compensation of the chromatic aberration, the display driving circuit includes an operation of displaying the image in the display area, The third position is spaced apart from the first position by a first distance, and The fourth position is spaced apart from the second position by a second distance different from the first distance, method.

Images