Display device for displaying image using lens and control method therefor

Abstract

A control method for a display device for displaying an image using a lens, according to one embodiment of the present invention, comprises the steps of: receiving image data; before projecting to a lens, correcting the received image data differently for each pixel by referring to a memory; and outputting the corrected image data.

Description

Display device for displaying images using a lens and method for controlling the same

[0001] The present invention is applicable to various devices that provide VR virtual reality services. For example, it can be applied to HMDs (Head Mounted Displays), smart glasses, mobile phones, PCs, etc.

[0002] Various VR devices, including HMDs, have recently appeared on the market. However, users wearing these devices experience chromatic aberration because they view image data through lenses.

[0003] Chromatic aberration refers to the phenomenon in which light passing through a lens has different refractive indices depending on its wavelength, causing images to be formed in different places depending on the color.

[0004] The refractive properties of light vary: shorter wavelengths have a higher refractive index, while longer wavelengths have a lower refractive index. This phenomenon causes chromatic aberration, which primarily results in color distortion in the outer edges of the image.

[0005] To solve this problem, conventional techniques simply used a scaling technique to correct chromatic aberration.

[0006] However, when only the scaling technique was used to correct chromatic aberration, there was a problem in that the deformation of the boundary area of ​​the image was not expressed uniformly, so chromatic aberration still remained.

[0007] One embodiment of the present invention provides a new compensation algorithm that minimizes chromatic aberration occurring in an edge region due to lens distortion in a device that provides images to a user through a special lens.

[0008] More specifically, to improve the performance of CAC, we intend to additionally compensate for the edges of the image through lens distortion correction preprocessing and postprocessing processes for each channel according to lens distortion.

[0009] In order to achieve the above-described purposes and the like, a method for controlling a display device that displays an image using a lens according to an embodiment of the present invention includes a step of receiving image data, a step of additionally performing preprocessing and postprocessing for each pixel for chromatic aberration correction by referring to a memory before projecting the image data onto the lens, and a step of outputting image data on which the preprocessing and postprocessing for each pixel have been additionally performed.

[0010] The step of performing the above is characterized in that it further includes a step of correcting chromatic aberration in a different order for each pixel, for example.

[0011] The above image data includes, for example, at least one of image data for a red pixel, image data for a green pixel, or image data for a blue pixel.

[0012] The image data for the above green pixels is designed to be bypassed without correction.

[0013] Furthermore, for the image data for the red pixel, correction is designed to be performed in the order of preprocessing, up-scaling, and post-processing with reference to the memory.

[0014] The above preprocessing corresponds to, for example, deconvolution, and the above postprocessing corresponds to, for example, convolution.

[0015] Meanwhile, for the image data for the blue pixel, correction is designed to be performed in the order of preprocessing, down-scaling, and post-processing with reference to the memory.

[0016] The above preprocessing corresponds to, for example, convolution, and the above postprocessing corresponds to, for example, deconvolution.

[0017] The above-described correction step is designed to be performed only on the edge region of the image data, for example.

[0018] The above boundary region may include, for example, a location where the RGB values ​​change abruptly beyond a preset threshold.

[0019] In addition, a method for controlling a display device that displays an image using a lens according to an embodiment of the present invention further includes a step of performing a multiplication operation on a variable (k) value that varies depending on the refractive index of the lens during a post-processing process of a red pixel or a blue pixel before outputting image data.

[0020] An HMD (Head Mounted Display) according to one embodiment of the present invention includes a strap that can be fixed to a user's body, at least one lens, a memory, and a controller.

[0021] In particular, the controller receives image data, and before projecting the image data onto the at least one lens, additionally performs preprocessing and postprocessing for each pixel for chromatic aberration correction by referring to the memory, and outputs image data on which the preprocessing and postprocessing for each pixel has been additionally performed.

[0022] A display device for displaying an image using a lens according to one embodiment of the present invention includes a display and a controller.

[0023] In particular, the controller is characterized in that it receives image data, and before projecting it onto a lens, additionally performs preprocessing and postprocessing for each pixel to correct chromatic aberration, and controls the display to output image data on which the preprocessing and postprocessing for each pixel has been additionally performed.

[0024] According to one embodiment of the present invention, in a device that provides an image to a user through a special lens, chromatic aberration occurring in an edge region due to lens distortion can be minimized.

[0025] More specifically, for example, in order to improve the performance of CAC, there is an advantage of additionally compensating for the edges of the image through lens distortion correction preprocessing and postprocessing processes for each channel according to lens distortion.

[0026] Therefore, there is a technical effect that can also improve customer satisfaction related to chromatic aberration.

[0027] In addition to the technical effects described above, matters that are obvious to those skilled in the art in consideration of the entire specification are also included in the additional technical effects of the present invention.

[0028] FIG. 1 illustrates various appearances of XR devices to which an embodiment of the present invention can be applied.

[0029] Figure 2 is a perspective view of the HMD device illustrated in Figure 1 viewed from various angles.

[0030] FIG. 3 is a block diagram illustrating the main internal components included in the HMD device illustrated in FIG. 1.

[0031] FIG. 4 illustrates an example of a silicon semiconductor substrate including a driving circuit included in the HMD device illustrated in FIG. 1.

[0032] FIG. 5 is a block diagram of a device that provides a VR (Virtual Reality) service according to one embodiment of the present invention.

[0033] FIG. 6 illustrates a process of additionally performing preprocessing and postprocessing in a CAC module according to one embodiment of the present invention.

[0034] Figure 7 illustrates the entire process of CAC processing comparing the prior art and an embodiment of the present invention.

[0035] FIG. 8 illustrates a more specific process of preprocessing and postprocessing for red pixel data according to one embodiment of the present invention.

[0036] FIG. 9 is a drawing for explaining video data of edge areas before and after lens passage comparing a conventional technology and an embodiment of the present invention.

[0037] And, FIG. 10 is a flow chart of a method for providing a VR (Virtual Reality) service according to another embodiment of the present invention.

[0038] Throughout the specification, identical reference numbers refer to substantially identical components. In the following description, detailed descriptions of components and functions not related to the core components of the present disclosure and those known in the art of the present disclosure may be omitted. The meanings of terms used in this specification should be understood as follows.

[0039] The advantages and features of the present disclosure, and methods for achieving them, will become clearer with reference to the embodiments described below in detail with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, but may be implemented in various different forms. These embodiments are provided solely to ensure the completeness of the present disclosure and to fully inform those skilled in the art of the scope of the disclosure, and the present disclosure is defined solely by the scope of the claims.

[0040] The shapes, sizes, ratios, angles, numbers, etc., disclosed in the drawings for explaining embodiments of the present disclosure are illustrative and are not limited to the details depicted. Like reference numerals designate like elements throughout the specification. Furthermore, in describing the present disclosure, detailed descriptions of related known technologies will be omitted if they are deemed to unnecessarily obscure the gist of the present disclosure.

[0041] In this specification, when the terms "includes," "has," and "consists of," are used, other parts may be added, unless "only" is used. When a component is expressed in the singular, it includes the plural unless otherwise explicitly stated.

[0042] When interpreting a component, it is interpreted as including the margin of error even if there is no separate explicit description.

[0043] When describing a positional relationship, for example, when the positional relationship between two parts is described as 'on top of', 'upper part of', 'lower part of', 'next to', etc., one or more other parts may be located between the two parts, unless 'right away' or 'directly' is used.

[0044] When describing a temporal relationship, for example, when the temporal continuity is described as 'after', 'following', 'next to', 'before', etc., it can also include cases where it is not continuous, as long as 'right away' or 'directly' is not used.

[0045] While terms like "first" and "second" are used to describe various components, these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, a "first" component referred to below may also be a "second" component within the technical scope of the present invention.

[0046] “X-axis direction”, “Y-axis direction” and “Z-axis direction” should not be interpreted as merely geometric relationships in which the relationship between them is perpendicular to each other, but may mean a wider directionality within the range in which the configuration of the present disclosure can function functionally.

[0047] FIG. 1 illustrates various appearances of XR devices to which an embodiment of the present invention can be applied.

[0048] Virtual Reality (VR) refers to a technology that uses virtual images, for example, for objects, backgrounds, and environments, rather than real ones. A representative product used in VR technology is the Head Mounted Display (HMD). When the HMD is worn on the head, small displays are positioned close to each eye, projecting three-dimensional (3D) images using parallax. Using a gyro sensor that tracks the user's movements and a rendering function that creates images based on those movements, the user can experience the feeling of being in a 3D space. Figure 1 (a) illustrates the exterior of an HMD device as an example.

[0049] Augmented Reality (AR) refers to a technology that superimposes a three-dimensional virtual image onto a real-world image or background, creating a single image. A representative product used in AR technology is AR glasses. These are eyeglass-shaped electronic devices that display AR content on transparent lenses. While worn like regular glasses, they display a large screen-like display in front of the user's eyes or allow them to access various AR content. Users can experience an expanded reality experience that combines AR content by utilizing all 360-degree spaces, centered on the user. Figure 1 (b) illustrates the exterior of AR glasses as an example.

[0050] Mixed Reality (MR) encompasses both Augmented Reality (AR), which adds virtual information to the real world, and Augmented Virtuality (AV), which adds real-world information to a virtual environment. In other words, it provides a smart environment where reality and virtuality are seamlessly connected, enabling users to experience a richer experience.

[0051] Extended Reality (XR) refers to ultra-realistic technologies and services that encompass mixed reality (MR) technologies that encompass virtual reality (VR) and augmented reality (AR).

[0052] In the following Figures 2 to 4, an HMD device to which VR technology is applied will be described as an example for convenience of explanation, but the present invention can be applied to any type of XR device.

[0053] Figure 2 is a perspective view of the HMD device illustrated in Figure 1 viewed from various angles.

[0054] FIG. 2 (a) is a perspective view from above of an HMD device according to an embodiment of the present invention, and reference numeral 210 denotes a lens, and there are two lenses for the left eye and the right eye, respectively.

[0055] No. 220 is a display, and it is possible to manufacture it in a form where there are two displays to display left-eye images and right-eye images respectively, or it is also within the scope of the present invention to manufacture it as a single display.

[0056] And, number 230 refers to an HMD device (other types of VR devices are also within the scope of the present invention).

[0057] FIG. 2 (b) is a perspective view of an HMD device according to an embodiment of the present invention viewed from the front, and FIG. 2 (c) is a perspective view of an HMD device according to an embodiment of the present invention viewed from the side.

[0058] FIG. 3 is a block diagram illustrating the main internal components included in the HMD device illustrated in FIG. 1.

[0059] As illustrated in FIG. 3, the image receiving unit (310) included in the left-eye device (300) and the image receiving unit (310) included in the right-eye device (350) receive the left-eye image and the right-eye image, respectively.

[0060] This is a characteristic of human vision, and since the viewpoint of an object must be different depending on the position of the two eyes, the images perceived by both eyes can be combined in the brain to be recognized as a single image, so the images for the left and right eyes are designed to be received separately.

[0061] The first image correction unit (320) included in the left-eye device (300) and the second image correction unit (340) included in the right-eye device (350) independently process the received image for R, G, and B, and then transmit the image to the left-eye and right-eye panels included in the image output unit (330), respectively.

[0062] And, the images sent to the left eye device (300) and the right eye device (350) are generated by the AP (application processor).

[0063] Meanwhile, in Figure 3, the device is divided into a receiving unit, a correction unit, and an output unit, but this configuration exists independently for the left-eye and right-eye devices. Of course, implementing it as a single configuration also falls within the scope of the present invention.

[0064] And, FIG. 4 illustrates an example of a silicon semiconductor substrate including a driving circuit included in the HMD device illustrated in FIG. 1.

[0065] Unlike display panels in other products according to the prior art, the HMD device (including other types of VR devices) according to one embodiment of the present invention is designed so that the driving layer is raised for the silicon semiconductor.

[0066] Furthermore, when the image is corrected, the resolution for red pixels increases, while that for blue pixels decreases. Therefore, before outputting the video data, some data for red pixels is removed, and the blue pixels are filled with black and transmitted to the driving layer to output the video data.

[0067] Figure 5 is a block diagram of a device providing a VR (Virtual Reality) service according to one embodiment of the present invention. Reference may be made to the embodiments described above in Figures 1 to 4 for supplementary interpretation of Figure 5 and the like.

[0068] In particular, since the product to which the present invention is applied allows the user to view image data through a lens (210) or the like as shown in FIG. 2, chromatic aberration occurs, and the present invention seeks to solve such chromatic aberration problem.

[0069] For example, as illustrated in FIG. 5, a device (500) providing a VR (Virtual Reality) service includes an image preprocessing correction unit (510), a lens distortion correction unit (520), an image postprocessing correction unit (530), and an output image synthesis unit (540).

[0070] In particular, it is also within the scope of the present invention to design the image preprocessing correction unit (510), the lens distortion correction unit (520), the image postprocessing correction unit (530), and the output image synthesis unit (540) to be performed by a single controller, processor, AP, etc.

[0071] Meanwhile, according to the conventional technology, chromatic aberration was corrected by applying up and down scaling according to lens distortion, but there was a problem that chromatic aberration still remained at the boundary of the image due to the difference between the lens distortion parameter value and the scaling ratio / parameter value.

[0072] To solve this problem, unlike the prior art, the device according to one embodiment of the present invention is designed to add an image preprocessing correction unit (510) and an image postprocessing correction unit (530). The specific functions of the image preprocessing correction unit (510) and the image postprocessing correction unit (530) newly introduced in the present invention will be described in more detail below with reference to FIG. 6.

[0073] FIG. 6 illustrates a process of additionally performing preprocessing and postprocessing in a CAC (Chromatic Aberration Correction) module according to one embodiment of the present invention.

[0074] As illustrated in (a) of Fig. 6, red or blue image data is intentionally designed to be included at the edge of the image to compensate for chromatic aberration. Consequently, the chromatic aberration phenomenon is not visible to the user in the image data passing through the lens. A related embodiment will be described in more detail below in Fig. 9.

[0075] Meanwhile, in order to obtain the result for (a) of Fig. 6, as shown in (b) of Fig. 6, image data (620) that has undergone preprocessing on the original image (610) is obtained, scaling is performed on the obtained image data (620), and finally, postprocessing is performed on the scaled image data (630). 640 denotes image data that has completed postprocessing. Here, preprocessing is performed by the image preprocessing correction unit (510) described in the previous Fig. 5, while postprocessing is performed by the image postprocessing correction unit (530) described in the previous Fig. 5.

[0076] However, experimentally, simply performing the same preprocessing and postprocessing on all pixel image data did not completely resolve the chromatic aberration issue. To further address this issue, chromatic aberration correction must be performed in a different order for each pixel. A related embodiment will be described in more detail in FIG. 7 below.

[0077] Figure 7 illustrates the entire process of CAC processing comparing the prior art and an embodiment of the present invention.

[0078] First, let me explain the problems of chromatic aberration correction using conventional techniques through a diagram.

[0079] As illustrated in (a) of Fig. 7, the CAC chromatic aberration correction module (700) according to the prior art was designed to simply perform a scaling process. That is, for example, it upscales or downscales image data for red pixels and image data for blue pixels, and outputs an interpolated image.

[0080] However, as mentioned above, contrary to the theory, there was a problem that the deformation was not uniformly performed in the boundary area.

[0081] To address this, as illustrated in (b) of Fig. 7, according to one embodiment of the present invention, a preprocessing step is introduced before the scaling process, and a postprocessing step is introduced after the scaling process. However, as briefly mentioned in Fig. 6, it has been experimentally confirmed that the specific preprocessing and postprocessing methods must vary for each pixel (Red, Green, Blue, etc.).

[0082] For image data related to red pixels, an upscaling process is required for chromatic aberration correction, and it was experimentally confirmed that deconvolution must be performed as preprocessing because the boundary area of ​​the image becomes wider during this process.

[0083] Therefore, when processing image data related to red pixels, the CAC module (710) first performs deconvolution in the preprocessing unit (711), then up-scales, and finally, the post-processing unit (713) performs convolution.

[0084] On the other hand, for image data related to blue pixels, a downscaling process is required for chromatic aberration correction. In this case, it was experimentally confirmed that convolution should be performed as preprocessing and deconvolution should be performed as postprocessing because the boundary area of ​​the image becomes narrow.

[0085] Therefore, when processing image data related to blue pixels, the CAC module (720) first performs convolution in the preprocessing unit (721), then down-scales, and finally, the postprocessing unit (723) performs de-convolution.

[0086] Figure 8 illustrates a more specific process for preprocessing and postprocessing red pixel data, according to one embodiment of the present invention. While formulas are included as examples, the present invention is not limited thereto, and it is clear that the scope of the rights should be determined in accordance with the matters set forth in the patent claims.

[0087] According to the prior art, when an input value (input x) is input to the CAC chromatic aberration module, an output value (output y) is generated as shown in (a) of Fig. 7.

[0088] On the other hand, according to one embodiment of the present invention, it was introduced to solve the problem of inconsistent deformation of an area in a scaling process according to a pixel value of an image, and when deformation occurs in a boundary area of ​​an image due to scaling, the boundary area is arbitrarily manipulated in advance through preprocessing, a y value is obtained through scaling, and then the arbitrarily manipulated boundary is readjusted in a postprocessing process to obtain a z value.

[0089] In this process, since there is a difference in refractive index for each lens, post-processing is performed through a mask that takes the convolution of h and k, and in particular, by manipulating (e.g., multiplication operation) the variable (k) value that varies depending on the refractive index of the lens and adjusting it so that chromatic aberration is removed when the result for z is displayed on the lens, it is expected that the present invention can be applied to any lens with a technical effect.

[0090] Meanwhile, Fig. 8 illustrates CAC chromatic aberration correction for red pixels. As described above, in the case of image data for red pixels, the boundary area of ​​the image becomes wider during the up-scaling process.

[0091] Therefore, the preprocessing unit (811) is a deconvolution unit. First, the scaler (812) performs upscaling. Finally, the post-processing unit (813) performs convolution ( ) is performed.

[0092] On the other hand, for image data for blue pixels, the boundary area of ​​the image becomes narrower during the down-scaling process, so convolution is performed through h as preprocessing, and as postprocessing Perform.

[0093] h and k can be additionally adjusted as mask parameters depending on the characteristics of the lens used in VR devices such as HMD and the distance from the center of the center, and a blur mask, etc. can be applied.

[0094] Meanwhile, a mask is a rectangular or circular window that can cover an image and is designed to perform functions such as setting an area by limiting a part of the image.

[0095] FIG. 9 is a drawing for explaining video data of edge areas before and after lens passage comparing a conventional technology and an embodiment of the present invention.

[0096] As illustrated in (a) of Fig. 9, image data such as red is intentionally included in the boundary portion when compensating for chromatic aberration according to the prior art. However, the chromatic aberration phenomenon still remains even after passing through the lens (i.e., red pixel data (910) not included in the image appears, for example, in the edge area, etc.).

[0097] On the other hand, as shown in (b) of FIG. 9, it can be seen that a technical effect was confirmed in which red pixel data not included in the image does not appear at all in the edge area, etc. after passing through the lens when compensating for chromatic aberration according to one embodiment of the present invention.

[0098] And, FIG. 10 is a flow chart of a method for providing a VR (Virtual Reality) service according to another embodiment of the present invention.

[0099] First, as illustrated in FIG. 10, a device providing a VR service according to another embodiment of the present invention receives input image data for each channel (S1000). Here, "by channel" refers to red pixel data, green pixel data, blue pixel data, etc.

[0100] As described above, green pixel data is bypassed without any special CAC chromatic aberration compensation procedure (S1004).

[0101] On the other hand, red pixel data is first subjected to preprocessing (e.g., convolution) (S1001), then upscaled (S1002), and finally postprocessed (e.g., deconvolution) (S1003).

[0102] Meanwhile, the blue pixel data is first subjected to preprocessing (e.g., deconvolution) (S1005), then down-scaled (S1006), and finally post-processing (e.g., convolution) (S1007).

[0103] And, the VR service providing device according to one embodiment of the present invention synthesizes and outputs each RGB pixel data (S1008).

[0104] To summarize and explain again, it is as follows.

[0105] A device according to one embodiment of the present invention is designed to receive image data, correct chromatic aberration of each pixel of the received image data in a different order by referring to a memory before projecting the image data onto a lens, and output the corrected image data.

[0106] The above image data includes, for example, at least one of image data for a red pixel, image data for a green pixel, or image data for a blue pixel.

[0107] Meanwhile, the above-described steps S1001 to S1007 may be designed to be performed only on the edge region of the image data.

[0108] Furthermore, the boundary region includes, for example, a location where the RGB values ​​change abruptly beyond a preset threshold.

[0109] Meanwhile, the present invention can also be applied to the HMD illustrated in (a) of FIG. 1.

[0110] The HMD illustrated in (a) of FIG. 1 includes a strap that can be externally fixed to a user's body, and internally includes at least one lens, a memory, and a controller.

[0111] In particular, the controller is designed to receive image data, and before projecting the image data onto at least one lens, correct chromatic aberration of the received image data in a different order for each pixel by referring to the memory, and output the corrected image data. Furthermore, it will be considered that the scope of the present invention also includes a supplementary interpretation of the HMD illustrated in (a) of Fig. 1 with reference to other drawings.

[0112] Furthermore, it is also within the scope of another right of the present invention to not implement the entire HMD illustrated in (a) of Fig. 1, but to implement only some of the internal components.

[0113] For example, according to another embodiment of the present invention, a device for providing a VR (Virtual Reality) service includes a display and a controller.

[0114] In particular, the controller is characterized in that it receives image data, corrects chromatic aberration of the received image data in a different order for each pixel before projecting it onto a lens, and controls the display to output the corrected image data.

[0115] Meanwhile, although the specification exemplifies VR, HMD, etc., the present invention can be applied to any type of display device that displays images using a lens, and it is natural that the scope of rights should be determined according to the matters described in the patent claims.

[0116] Those skilled in the art will appreciate that the present invention described above can be implemented in other specific forms without changing the technical idea or essential characteristics thereof.

[0117] For example, the image processing device according to the present disclosure may be implemented in the form of an IC by each component individually or by combining two or more components, and the functions of the image processing device may be implemented in the form of a program and installed in the IC. When the functions of the image processing device according to the present disclosure are implemented as a program, the functions of each component included in the image processing device may be implemented as a specific code, and the codes for implementing the specific functions may be implemented as a single program or may be implemented by dividing them into multiple programs.

[0118] Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. The scope of the present disclosure is defined by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included within the scope of the present disclosure.

Claims

1. A method for controlling a display device that displays an image using a lens, Step of receiving image data; A step of additionally performing preprocessing and postprocessing for each pixel to correct chromatic aberration by referring to the memory before being projected onto the lens; and A step of outputting image data on which preprocessing and postprocessing for each pixel are additionally performed. A method for controlling a display device that displays an image using a lens characterized by including a .

2. In paragraph 1, The steps performed above are: Steps for correcting chromatic aberration in different orders for each pixel above A method for controlling a display device for displaying an image using a lens characterized by further including:

3. In paragraph 2, The above image data is, A control method for a display device that displays an image using a lens characterized in that it includes at least one of image data for a red pixel, image data for a green pixel, and image data for a blue pixel.

4. In paragraph 3, A control method for a display device that displays an image using a lens characterized in that the image data for the green pixel is designed to be bypassed without correction.

5. In paragraph 3, For the image data for the above red pixel, A control method for a display device that displays an image using a lens, characterized in that correction is performed in the order of preprocessing, up-scaling, and post-processing with reference to the above memory.

6. In paragraph 5, A control method for a display device that displays an image using a lens, wherein the above preprocessing corresponds to deconvolution and the above postprocessing corresponds to convolution.

7. In paragraph 3, For the image data for the above blue pixel, A control method for a display device that displays an image using a lens, characterized in that correction is performed in the order of preprocessing, down-scaling, and post-processing with reference to the above memory.

8. In paragraph 7, A control method for a display device that displays an image using a lens, wherein the above preprocessing corresponds to convolution and the above postprocessing corresponds to deconvolution.

9. In paragraph 2, The above correction step is, In the above image data, it is characterized in that it is performed only for the boundary area, The above boundary area is, A control method for a display device that displays an image using a lens characterized by including a position where the RGB value changes abruptly beyond a preset threshold value.

10. In paragraph 9, Before outputting the above image data, A step of multiplying the variable (k) value that varies depending on the refractive index of the lens during the post-processing of the red pixel or blue pixel. A method for controlling a display device for displaying an image using a lens characterized by further including:

11. In HMD (Head Mounted Display), A strap that can be attached to the user's body; At least one lens; memory; and controller Including, but not limited to, The above controller, Receive image data, Before being projected onto at least one lens, additional preprocessing and postprocessing for each pixel for chromatic aberration correction are performed with reference to the memory, An HMD characterized in that it outputs image data on which preprocessing and postprocessing are additionally performed for each pixel.

12. In a display device that displays an image using a lens, display; and controller Including, but not limited to, The above controller, Receive image data, Before being projected onto the lens, additional preprocessing and postprocessing are performed for each pixel to correct chromatic aberration. A display device that displays an image using a lens, characterized in that it controls to output corrected image data through the display.

13. In paragraph 12, The above controller is a display device that displays an image using a lens characterized in that chromatic aberration is corrected in a different order for each pixel.

14. In paragraph 13, The above image data is, A display device that displays an image using a lens characterized by including at least one of image data for a red pixel, image data for a green pixel, and image data for a blue pixel.

15. In paragraph 13, A display device that displays an image using a lens characterized in that the image data for the above green pixel is designed to be bypassed without correction.

16. In paragraph 13, For the image data for the above red pixel, A display device that displays an image using a lens, characterized in that correction is performed in the order of preprocessing, up-scaling, and post-processing by referring to memory.

17. In paragraph 16, A display device that displays an image using a lens, wherein the above preprocessing corresponds to deconvolution and the above postprocessing corresponds to convolution.

18. In paragraph 13, For the image data for the above blue pixel, It is designed to perform corrections in the order of preprocessing, down-scaling, and post-processing, referring to memory. A display device that displays an image using a lens, wherein the above preprocessing corresponds to convolution and the above postprocessing corresponds to deconvolution.

19. In paragraph 13, The above controller, In the above image data, it is characterized in that the correction is controlled so that it is performed only for the boundary area, The above boundary area is, A display device that displays an image using a lens characterized by including a position where the RGB values ​​change abruptly beyond a preset threshold.

20. In paragraph 19, The above controller, Before outputting the above image data, A display device that displays an image using a lens characterized in that a variable (k) value that varies depending on the refractive index of the lens is multiplied during the post-processing of a red pixel or a blue pixel.

Images