Display driving device, display driving method and VR device

Abstract

The invention relates to a display driving device, a display driving method and a VR device. The driving method comprises the following steps: receiving an image; calculating the distance between the current point and the current pixel for the sub-pixel of the image; calculating a weight based on the parameter; and compensating for distortion in the image based on the weights. The color of the sub-pixel may include at least one of red, green, or blue, and the parameter may include at least one of a distance parameter, a distortion parameter, or a sub-pixel parameter.

Description

Technical Field

[0001] The present disclosure relates to a display driving device and a display driving method. Background Art

[0002] During operation of the display, distortion may occur in the displayed image depending on the characteristics of the lens and / or the characteristics of the image. If the input image is a digital image, chromatic aberration may be corrected during digital image processing. When chromatic aberration correction is performed on a digital image, the resulting image also has discrete features. One of the disadvantages of chromatic aberration correction is that an unnatural image is produced. Therefore, a display driving method and apparatus for correcting chromatic aberration distortion while compensating for the unnatural appearance of the resulting image is needed. Summary of the invention

[0003] Accordingly, the present disclosure is directed to a display driving apparatus and a display driving method that substantially obviate one or more problems due to limitations and disadvantages of the related art.

[0004] In an aspect, a display method and apparatus are provided for obtaining a smooth image from a user perception perspective by considering a degree of distortion in each lens by reflecting characteristics of the lens.

[0005] In an aspect, a low-latency and low-complexity display driving method and apparatus are provided to address distortion in various display devices and lenses and obtain a natural image.

[0006] However, the present disclosure is not limited to what has been specifically described above, and the scope of the aspects may be extended to other technical challenges that a person skilled in the art can infer based on the entire disclosure provided.

[0007] To achieve these and other advantages and in accordance with the present disclosure, as implemented and broadly described herein, a display driving method according to aspects is provided. The display driving method includes the following steps: receiving an image; calculating a distance between a current point and a current pixel for a sub-pixel of the image; calculating a weight based on a parameter; and compensating for distortion in the image based on the weight. The color of the sub-pixel may include at least one of red, green, or blue, and the parameter may include at least one of a distance parameter, a distortion parameter, or a sub-pixel parameter.

[0008] In another aspect of the present disclosure, a display driving device includes: a position calculator, which is configured to receive an image and calculate the distance between a current point and a current pixel for a sub-pixel of the image; a weight calculator, which is configured to calculate a weight based on a parameter; and a distortion correction calculator, which is configured to compensate for distortion in the image based on the weight, wherein the color of the sub-pixel includes at least one of red, green or blue, and wherein the parameter includes at least one of a distance parameter, a distortion parameter and a sub-pixel parameter.

[0009] In another aspect of the present disclosure, a virtual reality (VR) device includes: a lens; and a display driver device connected to the lens, wherein the display driver device includes: a position calculator, the position calculator is configured to receive an image and calculate the distance between a current point and a current pixel for a sub-pixel of the image; a weight calculator, the weight calculator is configured to calculate a weight based on a parameter; and a distortion correction calculator, the distortion correction calculator is configured to compensate for distortion in the image based on the weight, wherein the color of the sub-pixel includes at least one of red, green or blue, and wherein the parameter includes at least one of a distance parameter, a distortion parameter and a sub-pixel parameter.

[0010] It is to be understood that both the foregoing general description and the following detailed description of the present disclosure are exemplary and explanatory and are intended to provide further explanation of the disclosure as claimed.

[0011] The present disclosure has the following effects.

[0012] The display driving method and apparatus according to aspects can efficiently process digital images.

[0013] The display driving method and apparatus according to aspects can provide high-quality and easily recognizable digital images.

[0014] A display driving method and apparatus according to aspects may provide general services including a virtual reality (VR) service. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The accompanying drawings are included to provide a further understanding of the aspects, and the accompanying drawings illustrate aspects of the present disclosure and serve to explain the principles of the aspects together with the description. For a better understanding of the various aspects described herein, reference should be made to the following description of the aspects in conjunction with the accompanying drawings, in which the same reference numerals refer to corresponding parts throughout the drawings.

[0016] In the attached picture:

[0017] Figure 1A and Figure 1B Various appearances of extended reality (XR) devices applicable to one aspect of the present disclosure are illustrated;

[0018] Figure 2A , Figure 2B and Figure 2C yes Figure 1A and Figure 1B Stereoscopic views of the head mounted display (HMD) device from various angles;

[0019] Figure 3 is an example Figure 1A and Figure 1B A block diagram of the main components within the HMD device shown;

[0020] Figure 4 An exemplary silicon semiconductor substrate including a driving circuit incorporated into an HMD device is illustrated;

[0021] Figure 5 A configuration of a display driving device according to an aspect is illustrated;

[0022] Figure 6 Exemplary distortion compensation according to aspects is illustrated;

[0023] Figure 7 A distortion compensation method according to aspects is illustrated;

[0024] Figure 8 A chromatic aberration correction method according to aspects is illustrated;

[0025] Fig. 9 A distortion compensation method according to aspects is illustrated;

[0026] Fig.10 A chromatic aberration compensation method according to aspects is illustrated;

[0027] Fig.11 The chromatic aberration correction results according to aspects are illustrated;

[0028] Fig.12 The chromatic aberration correction results according to aspects are illustrated;

[0029] Fig.13 Distortion compensation according to aspects is illustrated;

[0030] Fig.14 The distortion compensation effect according to aspects is illustrated;

[0031] Fig.15 A display driving device according to aspects is illustrated;

[0032] Fig.16 An apparatus panel according to aspects is illustrated;

[0033] Fig.17 A display driving method according to aspects is illustrated;

[0034] Fig.18is a block diagram of an apparatus for providing a virtual reality (VR) service according to one aspect of the present disclosure;

[0035] Fig.19A , Fig.19B and Fig.19C illustrates the results of a distortion compensation algorithm according to one aspect of the present disclosure compared to the prior art;

[0036] Fig. 20 is a diagram illustrating bilinear interpolation according to one aspect of the present disclosure;

[0037] Fig.21A and Fig. 21B is a diagram illustrating a process of calculating different distortion correction weights considering the distance between a center point and a current pixel according to one aspect of the present disclosure;

[0038] Fig.22A and Fig. 22B is a diagram illustrating a process of calculating different distortion correction weights in consideration of the distance between a center point and a current pixel according to one aspect of the present disclosure; and

[0039] Fig.23 is a flowchart of a method for providing VR services according to another aspect of the present disclosure. DETAILED DESCRIPTION

[0040] Hereinafter, various aspects of the present disclosure will be described in detail, examples of which are illustrated in the accompanying drawings. The following detailed description with reference to the accompanying drawings is intended to illustrate various aspects of the present disclosure, rather than merely representing aspects that can be implemented according to the present disclosure. The following detailed description includes specific details to provide a thorough understanding of the aspects. However, it is apparent to those skilled in the art that the aspects can be practiced without these specific details.

[0041] Most of the terms used herein are selected from terms commonly used in the relevant field. However, some terms are arbitrarily selected by the applicant, and their meanings are refined in the following description as needed. Therefore, aspects should be understood based on the intended meaning of the terms rather than their names or meanings.

[0042] Figure 1A and Figure 1B Various appearances of extended reality (XR) devices suitable for one aspect of the present disclosure are illustrated.

[0043] Virtual reality (VR) refers to technology that utilizes virtual images for objects, backgrounds, and environments that are not part of the real world. One of the prominent products used in VR technology is a head-mounted display (HMD) device. When the HMD device is worn on the head, the HMD device has a small display positioned close to the eyes, thereby projecting a three-dimensional (3D) image based on parallax. The user can experience the feeling of being in a 3D space through the following features: a gyroscope sensor for tracking the user's movements; and a rendering function that creates images corresponding to these movements. Figure 1A The appearance of an exemplary HMD device is illustrated.

[0044] Augmented reality (AR) refers to a technology that superimposes 3D virtual images onto real-world images or backgrounds, and then displays the superimposed images as a single composite image. One of the prominent products used in AR technology is AR glasses. AR glasses are electronic devices in the form of glasses that implement AR content on transparent lenses. When worn like ordinary glasses, AR glasses can display images in front of the eyes, much like having a large screen, and can enable a variety of AR content experiences. Users can experience XR combined with AR content by utilizing all spaces within a 360-degree range relative to the user. Figure 1B The appearance of exemplary AR glasses is illustrated.

[0045] Mixed reality (MR) includes AR, which adds virtual information on the basis of reality, and augmented virtuality (AV), which adds real information to the virtual environment. In other words, MR provides an intelligent environment in which reality and virtuality are seamlessly connected, giving users a rich experience.

[0046] XR refers to hyper-reality technologies and services including VR, AR and MR.

[0047] In the following, for the sake of convenience, reference will be made to Figure 1A and Figure 1B Describes an HMD device based on VR technology. However, the present disclosure is applicable to all types of XR devices.

[0048] Figure 2A , Figure 2B and Figure 2C yes Figure 1A and Figure 1B Perspective views of the HMD device from various angles are shown.

[0049] Figure 2A 2 is a top perspective view of an HMD device according to an aspect of the present disclosure. Reference numeral 210 represents a lens, and there are two lenses for the left eye and the right eye, respectively.

[0050] Reference numeral 220 represents a display. It is within the scope of the present disclosure to produce a configuration with two displays, each display separately displaying a left-eye image and a right-eye image, or to produce a configuration with a single display.

[0051] Reference numeral 230 represents an HMD device (different types of VR devices also fall within the scope of the present disclosure).

[0052] Figure 2B is a front perspective view of an HMD device according to one aspect of the present disclosure, and Figure 2C is a side perspective view of an HMD device according to one aspect of the present disclosure.

[0053] Figure 3 is an example Figure 1A and Figure 1B A block diagram of the main components of the HMD device shown.

[0054] like Figure 3 As shown, the image receiver 310 included in the left-eye device 300 and the right-eye device 350 receives a left-eye image and a right-eye image, respectively.

[0055] Due to the visual characteristics of the human eye, it is necessary to observe an object from different angles based on the positions of both eyes, and the images perceived by both eyes can be combined in the brain and perceived as a single image. Therefore, the image receiver 310 is designed to receive images suitable for the left eye and the right eye respectively.

[0056] The first image corrector 320 included in the left eye device 300 and the second image corrector 340 included in the right eye device 350 independently process the received image for each of red (R), green (G), and blue (B). Then, the first image corrector 320 and the second image corrector 340 transfer the processed images to the left eye panel and the right eye panel, respectively. The left eye panel and the right eye panel are respectively included in the image output unit 330.

[0057] The images provided to the left-eye device 300 and the right-eye device 350 are generated by an application processor (AP).

[0058] exist Figure 3 In the present invention, the HMD device includes a receiver, a corrector, and an output unit, but this configuration exists independently for each of the left-eye device and the right-eye device. It also falls within the scope of the present disclosure to implement the receiver, the corrector, and the output unit as a single form.

[0059] Figure 4 An exemplary silicon semiconductor substrate including a driving circuit incorporated into the HMD device shown in FIG. 1 is illustrated.

[0060] Unlike display panels in other products in the prior art, an HMD device (including other types of VR devices) according to one aspect of the present disclosure is designed to have a driving layer placed on top of a silicon semiconductor.

[0061] For example, when processing an image, the resolution of the R pixel increases, while the resolution of the B pixel decreases. Therefore, the HMD device is designed so that some data of the R pixel is removed before outputting the video data, and the B pixel is filled with black to match the resolution of the G pixel, and then the video data is passed to the driving layer to output the video data.

[0062] In some aspects, the resolution of the R pixels and / or the B pixels may be increased. In this case, some data of the R pixels and / or the B pixels having the increased resolution may be removed.

[0063] In some aspects, the resolution of the R pixels and / or the B pixels may be reduced. In this case, the R pixels and / or the B pixels with reduced resolution may be filled with black.

[0064] Figure 5 A configuration of a display driving device according to an aspect is illustrated.

[0065] Reference Figure 5 , the display driving device 500 may include: a calculator 501 for calculating the position between the current pixel and the current point; a storage unit 502 for storing lens distortion parameters; a storage unit 503 for storing sub-pixel structure parameters; a calculator 504 for calculating distortion correction weights based on distance and distortion parameters; a calculator 505 for correcting image distortion; and / or an output image synthesizer 506. The operation of each component is described below. Figure 5 Each component of the display driving apparatus according to the illustrated aspects may correspond to hardware, software, a processor, and / or a combination thereof.

[0066] Figure 5 The display driving apparatus and method according to aspects may perform and include an image correction method based on a sub-pixel arrangement structure of a display.

[0067] Figure 5 The display driving device and method according to the aspect can be executed and include an algorithm for compensating for color artifacts caused by the sub-pixel structure of a display in a device that provides an image to a user through a special lens. If the relative position of the sub-pixels within a single pixel (i.e., the distance information of the sub-pixels located based on the center position of the pixel) is used as a parameter in the algorithm for compensating for distortion, the color artifacts can be compensated.

[0068] The display driving apparatus 500 may receive an input image and generate an output image for display driving. The input image may be processed into an output image based on operations according to the following aspects.

[0069] The first calculator 501 can calculate the position between the current pixel and the current point. The current pixel can represent a pixel included in the input image, and the current point can represent the position of the current point from the center of the display drive device and / or the lens. The first calculator can be called a position calculator between the current pixel and the current point.

[0070] The first storage unit 502 may store parameters representing information related to distortion in a display driving device and / or a lens connected to the display driving device. The first storage unit (i.e., lens distortion parameter storage unit) 502 may provide lens distortion parameters for display driving. The first storage unit may be referred to as a lens distortion parameter storage unit.

[0071] The second storage unit 503 can store parameters representing the structure of sub-pixels. Sub-pixels can represent sub-pixels of pixels of an input image, and one pixel can be composed of sub-pixels. The sub-pixel structure 601 can represent the arrangement of color components (e.g., R, G, and B components). In the sub-pixel structure 601 according to the aspect, the G component can be arranged vertically on the sub-pixel, and the R and B components can be arranged horizontally on the sub-pixel. For each input image, the sub-pixel structure may be different. The display driving method and device according to the aspect can reduce the distortion caused by sub-pixels and efficiently handle chromatic aberration. Detailed operations will be described below. The second storage unit can be referred to as a sub-pixel structure parameter storage unit.

[0072] The second calculator 504 may calculate the distortion correction weight based on the distortion parameter and / or the distance. The second calculator may be referred to as a distortion correction weight calculator based on the distance and the distortion parameter.

[0073] The third calculator 505 can correct image distortion based on the calculated weights. Figure 6 Describe image distortion correction. The third calculator may be referred to as an image distortion correction calculator.

[0074] The synthesizer 506 may synthesize and generate an output image based on the distortion corrected image. The synthesizer may be referred to as an output image synthesizer.

[0075] Figure 6 Exemplary distortion compensation according to aspects is illustrated.

[0076] Figure 5 The display driving device according to the aspect shown can be as follows Figure 6 The image distortion is effectively corrected as shown.

[0077] The original image 600 may correspond to Figure 5 The input image in. When the original image 600 passes through the lens for display driving, distortion such as chromatic aberration may occur. The display driving device / method according to the aspect can reduce the influence of distortion such as chromatic aberration caused by the lens by a preprocessing operation according to the aspect before the input image passes through the lens. The original image 600 may include pixels, and the pixels may include sub-pixels. As described above, the sub-pixel structure 601 may have an arrangement (structure, etc.) of color components. Since the arrangement of color components is related to distortion such as chromatic aberration, the display driving device according to the aspect can perform a method for compensating for distortion by reflecting the sub-pixel structure.

[0078] For example, referring to output image 602, it can be observed that when the display is driven according to the conventional distortion compensation method, chromatic aberration distortion occurs in the output image. On the other hand, referring to output image 603, it can be observed that when the display is driven according to the distortion compensation method according to the present invention, chromatic aberration distortion in the output image is compensated. Figure 5 The display driver in the embodiment is executed as follows Figure 6 The distortion compensation method shown.

[0079] Figure 7 A distortion compensation method according to an aspect is illustrated.

[0080] Figure 7 The above reference is illustrated Figure 6 It is observed that when the chromatic aberration in the original image 600 is corrected without considering the sub-pixel structure, the chromatic aberration distortion due to the sub-pixel structure appears in the output image 602. For example, when the G component is vertically offset from the center of the pixel in the sub-pixel structure 601, and when the R and B components are offset to the left and right, respectively, even if distortion compensation is performed on the pixel, chromatic aberration will appear in the output image due to the sub-pixel arrangement. Figure 8 To illustrate Figure 7 The algorithm of the distortion compensation method is shown.

[0081] Figure 8 A chromatic aberration correction method according to aspects is exemplified.

[0082] Referenced above Figure 7 The chromatic aberration correction algorithm is described as follows. Chromatic aberration correction may be referred to as distortion compensation.

[0083] The display driving method and device according to the aspect can be Figure 8The chromatic aberration correction method in the embodiment of the present invention is used to correct chromatic aberration. For example, the chromatic aberration correction method may be referred to as local interpolation. Considering the center point of the image, interpolation may be applied using a scaling ratio that increases as the distance from the center point increases. Considering the characteristic of locally applying the scaling ratio, the local interpolation may be referred to as local scaling ratio interpolation. Figure 8 Each variable in the formula shown is defined as follows.

[0084] The indices i and j represent the pixel coordinates of the location displayed on the panel.

[0085] The height of the input image and the height of the output image (h_input, h_output) represent a ratio (resolution ratio) between the input image and the output image in the vertical direction (height).

[0086] The width of the input image and the width of the output image (w_input, w_output) represent a ratio (resolution ratio) between the input image and the output image in the horizontal direction (width).

[0087] The position weight (PosW) represents a weight according to the distance from the center of the image. The value of the position weight (PosW) may increase or decrease as the distance from the center of the image increases. The value of the position weight (PosW) may be generated based on the difference in position between the center point and the current pixel.

[0088] The height coordinate and the width coordinate (cal_h, cal_w) represent coordinates of the input image, which are used to refer to R / G / B pixel information associated with pixel coordinates i and j.

[0089] If the above calculation is performed, the values ​​of the height coordinate and the width coordinate (cal_h and cal_w) have decimal points.

[0090] However, since pixel values ​​are available in integer units in the input image, the pixel brightness level to be displayed on the panel can be estimated based on the brightness levels of four pixels located near the height coordinate and the width coordinate (cal_h, cal_w).

[0091] In this case, x_1, x_2, y_1, and y_2 represent coordinates of surrounding pixels, and the brightness levels at the corresponding positions are p_1 to p_4.

[0092] The closer the pixel is to the reference height coordinate (cal_h) and width coordinate (cal_w), the greater the weight value is determined. The weight value is determined as follows Figure 8 w_x1, w_x2, w_y1 and w_y2 shown.

[0093] Through the above process, the brightness level (oval) of the pixel to be displayed can be estimated.

[0094] According to the aspect, the color difference (or distortion) correction method includes: calculating the weight of the brightness level of the pixel based on the position x1, x2, x3 and x4 of the pixels p1, p2, p3 and p4; and applying the weight to the brightness level of the interpolated (estimated) pixel. The height coordinate (cal_h) can be referred to as the height, and the width coordinate (cal_w) can be referred to as the width. The output image can be generated by estimating and improving the brightness level of the pixel corresponding to the height and width coordinates (cal_h, cal_w). Each of the height and width (cal_h, cal_w) can be generated based on the value of the weight (PosW), and the value of the weight (PosW) is based on the distance between the center point and the current pixel, the height ratio between the input image and the output image, the width ratio between the input image and the output image, and the position of the current pixel. Weights Wx1, Wx2, Wy1 and Wy2 can be calculated for each position based on the height and width (cal_h, cal_w).

[0095] Fig. 9 A distortion compensation method according to an aspect is illustrated.

[0096] Specifically, Fig. 9 Example application Figure 6 A distortion compensation method of the image 603 in which the distortion is compensated is shown. The image 603 may include sub-pixels, and the sub-pixels may have a structure in which color components are evenly arranged. Compared with the image 602, the sub-pixel structure may be considered to reduce the chromatic aberration distortion in the image 603.

[0097] Because of the above reference Figure 8 The described local interpolation-based lens distortion correction method is equally applicable to R / G / B colors without distinction, and this method may have limitations when considering the sub-pixel arrangement structure.

[0098] Therefore, assuming Fig. 9 If the sub-pixel structure shown (where there are 4 sub-pixels for each pixel), the following sub-pixels R / G1 / G2 / B need to be located a certain distance or more from the pixel center within a single pixel.

[0099] For example, Δ_y_c and Δ_x_c represent information on the extent to which a sub-pixel of each color (R, G, B, etc.) deviates from the center of the pixel in the Y direction and the X direction, respectively.

[0100] exist Fig. 9 In the structure shown, the R and B sub-pixels can be offset only in the X direction, while the G1 and G2 sub-pixels can be offset only in the Y direction. Fig. 9 The sub-pixel structure in is for illustrative purposes, and each sub-pixel may have various shapes.

[0101] Fig.10 A color difference compensation method according to an aspect is illustrated.

[0102] Specifically, as Figure 8 Aspects of the chromatic aberration correction method, Fig.10 A method 1000 is illustrated that can more accurately correct chromatic aberration in consideration of the structure of sub-pixels. Chromatic aberration compensation may be referred to as distortion compensation.

[0103] Will refer to Fig.10 Method 1000 is described, which takes into account the arrangement structure of sub-pixels, for example, for the B color among the multiple colors included in the sub-pixel. Various colors such as R, G, and B can be considered. If the degree of deviation of the B sub-pixel from the center of the pixel is expressed as Δ_y_b and Δ_x_b, these values ​​can be incorporated into the traditional height coordinate (cal_h) and width coordinate (cal_w) calculations, and the pixel value can be estimated based on the new position of cal_h_b and cal_w_b. Other formulas can be used with Figure 8 The same as those described in .

[0104] In the following, the Figure 8 and Fig.10 When applied Figure 8 When using the interpolation method in , R / G / B all refer to the pixel value at the same position, resulting in each sub-pixel having the same brightness and being represented as Figure 7 The enlarged image area 602 shown is one of black or white. On the other hand, when applying Fig.10 When considering the sub-pixels (i.e., by considering Fig. 9 The pixel value is referenced by the position of the sub-pixel actually displayed as shown in FIG. 1 . Therefore, the G sub-pixel referenced at the boundary can be turned on with a lower brightness than before, or the sub-pixel previously turned off can be turned on. In other words, chromatic aberration can be corrected by considering the characteristics of each sub-pixel.

[0105] In the color difference (distortion) compensation method according to the aspect, in addition to Figure 8 In addition to the operations in , distortion compensation can also be performed on sub-pixels in the image. Specifically, color difference distortion compensation can be performed on sub-pixels in the image for each of the R, G, and B data. For example, the sub-pixels can be distributed or arranged based on the color data. Fig. 9 and Fig.10 As shown, among the R, B, and G sub-pixels included in the pixel of the image, the R and B sub-pixels may be distributed along the x-axis, and the G1 and G2 sub-pixels may be distributed along the y-axis. The color difference may be compensated by considering the color arrangement for each sub-pixel.

[0106] For each of the R, G, and B sub-pixels, a weight (PosW) is calculated based on the center point and the pixel distance difference. For a given pixel position (i, j), the height ratio between the input image and the output image, the width ratio between the input image and the output image, the distance from the sub-pixel to the center of the pixel of each color along the x-axis, and the distance from the sub-pixel to the center of the pixel of each color along the y-axis can be considered to generate height and width coordinates (cal_h, cal_w).

[0107] Based on the height and width (cal_h, cal_w), weights Wx1, Wx2, Wy1, and Wy2 can be generated for the sub-pixels of each color. The decimal points of the height and width (cal_h, cal_w) can be processed by operations such as rounding down or flooring. Two sets of x-axis and y-axis coordinates can be generated with the rounded-down height and width. The pixel brightness of the output image can be interpolated (estimated) based on the pixel brightness of the four positions p`1, p`2, p`3, and p`4. Distortion in the output image can be compensated based on the generated reference pixel brightness and weights.

[0108] Fig.11 The chromatic aberration correction results according to aspects are illustrated.

[0109] Fig.11 Example basis Figure 7 and Figure 8 The chromatic aberration correction results of the method described in . Figure 7 and Figure 8 The color aberration correction method 11000 is performed as described, and the final result image 11001 can be provided to the user after passing through a lens connected to a display driving device. Depending on the characteristics of the object, color distortion may occur in a specific color (e.g., at least one of the following color components: R, B, or G at the outer edge of the object).

[0110] Fig.12 The chromatic aberration correction results according to aspects are illustrated.

[0111] Fig.12 Example basis Fig. 9 and Fig.10 The chromatic aberration correction results of the method described in . Fig. 9 and Fig.10 The chromatic aberration correction method is performed as described, and the final result image 12001 can be provided to the user after passing through a lens connected to a display driving device. Fig.11 compared to, Fig.12 It is illustrated that distortion (eg, chromatic aberration) occurring at the outer edges of an object is mitigated or eliminated.

[0112] Reference Fig.12, further considering the structure of the sub-pixels. Therefore, according to the reference position of the vertical boundary, the previously turned-off B sub-pixel can be turned on with a lower brightness, or the brightness of the previously turned-on R sub-pixel can be reduced.

[0113] Fig.13 Distortion compensation according to aspects is illustrated.

[0114] Fig.13 Illustrated based on Fig.10 In some aspects, chromatic aberration correction can be referred to as distortion compensation.

[0115] Figure 5 The operation flow of the display driving device 500 in the embodiment may be configured as follows Fig.13 For example, the position calculator 501, the parameter storage unit 502 and the parameter storage unit 503, the weight calculator 504, the correction calculator 505 and the output image synthesizer 506 may perform Fig.13 Each of the operations shown.

[0116] The display driving apparatus according to aspects may receive distortion parameters and / or sub-pixel parameters and input image data. The display driving apparatus may also receive distortion parameters and / or sub-pixel parameters representing characteristics of a lens used to process the input image.

[0117] The distortion compensation method may include operations for each color component. For example, the distortion compensation method may include separate passes for each of the R color, the G color, and the B color.

[0118] For R color, the distortion compensation method according to the aspect can calculate the distance between the center point and the current pixel. The distortion compensation method can calculate the distance between the center point position of the lens and the position of the current pixel of the input image data. The distortion compensation method can calculate the weight based on the distance parameter, the distortion parameter and the sub-pixel parameter. Specifically, the distortion compensation method can calculate the weight applied to Figure 8 and Fig.10 The weights of chromatic aberration compensation or distortion compensation are shown. The distortion compensation method can compensate for the distortion based on the calculated weights.

[0119] For the G color, bypassing may be performed without performing a separate operation for the G component. According to aspects, weights may be calculated based on sub-pixel parameters, and compensation may be performed, if necessary.

[0120] For B color, the distortion compensation method according to the aspect can calculate the distance between the center point and the current pixel, similar to R color. The distortion compensation method can calculate the distance between the center point position of the lens and the current position of the pixel of the input image data. The distortion compensation method can calculate the weight based on the distance parameter, the distortion parameter and the sub-pixel parameter. Specifically, the distortion compensation method can calculate the weight applied to Figure 8 and Fig.10 The weights of chromatic aberration compensation or distortion compensation are shown. The distortion compensation method can compensate for the distortion based on the calculated weights.

[0121] Because the degree of color difference or distortion perceived by the user's eyes may differ for each color component, different operations may be applied for each color component. Therefore, depending on the display operating environment and / or the characteristics of the input image, the paths of R / G / B may differ from those in Fig.13 The paths shown in are the same. Alternatively, for G color, the weight of each component can be calculated without bypassing. For R color or B color, bypassing can be performed.

[0122] Fig.14 The distortion compensation effect according to the aspect is illustrated.

[0123] When distortion compensation is performed according to the above method, an output image in which chromatic aberration distortion and / or edge distortion is compensated can be obtained. It is observed that chromatic aberration distortion and / or edge distortion are reduced in edge areas. In other words, it is observed that distortion such as color fringing is reduced.

[0124] Fig.15 A display driving device according to an aspect is illustrated.

[0125] Figure 3 and Figure 5 The display driver can be implemented as Fig.15 Device 1500 is shown.

[0126] The display driving device 1500 may include an interface unit 1501 , a processor 1502 and / or a memory 1503 . Fig.15 Each component shown may correspond to hardware, software, a processor and / or a combination thereof.

[0127] The interface unit 1501 can receive data required by the device and perform communication with the device. The interface unit 1501 can also receive and send information related to image analysis, lens distortion parameter analysis, etc.

[0128] The processor 1502 may be connected to the interface unit 1501 and the memory 1503 and as described above with reference to Figures 7 to 13 The processor may control and execute Figure 3 and Figure 5 The operation of each component is shown.

[0129] The memory 1503 may be connected to the processor, store information required for chromatic aberration compensation and / or edge compensation, and send the information to the processor.

[0130] Fig.16 A device panel according to aspects is illustrated.

[0131] Unlike conventional panels, VR devices have a drive layer on top of a silicon semiconductor. As described above, when an image is corrected, the resolution of the R pixel increases and the resolution of the B pixel decreases. Before outputting the image, data is removed from the R pixel (1600) and the B pixel is filled with black (1601). The overall data is then passed to the drive layer and output.

[0132] Refer to VR devices such as Figure 3 The configuration of the device according to the aspect may include a lens, and the image output from the display may pass through the lens and be transmitted to the user's eyes. In other words, the display driving device can mitigate and eliminate errors that may occur due to the characteristics of the lens when the image passes through the lens.

[0133] Fig.17 A display driving method according to an aspect is illustrated.

[0134] The display driving method according to the aspect may include receiving an image (S1700). Figure 3 and Figure 5 The image is received in the same manner as described in .

[0135] The display driving method according to the aspect may further include the following steps: calculating the distance between the current point and the current pixel for the sub-pixel of the image (S1701). Figure 3 , Figure 5 , Figure 8 , Fig.10 and Fig.13 The distance is calculated in the same way as described in .

[0136] The display driving method according to the aspect may further include the following steps: calculating the weight based on the parameter (S1702). In this case, the weight may be calculated in the same manner as in Figures 7 to 13 The weights are calculated in the same way as described in .

[0137] The display driving method according to the aspect may further include the following steps: compensating for distortion in the image based on the weight (S1703). Figures 5 to 13 Distortion is compensated in the same manner as described in .

[0138] Fig.18is a block diagram of an apparatus for providing VR services according to one aspect of the present disclosure.

[0139] Please refer to Figures 1 to Fig.17 The aspects described are to provide for Fig.18 Additional instructions for .

[0140] Specifically, the product to which the present disclosure is applied allows the user to FIG. 2A to FIG. 2C The lens 210 shown views the image data, which causes chromatic aberration to occur. Therefore, the present disclosure is directed to addressing this chromatic aberration problem.

[0141] Fig.18 The device 500 in may correspond to Figure 5 The device 500 in FIG. Figure 5 The device may also include Fig.18 In other words, the apparatus / method according to aspects may perform both chromatic aberration correction and distortion correction.

[0142] As described above, the present disclosure can provide an algorithm for compensating for distortion caused by lens distortion parameters in a device that provides an image to a user through a special lens (e.g., a VR device such as an HMD). To this end, the algorithm is designed to perform compensation by reflecting the distortion parameters, which depend on the distance between the center point position relative to the center point of the lens distortion parameters and the current pixel position.

[0143] For example, Fig.18 As shown, the device 500 for providing VR services includes: a calculator 510, which is used to calculate the position between the current pixel and the center point; a storage unit 520, which is used to store lens distortion parameters; a calculator 530, which is used to calculate the distortion correction weight based on the distance and the distortion parameters; a calculator 540, which is used to correct image distortion; and an output image synthesizer 550.

[0144] In addition to the storage unit 520, the calculator 510 is used to calculate the position between the current pixel and the center point, the calculator 530 is used to calculate the distortion correction weight based on the distance and the distortion parameter, the calculator 540 is used to correct the image distortion, and the output image synthesizer 550 can also be designed to be executed by a single controller, processor, AP, etc. Such a design also falls within the scope of the present disclosure.

[0145] On the other hand, the above components: component 510, component 530, component 540 and component 550 can be designed to be controlled by a display driver IC (DDI) instead of an AP. This design provides an additional effect of reducing power consumption to about 50% (i.e., up to 50 mW) compared to the power consumed by the AP of about 100 mW.

[0146] The lens distortion parameter storage unit 520 stores lens distortion parameters for chromatic aberration correction. The storage unit 520 may be implemented as various forms of memory.

[0147] The calculator 510 for calculating the position between the current pixel and the center point receives the original image data and initially calculates the distance between the center point and the current pixel.

[0148] The calculator 530 for calculating the distortion correction weight based on the distance and the distortion parameter is designed to secondarily calculate the distortion correction weight by considering the above-mentioned distance.

[0149] Unlike the related art, the calculator 540 for correcting image distortion is designed to perform image distortion correction based on the calculated distortion correction weight without using the lens distortion parameters stored in the storage unit 520 .

[0150] The output image synthesizer 550 combines the corrected image data and outputs the combined data. However, the output image synthesizer 550 may be designed to perform correction for R pixels and B pixels without performing correction for G pixels. Therefore, the G pixels may be corrected in consideration of the arrangement of the sub-pixels.

[0151] In other words, according to one aspect of the present disclosure, a distortion correction weight that varies according to the distance between the center point and the current pixel can be used instead of using the lens distortion parameters stored in the memory to solve the chromatic aberration problem at the outer edge of the image. This function can be performed by a controller such as an AP.

[0152] Specifically, the controller is designed to increase the distortion correction weight, for example, as the distance between the center point and the current pixel increases.

[0153] There is no specific limitation on obtaining a plurality of distortion correction weights. For example, the distortion correction weights may be obtained based on an interpolation technique or a lookup table (LUT).

[0154] On the other hand, the modules (components) 510 and 530 may be designed to be selectively temporarily disabled when the current pixel corresponds to a G pixel. Therefore, an additional technical advantage of minimizing unnecessary power consumption may be expected.

[0155] On the other hand, modules (components) 510 and 530 may be designed to operate normally when the current pixel corresponds to an R or B pixel.

[0156] Therefore, the above-mentioned center point corresponds to, for example, the center point of the distortion parameters of the R pixels or the center point of the distortion parameters of the B pixels.

[0157] Fig.19A , Fig.19B and Fig.19C Results of a distortion compensation algorithm according to one aspect of the present disclosure compared to the prior art are illustrated.

[0158] As described above, the G pixel may be designed to be bypassed without compensation. In addition, the G pixel may be corrected in consideration of the arrangement of sub-pixels. One of the features of the present disclosure is to perform compensation only on the R pixel and the B pixel.

[0159] like Fig.19A As shown, reference numeral 610 corresponds to the center point of the distortion parameters of the R pixels, and reference numeral 620 corresponds to the center point of the distortion parameters of the B pixels.

[0160] However, when applying a conventional distortion compensation algorithm, interpolation is uniformly performed based on the scaling ratio without considering Fig.19B Shown is the distance between the center point 611 and the current pixel 621. Therefore, chromatic aberration issues often remain at the outer edges.

[0161] On the other hand, when the distortion compensation algorithm according to one aspect of the present disclosure is applied, as Fig.19C As shown, interpolation is performed based on a scaling ratio that applies different weights as the distance between the center point 612 and the current pixel 622 increases. Therefore, the color difference problem can be solved even at the outer edge.

[0162] In this regard, bilinear interpolation can be modified and applied, which will be referred to below. Fig. 20 Explain in more detail. However, regarding the compensation method according to the aspect, the interpolation is not limited to the bilinear interpolation, and may include an interpolation equivalent to or similar to the bilinear interpolation such as bicubic interpolation. Next, the bilinear interpolation is explained.

[0163] Fig. 20 is a diagram for explaining bilinear interpolation according to one aspect of the present disclosure.

[0164] First, the following formula can be used to implement one aspect of the present disclosure. Specifically, a weight (PosW) based on the position difference (distance difference) between the center point and the current pixel is additionally used. Fig.21A and Fig. 21B More details about the weight based on the position difference (distance difference) are explained in more detail.

[0165]

[0166] In the above formula, o_val is the pixel value of the output image. In other words, o_val represents the pixel value of the image after interpolation, which corresponds to Figure 8 o_val and Fig. 20 Reference numeral 700 in the accompanying drawings.

[0167] In the above formula, p1 to p4 are pixel values ​​of the input image. That is, p1 to p4 represent pixel values ​​referenced when performing interpolation. In this description, since bilinear interpolation is assumed, calculation of pixel values ​​at four points will be described.

[0168] Furthermore, w_x1 to w_y2 represent weight values ​​determined based on pixel positions in the output image relative to pixel positions in the input image.

[0169] cal_h: cal_h represents the position value in the Y direction for 'j' (current y position) of the output image based on the ratio between h_input (the height of the input image) and h_output (the height of the output image), where 'h' is an abbreviation for height.

[0170] cal_w: cal_w represents the position value of the output image in the X direction for 'i' (current x position) based on the ratio between w_input (width of the input image) and w_output (width of the output image), where 'w' is an abbreviation for width.

[0171] In the following, the interpolation process will be described in more detail.

[0172] First, assume that scaling is performed from 100×80 to 160×100. If it is necessary to calculate the pixel value at (50, 36) in the output image and if it involves a process for finding pixel positions x1, x2, y1, and y2 to be referenced in the input image,

[0173] w_input: 100, h_input: 80, w_output: 160, h_output: 100, i: 50, j: 36

[0174] cal_h = 36 × 80 / 100 = 28.8

[0175] cal_w = 50 × 100 / 160 = 31.25

[0176] x1=31, x2=32, y1=28, y2=29

[0177] p1 = pixel value at position (31, 28) in the input image.

[0178] p2 = pixel value at position (32, 28) in the input image.

[0179] p3 = pixel value at position (31, 29) in the input image.

[0180] p4 = pixel value at position (32, 29) in the input image.

[0181] w_x1=1-(31.25-31)=0.75

[0182] w_x2=(31.25-31)=0.25

[0183] w_y1=1-(28.8-28)=0.2

[0184] w_y2=(28.8-28)=0.8

[0185] ->w_x1 to w_y2 are weights based on a first degree polynomial function based on the distance due to bilinear interpolation.

[0186] The result of the following calculation: o_val = (p1×0.75+p2×0.25)×0.2+(p3×0.75+p4×0.25)×0.8 becomes the pixel value at position (50,36) in the output image.

[0187] However, according to the present disclosure, when cal_h and cal_w are calculated, it is designed to add PosW as follows.

[0188]

[0189]

[0190] Fig.21A and Fig. 21B is a diagram illustrating a process of calculating different distortion correction weights in consideration of a distance between a center point and a current pixel according to one aspect of the present disclosure.

[0191] like Fig.21A As shown, the weight (PosW) is designed to increase as the distance from the center point increases.

[0192] An example formula for calculating the weight (PosW) is given in Fig. 21B As the current pixel position (i, j) moves away from the center point (x, y), the weight (PosW) gradually increases or decreases.

[0193] In addition, the following aspects may also be implemented: an aspect of interpolating a plurality of weights on a point basis; and an aspect of storing a plurality of weights in the form of a LUT, which both fall within the scope of the present disclosure.

[0194] Fig.22A and Fig. 22B is a diagram illustrating a process of calculating different distortion correction weights in consideration of a distance between a center point and a current pixel according to one aspect of the present disclosure.

[0195] like Fig.22AAs shown, the weight (PosW) is designed to increase or decrease as the distance from the center point increases.

[0196] An example formula for calculating the weight (PosW) is given in Fig. 22B As the current pixel position (i, j) moves away from the center point (x, y), the weight (PosW) gradually increases.

[0197] In addition, the following aspects may also be implemented: an aspect of interpolating multiple weights on a point basis; and an aspect of storing multiple weights in the form of a LUT, all of which fall within the scope of the present disclosure.

[0198] Fig.23 is a flowchart of a method for providing VR services according to another aspect of the present disclosure.

[0199] The input image data may be received (S1000) along with distortion parameters for each channel (eg, R / G / B, etc.). As described above, the G pixels may be bypassed (S1040). However, if compensation is performed taking into account sub-pixels, the G pixels may also be processed.

[0200] On the other hand, for the R pixel, the distance between the center point and the current pixel can be calculated (S1010), and the weight can also be calculated based on the distance and the distortion parameter (S1020). Distortion compensation is designed to be performed based on the calculated weight (S1030).

[0201] Therefore, for the B pixel, the distance between the center point and the current pixel can be calculated (S1050), and the weight can also be calculated based on the distance and the distortion parameter (S1060). Distortion compensation is designed to be performed based on the calculated weight (S1070).

[0202] Furthermore, it is designed to synthesize the data of each compensated pixel and output the synthesized data (S1080).

[0203] The above operation will be described again from the perspective of a device providing VR services. First, the device stores lens distortion parameters for chromatic aberration correction.

[0204] The device receives the original image data and initially calculates the distance between the center point and the current pixel. Then, the device secondarily calculates the distortion correction weight based on the calculated distance.

[0205] Different from the prior art, the apparatus uses the calculated distortion correction weights to output image data at the current pixel, rather than directly using lens distortion parameters stored in a memory.

[0206] Specifically, the secondary calculations ( S1020 and S1060 ) are designed so that the distortion correction weight increases as the distance increases.

[0207] like Fig. 21B As shown, multiple distortion correction weights can be obtained based on interpolation technology or LUT.

[0208] It is emphasized again that when the current pixel corresponds to a G pixel, the above steps S1010 , S1020 , S1030 , S1050 , S1060 , and S1070 are designed to be disabled.

[0209] Therefore, the center point in the following steps S1010 and S1050 corresponds to the center point of the distortion parameters of the R pixels or the center point of the distortion parameters of the B pixels.

[0210] Fig.23 At least one of the steps shown may also be designed to be performed (eg, by a DDI).

[0211] For example, the image processing device according to the present disclosure can be implemented in an IC for each component individually or by combining two or more components. The functions of the image processing device can be implemented in a program and embedded in the IC. When the functions of the image processing device according to the present disclosure are implemented in a program, the functions of each component included in the image processing device are implemented with specific codes. The code for implementing a specific function can be implemented in a single program. Alternatively, the code can be divided and implemented in multiple programs.

[0212] Reference Fig.13 The display driving method includes the following steps: receiving an image; calculating the distance between a current point and a current pixel for a sub-pixel of the image; calculating a weight based on a parameter; and compensating for distortion in the image based on the weight. The color of the sub-pixel may include at least one of R, G, or B, and the parameter may include at least one of a distance parameter, a distortion parameter, or a sub-pixel parameter.

[0213] Reference Fig.10 and Fig.11 , the weight calculation will be described. Calculating the weight may include the following steps: generating a position weight based on the distance from the current pixel to the center point; generating a height and a width for a sub-pixel based on the degree to which the sub-pixel is away from the center point of the sub-pixel along a specific axis, the position weight, the position of the sub-pixel, and a resolution ratio; generating a position of the pixel and a brightness level of the pixel based on the height and the width; and calculating the weight based on the position, height, and width of the pixel.

[0214] Reference Fig.10 and Fig.11, the sub-pixel may be B. The height may be generated based on the resolution ratio of the sub-pixel, the y-axis position of the sub-pixel, the position weight of the sub-pixel, and the degree to which the sub-pixel deviates from the center point of the pixel including the sub-pixel along the y-axis. The width may be generated based on the resolution ratio of the sub-pixel, the x-axis position of the sub-pixel, the position weight of the sub-pixel, and the degree to which the sub-pixel deviates from the center point of the pixel including the sub-pixel along the x-axis.

[0215] Reference Fig.10 and Fig.11 , the decimal point of the height may be rounded down, and the decimal point of the width may be rounded down. Four surrounding (or nearby) coordinate values ​​may be generated based on the rounded-down height and the rounded-down width. The weight of the B sub-pixel may be generated based on the four surrounding coordinate values, the height, and the width. The compensation value of the B sub-pixel may be generated based on the weight and the pixel value of the four surrounding coordinate values.

[0216] Reference Figure 5 , the display driving method may be performed by a display driving device. The display driving device includes: a position calculator configured to receive an image and calculate the distance between a current point and a current pixel for a sub-pixel of the image; a weight calculator configured to calculate a weight based on a parameter; and a distortion correction calculator configured to compensate for distortion in the image based on the weight. The color of the sub-pixel may include at least one of R, G, or B, and the parameter may include at least one of a distance parameter, a distortion parameter, or a sub-pixel parameter. The display driving device may include a memory and a processor.

[0217] The display driving method may be performed by a VR device including a display driving device. The VR device includes a lens, wherein the display driving device is connected to the lens. The display driving device includes: a position calculator configured to receive an image and calculate the distance between a current point and a current pixel for a sub-pixel of the image; a weight calculator configured to calculate a weight based on a parameter; and a distortion correction calculator configured to compensate for distortion in the image based on the weight. The color of the sub-pixel may include at least one of R, G, or B, and the parameter may include at least one of a distance parameter, a distortion parameter, or a sub-pixel parameter.

[0218] Therefore, color artifacts caused by a display in a device that provides an image to a user through a special lens can be compensated. If the relative positions of sub-pixels within a single pixel (i.e., distance information of the sub-pixels based on the center position of the pixel) are used as parameters in an algorithm for compensating for distortion, color artifacts can be compensated.

[0219] Aspects have been described from the perspective of methods and / or devices, and the descriptions of the methods and devices may be complementary and applicable to each other.

[0220] Although each of the accompanying drawings is explained separately for the sake of clarity, new aspects can also be designed by combining the aspects illustrated in each of the accompanying drawings. It is within the scope of the present disclosure for a person of ordinary skill in the art to design a computer-readable recording medium on which a program for executing the above-mentioned aspects is recorded as needed. The apparatus and method according to the aspects are not limited to the configurations and methods in the above-mentioned aspects. On the contrary, the aspects can be selectively combined in whole or in part to allow various modifications. Although the preferred aspects of the present disclosure have been illustrated and described, the present disclosure is not limited to the above-mentioned specific aspects. In addition, it will be understood by those skilled in the art that various modifications may be made to the aspects without departing from the subject matter of the aspects claimed for protection in the claims. These changes should not be understood separately from the technical concept or viewpoint of the aspects.

[0221] The various components of the device according to the aspect can be implemented by hardware, software, firmware or a combination thereof. For example, the various components of the aspect can be implemented as a single chip such as a hardware circuit. According to the aspect, the components of the aspect can be implemented as a separate chip. According to the aspect, at least one or more components of the device according to the aspect may include one or more processors capable of executing one or more programs. One or more programs may execute one or more of the operations / methods according to the aspect, or include instructions for executing the same operation / method. The executable instructions for executing the method / operation of the device according to the aspect may be stored in a non-transitory computer readable medium (CRM) or other computer program products configured to be executed by one or more processors. Alternatively, the instructions may be stored in a temporary CRM or other computer program products configured to be executed by one or more processors. The concept of the memory according to the aspect can not only cover volatile memory (e.g., random access memory (RAM)), but also non-volatile memory, flash memory, programmable read-only memory (PROM), etc. The memory can also be implemented in the form of a carrier wave such as a transmission on the Internet. Furthermore, the processor-readable recording medium can be distributed to computer systems connected via a network, where processor-readable codes can be stored and executed in a distributed manner.

[0222] In this document, " / " and "," are interpreted as "and / or". For example, "A / B" is interpreted as "A and / or B", and "A, B" are interpreted as "A and / or B". In addition, "A / B / C" means "at least one of A, B, and / or C". Similarly, "A, B, C" also means "at least one of A, B, and / or C". In addition, "or" is interpreted as "and / or". For example, "A or B" may mean: 1) only "A", 2) only "B", or 3) "A and B". In other words, "or" in this document may mean "additionally or alternatively".

[0223] Terms such as "first" and "second" may be used to describe various components of the aspects. However, the various components according to the aspects should not be limited by the interpretation of these terms. These terms are only used to distinguish one component from another component. For example, a first user input signal and a second user input signal are both user input signals, but unless clearly indicated in the context, the first user input signal and the second user input signal do not refer to the same user input signal.

[0224] The terms used to describe aspects are used for the purpose of describing specific aspects. In other words, these terms are not intended to limit aspects. As described in the aspects and claims, unless clearly specified in the context, the singular form is intended to cover the plural form. The "and / or" expression is used to represent all possible combinations of terms. Terms such as "include" or "comprise" are used to describe the presence of features, quantities, steps, elements and / or components, and do not imply the exclusion of additional features, quantities, steps, elements and / or components. Conditional expressions such as "if" and "when..." used to describe aspects are not limited to optional situations, but are intended to be interpreted as indicating that when a specific condition is met, the relevant operation or definition is performed or interpreted.

[0225] The operations according to aspects described herein may be performed by a sending / receiving device including a memory and / or a processor according to aspects. The memory may store a program for performing / controlling the operations according to aspects, and the processor may control the various operations described herein. The processor may also be referred to as a controller. The operations according to aspects may be performed by firmware, software, and / or a combination thereof. The firmware, software, and / or a combination thereof may be stored in a processor or a memory.

[0226] On the other hand, the operation according to the aspect may also be performed by a sending device and / or a receiving device according to the aspect. The sending / receiving device may include a transceiver for sending and receiving media data, a memory for storing instructions (e.g., program code, algorithm, flow chart and / or data) for processing according to the aspect, and a processor for controlling the operation of the sending / receiving device.

[0227] The processor may be referred to as a controller. The processor may correspond to hardware, software, and / or a combination thereof. The operations according to the aspects may be performed by the processor. In addition, the processor may be implemented as an encoder / decoder for the operations according to the aspects.

[0228] In the above, the best mode for implementing aspects has been described.

[0229] As described above, aspects may be applied in whole or in part to a display driving device and a display method.

[0230] Those skilled in the art may make various modifications or variations to the aspects without departing from the scope of the invention.

[0231] Aspects may include modifications / variations without departing from the scope of the claims and their equivalents.

[0232] CROSS-REFERENCE TO RELATED APPLICATIONS

[0233] This application claims priority to Korean Patent Application No. 10-2023-0101078, filed on August 2, 2023, which is incorporated herein by reference.

Claims

1. A display driving method, the display driving method comprising the following steps: receiving an image; Calculating the distance between the current point and the current pixel for the sub-pixels of the image; Calculate weights based on parameters; as well as compensating for distortion in the image based on the weights, The sub-pixel color includes at least one of red, green and blue, and The parameters include at least one of a distance parameter, a distortion parameter and a sub-pixel parameter.

2. The display driving method according to claim 1, wherein: The step of calculating the weight comprises the following steps: generating a position weight based on a distance from the current pixel to a center point; generating a height and a width of the sub-pixel based on the extent to which the sub-pixel is away from a central point of a pixel including the sub-pixel along a specific axis, the position weight, the position of the sub-pixel, and a resolution ratio; generating a position of a pixel and a brightness level of the pixel based on the height and the width; and A weight is calculated based on the position, the height, and the width of the pixel.

3. The display driving method according to claim 2, wherein: The sub-pixel is blue, wherein the height is generated based on a resolution ratio of the sub-pixel, a y-axis position of the sub-pixel, a position weight of the sub-pixel, and a degree of deviation of the sub-pixel from the center point of the pixel including the sub-pixel along the y-axis, and Wherein, the width is generated based on the resolution ratio of the sub-pixel, the x-axis position of the sub-pixel, the position weight of the sub-pixel and the degree to which the sub-pixel deviates from the center point of the pixel including the sub-pixel along the x-axis.

4. The display driving method according to claim 3, wherein: The decimal point of the stated height is rounded down, where the decimal point of the width is rounded down, Among them, the four surrounding coordinate values ​​are generated based on the rounded-down height and the rounded-down width. The weight of the blue sub-pixel is generated based on the four surrounding coordinate values, the height and the width, and The compensation value of the blue sub-pixel is generated based on the weight and the pixel values ​​of the four surrounding coordinate values.

5. A display driving device, comprising: a position calculator configured to receive an image and calculate a distance between a current point and a current pixel for sub-pixels of the image; a weight calculator configured to calculate a weight based on the parameter; as well as a distortion correction calculator configured to compensate for distortion in the image based on the weights, The sub-pixel color includes at least one of red, green or blue, and The parameters include at least one of a distance parameter, a distortion parameter and a sub-pixel parameter.

6. The display driving device according to claim 5, wherein: The weight calculator is configured to: generating a position weight based on a distance from the current pixel to a center point; generating a height and a width of the sub-pixel based on the extent to which the sub-pixel is away from a central point of a pixel including the sub-pixel along a specific axis, the position weight, the position of the sub-pixel, and a resolution ratio; generating a position of a pixel and a brightness level of the pixel based on the height and the width; and A weight is calculated based on the position, the height, and the width of the pixel.

7. The display driving device according to claim 6, wherein: The sub-pixel is blue, wherein the height is generated based on a resolution ratio of the sub-pixel, a y-axis position of the sub-pixel, a position weight of the sub-pixel, and a degree of deviation of the sub-pixel from the center point of the pixel including the sub-pixel along the y-axis, and Wherein, the width is generated based on the resolution ratio of the sub-pixel, the x-axis position of the sub-pixel, the position weight of the sub-pixel and the degree to which the sub-pixel deviates from the center point of the pixel including the sub-pixel along the x-axis.

8. The display driving device according to claim 7, wherein: The decimal point of the stated height is rounded down, where the decimal point of the width is rounded down, Among them, the four surrounding coordinate values ​​are generated based on the rounded-down height and the rounded-down width. The weight of the blue sub-pixel is generated based on the four surrounding coordinate values, the height and the width, and The compensation value of the blue sub-pixel is generated based on the weight and the pixel values ​​of the four surrounding coordinate values.

9. A virtual reality (VR) device, comprising: lens; as well as a display driving device connected to the lens, Wherein, the display driving device comprises: a position calculator configured to receive an image and calculate a distance between a current point and a current pixel for sub-pixels of the image; a weight calculator configured to calculate the weight based on the parameter; and a distortion correction calculator configured to compensate for distortion in the image based on the weights, The sub-pixel color includes at least one of red, green or blue, and The parameters include at least one of a distance parameter, a distortion parameter and a sub-pixel parameter.

10. The VR device according to claim 9, wherein: The weight calculator is configured to: generating a position weight based on a distance from the current pixel to a center point; generating a height and a width of the sub-pixel based on the extent to which the sub-pixel is away from a central point of a pixel including the sub-pixel along a specific axis, the position weight, the position of the sub-pixel, and a resolution ratio; generating a position of a pixel and a brightness level of the pixel based on the height and the width; and calculating a weight based on the position, the height and the width of the pixel, wherein the height is generated based on a resolution ratio of the sub-pixel, a y-axis position of the sub-pixel, a position weight of the sub-pixel, and a degree of deviation of the sub-pixel from the center point of the pixel including the sub-pixel along the y-axis, and wherein the width is generated based on the resolution ratio of the sub-pixel, the x-axis position of the sub-pixel, the position weight of the sub-pixel, and the degree to which the sub-pixel deviates from the center point of the pixel including the sub-pixel along the x-axis, Wherein, the decimal point of the height is rounded down, where the decimal point of the width is rounded down, Among them, the four surrounding coordinate values ​​are generated based on the rounded-down height and the rounded-down width. The weight of the blue sub-pixel is generated based on the four surrounding coordinate values, the height and the width, and The compensation value of the blue sub-pixel is generated based on the weight and the pixel values ​​of the four surrounding coordinate values.

Images