A method, apparatus and device for calibrating image color difference

CN116309142BActive Publication Date: 2026-09-29SHANGHAI LEXIANG TECHNOLOGY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202310212043.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-02-28
Publication Date
2026-09-29
Estimated Expiration
2043-02-28

AI Technical Summary

Technical Problem

但镜片的加入,成像像差不可避免,尤其是VR镜片口径较大,边缘视场的成像色差很难优化到较小值,而色差的存在将会使得用户看到色彩分离的现象,尤其在大视场处更为明显,从而影响用户体验

Benefits of technology

[0046]所述蓝色分量对应的色差校准模型如以下公式(3)所示:

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116309142B_ABST
    Figure CN116309142B_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a kind of image chromatic aberration calibration method, device and equipment, involve image processing technical field, the method comprises: for each color component, using optical device in the optical parameter corresponding to color component, the first coordinate of each pixel point in the image to be calibrated in pixel unit is converted into the second coordinate under length unit;Using the chromatic aberration calibration model corresponding to color component is obtained to the second coordinate and is calibrated, determine the third coordinate of each pixel point under length unit;Using the optical parameter corresponding to color component, the third coordinate obtained is converted into the fourth coordinate under pixel unit, determine the chromatic aberration calibration result under color component;The chromatic aberration calibration result under multiple color components is superimposed, obtains target calibration image, and using display device, display target calibration image.The coordinate of the image to be calibrated in pixel unit is converted into the coordinate under length unit, so that the calibration result is more accurate.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to a method, apparatus, and device for calibrating image color difference. Background Technology

[0002] Near-eye display (NED) headsets are the most typical and promising entry point into the metaverse. Taking Virtual Reality (VR) headsets as an example, VR technology aims to provide immersive 360° scenes, allowing users to interact within a virtual world. Due to the weight and size limitations of headsets, large-size spherical displays cannot be used to render a large field of view virtual environment. Therefore, VR uses the principle of convex lens imaging, placing a display of a certain size within one focal length of the VR lens. The human eye sees a magnified virtual image of the display device at the exit pupil distance on the other side of the lens. The image is then rendered into a 3D stereoscopic environment using a Software Development Kit (SDK), thus increasing the headset's field of view. However, the addition of lenses inevitably introduces image aberrations, especially since VR lenses have a larger aperture. It is difficult to optimize chromatic aberration at the edges of the field of view to a minimum, and this chromatic aberration will cause users to perceive color separation, especially noticeable in large fields of view, thus affecting the user experience. Summary of the Invention

[0003] This application provides an image color difference calibration method, apparatus, and device, which can quickly calibrate imaging color difference while ensuring calibration accuracy.

[0004] On one hand, embodiments of this application provide an image color difference calibration method applied to a virtual reality device, the virtual reality device including a display device and an optical device, the optical device being used to magnify the image displayed by the display device, the method including:

[0005] For each color component, the optical device is used to convert the first coordinate of each pixel in the image to be calibrated in pixel units into a second coordinate in length units using the optical parameters corresponding to the color component.

[0006] The obtained second coordinates are calibrated using the color difference calibration model corresponding to the color components to determine the third coordinates of each pixel in the length unit.

[0007] Using the optical parameters corresponding to the color component, the obtained third coordinate is transformed into a fourth coordinate in pixel units to determine the color difference calibration result under the color component;

[0008] The color difference calibration results of multiple color components are superimposed to obtain a target calibration image, which is then displayed using the display device.

[0009] In this embodiment, by converting the coordinates of the image to be calibrated in pixel units to coordinates in length units, a color difference calibration model corresponding to each color component is used to perform color difference calibration on the image, effectively solving the color difference problem of the image to be calibrated, improving the display effect of the image to be calibrated, and making the calibration results more accurate. Calibration is performed separately for each color component, further improving the accuracy of color difference calibration. Furthermore, calibration can be performed without the need for other software development tools, making color difference calibration faster.

[0010] Optionally, the step of using the optical parameters corresponding to the color component of the optical device to transform the first coordinates of each pixel in the image to be calibrated in pixel units into second coordinates in length units includes:

[0011] Using the optical device at the focal length corresponding to the color component, the first coordinate of each pixel in the image to be calibrated in pixel units is transformed into a second coordinate in length units.

[0012] In this embodiment, the coordinates of each pixel unit are converted into coordinates of a length unit according to the different focal lengths corresponding to the color components, making the color difference calibration results more accurate.

[0013] Optionally, calibrating the obtained second coordinates using the color difference calibration model corresponding to the color components to determine the third coordinates of each pixel in a length unit includes:

[0014] For each pixel, the original distance between the pixel and the center pixel of the display device is determined based on the first coordinate of the pixel in pixel units and the coordinate of the center pixel of the display device.

[0015] The original distance is input into the color difference calibration model corresponding to the color component for calibration to obtain the target calibration distance;

[0016] The second coordinates of the pixel are calibrated using the target calibration distance to determine the third coordinates of the pixel in length units.

[0017] In this embodiment, the target distance is first obtained by the original distance between the pixel and the center pixel of the display device, and then the third coordinate is obtained from the target distance. This makes the third coordinate more accurate, and thus more precise in color difference calibration.

[0018] Optionally, determining the original distance between the pixel and the center pixel of the display device based on the first coordinates of the pixel in pixel units and the coordinates of the center pixel of the display device includes:

[0019] Based on the first coordinates of the pixel in pixel units, the coordinates of the center pixel of the display device, and the optical parameters corresponding to the color components, the original distance between the pixel and the center pixel of the display device is determined.

[0020] In this embodiment, the original distance between the pixel and the center pixel of the display device is obtained by using the first coordinate, the coordinate of the center pixel of the display device, and the optical parameters of the color components, thus avoiding the problem of inaccurate original distance due to inaccurate coordinates.

[0021] Optionally, the plurality of color components include a red component, a green component, and a blue component.

[0022] Optionally, the color difference calibration model corresponding to the red component is shown in the following formula:

[0023] f r (r)=f(r)*(c 0r +c 1r r+...+c nr r n )...........(1)

[0024] The color difference calibration model corresponding to the green component is shown in the following formula:

[0025] f g (r)=f(r)...........(2)

[0026] The color difference calibration model corresponding to the blue component is shown in the following formula:

[0027] f b (r)=f(r)*(c 0b +c 1b r+...+c nb r n )...........(3)

[0028] On one hand, embodiments of this application provide an image color difference calibration device, the device comprising:

[0029] The conversion module is used to convert the first coordinate of each pixel in the image to be calibrated in pixel units into a second coordinate in length units for each color component using the optical parameters of the optical device corresponding to the color component.

[0030] The calibration module is used to calibrate the obtained second coordinates using the color difference calibration model corresponding to the color components, and determine the third coordinates of each pixel in the length unit.

[0031] The conversion module is further configured to use the optical parameters corresponding to the color component to convert the obtained third coordinate into a fourth coordinate in pixel units, and determine the color difference calibration result under the color component.

[0032] The overlay module is used to overlay the color difference calibration results of multiple color components to obtain a target calibration image, and to display the target calibration image using the display device.

[0033] Optionally, the conversion module is specifically used for:

[0034] Using the optical device at the focal length corresponding to the color component, the first coordinate of each pixel in the image to be calibrated in pixel units is transformed into a second coordinate in length units.

[0035] Optionally, the calibration module is specifically used for:

[0036] For each pixel, the original distance between the pixel and the center pixel of the display device is determined based on the first coordinate of the pixel in pixel units and the coordinate of the center pixel of the display device.

[0037] The original distance is input into the color difference calibration model corresponding to the color component for calibration to obtain the target calibration distance;

[0038] The second coordinates of the pixel are calibrated using the target calibration distance to determine the third coordinates of the pixel in length units.

[0039] Optionally, the calibration module is specifically used for:

[0040] Based on the first coordinates of the pixel in pixel units, the coordinates of the center pixel of the display device, and the optical parameters corresponding to the color components, the original distance between the pixel and the center pixel of the display device is determined.

[0041] Optionally, the plurality of color components include a red component, a green component, and a blue component.

[0042] Optionally, the color difference calibration model corresponding to the red component is as shown in the following formula (1):

[0043] f r (r)=f(r)*(c 0r +c 1r r+…+c nr r n(1)

[0044] The color difference calibration model corresponding to the green component is shown in the following formula (2):

[0045] f g (r)=f(r)…………..(2)

[0046] The color difference calibration model corresponding to the blue component is shown in the following formula (3):

[0047] f b (r)=f(r)*(c 0b +c 1b r+…+c nb r n (3)

[0048] In this embodiment, by converting the coordinates of the image to be calibrated in pixel units to coordinates in length units, a color difference calibration model corresponding to each color component is used to perform color difference calibration on the image, effectively solving the color difference problem of the image to be calibrated, improving the display effect of the image to be calibrated, and making the calibration results more accurate. Calibration is performed separately for each color component, further improving the accuracy of color difference calibration. Furthermore, calibration can be performed without the need for other software development tools, making color difference calibration faster. Attached Figure Description

[0049] Figure 1 A schematic diagram of an application scenario provided for an embodiment of the application;

[0050] Figure 2 A schematic diagram of a coordinate system provided for an embodiment of this application;

[0051] Figure 3 This is a schematic diagram of a coordinate system for a display device provided in an embodiment of this application;

[0052] Figure 4 A flowchart illustrating an image color difference calibration method provided in this application embodiment. Figure 1 ;

[0053] Figure 5 A flowchart illustrating a method for determining the third coordinate of a pixel in a unit of length, provided in an embodiment of this application;

[0054] Figure 6 A flowchart illustrating an image color difference calibration method provided in this application embodiment. Figure 2 ;

[0055] Figure 7 A schematic diagram of the structure of an image color difference calibration device provided in an embodiment of this application;

[0056] Figure 8 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0057] To make the objectives, technical solutions, and beneficial effects of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0058] The image color difference calibration method provided in this application is applied to a VR device. The VR device mainly includes a display device and an optical device, wherein the optical device is a convex lens, which is used to magnify the image displayed by the display device. Figure 1 An exemplary diagram illustrating an application scenario provided by an embodiment of this application is shown. Figure 1 As shown, in a VR system, the imaging principle of a convex lens is used. A display device of a certain size is placed within one focal length of the convex lens, and the human eye can see a magnified virtual image of the display device at the exit pupil distance on the other side of the convex lens. Figure 1 As shown, in a VR system, two lenses with focal points F and F' are distributed along the optical axis, with a focal length of f. A display AB is placed within the focal length on the left side, at a distance P from the convex lens. According to the imaging principle of a convex lens, light rays from point A on the display device pass through the convex lens and reach the focal length on the other side. Two light rays emanating from point A, FA, are refracted by the lens and emerge parallel to the optical axis, while AC, after refraction, intersects the optical axis at focal point F'. The backward extensions of these two light rays intersect at point A', which is the virtual image formed by point A. A perpendicular line is drawn from point A' to the optical axis; the focal point of this line is point B', which is the virtual image formed by point B. Thus, the virtual image formed by the display device after magnification by the convex lens is obtained.

[0059] Figure 2 This application provides a schematic diagram of a coordinate system, with the vertical direction of the convex lens as the Y-axis, the center of the convex lens as the origin, and a line perpendicular to the Y-axis as the X-axis. Figure 2 The example in the upper right corner illustrates the positive directions of the Y-axis and X-axis. Figure 3 An exemplary schematic diagram of a display device coordinate system provided in an embodiment of this application is shown, such as... Figure 3 As shown, Figure 2 The coordinate axes in the image are translated along the optical axis to obtain the coordinate axes on the display device.

[0060] See Figure 4This application provides an image color difference calibration method, applied to the aforementioned virtual reality device. The virtual reality device includes a display device and optical devices. The optical devices are used to magnify the image displayed by the display device. The specific steps of the image color difference calibration method are as follows:

[0061] Step 401: For each color component, use the optical parameters corresponding to the color component of the optical device to transform the first coordinate of each pixel in the image to be calibrated in pixel units into the second coordinate in length units.

[0062] Specifically, the optical component in a virtual reality device is typically a convex lens. The optical parameter is the focal length of the convex lens, which varies with wavelength; that is, different color components correspond to different focal length values. Before calibrating the color difference, one color among the multiple color components is first calibrated. The other colors are then calibrated in the same way, and the results are superimposed to achieve color difference calibration.

[0063] In some embodiments, the multiple color components include a red component, a green component, and a blue component.

[0064] Specifically, the RGB (Red, Green, Blue, abbreviated as RGB) color model is an industry color standard that obtains various colors by changing the three color channels of red (R), green (G), and blue (B) and superimposing them. RGB represents the colors of the three channels of red, green, and blue.

[0065] First, for the green component, let (u, v) be the coordinates of the pixel in the image to be calibrated in pixel units, called the first coordinates. Then, convert the first coordinates to coordinates in length units; the converted coordinates are called the second coordinates, as shown in formulas (4) and (5):

[0066]

[0067]

[0068] Among them, (u o v o ) represents the center pixel coordinates of the display device, u and v represent the coordinates of the pixels in the image to be calibrated in pixel units, and x represents the center pixel coordinates of the display device. ud and y ud f represents the second coordinate of the x-axis and y-axis in units of length. gx and f gy It is calculated using formulas (6) and (7).

[0069] In some embodiments, the focal length of the optical device corresponding to the color component is used to transform the first coordinate of each pixel in the image to be calibrated in pixel units into a second coordinate in length units.

[0070] Specifically, in formulas (4) and (5), f gx and f gy The following formulas (6) and (7) are used to calculate:

[0071]

[0072]

[0073] Where dx is the pixel size of the display device in the x-direction, dy is the pixel size of the display device in the y-direction, and f is the focal length of the optical device.

[0074] In this embodiment, the coordinates of each pixel unit are converted into coordinates of a length unit according to the different focal lengths corresponding to the color components, making the color difference calibration results more accurate.

[0075] Step 402: Use the color difference calibration model corresponding to the color components to calibrate the obtained second coordinates and determine the third coordinates of each pixel in the length unit.

[0076] Specifically, f(r) is a commonly used distortion model:

[0077] f(r) = 1 + k1r + k2r 2 +…+k n r n (8)

[0078] Wherein, kn is the distortion coefficient, which can be obtained from the distortion parameters of the lens optical design. r is the distance from the pixel (u, v) on the screen to the origin with the display device (u0, v0) as the origin before distortion, and f(r) is the distance from the pixel at position r to the origin after distortion calibration.

[0079] In color difference calibration, the calibration is mainly performed on the second coordinate. After obtaining the second coordinate, the second coordinate is transformed into the third coordinate by the distortion model according to formula (9) and formula (10) to obtain the calibration coordinate of the pixel in the length unit.

[0080] x d =x ud f g (r) (9)

[0081] y d =y ud f g (r) (10)

[0082] Where, x d and y d These are the calibrated coordinates in units of length.

[0083] In some embodiments, the color difference calibration model corresponding to the green component is as shown in the following formula (2):

[0084] f g (r)= f(r) (2)

[0085] In some embodiments, a color difference calibration model corresponding to the color components is used to calibrate the obtained second coordinates to determine the third coordinates of each pixel in a length unit. Specific steps are as follows: Figure 5 As shown, it includes:

[0086] Step 501: For each pixel, determine the original distance between the pixel and the center pixel of the display device based on the first coordinate of the pixel in pixel units and the coordinate of the center pixel of the display device.

[0087] Specifically, the original distance is the distance of each pixel from the center pixel of the display device. Before color difference calibration, the original distance of each pixel in the image to be calibrated must first be calculated. The original distance can be determined based on the first coordinate of each pixel in pixel units and the coordinates of the center pixel of the display device, as shown in formula (9):

[0088]

[0089] Where r is the original distance of each pixel.

[0090] In some embodiments, the original distance between a pixel and the center pixel of the display device is determined based on the first coordinates of the pixel in pixel units, the coordinates of the center pixel of the display device, and the optical parameters corresponding to the color components.

[0091] Specifically, when calculating the original distance for each pixel in the image to be calibrated, the original distance can also be calculated based on the different optical parameters corresponding to the color components, as shown in formula (12):

[0092]

[0093] in,

[0094] In this embodiment, the original distance between the pixel and the center pixel of the display device is obtained by using the first coordinate, the coordinate of the center pixel of the display device, and the optical parameters of the color components, thus avoiding the problem of inaccurate original distance due to inaccurate coordinates.

[0095] Step 502: Calibrate the original distance into the color difference calibration model corresponding to the color component to obtain the target calibration distance.

[0096] Specifically, by substituting the original distance r into the distortion model of formula (8), the target calibration distance can be obtained.

[0097] Step 503: Use the target calibration distance to calibrate the second coordinate of the pixel and determine the third coordinate of the pixel in the length unit.

[0098] Specifically, the target distance is substituted into formulas (9) and (10) to obtain the third coordinate.

[0099] In this embodiment, the target distance is first obtained by the original distance between the pixel and the center pixel of the display device, and then the third coordinate is obtained from the target distance. This makes the third coordinate more accurate, and thus more precise in color difference calibration.

[0100] Step 403: Using the optical parameters corresponding to the color components, the obtained third coordinate is converted into a fourth coordinate in pixel units to determine the color difference calibration result under the color components.

[0101] Specifically, after obtaining the calibrated third coordinate in length units, the third coordinate is then converted into the fourth coordinate in pixel units according to formulas (13) and (14), thereby obtaining the final color difference calibration result under the determined color components.

[0102] u d =x d f gx +u0 (13)

[0103] v d =y d f gy +v0 (14)

[0104] Among them, u d and v d These are the calibrated coordinates in pixels.

[0105] In steps 401 to 403 above, the calculated values ​​are often not integers, but pixel values ​​are generally rounded down. Therefore, in (u d v d The gray value at a certain point is obtained by interpolating it with the gray values ​​of its neighboring pixels. Bilinear interpolation is commonly used, but other interpolation methods are not restricted.

[0106] Step 404: Superimpose the color difference calibration results of multiple color components to obtain a target calibration image, and display the target calibration image using the display device.

[0107] Specifically, steps 401 to 403 are performed using the green component as an example to obtain the fourth coordinate under the green component. However, steps 401 to 403 are repeated for the red and blue components respectively, except that the distortion model is replaced with the red and blue components.

[0108] In some embodiments, the color difference calibration model corresponding to the red component is as shown in the following formula (1):

[0109] f r (r)=f(r)*(c 0r +c 1r r+…+c nr r n (1)

[0110] In some embodiments, the color difference calibration model corresponding to the blue component is as shown in the following formula (3):

[0111] f b (r)=f(r)*(c 0b +c 1b r+…+c nb r n (3)

[0112] Among them, f r (r) and f b (r) represents the distance from the origin to the pixel at position r after red and blue light distortion calibration. nr(b) This is the chromatic aberration coefficient corresponding to the wavelength distortion model. Like the distortion coefficient, this coefficient can be obtained from the optical design parameters of the lens, and a limited number of coefficients can be selected according to actual needs.

[0113] To further explain this application, the image color difference calibration method will be described in detail below with reference to a specific implementation scenario, such as... Figure 6 As shown:

[0114] Step 601: Obtain the image to be calibrated.

[0115] Step 602: Determine the first coordinate of each pixel in the image to be calibrated in pixel units.

[0116] Step 603: For the green component, convert the first coordinate of each pixel in pixel units into the second coordinate in length units.

[0117] Step 604: Obtain the original distance based on the first coordinate, the coordinate of the center pixel of the display device, and the optical parameters corresponding to the green component.

[0118] Step 605: Input the original distance into the color difference calibration model corresponding to the green component to obtain the target distance.

[0119] Step 606: Use the target distance to calibrate the second coordinate for each length unit to obtain the third coordinate.

[0120] Step 607: Convert the third coordinate into a fourth coordinate in pixel units.

[0121] Step 608: Use difference operation to calculate the gray value at the fourth coordinate.

[0122] Step 609: For the red component and the blue component, execute steps 603 to 608 respectively to obtain the corresponding fourth coordinate and the gray value at the fourth coordinate.

[0123] Step 610: Superimpose the fourth coordinate and grayscale value at the fourth coordinate corresponding to the red component, green component and blue component respectively to obtain the target calibration image.

[0124] In this embodiment, by converting the coordinates of the image to be calibrated in pixel units to coordinates in length units, a color difference calibration model corresponding to each color component is used to perform color difference calibration on the image, effectively solving the color difference problem of the image to be calibrated, improving the display effect of the image to be calibrated, and making the calibration results more accurate. Calibration is performed separately for each color component, further improving the accuracy of color difference calibration. Furthermore, calibration can be performed without the need for other software development tools, making color difference calibration faster.

[0125] Based on the same technical concept, embodiments of this application provide an image color difference calibration device, such as... Figure 7 As shown, the device includes:

[0126] The conversion module 701 is used to convert the first coordinate of each pixel in the image to be calibrated in pixel units into the second coordinate in length units for each color component using the optical parameters of the optical device corresponding to the color component.

[0127] The calibration module 702 is used to calibrate the obtained second coordinates using the color difference calibration model corresponding to the color components, and determine the third coordinates of each pixel in the length unit.

[0128] The conversion module 701 is further configured to use the optical parameters corresponding to the color component to convert the obtained third coordinate into a fourth coordinate in pixel units, and determine the color difference calibration result under the color component.

[0129] The overlay module 703 is used to overlay the color difference calibration results of multiple color components to obtain a target calibration image, and to display the target calibration image using the display device.

[0130] Optionally, the conversion module 701 is specifically used for:

[0131] Using the optical device at the focal length corresponding to the color component, the first coordinate of each pixel in the image to be calibrated in pixel units is transformed into a second coordinate in length units.

[0132] Optionally, the calibration module 702 is specifically used for:

[0133] For each pixel, the original distance between the pixel and the center pixel of the display device is determined based on the first coordinate of the pixel in pixel units and the coordinate of the center pixel of the display device.

[0134] The original distance is input into the color difference calibration model corresponding to the color component for calibration to obtain the target calibration distance;

[0135] The second coordinates of the pixel are calibrated using the target calibration distance to determine the third coordinates of the pixel in length units.

[0136] Optionally, the calibration module 702 is specifically used for:

[0137] Based on the first coordinates of the pixel in pixel units, the coordinates of the center pixel of the display device, and the optical parameters corresponding to the color components, the original distance between the pixel and the center pixel of the display device is determined.

[0138] Optionally, the plurality of color components include a red component, a green component, and a blue component.

[0139] Optionally, the color difference calibration model corresponding to the red component is shown in the following formula:

[0140] f r (r)=f(r)*(c 0r +c 1r r+…+c nr r n )

[0141] The color difference calibration model corresponding to the green component is shown in the following formula:

[0142] f g (r)=f(r)

[0143] The color difference calibration model corresponding to the blue component is shown in the following formula:

[0144] f b (r)=f(r)*(c 0b +c 1b r+…+c nb r n)

[0145] Based on the same technical concept, embodiments of this application provide a computer device, such as... Figure 8 The embodiment includes at least one processor 801 and a memory 802 connected to the at least one processor. The specific connection medium between the processor 801 and the memory 802 is not limited in this embodiment. Figure 8 Taking the connection between processor 801 and memory 802 via a bus as an example, the bus can be divided into address bus, data bus, control bus, etc.

[0146] In this embodiment of the application, the memory 802 stores instructions that can be executed by at least one processor 801. By executing the instructions stored in the memory 802, at least one processor 801 can perform the steps included in the above-described image color difference calibration method.

[0147] The processor 801 is the control center of the computer device, capable of connecting to various parts of the computer device via various interfaces and lines. It performs image color difference calibration by running or executing instructions stored in the memory 802 and calling data stored in the memory 802. Optionally, the processor 801 may include one or more processing units. The processor 801 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and applications, while the modem processor primarily handles wireless communication. It is understood that the modem processor may not be integrated into the processor 801. In some embodiments, the processor 801 and the memory 802 may be implemented on the same chip; in other embodiments, they may be implemented on separate chips.

[0148] The processor 801 can be a general-purpose processor, such as a central processing unit (CPU), digital signal processor, application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, capable of implementing or executing the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0149] Memory 802, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Memory 802 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. Memory 802 can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures that can be accessed by a computer, but is not limited thereto. In the embodiments of this application, memory 802 can also be a circuit or any other device capable of implementing storage functions for storing program instructions and / or data.

[0150] Based on the same inventive concept, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the above-described image color difference calibration method.

[0151] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0152] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0153] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0154] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0155] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for calibrating image color difference, applied to a virtual reality device, the virtual reality device comprising a display device and an optical device, the optical device being used to magnify the image displayed by the display device, the optical device being a convex lens, characterized in that... include: For each color component, the optical device uses the optical parameters corresponding to the color component to transform the first coordinate of each pixel in the image to be calibrated in pixel units into a second coordinate in length units; the optical parameter is the focal length of the convex lens, and the focal length varies with wavelength, that is, different color components correspond to different focal length values. The obtained second coordinates are calibrated using the color difference calibration model corresponding to the color component to determine the third coordinate of each pixel in length units; the obtained third coordinates are transformed into fourth coordinates in pixel units using the optical parameters corresponding to the color component to determine the color difference calibration result of the color component; the color difference calibration model corresponding to the green component is determined based on the distance from the pixel to the origin and the distortion coefficient on the display device; the color difference calibration models for the red and blue components are determined based on the color difference calibration model corresponding to the green component and the color difference coefficient of the corresponding wavelength distortion model; The color difference calibration results of multiple color components are superimposed to obtain a target calibration image, which is then displayed using the display device.

2. The method as described in claim 1, characterized in that, The step of using the optical parameters corresponding to the color components of the optical device to transform the first coordinates of each pixel in the image to be calibrated in pixel units into second coordinates in length units includes: Using the optical device at the focal length corresponding to the color component, the first coordinate of each pixel in the image to be calibrated in pixel units is transformed into a second coordinate in length units.

3. The method as described in claim 1, characterized in that, The step of calibrating the obtained second coordinates using the color difference calibration model corresponding to the color components to determine the third coordinates of each pixel in a length unit includes: For each pixel, the original distance between the pixel and the center pixel of the display device is determined based on the first coordinate of the pixel in pixel units and the coordinate of the center pixel of the display device. The original distance is input into the color difference calibration model corresponding to the color component for calibration to obtain the target calibration distance; The second coordinates of the pixel are calibrated using the target calibration distance to determine the third coordinates of the pixel in length units.

4. The method as described in claim 3, characterized in that, Determining the original distance between the pixel and the center pixel of the display device based on the first coordinate of the pixel in pixel units and the coordinates of the center pixel of the display device includes: Based on the first coordinates of the pixel in pixel units, the coordinates of the center pixel of the display device, and the optical parameters corresponding to the color components, the original distance between the pixel and the center pixel of the display device is determined.

5. The method as described in claim 1, characterized in that, The color difference calibration model corresponding to the red component is shown in the following formula (1): ………..(1) The color difference calibration model corresponding to the green component is shown in the following formula: = ………..(2) The color difference calibration model corresponding to the blue component is shown in the following formula: ………..(3); in, , f r (r) and f b (r) These represent the distances from the origin to the pixel at position r after green, red, and blue light distortion calibration, respectively. c nr(b) The chromatic aberration coefficients are for the corresponding wavelength distortion model. This is the distance from the origin to the pixel at position r after distortion calibration.

6. An image color difference calibration device, applied to a virtual reality device, the virtual reality device comprising a display device and an optical device, the optical device being used to magnify the image displayed by the display device, the optical device being a convex lens, characterized in that, include: The conversion module is used to convert the first coordinate of each pixel in the image to be calibrated in pixel units into a second coordinate in length units for each color component using the optical parameters of the optical device corresponding to the color component. The optical parameter is the focal length of the convex lens, which varies with wavelength; that is, different color components correspond to different focal length values. The calibration module is used to calibrate the obtained second coordinates using the color difference calibration model corresponding to the color component, and determine the third coordinate of each pixel in length units; the conversion module is also used to convert the obtained third coordinates into a fourth coordinate in pixel units using the optical parameters corresponding to the color component, and determine the color difference calibration result under the color component; the color difference calibration model corresponding to the green component is determined based on the distance from the pixel to the origin and the distortion coefficient on the display device; The color difference calibration models for the red and blue components are determined based on the color difference calibration model corresponding to the green component and the color difference coefficients of the corresponding wavelength distortion model. The overlay module is used to overlay the color difference calibration results of multiple color components to obtain a target calibration image, and to display the target calibration image using the display device.

7. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, It stores a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Image processing device, image processing method, program, and imaging device

    CN101335900A