Combined image distance correction method, device and system and storage medium

By acquiring the test images and determining the image compensation parameters for image combination distance correction, the problem of position deviation of projected images by the near-eye display device is solved, and the accuracy and user experience of the device are improved.

CN119052459APending Publication Date: 2024-11-29ZHUHAI MOJIE TECH CO LTD
View PDF 0 Cites 4 Cited by

Patent Information

Application Number
CN202411008471.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-25
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

The deviation of binocular imaging distance caused by frame and lens assembly errors during the production process affects the user experience.

Method used

By acquiring the test image, the image compensation parameter of the near-eye display device is determined, and transmitted to the device for image combination distance correction, and the projection position of the image to be displayed is adjusted.

Benefits of technology

It improves the accuracy and reliability of the projected image position of the near-eye display device and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119052459A_ABST
    Figure CN119052459A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of near-to-eye display equipment, and provides an image combination distance correction method, device and system and a storage medium, and the method comprises the steps: obtaining a test image which is shot by a shooting device at a target position corresponding to the near-to-eye display equipment; determining an image compensation parameter corresponding to the near-to-eye display equipment according to the test image; and transmitting the image compensation amount parameter to the near-eye display equipment, so that the near-eye display equipment performs image combination distance correction on a to-be-displayed image based on the image compensation amount parameter. According to the embodiment of the invention, the accuracy and reliability of the image projection position of the near-to-eye display equipment are improved, so that the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of near-eye display devices, and in particular to a method, device, system and storage medium for correcting combined image distance. Background Art

[0002] Near-eye display devices, such as AR (Augmented Reality) glasses and VR (Virtual Reality) glasses, have been applied in a variety of application scenarios, including navigation, gaming, education, and healthcare. To ensure the user's visual experience when wearing near-eye display devices, the binocular image distance (design value) of the near-eye display devices is designed during their production. However, due to various factors such as assembly errors between the frame and lenses, and deformation caused by force during assembly, the actual binocular image distance of near-eye display devices after leaving the factory can deviate from the design value, resulting in deviations in the position of the virtual image projected by the near-eye display devices, affecting the user experience. Summary of the Invention

[0003] The present application provides a method, device, system and storage medium for correcting the combined image distance, aiming to correct the combined image distance of an image projected by a near-eye display device and solve the problem of image position deviation.

[0004] To achieve the above objectives, the present application provides a method for correcting the combined image distance, which includes:

[0005] Acquire a test image, where the test image is captured by a shooting device located at a target position corresponding to the near-eye display device;

[0006] Determining image compensation parameters corresponding to the near-eye display device according to the test image;

[0007] The image compensation amount parameters are transmitted to the near-eye display device, so that the near-eye display device performs image combination distance correction on the image to be displayed based on the image compensation amount parameters.

[0008] In addition, to achieve the above-mentioned purpose, the present application also provides a coincident distance correction device, which includes a memory and a processor;

[0009] The memory is used to store computer programs;

[0010] The processor is configured to execute the computer program and implement the steps of the above-mentioned combined image distance correction method when executing the computer program.

[0011] In addition, to achieve the above-mentioned purpose, the present application also provides a coincidence distance correction system, characterized in that the coincidence distance correction system includes a shooting device and a coincidence distance correction device as described above; the shooting device is used to shoot a test image at a target position corresponding to a near-eye display device; the coincidence distance correction device is used to determine the image compensation amount parameters corresponding to the near-eye display device based on the test image, and transmit the image compensation amount parameters to the near-eye display device, so that the near-eye display device can perform coincidence distance correction on the image to be displayed according to the image compensation amount parameters.

[0012] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the steps of the above-mentioned combined image distance correction method.

[0013] The present application discloses a method, device, system and storage medium for correcting coincident distance. By obtaining a test image captured by a shooting device at a target position corresponding to a near-eye display device, an image compensation parameter corresponding to the near-eye display device is determined based on the test image, and the image compensation parameter is transmitted to the near-eye display device. After that, the near-eye display device can correct the coincident distance of the image to be displayed based on the image compensation parameter, thereby solving the problem of deviation in the position of the virtual image projected by the near-eye display device, thereby improving the accuracy and reliability of the image position projected by the near-eye display device, and further enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0015] Figure 1 This is a schematic diagram of the binocular image of the human eye when the light projected by AR glasses passes through the human eye under ideal conditions without angle deviation;

[0016] Figure 2 This is a schematic diagram of the binocular image formed by the light projected by AR glasses when the angle deviates from the ideal state;

[0017] Figure 3 This is a schematic flow chart of the steps of a combined image distance correction method provided in an embodiment of the present application;

[0018] Figure 4 is a schematic diagram of a coincident distance correction system provided in an embodiment of the present application;

[0019] Figure 5 is a schematic diagram of another combined image distance correction system provided in an embodiment of the present application;

[0020] Figure 6 is a schematic diagram of feature points of a test image provided by an embodiment of the present application;

[0021] Figure 7 is a schematic diagram of first pixel coordinates and second pixel coordinates provided in an embodiment of the present application;

[0022] Figure 8 This is a schematic diagram of an offset direction and an offset pixel amount provided in an embodiment of the present application;

[0023] Figure 9 This is a schematic diagram of a combined image distance correction process corresponding to a single lens of AR glasses provided in an embodiment of the present application;

[0024] Figure 10 This is a schematic block diagram of a combined image distance correction device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0026] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, combined, or partially merged, so the actual execution order may vary depending on the actual situation.

[0027] It should be understood that the terms used in this specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms unless the context clearly indicates otherwise.

[0028] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0029] The structure of AR glasses is similar to that of ordinary glasses, with lenses, frames, temples and nose pads. Both the left and right lenses can project light to the human eye to display the virtual image. Figure 1As shown in the figure, in the ideal state without angle deviation, after the light projected by the left and right lenses of the AR glasses passes through the human eye binocular image, the distance of the virtual object perceived by the user relative to the user is d1. When the lens or frame of the AR glasses deviates from the ideal state due to assembly error or deformation, as shown in the figure, Figure 2 As shown, the direction of the light projected from the lens also changes, resulting in a binocular image distance of d2. d2 changes relative to d1, and the position of the virtual image projected by the AR glasses deviates, affecting the user experience.

[0030] In order to solve the above problems, the embodiments of the present application provide a method, device, system and storage medium for correcting the combined image distance, which are used to improve the accuracy and reliability of the image position projected by the near-eye display device, thereby enhancing the user experience.

[0031] See also Figure 3 , Figure 3 The figure is a flow chart of a method for correcting the combined image distance provided in one embodiment of the present application. This method can be applied to a combined image distance correction system including a near-eye display device, and is used to correct the combined image distance of an image to be displayed projected by the near-eye display device, thereby resolving the problem of the combined image distance deviating from the designed value. Near-eye display devices include, but are not limited to, AR glasses, VR glasses, and other devices.

[0032] Before introducing the combined image distance correction method in detail, the combined image distance correction system is introduced first. Figure 4 As shown, the coincidence distance correction system 1000 includes a camera 100 and a coincidence distance correction device 200. The camera 100 includes, but is not limited to, a grayscale camera, a color camera, etc., and the camera 100 is wirelessly or wiredly connected to the coincidence distance correction device 200. The coincidence distance correction device 200 includes, but is not limited to, various electronic devices such as smartphones, tablet computers, desktop computers, and personal digital assistants. A near-eye display device 2000 is wirelessly or wiredly connected to the coincidence distance correction device 200. The near-eye display device 2000 includes, but is not limited to, AR glasses, VR glasses, and other devices. The camera 100 is placed at a target position corresponding to the near-eye display device 2000, and a test image is captured at the target position. The test image captured by the camera 100 is obtained, and the coincidence distance correction device 200 determines the image compensation parameters corresponding to the near-eye display device 2000 based on the test image, and transmits the image compensation parameters to the near-eye display device 2000. The near-eye display device 2000 performs coincidence distance correction on the image to be displayed based on the received image compensation parameters.

[0033] Exemplarily, the coincident distance correction system 1000 also includes an equipment jig and a guide rail, wherein the equipment jig includes but is not limited to a glasses jig, the equipment jig is used to support and fix the near-eye display device 2000, and the guide rail is used to support the shooting device 100 so that the shooting device 100 can be translated along the guide rail.

[0034] For example, taking the near-eye display device 2000 as AR glasses as an example, Figure 5 As shown, the coincidence distance correction system 1000 also includes a glasses fixture 300 and a guide rail 400. The glasses fixture 300 is used to support and secure the AR glasses. The camera 100 is fixed to the guide rail 400. The coincidence distance correction device 200 can control the camera 100 to translate along the guide rail 400. The guide rail 400 can be driven electrically or manually.

[0035] The combined image distance correction device 200 controls the AR glasses to display the test image, and controls the shooting device 100 to first move to the target position corresponding to the AR glasses to shoot the test image displayed by the AR glasses. Exemplarily, the target position includes but is not limited to the center position of the EyeBox of the AR glasses lens. Among them, EyeBox refers to the area where the user can still see a clear image when the eyes move. Beyond the EyeBox area, the image may be distorted or even not displayed. Since the AR glasses include left and right lenses, the target position is the center position of the EyeBox of the left and right lenses of the AR glasses.

[0036] The test image includes feature points. For example, the feature points include but are not limited to the center point of the test image. Figure 6 As shown, the feature points are the cross / dot / chessboard corner points in the center of the test image.

[0037] For example, the coincident distance correction device 200 controls the camera 100 to first move to the center of the EyeBox on one lens of the AR glasses and capture a test image displayed on that lens. The coincident distance correction device 200 then controls the camera 100 to translate to the center of the EyeBox on the other lens and capture another test image displayed on that lens. The two test images captured by the camera 100 are processed in the same manner, so the processing of the test image captured on one lens will be used as an example for explanation.

[0038] Exemplarily, a reference direction vector of the test image feature point light in the world coordinate system xyz is pre-designed, for example, the preset reference direction vector is A0=[x1, y1, z1].

[0039] The combined image distance correction device 200 uses a feature point detection algorithm to obtain the pixel coordinates (u1, v1) of the feature points of the test image displayed by the AR glasses in the test image captured by the shooting device. For the sake of distinction, the pixel coordinates (u1, v1) are referred to as the first pixel coordinates below. In addition, in the test image captured by the shooting device 100, the pixel coordinates (u0, v0) of the intersection of the lens optical axis and the image plane are obtained. For the sake of distinction, the pixel coordinates (u0, v0) are referred to as the second pixel coordinates below. For example, Figure 7 As shown, the first pixel coordinate is (u1, v1), and the second pixel coordinate of the intersection of the lens optical axis and the image plane is (u0, v0).

[0040] Based on the focal length f, pixel size p, first pixel coordinate (u1, v1) and second pixel coordinate (u0, v0) of the shooting device 100, the coincident distance correction device 200 determines the actual direction vector A1 of the feature point light in the test image in the world coordinate system xyz. The actual direction vector A1 can be expressed as A1 = [(u1-u0)×p, (v1-v0)×p, f].

[0041] The coincident distance correction device 200 calculates offset information of the actual direction vector A1 relative to the reference direction vector A0 based on the reference direction vector A0 and the actual direction vector A1. Exemplarily, the offset information includes, but is not limited to, a deflection angle α and an offset vector ΔA. The deflection angle α of the actual direction vector A1 relative to the reference direction vector A0 can be calculated, and the offset vector ΔA is defined as ΔA = A0 - A1.

[0042] The combined image distance correction device 200 is based on the deflection angle α and the formula Δu=tanα×(W h / 2) / tan(FOV h / 2), calculate the offset pixel amount Δu required for image correction. h is the number of horizontal pixels corresponding to the image to be displayed on the AR glasses, FOV h is the horizontal field of view angle corresponding to the image to be displayed by the AR glasses.

[0043] The combined image distance correction device 200 uses the offset vector ΔA according to the formula n=[1, 1, 0]ΔA T , calculate the offset direction n required for image correction, where T is the vector transpose.

[0044] For example, Figure 8 As shown, Figure 8When the test image displayed by the AR glasses is P1, the direction vector of its feature point light in the world coordinate system xyz is A1. When the test image displayed by the AR glasses is P2, the direction vector of its feature point light in the world coordinate system xyz is A0. A0 is the direction vector of the feature point light originally designed in the world coordinate system xyz. The offset direction n and the offset pixel amount Δu that the image center needs to offset when P1 is transformed into P2 can be calculated based on A1 and A0. In other words, the correction of the combined image distance can be achieved by adjusting the pixel coordinate position of the image to be displayed. Projecting ΔA into the image is the offset direction n required for image correction, n = [1, 1, 0] ΔA T , the amount of offset pixels required for image correction Δu=tanα×(W h / 2) / tan(FOV h / 2).

[0045] Following this process, the left and right lenses of the AR glasses are individually corrected for binocular convergence distance, resulting in two sets of image compensation parameters. Finally, these corresponding image compensation parameters for the left and right lenses are stored in the AR glasses' memory. When the AR glasses subsequently display a virtual image, they perform image translation based on the image compensation parameters corresponding to each lens, thereby correcting the binocular convergence distance.

[0046] It should be understood that the aforementioned coincident distance correction system 1000 is only a specific example and does not constitute a specific limitation on the coincident distance correction system of the embodiment of the present application. The coincident distance correction system of the embodiment of the present application may also be implemented in other specific ways. In other implementations, the coincident distance correction system may be more specific than the coincident distance correction system of the embodiment of the present application. Figure 4 and Figure 5 The coincident distance correction system 1000 may be shown with more or fewer components.

[0047] like Figure 3 As shown, the combined image distance correction method in this application specifically includes steps S101 to S103.

[0048] S101 : Acquire a test image, where the test image is captured by a shooting device located at a target position corresponding to a near-eye display device.

[0049] For example, assuming the near-eye display device is an AR pair of glasses, the camera is controlled to move to a target position corresponding to the AR pair of glasses to capture a test image displayed by the AR pair of glasses. Exemplarily, the target position includes, but is not limited to, the center of the EyeBox of the AR pair of glasses. Since the AR pair of glasses includes left and right lenses, the target position is the center of the EyeBox of the left and right lenses of the AR pair of glasses.

[0050] For the test images captured by the camera on each side of the lens, each test image is processed in the same manner. Therefore, the processing of the test image captured on one side of the lens is taken as an example to illustrate the method for correcting the combined image distance.

[0051] The test image includes feature points, and exemplary feature points include but are not limited to the center point of the test image. Figure 6 As shown, the feature points are the cross / dot / chessboard corner points in the center of the test image.

[0052] S102: Determine image compensation parameters corresponding to the near-eye display device according to the test image.

[0053] Exemplarily, the image compensation amount parameters include but are not limited to the offset pixel amount Δu and the offset direction n.

[0054] In some embodiments, determining the image compensation parameters corresponding to the near-eye display device based on the test image includes: determining the actual direction vector of the feature point light in the test image in space; calculating offset information based on the actual direction vector and a preset reference direction vector of the feature point light in space; and determining the image compensation parameters based on the offset information.

[0055] Exemplarily, a reference direction vector of the light of a feature point such as a center cross / dot / chessboard corner of the test image in the world coordinate system xyz is pre-designed. For example, the preset reference direction vector is A0=[x1, y1, z1].

[0056] After the test image is obtained, the actual direction vector A1 of the light of the feature point in the test image in the world coordinate system xyz is determined based on the test image.

[0057] In some embodiments, determining the actual direction vector of the light of the feature point in the test image in space includes: obtaining camera parameters; obtaining first pixel coordinates corresponding to the feature point, and second pixel coordinates corresponding to the intersection of the lens optical axis of the shooting device and the image plane; determining the actual direction vector based on the camera parameters, the first pixel coordinates, and the second pixel coordinates.

[0058] The camera parameters include but are not limited to focal length f and pixel size p.

[0059] For example, the pixel coordinates (u1, v1) of the feature points of the test image displayed by the AR glasses in the test image captured by the camera can be obtained by using the feature point detection algorithm. For the sake of distinction and description, the pixel coordinates (u1, v1) are referred to as the first pixel coordinates below. In addition, in the test image captured by the camera, the pixel coordinates (u0, v0) of the intersection of the lens optical axis and the image plane can be obtained in advance through calibration. For the sake of distinction and description, the pixel coordinates (u0, v0) are referred to as the second pixel coordinates below. For example, Figure 7 As shown, the first pixel coordinate is (u1, v1), and the second pixel coordinate of the intersection of the lens optical axis and the image plane is (u0, v0).

[0060] Based on the focal length f, the pixel size p, the first pixel coordinate (u1, v1) and the second pixel coordinate (u0, v0), the actual direction vector A1 of the feature point light in the test image in the world coordinate system xyz is determined.

[0061] In some embodiments, determining the actual direction vector based on the camera parameters, the first pixel coordinates, and the second pixel coordinates includes: calculating the actual direction vector based on A1=[(u1-u0)×p, (v1-v0)×p, f].

[0062] That is, the actual direction vector A1 of the light of the feature point in the test image in the world coordinate system xyz can be expressed as A1=[(u1-u0)×p, (v1-v0)×p, f].

[0063] Based on the reference direction vector A0 and the actual direction vector A1, the offset information of the actual direction vector A1 relative to the reference direction vector A0 is calculated. Exemplarily, the offset information includes, but is not limited to, a deflection angle α and an offset vector ΔA. The deflection angle α of the actual direction vector A1 relative to the reference direction vector A0 can be calculated, and the offset vector ΔA is defined as ΔA = A0 - A1.

[0064] In some embodiments, determining the image compensation parameter based on the offset information includes: calculating the offset pixel amount based on the deflection angle; and calculating the offset direction based on the offset vector.

[0065] According to the obtained deflection angle α and offset vector ΔA, the corresponding offset pixel amount Δu and offset direction n are calculated.

[0066] For example, according to the deflection angle α, the offset pixel amount Δu required for image correction can be calculated according to the following formula (1):

[0067] Δu=tanα×(W h / 2) / tan(FOV h / twenty one)

[0068] Among them, W h is the number of horizontal pixels corresponding to the image to be displayed on the AR glasses, FOV h is the horizontal field of view angle corresponding to the image to be displayed by the AR glasses.

[0069] For example, based on the offset vector ΔA, the offset direction n required for image correction can be calculated according to the following formula (2):

[0070] n=[1,1,0]ΔA T (2)

[0071] Where T is the vector transpose.

[0072] For example, Figure 8 As shown, Figure 8 When the test image displayed by the AR glasses is P1, the direction vector of its feature point light in the world coordinate system xyz is A1. When the test image displayed by the AR glasses is P2, the direction vector of its feature point light in the world coordinate system xyz is A0. A0 is the direction vector of the feature point light originally designed in the world coordinate system xyz. The offset direction n and the offset pixel amount Δu that the image center needs to offset when P1 is transformed into P2 can be calculated based on A1 and A0. In other words, the correction of the combined image distance can be achieved by adjusting the pixel coordinate position of the image to be displayed. Projecting ΔA into the image is the offset direction n required for image correction, n = [1, 1, 0] ΔA T , the amount of offset pixels required for image correction Δu=tanα×(W h / 2) / tan(FOV h / 2).

[0073] S103 : Transmit the image compensation parameter to the near-eye display device, so that the near-eye display device performs combined image distance correction on the image to be displayed based on the image compensation parameter.

[0074] After obtaining the offset pixel amount Δu and the offset direction n, the offset pixel amount Δu and the offset direction n are transmitted to the AR glasses. For example, the offset pixel amount Δu and the offset direction n are burned into the AR glasses.

[0075] Later, when the AR glasses are about to display the image, they can use the offset pixel value Δu and the offset direction n to correct the image's combined image distance. In practice, the offset pixel value Δu and the offset direction n are used to correct the image's combined image distance starting from the AR glasses' projected image source, ultimately correcting the image's combined image distance.

[0076] For example, if Figure 9As shown in the figure, the image correction process for the single-side lens of AR glasses is as follows:

[0077] In the first step, the camera captures the test image;

[0078] The second step is to extract the coordinates of feature points in the test image;

[0079] The third step is to calculate the actual direction vector of the feature point light in space;

[0080] The fourth step is to calculate the deflection angle and offset vector based on the actual direction vector and the pre-designed reference direction vector of the feature point light in space;

[0081] Step 5: Calculate the image compensation parameters (pixel offset and offset direction) corresponding to the image to be displayed on the AR glasses based on the deflection angle and offset vector.

[0082] Step 6: Save the image compensation parameters to the AR glasses.

[0083] according to Figure 9 The process calibrates the combined image distance for the left and right lenses of the AR glasses, generating two sets of image compensation parameters. Finally, these corresponding image compensation parameters for the left and right lenses are stored in the AR glasses' memory. When the AR glasses subsequently display a virtual image, they perform image translation based on the image compensation parameters corresponding to each lens, thereby correcting the binocular combined image distance.

[0084] In the above embodiment, a test image captured by a shooting device at a target position corresponding to a near-eye display device is obtained, and an image compensation parameter corresponding to the near-eye display device is determined based on the test image, and the image compensation parameter is transmitted to the near-eye display device. After that, the near-eye display device can perform image correction on the image to be displayed based on the image compensation parameter, thereby solving the problem of deviation in the position of the virtual image projected by the near-eye display device, thereby improving the accuracy and reliability of the image position projected by the near-eye display device, and further improving the user experience.

[0085] See also Figure 10 , Figure 10 This is a schematic block diagram of a coincident distance correction device provided in an embodiment of the present application. The coincident distance correction device can be configured in a near-eye display device to execute the aforementioned coincident distance correction method.

[0086] like Figure 10 As shown, the coincident distance correction device 200 may include a processor 210 and a memory 220, wherein the processor 210 and the memory 220 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus.

[0087] Specifically, the processor 210 may be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP).

[0088] Specifically, the memory 220 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk, etc. The memory 220 stores various computer programs for execution by the processor 210 .

[0089] The processor 210 is configured to run a computer program stored in the memory and implement the following steps when executing the computer program:

[0090] Acquire a test image, where the test image is captured by a shooting device located at a target position corresponding to the near-eye display device;

[0091] Determining image compensation parameters corresponding to the near-eye display device according to the test image;

[0092] The image compensation amount parameters are transmitted to the near-eye display device, so that the near-eye display device performs image combination distance correction on the image to be displayed based on the image compensation amount parameters.

[0093] In some embodiments, when determining the image compensation parameter corresponding to the near-eye display device according to the test image, the processor 210 is configured to implement:

[0094] Determining the actual direction vector of the feature point light in the test image in space;

[0095] Calculating offset information according to the actual direction vector and a preset reference direction vector of the feature point light in space;

[0096] The image compensation parameter is determined according to the offset information.

[0097] In some embodiments, when determining the actual direction vector of the light of the feature point in the test image in space, the processor 210 is configured to implement:

[0098] Get camera parameters;

[0099] Obtaining a first pixel coordinate corresponding to the feature point and a second pixel coordinate corresponding to an intersection of an optical axis of a lens of the shooting device and an image plane;

[0100] The actual direction vector is determined according to the camera parameters, the first pixel coordinates, and the second pixel coordinates.

[0101] In some embodiments, the camera parameters include focal length and pixel size. When determining the actual direction vector based on the camera parameters, the first pixel coordinates, and the second pixel coordinates, the processor 210 is configured to implement:

[0102] The actual direction vector is calculated based on A1=[(u1-u0)×p, (v1-v0)×p, f]; wherein (u1, v1) is the first pixel coordinate, (u0, v0) is the second pixel coordinate, p is the pixel size, f is the focal length, and A1 is the actual direction vector.

[0103] In some embodiments, the offset information includes a deflection angle and an offset vector, and the image compensation parameter includes an offset pixel amount and an offset direction. When determining the image compensation parameter based on the offset information, the processor 210 is configured to implement:

[0104] Calculating the offset pixel amount according to the deflection angle;

[0105] The offset direction is calculated according to the offset vector.

[0106] In some embodiments, when calculating the offset pixel amount according to the deflection angle, the processor 210 is configured to implement:

[0107] According to the formula Δu=tanα×(W h / 2) / tan(FOV h / 2), calculate the offset pixel amount;

[0108] Wherein, α is the deflection angle, W h is the number of horizontal pixels corresponding to the image to be displayed, FOV h is the horizontal viewing angle corresponding to the image to be displayed, and Δu is the offset pixel value.

[0109] In some embodiments, when calculating the offset direction according to the offset vector, the processor 210 is configured to implement:

[0110] According to the formula n=[1,1,0]ΔA T , calculate the offset direction;

[0111] Wherein, ΔA is the offset vector, T is the vector transpose, and n is the offset direction.

[0112] The coincident image distance correction device 200 can execute the coincident image distance correction method provided in the embodiment of the present application, and therefore can achieve the beneficial effects that can be achieved by the coincident image distance correction method provided in the embodiment of the present application. Please refer to the previous embodiment for details and will not be repeated here.

[0113] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned method for correcting the combined image distance are implemented.

[0114] The computer-readable storage medium may be an internal storage unit of the combined image distance correction device or the near-eye display device described in the aforementioned embodiment, such as a hard disk or memory of the combined image distance correction device or the near-eye display device. The computer-readable storage medium may also be an external storage device of the combined image distance correction device or the near-eye display device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital card (Secure Digital Card, SD Card), a flash card, etc. equipped on the combined image distance correction device or the near-eye display device.

[0115] Since the computer program stored in the storage medium can execute any one of the coincident distance correction methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the coincident distance correction methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0116] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0117] The above description is only a specific implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the scope of protection of the present application.

Claims

1. A method for correcting combined image distance, characterized in that: The combined image distance correction method comprises: Acquire a test image, where the test image is captured by a shooting device located at a target position corresponding to the near-eye display device; Determining image compensation parameters corresponding to the near-eye display device according to the test image; The image compensation amount parameters are transmitted to the near-eye display device, so that the near-eye display device performs image combination distance correction on the image to be displayed based on the image compensation amount parameters.

2. The method for correcting the combined image distance according to claim 1, wherein: Determining, according to the test image, an image compensation parameter corresponding to the near-eye display device, includes: Determine the actual direction vector of the feature point light in the test image in space; Calculating the offset information according to the actual direction vector and a preset reference direction vector of the feature point light in space; The image compensation parameter is determined according to the offset information.

3. The method for correcting the combined image distance according to claim 2, wherein: The determining the actual direction vector of the feature point light in the test image in space includes: Get camera parameters; Acquire a first pixel coordinate corresponding to the feature point and a second pixel coordinate corresponding to an intersection of an optical axis of a lens of the shooting device and an image plane; The actual direction vector is determined according to the camera parameters, the first pixel coordinates, and the second pixel coordinates.

4. The method for correcting the combined image distance according to claim 3, wherein: The camera parameters include focal length and pixel size, and determining the actual direction vector according to the camera parameters, the first pixel coordinates, and the second pixel coordinates includes: The actual direction vector is calculated based on A1=[(u1-u0)×p, (v1-v0)×p, f]; wherein (u1, v1) is the first pixel coordinate, (u0, v0) is the second pixel coordinate, p is the pixel size, f is the focal length, and A1 is the actual direction vector.

5. The method for correcting the combined image distance according to claim 2, wherein: The offset information includes a deflection angle and an offset vector, the image compensation parameter includes an offset pixel amount and an offset direction, and determining the image compensation parameter according to the offset information includes: Calculating the offset pixel amount according to the deflection angle; The offset direction is calculated according to the offset vector.

6. The method for correcting the combined image distance according to claim 5, wherein: Calculating the offset pixel amount according to the deflection angle includes: According to the formula Δu=tanα×(W h / 2) / tan(FOV h / 2), calculate the offset pixel amount; Wherein, α is the deflection angle, W h is the number of horizontal pixels corresponding to the image to be displayed, FOV h is the horizontal field of view angle corresponding to the image to be displayed, and Δu is the offset pixel amount.

7. The method for correcting the combined image distance according to claim 5, wherein: Calculating the offset direction according to the offset vector includes: According to the formula n = [1, 1, 0] ΔA T , calculate the offset direction; Wherein, ΔA is the offset vector, T is the vector transpose, and n is the offset direction.

8. A combined image distance correction device, characterized in that: The combined image distance correction device includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the steps of the combined image distance correction method according to any one of claims 1 to 7 when executing the computer program.

9. A combined image distance correction system, characterized in that: The combined image distance correction system includes a shooting device and the combined image distance correction device as described in claim 8; the shooting device is used to shoot a test image at a target position corresponding to the near-eye display device; the combined image distance correction device is used to determine the image compensation parameters corresponding to the near-eye display device according to the test image, and transmit the image compensation parameters to the near-eye display device, so that the near-eye display device can perform combined image distance correction on the image to be displayed according to the image compensation parameters.

10. The combined image distance correction system according to claim 9, wherein: The combined image distance correction system also includes a device fixture and a guide rail, wherein the device fixture is used to support and fix the near-eye display device, and the guide rail is used to support the shooting device so that the shooting device can be translated along the guide rail.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the combined image distance correction method according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Pre-correction display parameter calibration method, near-to-eye display method, device and equipment

    CN120602635A

  • PCB defect detection method and system based on AI vision

    CN120823208A

  • Control method and control device of intelligent glasses and intelligent glasses

    CN122151355A

  • Convergence distance correction method, apparatus and system, and storage medium

    WO2026021079A1