Convergence distance correction method, apparatus and system, and storage medium

Abstract

The present application relates to a convergence distance correction method, apparatus and system, and a storage medium. The method comprises: acquiring a test image, the test image being shot by a photographing apparatus at a target position corresponding to a near-eye display device; on the basis of the test image, determining an image compensation quantity parameter corresponding to the near-eye display device; and transmitting the image compensation quantity parameter to the near-eye display device for the near-eye display device to correct, on the basis of the image compensation quantity parameter, the convergence distance of an image to be displayed.

Description

Convergent image distance correction method, device, system and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411008471.7, filed on July 25, 2024, and entitled "Convergent image distance correction method, device, system and storage medium", the entire content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of near-eye display devices, and in particular to a convergent image distance correction method, device, system and storage medium. BACKGROUND

[0003] AR(Augmented Reality) glasses, VR(Virtual Reality) glasses and other near-eye display devices have been applied to navigation, gaming, education, medical treatment and other application scenarios. In order to ensure the visual experience of users wearing the near-eye display device, the binocular convergent image distance of the near-eye display device is designed (design value) when the near-eye display device is produced. However, due to various factors such as assembly error of the frame and the lens, deformation under force during assembly, etc., the actual binocular convergent image distance of the near-eye display device after leaving the factory will deviate from the design value, thereby causing the virtual image position projected by the near-eye display device to deviate, affecting the user experience. SUMMARY

[0004] The present application provides a convergent image distance correction method, device, system and storage medium, aiming to correct the convergent image distance of the image projected by the near-eye display device and solve the problem of deviation of the image position.

[0005] To achieve the above-mentioned purpose, the present application provides a convergent image distance correction method, which comprises:

[0006] acquiring a test image, the test image being photographed by a photographing device at a target position corresponding to the near-eye display device;

[0007] determining an image compensation parameter corresponding to the near-eye display device according to the test image;

[0008] transmitting the image compensation parameter to the near-eye display device, so that the near-eye display device corrects the convergent image distance of the to-be-displayed image based on the image compensation parameter.

[0009] In addition, to achieve the above-mentioned purpose, the present application also provides a convergent image distance correction device, which comprises a memory and a processor.

[0010] The memory is configured to store a computer program.

[0011] The processor is configured to execute the computer program and implement the steps of the conjugate image distance correction method as described above.

[0012] In addition, to achieve the above object, the present application also provides a conjugate image distance correction system, which comprises a photographing device and the conjugate image distance correction device as described above; the photographing device is configured to photograph a test image at a target position corresponding to a near-eye display device; the conjugate image distance correction device is configured to determine an image compensation parameter corresponding to the near-eye display device according to the test image, and transmit the image compensation parameter to the near-eye display device, so that the near-eye display device performs conjugate image distance correction on a to-be-displayed image according to the image compensation parameter.

[0013] In addition, to achieve the above object, the present application also provides a computer readable storage medium, which stores a computer program, and the computer program is configured to implement the steps of the conjugate image distance correction method as described above when executed by a processor.

[0014] The present application discloses a conjugate image distance correction method, device, system and storage medium. By obtaining a test image photographed by a photographing device at a target position corresponding to a near-eye display device, determining an image compensation parameter corresponding to the near-eye display device according to the test image, and transmitting the image compensation parameter to the near-eye display device, the near-eye display device can then perform conjugate image distance correction on a to-be-displayed image based on the image compensation parameter, thereby solving the problem of deviation of the position of a virtual image projected by the near-eye display device, improving the accuracy and reliability of the position of the image projected by the near-eye display device, and further improving the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0016] FIG. 1 is a schematic diagram of light rays projected by AR glasses in an ideal state without angle deviation passing through binocular conjugate image of human eyes;

[0017] FIG. 2 is a schematic diagram of light rays projected by AR glasses in a state with angle deviation passing through binocular conjugate image of human eyes;

[0018] FIG. 3 is a schematic flow chart of steps of a conjugate image distance correction method according to an embodiment of the present application;

[0019] FIG. 4 is a schematic diagram of a combined image distance correction system according to an embodiment of the present application;

[0020] FIG. 5 is a schematic diagram of another combined image distance correction system according to an embodiment of the present application;

[0021] FIG. 6 is a schematic diagram of a test image feature point according to an embodiment of the present application;

[0022] FIG. 7 is a schematic diagram of a first pixel coordinate and a second pixel coordinate according to an embodiment of the present application;

[0023] FIG. 8 is a schematic diagram of a shift direction and a shift pixel amount according to an embodiment of the present application;

[0024] FIG. 9 is a schematic diagram of a combined image distance correction process flow corresponding to a single lens of an AR glass according to an embodiment of the present application;

[0025] FIG. 10 is a schematic block diagram of a combined image distance correction device according to an embodiment of the present application. DETAILED DESCRIPTION

[0026] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0027] The flowcharts shown in the drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can be further divided, combined or partially merged, so the actual execution order can be changed according to the actual situation.

[0028] It should be understood that the terms used in the present application specification are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the present application specification and the appended claims, unless otherwise clearly indicated by the context, the singular forms "a", "an" and "the" are intended to include the plural forms.

[0029] It should also be understood that the term "and / or" used in the present application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

[0030] The structure of AR glasses is similar to ordinary glasses, and both have lenses, frames, temples and nose pads. The left and right lenses can project light rays of a virtual image to be displayed to the human eye. For example, as shown in FIG. 1, in an ideal state without angular deviation, the light rays projected by the left and right lenses of the AR glasses pass through the binocular image of the human eye, and the distance of the virtual object perceived by the user relative to the user is d1. When the lenses or frames of the AR glasses deviate from the ideal state due to assembly errors or deformation, as shown in FIG. 2, the direction of the light rays projected from the lenses also changes, resulting in a binocular image distance of d2, which changes relative to d1. The position of the virtual image projected by the AR glasses deviates, affecting the user experience.

[0031] To solve the above problems, embodiments of the present application provide a binocular image distance correction method, device, system and storage medium, which are used to improve the accuracy and reliability of the image projection position of a near-eye display device, and to improve the user experience.

[0032] Please refer to FIG. 3, which is a flowchart of a binocular image distance correction method according to an embodiment of the present application. The method can be applied to a binocular image distance correction system including a near-eye display device, and is used to correct the binocular image distance of the image to be displayed projected by the near-eye display device, solving the problem of deviation of the binocular image distance from the design value. The near-eye display device includes but is not limited to AR glasses, VR glasses and other devices.

[0033] Before introducing the binocular image distance correction method in detail, the binocular image distance correction system is introduced first. As shown in FIG. 4, the binocular image distance correction system 1000 includes a shooting device 100 and a binocular image distance correction device 200. The shooting device 100 includes but is not limited to a gray-scale camera, a color camera and the like, and is wirelessly / wired connected to the binocular image distance correction device 200. The binocular image distance correction device 200 includes but is not limited to a smart phone, a tablet computer, a desktop computer, a personal digital assistant and other types of electronic devices. The near-eye display device 2000 is wirelessly / wired connected to the binocular image distance correction device 200, which includes but is not limited to AR glasses, VR glasses and other devices. The shooting device 100 is placed at a target position corresponding to the near-eye display device 2000, and a test image is taken at the target position. The test image taken by the shooting device 100 is obtained, and the binocular image distance correction device 200 determines the image compensation parameter corresponding to the near-eye display device 2000 according to the test image, and transmits the image compensation parameter to the near-eye display device 2000. The near-eye display device 2000 corrects the binocular image distance of the image to be displayed according to the received image compensation parameter.

[0034] For example, the conjugate distance correction system 1000 further comprises a device jig and a guide rail, wherein the device jig comprises but is not limited to a glasses jig, the device jig is used to support and fix the near-eye display device 2000, and the guide rail is used to support the shooting device 100 and make the shooting device 100 translate along the guide rail.

[0035] For example, taking the near-eye display device 2000 as an AR glasses as shown in FIG. 5, the conjugate distance correction system 1000 further comprises a glasses jig 300 and a guide rail 400, the glasses jig 300 is used to support and fix the AR glasses. The shooting device 100 is fixed on the guide rail 400, and the conjugate distance correction device 200 can control the shooting device 100 to translate along the guide rail 400, and the guide rail 400 can be driven by electricity or manually.

[0036] The conjugate distance correction device 200 controls the AR glasses to display a test image, and controls the shooting device 100 to move to a target position corresponding to the AR glasses first, and then shoots the test image displayed by the AR glasses. For example, the target position comprises but is not limited to the center position of the EyeBox of the lens of the AR glasses. The EyeBox refers to the area in which the user can still see a clear image when the user moves the eyes, and the area beyond the EyeBox may present image distortion, or even no display content, etc. Since the AR glasses comprise left and right lenses, the target position is the center position of the EyeBox of the left and right lenses of the AR glasses.

[0037] The test image comprises a feature point, for example, the feature point comprises but is not limited to the center point of the test image. For example, as shown in FIG. 6, the feature point is a cross / circle / dot / chessboard corner point, etc.

[0038] For example, the conjugate distance correction device 200 controls the shooting device 100 to move to the center position of the EyeBox of one side of the lens of the AR glasses first, and then shoots a test image displayed by the lens of the AR glasses. Then, the conjugate distance correction device 200 controls the shooting device 100 to translate and move to the center position of the EyeBox of the other side of the lens of the AR glasses, and then shoots another test image displayed by the lens of the AR glasses. The processing of the two test images shot by the shooting device 100 is the same, so here the processing of the test image shot by one side of the lens is taken as an example for description.

[0039] For example, a reference direction vector of the feature point of the test image in the world coordinate system xyz is designed in advance, for example, the preset reference direction vector is A0=[x1, y1, z1].

[0040] The conjugate distance correction device 200 can obtain the pixel coordinates (u1, v1) of the feature point of the test image displayed by the AR glasses in the test image captured by the capturing device by using the feature point detection algorithm. In order to distinguish the description, the pixel coordinates (u1, v1) are referred to as first pixel coordinates hereinafter. In addition, the pixel coordinates (u0, v0) of the intersection of the lens optical axis and the image plane in the test image captured by the capturing device 100 are obtained. In order to distinguish the description, the pixel coordinates (u0, v0) are referred to as second pixel coordinates hereinafter. For example, as shown in FIG. 7, the first pixel coordinates (u1, v1) are obtained, and the second pixel coordinates (u0, v0) of the intersection of the lens optical axis and the image plane are obtained.

[0041] Based on the focal length f, the pixel size p, the first pixel coordinates (u1, v1) and the second pixel coordinates (u0, v0) of the capturing device 100, the conjugate distance correction device 200 determines the actual direction vector A1 of the light ray of the feature point in the test image in the world coordinate system xyz, which can be expressed as A1 = [(u1-u0)xp, (v1-v0)xp, f].

[0042] The conjugate distance correction device 200 calculates the offset information of the actual direction vector A1 relative to the reference direction vector A0 according to the reference direction vector A0 and the actual direction vector A1. For example, the offset information includes but is not limited to the deflection angle a and the offset vector DA. The deflection angle a of the actual direction vector A1 relative to the reference direction vector A0 can be calculated, and the offset vector DA is defined as DA = A0-A1.

[0043] The conjugate distance correction device 200 calculates the offset pixel amount Du required for image correction according to the deflection angle a according to the formula Du = tan a x (W h / 2) / tan (FOV h / 2). Wherein, W h is the horizontal pixel number corresponding to the image to be displayed by the AR glasses, and FOV h is the horizontal field of view angle corresponding to the image to be displayed by the AR glasses.

[0044] The conjugate distance correction device 200 calculates the offset direction n required for image correction according to the offset vector DA according to the formula n = [1, 1, 0]DA T , wherein T is the vector transpose.

[0045] For example, as shown in FIG. 8, when the AR glasses display a test image P1, the direction vector of the characteristic point light ray in the world coordinate system xyz is A1, and when the AR glasses display a test image P2, the direction vector of the characteristic point light ray in the world coordinate system xyz is A0, which is the direction vector of the originally designed characteristic point light ray in the world coordinate system xyz. A0 can be used to calculate the offset direction n and the offset pixel amount Au of the image center when P1 is transformed into P2, that is, the image center can be adjusted to correct the conjugate distance. The projection of ΔA into the image is the offset direction n required for image correction, n = [1, 1, 0] ΔA T , and the offset pixel amount Δu required for image correction is tan α x (W h / 2) / tan (FOV h / 2).

[0046] The conjugate distance correction is performed on the left and right lenses of the AR glasses according to the above processing method, and two sets of image compensation parameters are obtained. Finally, the image compensation parameters corresponding to the left and right lenses of the AR glasses are stored in the memory of the AR glasses. When the AR glasses display a virtual image, the virtual image is translated according to the image compensation parameters corresponding to the left and right lenses, so as to correct the binocular conjugate distance.

[0047] It should be understood that the conjugate distance correction system 1000 described above is only one specific example, and does not limit the conjugate distance correction system of the embodiments of the present application. The conjugate distance correction system of the embodiments of the present application can also have other specific implementations. In other implementations, the conjugate distance correction system can have more or fewer components than the conjugate distance correction system 1000 shown in FIGS. 4 and 5.

[0048] As shown in FIG. 3, the conjugate distance correction method in the present application specifically includes steps S101 to S103.

[0049] S101, acquiring a test image, the test image being photographed by a photographing device at a target position corresponding to a near-eye display device.

[0050] For example, taking the near-eye display device as an AR glasses, the photographing device is controlled to move to a target position corresponding to the AR glasses, and a test image displayed by the AR glasses is photographed. Exemplarily, the target position includes but is not limited to the EyeBox center position of the lenses of the AR glasses. Since the AR glasses include left and right lenses, the target position is the EyeBox center position of the left and right lenses of the AR glasses.

[0051] The processing of each test image captured by the photographing device on each side lens is the same, and thus the image distance correction method is described by taking the processing of a test image captured by one side lens as an example.

[0052] The test image includes feature points, and exemplary feature points include but are not limited to a center point of the test image. For example, as shown in FIG. 6, the feature points are cross / circle / chessboard corner points and the like.

[0053] S102. Determine an image compensation parameter corresponding to the near-eye display device according to the test image.

[0054] Exemplary image compensation parameters include but are not limited to an offset pixel amount Δu and an offset direction n.

[0055] In some embodiments, the determination of the image compensation parameter corresponding to the near-eye display device according to the test image includes: determining an actual direction vector of a feature point light ray in space in the test image; calculating offset information according to the actual direction vector and a preset reference direction vector of the feature point light ray in space; and determining the image compensation parameter according to the offset information.

[0056] Exemplary reference direction vectors of the feature point light rays in the world coordinate system xyz are designed in advance, for example, a preset reference direction vector A0 is [x1, y1, z1].

[0057] After the test image is obtained, an actual direction vector A1 of a feature point light ray in the world coordinate system xyz is determined based on the test image.

[0058] In some embodiments, the determination of the actual direction vector of the feature point light ray in space in the test image includes: obtaining photographing parameters; obtaining a first pixel coordinate corresponding to the feature point and a second pixel coordinate corresponding to an intersection of a lens optical axis and an image plane of the photographing device; and determining the actual direction vector according to the photographing parameters, the first pixel coordinate, and the second pixel coordinate.

[0059] The photographing parameters include but are not limited to a focal length f and a pixel size p.

[0060] For example, the feature point detection algorithm can be used to obtain the pixel coordinates (u1, v1) of the test image feature point displayed by the AR glasses in the test image captured by the shooting device. In order to distinguish the description, the pixel coordinates (u1, v1) will be referred to as the first pixel coordinates in the following. In addition, the pixel coordinates (u0, v0) of the intersection of the lens optical axis and the image plane in the test image captured by the shooting device can be obtained in advance through calibration. In order to distinguish the description, the pixel coordinates (u0, v0) will be referred to as the second pixel coordinates in the following. For example, as shown in FIG. 7, the first pixel coordinates are (u1, v1), and the second pixel coordinates of the intersection of the lens optical axis and the image plane are (u0, v0).

[0061] Based on the focal length f, the pixel size p, the first pixel coordinates (u1, v1) and the second pixel coordinates (u0, v0), the actual direction vector A1 of the feature point light ray in the test image in the world coordinate system xyz is determined.

[0062] In some embodiments, the actual direction vector is determined according to the shooting parameters, the first pixel coordinates, and the second pixel coordinates, including: calculating the actual direction vector based on A1 = [(u1-u0) x p, (v1-v0) x p, f].

[0063] That is, the actual direction vector A1 of the feature point light ray in the test image in the world coordinate system xyz can be expressed as A1 = [(u1-u0) x p, (v1-v0) x p, f].

[0064] According to the reference direction vector A0 and the actual direction vector A1, the offset information of the actual direction vector A1 relative to the reference direction vector A0 is calculated. For example, the offset information includes but is not limited to the deflection angle a and the offset vector DA. The deflection angle a of the actual direction vector A1 relative to the reference direction vector A0 can be calculated, and the offset vector DA is defined as DA = A0-A1.

[0065] In some embodiments, the image compensation parameter is determined according to the offset information, including: calculating the offset pixel amount according to the deflection angle; and calculating the offset direction according to the offset vector.

[0066] According to the obtained deflection angle a and offset vector DA, the corresponding offset pixel amount Du and offset direction n are calculated.

[0067] For example, according to the deflection angle a, the offset pixel amount Du required for image correction can be calculated according to the following formula (1): Du = tan a x (W h / 2) / tan (FOV h / 2) (1)

[0068] Among them, W h is the number of horizontal pixels corresponding to the image to be displayed by the AR glasses, and FOV h is the horizontal field of view angle corresponding to the image to be displayed by the AR glasses.

[0069] Exemplarily, according to the offset vector ΔA, the offset direction n required for image correction can be calculated according to the following formula (2): n = [1, 1, 0]ΔA T (2)

[0070] Among them, T is the vector transpose.

[0071] For example, as shown in FIG. 8, when the test image displayed by the AR glasses in FIG. 8 is P1, the direction vector of the feature point light ray in the world coordinate system xyz is A1. When the test image displayed by the AR glasses is P2, the direction vector of the feature point light ray in the world coordinate system xyz is A0. A0 is the direction vector of the feature point light ray in the world coordinate system xyz in the initial design. According to A1 and A0, the offset direction n and the offset pixel amount Δu that the image center needs to offset when P1 is transformed into P2 can be calculated inversely. That is, the correction of the convergence distance can be achieved by adjusting the pixel coordinate position of the image to be displayed. Projecting ΔA into the image is the offset direction n required for image correction, n = [1, 1, 0]ΔA T , the offset pixel amount Δu required for image correction = tanα × (W h / 2) / tan(FOV h / 2).

[0072] S103. Transmit the image compensation amount parameter to the near-eye display device for the near-eye display device to perform convergence distance correction on the image to be displayed based on the image compensation amount parameter.

[0073] After obtaining the offset pixel amount Δu and the offset direction n, transmit the offset pixel amount Δu and the offset direction n to the AR glasses. Exemplarily, burn the offset pixel amount Δu and the offset direction n into the AR glasses.

[0074] After that, when the AR glasses need to display the image to be displayed, the offset pixel amount Δu and the offset direction n can be used to perform convergence distance correction on the image to be displayed. In actual processing, starting from the projection image source of the AR glasses, the offset pixel amount Δu and the offset direction n are used to correct, so as to finally correct the convergence distance of the image to be displayed.

[0075] For example, as shown in FIG. 9, the convergence distance correction processing flow corresponding to one side lens of the AR glasses is as follows:

[0076] The first step is for the camera to collect test images;

[0077] Secondly, the feature point coordinates in the test image are extracted.

[0078] Thirdly, the actual direction vector of the feature point light ray in the space is calculated.

[0079] Fourthly, the deflection angle and the offset vector are calculated according to the actual direction vector and the reference direction vector of the feature point light ray in the space designed in advance.

[0080] Fifthly, the image compensation parameter (offset pixel amount and offset direction) corresponding to the image to be displayed by the AR glasses is calculated according to the deflection angle and the offset vector.

[0081] Sixthly, the image compensation parameter is saved to the AR glasses.

[0082] According to the flow in FIG. 9, the conjugate distance correction is performed on the left and right lenses of the AR glasses respectively, and two sets of image compensation parameters are obtained. Finally, the image compensation parameters corresponding to the left and right lenses of the AR glasses are stored in the memory of the AR glasses. When the AR glasses display a virtual image, the virtual image is subjected to image translation processing according to the image compensation parameters corresponding to the left and right lenses respectively, so as to realize the conjugate distance correction of the binoculars.

[0083] In the above embodiment, by obtaining the test image shot by the shooting device at the target position corresponding to the near-eye display device, the image compensation parameter corresponding to the near-eye display device is determined based on the test image, and the image compensation parameter is transmitted to the near-eye display device. Then, the near-eye display device can correct the conjugate distance of the image to be displayed based on the image compensation parameter, thereby solving the problem of deviation of the position of the virtual image projected by the near-eye display device, improving the accuracy and reliability of the position of the image projected by the near-eye display device, and further improving the user experience.

[0084] Please refer to FIG. 10, which is a schematic block diagram of a conjugate distance correction device according to an embodiment of the present application. The conjugate distance correction device can be configured in a near-eye display device, and is used to execute the conjugate distance correction method described above.

[0085] As shown in FIG. 10, the conjugate distance correction device 200 can include a processor 210 and a memory 220, wherein the processor 210 and the memory 220 are connected through a bus, such as an I2C (Inter-integrated Circuit) bus.

[0086] Specifically, the processor 210 can be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP), etc.

[0087] Specifically, the memory 220 can be a flash chip, a read-only memory (ROM) disk, an optical disk, a U disk, or a mobile hard disk, etc. The memory 220 stores various computer programs for the processor 210 to execute.

[0088] The processor 210 is configured to run the computer programs stored in the memory and implement the following steps when executing the computer programs:

[0089] obtain a test image, the test image being captured by a photographing device at a target position corresponding to the near-eye display device;

[0090] determine an image compensation parameter corresponding to the near-eye display device according to the test image;

[0091] transmit the image compensation parameter to the near-eye display device, so that the near-eye display device corrects the conjugate distance of a to-be-displayed image based on the image compensation parameter.

[0092] In some embodiments, when implementing the step of determining the image compensation parameter corresponding to the near-eye display device according to the test image, the processor 210 is configured to implement:

[0093] determine an actual direction vector of a feature point light ray in the test image in space;

[0094] calculate offset information according to the actual direction vector and a preset reference direction vector of the feature point light ray in space;

[0095] determine the image compensation parameter according to the offset information.

[0096] In some embodiments, when implementing the step of determining the actual direction vector of the feature point light ray in the test image in space, the processor 210 is configured to implement:

[0097] obtain a photographing parameter;

[0098] obtain a first pixel coordinate corresponding to the feature point and a second pixel coordinate corresponding to an intersection of a lens optical axis and an image plane of the photographing device;

[0099] determine the actual direction vector according to the camera parameter, the first pixel coordinate and the second pixel coordinate.

[0100] In some embodiments, the camera parameter includes focal length and pixel size, and the processor 210, in determining the actual direction vector according to the camera parameter, the first pixel coordinate and the second pixel coordinate, is configured to:

[0101] calculate the actual direction vector based on A1 = [(u1-u0)×p, (v1-v0)×p, f], wherein (u1, v1) is the first pixel coordinate, (u0, v0) is the second pixel coordinate, p is the pixel size, f is the focal length, and A1 is the actual direction vector.

[0102] In some embodiments, the offset information includes deflection angle and offset vector, and the image compensation parameter includes offset pixel amount and offset direction, and the processor 210, in determining the image compensation parameter according to the offset information, is configured to:

[0103] calculate the offset pixel amount according to the deflection angle;

[0104] calculate the offset direction according to the offset vector.

[0105] In some embodiments, the processor 210, in calculating the offset pixel amount according to the deflection angle, is configured to:

[0106] calculate the offset pixel amount according to the formula Δu = tanα×(W h / 2) / tan(FOV h / 2);

[0107] wherein α is the deflection angle, W h is the number of horizontal direction pixels corresponding to the to-be-displayed image, FOV h is the horizontal direction field of view angle corresponding to the to-be-displayed image, and Δu is the offset pixel amount.

[0108] In some embodiments, the processor 210, in calculating the offset direction according to the offset vector, is configured to:

[0109] calculate the offset direction according to the formula n = [1, 1, 0]ΔA T ; and

[0110] wherein ΔA is the offset vector, T is vector transpose, and n is the offset direction.

[0111] The image combination distance correction apparatus 200 can execute the image combination distance correction method provided by the embodiments of the present application, and thus can achieve the beneficial effects that can be achieved by the image combination distance correction method provided by the embodiments of the present application. Details are described in the foregoing embodiments, and thus will not be described here again.

[0112] The embodiments of the present application further provide a computer readable storage medium, and the computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the steps of the image combination distance correction method.

[0113] The computer readable storage medium can be an internal storage unit of the image combination distance correction apparatus or the near-eye display device, for example, a hard disk or a memory of the image combination distance correction apparatus or the near-eye display device. The computer readable storage medium can also be an external storage device of the image combination distance correction apparatus or the near-eye display device, for example, a plug-in hard disk, a smart media card (SMC), a secure digital card (SD Card), a flash card, etc.

[0114] The computer program stored in the storage medium can execute any of the image combination distance correction methods provided by the embodiments of the present application, and thus can achieve the beneficial effects that can be achieved by any of the image combination distance correction methods provided by the embodiments of the present application. Details are described in the foregoing embodiments, and thus will not be described here again.

[0115] It should be noted that, in this document, the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusions, so that processes, methods, articles, or systems that include a series of elements not only include those elements, but also include other elements not explicitly listed, or inherent to such processes, methods, articles, or systems. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of other identical elements in the process, method, article, or system that includes the element.

[0116] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical range disclosed by the present application, and these modifications or replacements should be covered within the protection scope of the present application.

Claims

1. A hybrid conjugate distance correction method, wherein, The image combination distance correction method comprises: acquiring a test image, the test image being photographed by a photographing device at a target position corresponding to a near-eye display device; determining an image compensation parameter corresponding to the near-eye display device according to the test image; transmitting the image compensation parameter to the near-eye display device, so that the near-eye display device performs image combination distance correction on a to-be-displayed image based on the image compensation parameter.

2. The hybrid distance correction method of claim 1, wherein, The determining of the image compensation parameter corresponding to the near-eye display device according to the test image comprises: determining an actual direction vector of a feature point light ray in space in the test image; calculating offset information according to the actual direction vector and a preset reference direction vector of the feature point light ray in space; determining the image compensation parameter according to the offset information.

3. The hybrid distance correction method of claim 2, wherein, The determining of the actual direction vector of the feature point light ray in space in the test image comprises: acquiring photographing parameters; acquiring a first pixel coordinate corresponding to the feature point and a second pixel coordinate corresponding to an intersection of a lens optical axis and an image plane of the photographing device; determining the actual direction vector according to the photographing parameters, the first pixel coordinate and the second pixel coordinate.

4. The hybrid distance correction method of claim 3, wherein, The photographing parameters comprise a focal length and a pixel size, and the determining of the actual direction vector according to the photographing parameters, the first pixel coordinate and the second pixel coordinate comprises: calculating the actual direction vector based on A1 = [(u1-u0)×p, (v1-v0)×p, f]; wherein (u1, v1) is the first pixel coordinate, (u0, v0) is the second pixel coordinate, p is the pixel size, f is the focal length, and A1 is the actual direction vector.

5. The hybrid distance correction method of claim 2, wherein, The offset information comprises a deflection angle and an offset vector, the image compensation parameter comprises an offset pixel amount and an offset direction, and the determining of the image compensation parameter according to the offset information comprises: calculating the offset pixel amount according to the deflection angle; calculating the offset direction according to the offset vector.

6. The hybrid distance correction method of claim 3, wherein, The offset information comprises a deflection angle and an offset vector, the image compensation parameter comprises an offset pixel amount and an offset direction, and the determining of the image compensation parameter according to the offset information comprises: calculating the offset pixel amount according to the deflection angle; calculating the offset direction according to the offset vector.

7. The hybrid distance correction method of claim 4, wherein, The offset information comprises a deflection angle and an offset vector, the image compensation parameter comprises an offset pixel amount and an offset direction, and the determining of the image compensation parameter according to the offset information comprises: calculating the offset pixel amount according to the deflection angle; calculating the offset direction according to the offset vector.

8. The hybrid distance correction method of claim 5, wherein, The calculating of the offset pixel amount according to the deflection angle comprises: According to the formula Δu = tan α x (W h / 2) / tan (FOV h / 2), the offset pixel amount is calculated; wherein a is the deflection angle, W h is the number of horizontal direction pixels corresponding to the image to be displayed, FOV h is the horizontal direction field of view angle corresponding to the image to be displayed, and Δu is the offset pixel amount.

9. The hybrid distance correction method of claim 6, wherein, The calculating of the offset pixel amount according to the deflection angle comprises: According to the formula Δu = tan α x (W h / 2) / tan (FOV h / 2), the offset pixel amount is calculated; wherein a is the deflection angle, W h is the number of horizontal direction pixels corresponding to the image to be displayed, FOV h is the horizontal direction field of view angle corresponding to the image to be displayed, and Au is the offset pixel amount.

10. The hybrid distance correction method of claim 7, wherein, The calculating of the offset pixel amount according to the deflection angle comprises: According to the formula Δu = tan α x (W h / 2) / tan (FOV h / 2), the offset pixel amount is calculated; wherein a is the deflection angle, W h is the number of horizontal direction pixels corresponding to the image to be displayed, FOV h is the horizontal direction field of view angle corresponding to the image to be displayed, and Au is the offset pixel amount.

11. The hybrid distance correction method of claim 5, wherein, The calculating of the offset direction according to the offset vector comprises: According to the formula n = [1, 1, 0] ΔA T , the offset direction is calculated; wherein ΔA is the offset vector, T is a vector transpose, and n is the offset direction.

12. The hybrid distance correction method of claim 6, wherein, The calculating the offset direction according to the offset vector comprises: According to the formula n = [1, 1, 0] ΔA T , the offset direction is calculated; Wherein, ΔA is the offset vector, T is vector transpose, and n is the offset direction.

13. The hybrid distance correction method of claim 7, wherein, The calculating the offset direction according to the offset vector comprises: According to the formula n = [1, 1, 0] ΔA T , the offset direction is calculated; Wherein, ΔA is the offset vector, T is vector transpose, and n is the offset direction.

14. The hybrid distance correction method of claim 8, wherein, The calculating the offset direction according to the offset vector comprises: According to the formula n = [1, 1, 0] ΔA T , the offset direction is calculated; Wherein, ΔA is the offset vector, T is vector transpose, and n is the offset direction.

15. The hybrid distance correction method of claim 9, wherein, The calculating the offset direction according to the offset vector comprises: According to the formula n = [1, 1, 0] ΔA T , the offset direction is calculated; Wherein, ΔA is the offset vector, T is vector transpose, and n is the offset direction.

16. The hybrid distance correction method of claim 10, wherein, The calculating the offset direction according to the offset vector comprises: According to the formula n = [1, 1, 0] ΔA T , the offset direction is calculated; Wherein, ΔA is the offset vector, T is vector transpose, and n is the offset direction.

17. An image combining distance correction device, wherein, The image distance correction device comprises a memory and a processor; The memory is configured to store a computer program; The processor is configured to execute the computer program and implement the steps of the image distance correction method according to claim 1 when executing the computer program.

18. A hybrid conjugate distance correction system, wherein, The image distance correction system comprises a photographing device and the image distance correction device according to claim 17; the photographing device is configured to photograph a test image at a target position corresponding to a near-eye display device; and the image distance correction device is configured to determine an image compensation parameter corresponding to the near-eye display device according to the test image, and transmit the image compensation parameter to the near-eye display device, so that the near-eye display device performs image distance correction on a to-be-displayed image according to the image compensation parameter.

19. The hybrid distance correction system of claim 18, wherein, The image distance correction system further comprises a device jig and a guide rail; the device jig is configured to support and fix the near-eye display device; and the guide rail is configured to support the photographing device and enable the photographing device to translate along the guide rail.

20. A computer readable storage medium, wherein, The computer readable storage medium stores a computer program, and the computer program is executed by the processor to implement the steps of the image distance correction method according to claim 1.

Images