Method and device for determining image combination distance, head-mounted display equipment and storage medium

By acquiring the left and right eye images of AR glasses, determining the image distance of feature points, the problem of inaccurate image distance of head-mounted display devices is solved, and higher accuracy and user experience is achieved.

CN118913634APending Publication Date: 2024-11-08ZHUHAI MOJIE TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410981862.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing head-mounted display devices such as AR glasses are difficult to accurately control the imaging distance during production, resulting in a difference between the actual imaging distance and the expected imaging distance, affecting the accuracy of the equipment.

Method used

By acquiring the left-eye image and the right-eye image of the feature image projected by the head-mounted display device, the image combination distance of each pair of feature points is determined, and the image combination distance of the device is calculated using the image combination distance of multiple pairs of feature points, and the image combination distance of the device is executed by a processor and memory. Computer programs realize the determination of precise imaging distance.

Benefits of technology

It realizes accurate imaging distance measurement of head-mounted display devices, which is more accurate than expected values, improving the device's user experience and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118913634A_ABST
    Figure CN118913634A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of distance measurement, and provides an image combination distance determination method and device, head-mounted display equipment and a storage medium, and the method comprises the steps: obtaining a left eye image and a right eye image corresponding to a feature image projected by the head-mounted display equipment; the image combination distance of each pair of feature points corresponding to the left eye image and the right eye image is determined, the left eye image and the right eye image comprise a plurality of feature points, and each pair of feature points comprise one feature point in the left eye image and one feature point corresponding to the same position in the right eye image; and determining an image combination distance corresponding to the head-mounted display device according to the image combination distance of the multiple pairs of feature points. According to the embodiment of the invention, the more accurate image combination distance of the head-mounted display equipment is obtained.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of distance measurement technology, and in particular to a method and device for determining a combined image distance, a head-mounted display device, and a storage medium. Background Art

[0002] Nowadays, AR (Augmented Reality) glasses, VR (Virtual Reality) glasses and other head-mounted display devices have been applied to navigation, games, education, medical care and other fields. Taking AR glasses as an example, in order to ensure the quality of AR glasses, the production process will be controlled to achieve the expected image distance before the AR glasses leave the factory. However, since the production process is affected by the accuracy of the process or fixture, the actual image distance of AR glasses is often different from the expected image distance, that is, the accurate image distance of the head-mounted display device cannot be obtained. Summary of the invention

[0003] The present application provides a method and device for determining a combined image distance, a head-mounted display device, and a storage medium, aiming to achieve accurate combined image distance determination for a head-mounted display device.

[0004] To achieve the above object, the present application provides a method for determining a combined image distance, the combined image distance determination method comprising:

[0005] Obtaining a left-eye image and a right-eye image corresponding to a feature image projected by a head-mounted display device;

[0006] Determine a combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, wherein the left-eye image and the right-eye image include a plurality of feature points, and each pair of feature points includes a feature point in the left-eye image and a feature point corresponding to the same position in the right-eye image;

[0007] According to the combined image distances of the multiple pairs of feature points, the combined image distance corresponding to the head mounted display device is determined.

[0008] In addition, to achieve the above-mentioned purpose, the present application also provides a combined image distance determination device, the combined image distance determination device comprising a memory and a processor;

[0009] The memory is used to store computer programs;

[0010] The processor is used to execute the computer program and implement the steps of the above-mentioned method for determining the combined image distance when executing the computer program.

[0011] In addition, to achieve the above-mentioned purpose, the present application also provides a head-mounted display device, which includes the above-mentioned combined image distance determination device.

[0012] In addition, to achieve the above-mentioned purpose, the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned method for determining the combined image distance are implemented.

[0013] The present application discloses a method and device for determining a combined image distance, a head-mounted display device, and a storage medium. The method comprises obtaining a left-eye image and a right-eye image corresponding to a feature image projected by a head-mounted display device, and determining a combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, wherein the left-eye image and the right-eye image include multiple feature points, and each pair of feature points includes a feature point in the left-eye image and a feature point corresponding to the same position in the right-eye image. The combined image distance corresponding to the head-mounted display device is determined according to the combined image distance of the multiple pairs of feature points. Compared with a method of using the expected combined image distance as the actual combined image distance of the head-mounted display device, a more accurate combined image distance of the head-mounted display device is obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0015] Figure 1 is a schematic flow chart of the steps of a method for determining a combined image distance provided in an embodiment of the present application;

[0016] Figure 2 It is a schematic diagram of AR glasses superimposing real scenes and virtual images;

[0017] Figure 3 This is a schematic diagram of the image formed by the light projected by AR glasses passing through the human eye binoculars;

[0018] Figure 4 It is a schematic diagram of a characteristic image;

[0019] Figure 5 is a schematic flow chart of the steps of another method for determining the combined image distance provided in an embodiment of the present application;

[0020] Figure 6 is a schematic flow chart of the steps of determining the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image provided by an embodiment of the present application;

[0021] Figure 7 It is a schematic diagram of the pixel coordinates of the left image and the right image;

[0022] Figure 8is a schematic flow chart of another step of determining the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image provided by an embodiment of the present application;

[0023] Fig. 9 It is a schematic block diagram of a combined image distance determination device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0025] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0026] It should be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.

[0027] It should also be understood that the term “and / or” used in the specification and appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0028] The embodiments of the present application provide a method and apparatus for determining a combined image distance, a head-mounted display device, and a storage medium, for obtaining an accurate combined image distance of a head-mounted display device.

[0029] See also Figure 1 , Figure 1 : is a flow chart of a method for determining the combined image distance provided by an embodiment of the present application. The method can be applied to a combined image distance determination device, and can also be applied to a head-mounted display device. The application does not limit the application scenario of the method. Among them, the head-mounted display device includes but is not limited to AR glasses, VR glasses and other devices. The following takes AR glasses as an example to specifically introduce the combined image distance determination method.

[0030] AR glasses are electronic devices that can display real scenes and virtual images in a superimposed manner. The lenses of AR glasses are transparent, and the external environment can be clearly seen through the lenses. In addition, AR glasses can project virtual images, allowing users to simultaneously see virtual images superimposed on the real world, such as Figure 2 As shown, one eye does not need to see the virtual image while the other eye can only see the real image, which avoids the inconvenience of switching the visual system's attention and adjusting the eye's focus and angle, has a better visual experience, and can effectively reduce eye fatigue.

[0031] The structure of AR glasses is similar to that of ordinary glasses, with lenses, frames, temples and nose pads. AR glasses use binocular imaging technology, and both left and right lenses can project light to the human eye to display the virtual image. Figure 3 As shown in the figure, the light emitted by the left lens is represented by vector V1, and the light emitted by the right lens is represented by vector V2. After the human eye forms a binocular image, a strong sense of depth is formed due to the existence of binocular parallax. The distance of the virtual object perceived by the user relative to the user is d, and the image formation distance of the AR glasses is d at this time. Binocular imaging can more realistically simulate the human eye's observation of objects, presenting different images through different perspectives of the left and right eyes, thereby forming binocular vision and enhancing the user's immersive experience.

[0032] like Figure 1 As shown, the method for determining the combined image distance specifically includes steps S101 to S103.

[0033] S101, obtaining a left-eye image and a right-eye image corresponding to a characteristic image projected by a head-mounted display device.

[0034] For example, Figure 4 As shown, the characteristic image projected by the AR glasses is the AprilTag image, which is a black and white pattern containing specific tags with different IDs, and can achieve positioning. It should be noted that the characteristic image is not limited to the AprilTag image, and other types of characteristic images can also be used.

[0035] When the AR glasses are worn, two camera devices are set at the positions corresponding to the human eyes, and the camera devices include but are not limited to cameras, cameras and other equipment. For example, the characteristic image projected by the AR glasses is observed simultaneously by two cameras, and the left eye image and the right eye image corresponding to the projection of the characteristic image are obtained by shooting, simulating the human eye to see the display of the AR glasses.

[0036] It should be noted that only one camera device may be used, and the left eye image and the right eye image may be obtained by moving the camera device to the positions of the left eye and the right eye respectively.

[0037] S102, determining a combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, wherein the left-eye image and the right-eye image include a plurality of feature points, and each pair of feature points includes a feature point in the left-eye image and a feature point corresponding to the same position in the right-eye image.

[0038] For example, still taking the feature image as the AprilTag image, the left and right images projected by the feature image include multiple feature points, each of which has a corresponding unique ID. The feature points in the left image and the feature points corresponding to the same position in the right image are a pair of feature points, that is, the feature points with the same ID in the left image and the right image are a pair of feature points. For multiple pairs of feature points in the left image and the right image, determine the combined image distance of each pair of feature points.

[0039] In some embodiments, Figure 5 As shown, step S101 may include step S104, and step S102 includes sub-step S1021.

[0040] S104, performing epipolar correction on the left eye image and the right eye image;

[0041] S1021, determining the combined image distance of each pair of feature points corresponding to the left eye image and the right eye image after epipolar correction.

[0042] For the camera device that captures the left and right images, calibrate the camera device's internal parameters, distortion, external parameters and other information. The internal parameters describe the transformation relationship from the coordinates in the camera device coordinate system to the pixel coordinates. For example, the internal parameter matrix K is as follows:

[0043]

[0044] Among them, f x 、f y They represent the corresponding focal lengths in the x-axis and y-axis directions, respectively, in pixels. u0 and v0 represent the row and column coordinates of the optical center (i.e., the intersection of the optical axis of the camera device and the image plane, usually located at the center of the image), respectively, in pixels.

[0045] The external parameters describe the position and angle of the camera observation point, and the distortion describes the image distortion. For example, the external parameter matrix is ​​as follows:

[0046]

[0047] Among them, R is a 3*3 rotation matrix, T is a 3*1 translation matrix, and T can be expressed as [T x , T y , T z ], T x 、Ty 、T z Represent the corresponding translation coordinates in the x-axis, y-axis, and z-axis directions respectively.

[0048] In order to eliminate the error caused by the camera device not being placed in parallel, the left eye image and the right eye image captured by the camera device are subjected to epipolar correction. For example, assuming that the left eye image is image_raw_left and the right eye image is image_raw_right, the left eye image image_raw_left and the right eye image image_raw_right are subjected to epipolar correction using the stereorectify algorithm. The StereoRectify algorithm is an image correction method for binocular stereo vision. The left eye image after epipolar correction is image_rectify_left and the right eye image is image_rectify_right.

[0049] After obtaining the left-eye image image_rectify_left and the right-eye image image_rectify_right, determine the combined image distance of each pair of feature points in the left-eye image image_rectify_left and the right-eye image image_rectify_right.

[0050] By performing epipolar correction on the left eye image and the right eye image, the error caused by the camera device not being placed in parallel is eliminated, so that the determined combined image distance of each pair of feature points in the left eye image and the right eye image is more accurate.

[0051] In some embodiments, Figure 6 As shown, step S102 may include sub-steps S1022 to S1024.

[0052] S1022, obtaining coordinate information corresponding to each pair of feature points;

[0053] S1023, obtaining a camera parameter corresponding to a camera device, wherein the left-eye image and the right-eye image are obtained by taking pictures of the camera device;

[0054] S1024: Determine a combined image distance of each pair of feature points according to the coordinate information and the camera parameters.

[0055] Exemplarily, the coordinate information of the feature point includes the horizontal pixel coordinates, vertical pixel coordinates, etc. corresponding to the feature point, and the camera parameters of the camera device include focal length, baseline length, etc., wherein the baseline length refers to the distance between the two cameras, and the focal length can be the corresponding focal length in the x-axis and / or y-axis direction.

[0056] For example, Figure 7As shown, the left eye image and the right eye image are obtained by shooting with two cameras arranged on the left and right. The feature point P of the left eye image l and the feature point P of the right eye image r , where P l The pixel coordinates are (x l ,y l ), P r The pixel coordinates are (x r ,y r ).

[0057] The baseline length between the two cameras can be set to The focal lengths of the two camera devices can be set to the corresponding focal lengths f in the x-axis direction. x .

[0058] In some embodiments, determining the combined image distance of each pair of feature points based on the coordinate information and the camera parameters includes: determining the binocular parallax corresponding to each pair of feature points based on the pixel coordinates; and determining the combined image distance of each pair of feature points based on the binocular parallax, the focal length and the baseline length.

[0059] For example, Figure 7 The pixel coordinates (x l ,y l )、(x r ,y r ) as an example, according to the horizontal pixel coordinate x l 、x r , the binocular disparity corresponding to the pair of feature points is calculated as |x l -x r |. Then, the combined image distance corresponding to the pair of feature points is obtained based on the obtained binocular parallax, as well as information such as the focal length and baseline length of the camera device.

[0060] Exemplarily, the combined image distance of each pair of feature points is calculated according to the following formula (1):

[0061] d=(f*b) / p (1)

[0062] Wherein, d is the combined image distance of each pair of feature points, f is the focal length of the camera device, b is the baseline length, and p is the binocular parallax corresponding to each pair of feature points.

[0063] The binocular disparity p = |x l -x r Substituting into the above formula (1), we get the following calculation formula (2) for the combined image distance of a pair of feature points:

[0064] d=(f*b) / |x l -x r| (2)

[0065] By using the above formula (2), the combined image distance of each pair of feature points in the left image and the right image can be calculated.

[0066] In some embodiments, Figure 8 As shown, step S102 may include sub-step S1025 and sub-step S1026.

[0067] S1025, determining a pixel offset matrix corresponding to the left-eye image and the right-eye image in the horizontal direction;

[0068] S1026. Determine the combined image distance of each pair of feature points according to the pixel offset matrix.

[0069] Exemplarily, a deep learning algorithm can be used to calculate the pixel offset of the right eye image relative to the left eye image, or the pixel offset of the left eye image relative to the right eye image, including a pixel offset matrix in the horizontal direction and a pixel offset matrix in the vertical direction. For example, the pixel offset matrix in the horizontal direction is flow_x, and its size (the number of rows and columns of the matrix) is consistent with the size of the left eye image / right eye image (the number of horizontal and vertical pixels of the image), and the pixel offset matrix in the vertical direction is flow_y, and its size is consistent with the size of the left eye image / right eye image.

[0070] According to the pixel offset matrix in the horizontal direction, the binocular disparity corresponding to each pair of feature points in the left image and the right image can be determined. For example, according to each element flow_x[i, j] in the pixel offset matrix, the binocular disparity of each pair of feature points corresponding to each corresponding position is determined as p_ij.

[0071] Then, the combined image distance corresponding to each pair of feature points of the left image and the right image is calculated according to the following formula (3):

[0072] d_ij=(f*b) / p_ij (3)

[0073] Wherein, d_ij is the combined image distance of each pair of feature points, f is the focal length of the camera device, b is the baseline length, and p_ij is the binocular parallax corresponding to each pair of feature points.

[0074] S103: Determine an image distance corresponding to the head mounted display device according to image distances of multiple pairs of feature points.

[0075] After obtaining the combined image distances of the multiple pairs of feature points based on the multiple pairs of feature points of the left-eye image and the right-eye image, the combined image distances corresponding to the AR glasses are obtained based on the combined image distances of the multiple pairs of feature points.

[0076] In some embodiments, determining the image distance corresponding to the head-mounted display device based on the image distances of multiple pairs of feature points includes: calculating an average value of the image distances of the multiple pairs of feature points, and determining the average value as the image distance corresponding to the head-mounted display device.

[0077] For example, suppose the combined image distances of N pairs of feature points are d1, d2, d3, ... d N , calculate d1, d2, d3, ... d N The calculated average value is determined as the image combination distance corresponding to the head mounted display device.

[0078] It should be noted that in addition to the above-mentioned method of using the average value of the image distances of multiple pairs of feature points as the image distance corresponding to the head-mounted display device, other methods can also be used to obtain the image distance corresponding to the head-mounted display device. For example, the maximum / minimum value of the image distances of multiple pairs of feature points is used as the image distance corresponding to the head-mounted display device. For another example, the range of the maximum and minimum values ​​of the image distances of multiple pairs of feature points is calculated, and the range is used as the image distance corresponding to the head-mounted display device. The specific method of determining the image distance of the head-mounted display device based on the image distance of multiple pairs of feature points is not limited in this application.

[0079] In the above embodiment, by acquiring the left-eye image and the right-eye image corresponding to the feature image projected by the head-mounted display device, the image convergence distance of each pair of feature points corresponding to the left-eye image and the right-eye image is determined, wherein the left-eye image and the right-eye image include multiple feature points, and each pair of feature points includes a feature point in the left-eye image and a feature point corresponding to the same position in the right-eye image. According to the image convergence distance of the multiple pairs of feature points, the image convergence distance corresponding to the head-mounted display device is determined. Compared with the method of using the expected image convergence distance as the actual image convergence distance of the head-mounted display device, a more accurate image convergence distance of the head-mounted display device is obtained.

[0080] See also Fig. 9 , Fig. 9 It is a schematic block diagram of a combined image distance determination device provided in an embodiment of the present application. The combined image distance determination device can be configured in a head-mounted display device to execute the aforementioned combined image distance determination method.

[0081] like Fig. 9 As shown, the combined image distance determination device 200 may include a processor 210 and a memory 220, wherein the processor 210 and the memory 220 are connected via a bus, such as an I2C (Inter-integrated Circuit) bus.

[0082] Specifically, the processor 210 may be a micro-controller unit (MCU), a central processing unit (CPU), or a digital signal processor (DSP).

[0083] Specifically, the memory 220 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB disk, or a mobile hard disk, etc. The memory 220 stores various computer programs for the processor 210 to execute.

[0084] The processor 210 is used to run a computer program stored in the memory, and implements the following steps when executing the computer program:

[0085] Obtaining a left-eye image and a right-eye image corresponding to a feature image projected by a head-mounted display device;

[0086] Determine a combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, wherein the left-eye image and the right-eye image include a plurality of feature points, and each pair of feature points includes a feature point in the left-eye image and a feature point corresponding to the same position in the right-eye image;

[0087] According to the combined image distances of the multiple pairs of feature points, the combined image distance corresponding to the head mounted display device is determined.

[0088] In some embodiments, when the processor 210 implements the determination of the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, it is configured to implement:

[0089] Obtaining coordinate information corresponding to each pair of feature points;

[0090] Acquire camera parameters corresponding to a camera device, wherein the left-eye image and the right-eye image are obtained by taking pictures of the camera device;

[0091] The combined image distance of each pair of feature points is determined according to the coordinate information and the camera parameters.

[0092] In some embodiments, the coordinate information includes the pixel coordinates in the horizontal direction corresponding to each feature point, and the camera parameters include the focal length and the baseline length. When the processor 210 determines the combined image distance of each pair of feature points according to the coordinate information and the camera parameters, it is used to implement:

[0093] Determining the binocular disparity corresponding to each pair of feature points according to the pixel coordinates;

[0094] The combined image distance of each pair of feature points is determined according to the binocular parallax, the focal length and the baseline length.

[0095] In some embodiments, when the processor 210 determines the combined image distance of each pair of feature points according to the binocular parallax, the focal length and the baseline length, it is configured to implement:

[0096] According to the formula d=(f*b) / p, the combined image distance of each pair of feature points is calculated;

[0097] Wherein, d is the combined image distance of each pair of feature points, f is the focal length, b is the baseline length, and p is the binocular parallax.

[0098] In some embodiments, when the processor 210 implements the determination of the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, it is configured to implement:

[0099] Determine a pixel offset matrix corresponding to the left-eye image and the right-eye image in the horizontal direction;

[0100] The combined image distance of each pair of feature points is determined according to the pixel offset matrix.

[0101] In some embodiments, after obtaining the left-eye image and the right-eye image corresponding to the feature image projected by the head mounted display device, the processor 210 is used to implement:

[0102] Performing epipolar correction on the left eye image and the right eye image;

[0103] When the processor 210 implements the determination of the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, it is used to implement:

[0104] Determine the combined image distance of each pair of feature points corresponding to the left eye image and the right eye image after epipolar correction.

[0105] In some embodiments, when the processor 210 determines the image distance corresponding to the head mounted display device according to the image distances of multiple pairs of feature points, it is configured to implement:

[0106] An average value of the combined image distances of the multiple pairs of feature points is calculated, and the average value is determined as the combined image distance corresponding to the head mounted display device.

[0107] The combined image distance determination device 200 can execute the combined image distance determination method provided in the embodiment of the present application, and therefore can achieve the beneficial effects that can be achieved by the combined image distance determination method provided in the embodiment of the present application. Please refer to the previous embodiment for details, which will not be repeated here.

[0108] In an embodiment of the present application, a head mounted display device is further provided. The head mounted display device includes a combined image distance determining device. The combined image distance determining device can be Fig. 9 Therefore, the head mounted display device can achieve the beneficial effects that can be achieved by the method for determining the combined image distance provided in the embodiment of the present application, as detailed in the previous embodiment, which will not be repeated here.

[0109] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for determining the combined image distance as described above are implemented.

[0110] The computer-readable storage medium may be an internal storage unit of the combined image distance determination device or the head-mounted display device described in the foregoing embodiments, such as a hard disk or memory of the combined image distance determination device or the head-mounted display device. The computer-readable storage medium may also be an external storage device of the combined image distance determination device or the head-mounted display device, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital card (Secure Digital Card, SD Card), a flash card (Flash Card), etc., equipped on the combined image distance determination device or the head-mounted display device.

[0111] Since the computer program stored in the storage medium can execute any one of the methods for determining the combined image distance provided in the embodiments of the present application, the beneficial effects that can be achieved by any one of the methods for determining the combined image distance provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0112] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0113] The above description is only a specific implementation mode of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or substitutions within the technical scope disclosed in the present application, and these modifications or substitutions should be included in the protection scope of the present application.

Claims

1. A method for determining a combined image distance, characterized in that: The combined image distance determination method comprises: Obtaining a left-eye image and a right-eye image corresponding to a feature image projected by a head-mounted display device; Determine a combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image, wherein the left-eye image and the right-eye image include a plurality of feature points, and each pair of feature points includes a feature point in the left-eye image and a feature point corresponding to the same position in the right-eye image; According to the combined image distances of the multiple pairs of feature points, the combined image distance corresponding to the head mounted display device is determined.

2. The method for determining the combined image distance according to claim 1, wherein: The determining of the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image includes: Obtaining coordinate information corresponding to each pair of feature points; Acquire camera parameters corresponding to a camera device, wherein the left-eye image and the right-eye image are obtained by taking pictures of the camera device; The combined image distance of each pair of feature points is determined according to the coordinate information and the camera parameters.

3. The method for determining the combined image distance according to claim 2, wherein: The coordinate information includes the pixel coordinates in the horizontal direction corresponding to each feature point, the camera parameters include focal length and baseline length, and determining the combined image distance of each pair of feature points according to the coordinate information and the camera parameters includes: Determining the binocular disparity corresponding to each pair of feature points according to the pixel coordinates; The combined image distance of each pair of feature points is determined according to the binocular parallax, the focal length and the baseline length.

4. The method for determining the combined image distance according to claim 3, wherein: The determining the combined image distance of each pair of feature points according to the binocular parallax, the focal length and the baseline length comprises: According to the formula d=(f*b) / p, the combined image distance of each pair of feature points is calculated; Wherein, d is the combined image distance of each pair of feature points, f is the focal length, b is the baseline length, and p is the binocular parallax.

5. The method for determining the combined image distance according to claim 1, wherein: The determining of the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image includes: Determine a pixel offset matrix corresponding to the left-eye image and the right-eye image in the horizontal direction; The combined image distance of each pair of feature points is determined according to the pixel offset matrix.

6. The method for determining the combined image distance according to claim 1, wherein: After obtaining the left-eye image and the right-eye image corresponding to the feature image projected by the head mounted display device, the method includes: Performing epipolar correction on the left eye image and the right eye image; The determining of the combined image distance of each pair of feature points corresponding to the left-eye image and the right-eye image includes: Determine the combined image distance of each pair of feature points corresponding to the left eye image and the right eye image after epipolar correction.

7. The method for determining the combined image distance according to any one of claims 1 to 6, characterized in that: The determining, according to the image distances of the plurality of pairs of feature points, the image distance corresponding to the head mounted display device comprises: An average value of the combined image distances of the multiple pairs of feature points is calculated, and the average value is determined as the combined image distance corresponding to the head mounted display device.

8. A device for determining a combined image distance, characterized in that: The combined image distance determination device comprises a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the steps of the method for determining the combined image distance according to any one of claims 1 to 7 when executing the computer program.

9. A head mounted display device, characterized in that: The head mounted display device comprises the combined image distance determination device as claimed in claim 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for determining the combined image distance according to any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Glasses combined image quality detection method and device, electronic equipment and storage medium

    CN120823169A