A binocular parallax measuring device and method

Abstract

The application provides a binocular parallax measuring device and method, which is used for measuring binocular parallax of a head-mounted display device, and comprises a first telescope system, a second telescope system, a converging lens and an imaging sensor. The head-mounted display device comprises left and right eyeglasses, the optical axis of the left eyeglass coincides with the optical axis of the first telescope system, and the left eyeglass is located in front of the first telescope system; the optical axis of the right eyeglass coincides with the optical axis of the second telescope system, and the right eyeglass is located in front of the second telescope system; the converging lens is located behind the first and second telescope systems, and in front of the imaging sensor; and the center of the converging lens and the center of the imaging sensor are located on the optical axis of the converging lens. Through the device, the problem that the current binocular parallax testing device of the head-mounted display device is complex in technology and low in precision can be solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of optical equipment, in particular to a binocular parallax measurement device and method. BACKGROUND

[0002] The near eye display (NED) head-mounted device is the most typical and potential medium of the meta universe, taking a virtual reality (VR) head-mounted display device as an example. In order to adapt to different groups of people, most of the current VR head-mounted display devices support interpupillary distance (IPD) mechanical adjustment, but cannot solve the problem of binocular parallax of the VR head-mounted display device, and the binocular parallax determines the fusion degree of the binocular module imaging. If the binocular parallax of the head-mounted display device is too large, the fusion degree of the binocular module imaging will be poor, the user will have a binocular ghosting phenomenon when using the VR head-mounted display device, and the user experience will be affected.

[0003] At present, the test of the binocular parallax of the head-mounted display device needs to test the eccentricity values of the left module and the right module respectively, and then calculate the binocular parallax by using the eccentricity values of the left module and the right module. The test process of this method is relatively complex. After testing the eccentricity of the left module, the test equipment needs to be moved to test the eccentricity of the right module. During the movement of the test equipment, a certain precision error will be generated. Therefore, the binocular parallax calculated based on this will also have a certain precision error. SUMMARY

[0004] The present application provides a binocular parallax measurement device and method to solve the problem of complex technology and low precision of the current binocular parallax test device of the head-mounted display device.

[0005] In a first aspect, the present application provides a binocular parallax measurement device, which is used for measuring the binocular parallax of a head-mounted display device, and includes a first telescope system, a second telescope system, a converging lens and an imaging sensor.

[0006] The head-mounted display device includes a left eye lens and a right eye lens. The optical axis of the left eye lens coincides with the optical axis of the first telescope system, and the left eye lens is located in front of the first telescope system. The optical axis of the right eye lens coincides with the optical axis of the second telescope system, and the right eye lens is located in front of the second telescope system. The optical axis of the left eye lens is parallel to the optical axis of the right eye lens.

[0007] The converging lens is located behind the first telescope system and the second telescope system, the converging lens is located in front of the imaging sensor, the center of the converging lens and the center of the imaging sensor are located on the optical axis of the converging lens, the optical axis of the converging lens is parallel to the optical axis of the left eye lens and the optical axis of the right eye lens, and the aperture of the converging lens is greater than the distance between the optical axis of the left eye lens and the optical axis of the right eye lens.

[0008] The device includes a first telescope system and a second telescope system, so that the eccentricity values of the left module based on the left eye lens and the right module based on the right eye lens can be measured at the same time, and the measurement results of the eccentricity values of the left module and the right module are converged through the converging lens, and the convergence result is displayed on the imaging sensor. Therefore, the problem of precision error caused by moving the measuring device can be avoided, and the problem of complex and low precision of the binocular disparity testing device of the current head-mounted display device is solved.

[0009] Optionally, the distance between the center of the left eye lens and the center of the first telescope system is equal to the distance between the center of the right eye lens and the center of the second telescope system.

[0010] Optionally, the head-mounted display device further comprises a first screen and a second screen, the first screen is located in front of the left eye lens, the second screen is located in front of the right eye lens, and the left eye lens and the right eye lens are the same lens.

[0011] Optionally, the distance between the first screen and the left eye lens is equal to the distance between the second screen and the right eye lens.

[0012] Optionally, the first telescope system and the second telescope system are the same telescope system, and the first telescope system is any one of a Kepler telescope system, a catadioptric telescope system, a reflective telescope system and a Galilean telescope system.

[0013] Optionally, the aperture of the converging lens is greater than the sum of the distance between the optical axis of the left eye lens and the optical axis of the right eye lens, half of the aperture of the first telescope system and half of the aperture of the second telescope system.

[0014] Optionally, the imaging sensor is located at one focal length of the converging lens.

[0015] In a second aspect, an embodiment of the present application provides a binocular disparity measurement method, which is used for measuring the binocular disparity of a head-mounted display device, and the method comprises the following steps:

[0016] The first telescope system is used to obtain a first virtual image; the head-mounted display device comprises a first screen, and the first virtual image is a virtual image corresponding to the first screen;

[0017] The second telescope system is used to obtain a second virtual image; the head-mounted display device further comprises a second screen, and the second virtual image is a virtual image corresponding to the second screen;

[0018] The converging lens is used to converge the first virtual image and the second virtual image to obtain a converged virtual image;

[0019] The imaging sensor is used to display the converged virtual image;

[0020] The binocular disparity of the head-mounted display device is calculated according to the display result of the imaging sensor.

[0021] In the technical solution, the first virtual image is obtained by the first telescope system, the second virtual image is obtained by the second telescope system, the converging lens converges the first virtual image and the second virtual image to obtain a converged virtual image, and the imaging sensor can receive and display the converged virtual image, so that the binocular disparity of the head-mounted display device can be calculated based on the converged virtual image of the imaging sensor, thereby solving the problem of complex binocular disparity testing device technology and low precision of the head-mounted display device.

[0022] Optionally, the first virtual image is a virtual image formed by reversely extending and converging first refracted light rays of light rays emitted by the first screen through a left eye lens; and the second virtual image is a virtual image formed by reversely extending and converging second refracted light rays of light rays emitted by the second screen through a right eye lens.

[0023] Optionally, the display result of the imaging sensor comprises a mark associated with the first virtual image and a mark associated with the second virtual image.

[0024] The binocular disparity is calculated according to the display result of the imaging sensor, comprising:

[0025] The binocular disparity of the head-mounted display device is calculated according to the mark associated with the first virtual image and the mark associated with the second virtual image.

[0026] Optionally, the mark associated with the first virtual image is a cross mark, and the mark associated with the second virtual image is a cross mark. BRIEF DESCRIPTION OF DRAWINGS

[0027] Figure 1 It is a schematic diagram of the light path in the existing telescope system in the present application, in which the light is transmitted from the infinite distance to the objective lens in parallel;

[0028] Figure 2 It is a schematic diagram of the light path in the existing telescope system in the present application, in which the light is transmitted from the finite distance to the objective lens obliquely;

[0029] Figure 3 The focusing mirror focusing light path schematic diagram of the existing telescope system in the present application, in which the light is transmitted from the infinite parallel to the objective lens;

[0030] Figure 4 The focusing mirror focusing light path schematic diagram of the existing telescope system in the present application, in which the light is transmitted from the infinite parallel to the objective lens;

[0031] Figure 5 The structure schematic diagram of a binocular parallax measurement device provided by the embodiment of the present application;

[0032] Figure 6 The schematic diagram of a module center cross mark provided by the embodiment of the present application;

[0033] Figure 7 The schematic diagram of a head-mounted display device virtual image receiving light path provided by the embodiment of the present application when there is no module deviation;

[0034] Figure 8 The schematic diagram of a head-mounted display device virtual image receiving light path provided by the embodiment of the present application when there is module deviation;

[0035] Figure 9 The schematic diagram of a binocular parallax test light path provided by the embodiment of the present application when there is no binocular parallax;

[0036] Figure 10 The schematic diagram of a binocular parallax test light path provided by the embodiment of the present application when there is binocular parallax;

[0037] Figure 11 The schematic diagram of a CCD connected computer real-time image capture provided by the embodiment of the present application;

[0038] Figure 12 The schematic diagram of a scale factor calibration provided by the embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical scheme and advantages of the present application clearer, the present application will be further described in detail below with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative labor fall within the protection scope of the present application.

[0040] The application scenarios described in the embodiments of the present application are used to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, with the appearance of new application scenarios, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems. In the description of the present application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0041] The technical concepts in the present application are explained as follows:

[0042] 1. Imaging principle of head-mounted display device

[0043] The imaging principle of the head-mounted display device is actually the imaging process of a magnifying glass. The display device is placed within one focal length of the lens. The light emitted by the display device is refracted by the lens. The refracted light is divergent. The refracted light is convergent when extended in the opposite direction, forming a virtual image. The human eye can see the magnified virtual image of the display device at the exit pupil distance on the other side of the lens.

[0044] 2. Binocular disparity

[0045] Binocular disparity (Disparity), also known as binocular virtual image geometry difference, refers to the alignment deviation of the binocular module imaging. The definition of binocular disparity is related to the module decentering, which refers to the deviation (Decenter) between the lens center and the display center. The module composed of the left eye lens and its corresponding display is called the left module (L module), and its decentering is defined as Dcenter_L. The module composed of the right eye lens and its corresponding display is called the right module (R module), and its decentering is defined as Dcenter_R. The calculation formula of binocular disparity is Disparity = |Dcenter_L - Dcenter_R|, which is the absolute value of the difference between the decentering values of the left module and the right module.

[0046] 3. Telescope system

[0047] The telescope system includes Kepler telescope system, folded telescope system, reflecting telescope system, and Galilean telescope system (convex-concave telescope system). The following describes the telescope system by taking the Kepler telescope system as an example. The Kepler telescope system is composed of two convex lenses, in which the convex lens with a large focal length is the objective lens, and the convex lens with a small focal length is the eyepiece. The lenses in the telescope system are regarded as ideal thin lenses.

[0048] Exemplarily, as Figure 1As shown, light is transmitted from infinity to the objective lens in parallel, focused by the objective lens to the objective focus point, and then transmitted to the eyepiece. At this time, since the focal points of the objective lens and the eyepiece coincide, the light can be emitted from the eyepiece in parallel. The focal point of the objective lens is the image-side focal point F1', the focal point of the eyepiece is the object-side focal point F2, the focal length of the objective lens is f1', and the focal length of the eyepiece is -f2.

[0049] Exemplarily, as shown in FIG. 1, the light is transmitted from infinity to the objective lens in parallel, focused by the objective lens to the objective focus point, and then transmitted to the eyepiece. At this time, since the focal points of the objective lens and the eyepiece coincide, the light can be emitted from the eyepiece in parallel. The focal point of the objective lens is the image-side focal point F1', the focal point of the eyepiece is the object-side focal point F2, the focal length of the objective lens is f1', and the focal length of the eyepiece is -f2. Figure 2 As shown, light is transmitted from a finite distance to the objective lens in parallel, focused by the objective lens to the objective focus point, and then transmitted to the eyepiece. At this time, since the focal points of the objective lens and the eyepiece coincide, the light can be emitted from the eyepiece in parallel. The focal point of the objective lens is the image-side focal point F1', the focal point of the eyepiece is the object-side focal point F2, the focal length of the objective lens is f1', and the focal length of the eyepiece is -f2.

[0050] The above Figure 1 and Figure 2 The corresponding structure is to use the eyepiece as a focusing mirror for focusing. The focusing mode of the telescope system is not limited to this, and can be replaced, for example, a concave lens can be used as a focusing mirror for focusing.

[0051] Exemplarily, Figure 3 For light transmitted from infinity to the objective lens in parallel, d0 is the distance between the focusing mirror and the objective lens, and f' is the combined image-side focal length of the objective lens and the focusing mirror. Figure 4 For light transmitted from a finite distance to the objective lens in parallel, focusing is completed by adjusting the position of the focusing mirror to make the image clear. At this time, the position of the focusing mirror is moved by a distance of △d relative to the position when the light is transmitted from infinity to the objective lens in parallel.

[0052] Currently, the existing binocular parallax testing device is complex, and needs to test the module eccentricity of the L module and the R module twice, and then calculate the binocular parallax based on the formula. After testing the eccentricity of the L module, the R module needs to be moved for eccentricity testing. During the movement of the testing equipment, a certain precision error will be generated, and the binocular parallax calculated based on this will also have a certain precision error.

[0053] Therefore, the present application provides a binocular parallax measuring device to solve the problem that the binocular parallax testing device of the current head-mounted display device is complex and has low precision. All lenses in the present application are regarded as ideal thin lenses.

[0054] The binocular parallax measuring device provided by the present application is used to measure the binocular parallax of a head-mounted display device, and includes a first telescope system, a second telescope system, a converging lens, and an imaging sensor. The structural schematic diagram is as shown inFigure 5 as shown.

[0055] by Figure 5 As can be seen, the head-mounted display device comprises a first screen, a second screen, a left eye lens and a right eye lens. The first screen is located in front of the left eye lens, the second screen is located in front of the right eye lens, and the distance between the first screen and the left eye lens is equal to the distance between the second screen and the right eye lens. Among them, the left eye lens and the first screen constitute a left module (L module), and the right eye lens and the second screen constitute a right module (R module).

[0056] The left eye lens is located in front of the first telescope system, and the optical axis of the left eye lens coincides with the optical axis of the first telescope system, that is, the optical axis of the left eye lens, the optical axis of the objective lens in the first telescope system and the optical axis of the eyepiece are the same optical axis that overlaps.

[0057] The right eye lens is located in front of the second telescope system, and the optical axis of the right eye lens coincides with the optical axis of the second telescope system, that is, the optical axis of the right eye lens, the optical axis of the objective lens in the second telescope system and the optical axis of the eyepiece are the same optical axis that overlaps, and the optical axis of the left eye lens and the optical axis of the right eye lens are two parallel optical axes.

[0058] Exemplarily, the distance between the left eye lens and the center of the first telescope system is equal to the distance between the right eye lens and the center of the second telescope system, and the left eye lens and the right eye lens are the same lens with consistent shape, size and parameter attributes.

[0059] Exemplarily, the first telescope system and the second telescope system are the same telescope system, for example, when the first telescope system is a Kepler telescope system, the second telescope system is a Kepler telescope system with consistent shape, size and parameter attributes with the first telescope system. Among them, the objective lens of the first telescope system and the second telescope system can be a doublet achromatic lens or a triplet achromatic lens.

[0060] The converging lens is located behind the first telescope system and the second telescope system, and the imaging sensor is located at one focal length behind the converging lens. The center of the converging lens and the center of the imaging sensor are located on the optical axis of the converging lens, and the optical axis of the converging lens is parallel to the optical axis of the left eye lens, that is, the optical axis of the converging lens is also parallel to the optical axis of the right eye lens. Among them, the aperture of the converging lens is greater than the distance between the optical axis of the left eye lens and the optical axis of the right eye lens. Specifically, the aperture of the converging lens is greater than the sum of the distance between the optical axis of the left eye lens and the optical axis of the right eye lens, half of the aperture of the first telescope system and half of the aperture of the second telescope system.

[0061] The application also proposes a binocular parallax measurement method, which can be used to measure the binocular parallax of the head-mounted display device.

[0062] Firstly, the first screen displays a mark capable of highlighting the center, and the present application takes a cross mark as an example, as shown in Figure 6 The color of the cross coordinates is not limited in the present application, and can be any color such as white, red, green, blue, etc. The light emitted by the first screen forms first refracted light through the left eyepiece of the head-mounted display device, and the first refracted light is reversely extended to converge to form a virtual image, which is referred to as a first virtual image, and the first virtual image can be projected on the first telescope system. Meanwhile, the second screen displays a cross mark, and the light emitted by the second screen forms second refracted light through the right eyepiece of the head-mounted display device, and the second refracted light is reversely extended to converge to form a virtual image, which is referred to as a second virtual image, and the second virtual image can be projected on the second telescope system.

[0063] Then, the converging lens converges the first virtual image on the first telescope system and the second virtual image on the second telescope system to form a converged virtual image, which is the fusion of the cross mark corresponding to the first virtual image and the cross mark corresponding to the second virtual image. Finally, the imaging sensor receives and displays the converged virtual image on the converging lens, and the binocular disparity of the head-mounted display device is calculated according to the cross mark corresponding to the first virtual image and the cross mark corresponding to the second virtual image on the imaging sensor.

[0064] Exemplarily, the first virtual image is projected on the first telescope system.

[0065] When the center of the screen and the center of the lens are located on the optical axis of the lens, i.e., there is no module eccentricity, the optical path diagram is as shown in Figure 7 . Figure 7 The screen and the VR lens form a head-mounted display device optical path (referred to as a head-mounted optical path), and the telescope system forms a virtual image receiving optical path. The screen emits light, which is refracted after passing through the lens and is emitted as divergent light. The refracted light is reversely extended to converge to form a virtual image, which is projected on the virtual image receiving optical path (i.e., the telescope system). The virtual image light is refracted by the objective lens to reach the eyepiece, and finally exits the eyepiece in the form of parallel light.

[0066] Specifically, Figure 7 Eye Relief is the first distance, which is the distance between the user's eye and the lens, and the first distance is determined according to an empirical value; the virtual image distance V is the distance between the virtual image formed by the head-mounted display device optical path and the user's eye; C is the distance between the objective lens vertex and the user's eye; the light ray divergence angle θ is the angle between the refracted edge light and the lens optical axis, which is determined by the virtual image distance; and the optical interval δ is determined by θ and C.

[0067] When the center of the screen deviates from the optical axis of the lens, the center of the screen and the center of the lens are not on the same straight line, i.e., there is module eccentricity, and the optical path diagram is as shown in Figure 8 .

[0068] exist Figure 7 In this case, the object distance p is p = V + C, and the objective lens focal length f is f = f1'. Based on the imaging formula 1 / p + 1 / q = 1 / f (where p is the object distance, q is the image distance, and f is the objective lens focal length), the corresponding image distance q = f1' + δ. Since in Figure 8 In this case, the distance between the virtual image and the objective lens, i.e., the object distance p, remains p = V + C, and the focal length of the objective lens f remains unchanged at f = f1'. Therefore, in Figure 8 The image distance of the virtual image after refraction by the objective lens is still f1'+δ. That is, even with module eccentricity, the virtual image can still be imaged on the object-side focal plane of the eyepiece after passing through the objective lens.

[0069] Specifically, Figure 8 The central ray emitted from the center of the screen forms an angle α with the optical axis of the lens, and the rays from the two edges are no longer symmetrical with respect to the optical axis of the lens. This application defines the sign of rays above the optical axis of the lens as positive and those below as negative. In this case, the center of the screen is above the optical axis of the lens, meaning the sign of module eccentricity is positive. The imaging point of the virtual image after passing through the objective lens is below the optical axis, and its sign is opposite to the sign of module eccentricity. This imaging point still emits parallel light after passing through the eyepiece, but this parallel light is no longer parallel to the optical axis of the lens; instead, it forms an angle with the optical axis. This application defines this angle as β.

[0070] Since the left and right lenses are identical, and the first and second telescope systems are also identical, the projection of the second virtual image onto the second telescope system is consistent with the projection of the first dotted line onto the first telescope system. A schematic diagram of the optical path can be found here. Figure 7 and Figure 8 Two scenarios.

[0071] Depend on Figure 7 and Figure 8 As can be seen from the virtual image receiving optical path of the head-mounted display device, although the telescope system can receive the virtual image of a monocular module (i.e., the L module or the R module), it cannot synthesize the virtual image of a binocular module (i.e., a combination of the L and R modules) to evaluate the magnitude of binocular parallax. Therefore, after the binocular virtual image is projected onto the telescope system, a converging lens can be used to converge the binocular virtual image. This converging lens can be a cemented second achromatic lens or a cemented third achromatic lens.

[0072] Specifically, in this application, the converging lens is an example of a convex lens. The aperture of the convex lens needs to be greater than the sum of the distance between the optical axes of the left and right lenses, half the aperture of the first telescope system, and half the aperture of the second telescope system. This ensures that the converging lens can receive all the light emitted from both telescopes.

[0073] Finally, the converging virtual image converged by the converging lens is received by the imaging sensor, and the imaging sensor is placed on the focal plane of the converging lens, so as to calculate the binocular disparity of the collected image. Specifically, the imaging sensor in the present application can adopt a charge-coupled device (CCD).

[0074] Exemplarily, as shown in FIG. 6, when the L module and the R module do not have module deviation, the binocular virtual image light passes through the telescope system and is emitted in the form of parallel light, and then the binocular virtual image can be converged on the focal plane of the converging lens. At this time, the virtual image received by the CCD after being converged by the converging lens is two superimposed cross images, that is, the binocular disparity is 0. Specifically, the cross image is a straight line. Figure 9 The example of FIG. 6 is taken as an example of one-dimensional module deviation, and in actuality, there is two-dimensional module deviation. Figure 9

[0075] Since the resolution of the CCD is usually several times higher than the resolution of the screen of the head-mounted display device, and the screen light passes through the optical path magnification of the head-mounted display device and then passes through the telescope system and can be converged on the CCD, the cross image received by the CCD is not a continuous straight line but a continuous pixel point dotted line. On this basis, the pixel points of the cross image can be lit at intervals, the line segment of the cross image is marked as a dotted line, the interval of the pixel points on the CCD image is further enlarged, and the naked eye reading is facilitated.

[0076] When at least one module of the binocular module has module deviation, the binocular disparity is generally not 0. Exemplarily, as shown in FIG. 7, the L module has module deviation, and the R module does not have module deviation. Figure 10 As shown in FIG. 7, the center of the screen of the L module is deviated from the center of the lens, and the parallel light emitted by the virtual image of the L module after passing through the telescope system has an angle with the telescope eyepiece optical axis, so as to be converged on a position deviated from the center of the CCD by the converging lens. The distance between the position where the virtual image of the L module is converged by the converging lens and the optical axis of the converging lens is the eccentricity value of the L module at this time. The center of the screen of the R module is not deviated from the center of the lens, that is, the R module does not have module eccentricity, and the parallel light emitted by the virtual image of the R module after passing through the telescope system does not have an angle with the telescope eyepiece optical axis, so as to be converged on the center of the CCD by the converging lens. Correspondingly, the cross image of the L module is projected on a position deviated from the center of the CCD, and the cross image of the R module is projected on the center of the CCD. Figure 10 The distance between the two vertical dotted lines displayed by the CCD is the binocular disparity of the head-mounted display device. Figure 10

[0077] For analyzing the binocular disparity of the head-mounted display device according to the image received by the CCD, the present application proposes two analysis methods:

[0078] ​​(1) Directly reading data by naked eyes. Since the resolution of the CCD is much higher than the pixel resolution of the screen of the head-mounted display device, the pixels of the screen of the head-mounted display device can be clearly recognized on the image received by the CCD, and the binocular parallax can be directly read by naked eyes;

[0079] (2) Reading data by image processing. Since the reading data by naked eyes is affected by subjective and objective factors, errors exist. Therefore, the CCD is connected with a computer, as shown in FIG. 2. The image is captured in real time by the CCD and processed by image processing software, so that the binocular parallax can be quickly and accurately obtained. The image processing software can be MATLAB. Figure 11

[0080] Based on the device for measuring the binocular parallax of the head-mounted display device and the method for measuring the binocular parallax of the head-mounted display device proposed in the present application, the specific binocular parallax test process is as follows:

[0081] Step 1: Place the head-mounted display device on a stable platform or a special tooling and fix it. Display a cross mark or other marks capable of highlighting the center on the screen center of the binocular module of the head-mounted display device.

[0082] Step 2: Align the first telescope system with the center of the left eye lens and align the second telescope system with the center of the right eye lens. The alignment mode can be mechanical alignment or other arbitrary alignment mode, which is not limited in the present application.

[0083] Step 3: Place the converging lens behind the telescope system, so that the optical axis of the converging lens is at the same height as the optical axis of the lens in the head-mounted display device. Specifically, it can be achieved by two ways: (1) first mechanically align the optical axis of the converging lens with the optical axis of any one of the telescope systems, and then move to the center of the distance between the two telescope systems; (2) align the optical axis of the converging lens with the optical axis of the lens in the head-mounted display device before step 2, and then place the converging lens at the center of the distance between the two telescope systems after the telescope systems are placed. Compared with way (1), way (2) can reduce the error of indirect alignment.

[0084] Step 4: Place the CCD at one focal length of the converging lens, and align the center of the CCD with the optical axis of the converging lens. The alignment mode can be any alignment mode, which is not limited in the present application.

[0085] Step 5: Adjust the optical distance between the two telescope systems until the CCD can receive the clearest image. Specifically, since the telescope system is encapsulated in actual use, the adjustment of the optical distance is completed by adjusting the eyepiece.

[0086] ​Step 6: Save the clear image captured by the CCD, perform post-processing, and calculate the binocular parallax. Specifically, the image processing procedure is as follows:

[0087] The image captured by a CCD is processed to obtain a result in CCD pixels, while binocular parallax is evaluated in screen pixels. Therefore, a scaling factor K needs to be set between CCD pixels and screen pixels for calculation and calibration. The specific calibration process for the scaling factor K is as follows: Select different screen pixel intervals A and their corresponding CCD pixel intervals B in the captured image, and calculate the scaling factor K between screen pixel interval A and CCD pixel interval B, where K = B / A. When there are multiple sets of K, they need to be averaged to reduce errors, thus obtaining the final K value.

[0088] For example, such as Figure 12 As shown, screen pixel intervals A1, A2, A3, and A4 are selected, and the corresponding CCD pixel intervals are B1, B2, B3, and B4. At this time, A1 = 18, A2 = 32, A3 = 18, A4 = 20, B1 = 54, B2 = 90, B3 = 58, and B4 = 60. The scaling factors K1 = B1 / A1 = 54 / 18 = 3, K2 = B2 / A2 = 90 / 32 = 2.8, K3 = B3 / A3 = 58 / 18 = 3.2, and K4 = B4 / A4 = 60 / 20 = 3 are calculated respectively. Then, the average value of these four scaling factors is taken to obtain the final K value of K = 3.

[0089] After obtaining the scaling factor K, the captured image can be processed. The image processing process includes, but is not limited to, binarization, filtering, line detection, and calculation of the intersection point of the lines. Then, the binocular parallax value of the head-mounted display device can be calculated based on the scaling factor on the processed captured image.

[0090] For example, such as Figure 12 As shown, Figure 12 After processing, the CCD pixel B corresponding to the binocular parallax is 24. Based on the scaling factor K=3, the binocular parallax value of the head-mounted display device is 8 (24 / 3=8).

[0091] The screen center of the binocular module of the head-mounted display device displays a cross mark, wherein the light emitted by the first screen forms a first virtual image projected on the first telescope system through the left eye lens, the light emitted by the second screen forms a second virtual image projected on the second telescope system through the right eye lens, then the converging lens converges the binocular virtual image to form a converging virtual image, and the CCD receives and displays the converging virtual image, so that the binocular parallax of the head-mounted display device is calculated according to the cross mark of the converging virtual image displayed on the CCD combined with the proportion factor K. The binocular parallax testing device can measure the binocular parallax without moving the device in the testing process, and solves the problems of complex technology and low precision of the binocular parallax testing device of the head-mounted display device.

[0092] The division of units in the embodiments of the present application is illustrative, and is only a logical functional division. In actual implementation, another division manner can be used. In addition, each functional unit in each embodiment of the present application can be integrated in one processor, or can be physically separated, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware, or in the form of a software functional unit.

[0093] Although the preferred embodiments of the present application have been described, those skilled in the art can make further changes and modifications to the embodiments once they know the basic inventive concept. Therefore, the appended claims are intended to cover all changes and modifications falling within the scope of the present application.

[0094] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

1. A binocular parallax measurement apparatus, the apparatus for measuring binocular parallax of a head-mounted display device, characterized by, The device comprises a first telescope system, a second telescope system, a converging lens and an imaging sensor; The head-mounted display device comprises a left eye lens, a right eye lens, a first screen and a second screen, the first screen is located in front of the left eye lens, the second screen is located in front of the right eye lens, the left eye lens and the right eye lens are the same lens; the binocular parallax is the absolute value of the difference between the left module eccentricity and the right module eccentricity, the left module eccentricity is the deviation between the center of the first screen and the center of the left eye lens, and the right module eccentricity is the deviation between the center of the second screen and the center of the right eye lens; wherein the optical axis of the left eye lens coincides with the optical axis of the first telescope system, the left eye lens is located in front of the first telescope system, the optical axis of the right eye lens coincides with the optical axis of the second telescope system, the right eye lens is located in front of the second telescope system, and the optical axis of the left eye lens is parallel to the optical axis of the right eye lens; the light emitted by the first screen forms a first virtual image through the left eye lens and is projected on the first telescope system, and the light emitted by the second screen forms a second virtual image through the right eye lens and is projected on the second telescope system; The converging lens is located behind the first telescope system and the second telescope system, and in front of the imaging sensor; the center of the converging lens and the center of the imaging sensor are located on the optical axis of the converging lens, and the optical axis of the converging lens is parallel to the optical axis of the left eye lens; wherein the aperture of the converging lens is greater than the sum of the distance between the optical axis of the left eye lens and the optical axis of the right eye lens, half of the aperture of the first telescope system and half of the aperture of the second telescope system.

2. The apparatus of claim 1, wherein, The distance between the center of the left eye lens and the center of the first telescope system is equal to the distance between the center of the right eye lens and the center of the second telescope system.

3. The apparatus of claim 1, wherein, The distance between the first screen and the left eye lens is equal to the distance between the second screen and the right eye lens.

4. The apparatus of claim 1, wherein, The first telescope system and the second telescope system are the same telescope system, and the first telescope system is any one of a Kepler telescope system, a catadioptric telescope system, a reflective telescope system and a Galilean telescope system.

5. The apparatus of claim 1, wherein, The imaging sensor is located at one focal length of the converging lens.

6. A binocular parallax measurement method for measuring binocular parallax of a head-mounted display device, the method comprising: The method comprises: The first telescope system is used to obtain a first virtual image; the head-mounted display device comprises a first screen, and the first virtual image is a virtual image corresponding to the first screen; The second telescope system is used to obtain a second virtual image; the head-mounted display device further comprises a second screen, and the second virtual image is a virtual image corresponding to the second screen; the first virtual image is a virtual image formed by converging the first refracted light rays of the light emitted by the first screen through the left eye lens in reverse; and the second virtual image is a virtual image formed by converging the second refracted light rays of the light emitted by the second screen through the right eye lens in reverse. The converging lens is used to converge the first virtual image and the second virtual image to obtain a converging virtual image; the aperture of the converging lens is greater than the sum of the distance between the optical axes of the left and right lenses, half the aperture of the first telescope system, and half the aperture of the second telescope system. An imaging sensor is used to display the convergent virtual image; The binocular parallax of the head-mounted display device is calculated based on the display results of the imaging sensor; the binocular parallax is the absolute value of the difference between the eccentricity value of the left module and the eccentricity value of the right module, the eccentricity value of the left module is the deviation between the center of the first screen and the center of the left lens, and the eccentricity value of the right module is the deviation between the center of the second screen and the center of the right lens.

7. The method of claim 6, wherein, The display results of the imaging sensor include a marker associated with the first virtual image and a marker associated with the second virtual image; Calculating binocular parallax based on the display results of the imaging sensor includes: The binocular parallax of the head-mounted display device is calculated based on the markers associated with the first virtual image and the markers associated with the second virtual image.

8. The method of claim 7, wherein, The marker associated with the first virtual image is a cross mark, and the marker associated with the second virtual image is a cross mark.

Images