Head-mounted display device calibration method and system

Abstract

A head-mounted display device calibration method, relating to the technical field of virtual reality. The method comprises: controlling a photosensitive apparatus to collect an optical signal emitted by a head-mounted display device (1030) to be calibrated and guided by an optical assembly (1020) to obtain a first quantized representation value of luminous flux (110); controlling the optical assembly (1020) to rotate until the first quantized representation value satisfies a first set condition, to complete center calibration (120); controlling the optical assembly (1020) to rotate so as to track a second light source point displayed on a screen of said head-mounted display device (1030), to obtain a second quantized representation value of the luminous flux (130); and when it is determined by tracking that the second quantized representation value satisfies a second set condition, controlling the optical assembly (1020) to stop rotating (140). Also provided are a head-mounted display device calibration apparatus and system, a non-transitory computer-readable storage medium, and a computer program product.

Description

Head-mounted display device calibration methods and systems

[0001] Cross-reference to related applications

[0002] This application is based on and claims priority to Chinese Patent Application No. 2024105152112, filed on April 26, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of virtual reality technology, and more specifically, to a head-mounted display device calibration method and system. Background Technology

[0004] With the development of virtual extended reality technology, head-mounted displays (HMDs) are being used more and more widely in people's daily lives. In related technologies, the calibration of HMDs is primarily performed by the user wearing the device. This can cause discomfort to the wearer, affecting the user experience and the calibration results. Summary of the Invention

[0005] This application aims to address at least one of the technical problems existing in the prior art. To this end, this application proposes a head-mounted display device calibration method and system, which improves the user experience while also increasing calibration efficiency and the accuracy and precision of calibration results.

[0006] In a first aspect, this application provides a head-mounted display (HMD) device calibration method, applied to a HMD device calibration system. The HMD device calibration system includes a rotatable optical component and a photosensitive device. A HMD device to be calibrated is disposed within the HMD device calibration system, and the optical component is disposed between the HMD device to be calibrated and the photosensitive device. The method includes:

[0007] The photosensitive device is controlled to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain a first quantitative characterization value of the light flux;

[0008] The optical component is rotated until the first quantization value meets the first set condition, and the center calibration is completed; the center calibration is used to align the gaze point of the head-mounted display calibration system with the center of the screen of the head-mounted display to be calibrated.

[0009] The optical components are controlled to rotate in order to track a second light source point displayed on the screen of the head-mounted display device to be calibrated, thereby obtaining a second quantitative characterization value of the luminous flux;

[0010] If the second quantization value is found to meet the second set condition, the optical component is controlled to stop rotating.

[0011] According to the head-mounted display device calibration method of this application, by setting up a head-mounted display device calibration system to simulate the human eye, the optical components are controlled to rotate based on the change in the amount of light received before and after the head-mounted display device calibration system so as to take the position where the amount of light received is the largest as the calibration completion point. This not only improves the user experience, but also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0012] According to one embodiment of this application, controlling the rotation of the optical component includes:

[0013] The optical component is controlled to rotate, and the photosensitive device is controlled to re-acquire the light signal, updating the first quantization value of the light flux;

[0014] Based on the first quantized representation value of the luminous flux before the update and the first quantized representation value of the luminous flux after the update, a first target adjustment variable is determined; the first target adjustment variable includes adjustment angle and adjustment direction.

[0015] Based on the first target adjustment variable, the optical component is controlled to rotate, and the process returns to the step of controlling the photosensitive device to re-acquire the light signal and update the first quantization value of the light flux.

[0016] According to one embodiment of this application, determining the first target adjustment variable based on the first quantized representation value of the luminous flux before the update and the first quantized representation value of the luminous flux after the update includes:

[0017] If the first quantization value of the updated luminous flux is greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than a first threshold, the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction.

[0018] If the first quantization value of the updated luminous flux is not greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than a first threshold, the opposite direction of the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction.

[0019] If the difference between the first quantized representation value of the updated luminous flux and the first quantized representation value of the luminous flux before the update is less than a first threshold, the first target adjustment variable is determined to not exceed a fourth set threshold.

[0020] According to one embodiment of this application, controlling the optical component to stop rotating when the second quantization value is found to meet a second preset condition includes:

[0021] The optical component is controlled to stop rotating when the second light source point is tracked using a cross-sweep tracking method until the second quantization value of the luminous flux meets the second set condition.

[0022] According to one embodiment of this application, the step of tracking the second light source point using a cross-sweep tracking method until the second quantization value of the luminous flux satisfies the second set condition, and then controlling the optical component to stop rotating, includes:

[0023] The second quantized representation value of the luminous flux corresponding to each sub-region within the motion region is traversed, and the sub-region whose second quantized representation value of the luminous flux satisfies the second set condition is determined as the target sub-region.

[0024] Starting from the center point of the target sub-region, the gaze point is controlled to scan in a cross direction, and the region corresponding to the second quantization value of the light flux of each scanned region satisfies the second set condition is determined as the location of the second light source point.

[0025] Control the optical components to stop rotating.

[0026] According to one embodiment of this application, the step of controlling the gaze point to scan in a cross direction, starting from the center point of the target sub-region, and determining the region where the second quantized characterization value of the luminous flux corresponding to each scanned region satisfies the second set condition as the location of the second light source point includes:

[0027] Starting from the center point of the target sub-region, the photosensitive device is controlled to collect light signals to obtain a second quantitative characterization value of the light flux.

[0028] The optical components are rotated to control the gaze point to scan the target direction in the horizontal and vertical directions, and the photosensitive device is controlled to re-acquire light signals to update the second quantization value of the light flux.

[0029] Based on the second quantized characterization value of the luminous flux before and after the update, a second target adjustment variable is determined; the second target adjustment variable includes the adjustment angle and the adjustment direction.

[0030] Based on the second target adjustment variable, the optical component is controlled to rotate until the second quantization value of the luminous flux meets the second set condition. Then, the gaze point is controlled to scan in a direction other than the target direction in the horizontal and vertical directions until the second quantization value of the luminous flux obtained in the other direction meets the second set condition. At this time, the area corresponding to this time is determined to be the location of the second light source point.

[0031] According to one embodiment of this application, before controlling the photosensitive device to acquire the light signal emitted by the head-mounted display device to be calibrated and guided by the optical component to obtain a first quantitative characterization value of the luminous flux, the method further includes:

[0032] The photosensitive device is controlled to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain a third quantitative characterization value of the light flux;

[0033] Based on the category of the head-mounted display device to be calibrated, the target component is rotated until the third quantization value of the light flux meets the third set condition, and then the IPD adjustment is completed.

[0034] According to one embodiment of this application,

[0035] When the category is adjustable IPD of the head-mounted display, the simulated IPD corresponding to the head-mounted display calibration system is determined to be the average value of the human eye, and the head-mounted display IPD is determined to be the target component;

[0036] In the case where the category is head-mounted display IPD is not adjustable, the IPD motor shaft corresponding to the head-mounted display device calibration system is identified as the target component.

[0037] Secondly, this application provides a head-mounted display (HMD) device calibration apparatus for use in a HMD device calibration system. The HMD device calibration system includes a rotatable optical component and a photosensitive device. A HMD device to be calibrated is disposed within the HMD device calibration system, and the optical component is disposed between the HMD device to be calibrated and the photosensitive device. The apparatus includes:

[0038] The control module is configured to obtain a first quantized value of luminous flux based on the light signal emitted by the head-mounted display device to be calibrated and guided by the optical component, which is acquired by the photosensitive device; and to control the rotation of the optical component based on the first quantized value until center calibration is completed; and

[0039] The optical component is controlled to rotate in order to track a second light source point displayed on the screen of the head-mounted display device to be calibrated, thereby obtaining a second quantized characterization value of the luminous flux. When the second quantized characterization value of the luminous flux is found to meet a second set condition, the optical component is controlled to stop rotating.

[0040] According to the head-mounted display device calibration device of this application, by setting up a head-mounted display device calibration system for simulating the human eye, the optical components are controlled to rotate based on the change in the amount of light entering the head-mounted display device before and after the calibration system, so that the position where the amount of light entering is the largest is taken as the calibration completion point. This not only improves the user experience, but also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0041] Thirdly, this application provides a head-mounted display device calibration system, comprising:

[0042] A rotatable optical component that receives light signals emitted by the head-mounted display device to be calibrated and transmits the light signals backward;

[0043] A photosensitive device disposed at the rear end of the optical component, the photosensitive device being used to generate a quantized characterization value of the luminous flux of the optical signal guided and transmitted by the optical component; and

[0044] A control device is connected to the optical component and the photosensitive device respectively. The control device controls the rotation of the optical component based on the quantized characterization value of the light flux transmitted by the photosensitive device, so as to calibrate the head-mounted display device to be calibrated.

[0045] Fourthly, this application provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the head-mounted display device calibration method as described in the first aspect above.

[0046] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the head-mounted display device calibration method as described in the first aspect above.

[0047] The above-described one or more technical solutions in the embodiments of this application have at least one of the following technical effects:

[0048] By setting up a head-mounted display calibration system to simulate the human eye, the optical components are rotated based on the change in the amount of light received before and after the calibration system is set up so that the position with the maximum amount of light received is taken as the calibration completion point. This not only improves the user experience, but also improves calibration efficiency and the accuracy and precision of the calibration results.

[0049] Furthermore, by using a gradient descent method to determine the first target adjustment variable for the next adjustment based on the change in luminous flux before and after the rotation, the first target adjustment variable can change accordingly based on the change in luminous flux before and after the adjustment, which has high adjustment efficiency and high adjustment precision and accuracy.

[0050] Furthermore, eye-tracking calibration using the cross-scan tracking method offers high calibration accuracy and precision, and is simple and easy to implement.

[0051] Furthermore, by performing IPD calibration before eye-tracking calibration, targeted calibration can be performed on different head-mounted displays to be calibrated. Eye-tracking calibration is then performed based on IPD calibration, further improving the accuracy and precision of eye-tracking calibration.

[0052] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0053] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which:

[0054] Figure 1 is one of the flowcharts illustrating the head-mounted display device calibration method provided in this application embodiment;

[0055] Figure 2 is a second schematic flowchart of the head-mounted display device calibration method provided in the embodiments of this application;

[0056] Figure 3 is a third schematic flowchart of the head-mounted display device calibration method provided in the embodiments of this application;

[0057] Figure 4 is a fourth schematic flowchart of the head-mounted display device calibration method provided in the embodiments of this application;

[0058] Figure 5 is a fifth schematic flowchart of the head-mounted display device calibration method provided in the embodiments of this application;

[0059] Figure 6 is a schematic flowchart of the head-mounted display device calibration method provided in the embodiments of this application;

[0060] Figure 7 is the seventh flowchart illustrating the head-mounted display device calibration method provided in this application embodiment;

[0061] Figure 8 is one of the structural schematic diagrams of the head-mounted display device calibration system provided in the embodiments of this application;

[0062] Figure 9 is a second schematic diagram of the head-mounted display device calibration system provided in the embodiments of this application. Detailed Implementation

[0063] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0064] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0065] The following description, in conjunction with the accompanying drawings, details the head-mounted display device calibration method, head-mounted display device calibration device, head-mounted display device calibration system, and readable storage medium provided in this application through specific embodiments and application scenarios.

[0066] The head-mounted display device calibration method can be applied to the terminal, and can be executed by the hardware or software in the terminal.

[0067] The terminal includes, but is not limited to, portable communication devices such as mobile phones or tablets. It should also be understood that, in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer.

[0068] The head-mounted display device calibration method provided in this application embodiment can be executed by a head-mounted display device calibration system or a functional module or entity within the head-mounted display device calibration system that can implement the head-mounted display device calibration method. The following description uses a head-mounted display device calibration system as the executing entity to illustrate the head-mounted display device calibration method provided in this application embodiment.

[0069] As shown in Figure 1, the head-mounted display device calibration method includes steps 110, 120, 130, and 140.

[0070] This head-mounted display (HMD) calibration method is applied to a HMD calibration system, which includes a photosensitive device and a rotatable optical component. The HMD to be calibrated is placed within the calibration system, and the optical component is positioned between the HMD and the photosensitive device. The HMD can be an XR or similar head-mounted display.

[0071] By cooperating with the optical components and the photosensitive device, light energy from the head-mounted display can be transmitted to the photosensitive device through the optical components with as little loss as possible, so as to facilitate subsequent rotation control. Of course, the photosensitive device can be fixed relative to the optical components, or it can be made to rotate synchronously with the optical components in order to maximize the lossless transmission of light information. That is, in some embodiments, the photosensitive device can move in response to the movement of the optical components.

[0072] Step 110: Control the photosensitive device to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain the first quantitative characterization value of the light flux.

[0073] In this step, optical components and photosensitive devices are used to simulate a human eye. The optical components may include a simulated eyeball through which light from the head-mounted display under test can pass and be transmitted.

[0074] The light signal emitted by the head-mounted optical display is imaged by optical components and then collected by a photosensitive device to obtain the first quantitative characterization value of the light flux.

[0075] Among them, the first quantitative characterization value of luminous flux is used to measure the amount of light entering the optical component.

[0076] The photosensitive device can be an image sensor, camera, or photoelectric sensor, etc. In the actual execution process, as shown in Figure 2, after the image sensor set behind the optical component completes the exposure and focus parameter settings, it captures the light signal emitted by the head-mounted display device to be calibrated and imaged by the optical component, obtains the first quantitative characterization value of the light flux, and transmits the first quantitative characterization value of the light flux to the host computer for subsequent image processing.

[0077] It is understandable that different photosensitive devices may have different quantitative representations of luminous flux.

[0078] For example, for an image sensor, the brightness of the image acquired by the image sensor can be used as a standard to measure luminous flux, that is, the first quantization value is determined as the average brightness of the region in the image.

[0079] For example, for photoelectric sensors, the electrical signal they generate can be used as a standard for measuring luminous flux, that is, the first quantization value is determined as the magnitude of the electrical signal.

[0080] Of course, in other embodiments, the first quantification value may also take other forms, which will not be elaborated here.

[0081] Step 120: Control the optical components to rotate until the first quantization value meets the first set condition, and complete the center calibration; the center calibration is used to align the gaze point of the head-mounted display calibration system with the center of the screen of the head-mounted display to be calibrated.

[0082] In this step, the gaze point is the intersection of the line of sight of the optical components and the screen of the head-mounted display device to be calibrated, that is, the intersection of the line connecting the center of the simulated eyeball and the simulated pupil with the screen.

[0083] The first setting condition can be that the first quantitative representation value of the luminous flux reaches a large or maximum value.

[0084] The first set of conditions can be based on user-defined criteria.

[0085] If the first quantitative characterization value of the luminous flux meets the first set condition, it is considered that the amount of light entering the optical component in the current pose is relatively large, and can be approximately considered to have reached the maximum value.

[0086] For example, continuing to refer to Figure 2, taking the image brightness as the first quantization representation of luminous flux, after the host computer receives the image, it automatically delineates the region of interest (ROI) to be analyzed, i.e., the part containing the complete focal point. The image is then converted to grayscale, and the average brightness within the ROI is used as the first quantization representation of the currently received luminous flux. The ROI is the area where the first light source is most likely to be projected, determined based on the range of human eye movement.

[0087] It should be noted that the light signals guided by the optical components may differ at different angles, and the first quantitative representation of the luminous flux may also change accordingly.

[0088] In this step, each time the optical component is rotated, the first quantitative characterization value of the luminous flux corresponding to the guided light signal at the current rotation angle should be collected.

[0089] By comparing the first quantized value of the light flux collected after each rotation, when it is determined that the first quantized value of the light flux reaches its maximum after a certain rotation, it can be considered that the optical component is aligned with the center of the screen of the head-mounted display device to be calibrated. Thus, the head-mounted display device calibration system and the head-mounted display device to be calibrated are centered based on the angle corresponding to the current optical component.

[0090] The specific implementation method of center calibration will be explained below with reference to Figure 4.

[0091] In some embodiments, controlling the rotation of the optical component may include:

[0092] Control the rotation of the optical components and control the photosensitive device to re-acquire the light signal, updating the first quantitative characterization value of the light flux;

[0093] Based on the first quantized characterization value of luminous flux before and after the update, a first target adjustment variable is determined; the first target adjustment variable includes adjustment angle and adjustment direction.

[0094] The optical component is rotated based on the first target adjustment variable, and the process returns to control the photosensitive device to re-acquire the light signal and update the first quantitative characterization value of the luminous flux.

[0095] In this embodiment, the first target adjustment variable is a vector, which may include adjustment angle and adjustment direction. The first target adjustment variable can be a changing quantity, that is, during the process of controlling the rotation of the optical component, the adjustment angle and adjustment direction of each rotation may be the same or different from the previous one.

[0096] The first target adjustment variable can be determined based on the relationship between the magnitude of the luminous flux sensed by the photosensitive device before and after rotation (i.e., the first quantitative representation of the luminous flux).

[0097] Understandably, taking image brightness as an example, for the first rotation, the first quantization value of the luminous flux before the update is the image brightness sensed before the first rotation, and the first quantization value of the luminous flux after the update is the image brightness sensed after the first rotation. After the second rotation, the brightness sensed after the first rotation becomes the brightness sensed before the second rotation. That is, the first quantization value of the luminous flux before the update is updated to the image brightness sensed after the first rotation, and the first quantization value of the luminous flux after the update is updated to the image brightness sensed after the second rotation, and so on, until the photosensitive device senses the maximum image brightness, then the rotation stops, and the center calibration is completed based on the current pose of the optical components.

[0098] In some embodiments, during the initial rotation, the first target adjustment variable can be set to an initial value, and the adjustment direction corresponding to the initial value can be any direction.

[0099] In some embodiments, determining a first target adjustment variable based on the first quantized representation value of the luminous flux before the update and the first quantized representation value of the luminous flux after the update may include:

[0100] If the first quantization value of the updated luminous flux is greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than the first threshold, the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction.

[0101] If the first quantization value of the updated luminous flux is not greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than the first threshold, the opposite direction of the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction.

[0102] When the degree of difference between the first quantization representation value of the updated luminous flux and the first quantization representation value of the luminous flux before update is less than the first threshold, it is determined that the first target adjustment variable does not exceed the fourth set threshold.

[0103] In this embodiment, the degree of difference can be expressed as the absolute value of the difference or the absolute value of the ratio, etc. The first threshold is a small positive value, which can be specifically based on user definition. The fourth set threshold is a small number. In some embodiments, the fourth set threshold can be set to 0.

[0104] When the degree of difference between the first quantization representation value of the updated luminous flux and the first quantization representation value of the luminous flux before update is less than the first threshold, it can be approximately considered that the first quantization representation value of the luminous flux before update is the same as the first quantization representation value of the updated luminous flux. When the first quantization representation values of the luminous flux collected before and after rotation are the same, it can be considered that convergence is achieved, that is, the luminous flux reaches a larger value.

[0105] Continuing with the above embodiment as an example, as shown in Figure 4, first calculate the first quantization representation value A1 of the initially collected luminous flux (i.e., the first quantization representation value of the luminous flux before update), control the rotation of the optical component based on the initial value to calculate the first quantization representation value A2 of the luminous flux obtained after rotation (i.e., the first quantization representation value of the updated luminous flux), and compare the magnitudes of A1 and A2.

[0106] Taking the first threshold as 0 as an example.

[0107] If A2 > A1, it is determined that the rotation direction included in the first target adjustment variable is the corresponding direction, that is, control the optical component to continue moving in the direction.

[0108] If A2 < A1, it is determined that the rotation direction included in the first target adjustment variable is the direction opposite to the corresponding direction, that is, control the optical component to move in the opposite direction of the direction.

[0109] Until A2 = A1, it is considered that convergence is achieved in this direction.

[0110] In some embodiments, the adjustment angle can be determined by an optimization algorithm until convergence is achieved in this direction. Among them, the optimization algorithm can include the gradient descent algorithm.

[0111] For example, record the light incident amount (i.e., the first quantization representation value of the luminous flux) A1 after the optical component mechanically returns to zero, and set an initial value (this initial value includes an initial adjustment angle x°); after controlling the rotation of the optical component, record the light incident amount after rotation (i.e., the first quantization representation value of the luminous flux) A2.

[0112] Then, based on the relationship between the amount of light entering the camera before and after rotation and the reference amount of light entering the camera, the adjustment angle corresponding to the next adjustment is determined. In some embodiments, taking an image as an example, the reference amount of light entering the camera can be the average brightness within the area.

[0113] For example, as shown in Figure 7, the ratio of the difference in light intensity before and after rotation to the reference light intensity can be used as the adjustment angle for the next adjustment. This allows the adjustment angle to change accordingly based on the change in light intensity before and after adjustment, until convergence is achieved, thus completing the center calibration.

[0114] Referring again to Figure 7, in some embodiments, an adjustment count threshold can be set. When the adjustment count reaches the threshold, the center calibration ends. Then, the rotation direction is adjusted (that is, the direction is adjusted to a direction different from both the initial value and its opposite direction, and the new direction is used as the initial value for the next round of adjustment), and the above steps are repeated until the maximum amount of light is sensed.

[0115] In some embodiments, the first threshold can also be set to 1% of A2, as shown in Figure 4, for center calibration.

[0116] According to the head-mounted display device calibration method provided in the embodiments of this application, the first target adjustment variable corresponding to the next adjustment is determined based on the change in the amount of light before and after rotation using a gradient descent method. This allows the first target adjustment variable to change accordingly based on the change in the amount of light before and after adjustment, resulting in high adjustment efficiency and high adjustment precision and accuracy.

[0117] Step 130: Control the optical components to rotate in order to track the second light source point displayed on the screen of the head-mounted display device to be calibrated, and obtain the second quantitative characterization value of the luminous flux;

[0118] In this step, after completing the central calibration, you can proceed to the eye-tracking calibration stage.

[0119] The second light source is the point to be tracked.

[0120] The second light source can be randomly displayed at any position on the screen.

[0121] The second quantitative characterization value of luminous flux is used to measure the amount of light entering the optical component. Its form of expression can be the same as that of the first quantitative characterization value, which will not be described in detail here.

[0122] In actual execution, the optical components are rotated to track the point to be tracked displayed on the screen. It is understandable that, with the position of the second light source point on the screen remaining unchanged, the amount of light sensed by the photosensitive device will vary depending on the position of the optical components aligned with different positions on the screen. Furthermore, the closer the gaze point of the optical components is to the location of the second light source point, the greater the amount of light sensed by the photosensitive device.

[0123] Step 140: When the second quantization value is found to meet the second set condition, control the optical component to stop rotating.

[0124] In this step, the second setting condition can be that the second quantization value of the luminous flux in a certain region reaches a large or maximum value.

[0125] When the second quantitative representation value of the luminous flux of the currently scanned area sensed by the photosensitive device meets the second set condition, it can be approximately assumed that the gaze point of the optical component has coincided with the second light source point, thereby controlling the optical component to stop rotating and completing eye movement calibration.

[0126] Then, another second light source point is randomly displayed on the screen to repeat steps 130 to 140 until eye-tracking calibration of all points to be tracked is completed.

[0127] The specific implementation method of eye-tracking calibration is explained below.

[0128] In some embodiments, controlling the optical component to stop rotating when the second quantization value is found to meet a second set condition may include:

[0129] The optical components are controlled to stop rotating when the second light source point is tracked by a cross-sweep tracking method until the second quantization value of the luminous flux meets the second set condition.

[0130] In this embodiment, if the second quantitative characterization value of the light flux meets the second set condition, it is considered that the light intake of the optical component in the current pose is large, and can be approximately considered to have reached the maximum value.

[0131] For example, using the row where the center point of the screen is located as the reference row, find the point in that row where the second quantization value of luminous flux reaches its maximum, and then using the column where that point is located as the reference, find the point in that column where the second quantization value of luminous flux reaches its maximum, thereby achieving eye-tracking calibration.

[0132] Of course, in other embodiments, a row may be randomly selected as the base row, and this application does not limit this.

[0133] In some embodiments, tracking the second light source point using a cross-sweep tracking method until the second quantized representation value of the luminous flux meets a second preset condition, and then controlling the optical component to stop rotating, may include:

[0134] The second quantized representation value of luminous flux corresponding to each sub-region within the motion area is traversed, and the sub-region whose second quantized representation value of luminous flux satisfies the second set condition is determined as the target sub-region.

[0135] Starting from the center point of the target sub-region, the gaze point is controlled to scan in a cross direction, and the region corresponding to the second quantization value of the light flux of each scanned region satisfies the second set condition is determined as the location of the second light source point.

[0136] Control the optical components to stop rotating.

[0137] In this embodiment, the motion area is the field of view that the optical component can cover during its rotation.

[0138] The motion area can be pre-divided into multiple sub-regions, such as 4 or 9 regions. The target sub-region is the sub-region where the second light source point is located.

[0139] First, the second quantization value of the luminous flux in each sub-region is compared to determine the sub-region where the second light source point is located, thus narrowing the tracking range. Then, within the target sub-region, the cross-scan tracking method is further used to track the region where the second quantization value of the luminous flux meets the second set condition, thus completing the eye-tracking calibration.

[0140] In some embodiments, starting from the center point of the target sub-region, the gaze point is controlled to scan in a cross direction, and the region corresponding to the second quantization value of the luminous flux of each scanned region satisfies the second set condition is determined as the location of the second light source point, which may include:

[0141] Starting from the center point of the target sub-region, the photosensitive device is controlled to collect light signals to obtain the second quantitative characterization value of the light flux;

[0142] The optical components are rotated to control the gaze point to scan the target direction in the horizontal and vertical directions, and the photosensitive device is controlled to re-acquire the light signal and update the second quantitative characterization value of the light flux.

[0143] Based on the second quantized characterization value of the luminous flux before and after the update, the second target adjustment variable is determined; the second target adjustment variable includes the adjustment angle and the adjustment direction.

[0144] Based on the second target adjustment variable, the optical component is controlled to rotate until the second quantitative characterization value of the light flux meets the second set condition. Then, the gaze point is controlled to scan in the horizontal and vertical directions other than the target direction until the second quantitative characterization value of the light flux obtained in the other direction meets the second set condition. At this time, the area corresponding to this time is determined to be the location of the second light source point.

[0145] In this embodiment, the target direction can be either the horizontal or the vertical direction.

[0146] Using the target direction as the line direction, and taking 9 sub-regions as an example, we will explain.

[0147] In actual execution, after center alignment is completed, eye-tracking calibration is performed. The point to be tracked (i.e., the second light source point) will randomly appear on the screen. At this time, the motion area is divided into nine regions, as shown in Figure 5. The center of each region is traversed. When the optical component is looking at the center of the sub-region where the point to be tracked is located, the second quantization value of the detectable light flux reaches the maximum. Then, the sub-region is determined as the partition position of the point to be tracked (i.e., the target sub-region). After the target sub-region is determined, cross-scan tracking is performed within the target sub-region.

[0148] For example, starting from the center point of the target sub-region, the gaze point is controlled to scan along the horizontal direction to find the position where the second quantization value of luminous flux reaches its maximum. Then, using this position as a reference, the scan is performed along the vertical direction to obtain the position where the second quantization value of luminous flux reaches its maximum, thereby determining the point to be tracked.

[0149] In some embodiments, after scanning along the vertical direction and determining the position where the second quantization value of the luminous flux reaches its maximum, the target range can be traversed with that position as the center to further find the point where the second quantization value of the luminous flux reaches its maximum within the target range, and this point can be determined as the final tracking point, as shown in Figure 6.

[0150] In some embodiments, the target area may be a circular region with a diameter of 1 mm or 0.5 mm, etc., which is not limited in this application.

[0151] In the cross-search method, the process of finding the second quantitative representation value of luminous flux in the horizontal and vertical directions that meets the second set condition is the same as the center calibration process. The specific execution logic is shown in Figure 7, which will not be elaborated here.

[0152] Once aligned with the point to be calibrated, the point will begin to flash. This is reflected in the brightness value, indicating that the calibration of that point is complete, and the calibration of the next point can begin.

[0153] The calibration process for each point follows the same principle, and so on, until eye-tracking calibration for all points is completed.

[0154] The head-mounted display device calibration method provided in the embodiments of this application uses the cross-scan tracking method for eye-tracking calibration, which has high calibration accuracy and precision, and is simple and easy to implement.

[0155] During the research and development process, the inventors discovered that in related technologies, eye-tracking calibration is mainly performed manually by wearing the head-mounted display device to be calibrated. This process can cause discomfort to the wearer and affect the user experience. Furthermore, the calibration process is greatly influenced by the wearer's subjectivity, which affects the accuracy and precision of the calibration results.

[0156] In this application, a head-mounted display calibration system is set up to simulate the human eye. During the calibration process, the head-mounted display to be calibrated is worn by the calibration system. The optical components in the calibration system are rotated in the corresponding direction and angle according to the change in the amount of light entering the head-mounted display before and after the calibration system. This process is repeated until the amount of light entering the head-mounted display reaches a first set threshold. The position with the maximum amount of light entering the head-mounted display is taken as the calibration completion point, thereby realizing eye-tracking calibration. It does not require manual wearing and is simple and easy to operate. While improving the user experience, it also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0157] According to the head-mounted display device calibration method provided in the embodiments of this application, by setting up a head-mounted display device calibration system for simulating the human eye, the optical components are controlled to rotate based on the change in the amount of light received before and after the head-mounted display device calibration system, so that the position where the amount of light received is larger is taken as the calibration completion point. This not only improves the user experience, but also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0158] As shown in Figure 3, in some embodiments, before step 110, the method may further include:

[0159] The photosensitive device is controlled to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain the third quantitative characterization value of the light flux;

[0160] Based on the category of the head-mounted display device to be calibrated, the target component is rotated until the third quantization value of the light flux meets the third set condition, and then the IPD adjustment is completed.

[0161] In this embodiment, IPD (Inter-Pupillary Distance) calibration refers to interpupillary distance calibration. The target component is the component used to adjust IPD.

[0162] It should be noted that the target components used to adjust IPD may differ for different head-mounted displays to be calibrated. The third quantization value of luminous flux is used to measure the amount of light entering the optical components, and its representation can be similar to that of the first quantization value of luminous flux.

[0163] The third setting condition can be that the first quantitative representation value of the luminous flux reaches a large or maximum value.

[0164] The IPD calibration processing logic is similar to the central calibration processing logic.

[0165] For example, continuing to refer to Figure 3, in the actual execution process, when the target component is in the initial pose, the photosensitive device is controlled to sense the amount of light entering the light signal after being guided by the optical component, and the amount of light entering is obtained as A1; then, the target component is controlled to rotate based on the third target adjustment variable, and then the photosensitive device is controlled to sense the amount of light entering the light signal after being guided by the optical component, and the amount of light entering is obtained as A2. The magnitudes of A1 and A2 are compared to update the third target adjustment variable to control the target component to rotate again, until the amount of light entering meets the third set condition, and then the IPD is calibrated based on the pose of the target component at this time.

[0166] After completing the IPD calibration, you can proceed to the central calibration stage. During the calibration process, each eye can be calibrated separately to complete the binocular calibration.

[0167] According to the head-mounted display device calibration method provided in the embodiments of this application, by performing IPD calibration before eye-tracking calibration, targeted calibration can be performed for different head-mounted display devices to be calibrated. By performing eye-tracking calibration on the basis of IPD calibration, the accuracy and precision of eye-tracking calibration are further improved.

[0168] In some embodiments, when the head-mounted display IPD is adjustable, the simulated IPD corresponding to the head-mounted display calibration system is determined to be the average value of the human eye, and the head-mounted display IPD is determined to be the target component; when the head-mounted display IPD is not adjustable, the IPD motor shaft corresponding to the head-mounted display calibration system is determined to be the target component.

[0169] In this embodiment, the simulated IPD is the human eye simulation device IPD, i.e., the optical component IPD.

[0170] The IPD of the head-mounted display is the IPD of the head-mounted display device to be calibrated. It is understood that the IPD of some head-mounted displays to be calibrated is adjustable, while the IPD of some head-mounted displays to be calibrated is fixed and cannot be adjusted.

[0171] For head-mounted displays with adjustable IPD, the optical component IPD can be fixed to the average value of human eye during the design of optical components. During the calibration process, the head-mounted display IPD is manually adjusted while observing the third quantitative characterization value of the light flux obtained by the host computer. The IPD is then adjusted until the measured third quantitative characterization value of the light flux meets the third set condition.

[0172] For cases where the head-mounted display's IPD is not adjustable, the motor shaft of the human eye simulation device's IPD can be controlled. Combined with the third quantization value of luminous flux, the device's IPD can be automatically adjusted during the calibration process until the third quantization value of luminous flux meets the third set condition.

[0173] The head-mounted display device calibration method provided in the embodiments of this application selects the corresponding adjustment method based on the type of head-mounted display IPD during IPD calibration, which is applicable to various types of head-mounted display devices to be calibrated and has high universality and flexibility.

[0174] The head-mounted display (HMD) calibration method provided in this application can be executed by a HMD calibration device. This application uses an HMD calibration device executing the calibration method as an example to illustrate the HMD calibration device provided in this application.

[0175] This application also provides a head-mounted display (HMD) device calibration apparatus. This HMD device calibration apparatus is applied to a HMD device calibration system, which includes a rotatable optical component and a photosensitive device. The HMD device to be calibrated is disposed within the HMD device calibration system, and the optical component is disposed between the HMD device to be calibrated and the photosensitive device.

[0176] The head-mounted display calibration device includes: a control module.

[0177] The control module is used to obtain a first quantized characterization value of the luminous flux based on the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components, which is collected by the photosensitive device; and to control the rotation of the optical components based on the first quantized characterization value until the center calibration is completed; and

[0178] The optical component is controlled to rotate in order to track the second light source point displayed on the screen of the head-mounted display device to be calibrated, thereby obtaining a second quantitative characterization value of the luminous flux. When the second quantitative characterization value of the tracked luminous flux meets a second set condition, the optical component is controlled to stop rotating.

[0179] According to the head-mounted display device calibration device provided in the embodiments of this application, by setting up a head-mounted display device calibration system for simulating the human eye, the optical components are controlled to rotate based on the change in the amount of light entering the head-mounted display device before and after the calibration system, so that the position where the amount of light entering is the largest is taken as the calibration completion point. This not only improves the user experience, but also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0180] In some embodiments, the control module can also be used for:

[0181] Control the rotation of the optical components and control the photosensitive device to re-acquire the light signal, updating the first quantitative characterization value of the light flux;

[0182] Based on the first quantized characterization value of luminous flux before and after the update, a first target adjustment variable is determined; the first target adjustment variable includes adjustment angle and adjustment direction.

[0183] The optical component is rotated based on the first target adjustment variable, and the process returns to control the photosensitive device to re-acquire the light signal and update the first quantitative characterization value of the luminous flux.

[0184] In some embodiments, the control module can also be used for:

[0185] If the first quantization value of the updated luminous flux is greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than the first threshold, the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction.

[0186] If the first quantization value of the updated luminous flux is not greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than the first threshold, the opposite direction of the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction.

[0187] If the difference between the updated first quantized value of luminous flux and the original first quantized value of luminous flux is less than the first threshold, the first target adjustment variable is determined to not exceed the fourth set threshold.

[0188] In some embodiments, the control module can also be used for:

[0189] The optical components are controlled to stop rotating when the second light source point is tracked by a cross-sweep tracking method until the second quantization value of the luminous flux meets the second set condition.

[0190] In some embodiments, the control module can also be used for:

[0191] The second quantized representation value of luminous flux corresponding to each sub-region within the motion area is traversed, and the sub-region whose second quantized representation value of luminous flux satisfies the second set condition is determined as the target sub-region.

[0192] Starting from the center point of the target sub-region, the gaze point is controlled to scan in a cross direction, and the region corresponding to the second quantization value of the light flux of each scanned region satisfies the second set condition is determined as the location of the second light source point.

[0193] Control the optical components to stop rotating.

[0194] In some embodiments, the control module can also be used for:

[0195] Starting from the center point of the target sub-region, the photosensitive device is controlled to collect light signals to obtain the second quantitative characterization value of the light flux;

[0196] The optical components are rotated to control the gaze point to scan the target direction in the horizontal and vertical directions, and the photosensitive device is controlled to re-acquire the light signal and update the second quantitative characterization value of the light flux.

[0197] Based on the second quantized characterization value of the luminous flux before and after the update, the second target adjustment variable is determined; the second target adjustment variable includes the adjustment angle and the adjustment direction.

[0198] Based on the second target adjustment variable, the optical component is controlled to rotate until the second quantitative characterization value of the light flux meets the second set condition. Then, the gaze point is controlled to scan in the horizontal and vertical directions other than the target direction until the second quantitative characterization value of the light flux obtained in the other direction meets the second set condition. At this time, the area corresponding to this time is determined to be the location of the second light source point.

[0199] In some embodiments, the control module can also be used for:

[0200] Before the control photosensitive device collects the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain the first quantitative characterization value of the light flux, the control photosensitive device collects the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain the third quantitative characterization value of the light flux.

[0201] Based on the category of the head-mounted display device to be calibrated, the target component is rotated until the third quantization value of the light flux meets the third set condition, and then the IPD adjustment is completed.

[0202] In some embodiments, the control module can also be used for...

[0203] When the category is adjustable IPD of head-mounted display, the simulated IPD corresponding to the head-mounted display calibration system is determined to be the average value of human eye, and the head-mounted display IPD is determined to be the target component;

[0204] When the head-mounted display IPD is not adjustable, the IPD motor shaft corresponding to the head-mounted display calibration system is identified as the target component.

[0205] The head-mounted display (HMD) calibration device in this application embodiment can be a HMD calibration system or a component within the HMD calibration system, such as an integrated circuit or chip. The HMD calibration system can be a terminal or other devices besides a terminal. For example, the HMD calibration system can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle HMD calibration system, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the specific device.

[0206] The head-mounted display device calibration device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit it.

[0207] The head-mounted display device calibration apparatus provided in this application embodiment can realize the various processes implemented in the method embodiments of Figures 1 to 7. To avoid repetition, it will not be described again here.

[0208] This application also provides a head-mounted display device calibration system based on the head-mounted display device calibration method described in any of the above embodiments.

[0209] As shown in Figure 8, the head-mounted display calibration system includes: a rotatable optical component 1020, a photosensitive device, and a control device.

[0210] In this embodiment, the rotatable optical component 1020 is used to receive the light signal emitted by the head-mounted display device 1030 to be calibrated and transmit the light signal backward.

[0211] The head-mounted display device 1030 to be calibrated includes a head-mounted display optical engine.

[0212] The head-mounted optical system is used to provide the light source information needed for alignment.

[0213] The photosensitive device is located at the rear end of the optical components.

[0214] The photosensitive device is used to generate a quantitative characterization value of the luminous flux of the light signal transmitted by the rotatable optical component 1020.

[0215] The photosensitive device can be a camera or a photoelectric sensor. When the photosensitive device is a camera, the quantified value of the corresponding luminous flux is the image brightness; when the photosensitive device is a photoelectric sensor, the quantified value of the corresponding luminous flux is an electrical signal. Of course, the photosensitive device can also be other quantifiable indicators that can convert light signals for acquisition and analysis, which will not be elaborated upon here.

[0216] The photosensitive device can be fixed relative to the optical components.

[0217] In some embodiments, the photosensitive device may be connected to an optical component so that the photosensitive device rotates synchronously with the optical component, thereby maximizing lossless transmission of optical signals.

[0218] The control device is connected to the rotatable optical component 1020 and the photosensitive device respectively. The control device controls the rotation of the rotatable optical component 1020 based on the quantized characterization value of the light flux transmitted by the photosensitive device, so as to calibrate the head-mounted display device to be calibrated.

[0219] The control device can perform the head-mounted display device calibration method as described in any of the above embodiments.

[0220] In some embodiments, the rotatable optical component 1020 includes a simulated eyeball through which light from the head-mounted display device to be calibrated is passed and guided, and a simulated pupil is provided on the simulated eyeball. Of course, in order to better achieve lossless transmission of light information, the rotatable optical component may also include components such as lenses located at the rear end of the simulated eyeball to collect and focus light information, which will not be described in detail here.

[0221] In some embodiments, the system may further include a support device 1010.

[0222] The support device 1010 has a notch, which is used to support the head-mounted display device 1030 to be calibrated, and the head-mounted display device 1030 to be calibrated is directly facing the notch.

[0223] The rotatable optical component 1020 is rotatably disposed in the notch.

[0224] The photosensitive device is located at the rear end of the rotatable optical component 1020 and is used to receive the light signal transmitted from the rotatable optical component 1020 and generate a quantitative representation value of the light flux.

[0225] The number of spherical notches, rotatable optical components 1020 and photosensitive devices can each be two, with two spherical notches, two rotatable optical components 1020 and two photosensitive devices arranged in a one-to-one correspondence.

[0226] Figure 9 illustrates a side view of a head-mounted display device calibration system.

[0227] According to the head-mounted display device calibration system provided in the embodiments of this application, by setting up a head-mounted display device calibration system for simulating the human eye, the rotatable optical component 1020 is controlled to rotate based on the change in the amount of light received before and after the head-mounted display device calibration system, so that the position where the amount of light received is the largest is taken as the calibration completion point. While improving the user experience, it also improves the calibration efficiency and the accuracy and precision of the calibration results.

[0228] This application also provides a non-transitory computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the various processes of the above-described head-mounted display device calibration method embodiments and achieves the same technical effect. To avoid repetition, it will not be described again here.

[0229] The processor is the processor in the head-mounted display device calibration system described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0230] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described head-mounted display device calibration method.

[0231] The processor is the processor in the head-mounted display device calibration system described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0232] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described head-mounted display device calibration method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0233] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0234] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0235] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0236] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

[0237] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0238] Although embodiments of this application have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of this application, the scope of which is defined by the claims and their equivalents.

Claims

1. A method for calibrating a head-mounted display device, characterized in that, A head-mounted display (HMD) device calibration system is used, the HMD device calibration system including a rotatable optical component and a photosensitive device, the HMD device to be calibrated is disposed in the HMD device calibration system, and the optical component is disposed between the HMD device to be calibrated and the photosensitive device; the method includes: The photosensitive device is controlled to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain a first quantitative characterization value of the light flux; The optical component is rotated until the first quantization value meets the first set condition, and the center calibration is completed; the center calibration is used to align the gaze point of the head-mounted display calibration system with the center of the screen of the head-mounted display to be calibrated. The optical components are controlled to rotate in order to track a second light source point displayed on the screen of the head-mounted display device to be calibrated, thereby obtaining a second quantitative characterization value of the luminous flux; If the second quantization value is found to meet the second set condition, the optical component is controlled to stop rotating.

2. The head-mounted display device calibration method according to claim 1, characterized in that, The control of the rotation of the optical component includes: The optical component is controlled to rotate, and the photosensitive device is controlled to re-acquire the light signal, updating the first quantization value of the light flux; Based on the first quantized representation value of the luminous flux before the update and the first quantized representation value of the luminous flux after the update, a first target adjustment variable is determined; the first target adjustment variable includes adjustment angle and adjustment direction. Based on the first target adjustment variable, the optical component is controlled to rotate, and the process returns to the step of controlling the photosensitive device to re-acquire the light signal and update the first quantization value of the light flux.

3. The head-mounted display device calibration method according to claim 2, characterized in that, The determination of the first target adjustment variable based on the first quantized representation value of the luminous flux before and after the update includes: If the first quantization value of the updated luminous flux is greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than a first threshold, the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction. If the first quantization value of the updated luminous flux is not greater than the first quantization value of the luminous flux before the update, and the difference between the first quantization value of the updated luminous flux and the first quantization value of the luminous flux before the update is not less than a first threshold, the opposite direction of the rotation direction corresponding to the last rotation of the optical component is determined as the adjustment direction. If the difference between the first quantized representation value of the updated luminous flux and the first quantized representation value of the luminous flux before the update is less than a first threshold, the first target adjustment variable is determined to not exceed a fourth set threshold.

4. The head-mounted display device calibration method according to any one of claims 1-3, characterized in that, The step of controlling the optical component to stop rotating when the second quantization value is found to meet the second preset condition includes: The optical component is controlled to stop rotating when the second light source point is tracked using a cross-sweep tracking method until the second quantization value of the luminous flux meets the second set condition.

5. The head-mounted display device calibration method according to claim 4, characterized in that, The step of tracking the second light source point using a cross-sweep tracking method until the second quantized representation value of the luminous flux meets the second set condition, and then controlling the optical component to stop rotating, includes: The second quantized representation value of the luminous flux corresponding to each sub-region within the motion region is traversed, and the sub-region whose second quantized representation value of the luminous flux satisfies the second set condition is determined as the target sub-region. Starting from the center point of the target sub-region, the gaze point is controlled to scan in a cross direction, and the region corresponding to the second quantization value of the light flux of each scanned region satisfies the second set condition is determined as the location of the second light source point. Control the optical components to stop rotating.

6. The head-mounted display device calibration method according to claim 5, characterized in that, The step of controlling the gaze point to scan in a cross direction, starting from the center point of the target sub-region, and determining the region where the second quantized representation value of the luminous flux corresponding to each scanned region satisfies the second set condition as the location of the second light source point includes: Starting from the center point of the target sub-region, the photosensitive device is controlled to collect light signals to obtain a second quantitative characterization value of the light flux. The optical components are rotated to control the gaze point to scan the target direction in the horizontal and vertical directions, and the photosensitive device is controlled to re-acquire the light signal to update the second quantization value of the light flux. Based on the second quantized characterization value of the luminous flux before and after the update, a second target adjustment variable is determined; the second target adjustment variable includes the adjustment angle and the adjustment direction. Based on the second target adjustment variable, the optical component is controlled to rotate until the second quantization value of the luminous flux meets the second set condition. Then, the gaze point is controlled to scan in a direction other than the target direction in the horizontal and vertical directions until the second quantization value of the luminous flux obtained in the other direction meets the second set condition. At this time, the area corresponding to this time is determined to be the location of the second light source point.

7. The head-mounted display device calibration method according to any one of claims 1-6, characterized in that, Before controlling the photosensitive device to acquire the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain a first quantitative characterization value of the luminous flux, the method further includes: The photosensitive device is controlled to collect the light signal emitted by the head-mounted display device to be calibrated and guided by the optical components to obtain a third quantitative characterization value of the light flux; Based on the category of the head-mounted display device to be calibrated, the target component is rotated until the third quantization value of the light flux meets the third set condition, and then the IPD adjustment is completed.

8. The head-mounted display device calibration method according to claim 7, characterized in that, When the category is adjustable IPD of the head-mounted display, the simulated IPD corresponding to the head-mounted display calibration system is determined to be the average value of the human eye, and the head-mounted display IPD is determined to be the target component; In the case where the category is head-mounted display IPD is not adjustable, the IPD motor shaft corresponding to the head-mounted display device calibration system is identified as the target component.

9. A head-mounted display device calibration device, characterized in that, An apparatus for use in a head-mounted display (HMD) calibration system, the HMD calibration system comprising a rotatable optical component and a photosensitive device, wherein a HMD to be calibrated is disposed within the HMD calibration system, and the optical component is disposed between the HMD to be calibrated and the photosensitive device; the apparatus comprises: The control module is configured to obtain a first quantized value of luminous flux based on the light signal emitted by the head-mounted display device to be calibrated and guided by the optical component, which is acquired by the photosensitive device; and to control the rotation of the optical component based on the first quantized value until center calibration is completed; and The optical component is controlled to rotate in order to track a second light source point displayed on the screen of the head-mounted display device to be calibrated, thereby obtaining a second quantized characterization value of the luminous flux. When the second quantized characterization value of the luminous flux is found to meet a second set condition, the optical component is controlled to stop rotating.

10. A head-mounted display device calibration system, characterized in that, include: A rotatable optical component that receives light signals emitted by the head-mounted display device to be calibrated and transmits the light signals backward; A photosensitive device disposed at the rear end of the optical component, the photosensitive device being used to generate a quantized characterization value of the luminous flux of the optical signal guided and transmitted by the optical component; and A control device is connected to the optical component and the photosensitive device respectively. The control device controls the rotation of the optical component based on the quantized characterization value of the light flux transmitted by the photosensitive device, so as to calibrate the head-mounted display device to be calibrated.

11. The head-mounted display device calibration system according to claim 10, characterized in that, The optical components include a simulated eyeball structure that allows light to pass through and guides light.

12. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the head-mounted display device calibration method as described in any one of claims 1-8.

13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the head-mounted display device calibration method as described in any one of claims 1-8.

Images