Display deviation calibration method, near-to-eye display equipment box, system and storage medium

Abstract

The embodiment of the invention provides a display deviation calibration method, a near-to-eye display equipment box, a system and a storage medium, and belongs to the field of near-to-eye display. The method comprises the following steps: acquiring current deformation information of the near-to-eye display equipment; determining a target calibration parameter of the display deviation of the near-to-eye display equipment according to the current deformation information and a mapping relationship between pre-stored deformation information and the calibration parameter of the display deviation; and calibrating the display deviation of the near-to-eye display equipment according to the target calibration parameter. According to the technical scheme of the embodiment of the invention, the calibration efficiency and accuracy of the display deviation of the near-to-eye display equipment are improved.

Description

Technical Field

[0001] This invention relates to the field of near-eye display technology, and more particularly to a display deviation calibration method, a near-eye display device box, a system, and a storage medium. Background Technology

[0002] With the lightweighting and intelligentization of near-eye display devices such as Augmented Reality (AR) glasses and Mixed Reality (MR) glasses, these devices have been widely used across various industries. However, in daily use, near-eye display devices are prone to structural deformation due to pressure, drops, or temperature changes. This physical deformation can cause problems such as image ghosting and depth perception distortion, affecting the display effect and severely impacting the user experience. Currently, after physical deformation occurs, users primarily rely on manual calibration of the display deviation, which is inefficient and inaccurate. Summary of the Invention

[0003] This invention provides a display deviation calibration method, a near-eye display device box, a system, and a storage medium, aiming to improve the calibration efficiency and accuracy of display deviation in near-eye display devices.

[0004] In a first aspect, embodiments of the present invention provide a display deviation calibration method, comprising: Obtain the current deformation information of the near-eye display device; Based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameters of the display deviation, the target calibration parameters of the display deviation of the near-eye display device are determined; The display deviation of the near-eye display device is calibrated according to the target calibration parameters.

[0005] The first aspect provides a display deviation calibration method based on the current deformation information of the near-eye display device and the mapping relationship between the pre-stored deformation information and the calibration parameters of the display deviation. It determines the target calibration parameters of the display deviation of the near-eye display device and calibrates the display deviation of the near-eye display device based on the target calibration parameters. The entire process does not require user intervention, which improves the calibration efficiency, accuracy and convenience of the display deviation.

[0006] Secondly, embodiments of the present invention also provide a near-eye display device box, comprising: Box body; A deformation detection device, disposed in the housing, is used to detect deformation-related information of the near-eye display device; A communication module, located in the housing, is used to communicate with the near-eye display device; A memory, located in the housing, is used to store the mapping relationship between deformation information and calibration parameters of display deviation; A processor, located in the housing, is used to perform the following steps: The deformation-related information of the near-eye display device detected by the deformation detection device is obtained, and the current deformation information of the near-eye display device is determined based on the deformation-related information. Based on the current deformation information and the mapping relationship, the target calibration parameters for the display deviation of the near-eye display device are determined; The communication module is controlled to send the target calibration parameters to the near-eye display device, so that the near-eye display device can calibrate the display deviation according to the received target calibration parameters.

[0007] The second aspect provides a near-eye display device box that can determine the current deformation information of the near-eye display device based on its deformation-related information. Then, based on the mapping relationship between the current deformation information and pre-stored deformation information and display deviation calibration parameters, it determines the target calibration parameters for the display deviation of the near-eye display device. These target calibration parameters are then sent to the near-eye display device, enabling it to calibrate the display deviation according to the received parameters. The entire process requires no user intervention; the user simply needs to place the near-eye display device into the near-eye display device box to complete the calibration. This improves the efficiency, accuracy, and convenience of display deviation calibration. Furthermore, it eliminates the need to integrate a dedicated deformation detection sensor into the near-eye display device, reducing its complexity, power consumption, and cost.

[0008] Thirdly, embodiments of the present invention also provide a display deviation calibration system, including a near-eye display device and a near-eye display device box as described in the second aspect.

[0009] Fourthly, embodiments of the present invention also provide a storage medium for computer-readable storage, the storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the display deviation calibration method as described in the first aspect. Attached Figure Description

[0010] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a schematic flowchart of a display deviation calibration method provided in an embodiment of the present invention; Figure 2 yes Figure 1 A flowchart illustrating the sub-steps of the deviation calibration method in the diagram; Figure 3 This is a schematic block diagram of the structure of a near-eye display device box provided in an embodiment of the present invention; Figure 4 This is a schematic structural block diagram of a display deviation calibration system provided in an embodiment of the present invention; Figure 5 This is a schematic block diagram of another display deviation calibration system provided in an embodiment of the present invention; Figure 6 This is a schematic block diagram of another display deviation calibration system provided in an embodiment of the present invention. Detailed Implementation

[0012] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0013] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0014] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0015] With the lightweighting and intelligentization of near-eye display devices such as Augmented Reality (AR) glasses and Mixed Reality (MR) glasses, these devices have been widely used across various industries. However, in daily use, near-eye display devices are prone to structural deformation due to pressure, drops, or temperature changes. This physical deformation can cause problems such as image ghosting and depth perception distortion, affecting the display effect and severely impacting the user experience. Currently, after physical deformation occurs, users primarily rely on manual calibration of the display deviation, which is inefficient and inaccurate.

[0016] To address the aforementioned issues, this invention provides a display deviation calibration method. This method determines the target calibration parameters for the display deviation of the near-eye display device based on the current deformation information of the near-eye display device and the mapping relationship between the pre-stored deformation information and the calibration parameters of the display deviation. Based on the target calibration parameters, the display deviation of the near-eye display device is calibrated. The entire process does not require user intervention, thus improving the calibration efficiency, accuracy, and convenience of the display deviation calibration.

[0017] It should be noted that the display deviation calibration method provided in this embodiment of the invention can be applied to near-eye display device boxes, near-eye display devices, and cloud servers. This embodiment of the invention does not specifically limit it in this regard.

[0018] In some embodiments, the near-eye display device box controls the deformation detection device to collect deformation-related information of the near-eye display device. Based on the deformation-related information, the current deformation information of the near-eye display device is determined. The deformation-related information includes three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device and / or the current magnetic field information of multiple magnetic markers in the near-eye display device. Based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameters of the display deviation, the target calibration parameters of the near-eye display device are determined. The target calibration parameters are sent to the near-eye display device so that the near-eye display device can calibrate the display deviation according to the received target calibration parameters. In this embodiment, the user only needs to place the near-eye display device into the near-eye display device box to complete the calibration without manual intervention, which improves the calibration efficiency, accuracy and convenience of the display deviation. Furthermore, it does not require the integration of a dedicated sensor for deformation detection into the near-eye display device, reducing the complexity, power consumption and cost of the near-eye display device.

[0019] In some embodiments, the near-eye display device box receives current deformation information of the near-eye display device sent by the near-eye display device, which is determined by a deformation detection component in the near-eye display device. The near-eye display device box determines a target calibration parameter for the display deviation of the near-eye display device based on the current deformation information and the mapping relationship between pre-stored deformation information and calibration parameters for display deviation. The target calibration parameter is then sent to the near-eye display device, enabling the near-eye display device to calibrate the display deviation according to the received target calibration parameter. In this embodiment, the user only needs to place the near-eye display device into the near-eye display device box to complete the calibration, without manual intervention, thus improving the calibration efficiency, accuracy, and convenience of the display deviation calibration.

[0020] In some embodiments, the cloud server receives current deformation information of the near-eye display device from the near-eye display device, which is determined by a deformation detection component in the near-eye display device. The cloud server determines target calibration parameters for the display deviation of the near-eye display device based on the current deformation information and the mapping relationship between pre-stored deformation information and calibration parameters for display deviation. The cloud server sends the target calibration parameters to the near-eye display device, enabling the near-eye display device to calibrate the display deviation according to the received target calibration parameters. This embodiment of the invention uses a cloud server with high computing power to calculate the target calibration parameters, further improving the calibration efficiency of the display deviation.

[0021] In some embodiments, the near-eye display device box controls the deformation detection device to collect deformation-related information of the near-eye display device and sends the deformation-related information to a cloud server. The deformation-related information includes three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device and / or the current magnetic field information of multiple magnetic markers in the near-eye display device. The cloud server determines the current deformation information of the near-eye display device based on the deformation-related information. The cloud server determines the target calibration parameters for the display deviation of the near-eye display device based on the current deformation information and the mapping relationship between the pre-stored deformation information and the calibration parameters for the display deviation. The cloud server sends the target calibration parameters to the near-eye display device, or the cloud server sends the target calibration parameters to the near-eye display device box, and the near-eye display device box sends the target calibration parameters to the near-eye display device, so that the near-eye display device can calibrate the display deviation according to the received target calibration parameters. In this embodiment, the user only needs to place the near-eye display device into the near-eye display device box to complete the calibration without manual intervention, which improves the calibration efficiency, accuracy and convenience of the display deviation. Furthermore, the use of a cloud server with high computing power to calculate the target calibration parameters further improves the calibration efficiency of the display deviation.

[0022] In some embodiments, near-eye display devices may include augmented reality (AR) glasses, AR helmets, mixed reality (MR) glasses, and MR helmets, etc.

[0023] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0024] Please see Figure 1 , Figure 1 This is a schematic flowchart of a display deviation calibration method provided in an embodiment of the present invention.

[0025] like Figure 1As shown, the display deviation calibration method includes steps S101 to S103.

[0026] Step S101: Obtain the current deformation information of the near-eye display device.

[0027] In this embodiment, the current deformation information of the near-eye display device may include the current deformation information of a target part of the near-eye display device. The target part may include the temples, nose pads, and front frame of the near-eye display device. The current deformation information of the target part may include at least one of the following: the horizontal (left-right) offset Δx of the target part, the vertical (up-down) offset Δy of the target part, the front-back offset Δz of the target part, the horizontal torsional deformation (around the Y-axis) of the target part, the vertical torsional deformation (around the X-axis) of the target part, and the lateral torsional deformation (around the Z-axis) of the target part.

[0028] In some embodiments, obtaining the current deformation information of the near-eye display device includes: in response to the near-eye display device being placed in a near-eye display device box and the near-eye display device box being in a closed state, the near-eye display device box or a cloud server obtains the current deformation information of the near-eye display device. The near-eye display device box includes a pressure sensing component. In response to the pressure value output by the pressure sensing component being greater than a preset pressure value, it is determined that the near-eye display device is placed in the near-eye display device box; in response to the pressure value output by the pressure sensing component being less than the preset pressure value, it is determined that the near-eye display device is not placed in the near-eye display device box. In this embodiment, when the user places the near-eye display device into the near-eye display device box, the display deviation calibration of the near-eye display device is automatically triggered after the near-eye display device box is closed, without user intervention, thus improving the convenience of display deviation calibration for the near-eye display device.

[0029] In some embodiments, such as Figure 2 As shown, step S101 includes sub-steps S1011 to S1012.

[0030] Sub-step S1011: Obtain deformation-related information of the near-eye display device.

[0031] In this embodiment, the deformation-related information of the near-eye display device includes three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device and / or the current magnetic field information of multiple magnetic markers in the near-eye display device. The target area may include the temples, nose pads, and front frame of the near-eye display device.

[0032] In some embodiments, the near-eye display device box includes a deformation detection device, and acquiring deformation-related information of the near-eye display device includes: the near-eye display device box controlling the deformation detection device to collect deformation-related information of the near-eye display device. For example, in response to the near-eye display device being placed in the near-eye display device box and the near-eye display device box being in a closed state, the near-eye display device box controls the deformation detection device to collect deformation-related information of the near-eye display device.

[0033] In some embodiments, the deformation detection device includes a laser ranging array, a first camera module, and a second camera module. Controlling the deformation detection device to collect deformation-related information of the near-eye display device includes: controlling the laser ranging array to collect three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device; and controlling the first camera module to collect a first image of the target area of ​​the near-eye display device and controlling the second camera module to collect a second image of the target area of ​​the near-eye display device. The three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device, the first image, and the second image are determined as the deformation-related information of the near-eye display device.

[0034] For example, a laser ranging array is disposed on the inner wall of the near-eye display device box, so that after the near-eye display device is placed in the near-eye display device box, the laser ranging array can acquire three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device. The laser ranging array may include an 8-point laser ranging array. A first camera module is disposed in the box body of the near-eye display device box in a first direction facing the target area of ​​the near-eye display device, and is used to acquire a first image of the target area of ​​the near-eye display device. A second camera module is disposed in the box body of the near-eye display device box in a second direction facing the target area of ​​the near-eye display device, and is used to acquire a second image of the target area of ​​the near-eye display device. For example, the first camera module is disposed in the box body of the near-eye display device box facing the front of the front frame of the near-eye display device, and is used to acquire an image of the front of the front frame; the second camera module is disposed in the box body of the near-eye display device box facing the right side of the front frame of the near-eye display device, and is used to acquire an image of the right side of the front frame.

[0035] In some embodiments, the deformation detection device includes a magnetic sensor array, and controlling the deformation detection device to collect deformation-related information of the near-eye display device includes: controlling the near-eye display device to control the magnetic sensor array to collect current magnetic field information of multiple magnetic markers in the near-eye display device. The multiple magnetic markers in the near-eye display device are disposed at a target location of the near-eye display device. For example, the multiple magnetic markers in the near-eye display device are disposed at the temple hinge of the near-eye display device.

[0036] Sub-step S1012: Determine the current deformation information of the near-eye display device based on deformation-related information.

[0037] This embodiment is able to accurately determine the current deformation information of the near-eye display device based on the three-dimensional point cloud data of multiple key points of the target part of the near-eye display device and / or the current magnetic field information of multiple magnetic markers in the near-eye display device.

[0038] In some embodiments, determining the current deformation information of the near-eye display device based on deformation-related information includes: the near-eye display device box or cloud server determining the three-dimensional point cloud data of multiple key points of the target area as the current three-dimensional point cloud data of the target area; and determining the current deformation information of the near-eye display device based on the current three-dimensional point cloud data and the reference three-dimensional point cloud data of the near-eye display device. This embodiment, based on the current three-dimensional point cloud data of the target area of ​​the near-eye display device and the reference three-dimensional point cloud data, can accurately determine the current deformation information of the near-eye display device.

[0039] In some embodiments, the deformation-related information further includes a first image and a second image of the target region. Determining the current deformation information of the near-eye display device based on the deformation-related information includes: the near-eye display device box or cloud server determining the three-dimensional point cloud data of the contour of the target region based on the first image and the second image; determining the three-dimensional point cloud data of the contour of the target region and the three-dimensional point cloud data of multiple key points of the target region as the current three-dimensional point cloud data of the target region; and determining the current deformation information of the near-eye display device based on the current three-dimensional point cloud data and the reference three-dimensional point cloud data of the near-eye display device. In this embodiment, the three-dimensional point cloud data of the contour of the target region and the three-dimensional point cloud data of multiple key points of the target region are determined as the current three-dimensional point cloud data of the target region to ensure the accuracy of the current three-dimensional point cloud data. Thus, based on the current three-dimensional point cloud data of the target region of the near-eye display device and the reference three-dimensional point cloud data, the current deformation information of the near-eye display device can be determined more accurately.

[0040] In some embodiments, the reference 3D point cloud data of the near-eye display device is the 3D point cloud data of the near-eye display device in an undeformed state, which can be calibrated when the near-eye display device is used for the first time. For example, when using the near-eye display device for the first time, the near-eye display device is placed on a standard fixture and then placed in the near-eye display device box. The near-eye display device box collects the 3D point cloud data of the near-eye display device in an undeformed state to obtain the reference 3D point cloud data of the near-eye display device, and stores the reference 3D point cloud data of the near-eye display device.

[0041] For example, the reference 3D point cloud data of the near-eye display device includes the reference 3D point cloud data of the target area of ​​the near-eye display device. For instance, when using the near-eye display device for the first time, the near-eye display device is placed on a standard fixture and then placed inside the near-eye display device box. The laser ranging array in the near-eye display device box is controlled to collect 3D point cloud data of multiple key points of the target area of ​​the near-eye display device. The collected 3D point cloud data of multiple key points of the target area is determined as the reference 3D point cloud data of the target area and stored.

[0042] For example, when using a near-eye display device for the first time, the near-eye display device is placed on a standard fixture and then placed inside the near-eye display device box. The near-eye display device box controls a laser ranging array to collect three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device; and controls a first camera module in the near-eye display device box to collect a first image of the target area of ​​the near-eye display device and controls a second camera module in the near-eye display device box to collect a second image of the target area of ​​the near-eye display device; based on the first and second images, the three-dimensional point cloud data of the contour of the target area is determined, and then the three-dimensional point cloud data of the contour of the target area and the three-dimensional point cloud data of multiple key points of the target area are determined as the reference three-dimensional point cloud data of the target area and stored.

[0043] In some embodiments, determining the current deformation information of the near-eye display device based on the current 3D point cloud data and the reference 3D point cloud data of the near-eye display device may include: the near-eye display device box or cloud server performing point cloud registration between the current 3D point cloud data and the reference 3D point cloud data of the near-eye display device based on a preset point cloud registration algorithm to obtain a target transformation matrix that minimizes the distance between the current 3D point cloud data and the reference 3D point cloud data; transforming the current 3D point cloud data according to the target transformation matrix to obtain target 3D point cloud data, and determining the Euclidean distance between each point in the target 3D point cloud data and its nearest neighbor in the reference 3D point cloud data; and determining the current deformation information of the near-eye display device based on the Euclidean distance between each point in the target 3D point cloud data and its nearest neighbor in the reference 3D point cloud data. The preset point cloud registration algorithm may include an iterative nearest-neighbor algorithm.

[0044] In some embodiments, determining the current deformation information of the near-eye display device based on the Euclidean distance between each point in the target 3D point cloud data and its nearest neighbor in the reference 3D point cloud data may include: calculating the root mean square error or mean square error of the Euclidean distance based on the Euclidean distance between each point in the target 3D point cloud data and its nearest neighbor in the reference 3D point cloud data, and determining the calculated root mean square error or mean square error as the current deformation information of the near-eye display device.

[0045] In some embodiments, determining the current deformation information of the near-eye display device based on deformation-related information includes: determining the current pose information of multiple magnetic markers based on the current magnetic field information of multiple magnetic markers and the reference magnetic field information of multiple magnetic markers; and determining the current deformation information of the near-eye display device based on the current pose information of multiple magnetic markers and the reference pose information of multiple magnetic markers. The current pose information of multiple magnetic markers can be obtained by inverting and calculating using a magnetic dipole model based on the current magnetic field information of multiple magnetic markers and the reference magnetic field information of multiple magnetic markers. This embodiment can accurately determine the current deformation information of the near-eye display device based on the current pose information of multiple magnetic markers and the reference pose information of multiple magnetic markers.

[0046] In some embodiments, the reference magnetic field information of multiple magnetic markers in the near-eye display device is obtained when the near-eye display device is in an undeformed state. This magnetic field information can be calibrated during the first use of the near-eye display device. For example, during the first use, the near-eye display device is placed on a standard fixture and then placed inside its housing. While the near-eye display device is in an undeformed state, the housing collects the magnetic field information of multiple magnetic markers using a magnetic sensor array to obtain the reference magnetic field information of the multiple magnetic markers. Based on this reference magnetic field information, the reference pose information of the multiple magnetic markers is calculated and stored.

[0047] In some embodiments, determining the current deformation information of the near-eye display device based on the current pose information of the multiple magnetic markers and the reference pose information of the multiple magnetic markers includes: determining the position offset and attitude change of each magnetic marker based on the current pose information of each magnetic marker and the corresponding reference pose information, and determining the current deformation information of the near-eye display device based on the position offset and attitude change of each magnetic marker.

[0048] In some embodiments, the current pose information of the magnetic marker includes the current position and current orientation of the magnetic marker, and the reference pose information of the magnetic marker includes the reference position and reference orientation of the magnetic marker. Determining the position offset and orientation change of each magnetic marker based on its current pose information and corresponding reference pose information includes: for each magnetic marker, determining the absolute value of the deviation between its current position and its reference position to obtain the position offset of the magnetic marker; and determining the absolute value of the deviation between its current orientation and its reference orientation to obtain the orientation offset of the magnetic marker. The position offset of the magnetic marker includes its horizontal offset, its vertical offset, and its forward / backward offset. The orientation change of the magnetic marker includes its horizontal torsional deformation, its vertical torsional deformation, and its lateral torsional deformation.

[0049] In some embodiments, determining the current deformation information of the near-eye display device based on the position offset and attitude change of each magnetic marker includes: calculating an average position offset based on the position offset of each magnetic marker; calculating an average attitude change based on the attitude change of each magnetic marker; and using the average position offset and the average attitude change as the current deformation information of the near-eye display device. Alternatively, the maximum position offset among the position offsets of each magnetic marker and the maximum attitude change among the attitude changes of each magnetic marker can be used as the current deformation information of the near-eye display device.

[0050] In some embodiments, obtaining the current deformation information of the near-eye display device includes: receiving the current deformation information of the near-eye display device sent by the near-eye display device, wherein the current deformation information of the near-eye display device is determined by a deformation detection component in the near-eye display device. The deformation detection component in the near-eye display device may include a micro-strain gauge. For example, a micro-strain gauge can be built into the front frame of the near-eye display device, and the current deformation information of the near-eye display device can be detected by the built-in micro-strain gauge. This embodiment directly detects the deformation of the near-eye display device based on the deformation detection component in the near-eye display device, without the need for complex calculations, thus achieving higher efficiency.

[0051] In some embodiments, the resistance value of the micro-strain gauge changes with the deformation of the front frame of the near-eye display device. Specifically, the near-eye display device acquires the current resistance value of the micro-strain gauge, determines the deviation between the current resistance value and the reference resistance value of the micro-strain gauge, and obtains the resistance change of the micro-strain gauge. Based on the resistance change of the micro-strain gauge and the pre-stored mapping relationship between the resistance change and deformation information, the current deformation information of the near-eye display device is determined. The mapping relationship between the resistance change and deformation information is pre-established.

[0052] Step S102: Determine the target calibration parameters for the display deviation of the near-eye display device based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameters for the display deviation.

[0053] In this embodiment, the mapping relationship between the pre-stored deformation information and the calibration parameters of the display deviation is established in advance. For example, the mapping relationship between the deformation information and the calibration parameters of the display deviation can be obtained by training a neural network model based on multiple training samples, including the deformation information of the near-eye display device and the labeled calibration parameters.

[0054] In some embodiments, determining the target calibration parameters for the display deviation of a near-eye display device based on the current deformation information and the pre-stored mapping relationship between deformation information and calibration parameters for display deviation includes: the near-eye display device box or cloud server determines the deformation type of the near-eye display device based on the current deformation information, and determines the target calibration parameters for the display deviation of the near-eye display device based on the mapping relationship matching the deformation type from multiple pre-stored mapping relationships and the current deformation information. Here, the mapping relationship is the mapping relationship between deformation information and calibration parameters for display deviation, and the deformation type of the near-eye display device includes horizontal offset, vertical offset, front-back offset, horizontal torsional deformation, vertical torsional deformation, or lateral torsional deformation, etc. This embodiment can more accurately determine the target calibration parameters for the display deviation of the near-eye display device based on the mapping relationship matching the deformation type of the near-eye display device.

[0055] In some embodiments, the mapping relationship between the pre-stored deformation information and the calibration parameters of the display deviation is related to the model of the near-eye display device supported by the near-eye display device box. For example, the mapping relationship between the deformation information and the calibration parameters of the display deviation is as follows: δx is the horizontal translation compensation amount, δα is the image rotation compensation angle, Δθ is the horizontal torsional deformation amount, Δy is the vertical offset amount, k1, k2 and k3 are preset weight coefficients, and k1, k2 and k3 are related to the model of the near-eye display device. Different models of near-eye display devices correspond to different k1, k2 and k3.

[0056] Step S103: Calibrate the display deviation of the near-eye display device according to the target calibration parameters.

[0057] This embodiment determines the target calibration parameters for the display deviation of the near-eye display device based on the current deformation information of the near-eye display device and the mapping relationship between the pre-stored deformation information and the calibration parameters of the display deviation. Based on the target calibration parameters, the display deviation of the near-eye display device is calibrated. The entire process does not require user intervention, which improves the calibration efficiency, accuracy and convenience of the display deviation.

[0058] In some embodiments, calibrating the display deviation of the near-eye display device according to the target calibration parameters includes: the near-eye display device box or cloud server sending the target calibration parameters to the near-eye display device, so that the near-eye display device calibrates the display deviation according to the target calibration parameters. For example, the near-eye display device adjusts the output pose of the image rendering engine according to the target calibration parameters to achieve image merging compensation. For example, the target calibration parameters include horizontal translation compensation and image rotation compensation angle. The horizontal translation compensation is δx = +1mm (moving the image to the left by +1mm), and the image rotation compensation angle is δα = -3° (rotating the image counterclockwise by -3.0 degrees). The image rendering engine first creates two standard virtual cameras for the left and right eyes. The initial pose of the left-eye virtual camera is (X0_left, Y0_left, Z0_left, R0_left), and the initial pose of the right-eye virtual camera is (X0_right, Y0_right, Z0_right, R0_right). R0_left is the initial rotation matrix of the left-eye virtual camera (used to describe the initial pose of the left-eye virtual camera), and R0_right is the initial rotation matrix of the right-eye virtual camera (used to describe the initial pose of the right-eye virtual camera). Treating the two virtual cameras for the left and right eyes as a whole, move them +1mm to the right and rotate them -3° clockwise. The final compensated pose of the left virtual camera output by the image rendering engine is (X0_left +1mm, Y0_left, Z0_left, R*R0_left), and the compensated pose of the right virtual camera is X0_right +1mm, Y0_right, Z0_right, R0_right), where R is a rotation matrix that rotates -3° around the Z-axis.

[0059] For example, suppose the AR glasses case has calculated a specific deformation in the front frame of the AR glasses and generated the corresponding target calibration parameters. Subsequently, the AR glasses' image rendering engine will adjust according to the following steps: 1. Receive target calibration parameters The AR glasses case sends a set of target calibration parameters to the AR glasses via NFC or Bluetooth. For example, the target calibration parameters include: Horizontal translation compensation (δx): The right eye image needs to be translated 3.5 pixels to the right.

[0060] Vertical translation compensation (δy): The left eye image needs to be translated downwards by 1.2 pixels.

[0061] Image rotation compensation angle (δα): The right eye image needs to be rotated counterclockwise by 0.7 degrees.

[0062] Scaling adjustment factor (s): The left eye image needs to be reduced to 99.8% of its original size.

[0063] 2. Image rendering engine applies target calibration parameters The operating system or dedicated calibration software of AR glasses will parse these parameters and instruct the image rendering engine (such as an engine based on OpenGL ES or Vulkan) to perform the following matrix transformation adjustments when rendering each frame of virtual content: Modify the projection matrix: The image rendering engine fine-tunes its projection matrix. For example, for the right-eye image, an additional translation transformation is applied to the original perspective projection matrix, shifting it by 3.5 pixels on the X-axis to the corresponding viewing angle (e.g., 0.15°) to compensate for the horizontal translation δx.

[0064] Adjusting the model-view matrix: For the right-eye view, the image rendering engine rotates its model-view matrix (or view matrix) by -0.7 degrees (counterclockwise) around the Z-axis (viewing direction) to compensate for the rotation deviation δα. Simultaneously, a scaling factor s=0.998 is applied to the model matrix of the left-eye view to compensate for minor scale differences.

[0065] 3. Synthesizing and outputting the corrected image After the aforementioned matrix transformation, the positions and orientations of the images generated by the image rendering engine for the left and right eyes in virtual space have been subtly adjusted. When these corrected images are projected onto the human eye through the waveguide, their imaging positions on the retina change. The goal is that even if there are minor deformations in the physical front frame of the AR glasses, the software-corrected images for the left and right eyes can be perfectly fused in the visual cortex to form a single, clear 3D virtual object.

[0066] 4. Actual effect illustration Before calibration: When a user observes a virtual cube, the images of the left and right eyes may not be aligned due to the deformation of the front frame, which may result in double images or the inability to merge the images.

[0067] After calibration: After adjusting the pose using the aforementioned target calibration parameters, the cube images generated by the image rendering engine for the left and right eyes were fine-tuned in terms of position, angle, and scale. This allows the cube images seen by the left and right eyes to be correctly combined in the brain, eliminating ghosting and restoring normal depth perception.

[0068] In some embodiments, the near-eye display device box further includes a miniature display screen or a miniature projector. After step S103, the method further includes: the near-eye display device box controlling the miniature display screen to display a preset benchmark test pattern or controlling the miniature projector to project the benchmark test pattern onto the lens of the near-eye display device; and controlling the near-eye display device to project a virtual test pattern identical to the benchmark test pattern; controlling the camera in the near-eye display device box to perform a shooting operation to obtain a target image, the target image including the benchmark test pattern and the virtual test pattern; determining the pixel deviation between the benchmark test pattern in the target image and the virtual test pattern in the target image; in response to the pixel deviation being greater than or equal to a preset pixel deviation, recalibrating the display deviation of the near-eye display device according to the pixel deviation; and returning to the steps of controlling the miniature display screen to display the preset benchmark test pattern or controlling the miniature projector to project the benchmark test pattern onto the lens of the near-eye display device until the pixel deviation is less than the preset pixel deviation. In this embodiment, after calibrating the display deviation of the near-eye display device, a calibration verification of the display deviation is performed. If the verification passes, no further calibration is required, and the calibration is completed. If the verification fails, the display deviation calibration is performed again to ensure the display effect of the near-eye display device.

[0069] In some embodiments, the display deviation calibration method provided by the present invention further includes: in response to a pixel deviation being less than a preset pixel deviation, storing the current deformation information of the near-eye display device and the latest target calibration parameters as a target sample; and in response to the number of stored target samples reaching a preset number, updating the mapping relationship between deformation information and display deviation calibration parameters based on the stored target samples. The present invention adaptively updates the mapping relationship between deformation information and display deviation calibration parameters to ensure the accuracy of the mapping relationship and further improve the calibration accuracy of the display deviation of the near-eye display device.

[0070] In some embodiments, calibrating the display deviation of a near-eye display device according to a target calibration parameter includes: determining a target deformation of the near-eye display device based on its current deformation information; and calibrating the display deviation of the near-eye display device according to the target calibration parameter in response to the target deformation being less than a preset deformation. The preset deformation can be set based on actual conditions, and this embodiment does not specifically limit it. For example, the preset deformation is 2mm. This embodiment of the invention can automatically calibrate the display deviation of the near-eye display device when the deformation is small, improving calibration efficiency.

[0071] In some embodiments, the display deviation calibration method provided by the present invention further includes: in response to a target deformation being greater than or equal to a preset deformation, determining a preset calibration parameter with the smallest deviation from the target calibration parameter from a preset calibration parameter range, and calibrating the display deviation of the near-eye display device according to the preset calibration parameter with the smallest deviation from the target calibration parameter. In this embodiment, when the near-eye display device has a large deformation, calibrating the display deviation according to the large deformation would lead to image distortion. In this case, calibrating the display deviation of the near-eye display device based on the preset calibration parameter with the smallest deviation from the target calibration parameter within the preset calibration parameter range can calibrate the display deviation of the near-eye display device while ensuring that the image is not distorted.

[0072] In some embodiments, the display deviation calibration method provided by this invention further includes: in response to a target deformation being greater than or equal to a preset deformation, outputting a preset reminder message, the preset reminder message being used to remind the user that the deformation of the near-eye display device exceeds the limit. Outputting the preset reminder message may include controlling the red indicator light on the near-eye display device box to flash and / or controlling the near-eye display device to display the preset reminder message, etc. This embodiment reminds the user that the deformation of the near-eye display device exceeds the limit when the deformation is large, facilitating timely handling by the user.

[0073] For example, a near-eye display device includes AR glasses, and the near-eye display device case includes an AR glasses case. When a new AR glasses is used for the first time, it is placed in a standard fixture and then into the AR glasses case. The AR glasses case initiates a reference scan to obtain 3D point cloud data of the target area of ​​the AR glasses in an undeformed state, thus obtaining the reference 3D point cloud data of the AR glasses. During routine calibration, the user places the AR glasses into the AR glasses case. The pressure-sensing pad in the AR glasses case outputs a pressure value upon placement of the AR glasses, and then automatically triggers the calibration process (executes the display deviation calibration method provided in this embodiment of the invention) after the case lid is closed. The indicator light on the AR glasses case displays the calibration progress; a solid green light indicates successful calibration, while a flashing red light indicates that the deformation of the AR glasses exceeds the limit and requires manual intervention. When the deformation of the AR glasses is detected to exceed a safety threshold (e.g., >2mm), the user is reminded via the APP to send the device for repair, and a conservative calibration mode is activated to prevent image distortion. For example, the display deviation of the near-eye display device is calibrated based on the preset calibration parameter with the smallest deviation from the target calibration parameter within the preset calibration parameter range.

[0074] The display deviation calibration method provided in this invention is applicable to: Frequent movement scenarios: For AR glasses that are frequently carried outdoors (such as AR interview glasses used by media reporters), daily calibration can maintain the best display effect. Industrial scenarios: In factory environments with large temperature differences and prone to collisions, regular calibration compensates for deformation caused by structural fatigue. Multi-user sharing scenarios: The glasses case can store multiple sets of device parameters to adapt to slight deformations caused by different users' wearing habits. The display deviation calibration method provided in this invention has the following advantages: Non-contact detection: Avoids secondary damage caused by physical contact and extends the life of the device. Proactive maintenance: Predicts structural weaknesses through long-term deformation trend analysis and provides early warning. Ecosystem compatibility: The solution can be integrated with existing AR glasses systems. The display deviation calibration method provided in this invention can detect micron-level front frame deformation, achieve pixel-level image alignment calibration, control the binocular image overlap error within ±0.1° of the field of view, and reduce display failures caused by deformation through regular calibration, thus reducing the return rate. Using the glasses case as an external calibration platform avoids integrating expensive sensors into the AR glasses body, reducing the overall cost. This invention achieves "invisible maintenance" of AR glasses through the essential accessory of a glasses case, effectively solving the display problem caused by physical deformation without increasing the burden on the host device, and providing key technical support for the large-scale popularization of AR technology.

[0075] Please see Figure 3 , Figure 3 This is a schematic block diagram of the structure of a near-eye display device box provided in an embodiment of the present invention.

[0076] like Figure 3 As shown, the near-eye display device box 100 includes a box body 110, a deformation detection device 120 disposed in the box body 110, a communication module 130, a memory 140, and a processor 150. The deformation detection device 120 is used to detect deformation-related information of the near-eye display device; the communication module 130 is used to communicate with the near-eye display device; the memory 140 is used to store the mapping relationship between deformation information and calibration parameters of display deviation; and the processor 150 is used to implement the following steps: The deformation-related information of the near-eye display device detected by the deformation detection device is obtained, and the current deformation information of the near-eye display device is determined based on the deformation-related information. Based on the current deformation information and the mapping relationship, the target calibration parameters for the display deviation of the near-eye display device are determined; The communication module is controlled to send the target calibration parameters to the near-eye display device, so that the near-eye display device can calibrate the display deviation according to the received target calibration parameters.

[0077] In some embodiments, the deformation detection device 120 includes: A laser ranging array is used to acquire three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device; A first camera module is disposed on the housing in a first direction facing the target part of the near-eye display device, and is used to capture a first image of the target part of the near-eye display device; The second camera module is disposed on the housing in a second direction facing the target part of the near-eye display device, and is used to capture a second image of the target part of the near-eye display device. The first direction is different from the second direction. When the processor 150 determines the current deformation information of the near-eye display device based on the deformation-related information, it is configured to: Based on the first image and the second image, the three-dimensional point cloud data of the contour of the target part is determined, and the three-dimensional point cloud data of the contour of the target part and the three-dimensional point cloud data of multiple key points of the target part are determined as the current three-dimensional point cloud data of the target part. Based on the current three-dimensional point cloud data and the reference three-dimensional point cloud data of the near-eye display device stored in the memory, the current deformation information of the near-eye display device is determined.

[0078] In some embodiments, the near-eye display device includes a plurality of magnetic markers, and the processor 150, when determining the current deformation information of the near-eye display device based on the deformation-related information, is configured to: Based on the current magnetic field information and the reference magnetic field information of the plurality of magnetic markers stored in the memory, the current pose information of the plurality of magnetic markers is determined; The current deformation information of the near-eye display device is determined based on the current pose information of the plurality of magnetic markers and the reference pose information of the plurality of magnetic markers stored in the memory.

[0079] The near-eye display device box also includes a pressure sensing component, and the processor 150 is further configured to: In response to the pressure value output by the pressure sensing component being greater than a preset pressure value, the deformation detection device is controlled to detect deformation-related information of the near-eye display device.

[0080] In some embodiments, the processor 150 is further configured to: The communication module is controlled to receive the current deformation information of the near-eye display device sent by the near-eye display device. The current deformation information of the near-eye display device is determined by the deformation detection component in the near-eye display device.

[0081] In some embodiments, the internal sensors of the near-eye display device box 100, such as the deformation detection device 120, are modularly designed and replaceable via a magnetic interface. The near-eye display device box 100 supports wireless charging, and the communication module 130 within it may include a Bluetooth module or a Near Field Communication (NFC) module. Correspondingly, the near-eye display device includes a Bluetooth module or an NFC module, enabling wireless communication between the near-eye display device box 100 and the near-eye display device. It is understood that the near-eye display device box 100 and the near-eye display device can also communicate via a wired connection; this embodiment of the invention does not specifically limit this communication.

[0082] Specifically, the processor provides computing and control capabilities to support the operation of the entire near-eye display device box. The processor can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among these, a general-purpose processor can be a microprocessor or any conventional processor.

[0083] Specifically, the memory 140 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc. The deformation detection device 120, the communication module 130, the memory 140, and the processor 150 can be connected via a bus.

[0084] Those skilled in the art will understand that Figure 3 The structure shown is merely a block diagram of a portion of the structure related to the embodiments of the present invention, and does not constitute a limitation on the near-eye display device box to which the embodiments of the present invention are applied. A specific near-eye display device box may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0085] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the near-eye display device box described above can be referred to the corresponding process in the aforementioned display deviation calibration method embodiment, and will not be repeated here.

[0086] Please see Figure 4 , Figure 4 This is a schematic block diagram of a display deviation calibration system provided in an embodiment of the present invention.

[0087] like Figure 4 As shown, the display deviation calibration system 10 includes a near-eye display device box 100 and a near-eye display device 200. The near-eye display device box 100 and the near-eye display device 200 communicate wirelessly or via a wired connection.

[0088] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the display deviation calibration system described above can be referred to the corresponding process in the aforementioned display deviation calibration method embodiments, and will not be repeated here.

[0089] Please see Figure 5 , Figure 5 This is a schematic block diagram of another display deviation calibration system provided in an embodiment of the present invention.

[0090] like Figure 5 As shown, the display deviation calibration system 20 includes a near-eye display device 200 and a cloud server 300. The cloud server 300 communicates with the near-eye display device 200 wirelessly, wherein: The near-eye display device 200 is configured to control the deformation detection component to collect the current deformation information of the near-eye display device 200 and send the current deformation information to the cloud server 300; The cloud server 300 is configured to receive the current deformation information sent by the near-eye display device 200, and determine the target calibration parameters of the display deviation of the near-eye display device based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameters of the display deviation. The cloud server 300 is also configured to send the target calibration parameters to the near-eye display device 200; The near-eye display device 200 is also configured to receive target calibration parameters sent by the cloud server 300, and to calibrate the display deviation according to the target calibration parameters.

[0091] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the display deviation calibration system described above can be referred to the corresponding process in the aforementioned display deviation calibration method embodiments, and will not be repeated here.

[0092] Please see Figure 6 , Figure 6 This is a schematic block diagram of another display deviation calibration system provided in an embodiment of the present invention.

[0093] like Figure 6 As shown, the display deviation calibration system 30 includes a near-eye display device box 100, a near-eye display device 200, and a cloud server 300. The near-eye display device box 100 and the near-eye display device 200 communicate wirelessly or via wired means. The cloud server 300 communicates wirelessly with the near-eye display device box 100 and the near-eye display device 200. The near-eye display device box 100 is configured to control the deformation detection device to detect deformation-related information of the near-eye display device placed in the near-eye display device box 100, and send the deformation-related information to the cloud server 300. The deformation-related information includes three-dimensional point cloud data of multiple key points of the target part of the near-eye display device and / or the current magnetic field information of multiple magnetic markers in the near-eye display device. The cloud server 300 is configured to receive the deformation-related information sent by the near-eye display device box 100, and determine the current deformation information of the near-eye display device based on the deformation-related information. The cloud server 300 is further configured to determine the target calibration parameter of the display deviation of the near-eye display device based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameter of the display deviation, and send the target calibration parameter to the near-eye display device 200; The near-eye display device 200 is configured to receive target calibration parameters sent by the cloud server 300, and to calibrate the display deviation according to the target calibration parameters.

[0094] In some embodiments, the near-eye display device box 100 is further configured to control a deformation detection device to detect deformation-related information of a near-eye display device placed in the near-eye display device box 100, and send the deformation-related information to the near-eye display device 200; The near-eye display device 200 is also configured to send the deformation-related information to the cloud server 300.

[0095] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the display deviation calibration system described above can be referred to the corresponding process in the aforementioned display deviation calibration method embodiments, and will not be repeated here.

[0096] This invention also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement any of the display deviation calibration methods provided in the specification of this invention.

[0097] The storage medium can be volatile or non-volatile. It can be an internal storage unit of the near-eye display device, near-eye display device box, or cloud server as described in the foregoing embodiments, such as the hard drive or memory of the near-eye display device, near-eye display device box, or cloud server. Alternatively, it can be an external storage device of the near-eye display device, near-eye display device box, or cloud server, such as a plug-in hard drive, smart media card (SMC), secure digital (SD) card, flash card, etc., provided on the near-eye display device, near-eye display device box, or cloud server.

[0098] Those skilled in the art will understand that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware embodiments, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0099] It should be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0100] The sequence numbers of the above embodiments of the present invention are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The above descriptions are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for displaying deviation calibration, characterized in that, include: Obtain the current deformation information of the near-eye display device; Based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameters of the display deviation, the target calibration parameters of the display deviation of the near-eye display device are determined; The display deviation of the near-eye display device is calibrated according to the target calibration parameters.

2. The display deviation calibration method according to claim 1, characterized in that, The acquisition of the current deformation information of the near-eye display device includes: Obtain deformation-related information of the near-eye display device, the deformation-related information including three-dimensional point cloud data of multiple key points of the target part of the near-eye display device and / or the current magnetic field information of multiple magnetic markers in the near-eye display device; Based on the deformation-related information, the current deformation information of the near-eye display device is determined.

3. The display deviation calibration method according to claim 2, characterized in that, The deformation-related information also includes a first image and a second image of the target area. Determining the current deformation information of the near-eye display device based on the deformation-related information includes: Based on the first image and the second image, determine the three-dimensional point cloud data of the contour of the target region; The three-dimensional point cloud data of the contour of the target part and the three-dimensional point cloud data of multiple key points of the target part are determined as the current three-dimensional point cloud data of the target part; Based on the current 3D point cloud data and the reference 3D point cloud data of the near-eye display device, the current deformation information of the near-eye display device is determined.

4. The display deviation calibration method according to claim 2, characterized in that, Determining the current deformation information of the near-eye display device based on the deformation-related information includes: Based on the current magnetic field information of the plurality of magnetic markers and the reference magnetic field information of the plurality of magnetic markers, the current pose information of the plurality of magnetic markers is determined; The current deformation information of the near-eye display device is determined based on the current pose information of the plurality of magnetic markers and the reference pose information of the plurality of magnetic markers.

5. The display deviation calibration method according to claim 1, characterized in that, The current deformation information of the near-eye display device is determined by the deformation detection component in the near-eye display device.

6. The display deviation calibration method according to any one of claims 1-5, characterized in that, The near-eye display device is placed in a near-eye display device box. After calibrating the display deviation of the near-eye display device according to the target calibration parameters, the method further includes: Controlling the micro-display screen in the near-eye display device box to display a preset benchmark test pattern or controlling the micro-projector in the near-eye display device box to project the benchmark test pattern onto the lens of the near-eye display device; and The near-eye display device is controlled to project a virtual test pattern identical to the benchmark test pattern. The camera in the near-eye display device box is controlled to perform a shooting operation to obtain a target image, the target image including the benchmark test pattern and the virtual test pattern; Determine the pixel deviation between the benchmark test pattern in the target image and the virtual test pattern in the target image; In response to the pixel deviation being greater than or equal to a preset pixel deviation, the display deviation of the near-eye display device is recalibrated according to the pixel deviation; Return to the step of controlling the micro-display to display the preset benchmark test pattern or controlling the micro-projector to project the benchmark test pattern onto the lens of the near-eye display device, until the pixel deviation is less than the preset pixel deviation.

7. The display deviation calibration method according to any one of claims 1-5, characterized in that, The step of calibrating the display deviation of the near-eye display device according to the target calibration parameters includes: Based on the current deformation information of the near-eye display device, determine the target deformation of the near-eye display device; In response to the target deformation being less than a preset deformation, the display deviation of the near-eye display device is calibrated according to the target calibration parameters.

8. The display deviation calibration method according to claim 7, characterized in that, The method further includes: In response to the target deformation being greater than or equal to a preset deformation, a preset calibration parameter with the smallest deviation from the target calibration parameter is determined from a preset calibration parameter range, and the display deviation of the near-eye display device is calibrated based on the preset calibration parameter with the smallest deviation from the target calibration parameter.

9. The display deviation calibration method according to any one of claims 1-5, characterized in that, The step of determining the target calibration parameter for the display deviation of the near-eye display device based on the mapping relationship between the current deformation information and the pre-stored deformation information and the calibration parameter for the display deviation includes: Based on the current deformation information, the deformation type of the near-eye display device is determined; Based on the pre-stored mapping relationship that matches the deformation type and the current deformation information, the target calibration parameter for the display deviation of the near-eye display device is determined.

10. A near-eye display device box, characterized in that, include: Box body; A deformation detection device, disposed in the housing, is used to detect deformation-related information of the near-eye display device; A communication module, located in the housing, is used to communicate with the near-eye display device; A memory, located in the housing, is used to store the mapping relationship between deformation information and calibration parameters of display deviation; A processor, located in the housing, is used to perform the following steps: The deformation-related information of the near-eye display device detected by the deformation detection device is obtained, and the current deformation information of the near-eye display device is determined based on the deformation-related information. Based on the current deformation information and the mapping relationship, the target calibration parameters for the display deviation of the near-eye display device are determined; The communication module is controlled to send the target calibration parameters to the near-eye display device, so that the near-eye display device can calibrate the display deviation according to the received target calibration parameters.

11. The near-eye display device box according to claim 10, characterized in that, The deformation detection device includes: A laser ranging array is used to acquire three-dimensional point cloud data of multiple key points of the target area of ​​the near-eye display device; A first camera module is disposed on the housing in a first direction facing the target part of the near-eye display device, and is used to capture a first image of the target part of the near-eye display device; The second camera module is disposed on the housing in a second direction facing the target part of the near-eye display device, and is used to capture a second image of the target part of the near-eye display device. The first direction is different from the second direction. When the processor determines the current deformation information of the near-eye display device based on the deformation-related information, it is configured to: Based on the first image and the second image, the three-dimensional point cloud data of the contour of the target part is determined, and the three-dimensional point cloud data of the contour of the target part and the three-dimensional point cloud data of multiple key points of the target part are determined as the current three-dimensional point cloud data of the target part. Based on the current three-dimensional point cloud data and the reference three-dimensional point cloud data of the near-eye display device stored in the memory, the current deformation information of the near-eye display device is determined.

12. The near-eye display device box according to claim 10, characterized in that, The near-eye display device includes multiple magnetic markers, and the deformation detection device includes: A magnetic sensor array is used to acquire the current magnetic field information of multiple magnetic markers in the near-eye display device; When the processor determines the current deformation information of the near-eye display device based on the deformation-related information, it is configured to: Based on the current magnetic field information and the reference magnetic field information of the plurality of magnetic markers stored in the memory, the current pose information of the plurality of magnetic markers is determined; The current deformation information of the near-eye display device is determined based on the current pose information of the plurality of magnetic markers and the reference pose information of the plurality of magnetic markers stored in the memory.

13. The near-eye display device box according to claim 10, characterized in that, The processor is also used for: The communication module is controlled to receive the current deformation information of the near-eye display device sent by the near-eye display device. The current deformation information of the near-eye display device is determined by the deformation detection component in the near-eye display device.

14. A display deviation calibration system, characterized in that, Includes a near-eye display device and a near-eye display device box as described in any one of claims 10-13.

15. A storage medium for computer-readable storage, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the steps of the display deviation calibration method according to any one of claims 1 to 9.

Images