Binocular combined image distance calibration method and device and augmented reality glasses

Abstract

This application discloses a binocular merging distance calibration method, apparatus, and augmented reality glasses. The method, when the user's head width does not match the calibrated binocular merging distance setting of the augmented reality glasses, adjusts the pixel position corresponding to the calibrated binocular merging distance setting within the pixel position adjustment range of the calibration setting. This adjusted pixel position ensures that the merging distance of the user's glasses matches the calibrated binocular merging distance setting. In other words, merging distance calibration is achieved by adjusting the pixel offset of the display module, thereby ensuring that people with different head widths have the same viewing effect at the calibrated binocular merging distance setting. Because this approach avoids the need for users to adjust the binocular merging distance setting to achieve the same merging distance for users with different head widths, it both prevents the misuse of the binocular merging distance adjustment function and effectively improves the calibration accuracy of the calibrated binocular merging distance.

Description

Technical Field

[0001] This application relates to the field of augmented reality technology, specifically to a binocular synchro distance calibration method and apparatus, and augmented reality glasses. Background Technology

[0002] Augmented reality (AR) glasses overlay digital information onto a virtual screen within the user's field of vision. The binocular convergence distance (or simply convergence distance) of AR glasses refers to the distance from the point where the images converge between the user's eyes when wearing the device. It determines the spatial position of the virtual image, affects the focusing and convergence coordination of the eyes, and is crucial for visual comfort and depth perception, making it a key indicator for evaluating the optical design of AR glasses. For example, some devices set this distance to 3.97 meters to simulate a distant viewing experience. The convergence distance of AR glasses is typically fixed by the device manufacturer during the design phase. Currently, the convergence distance for AR glasses is set based on a specific interpupillary distance (IPD) and head width.

[0003] However, in practical use, different head widths exert varying outward forces on the temples of the glasses, resulting in different degrees of deformation of the front frame and causing significant deviations in the actual subjective alignment distance for different people wearing the glasses. Therefore, how to achieve the same calibrated alignment distance when people with different head widths wear the same AR glasses is an urgent problem that needs to be researched and solved. Summary of the Invention

[0004] This application provides a binocular merging distance calibration method to solve the problem of mismatch between the user's head width and the calibrated binocular merging distance of AR glasses in the prior art. This application also provides a binocular merging distance calibration device and augmented reality glasses.

[0005] This application provides a binocular sync distance calibration method, including: Obtain the adjustment range of the virtual image pixel position used for calibrating the binocular merging distance level, and use it as the pixel position adjustment range for level calibration; Based on the pixel position adjustment range of the gear calibration, obtain the target pixel position that matches the user's head width and corresponds to the calibrated binocular merging distance gear. The pixel position corresponding to the calibrated binocular fusion distance level is adjusted to the target pixel position, so that the binocular fusion distance of a user with the specified head width wearing augmented reality glasses is the calibrated binocular fusion distance level.

[0006] Optional, also includes: Acquire user data on multiple binocular focusing distance settings for augmented reality glasses; Based on the usage data, determine whether there is a binocular fusion distance adjustment operation that may be related to the user's head width; If the above judgment result is yes, then the target pixel position is obtained according to the pixel position adjustment range of the gear calibration.

[0007] Optionally, the usage data includes a first correspondence between binocular fusion distance settings and actual usage scenarios; The step of determining whether there is a binocular fusion distance adjustment operation that may be related to the user's head width based on the usage data includes: Obtain the second correspondence between binocular fusion distance levels and calibrated usage scenarios; Based on the first and second correspondences, obtain the usage frequency of binocular fusion distance levels that do not match the calibrated usage scenarios; Based on the frequency of use, determine whether there is any binocular focusing distance adjustment operation that may be related to the user's head width.

[0008] Optionally, determining whether there is a binocular fusion distance adjustment operation that may be related to the user's head width based on the usage data includes: Based on the usage data, obtain the binocular fusion distance settings commonly used by the user; Based on the commonly used binocular fusion distance settings and the calibrated binocular fusion distance settings of augmented reality glasses, determine whether there is a binocular fusion distance setting adjustment operation that may be related to the user's head width.

[0009] Optional, also includes: If the above judgment result is yes, then a message prompting the user to enable binocular fusion distance calibration will be displayed; If the user enables the binocular merging distance calibration, then the pixel position adjustment range based on the calibrated gear level is executed to obtain the target pixel position.

[0010] Optionally, the information prompting the user to enable binocular merging distance calibration includes: the binocular merging distance setting does not match the current usage scenario, and the commonly used binocular merging distance setting does not match the calibrated binocular merging distance setting.

[0011] Optionally, the binocular merging distance can be adjusted, including: The adjustment range of the virtual image pixel position used to adjust the binocular merging distance level is obtained as the pixel position adjustment range for level adjustment; the pixel position adjustment range for level adjustment and the pixel position adjustment range for level calibration do not overlap. Based on the pixel position adjustment range of the gear adjustment and the virtual image pixel position of the current binocular fusion distance gear, obtain the virtual image pixel position of the target binocular fusion distance gear.

[0012] Optional, also includes: Obtain user instructions to calibrate the binocular fusion distance of augmented reality glasses.

[0013] Optional, also includes: Detect whether the augmented reality glasses are malfunctioning; if so, adjust the pixel position range according to the pixel position calibration of the specified level to obtain the target pixel position.

[0014] Optional, also includes: Record the correspondence between the pixel positions of multiple user head widths and the calibrated binocular fusion distance levels; Obtain the target user's head width; Based on the correspondence, obtain the target pixel position corresponding to the target user's head width; A virtual image is displayed at the target pixel location, with the binocular merging distance of the target user wearing augmented reality glasses serving as the calibrated binocular merging distance level.

[0015] Optional, also includes: Record the correspondence between multiple users and the pixel positions corresponding to the calibrated binocular fusion distance levels; Acquire target users; Based on the correspondence, obtain the target pixel position corresponding to the target user; A virtual image is displayed at the target pixel location, with the binocular merging distance of the target user wearing augmented reality glasses serving as the calibrated binocular merging distance level.

[0016] Optional, also includes: Obtain the user's head width or user's head width category; The target pixel position can be obtained using one of the following methods: Obtain the correspondence between head width and pixel position corresponding to the calibrated binocular fusion distance; based on the correspondence, obtain the target pixel position corresponding to the user's head width; Obtain the correspondence between head width and pixel position offset corresponding to the calibrated binocular fusion distance; obtain the target pixel position offset corresponding to the user's head width based on the correspondence; determine the target pixel position based on the target pixel position offset and the preset pixel position corresponding to the calibrated binocular fusion distance; Obtain the correspondence between head width category and pixel position corresponding to the calibrated binocular fusion distance; based on the correspondence, obtain the target pixel position corresponding to the user's head width category; Obtain the correspondence between the head width category and the pixel position offset corresponding to the calibrated binocular fusion distance; obtain the target pixel position offset corresponding to the user's head width category based on the correspondence; determine the target pixel position based on the target pixel position offset and the preset pixel position corresponding to the calibrated binocular fusion distance.

[0017] Optionally, the acquisition of the user's head width can be achieved using any of the following methods: Obtain the head width data input by the user; The user's head width is obtained based on the facial image of the user wearing the augmented reality glasses.

[0018] Optionally, obtaining the target pixel position includes: Display a virtual image corresponding to the target pattern card, which is located on the world-facing side of the augmented reality glasses; Obtain the first pixel position related data marker of the left eye image of the virtual image at the alignment position on the target pattern card, and the second pixel position related data marker of the right eye image of the virtual image at the alignment position on the target pattern card; The target pixel position is obtained based on the first pixel position related data marker and the second pixel position related data marker.

[0019] Optional, also includes: Display the target location of the target pattern card.

[0020] Optionally, obtaining the target pixel position includes: Obtain the binocular fusion distance input by the user; The target pixel position is obtained based on the difference between the binocular merging distance and the calibrated binocular merging distance.

[0021] Optional, also includes: Obtain the adjusted binocular fusion distance input by the user; The target pixel position is obtained based on the difference between the adjusted binocular merging distance and the calibrated binocular merging distance.

[0022] This application provides a binocular merging distance calibration device, comprising: The calibration range acquisition unit is used to acquire the adjustment range of the pixel position of the virtual image used for calibrating the binocular merging distance level, and to use it as the pixel position adjustment range for level calibration. The pixel position acquisition unit is used to acquire the target pixel position that matches the user's head width and corresponds to the calibrated binocular fusion distance level, based on the pixel position adjustment range calibrated by the gear level. The pixel position adjustment unit is used to adjust the pixel position corresponding to the calibrated binocular fusion distance level to the target pixel position, so that the binocular fusion distance of the augmented reality glasses worn by the user with the user's head width is the calibrated binocular fusion distance level.

[0023] This application provides augmented reality glasses, including: Processor; and A memory for storing a program for implementing the method described in any of the above descriptions, wherein the augmented reality glasses are powered on and the program for running the method is executed by the processor.

[0024] Compared with the prior art, this application has the following advantages: The binocular fusion distance calibration method provided in this application obtains the adjustment range of the virtual image pixel position used for calibrating the binocular fusion distance level as the pixel position adjustment range for level calibration; according to the pixel position adjustment range for level calibration, obtains the target pixel position that matches the user's head width and corresponds to the calibrated binocular fusion distance level; adjusts the pixel position corresponding to the calibrated binocular fusion distance level to the target pixel position, so that the binocular fusion distance of a user with the user's head width wearing augmented reality glasses is the calibrated binocular fusion distance level. This approach ensures that when a user's head width does not match the calibrated binocular focusing distance setting of the augmented reality (AR) glasses, the glasses can automatically adjust the pixel position within the calibrated pixel position adjustment range to the target pixel position where the user's binocular focusing distance matches the calibrated setting. In other words, binocular focusing distance calibration is achieved by adjusting the pixel offset of the display module. This ensures that people with different head widths have the same viewing effect at the calibrated binocular focusing distance setting, providing better applicability for different users and avoiding significant perceived discrepancies in focusing distance between different individuals. Because this approach prevents users from adjusting the binocular focusing distance setting to achieve the same calibrated setting for users with different head widths, it avoids misuse of the binocular focusing distance adjustment function and effectively improves the calibration accuracy of the calibrated binocular focusing distance. Attached Figure Description

[0025] Figure 1 This is a schematic flowchart of an embodiment of the binocular merging distance calibration method provided in this application; Figure 2 This is a schematic diagram of pixel position adjustment in an embodiment of the binocular merging distance calibration method provided in this application; Figure 3 This is a schematic diagram of the use of an embodiment of the binocular merging distance calibration method provided in this application. Detailed Implementation

[0026] Many specific details are set forth in the following description to provide a full understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this application; therefore, this application is not limited to the specific embodiments disclosed below.

[0027] This application provides a binocular merging distance calibration method and apparatus, as well as augmented reality glasses. The various solutions are described in detail below in each embodiment.

[0028] First Embodiment Please refer to Figure 1 This is a schematic flowchart of the binocular fusion distance calibration method of this application. In this embodiment, the binocular fusion distance calibration method includes the following steps: Step S101: Obtain the adjustment range of the virtual image pixel position used for calibrating the binocular merging distance level, and use it as the pixel position adjustment range for level calibration.

[0029] Augmented reality glasses can include one or more binocular focusing distance settings. Glasses supporting multiple settings can adapt to different usage scenarios. For example, glasses model A supports multiple focusing distance settings from 2 to 10 meters, while glasses model B supports image distance adjustment from 1 to 10 meters. Glasses using a single-vision camera mostly have a fixed focusing distance and do not have focusing distance adjustment functionality.

[0030] The calibrated binocular fusion distance setting for augmented reality glasses is a reference distance for binocular fusion determined through specific technical means during factory manufacturing or adjustment. This ensures accurate fusion of the virtual images for both eyes and serves as a reference standard for subsequent fusion distance adjustments. For example, the calibrated fusion distance for a certain pair of glasses, model C, is 3.97 meters. This is the reference distance for accurate fusion of the virtual images for both eyes. It is a fixed reference value determined by the manufacturer through processes such as capturing characteristic images projected by the glasses using professional equipment and calculating the left-right deviation of feature points in the left and right eye images. At this distance, issues such as ghosting and dizziness are better avoided, providing users with a clear imaging effect that conforms to human visual habits.

[0031] The binocular merging distance of augmented reality glasses is related to the display position of virtual image pixels (hereinafter referred to as virtual image pixel position). By adjusting the virtual image pixel position, the correspondence between feature points of the left and right eye images can be changed, thereby adjusting the merging distance. The method provided in this application embodiment sets an adjustment range for the virtual image pixel position used to calibrate the binocular merging distance level. For ease of description, this adjustment range is simply referred to as the pixel position adjustment range for level calibration.

[0032] The augmented reality glasses in this embodiment support binocular merging distance calibration. In one example, these glasses also support multiple levels of binocular merging distance adjustment. Users can manually switch between specific levels, such as a 1-meter level for near-field prompting scenarios and a 3-meter level for distant navigation scenarios. Adjusting the binocular merging distance level includes: obtaining the adjustment range of the virtual image pixel position used to adjust the binocular merging distance level, as the pixel position adjustment range for level adjustment. In specific implementations, the pixel position adjustment range for level "adjustment" and the pixel position adjustment range for level "calibration" in this embodiment may not overlap, making the pixel adjustment ranges for level adjustment and merging distance calibration independent and without conflict; based on the pixel position adjustment range for level adjustment and the virtual image pixel position of the current binocular merging distance level, the virtual image pixel position of the target binocular merging distance level is obtained. It should be noted that in specific implementations, the pixel position adjustment range for level "adjustment" and the pixel position adjustment range for level "calibration" in this embodiment may also overlap.

[0033] like Figure 2 As shown, the pixel position adjustment range includes a white area and a shaded area. The white area represents the pixel position adjustment range for level calibration, while the shaded area represents the pixel position adjustment range for level adjustment. The pixel position adjustment range for level adjustment can be moved within the pixel position adjustment range for level calibration, thereby allowing calibration of the image distance at any level. The white area represents all available compensation pixels for calibrating the image distance; the shaded area represents all available adjustable pixels for adjusting the image distance level.

[0034] Step S103: Based on the pixel position adjustment range of the gear calibration, obtain the target pixel position that matches the user's head width and corresponds to the calibrated binocular merging distance gear.

[0035] The method provided in this application embodiment automatically obtains a target pixel position corresponding to the calibrated binocular merging distance level that matches the user's head width when the user's head width does not match the calibrated binocular merging distance level of the augmented reality glasses, according to the pixel position adjustment range calibrated by the level in step S103. The target pixel position is within the pixel position adjustment range calibrated by the level.

[0036] In one example, the method provided in this application embodiment may further include the following steps: obtaining user usage data of multiple binocular fusion distance levels of augmented reality glasses; determining, based on the usage data, whether there is a binocular fusion distance level adjustment operation that may be related to the user's head width; step S103 may be implemented in the following manner: if the above determination result is yes, then the target pixel position is obtained based on the pixel position adjustment range of the level calibration.

[0037] User usage data for multiple binocular merging distance settings of augmented reality glasses, including data on multiple adjustments made by the user to the merging distance settings while using the glasses. The system determines whether any of these adjustments are related to the user's head width. If such adjustments are found, step S103 is executed to obtain the target pixel position based on the pixel position adjustment range specified in the merging distance calibration. This processing method automatically triggers merging distance calibration based on user usage data for multiple binocular merging distance settings of the augmented reality glasses; therefore, it effectively improves the efficiency of merging distance calibration, thereby enhancing the user experience.

[0038] In one example, the usage data includes a first correspondence between binocular merging distance settings and usage scenarios; determining whether there is a binocular merging distance setting adjustment operation that may be related to the user's head width based on the usage data includes: obtaining a second correspondence between binocular merging distance settings and calibrated usage scenarios; obtaining the usage frequency of binocular merging distance settings that do not match the calibrated usage scenarios based on the first and second correspondences; and determining whether there is a binocular merging distance setting adjustment operation that may be related to the user's head width based on the usage frequency.

[0039] In practical applications, glasses supporting multi-level adjustment can establish a second correspondence between binocular merging distance levels and calibrated usage scenarios. Different levels are set for different usage scenarios, and selecting the level corresponding to the usage scenario allows for a more suitable viewing distance. However, when the user's head width does not match the calibrated merging distance level, the user will adjust the binocular merging distance level of the augmented reality glasses to obtain a clearer and more comfortable viewing distance. In this case, the usage data, including the first correspondence between the binocular merging distance level and the actual usage scenario, can be recorded. Multiple adjustments form multiple first correspondences. The actual usage scenario may not conform to the second correspondence with the selected binocular merging distance level. For example, according to the second correspondence, actual usage scenario A should correspond to level 1, but the user actually selects level 3 in actual usage scenario A. Based on the first and second correspondences, the frequency of use of binocular merging distance levels that do not match the calibrated usage scenario can be obtained; based on the usage frequency, it can be determined whether there are binocular merging distance level adjustments that may be related to the user's head width. For example, when the frequency of use exceeds a frequency threshold, it is determined that there is a binocular fusion distance adjustment operation that may be related to the user's head width.

[0040] The method provided in this application embodiment obtains a second correspondence between binocular merging distance settings and calibrated usage scenarios; based on the second correspondence and a first correspondence included in the usage data, it obtains the usage frequency of binocular merging distance settings that do not match the calibrated usage scenarios; based on the usage frequency, it determines whether there is a binocular merging distance setting adjustment operation that may be related to the user's head width. This processing method enables automatic triggering of merging distance calibration based on usage scenario and merging distance settings data; therefore, it can effectively improve the efficiency of merging distance calibration, thereby enhancing the user experience.

[0041] In one example, determining whether there is a binocular merging distance adjustment operation that may be related to the user's head width based on the usage data includes: obtaining the user's commonly used binocular merging distance setting based on the usage data; and determining whether there is a binocular merging distance adjustment operation that may be related to the user's head width based on the commonly used binocular merging distance setting and the calibrated binocular merging distance setting of the augmented reality glasses. This processing method allows the user's commonly used merging distance to be identified from the usage data. Since the commonly used merging distance is not the calibrated merging distance, it can be determined that there is a binocular merging distance adjustment operation that may be related to the user's head width. For example, if the calibrated setting is 4 meters, and the user repeatedly adjusts to the 6-meter setting during daily use, it may be due to the user's head width not matching the calibrated merging distance.

[0042] In one example, the method provided in this application embodiment may further include the following steps: if the above determination result is yes, then display information prompting the user to enable binocular sync distance calibration; if the user enables the binocular sync distance calibration, then perform a pixel position adjustment range based on the calibrated setting to obtain the target pixel position. This processing method ensures that after determining that there is a binocular sync distance setting adjustment operation that may be related to the user's head width, information is displayed to the user, informing them that the user's head width and the calibrated sync distance may not be compatible, reminding them to enable the sync distance calibration function, allowing the user to decide whether to perform sync distance calibration; therefore, it can effectively improve the user experience.

[0043] In practice, prompting users to enable binocular merging distance calibration may be due to a mismatch between the binocular merging distance setting and the current usage scenario, affecting the user's viewing experience. Alternatively, it could be due to a mismatch between the commonly used binocular merging distance setting and the calibrated binocular merging distance setting, etc.

[0044] In one example, the method provided in this application embodiment may further include the following step: obtaining a user instruction to calibrate the binocular synchrotron distance of the augmented reality glasses. This processing method enables the user to trigger the synchrotron distance calibration function; therefore, it can effectively improve the user experience. In specific implementation, the glasses can provide an option to enable synchrotron distance calibration; when the user selects this option, the glasses can obtain the corresponding user instruction.

[0045] In one example, the method provided in this application embodiment may further include the following steps: detecting whether the augmented reality glasses are malfunctioning; if so, obtaining the target pixel position based on the pixel position adjustment range of the calibrated level. In specific implementation, due to device malfunctions, the actual image-to-image distance generated by the user viewing virtual images while wearing glasses may deviate from the calibrated image-to-image distance, requiring image-to-image distance calibration. This approach automatically triggers the image-to-image distance calibration function when an abnormality occurs during AR glasses use and recalibration of the image-to-image distance is required. This eliminates the need for repair and calibration at the factory; instead, calibration can be easily completed by the user themselves. Therefore, it effectively improves image-to-image distance calibration efficiency, thereby enhancing the user experience.

[0046] In one example, the method provided in this application embodiment may further include the following steps: recording the correspondence between multiple user head widths and the pixel positions corresponding to the calibrated binocular fusion distance levels; obtaining the target user head width; obtaining the target pixel position corresponding to the target user head width according to the correspondence; and displaying a virtual image at the target pixel position so that the binocular fusion distance of the target user wearing augmented reality glasses is the calibrated binocular fusion distance level. By adopting this processing method, after calibrating the fusion distance for any user head width, the correspondence between the user head width and the corresponding target pixel position is stored. Thus, when different users use the same glasses, based on this correspondence, the virtual image is displayed at the target pixel position corresponding to the user's head width; therefore, the utilization rate of the glasses can be effectively improved.

[0047] In one example, the method provided in this application embodiment may further include the following steps: recording the correspondence between multiple users and the pixel positions corresponding to the calibrated binocular fusion distance level; obtaining a target user; obtaining the target pixel position corresponding to the target user according to the correspondence; and displaying a virtual image at the target pixel position so that the binocular fusion distance of the target user wearing augmented reality glasses is the calibrated binocular fusion distance level. This processing method allows the correspondence between the user and the corresponding target pixel position to be stored after calibrating the fusion distance for any user's head width. Thus, when different users use the same glasses, the virtual image is displayed at the target pixel position corresponding to that user based on this correspondence; therefore, the utilization rate of the glasses can be effectively improved.

[0048] In one example, the method provided in this application embodiment may further include the following steps: obtaining the user's head width; correspondingly, obtaining the target pixel position can be achieved by: obtaining the correspondence between the head width and pixel position corresponding to the calibrated binocular fusion distance; and obtaining the target pixel position corresponding to the user's head width based on the correspondence. This processing method enables the pixel position corresponding to the calibrated binocular fusion distance to be determined based on a pre-configured correspondence between the head width and pixel position corresponding to the calibrated binocular fusion distance.

[0049] In one example, the method provided in this application embodiment may further include the following steps: obtaining the user's head width; correspondingly, obtaining the target pixel position, implemented in the following manner: obtaining the correspondence between the head width and pixel position offset corresponding to the calibrated binocular fusion distance; obtaining the target pixel position offset corresponding to the user's head width according to the correspondence; determining the target pixel position according to the target pixel position offset and the preset pixel position corresponding to the calibrated binocular fusion distance. For example, if the target pixel position offset is -8 (offset 8 pixels to the left) and the preset pixel position is 25, then the target pixel position is 17. This processing method enables the pixel position at the calibrated binocular fusion distance corresponding to the user's head width to be determined based on the pre-configured correspondence between the head width and pixel position offset corresponding to the calibrated binocular fusion distance.

[0050] In one example, obtaining the user's head width can be achieved by acquiring the head width data input by the user. This processing method allows the user to directly input head width data; therefore, it can effectively improve the accuracy of the user's head width data, thereby improving the image alignment accuracy.

[0051] In another example, obtaining the user's head width can be achieved by acquiring the user's head width based on a facial image of the user wearing the augmented reality glasses. This approach allows for the prediction of the user's head width data by acquiring a facial image and considering the positional relationship between the glasses and facial feature bits; therefore, it can effectively improve the user experience.

[0052] In one example, the method provided in this application embodiment may further include the following steps: obtaining the user's head width category; correspondingly, obtaining the target pixel position, implemented in the following manner: obtaining the correspondence between the head width category and the pixel position corresponding to the calibrated binocular merging distance; obtaining the target pixel position corresponding to the user's head width category according to the correspondence. This processing method allows the pixel position of the calibrated binocular merging distance corresponding to the user's head width to be determined based on a pre-configured correspondence between the head width category and the pixel position corresponding to the calibrated binocular merging distance. Compared to merging distance calibration based on user head width data, this processing method can effectively reduce data configuration costs.

[0053] In one example, the method provided in this application embodiment may further include the following steps: obtaining the user's head width category; correspondingly, obtaining the target pixel position, implemented in the following manner: obtaining the correspondence between the head width category and the pixel position offset corresponding to the calibrated binocular merging distance; obtaining the target pixel position offset corresponding to the user's head width category according to the correspondence; determining the target pixel position according to the target pixel position offset and the preset pixel position corresponding to the calibrated binocular merging distance. This processing method allows the pixel position of the calibrated binocular merging distance corresponding to the user's head width to be determined based on the pre-configured correspondence between the head width category and the pixel position offset corresponding to the calibrated binocular merging distance. Compared to merging distance calibration based on user head width data, this processing method can effectively reduce data configuration costs.

[0054] like Figure 2 As shown, head width is divided into three categories: small head width, medium head width, and large head width. The total range of pixel position adjustment includes a white area and a shaded area. The white area represents the pixel position adjustment range for level calibration, including all available compensation (calibrating the image distance) pixels. The shaded area represents the pixel position adjustment range for level adjustment, including all available adjustment (adjusting the image distance level) pixels. The pixel position adjustment range for level adjustment can be moved within the pixel position adjustment range of level calibration. The middle pixel position diagram corresponds to the medium head width group. The pixel position corresponding to the middle dotted vertical line is the initial pixel position for calibrating the image distance, which is the initial position marked by the manufacturer when the glasses are manufactured. The pixel position diagram on the left corresponds to the small head width group. The pixel position for calibrating the image distance is shifted to the left. This shift is called the compensation pixel, and the difference between the center after compensation and the factory-calibrated initial position is the offset. The pixel position diagram on the right corresponds to the large head width group. The pixel position for calibrating the image distance is shifted to the right. This offset is the compensation pixel.

[0055] In one example, obtaining the user's head width category can be achieved by obtaining the head width category input by the user. This approach allows the user to directly input the head width category; therefore, it effectively improves the accuracy of the user's head width category, thereby improving the image merging distance calibration accuracy.

[0056] In another example, obtaining the user's head width category can be achieved by acquiring the user's head width category based on a facial image of the user wearing the augmented reality glasses. This approach allows for the prediction of the user's head width category by capturing a facial image and considering the positional relationship between the glasses and facial feature bits; therefore, it can effectively improve the user experience.

[0057] In one example, obtaining the target pixel position includes: displaying a virtual image corresponding to a target pattern card, the target pattern card being located on the world-facing side of the augmented reality glasses; obtaining a first pixel position-related data marker at the alignment position of the left eye image of the virtual image on the target pattern card, and a second pixel position-related data marker at the alignment position of the right eye image of the virtual image on the target pattern card; and obtaining the target pixel position based on the first pixel position-related data marker and the second pixel position-related data marker. This processing method eliminates the need to input the user's head width or capture a user's facial image to obtain the target pixel position; therefore, it effectively improves the user experience.

[0058] Figure 3 The diagram shows the shape of the target pattern card. The card is placed at a designated position on the outside of glasses, which project a virtual image corresponding to the card onto the left and right display screens. The system acquires pixel position data marker A (the first pixel position data marker) for the alignment position of the virtual image on the left screen with the card, and pixel position data marker B (the second pixel position data marker) for the alignment position of the virtual image on the right screen with the card. The target pixel position can be obtained based on markers A and B. The pixel position data marked on the card can be the pixel position itself, pixel position offset, or other data related to pixel position.

[0059] In one example, the method provided in this application embodiment may further include the following step: displaying the target position of the target pattern card. This approach can guide the user to place the target pattern card in a suitable position to obtain accurate first mark A and second mark B, thereby improving the accuracy of the target pixel position.

[0060] In one example, obtaining the target pixel position includes: obtaining the binocular merging distance input by the user; and obtaining the target pixel position based on the difference between the binocular merging distance and the calibrated binocular merging distance. This processing method allows the user to directly input their perceived actual merging distance and adjust the pixel position of the calibrated merging distance directly based on the difference between the actual and calibrated merging distances; therefore, it can effectively improve the calibration efficiency of the merging rate.

[0061] In one example, the method provided in this application embodiment may further include the following steps: obtaining the adjusted binocular merging distance input by the user; and obtaining the target pixel position based on the difference between the adjusted binocular merging distance and the calibrated binocular merging distance. This processing method allows the user to directly input the perceived actual calibrated merging distance after calibrating the merging distance, and directly adjust the pixel position of the calibrated merging distance based on the difference between the actual calibrated merging distance and the calibrated merging distance, thereby forming a closed-loop calibration of the merging distance; therefore, the calibration efficiency of the merging rate can be further improved.

[0062] Step S105: Adjust the pixel position corresponding to the calibrated binocular fusion distance level to the target pixel position, so that the binocular fusion distance of the augmented reality glasses worn by the user with the user's head width is the calibrated binocular fusion distance level.

[0063] This step adjusts the pixel position corresponding to the calibrated binocular merging distance level (such as the initial pixel position or the pixel position after one calibration) to the target pixel position of the calibrated binocular merging distance level when the user wears the augmented reality glasses. The binocular merging distance is calibrated by adjusting the pixel offset of the display module. This ensures that people with different head widths have the same viewing effect at the calibrated binocular merging distance level, achieving better applicability for different users and avoiding obvious perceptual deviations in merging distance when different people wear them.

[0064] As can be seen from the above embodiments, the binocular fusion distance calibration method provided in this application obtains the adjustment range of the virtual image pixel position used for calibrating the binocular fusion distance level as the pixel position adjustment range for level calibration; according to the pixel position adjustment range for level calibration, obtains the target pixel position that matches the user's head width and corresponds to the calibrated binocular fusion distance level; adjusts the pixel position corresponding to the calibrated binocular fusion distance level to the target pixel position, so that the binocular fusion distance of a user with the user's head width wearing augmented reality glasses is the calibrated binocular fusion distance level. This processing method allows the augmented reality glasses to automatically adjust the pixel position corresponding to the calibrated binocular focusing distance setting within the pixel position adjustment range of the setting, so that the binocular focusing distance of the user's augmented reality glasses matches the calibrated setting, even when the user's head width does not match the calibrated binocular focusing distance setting. In other words, binocular focusing distance calibration is achieved by adjusting the pixel offset of the display module. This ensures that people with different head widths have the same viewing effect at the calibrated binocular focusing distance setting, providing better applicability for different users and avoiding significant perceived discrepancies in focusing distance between different individuals. Because this method prevents users from manually adjusting the binocular focusing distance setting to achieve the calibrated setting, it avoids misuse of the binocular focusing distance adjustment function and effectively improves the calibration accuracy of the calibrated binocular focusing distance.

[0065] Second Embodiment In the above embodiments, a binocular synchro distance calibration method is provided. Correspondingly, this application also provides a binocular synchro distance calibration device. This device corresponds to the above method embodiments. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The embodiments of the binocular synchro distance calibration device described below are merely illustrative.

[0066] This application also provides a binocular fusion distance calibration device, comprising: a calibration range acquisition unit, a pixel position acquisition unit, and a pixel position adjustment unit. The calibration range acquisition unit is used to acquire an adjustment range for the pixel position of a virtual image used to calibrate and set binocular fusion distance levels, serving as the pixel position adjustment range for level calibration. The pixel position acquisition unit is used to acquire a target pixel position corresponding to the calibrated binocular fusion distance level, matching the user's head width, based on the pixel position adjustment range for level calibration. The pixel position adjustment unit is used to adjust the pixel position corresponding to the calibrated binocular fusion distance level to the target pixel position, such that the binocular fusion distance of a user with the specified head width wearing augmented reality glasses is the calibrated binocular fusion distance level.

[0067] In one example, the device further includes: a user data acquisition unit, a judgment unit, and a first target pixel position acquisition unit. The user data acquisition unit is used to acquire user usage data for multiple binocular fusion distance settings of the augmented reality glasses; the judgment unit is used to determine, based on the usage data, whether there is a binocular fusion distance setting adjustment operation that may be related to the user's head width; and the first target pixel position acquisition unit is used to acquire the target pixel position based on the pixel position adjustment range calibrated by the setting if the judgment result is yes.

[0068] In one example, the usage data includes a first correspondence between binocular merging distance settings and actual usage scenarios; the judgment unit is specifically used to obtain a second correspondence between binocular merging distance settings and calibrated usage scenarios; based on the first and second correspondences, obtain the usage frequency of binocular merging distance settings that do not match the calibrated usage scenarios; based on the usage frequency, determine whether there are binocular merging distance setting adjustment operations that may be related to the user's head width.

[0069] In one example, the judgment unit is specifically used to obtain the user's commonly used binocular fusion distance setting based on the usage data; and to determine whether there is a binocular fusion distance setting adjustment operation that may be related to the user's head width based on the commonly used binocular fusion distance setting and the calibrated binocular fusion distance setting of the augmented reality glasses.

[0070] In one example, the device further includes: a prompt information display unit and a calibration activation unit. The prompt information display unit is used to display information prompting the user to activate binocular merging distance calibration if the above determination result is yes; the calibration activation unit is used to, if the user activates the binocular merging distance calibration, perform a pixel position adjustment range based on the calibrated gear level to obtain the target pixel position.

[0071] In one example, the information prompting the user to enable binocular fusion distance calibration includes: the binocular fusion distance setting does not match the current usage scenario, and the commonly used binocular fusion distance setting does not match the calibrated binocular fusion distance setting.

[0072] Optionally, adjusting the binocular merging distance level includes: obtaining an adjustment range of the virtual image pixel position used to adjust the binocular merging distance level, as the pixel position adjustment range for level adjustment; the pixel position adjustment range for level adjustment and the pixel position adjustment range for level calibration do not overlap; obtaining the virtual image pixel position of the target binocular merging distance level based on the pixel position adjustment range for level adjustment and the virtual image pixel position of the current binocular merging distance level.

[0073] In one example, the device further includes a user instruction acquisition unit for acquiring user instructions to calibrate the binocular fusion distance of the augmented reality glasses.

[0074] In one example, the device further includes: an anomaly detection unit for detecting whether the augmented reality glasses are malfunctioning; if so, obtaining the target pixel position based on the pixel position adjustment range calibrated by the gear level.

[0075] In one example, the device further includes: a first correspondence recording unit, a user head width acquisition unit, a second target pixel position acquisition unit, and a first virtual image display unit. The first correspondence recording unit is used to record the correspondence between multiple user head widths and pixel positions corresponding to calibrated binocular fusion distance levels; the user head width acquisition unit is used to acquire the target user head width; the second target pixel position acquisition unit is used to acquire the target pixel position corresponding to the target user head width according to the correspondence; and the first virtual image display unit is used to display a virtual image at the target pixel position, so that the binocular fusion distance of the target user wearing augmented reality glasses is the calibrated binocular fusion distance level.

[0076] In one example, the device further includes: a second correspondence recording unit, a target user acquisition unit, a third target pixel position acquisition unit, and a second virtual image display unit. The second correspondence recording unit is used to record the correspondence between multiple users and pixel positions corresponding to a calibrated binocular fusion distance level; the target user acquisition unit is used to acquire a target user; the third target pixel position acquisition unit is used to acquire the target pixel position corresponding to the target user based on the correspondence; and the second virtual image display unit is used to display a virtual image at the target pixel position, so that the binocular fusion distance of the target user wearing augmented reality glasses is the calibrated binocular fusion distance level.

[0077] In one example, the device further includes: a head width information acquisition unit, configured to acquire the user's head width or user head width category; acquire the target pixel position, implemented in one of the following ways: 1) acquire the correspondence between head width and pixel position corresponding to the calibrated binocular fusion distance; acquire the target pixel position corresponding to the user's head width according to the correspondence; 2) acquire the correspondence between head width and pixel position offset corresponding to the calibrated binocular fusion distance; acquire the target pixel position offset corresponding to the user's head width according to the correspondence; 3) Determine the target pixel position based on the target pixel position offset and the preset pixel position corresponding to the calibrated binocular fusion distance; 4) Obtain the correspondence between the head width category and the pixel position corresponding to the calibrated binocular fusion distance; Obtain the target pixel position corresponding to the user's head width category based on the correspondence; 5) Obtain the correspondence between the head width category and the pixel position offset corresponding to the calibrated binocular fusion distance; Obtain the target pixel position offset corresponding to the user's head width category based on the correspondence; Determine the target pixel position based on the target pixel position offset and the preset pixel position corresponding to the calibrated binocular fusion distance.

[0078] In one example, obtaining the user's head width can be achieved in any of the following ways: 1) obtaining the head width data input by the user; 2) obtaining the user's head width based on the facial image of the user wearing the augmented reality glasses.

[0079] In one example, obtaining the target pixel position includes: displaying a virtual image corresponding to a target pattern card, the target pattern card being located on the world-facing side of the augmented reality glasses; obtaining a first pixel position related data marker at the alignment position of the left eye image of the virtual image on the target pattern card, and a second pixel position related data marker at the alignment position of the right eye image of the virtual image on the target pattern card; and obtaining the target pixel position based on the first pixel position related data marker and the second pixel position related data marker.

[0080] In one example, the device further includes a card position display unit for displaying the target position of the target pattern card.

[0081] In one example, obtaining the target pixel position includes: obtaining the binocular merging distance input by the user; and obtaining the target pixel position based on the difference between the binocular merging distance and the calibrated binocular merging distance.

[0082] In one example, the device further includes: a user input acquisition unit for acquiring the adjusted binocular fusion distance input by the user; and an optimization unit for acquiring the target pixel position based on the difference between the adjusted binocular fusion distance and the calibrated binocular fusion distance.

[0083] Third Embodiment In the above embodiments, a binocular merging distance calibration method is provided. Correspondingly, this application also provides augmented reality glasses. These augmented reality glasses correspond to the method embodiments described above. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple; relevant details can be found in the descriptions of the method embodiments. The following description of the augmented reality glasses embodiments is merely illustrative.

[0084] This application also provides augmented reality glasses, including: a memory and a processor; the memory is used to store a program for implementing a binocular fusion distance calibration method, and the augmented reality glasses are powered on and run the program of the binocular fusion distance calibration method through the processor.

[0085] Memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0086] In specific implementations, the electronic device may further include one or more of the following components: a power supply component, an input / output (I / O) interface, and a communication component. The power supply component provides power to various components of the electronic device. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device. The I / O interface provides an interface between the processor 503 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. The communication component is configured to facilitate wired or wireless communication between the electronic device and user devices (such as smartphones, tablets, etc.).

[0087] Fourth embodiment This application also provides a computer-readable storage medium. Since the embodiments of the computer-readable storage medium are substantially similar to the method embodiments, the description is relatively simple; relevant details can be found in the description of the method embodiments. The computer-readable storage medium embodiments described below are merely illustrative.

[0088] In this embodiment, a non-transitory computer-readable storage medium including instructions is provided, such as a memory including instructions, which can be executed by a processor of an electronic device to complete the binocular merging distance calibration method provided in this disclosure. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0089] It should be noted that the embodiments of this application may involve the use of user data. In practical applications, user-specific personal data may be used in the scheme described herein within the scope permitted by applicable laws and regulations, provided that it complies with the applicable laws and regulations of the country (e.g., with the user's explicit consent, with the user being properly notified, etc.).

[0090] Although this application discloses preferred embodiments as described above, it is not intended to limit this application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of this application. Therefore, the scope of protection of this application should be determined by the scope defined in the claims of this application.

[0091] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0092] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0093] 1. Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include non-transitory computer-readable media, such as modulated data signals and carrier waves.

[0094] 2. Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

Claims

1. A binocular image merging distance calibration method, characterized in that, include: Obtain the adjustment range of the virtual image pixel position used for calibrating the binocular merging distance level, and use it as the pixel position adjustment range for level calibration; Based on the pixel position adjustment range of the gear calibration, obtain the target pixel position that matches the user's head width and corresponds to the calibrated binocular merging distance gear. The pixel position corresponding to the calibrated binocular fusion distance level is adjusted to the target pixel position, so that the binocular fusion distance of a user with the specified head width wearing augmented reality glasses is the calibrated binocular fusion distance level.

2. The method according to claim 1, characterized in that, Also includes: Acquire user data on multiple binocular focusing distance settings for augmented reality glasses; Based on the usage data, determine whether there is a binocular fusion distance adjustment operation that may be related to the user's head width; The step of obtaining the target pixel position corresponding to the calibrated binocular merging distance level that matches the user's head width, based on the pixel position adjustment range calibrated according to the gear level, includes: If the above judgment result is yes, then the target pixel position is obtained according to the pixel position adjustment range of the gear calibration.

3. The method according to claim 2, characterized in that, The usage data includes a first correspondence between binocular fusion distance settings and actual usage scenarios; The step of determining whether there is a binocular fusion distance adjustment operation that may be related to the user's head width based on the usage data includes: Obtain the second correspondence between binocular fusion distance levels and calibrated usage scenarios; Based on the first and second correspondences, obtain the usage frequency of binocular fusion distance levels that do not match the calibrated usage scenarios; Based on the frequency of use, determine whether there is any binocular focusing distance adjustment operation that may be related to the user's head width.

4. The method according to claim 2, characterized in that, The step of determining whether there is a binocular fusion distance adjustment operation that may be related to the user's head width based on the usage data includes: Based on the usage data, obtain the binocular fusion distance settings commonly used by the user; Based on the commonly used binocular fusion distance settings and the calibrated binocular fusion distance settings of augmented reality glasses, determine whether there is a binocular fusion distance setting adjustment operation that may be related to the user's head width.

5. The method according to claim 2, characterized in that, Also includes: If the above judgment result is yes, then a message prompting the user to enable binocular fusion distance calibration will be displayed; If the user enables the binocular merging distance calibration, then the pixel position adjustment range based on the calibrated gear level is executed to obtain the target pixel position.

6. The method according to claim 5, characterized in that, The information prompting the user to enable binocular merging distance calibration includes: the binocular merging distance setting does not match the current usage scenario, and the commonly used binocular merging distance setting does not match the calibrated binocular merging distance setting.

7. The method according to claim 2, characterized in that, Adjusting the binocular merging distance setting includes: The adjustment range of the virtual image pixel position used to adjust the binocular merging distance level is obtained as the pixel position adjustment range for level adjustment; the pixel position adjustment range for level adjustment and the pixel position adjustment range for level calibration do not overlap. Based on the pixel position adjustment range of the gear adjustment and the virtual image pixel position of the current binocular fusion distance gear, obtain the virtual image pixel position of the target binocular fusion distance gear.

8. The method according to claim 1, characterized in that, Also includes: Obtain user instructions to calibrate the binocular fusion distance of augmented reality glasses.

9. The method according to claim 1, characterized in that, Also includes: Detect any abnormalities in the augmented reality glasses; If so, the target pixel position is obtained according to the pixel position adjustment range of the gear calibration.

10. The method according to claim 1, characterized in that, Also includes: Record the correspondence between the pixel positions of multiple user head widths and the calibrated binocular fusion distance levels; Obtain the target user's head width; Based on the correspondence, obtain the target pixel position corresponding to the target user's head width; A virtual image is displayed at the target pixel location, with the binocular merging distance of the target user wearing augmented reality glasses serving as the calibrated binocular merging distance level.

11. The method according to claim 1, characterized in that, Also includes: Obtain the user's head width or user's head width category; The target pixel position can be obtained using one of the following methods: Obtain the correspondence between head width and pixel position corresponding to the calibrated binocular fusion distance; based on the correspondence, obtain the target pixel position corresponding to the user's head width; Obtain the correspondence between head width and pixel position offset corresponding to the calibrated binocular fusion distance; based on the correspondence, obtain the target pixel position offset corresponding to the user's head width; The target pixel position is determined based on the target pixel position offset and the preset pixel position corresponding to the calibrated binocular image merging distance; Obtain the correspondence between head width category and pixel position corresponding to the calibrated binocular fusion distance; Based on the correspondence, obtain the target pixel position corresponding to the user head width category; Obtain the correspondence between the head width category and the pixel position offset corresponding to the calibrated binocular fusion distance; based on the correspondence, obtain the target pixel position offset corresponding to the user's head width category; The target pixel position is determined based on the target pixel position offset and the preset pixel position corresponding to the calibrated binocular image merging distance.

12. The method according to claim 1, characterized in that, Obtaining the target pixel position includes: Display a virtual image corresponding to the target pattern card, which is located on the world-facing side of the augmented reality glasses; Obtain the first pixel position related data marker of the left eye image of the virtual image at the alignment position on the target pattern card, and the second pixel position related data marker of the right eye image of the virtual image at the alignment position on the target pattern card; The target pixel position is obtained based on the first pixel position related data marker and the second pixel position related data marker.

13. A binocular image merging distance calibration device, characterized in that, include: The calibration range acquisition unit is used to acquire the adjustment range of the pixel position of the virtual image used for calibrating the binocular merging distance level, and to use it as the pixel position adjustment range for level calibration. The pixel position acquisition unit is used to acquire the target pixel position that matches the user's head width and corresponds to the calibrated binocular fusion distance level, based on the pixel position adjustment range calibrated by the gear level. The pixel position adjustment unit is used to adjust the pixel position corresponding to the calibrated binocular fusion distance level to the target pixel position, so that the binocular fusion distance of the augmented reality glasses worn by the user with the user's head width is the calibrated binocular fusion distance level.

14. An augmented reality glasses, characterized in that, include: processor; as well as A memory for storing a program for implementing the method according to any one of claims 1 to 12, wherein the augmented reality glasses are powered on and the program for running the method is executed by the processor.

Images