A calibration method and system of an AR glasses, an electronic device and a storage medium

By collecting eye data and visual measurements from the wearer, the display parameters and brightness of the AR glasses are adjusted, solving the problem of insufficient display quality in existing AR glasses technologies and achieving more realistic image display and a better user experience.

CN118534656BActive Publication Date: 2026-01-27GOERTEK INC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202410705208.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-05-31
Publication Date
2026-01-27
Estimated Expiration
2044-05-31

AI Technical Summary

Technical Problem

Existing AR glasses only undergo mechanical calibration before leaving the factory, which cannot guarantee the image display effect, resulting in insufficient display quality.

Method used

Collect the wearer's eye data to determine the gaze position and angle, determine the visual range through visual measurement, adjust the display parameters of the virtual content to match the current visible area, and adjust the brightness and refresh rate according to the ambient light intensity and the wearer's status.

Benefits of technology

It improves the image display quality of AR glasses, enhances the integration of virtual content with the real environment, and reduces visual discomfort and information loss.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118534656B_ABST
    Figure CN118534656B_ABST
Patent Text Reader

Abstract

The application discloses a calibration method and system of AR glasses, electronic equipment and a storage medium, and belongs to the technical field of augmented reality technology. The calibration method of the AR glasses comprises the following steps: collecting eye data of a wearer, determining a gaze position and a gaze angle according to the eye data; determining a visual range of the wearer through visual measurement; determining a visual field boundary of the wearer on a lens according to the gaze position, the gaze angle and the visual range, and setting a region in the visual field boundary as a current visible region; setting a region where virtual content currently displayed on the lens is located as an initial display region, comparing the initial display region with the current visible region to obtain a comparison result; wherein the comparison result comprises a position comparison result and / or a size comparison result; and adjusting display parameters of the virtual content according to the comparison result. The application can improve the image display quality of the AR glasses.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of augmented reality technology, and in particular to a calibration method, system, electronic device, and storage medium for AR glasses. Background Technology

[0002] Augmented Reality (AR) technology is a technology that integrates virtual information with the real world. AR technology can simulate and apply virtual information such as text, images, and 3D models to the real world, thereby enhancing the real world.

[0003] With the development of AR technology, AR glasses have become a relatively common AR product. Users wearing AR glasses can see both real-world and virtual scenes. AR glasses require calibration before leaving the factory, but current technologies typically only perform mechanical calibration operations such as interpupillary distance and diopter adjustment, which cannot guarantee the display quality of the AR glasses' images.

[0004] Therefore, improving the image display quality of AR glasses is a technical problem that needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a calibration method for AR glasses, a calibration system for AR glasses, an electronic device, and a storage medium that can improve the image display quality of AR glasses.

[0006] To address the aforementioned technical problems, this application provides a calibration method for AR glasses, which includes:

[0007] Collect the wearer's eye data, and determine the gaze position and gaze angle based on the eye data;

[0008] The wearer's visual range is determined by visual measurement;

[0009] The wearer’s visual field boundary on the lens is determined based on the gaze position, the gaze angle and the visual range, and the area within the visual field boundary is set as the current visible area.

[0010] The area where the virtual content currently displayed on the lens is located is set as the initial display area, and the initial display area is compared with the current visible area to obtain a comparison result; wherein, the comparison result includes a position comparison result and / or a size comparison result;

[0011] The display parameters of the virtual content are adjusted according to the comparison results.

[0012] Furthermore, the display parameters of the virtual content are adjusted according to the comparison results, including:

[0013] If the comparison result includes a position comparison result, then the center point position deviation value is determined based on the position comparison result, and the display position of the virtual content is adjusted based on the center point position deviation value, so that the display position of the center point of the virtual content is the center of the current visible area.

[0014] Furthermore, the display parameters of the virtual content are adjusted according to the comparison results, including:

[0015] If the comparison result includes a size comparison result, then a resolution deviation value is determined based on the size comparison result, and the resolution of the virtual content is adjusted according to the resolution deviation value so that the resolution of the virtual content matches the size of the current visible area.

[0016] Furthermore, it also includes:

[0017] Generate a corresponding display effect diagram based on the virtual content;

[0018] The color of the displayed image is compared with that of a preset image, and the color profile of the AR glasses is calibrated based on the color comparison results.

[0019] Furthermore, it also includes:

[0020] Detect the scene type of the wearer's location;

[0021] Determine whether the scene type is a preset scene;

[0022] If so, query the preset brightness value corresponding to the preset scene, and adjust the current brightness of the AR glasses according to the preset brightness value;

[0023] If not, then environmental information is collected, and the current brightness of the AR glasses is adjusted according to the environmental information; wherein, the environmental information includes ambient light intensity and / or light intensity change rate.

[0024] Furthermore, adjusting the current brightness of the AR glasses based on the environmental information includes:

[0025] If the environmental information includes the ambient light intensity and the rate of change of light intensity, then a light intensity prediction curve is generated based on the ambient light intensity and the rate of change of light intensity; wherein, the light intensity prediction curve is used to describe the correspondence between time and ambient light intensity;

[0026] A corresponding brightness control curve is generated according to the light intensity prediction curve, and the current brightness of the AR glasses is adjusted according to the brightness control curve.

[0027] Furthermore, it also includes:

[0028] Determine whether the wearer is in motion;

[0029] If so, the head movement speed and hand movement speed of the wearer are calculated, and the refresh rate of the AR glasses is adjusted according to the head movement speed and hand movement speed.

[0030] This application also provides a calibration system for AR glasses, the system comprising:

[0031] An eye detection module is used to collect the wearer's eye data and determine the gaze position and gaze angle based on the eye data;

[0032] A visual measurement module is used to determine the wearer's visual range through visual measurement;

[0033] The visible area determination module is used to determine the visual field boundary of the wearer on the lens based on the gaze position, the gaze angle and the visual range, and set the area within the visual field boundary as the current visible area;

[0034] The comparison module is used to set the area where the currently displayed virtual content on the lens is located as the initial display area, and compare the initial display area with the currently visible area to obtain a comparison result; wherein, the comparison result includes a position comparison result and / or a size comparison result;

[0035] The parameter adjustment module is used to adjust the display parameters of the virtual content according to the comparison results.

[0036] This application also provides a storage medium storing a computer program thereon, which, when executed, implements the steps of the above-described AR glasses calibration method.

[0037] This application also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor invokes the computer program in the memory to implement the steps of the above-described AR glasses calibration method.

[0038] This application provides a calibration method for AR glasses. The method collects the wearer's eye data to determine the gaze position and angle, and also determines the wearer's visual range through visual measurements. Then, by combining the gaze position, gaze angle, and visual range, the actual current visible area on the lens is determined. This application compares the current visible area with the initial display area of ​​the virtual content displayed on the lens to obtain a comparison result. Based on the comparison result, the positional deviation and / or size deviation between the currently displayed virtual content area and the current visible area can be determined. Based on the aforementioned positional deviation and / or size deviation, the display parameters of the virtual content can be adjusted to ensure the matching of the virtual content with the current visible area. This method dynamically optimizes the display parameters of the virtual content, reduces visual discomfort and information loss, and allows the virtual image to blend more naturally into the user's real environment, enhancing the realism of the image display and user acceptance, and improving the image display quality of the AR glasses. This application also provides an AR glasses calibration system, a storage medium, and an electronic device with the above-mentioned beneficial effects, which will not be elaborated further here. Attached Figure Description

[0039] To more clearly illustrate the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 A flowchart illustrating a calibration method for AR glasses provided in an embodiment of this application;

[0041] Figure 2 This is a schematic diagram of the structure of a calibration system for AR glasses provided in an embodiment of this application. Detailed Implementation

[0042] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0043] Please see below. Figure 1 , Figure 1 This is a flowchart illustrating a calibration method for AR glasses provided in an embodiment of this application.

[0044] Specific steps may include:

[0045] S101: Collect the wearer's eye data and determine the gaze position and gaze angle based on the eye data;

[0046] This embodiment can be applied to the processing chip of AR glasses, or to control devices connected to AR glasses. This embodiment can collect user eye data (such as eye position, pupil position, gaze direction, and distance from the glasses to the screen) using a camera or sensor, and then determine the user's gaze position and gaze angle based on the collected eye data.

[0047] As one feasible implementation, this step can be based on collecting eye data using an eye-tracking device to determine the gaze position and gaze angle. Specifically, the eye-tracking device emits infrared light to illuminate the surface of the eye, and then determines the eye data (i.e., eye-tracking data) based on the reflected light. Based on the eye-tracking data, the location of the user's gaze focus (i.e., gaze position) and the angle of the user's line of sight relative to a reference plane (such as the plane of the lens) (i.e., gaze angle) can be determined.

[0048] S102: Determine the wearer's visual range through visual measurement;

[0049] This step can utilize a camera or other visual sensing devices to assess and quantify the visual range that a user wearing AR glasses can perceive. For example, in this embodiment, a camera can be used to capture the wearer's eye rotation limit position and pupil size information when observing a test scene. Based on the eye rotation limit position and pupil size information, the wearer's maximum horizontal viewing angle, maximum vertical viewing angle, and stereoscopic depth range can be calculated. The wearer's visual range can be determined based on the maximum horizontal viewing angle, maximum vertical viewing angle, and stereoscopic depth range.

[0050] S103: Determine the visual field boundary of the wearer on the lens based on the gaze position, gaze angle and visual range, and set the area within the visual field boundary as the current visible area;

[0051] In this embodiment, image processing calculations are performed on the gaze position, gaze angle, and visual range to obtain the wearer's visual field boundary on the lens. The visual field boundary is the boundary line of the maximum range that the wearer can clearly see through the lens, that is, the limit of the farthest boundary that the line of sight can reach.

[0052] After determining the visual field boundary, the area on the lens within the aforementioned visual field boundary can be set as the current visible area. Since the wearer's gaze position and visual range may change over time, this embodiment can update the wearer's current visible area according to a preset period.

[0053] S104: Set the area where the virtual content currently displayed on the lens is located as the initial display area, and compare the initial display area with the current visible area to obtain the comparison result;

[0054] Prior to this step, there may be an operation to display virtual content on the lens. In this embodiment, the area where the currently displayed virtual content is located on the lens can be set as the initial display area. After determining the initial display area and the current visible area, the initial display area and the current visible area can be compared to obtain the difference between the initial display area and the current visible area, i.e., the comparison result.

[0055] Specifically, this embodiment can compare the position of the initial display area and the current visible area to obtain the position comparison result; this embodiment can also compare the size of the initial display area and the current visible area to obtain the size comparison result.

[0056] This step compares the initial display area with the current visible area, which helps determine the relationship between the virtual content and the wearer's field of vision, and optimizes display parameters accordingly to improve the user experience.

[0057] S105: Adjust the display parameters of the virtual content according to the comparison results.

[0058] In this embodiment, the comparison results can be analyzed to determine the deviation between the initial display area and the current visible area, and then the display parameters of the virtual content can be adjusted based on the deviation so that the virtual content after adjusting the display parameters is appropriately displayed in the wearer's field of vision.

[0059] This embodiment collects the wearer's eye data to determine the gaze position and angle, and also determines the wearer's visual range through visual measurements. Then, combining the gaze position, gaze angle, and visual range, it determines the wearer's actual current visible area on the lens. This embodiment compares the current visible area with the initial display area of ​​the virtual content displayed on the lens to obtain a comparison result. Based on the comparison result, the positional deviation and / or size deviation between the currently displayed virtual content area and the current visible area can be determined. Based on the aforementioned positional deviation and / or size deviation, the display parameters of the virtual content can be adjusted to ensure the matching of the virtual content with the current visible area. This method dynamically optimizes the display parameters of the virtual content, reduces visual discomfort and information loss, allows virtual images to blend more naturally into the user's real environment, enhances the realism of the image display and user acceptance, and improves the image display quality of AR glasses.

[0060] As for Figure 1In a further description of the corresponding embodiment, if the comparison result includes a position comparison result, the display position in the virtual content display parameters can be adjusted in the following ways:

[0061] The center point position deviation value is determined based on the position comparison result, and the display position of the virtual content is adjusted according to the center point position deviation value so that the display position of the center point of the virtual content is the center of the current visible area.

[0062] Specifically, this embodiment calculates the difference between the center point of the initial display area and the center point of the current visible area to obtain the center point position deviation value. After determining the center point position deviation value, this embodiment can adjust the display position of the virtual content according to the center point position deviation value, so that the virtual content is in the center of the current visible area.

[0063] As for Figure 1 In a further description of the corresponding embodiment, if the comparison result includes a size comparison result, the resolution in the virtual content display parameters can be adjusted in the following ways:

[0064] Based on the size comparison result, a resolution deviation value is determined, and the resolution of the virtual content is adjusted according to the resolution deviation value so that the resolution of the virtual content matches the size of the current visible area.

[0065] Specifically, this embodiment calculates the difference between the initial display area size and the current viewable area size to obtain the resolution difference. After determining the resolution difference, this embodiment adjusts the resolution of the virtual content based on the resolution difference to ensure that the virtual content is displayed with optimal quality within the current viewable area. This method improves the clarity of the virtual content and reduces image distortion and blurring.

[0066] As for Figure 1 As further described in the corresponding embodiment, this embodiment can generate a corresponding display effect image based on the virtual content; compare the color of the display effect image with a preset image, and calibrate the color profile of the AR glasses based on the color comparison result.

[0067] In this embodiment, a display effect diagram can be generated based on the attributes of the virtual content (such as resolution, color depth, texture, etc.) and the display parameters of the AR glasses. The display effect diagram is used to simulate the display effect of the virtual content in the AR glasses. This embodiment can also select a color card or color test pattern as a preset image and compare it with the display effect diagram to obtain a color comparison result. Based on the color comparison result, the color difference between the display effect diagram and the preset image can be determined. This embodiment can reduce these differences by modifying parameters in the color configuration file (such as brightness, contrast, saturation, or color temperature) to achieve color calibration.

[0068] As for Figure 1 In a further description of the corresponding embodiment, the brightness of the AR glasses can also be adjusted in the following ways:

[0069] The system detects the scene type of the wearer's location; determines whether the scene type is a preset scene; if so, it queries the preset brightness value corresponding to the preset scene and adjusts the current brightness of the AR glasses according to the preset brightness value; if not, it collects environmental information and adjusts the current brightness of the AR glasses according to the environmental information; wherein, the environmental information includes ambient light intensity and / or light intensity change rate.

[0070] The aforementioned preset scenarios can be scenarios with predetermined preset brightness values, such as movie theaters, study rooms, and subways. This embodiment can determine the scenario type of the wearer based on location information and surrounding environment images. If the scenario type is a preset scenario, the current brightness of the AR glasses can be set to the preset brightness value corresponding to that scenario. If the scenario type is not a preset scenario, this embodiment can adaptively adjust the current brightness of the AR glasses based on environmental information.

[0071] As for Figure 1 In a further description of the corresponding embodiment, this embodiment can adjust the current brightness of the AR glasses according to the environmental information in the following way: if the environmental information includes the ambient light intensity and the light intensity change rate, then a light intensity prediction curve is generated according to the ambient light intensity and the light intensity change rate; wherein, the light intensity prediction curve is used to describe the correspondence between time and ambient light intensity; a corresponding brightness control curve is generated according to the light intensity prediction curve, and the current brightness of the AR glasses is adjusted according to the brightness control curve.

[0072] This embodiment generates a light intensity prediction curve by combining ambient light intensity and light intensity change rate, and adjusts the brightness of AR glasses accordingly. This not only improves the comfort and naturalness of the user experience, but also enhances the fusion effect of reality and virtual content.

[0073] As for Figure 1Further description of the corresponding embodiment suggests that the refresh rate of the AR glasses can also be adjusted in the following way: determining whether the wearer is in motion; if so, calculating the wearer's head movement speed and hand movement speed, and adjusting the refresh rate of the AR glasses based on the head movement speed and hand movement speed. Specifically, in this embodiment, the refresh rate of the AR glasses can be obtained by weighted calculation of head movement speed and hand movement speed, where head movement speed and hand movement speed are positively correlated.

[0074] In this embodiment, after obtaining the head and hand movement speeds, the refresh rate of the AR glasses can be adjusted based on these speeds. When the head and hand movement speeds are fast, a higher refresh rate is needed to maintain smoothness and avoid motion blur or lag. When the head and hand movement speeds are slow, the refresh rate can be reduced to save energy and extend the device's lifespan.

[0075] The process described in the above embodiments is illustrated below through examples in practical applications.

[0076] AR glasses use a series of optical imaging elements to form a distant virtual image and project it into the user's eyes. Currently, AR glasses undergo rigorous testing before leaving the factory, including simulating user wearing, adjusting interpupillary distance, and refractive power, to ensure satisfactory clarity and comfort for the user. However, even after these mechanical calibrations, AR glasses still cannot achieve optimal clarity.

[0077] To address the technical problems existing in the aforementioned related technologies, this embodiment provides an AR glasses testing and calibration method, specifically including the following steps:

[0078] Step A1: Preheat the AR glasses.

[0079] This step ensures that the AR glasses have been turned on for a period of time so that they can reach a stable working state.

[0080] Step A2: Adjust the brightness.

[0081] This step allows you to adjust the brightness settings of the AR glasses to suit the current indoor lighting environment. If the AR glasses are too bright or too dark, it may affect visual comfort and image accuracy.

[0082] Step A3: Adjust the contrast.

[0083] Contrast ratio is the relative brightness difference between the brightest white and the darkest black on AR glasses. Adjusting the contrast ratio yields the best image clarity and detail.

[0084] Step A4: Pixel calibration.

[0085] Pixel calibration ensures color consistency across different devices, improving image visibility. Reference objects such as standard color charts or grayscale charts can be used during the calibration process.

[0086] Step A5: Calibrate the colors.

[0087] This embodiment can be calibrated using a color calibration instrument to ensure that the AR glasses display colors accurately. This typically involves adjusting the AR glasses' color profile to match standard color specifications.

[0088] Step A6: Adjust the resolution.

[0089] Resolution determines the number of pixels on AR glasses, affecting image clarity and detail. This embodiment allows you to select an appropriate resolution to achieve the best viewing experience based on the image or video content to be displayed.

[0090] Step A7: Anti-aliasing settings.

[0091] Anti-aliasing is an image processing technique used to reduce the jagged edges of an image. By adjusting the anti-aliasing level, image edges can be made smoother and distortion reduced.

[0092] Step A8: Adjust the refresh rate.

[0093] The refresh rate determines how many times the AR glasses update the image per second. For content that requires a high frame rate, such as dynamic images or games, adjusting to a higher refresh rate can result in a smoother visual experience.

[0094] The binocular display system used in AR glasses follows the natural binocular imaging principle of the human eye. It's crucial to avoid misalignment or offset between the images displayed to each eye. Therefore, precise pixel calibration technology is needed to achieve seamless fusion of the images from both eyes. Thus, steps A3-A8 above can be calibrated using a binocular calibration mode. The binocular calibration mode performs factory correction, distortion correction, downsampling (reducing by half), and HDR bracketing on the 3D data output from the VR glasses. Then, it performs online calibration. Once the calibration quality meets the standards, it is input into a stereo CNN network and then into the rendering pipeline to generate coatings, texture repair, meshes, etc. If the calibration quality does not meet the standards, it reverts to monocular calibration mode, inputs the data into a monocular CNN network for processing, and then into the rendering pipeline to generate a new perspective. When one camera is obstructed, or when the feature data captured by the camera is insufficient, the above embodiment can use monocular calibration mode for detection. Whether in binocular or monocular calibration mode, the same downstream processing pipeline is used. The advantage is that it can output high-accuracy relative parallax, which can well meet the purpose of 3D capture and modeling. In addition, after generating the depth parallax map, the system will crop the largest effective area and maintain the original aspect ratio. This can further optimize the overall quality of 3D modeling.

[0095] When performing pixel calibration, this embodiment first determines the image's color space and color profile. The color space determines the range of colors that can be represented in an image, while the color profile defines how these colors are rendered on a specific device. Calibration ensures a closer resemblance to the real scene and improves the image's visual quality. The calibration process typically requires the use of reference objects such as standard color charts or grayscale charts. By photographing these reference objects, a set of baseline data can be obtained, and then the pixel values ​​in the image are adjusted based on this data.

[0096] This embodiment also provides a pixel calibration scheme for AR glasses, including the following steps:

[0097] Step B1: Calibration preparation.

[0098] Before starting pixel calibration, users are asked to adopt a specific posture or look at a specific landmark to ensure that their eyes are in the correct position and posture.

[0099] Step B2: Eye data acquisition.

[0100] AR glasses use built-in cameras or sensors to collect data about the user's eye position, pupil position, gaze direction, and distance from the eyes to the screen. This data is used to calculate pixel calibration parameters.

[0101] Step B3: Visual measurement.

[0102] The cameras or sensors inside the AR glasses measure the visual range of each of the user's eyes and determine the mapped area of ​​each eye on the screen.

[0103] Step B4: Image analysis.

[0104] Based on eye data and visual measurements, the AR glasses' cameras or sensors analyze and transmit the mapping of the user's eyes on the screen to determine the amount of adjustment needed for pixel calibration.

[0105] Step B5: Pixel adjustment.

[0106] Based on the image analysis results, the pixels on the screen are fine-tuned via the AR glasses' system menu to ensure that the position and size of the virtual content in the user's eyes are aligned with the real world. This may involve adjusting the position, size, brightness, or color of pixels.

[0107] Step B6: Calibration Confirmation.

[0108] After the pixel adjustment is completed, the AR glasses will provide users with some feedback so that they can confirm whether the calibration has achieved the expected results.

[0109] When performing binocular calibration, this embodiment can be executed according to steps B1 to B6 above. If the desired result is not achieved after adjustment, monocular calibration mode needs to be used, that is, one side of the AR glasses is blocked and calibration is performed again. After the two display areas of the AR glasses are calibrated separately, binocular observation is then used to observe whether the binocular images achieve seamless fusion during use.

[0110] This embodiment uses pixel calibration technology to assist in the image calibration of VR glasses. Pixel calibration technology is a technique used to adjust and optimize image quality. It corrects the pixel values ​​in the image to make them closer to the colors and details of the real scene. Calibration through pixel calibration technology can ensure the authenticity of the presented image and improve the visual effect and viewing experience of the image.

[0111] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of an AR glasses calibration system provided in an embodiment of this application. The system may include:

[0112] The eye detection module 201 is used to collect the wearer's eye data and determine the gaze position and gaze angle based on the eye data;

[0113] The visual measurement module 202 is used to determine the wearer's visual range through visual measurement;

[0114] The visible area determination module 203 is used to determine the visual field boundary of the wearer on the lens based on the gaze position, the gaze angle and the visual range, and set the area within the visual field boundary as the current visible area;

[0115] The comparison module 204 is used to set the area where the currently displayed virtual content on the lens is located as the initial display area, and compare the initial display area with the current visible area to obtain a comparison result; wherein, the comparison result includes a position comparison result and / or a size comparison result;

[0116] The parameter adjustment module 205 is used to adjust the display parameters of the virtual content according to the comparison results.

[0117] This embodiment collects the wearer's eye data to determine the gaze position and angle, and also determines the wearer's visual range through visual measurements. Then, combining the gaze position, gaze angle, and visual range, it determines the wearer's actual current visible area on the lens. This embodiment compares the current visible area with the initial display area of ​​the virtual content displayed on the lens to obtain a comparison result. Based on the comparison result, the positional deviation and / or size deviation between the currently displayed virtual content area and the current visible area can be determined. Based on the aforementioned positional deviation and / or size deviation, the display parameters of the virtual content can be adjusted to ensure the matching of the virtual content with the current visible area. This method dynamically optimizes the display parameters of the virtual content, reduces visual discomfort and information loss, allows virtual images to blend more naturally into the user's real environment, enhances the realism of the image display and user acceptance, and improves the image display quality of AR glasses.

[0118] Furthermore, the process by which the parameter adjustment module 205 adjusts the display parameters of the virtual content according to the comparison result includes: if the comparison result includes a position comparison result, then determining the center point position deviation value according to the position comparison result, and adjusting the display position of the virtual content according to the center point position deviation value, so that the display position of the center point of the virtual content is the center of the current visible area.

[0119] Furthermore, the process by which the parameter adjustment module 205 adjusts the display parameters of the virtual content according to the comparison result includes: if the comparison result includes a size comparison result, then a resolution deviation value is determined according to the size comparison result, and the resolution of the virtual content is adjusted according to the resolution deviation value so that the resolution of the virtual content matches the size of the current visible area.

[0120] Furthermore, it also includes:

[0121] The color calibration module is used to generate a corresponding display effect image based on the virtual content; it is also used to compare the display effect image with a preset image in terms of color, and to calibrate the color profile of the AR glasses based on the color comparison result.

[0122] Furthermore, it also includes:

[0123] The brightness adjustment module is used to detect the scene type of the wearer's location; it is also used to determine whether the scene type is a preset scene; if so, it queries the preset brightness value corresponding to the preset scene and adjusts the current brightness of the AR glasses according to the preset brightness value; if not, it collects environmental information and adjusts the current brightness of the AR glasses according to the environmental information; wherein, the environmental information includes ambient light intensity and / or light intensity change rate.

[0124] Furthermore, the process by which the brightness adjustment module adjusts the current brightness of the AR glasses based on the environmental information includes: if the environmental information includes the ambient light intensity and the light intensity change rate, then generating a light intensity prediction curve based on the ambient light intensity and the light intensity change rate; wherein, the light intensity prediction curve is used to describe the correspondence between time and ambient light intensity; generating a corresponding brightness control curve according to the light intensity prediction curve, and adjusting the current brightness of the AR glasses according to the brightness control curve.

[0125] Furthermore, it also includes:

[0126] The refresh rate adjustment module is used to determine whether the wearer is in motion; if so, it calculates the head movement speed and hand movement speed of the wearer, and adjusts the refresh rate of the AR glasses according to the head movement speed and hand movement speed.

[0127] Since the embodiments of the system part correspond to the embodiments of the method part, please refer to the description of the embodiments of the method part for the embodiments of the system part, and they will not be repeated here.

[0128] This application also provides a storage medium on which a computer program is stored, which, when executed, can perform the steps provided in the above embodiments. The storage medium may include various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0129] This application also provides an electronic device that may include a memory and a processor. The memory stores a computer program, and when the processor calls the computer program in the memory, it can implement the steps provided in the above embodiments. Of course, the electronic device may also include various network interfaces, power supplies, and other components.

[0130] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the systems disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the descriptions are relatively simple; relevant parts can be referred to the method section. It should be noted that those skilled in the art can make various improvements and modifications to this application without departing from the principles of this application, and these improvements and modifications also fall within the protection scope of this application.

[0131] It should also be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A calibration method for AR glasses, characterized in that, include: Collect the wearer's eye data, and determine the gaze position and gaze angle based on the eye data; The wearer's visual range is determined by visual measurement; The wearer’s visual field boundary on the lens is determined based on the gaze position, the gaze angle and the visual range, and the area within the visual field boundary is set as the current visible area. The area where the virtual content currently displayed on the lens is located is set as the initial display area, and the initial display area is compared with the current visible area to obtain a comparison result; wherein, the comparison result includes a position comparison result and / or a size comparison result; The display parameters of the virtual content are adjusted according to the comparison results. The adjustment of the display parameters of the virtual content according to the comparison results includes: If the comparison result includes a position comparison result, then the center point position deviation value is determined according to the position comparison result, and the display position of the virtual content is adjusted according to the center point position deviation value so that the display position of the center point of the virtual content is the center of the current visible area; If the comparison result includes a size comparison result, then a resolution deviation value is determined based on the size comparison result, and the resolution of the virtual content is adjusted according to the resolution deviation value so that the resolution of the virtual content matches the size of the current visible area.

2. The calibration method for AR glasses according to claim 1, characterized in that, Also includes: Generate a corresponding display effect diagram based on the virtual content; The color of the displayed image is compared with that of a preset image, and the color profile of the AR glasses is calibrated based on the color comparison results.

3. The calibration method for AR glasses according to claim 1, characterized in that, Also includes: Detect the scene type of the wearer's location; Determine whether the scene type is a preset scene; If so, query the preset brightness value corresponding to the preset scene, and adjust the current brightness of the AR glasses according to the preset brightness value; If not, then environmental information is collected, and the current brightness of the AR glasses is adjusted according to the environmental information; wherein, the environmental information includes ambient light intensity and / or light intensity change rate.

4. The calibration method for AR glasses according to claim 3, characterized in that, Adjusting the current brightness of the AR glasses based on the environmental information includes: If the environmental information includes the ambient light intensity and the rate of change of light intensity, then a light intensity prediction curve is generated based on the ambient light intensity and the rate of change of light intensity; wherein, the light intensity prediction curve is used to describe the correspondence between time and ambient light intensity; A corresponding brightness control curve is generated according to the light intensity prediction curve, and the current brightness of the AR glasses is adjusted according to the brightness control curve.

5. The calibration method for AR glasses according to claim 1, characterized in that, Also includes: Determine whether the wearer is in motion; If so, the head movement speed and hand movement speed of the wearer are calculated, and the refresh rate of the AR glasses is adjusted according to the head movement speed and hand movement speed.

6. A calibration system for AR glasses, characterized in that, include: An eye detection module is used to collect the wearer's eye data and determine the gaze position and gaze angle based on the eye data; A visual measurement module is used to determine the wearer's visual range through visual measurement; The visible area determination module is used to determine the visual field boundary of the wearer on the lens based on the gaze position, the gaze angle and the visual range, and set the area within the visual field boundary as the current visible area; The comparison module is used to set the area where the currently displayed virtual content on the lens is located as the initial display area, and compare the initial display area with the currently visible area to obtain a comparison result; wherein, the comparison result includes a position comparison result and / or a size comparison result; The parameter adjustment module is used to adjust the display parameters of the virtual content according to the comparison results; The process by which the parameter adjustment module adjusts the display parameters of the virtual content according to the comparison results includes: if the comparison results include position comparison results, then a center point position deviation value is determined based on the position comparison results, and the display position of the virtual content is adjusted according to the center point position deviation value so that the display position of the center point of the virtual content is the center of the current visible area; if the comparison results include size comparison results, then a resolution deviation value is determined based on the size comparison results, and the resolution of the virtual content is adjusted according to the resolution deviation value so that the resolution of the virtual content matches the size of the current visible area.

7. An electronic device, characterized in that, The device includes a memory and a processor, wherein the memory stores a computer program, and the processor invokes the computer program in the memory to implement the steps of the calibration method for AR glasses as described in any one of claims 1 to 5.

8. A storage medium, characterized in that, The storage medium stores computer-executable instructions, which, when loaded and executed by a processor, implement the steps of the calibration method for AR glasses as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Display panel, display device and virtual reality device

    CN108665805A

  • Display calibration method and device of head-mounted equipment, head-mounted equipment and storage medium

    CN113589532A

  • Display method, display device, and recording medium

    CN114791673A