Pre-correction display parameter calibration method, near-eye display method, device and apparatus

Abstract

This application provides a pre-calibration display parameter calibration method, a near-eye display method, an apparatus, and a device, relating to the field of display device technology. The method includes: determining a portion of fixation points among multiple fixation points within the field of view of a near-eye display module; acquiring an eye-simulation dataset of the central display component and / or the peripheral display component corresponding to the portion of fixation points; and determining a pre-calibration display parameter set for the central display component and / or the peripheral display component based on the eye-simulation dataset. The embodiments of this application can provide a technical solution capable of achieving natural visual transitions and pixel imaging offset correction.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a pre-calibration display parameter calibration method, a near-eye display method, apparatus and equipment. Background Technology

[0002] Near-to-Eye Display (NPD) is a technology that projects digital information into the human eye's retina through an optical system. It encompasses fields such as Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and Extended Reality (XR).

[0003] Near-eye display devices often use hybrid optical systems to expand the field of view. However, different optical elements in the hybrid optical system have aberrations and differences in light efficiency, which can easily cause edge pixel imaging shift, splicing gaps, and sudden brightness changes in different display areas, making the human eye easily aware of the boundaries.

[0004] Currently, hybrid optical systems are designed to address these issues, but it is difficult to achieve natural visual transitions and pixel imaging offset correction simply by designing hybrid optical systems. Summary of the Invention

[0005] This application provides a pre-calibration display parameter calibration method, a near-eye display method, an apparatus, and a device, which are used to provide a technical solution that can achieve natural visual transition and / or pixel imaging offset correction.

[0006] In a first aspect, embodiments of this application provide a pre-calibration display parameter calibration method for calibrating the display parameters of a near-eye display module; the near-eye display module includes: a central display component and peripheral display components;

[0007] The method includes:

[0008] Within the field of view of the near-eye display module, a portion of the multiple fixation points are identified;

[0009] Obtain an eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point;

[0010] Based on the eye-simulation dataset, determine the pre-calibrated display parameter set for the central display component and / or the peripheral display component.

[0011] Secondly, embodiments of this application provide a near-eye display method, the method comprising:

[0012] Obtain the configuration display dataset for the central display component and / or the peripheral display components;

[0013] Based on the set display dataset and the pre-calibrated display parameter set of the central display component and / or the peripheral display component, the pre-calibrated display dataset of the central display component and / or the peripheral display component is determined; wherein the pre-calibrated display parameter set of the central display component and / or the peripheral display component is obtained by the pre-calibrated display parameter calibration method according to any one of the first aspects;

[0014] The pre-calibrated display dataset is used to drive the near-eye display module to generate and display images.

[0015] Thirdly, embodiments of this application provide a near-eye display method, the method comprising:

[0016] Obtain the setting display dataset of the central display component and / or the peripheral display component, wherein the setting display dataset includes the setting input parameters of each setting pixel position in the central display component and / or the peripheral display component;

[0017] Based on the set display dataset and the pre-calibrated display parameter set of the central display component and / or the peripheral display component, the pre-calibrated display dataset of the central display component and / or the peripheral display component is determined; the pre-calibrated display parameter set of the central display component and / or the peripheral display component is obtained by the pre-calibrated display parameter calibration method according to any one of the first aspects; the pre-calibrated display dataset includes pre-calibrated input parameters for each set pixel position in the central display component and / or the peripheral display component;

[0018] The pre-calibrated display dataset is used to drive the near-eye display module to generate and display images.

[0019] Fourthly, embodiments of this application provide a near-eye display method, the method comprising:

[0020] Based on eye-tracking results, determine the target fixation point;

[0021] Based on the target gaze point and the pre-calibrated display parameter set of the central display component and / or the peripheral display component, a target pre-calibrated display parameter set is determined; wherein the pre-calibrated display parameter set of the central display component and / or the peripheral display component is obtained by the pre-calibrated display parameter calibration method according to any one of the first aspects;

[0022] Obtain the set display dataset of the central display component and / or the peripheral display component;

[0023] The target pre-calibration display dataset is determined based on the set display dataset and target pre-calibration display parameter set of the central display component and / or the peripheral display component;

[0024] The target pre-corrected display dataset is used to drive the near-eye display module to generate and display images.

[0025] Fifthly, embodiments of this application provide a pre-calibration display parameter calibration device.

[0026] Used for calibrating the display parameters of the near-eye display module; the near-eye display module includes: a central display component and peripheral display components;

[0027] The device includes: a first processing module and a first control module;

[0028] The first processing module is used for:

[0029] Within the field of view of the near-eye display module, a portion of the multiple fixation points are identified;

[0030] Obtain an eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point;

[0031] Based on the eye-simulation dataset, determine the pre-calibrated display parameter set for the central display component and / or the peripheral display component;

[0032] The first control module is used to control the first processing module to perform the processing as described above.

[0033] Sixthly, embodiments of this application provide a near-eye display device, comprising:

[0034] Near-eye display module, used to generate and display images;

[0035] The second processing module is configured to acquire a set display dataset of the central display component and / or the peripheral display component; and to determine a pre-calibration display dataset of the central display component and / or the peripheral display component based on the set display dataset and the pre-calibration display parameter set; wherein the pre-calibration display parameter set is obtained by the pre-calibration display parameter calibration method according to any one of the first aspects;

[0036] The second control module is used to control the second processing module to perform the processing as described above, and to drive the near-eye display module to generate and display images using the pre-corrected display dataset.

[0037] Seventhly, embodiments of this application provide a near-eye display device, comprising:

[0038] Near-eye display module, used to generate and display images;

[0039] The eye-tracking module is used to collect the user's eye movement data;

[0040] The second processing module is configured to: determine a target gaze point based on user eye movement data collected by the eye-tracking module; determine a target pre-calibrated display parameter set based on the target gaze point and a pre-calibrated display parameter set; acquire a set display dataset for the central display component and / or the peripheral display component; and determine a target pre-calibrated display dataset based on the set display dataset for the central display component and / or the peripheral display component and the target pre-calibrated display parameter set; wherein the pre-calibrated display parameter set is obtained by the pre-calibrated display parameter calibration method described in any one of the first aspects.

[0041] The second control module is used to control the eye-tracking module to collect user eye-tracking data, to control the second processing module to perform the processing as described above, and to drive the near-eye display module to generate and display images using the target pre-correction display dataset.

[0042] Eighthly, embodiments of this application provide an electronic device, including a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the methods described in any one of the first, second, third, and fourth aspects.

[0043] In a ninth aspect, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the methods described in any one of the first, second, third, and fourth aspects.

[0044] In a tenth aspect, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the methods described in any one of the first, second, third, and fourth aspects.

[0045] When the above technical solution is adopted, the pre-calibration display parameter calibration method obtains the eye-entry simulation dataset of the central display component and / or the peripheral display component at some fixation points in the field of view of the near-eye display module, and then determines the pre-calibration display parameter set of the central display component and / or the peripheral display component based on the eye-entry simulation dataset.

[0046] This pre-corrected display dataset can be used to pre-correct pixel imaging offsets of the central display component and / or peripheral display components to compensate for pixel imaging offsets caused by aberrations in different display areas, thereby improving the splicing gaps.

[0047] In the near-eye display method, a pre-calibrated display dataset is determined based on the set display dataset of the central display component and / or the peripheral display component, and a pre-calibrated display parameter set. The pre-calibrated display dataset is then used to drive the near-eye display module to generate and display an image, thereby pre-calibrating the pixel imaging offset of the central display component and / or the peripheral display component. This corrects the pixel imaging offset caused by aberrations in different display areas, thereby improving the stitching gap of the near-eye display image and enhancing the display quality of the near-eye display device.

[0048] And / or, the pre-corrected display dataset can be used to pre-correct brightness abrupt changes in the central display component and / or peripheral display components, making the brightness transition between the display areas of the central display component and the peripheral display components more natural, reducing the human eye's perception of brightness boundaries, and making the brightness of the near-eye display image more uniform.

[0049] In the near-eye display method, a pre-calibrated display dataset is determined based on the set display dataset of the central display component and / or the peripheral display component, and a pre-calibrated display parameter set. The pre-calibrated display dataset is then used to drive the near-eye display module to generate and display an image. This pre-calibrates the brightness abrupt changes of the central display component and / or the peripheral display component, making the brightness transition between the display areas of the central display component and the peripheral display component more natural, reducing the human eye's perception of brightness boundaries, and making the brightness of the near-eye display image more uniform, thereby improving the display quality of the near-eye display device.

[0050] Furthermore, in the near-eye display module, the central optical element of the central display component is set as a lens, and the peripheral optical elements of the peripheral display components are designed as a lens array. This allows for a reduction in the thickness of the peripheral display components while ensuring the imaging quality of the near-eye display module. Additionally, along the direction from the first side to the second side of the peripheral optical elements, the focal length of the sub-lenses in the peripheral optical elements gradually decreases, and / or the refractive index of the peripheral optical elements gradually increases. This results in a gradual decrease in the MTF (Mean Transmission Factor) of the peripheral display components from the side closer to the central display component to the side farther away from the central display component. This approach takes into account that the user's eye has higher requirements for the imaging quality of the central display component and lower requirements for the imaging quality of the peripheral display components. By gradually reducing the MTF of the peripheral display components while ensuring a large field of view for the near-eye display module, the optical design difficulty of the near-eye display module is reduced. Attached Figure Description

[0051] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0052] Figure 1A flowchart of a display parameter calibration method provided in this application embodiment Figure 1 ;

[0053] Figure 2 A schematic diagram of setting a brightness sensor in the field of view of a near-eye display module, provided in an embodiment of this application. Figure 1 ;

[0054] Figure 3 A schematic diagram of setting a brightness sensor in the field of view of a near-eye display module, provided in an embodiment of this application. Figure 2 ;

[0055] Figure 4 A schematic diagram of setting a brightness sensor in the field of view of a near-eye display module, provided in an embodiment of this application. Figure 3 ;

[0056] Figure 5 The first step flow of a display parameter calibration method provided in the embodiments of this application Figure 2 ;

[0057] Figure 6 The second step flow of a display parameter calibration method provided in the embodiments of this application Figure 2 ;

[0058] Figure 7 The third step flow of a display parameter calibration method provided in the embodiments of this application Figure 2 ;

[0059] Figure 8 The fourth step of a display parameter calibration method provided in this application embodiment Figure 2 ;

[0060] Figure 9 A flowchart of a display parameter calibration method provided in this application embodiment Figure 3 ;

[0061] Figure 10 This application provides a schematic diagram of the field of view division of a near-eye display module according to an embodiment of the present application.

[0062] Figure 11 A flowchart of a display parameter calibration method provided in this application embodiment Figure 4 ;

[0063] Figure 12 A gradient solid model of the MTF of a near-eye display module provided in this application embodiment;

[0064] Figure 13 A schematic diagram illustrating the field-of-view transition of a near-eye display module provided in an embodiment of this application;

[0065] Figure 14 A schematic diagram illustrating the overlapping of the field of view portions of a near-eye display module provided in an embodiment of this application;

[0066] Figure 15 A schematic diagram of a folded optical path for a central display component and a peripheral display component provided in an embodiment of this application;

[0067] Figure 16 A simulation diagram of a near-eye display module provided in an embodiment of this application;

[0068] Figure 17 This is a schematic diagram of the structure of a display parameter calibration device provided in an embodiment of this application;

[0069] Figure 18 A step flow chart of a near-eye display method provided in the embodiments of this application Figure 1 ;

[0070] Figure 19 A step flow chart of a near-eye display method provided in the embodiments of this application Figure 2 ;

[0071] Figure 20 A step flow chart of a near-eye display method provided in the embodiments of this application Figure 3 ;

[0072] Figure 21 A step flow chart of a near-eye display method provided in the embodiments of this application Figure 4 ;

[0073] Figure 22 A step flow chart of a near-eye display method provided in the embodiments of this application Figure 5 ;

[0074] Figure 23 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0075] Figure label:

[0076] 10-Central display assembly; 11-Central display; 12-Central optical components;

[0077] 20 - Peripheral display assembly; 21 - Peripheral display; 22 - Peripheral optical element; 221 - First side of the optical element; 222 - Second side of the optical element; A - Direction from the first side to the second side;

[0078] 101-Reflective polarizer; 102-Quarter-wave plate; 103-Semi-transparent mirror; 104-Linear polarizer;

[0079] 30 - Brightness detection module; 31 - Brightness sensor. Detailed Implementation

[0080] First, the technical terms involved in the embodiments of this application will be explained:

[0081] Near-eye display devices are technological devices that project digital information directly onto the human eye's retina within its perception range. They are commonly used in fields such as virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR), allowing users to interact with digital content in the real world or a virtual environment.

[0082] Hybrid optical systems: Hybrid optical systems are optical systems that combine multiple different types of optical elements or technologies. In near-eye display devices, hybrid optical systems are typically used to expand the field of view, improve image quality, or achieve other specific functions.

[0083] Near-eye display module: This is the core component of a near-eye display device, containing all the optical and electronic components required to display images. It typically includes a display panel (such as OLED or LCD), optical lenses, light source, driving circuit, etc.

[0084] The fixation point is the point where the human eye focuses its gaze when observing a scene. In near-eye display devices, the fixation point is typically used to determine the area of ​​the screen or virtual environment that the user is currently viewing.

[0085] The fixation area refers to the range or area covered by the human eye when observing a scene.

[0086] Near-eye display devices often use hybrid optical systems to expand the field of view. However, different optical elements in the hybrid optical system have different aberration characteristics and light efficiency, which can easily cause sudden changes in brightness in different display areas. The human eye can easily perceive the boundaries and the imaging offset of edge pixels, resulting in splicing gaps.

[0087] Currently, hybrid optical systems are designed to address these issues, but it is difficult to achieve natural visual transitions and pixel imaging offset correction simply by designing hybrid optical systems.

[0088] Based on this, the technical concept of this application is as follows: In the field of view of the near-eye display module, some of the multiple fixation points are determined, and an eye-simulation dataset of the central display module and / or, the peripheral display module at the partial fixation points is obtained. Then, a pre-correction display parameter set is determined based on the eye-simulation dataset, which includes pixel brightness pre-correction parameters and / or, pixel position pre-correction parameters. Subsequently, for the user's actual target fixation point, a target pre-correction display dataset is determined based on the setting display dataset of the central display module and / or, the peripheral display module, and the pre-correction display parameter set. Then, the display parameters of the near-eye display module are adjusted based on the target pre-correction display dataset to pre-correct the pixel position and pixel brightness at the target fixation point.

[0089] The technical solutions shown in this application will now be described in detail through specific embodiments. It should be noted that the following embodiments may exist independently or in combination with each other; for identical or similar content, the description will not be repeated in different embodiments.

[0090] Reference Figure 1 This illustration shows a pre-calibration display parameter calibration method provided by an exemplary embodiment of the present application. The method is used to calibrate the display parameters of a near-eye display module, wherein the near-eye display module includes a central display component and a peripheral display component.

[0091] The central display module covers the user's central field of vision and is responsible for presenting high-definition, high-contrast core visual content. The peripheral display modules cover the user's peripheral field of vision and are typically used to extend the field of vision or provide auxiliary information.

[0092] Reference Figure 1 The pre-calibration display parameter calibration method includes the following steps:

[0093] S101, within the field of view of the near-eye display module, determine a portion of the multiple fixation points.

[0094] Optionally, based on the characteristics of the near-eye display module or the task requirements, some of the multiple fixation points can be determined within the field of view of the near-eye display module.

[0095] In this application, multiple fixation areas corresponding to some fixation points can either fully cover the field of view of the near-eye display module or partially cover the field of view of the near-eye display module. This application does not impose any special limitations on this.

[0096] In an optional example, the field of view of the near-eye display module can be divided into an N×N grid, with partial fixation points determined at the center of the grid.

[0097] For example, a gaze point is generated at the center of all grids.

[0098] For example, a gaze point can be generated at the center of a portion of the grid in the core region.

[0099] In another optional example, partial fixations are generated from multiple fixations based on a specific task (such as reading, searching, or playing).

[0100] S102, obtain the eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point.

[0101] In the embodiments of this application, corresponding sensors can be set at some fixation points to obtain eye simulation datasets of the central display component and / or the peripheral display component. Alternatively, corresponding sensors can be set near some fixation points to obtain eye simulation datasets of the central display component and / or the peripheral display component.

[0102] Optionally, the aforementioned sensors may include an image sensor or a brightness sensor. The image sensor may be positioned at a corresponding partial fixation point to acquire an eye-simulation dataset of the central display component and / or the peripheral display component. The brightness sensor may be positioned near or at a corresponding partial fixation point to acquire an eye-simulation dataset of the central display component and / or the peripheral display component.

[0103] S103, based on the eye-simulation dataset, determine the pre-calibrated display parameter set for the central display component and / or the peripheral display component.

[0104] In this embodiment, the eye-simulation dataset may include data for pre-correcting aberrations, or data for pre-improving brightness uniformity. This means that the eye-simulation dataset and the pre-corrected display parameter set can exist in at least three of the following ways:

[0105] The first type, where the eye simulation dataset includes data for pre-correcting aberrations, then the pre-corrected display parameter set includes pixel position pre-correction parameters;

[0106] The second type, where the eye simulation dataset includes data for improving brightness uniformity in advance, includes pixel brightness pre-correction parameters.

[0107] The third type, where the eye simulation dataset includes data for pre-correcting aberrations and data for pre-improving brightness uniformity, then the pre-corrected display parameter set includes pixel position pre-correction parameters and pixel brightness pre-correction parameters.

[0108] Based on the pre-corrected aberration data, the generated pre-corrected display parameter set is used to pre-correct aberrations present in different optical elements in a hybrid optical system.

[0109] Based on data that has been pre-improved for brightness uniformity, a pre-calibrated set of display parameters is generated to pre-correct for differences in luminous efficacy among different optical elements in a hybrid optical system.

[0110] When the above technical solution is adopted, the pre-calibration display parameter calibration method obtains the eye-entry simulation dataset of the central display component and / or the peripheral display component at some fixation points in the field of view of the near-eye display module, and then determines the pre-calibration display parameter set of the central display component and / or the peripheral display component based on the eye-entry simulation dataset.

[0111] This pre-calibrated display dataset can be used to pre-correct the pixel imaging offset of the central display component and / or the peripheral display components, so as to correct the pixel imaging offset caused by aberrations in different display areas and thus improve the splicing gap.

[0112] And / or, the pre-corrected display dataset can be used to pre-correct brightness abrupt changes in the central display component and / or peripheral display components, making the brightness transition between the display areas of the central display component and the peripheral display components more natural, reducing the human eye's perception of brightness boundaries, and making the brightness of the near-eye display image more uniform.

[0113] In an optional implementation, the eye-simulation dataset may include the eye-simulation dataset of the central display component corresponding to the partial fixation points, and / or the eye-simulation dataset of the peripheral display components.

[0114] The luminance dataset is collected by a luminance detection module, which includes multiple luminance sensors. The luminance dataset of the central display component is collected by at least one luminance sensor facing the central display component, and the luminance dataset of the peripheral display component is collected by at least one luminance sensor facing the peripheral display component.

[0115] Some of the fixation points can be referred to in the previous explanation, and will not be repeated here.

[0116] In this embodiment of the application, the gaze area of ​​this portion of the gaze point may include a central gaze point and peripheral gaze points. The central gaze point corresponds to the gaze point directly in front of the user, and the peripheral gaze points correspond to the gaze points to the side and in front of the user.

[0117] Optionally, any one of the aforementioned partial fixations can be understood as each fixation point in the partial fixations.

[0118] Reference Figure 2 , Figure 3 and Figure 4 A luminance sensor 31 is deployed at any of the fixation points in the partial fixation points to acquire the luminance data actually received by the user's eyes at the corresponding fixation point.

[0119] Reference Figure 2 and Figure 3 The brightness sensor 31 is positioned between the near-eye display module and the user's eyes, and the brightness sensor is close to the near-eye display module, with the brightness sensor 31 facing the light-emitting end of the near-eye display module.

[0120] In some other embodiments, reference is made to Figure 4 The brightness sensor 31 can also be positioned close to the user's eyes, or the brightness sensor 31 can be positioned at a preset location on the user's eyes (not shown in the figure) to more accurately measure the brightness data entering the eye.

[0121] The number of brightness sensors 31 can be determined based on the field of view of the near-eye display module and the brightness acquisition field of view of a single brightness sensor.

[0122] In one example, horizontally, that is Figure 2 In the left-right direction shown, if the brightness acquisition field of view of a single brightness sensor 31 is 10° and the field of view of the near-eye display module is 120°, then 12 brightness sensors 31 can be evenly spaced, with each brightness sensor 31 corresponding to one of the partial fixation points, and the number of partial fixation points in this embodiment is 12; or 5 brightness sensors 31 can be evenly spaced, with each brightness sensor 31 corresponding to one of the partial fixation points, and the number of partial fixation points in this embodiment is 5.

[0123] Based on this, at each fixation point of partial fixation, the luminance dataset of the central display component and the peripheral display component within the field of view of the corresponding luminance sensor can be obtained through the deployed luminance sensors.

[0124] Then, the eye brightness datasets of the central display component and the peripheral display component corresponding to some gaze points can be combined to obtain the eye brightness dataset at each pixel position of the central display component and the peripheral display component.

[0125] The pre-calibrated display parameter set includes the central display component and / or the brightness weight allocation matrix corresponding to each pixel position in the peripheral display components.

[0126] In this embodiment, the luminance weighting matrix is ​​a weight assigned to each pixel position to adjust its luminance contribution at different gaze points, so as to achieve uniformity of overall luminance.

[0127] Below, in Figure 1 Based on the illustrated embodiments, combined with Figure 5 The calibration method for the above display parameters will be explained in detail.

[0128] Figure 5 The first step flow of a display parameter calibration method provided in the embodiments of this application Figure 2 Please see. Figure 5 The method may include:

[0129] S201, within the field of view of the near-eye display module, determine a portion of the multiple fixation points.

[0130] The description of this step can be found in [reference]. Figure 1 The relevant description of S101 in the document will not be repeated here.

[0131] S202, obtain an eye-simulation dataset of the central display component and / or the peripheral display component at multiple partial fixation points.

[0132] The description of this step can be found in [reference]. Figure 1 The relevant description of S102 in the document will not be repeated here.

[0133] As described above, the eye-simulation data may include the eye-simulation data sets of the central display component and / or the peripheral display component at the respective fixation points (i.e., the eye-simulation data set of the first case mentioned above).

[0134] S203, based on the eye brightness datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, determine the eye brightness data of each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial fixation points.

[0135] The local luminance datasets corresponding to the central display component and / or the peripheral display component for each of the partial fixation points can be understood as: the local luminance datasets corresponding to the central display component and / or the peripheral display component for any fixation point among the partial fixation points. That is, if the partial fixation points include 12 fixation points, then the number of local luminance datasets corresponding to each partial fixation point is also 12.

[0136] For any fixation point among the partial fixations, the distribution of the eye-receiving luminance data in the corresponding central display component and / or peripheral display component is related to the testing accuracy of the luminance detection module. If the testing accuracy of the luminance detection module is high, it can accurately measure the luminance value of each pixel position within the acquisition field of view of the luminance detection module corresponding to the fixation point; if the testing accuracy of the luminance detection module is low, it can only measure the luminance value of each pixel region within the acquisition field of view of the luminance detection module corresponding to the fixation point, that is, the luminance value of each pixel position is equal within any pixel region.

[0137] Optionally, the field of view of the brightness detection module can be understood as the field of view of multiple brightness sensors included in the brightness sensor module.

[0138] The field of view of a brightness sensor can be understood as the spatial angular range within which the sensor can receive light, usually expressed as horizontal angle × vertical angle. For example, the field of view of a brightness sensor is 60° × 40°.

[0139] The aforementioned combined field of view can be understood as combining the field of view of each brightness sensor.

[0140] Optionally, when the coverage areas of the acquisition fields of multiple sensors are independent, the stitched acquisition field of view is the result of stitching together the acquisition fields of multiple sensors. When the coverage areas of the acquisition fields of multiple sensors overlap, the stitched acquisition field of view is the acquisition field of view obtained by fusing the overlapping acquisition fields of view.

[0141] Based on the above description, the luminance data of each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to a partial fixation point can be understood as: the luminance data of each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to all partial fixation points, where each pixel position can be understood as all pixel positions within the detection area covered by the luminance detection module. For example, if the luminance detection module corresponding to a partial fixation point covers a detection area with a field of view of 60°, then "the luminance data of each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to a partial fixation point" is: the luminance data of each pixel position in the central display component and / or the peripheral display component included within this 60° acquisition field of view.

[0142] S204, based on the eye brightness data of each pixel position corresponding to the partial fixation points, determine the dynamic brightness weight corresponding to each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial fixation points.

[0143] In some examples, the aforementioned dynamic brightness weights can be determined based on a brightness weight term formed from the eye brightness data at the corresponding pixel position, a preset brightness gradient weight term, and a preset distance attenuation weight term, in order to more accurately adjust the display effect of the near-eye display module, thereby improving brightness uniformity and visual comfort.

[0144] Optionally, dynamic brightness weights can be characterized as:

[0145] ;

[0146] Where α is the trust weight of the brightness sensor data, representing the degree of dependence on direct measurements; the default value for α can be 0.6. sensor The brightness data of the eye obtained by the brightness sensor, β is the brightness gradient weight, which is used to enhance the correction intensity in areas with drastic brightness changes. The default value of β can be 0.3. γ represents the rate of change in brightness, and γ is the distance attenuation weight, controlling the influence range of the seam or edge area. The default value of γ is 0.1. d is the physical distance from the pixel position to the seam (virtual image seam), in millimeters (mm). d0 is the characteristic length of distance attenuation, determining the degree of diffusion of the influence range. The typical value of d0 is 5mm.

[0147] S205, based on the dynamic brightness weight corresponding to each pixel position corresponding to each of the partial gaze points, the normalized weight corresponding to each pixel position, and the brightness correction weight corresponding to each pixel position, determine the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial gaze points.

[0148] The normalized weight is obtained by normalizing the multiple dynamic brightness weights corresponding to the multiple pixel positions. This normalized weight is used to normalize the dynamic brightness weights corresponding to the multiple pixels, and to adjust the sum of these weights to 1.

[0149] It should be understood that without normalized weights, the absolute value of dynamic brightness weights can fluctuate significantly due to various factors (such as different brightness measurements, parameter settings, etc.). When these dynamic brightness weights are directly used for brightness correction, it may cause the brightness of certain pixel locations to be over-amplified or over-compressed. For example, if the dynamic brightness weight of a certain pixel location becomes abnormally large due to measurement errors or other reasons, adjusting the brightness according to this weight without normalization may cause the brightness of that pixel location to be much higher than normal, disrupting the overall brightness balance; conversely, if the weight is too small, it may cause the brightness of the pixel location to be over-compressed. However, with normalized weights, the weight of each pixel location is limited to a relatively reasonable range, avoiding such extreme changes in absolute brightness values.

[0150] In near-eye display modules, excessive brightness adjustment of pixels in certain local areas can lead to local overcorrection. For example, excessively increasing the brightness weight of some pixels in a region to improve brightness uniformity may result in these pixels being too bright, increasing the brightness difference with surrounding pixels, and ultimately affecting the overall display effect. Normalized weights, by reasonably allocating weight ratios, avoid this local overcorrection, making brightness adjustment smoother and more uniform.

[0151] The brightness correction weight is determined based on the error term of the brightness data of the pixels corresponding to the pixel positions.

[0152] It should be understood that errors in the brightness data of the area in front of the eye can originate from multiple sources, such as measurement errors of the brightness sensor, the influence of ambient light, and brightness fluctuations of the display components themselves. For example, when measuring the brightness of the area in front of the eye, the brightness sensor may be affected by external interference or its own accuracy limitations, resulting in a deviation between the measured value and the actual brightness of the area in front of the eye; changes in ambient light can also affect the brightness value measured by the sensor, thus producing errors.

[0153] The embodiments of this application determine the brightness correction weight based on these error terms, which can further correct the brightness of the pixel position. If the brightness data of a certain pixel position has a positive error (the measured value is higher than the actual value), by reducing its brightness correction weight, the contribution of that pixel position to the final brightness display can be reduced, making its brightness closer to the actual requirement; conversely, if there is a negative error (the measured value is lower than the actual value), the brightness correction weight can be increased, increasing its brightness contribution.

[0154] Therefore, by adjusting the brightness correction weight, the true brightness of the pixel position can be reflected more accurately, thereby improving the display accuracy of the near-eye display module.

[0155] Optionally, the brightness weighting matrix can be represented as:

[0156] ;

[0157] Where W(x,y) represents the dynamic weight function, ∑W(x i ,y i The normalized denominator is represented by λ, which is the nonlinear enhancement coefficient used to control the amplification ratio of brightness difference. The default value is 0.2. erf is the error function, where ΔL represents the absolute difference between the current brightness (the brightness data detected by the brightness sensor) and the true brightness (the brightness data in the set display dataset). σ is the brightness difference threshold, which determines the sensitivity of the error function (erf). The default value is 5 cd / m². When ΔL > σ, the error function approaches 1, increasing the correction strength; when ΔL < σ, the error function approaches 0, maintaining linear adjustment.

[0158] Based on the above steps S203-S205, the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to the partial fixation points can be determined according to the eye luminance dataset of the central display component and / or the peripheral display component corresponding to the partial fixation points.

[0159] S206a, based on the brightness weight allocation matrix of each pixel position within the acquisition field of view of the brightness detection module corresponding to the partial fixation point, determine the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component.

[0160] In this embodiment of the application, the field of view of the brightness detection module corresponding to the partial gaze point may completely cover the entire field of view formed by the central display component and the peripheral display component, or it may partially cover a portion of the field of view formed by the central display component and the peripheral display component.

[0161] In one optional implementation, the brightness detection module has multiple brightness sensors, and the field of view of the multiple brightness sensors covers at least a portion of the field of view formed by the central display component and the peripheral display component.

[0162] In some examples, the field of view of the brightness detection module covers the entire field of view formed by the central display component and the peripheral display components.

[0163] Then as Figure 6 As shown, step S206b may include: combining the luminance weight allocation matrix of each pixel position corresponding to the partial gaze points to obtain the central display component, and / or the luminance weight allocation matrix corresponding to each pixel position in the peripheral display component.

[0164] It should be understood that since the field of view of the brightness detection module corresponding to some gaze points covers the entire field of view formed by the central display component and the peripheral display component, the brightness weight allocation matrix of each pixel position corresponding to each of the some gaze points can be combined to form the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component.

[0165] Optionally, the matrix stitching rules can be determined based on the field-of-view structure of the near-eye display module and the distribution of the brightness sensors. Since the brightness sensors corresponding to some gaze points are evenly distributed within the field of view, a position-based stitching method can be used. For example, the field of view can be divided into multiple sub-regions, each sub-region corresponding to the acquisition field of view of one gaze point. According to the positional relationship of the sub-regions, the brightness weight allocation matrices corresponding to each gaze point in the partial gaze points can be stitched together sequentially.

[0166] When the fields of view of adjacent fixation points may overlap, the brightness weights of the overlapping areas need to be processed. A weighted averaging method can be used, where different weight coefficients are assigned to the brightness weights corresponding to different fixation points based on the distance of the overlapping area from each fixation point or its importance, and then a weighted average is performed to obtain the final brightness weights of the overlapping areas.

[0167] Subsequently, following the established stitching rules and processing methods, the luminance weight allocation matrices corresponding to some gaze points are stitched together to form complete luminance weight allocation matrices corresponding to each pre-corrected pixel in the central display component and the peripheral display components. This matrix should cover the entire field of view of the near-eye display module, and each pixel should have a corresponding luminance weight value.

[0168] It is worth noting that, Figure 6 For a detailed description and technical effect of steps S201-205, please refer to Figure 5 The embodiments shown are not described in detail here.

[0169] In another example, the field of view of the brightness detection module covers a portion of the field of view formed by the central display component and the peripheral display components. For example... Figure 7 As shown, step S206c may include: obtaining the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the brightness weight allocation matrix corresponding to each pixel position in the peripheral display component by combining the brightness weight allocation matrix corresponding to each pixel position in the field of view of the brightness sensor corresponding to the partial gaze points and the interpolation method.

[0170] It should be understood that the field of view of the brightness detection module covers a portion of the field of view jointly formed by the central display component and the peripheral display components. This can be interpreted as the brightness detection module's field of view being smaller than the combined field of view of the central display component and the peripheral display components. Therefore, the multiple brightness detection modules cannot measure the position of every pixel in the central display component and / or the peripheral display components. Based on this, the embodiments of this application use interpolation to calculate the brightness weight of each pixel position in the central display component and / or the peripheral display components based on the brightness information of the surrounding area collected by the brightness sensor in the brightness detection module, making the data more complete.

[0171] Specifically, for each pixel location, the known luminance weight assignment matrix data points in its vicinity are found (i.e., the luminance weight values ​​corresponding to the nearest gaze points). Then, the luminance weight value for that pixel location is calculated according to the selected interpolation method. For example, when using bilinear interpolation, interpolation can be performed based on the luminance weight values ​​of the four nearest neighbor gaze points.

[0172] In the two examples above where the field of view acquired by the brightness detection module covers at least a portion of the field of view formed by the central display component and the peripheral display components, such as... Figure 2 As shown, as a first setting of the brightness detection module, the brightness dataset of the central display component is collected by at least one brightness sensor with the brightness acquisition direction perpendicular to the central display component, and the brightness dataset of the peripheral display component is collected by at least one brightness sensor with the brightness acquisition direction perpendicular to the peripheral display component.

[0173] In other words, the brightness acquisition direction of at least one brightness sensor in the brightness detection module is perpendicular to the central display component, wherein the central display component forms a field of view of 0-60°. For example, at a fixation point with a field of view of 35°, the brightness acquisition direction of the brightness sensor is perpendicular to the central display component. The brightness acquisition direction of at least one brightness sensor is perpendicular to the peripheral display component, wherein the peripheral display component forms a field of view of 60-120°. For example, at a fixation point with a field of view of 100°, the brightness acquisition direction of the brightness sensor is perpendicular to the peripheral display component. This vertical setup ensures uniform brightness across the pre-calibrated central and peripheral display components. This means that the brightness collected at equidistant points from both components is equal. Therefore, there is no strict constraint on the direction of brightness collection by any single brightness sensor along the gaze direction of its corresponding gaze point. This allows the brightness sensor at any gaze point to be directly aligned with the emitting surface of the central or peripheral display component, minimizing brightness loss and deviation caused by light refraction and reflection. This results in more accurate collection of the actual brightness data entering the human eye from the central or peripheral display components, providing a precise basis for subsequent brightness adjustment and control.

[0174] Furthermore, it should be understood that the central display component and the peripheral display components may differ in terms of displayed content, functions, and user attention, and their brightness requirements may also differ. By setting brightness sensors perpendicular to them, the brightness data of the two areas can be collected independently and accurately, enabling the embodiments of this application to perform personalized brightness adjustments for different areas and meet diverse display needs.

[0175] Alternatively, in the two examples above where the field of view of the brightness detection module covers at least a portion of the field of view formed by the central display component and the peripheral display components, such as... Figure 3 As shown, in the second configuration of the brightness detection module, the brightness acquisition direction of any brightness sensor in the brightness detection module is set along the gaze direction of its corresponding gaze point.

[0176] In other words, the brightness acquisition direction of the brightness sensor in the brightness monitoring module is consistent with the corresponding gaze direction. For example, the brightness acquisition direction of the brightness sensor at a gaze point with a field of view of 35° is along the gaze direction of the gaze point with a field of view of 35°. Optionally, in some gaze points, each gaze point corresponds to one or more brightness sensors, and the brightness acquisition direction of the corresponding brightness sensor is consistent with the gaze direction of the gaze point. The brightness data within the gaze area of ​​that gaze point can be acquired by the corresponding one or more brightness sensors.

[0177] Based on this, the brightness acquisition direction of the brightness sensor in the brightness detection module is set along the gaze direction of the corresponding gaze point, so that each brightness sensor can accurately acquire brightness for its specific gaze area, ensuring that the acquired brightness data can reflect the actual brightness situation within the gaze area and improving the accuracy of the brightness data.

[0178] It is worth noting that, Figure 7 For a detailed description and technical effect of steps S201-205, please refer to Figure 5 The embodiments shown are not described in detail here.

[0179] When multiple luminance sensors correspond to the gaze area of ​​any given gaze point, these sensors can collect luminance data from the same gaze area from different angles or positions. By integrating data from multiple sensors, the potential errors or limitations of a single sensor can be further reduced, thereby obtaining luminance information within the gaze area more comprehensively and accurately, and improving the reliability of luminance detection.

[0180] Furthermore, this application can set one or more brightness sensors according to the characteristics and needs of different gaze points, so that the embodiments of this application can adapt to various complex and ever-changing application scenarios. For example, in some gaze areas with high requirements for brightness detection accuracy, multiple brightness sensors can be set for fine detection; while in some relatively less important gaze areas, the number of sensors can be appropriately reduced to reduce cost and complexity while ensuring detection effect.

[0181] In other examples, such as Figure 4 As shown, in a third configuration of the brightness detection module, the brightness acquisition direction of the module is set along the gaze direction of its corresponding gaze point. In this example, within the field of view of the central display component and / or the peripheral display component, the acquisition direction of the brightness detection module can change with the gaze point.

[0182] Specifically, the brightness detection module includes multiple brightness sensors, and in this example, the acquisition range of these multiple brightness sensors can cover the entire field of view of the central display component and / or the peripheral display component. For example, if the field of view of the central display component and / or the peripheral display component is 120°, then the multiple brightness sensors cover a 120° field of view. The acquisition direction of the brightness detection module can be the acquisition direction of the brightness sensor located at the center of the multiple brightness sensors. That is, within the gaze area corresponding to each gaze point, the acquisition direction of the brightness sensor located at the center of the brightness detection module is arranged along the gaze direction of the corresponding gaze point. For example, at a gaze point with a field of view of 35°, the acquisition direction of the brightness sensor located at the center of the brightness detection module is along the gaze direction of the gaze point with a field of view of 35°.

[0183] Based on this, in this example, at any of the partial fixation points, the eye brightness dataset of the central display component and / or the peripheral display component within its corresponding fixation area can be obtained.

[0184] Then as Figure 8 As shown, step S206d may include: based on the brightness weight allocation matrix of each pixel position in the acquisition field of the brightness detection module corresponding to the partial gaze points, and combined with an interpolation method, obtaining the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component in the acquisition field of the brightness detection module corresponding to the multiple gaze points.

[0185] In this embodiment, an interpolation algorithm (such as bilinear interpolation, bicubic interpolation, etc.) can be used to estimate the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component within the viewing area corresponding to multiple viewing points in the field of view, based on the brightness weight allocation matrix of each pixel position corresponding to a finite number of viewing points.

[0186] The number of multiple fixation points can be two or three times the number of partial fixation points, or it can be specifically set according to actual needs. This application embodiment does not impose any special limitations on this.

[0187] The selection of the above interpolation method should be optimized according to the characteristics of the data and the requirements of the display device to ensure the smoothness and accuracy of the interpolation results.

[0188] It should be understood that setting the brightness acquisition direction of the brightness detection module along the gaze direction of the corresponding gaze point allows the brightness acquisition to be more accurately focused on the area actually being focused on by the user. Human visual attention is typically concentrated around the gaze point; this acquisition method avoids acquiring a large amount of brightness information from areas irrelevant to the user's focus, thus obtaining brightness data that better matches human visual perception and improving the relevance and accuracy of brightness detection.

[0189] Furthermore, this example uses the luminance weight allocation matrix of each pixel position within the acquisition field of view of the luminance detection module corresponding to some gaze points as a basis. It extends this matrix to the acquisition field of view corresponding to multiple gaze points through interpolation, enabling fine-grained allocation of luminance weights for each pixel position in the central display component and / or peripheral display components. Based on this, different pixel positions in the central and peripheral display components are assigned different weights according to their importance and visual impact within the gaze point's field of view, resulting in a more detailed and comprehensive luminance analysis. The application of interpolation allows for a smooth transition in luminance weight allocation between adjacent gaze points, avoiding discontinuities in luminance analysis caused by abrupt weight changes. This ensures a reasonable distribution of luminance weights throughout the display area, thereby more accurately reflecting the combined impact of luminance in different areas of the central and peripheral display components on the user's vision.

[0190] It should be further understood that different display content (such as text, images, videos, etc.) has different brightness requirements, and the distribution of the user's gaze point will also change when viewing different content. This example can dynamically adjust the brightness weight allocation matrix according to the actual display content and the user's gaze behavior, so that the near-eye display module can adapt to various complex display scenarios and provide the best brightness display effect.

[0191] It is worth noting that, Figure 8 For a detailed description and technical effect of steps S201-205, please refer to Figure 5 The embodiments shown are not described in detail here.

[0192] Below, in Figure 1 Based on the illustrated embodiments, combined with Figure 9 The calibration method for the above display parameters will be explained in detail.

[0193] Figure 9 A flowchart of a display parameter calibration method provided in this application embodiment Figure 3 Please see. Figure 9 The method may include:

[0194] S301, within the field of view of the near-eye display module, determine a portion of the multiple fixation points.

[0195] The description of this step can be found in [reference]. Figure 1 The relevant description of S101 in the document will not be repeated here.

[0196] S302, acquire an eye-simulation dataset of the central display component and / or the peripheral display component at multiple partial fixation points.

[0197] The description of this step can be found in [reference]. Figure 1 The relevant description of S102 in the document will not be repeated here.

[0198] As described above, the eye-simulation data may include the eye-simulation data sets of the central display component and / or the peripheral display component at the respective fixation points.

[0199] S303, based on the eye brightness datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, determine the eye brightness data of some pixel positions in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial fixation points.

[0200] like Figure 5 In the illustrated embodiment, regarding the description of S203, if the testing accuracy of the luminance detection module is low, it can only measure the luminance value of each pixel region within the acquisition field of view of the luminance detection module corresponding to the fixation point. That is, within any pixel region, the luminance value of each pixel position is equal. To more accurately calculate the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component, the output luminance data of the luminance detection module can be processed. That is, the luminance datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points can be processed.

[0201] Optionally, the eye brightness datasets of the central display component and / or the peripheral display component corresponding to the respective fixation points are processed as follows:

[0202] For any of the aforementioned fixation points, within any pixel region of the acquisition field of the luminance detection module corresponding to that fixation point, the luminance value of each pixel region is determined as the luminance value of the central pixel position within the corresponding pixel region. Based on this, the eye-receiving luminance data of some pixel positions in the central display component and / or the peripheral display component within the acquisition field of the luminance detection module corresponding to that fixation point are determined.

[0203] S304, based on the eye brightness data of the partial pixel positions corresponding to the partial gaze points, determine the dynamic brightness weights of the partial pixel positions in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial gaze points.

[0204] The description of this step can be found in [reference]. Figure 5 The relevant description of S204 in the document will not be repeated here.

[0205] S305, based on the dynamic brightness weights corresponding to the pixel positions corresponding to the partial gaze points, the normalized weights corresponding to the pixel positions, and the brightness correction weights corresponding to the pixel positions, determine the brightness weight allocation matrix corresponding to the pixel positions in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial gaze points.

[0206] The description of this step can be found in [reference]. Figure 5 The relevant description of S205 is not repeated here.

[0207] Based on the above steps S303-S305, it is possible to determine the brightness weight allocation matrix corresponding to the positions of some pixels in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial gaze points, based on the eye brightness dataset of the central display component and / or the peripheral display component corresponding to the partial gaze points.

[0208] S306, based on the luminance weight allocation matrix corresponding to the pixel positions corresponding to the partial gaze points, determine the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to the partial gaze points.

[0209] In this embodiment, based on the partial pixel positions, a mapping relationship between the partial pixel positions and each pixel position can be established through methods such as geometric position matching and interpolation algorithms. For example, for a new pixel position, the nearest partial pixel position is found, and its corresponding brightness weight allocation matrix is ​​used as a reference.

[0210] Using the above mapping relationship, the existing luminance weight allocation matrix for some pixel locations is extended to all pixel locations. For each gaze point in the partial gaze points, a corresponding luminance weight value is assigned to each pixel location according to the mapping relationship. Specifically, assuming there are already some pixel locations P1, P2, ... For a new pixel position Pnew, find the closest partial pixel position Pk, and then assign the brightness weight allocation matrix corresponding to Pk to Pnew.

[0211] Optionally, the expanded brightness weighting matrix can be adjusted based on the range and characteristics of the field of view captured by the brightness sensor. If a pixel is located at the edge of the field of view, its brightness weight may need to be appropriately reduced to avoid the impact of boundary effects on the display. Adjustment rules can be formulated based on the geometry and brightness distribution patterns of the field of view. For example, a linear decay function can be used to adjust the brightness weighting matrix according to the distance from the pixel to the center of the field of view.

[0212] Based on S303-S306, it is possible to determine the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial fixation points, based on the eye brightness dataset of the central display component and / or the peripheral display component corresponding to the partial fixation points.

[0213] S307, based on the brightness weight allocation matrix of each pixel position in the field of view of the brightness detection module corresponding to the partial gaze point, determine the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component.

[0214] The description of this step can be found in [reference]. Figure 5 The relevant description of S206a in the document will not be repeated here.

[0215] The above embodiments provide a detailed description of the simulated eye-viewing data being eye-viewing brightness data, the determination of the central display component based on the eye-viewing brightness dataset, and / or the pre-calibrated display parameter set of the peripheral display component.

[0216] It should be understood that in actual near-eye display modules, due to factors such as manufacturing process and installation errors, the set pixel position may not accurately correspond to the actual position where the brightness needs to be detected. By offsetting to obtain the pre-corrected pixel position, these physical deviations can be compensated. Based on the pre-corrected pixel position, brightness correction can be performed to make the brightness output of the display module more in line with the design requirements, avoid the problem of excessive brightness, excessive darkness or uneven brightness caused by position deviation, and improve the accuracy of the overall brightness display.

[0217] The pre-corrected display parameter set includes the pre-corrected pixel positions of each set pixel position in the central display component and / or the peripheral display component within the gaze regions corresponding to the plurality of gaze points. Optionally, refer to Figure 10The central display component forms a core field of view away from the peripheral display component and a first field of view adjacent to the peripheral display component. The peripheral display component forms an edge field of view away from the central display component and a second field of view adjacent to the central display component. The first field of view and the second field of view are connected or partially overlapped, and the first field of view and the second field of view together constitute a transition field of view.

[0218] The number of fixation points in the transition field of view is greater than the number of fixation points in the core field of view and the edge field of view.

[0219] And / or, the number of fixation points in the first field of view is greater than the number of fixation points in the core field of view, and the number of fixation points in the second field of view is greater than the number of fixation points in the edge field of view.

[0220] It should be understood that increasing the number of fixation points in the transition field of view allows for more accurate measurement and correction of aberrations in that area. This not only ensures consistent correction between the central and peripheral display components in that area, improving the overall synergy of the multi-display system, but also makes the transition of displayed content between the central and peripheral display components smoother, avoiding obvious splicing marks and improving the user's visual comfort.

[0221] As a specific example, within the field of view of the central display component, there is a core field of view that is far from the peripheral display component and a first field of view that is adjacent to the peripheral display component. In the core field of view and the first field of view, a1 and a2 fixation points are respectively taken, and a1 < a2. Within the field of view of the peripheral display component, there is an edge field of view that is far from the central display component and a second field of view that is adjacent to the central display component. In the second field of view and the edge field of view, b2 and b1 fixation points are respectively taken, and b2 > b1.

[0222] Because the light field of the transition field of view is more complex, more simulated viewpoints need to be sampled to increase the amount of data for the actual imaging coordinates, which can make the obtained distortion vector more accurate. Therefore, more gaze points are set in the transition field of view.

[0223] Optionally, the central display component includes a central optical element having a first surface shape, and the peripheral display component includes a peripheral optical element array having a second surface shape, where a1+a2 < b1+b2. Since the light field of the peripheral display component is more complex, setting more simulated viewpoint samples within the field of view of the peripheral display component can also make the obtained distortion vector more accurate.

[0224] Optionally, the aforementioned eye-simulation dataset may further include a set of calibration images of the central display component and / or the peripheral display component within the gaze regions corresponding to the respective gaze points.

[0225] In some embodiments of this application, the central display component and / or the peripheral display component are used to display any test image, such as a whiteboard image.

[0226] More preferably, the central display component and / or the peripheral display component are used to display the calibration board, wherein the multiple calibration images in the calibration image set are all images of the calibration board acquired by the central display component and / or the peripheral display component, which are image sensors located at some gaze points. The pattern on the calibration board can be a checkerboard, a dot matrix, etc.

[0227] For example, both the central display component and the peripheral display component display a checkerboard pattern. A mechanical turntable is used to drive the image sensor to rotate in order to simulate some gaze points and obtain multiple calibration images at some gaze points to obtain the corresponding calibration image set.

[0228] The aforementioned calibration image set is used to determine the distortion vector at the calibrated pixel position in the central display component and / or the peripheral display component within the gaze region corresponding to a partial gaze point. Then, based on the distortion vector, the pre-corrected pixel position corresponding to the calibrated pixel position in the central display component and / or the peripheral display component corresponding to the partial gaze point is determined. In this embodiment, the pre-corrected pixel position corresponding to each pixel position in the central display component and / or the peripheral display component corresponding to multiple gaze points can also be determined based on the pre-corrected pixel position corresponding to the calibrated pixel position in the central display component and / or the peripheral display component corresponding to a partial gaze point.

[0229] Below, in Figure 1 Based on the illustrated embodiments, combined with Figure 11 The calibration method for the above display parameters will be explained in detail.

[0230] Figure 11 A flowchart of a display parameter calibration method provided in this application embodiment Figure 4 Please see. Figure 11 The method may include:

[0231] S401, within the field of view of the near-eye display module, determine a portion of the multiple fixation points.

[0232] The description of this step can be found in [reference]. Figure 1 The relevant description of S101 in the document will not be repeated here.

[0233] S402, obtain the eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point.

[0234] The description of this step can be found in [reference]. Figure 1 The relevant description of S102 in the document will not be repeated here.

[0235] As described above, the eye-entry simulation data may include the calibration image set of the central display component and / or the peripheral display component within the gaze regions corresponding to the partial gaze points (i.e., the second case of the eye-entry simulation dataset).

[0236] S403, based on the calibration image sets corresponding to the partial gaze points, determine the actual virtual image positions corresponding to the set pixel positions in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points.

[0237] In this embodiment of the application, an image processing algorithm is used to detect the feature points (i.e. the corner points of the calibration pattern) of each calibration image in the calibration image set corresponding to the partial gaze points, and the pixel coordinates of all feature points are recorded.

[0238] Then, based on the calibration image, the parameters of the image sensor, and the optical parameters of the central display component and the peripheral display component, the actual virtual image position corresponding to the feature point is calculated.

[0239] The parameters of the image sensor include its intrinsic and extrinsic parameters. The optical parameters of the central and peripheral display components include the focal length, principal point coordinates, and distortion coefficients of the optical elements in the central and peripheral display components.

[0240] Based on the above, the actual virtual image positions corresponding to certain set pixel positions in the central display component and / or the peripheral display component within the field of view corresponding to certain fixation points are obtained. These set pixel positions correspond to the pixel positions of feature points in the calibration images within the calibration image set.

[0241] S404, obtain the target virtual image positions corresponding to the set pixel positions in the central display component and / or the peripheral display component within the gaze regions corresponding to the respective gaze points.

[0242] Based on the partially set pixel positions and the optical parameters of the central display component and / or the peripheral display component, the target virtual image positions corresponding to the partially set pixel positions in the central display component and / or the peripheral display component within the gaze area corresponding to each gaze point can be obtained.

[0243] S405, based on the actual virtual image position of the partial set pixel position corresponding to the partial gaze point and the target virtual image position of the partial set pixel position corresponding to the partial gaze point, determine the distortion vector of each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze point.

[0244] It should be understood that the distortion vector represents the offset of the actual virtual image position relative to the target virtual image position, and is used to quantify the distortion characteristics of pixel position imaging in the central display component and / or peripheral display components.

[0245] For example, for a given pixel location, the distortion vector calculated based on its actual virtual image coordinates and target virtual image coordinates can be represented as: D=(x 实际 -x 目标 ,y 实际 -y 目标 ).

[0246] In some examples, the obtained distortion vector can be stored as a lookup table (LUT) for quick lookup during subsequent distortion correction.

[0247] Optionally, step S405 may include the following steps:

[0248] Step 1: Based on the actual virtual image positions of the partial set pixel positions corresponding to the partial gaze points and the target virtual image positions of the partial set pixel positions corresponding to the partial gaze points, determine the distortion vectors of the partial set pixel positions in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points.

[0249] As described above, some of the pixel positions are set to correspond to the pixel positions of feature points in the calibration image set.

[0250] Based on the target virtual image position corresponding to the partially set pixel position and the actual virtual image position corresponding to the partially set pixel position, the distortion vector of the partially set pixel position is determined. The distortion vector expression described above can be used, and will not be repeated here.

[0251] Step 2: Based on the distortion vectors of the set pixel positions corresponding to the partial gaze points, determine the distortion vectors corresponding to each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points.

[0252] Based on the distortion vectors of the set pixel positions corresponding to the partial gaze points, an interpolation algorithm or distortion model can be used to fit the distortion vectors of each set pixel position in the central display component and / or peripheral display component within the field of view corresponding to the partial gaze points.

[0253] For example, using an interpolation algorithm, determining the distortion vector for each specified pixel position in the central display component and / or peripheral display component within a partial gaze point field of view, based on the distortion vector of a portion of the specified pixel positions, may include:

[0254] Bilinear interpolation is performed on the distortion vectors of adjacent set pixel positions to obtain the distortion vector at the middle position.

[0255] Alternatively, spline interpolation can be used to smoothly extend the distortion vector to each set pixel position.

[0256] For example, using a distortion model, based on the distortion vectors of the specified pixel positions corresponding to the partial gaze points, determining the distortion vector for each specified pixel position in the central display component and / or peripheral display components within the field of view of the partial gaze points can include:

[0257] First, based on the distribution characteristics of the distortion vectors at some pixel positions, select an appropriate distortion model (such as radial distortion model, tangential distortion model, or combined model).

[0258] Then, using the selected distortion model, based on the distortion vectors of the partial set pixel positions, the distortion vectors of each set pixel position in the central display component and / or peripheral display component within the partial foveation field of view are determined.

[0259] The above describes the distortion vectors obtained for each designated pixel position in the central display component and / or the peripheral display component within the field of view corresponding to some gaze points. To verify the accuracy of the obtained distortion vectors for each designated pixel position, the actual virtual image position and the target virtual image position (not involved in the calculation) of the designated pixel position can be used to verify the accuracy of the generated distortion vectors. Based on the verification results, the interpolation method or distortion model parameters can be adjusted to optimize the generation effect of the distortion vectors.

[0260] In some examples, based on the distortion vectors of the respective designated pixel positions corresponding to the respective partial fixation points, it is determined that within the field of view corresponding to the respective partial fixation points, each designated pixel position in the central display component and / or the peripheral display component corresponds to a distortion vector, including:

[0261] Based on the distortion vectors of the respective set pixel positions corresponding to the respective gaze points, and the first distortion vector fitting expression, the distortion vectors of each set pixel position of the central display component and / or the peripheral display component within the gaze areas corresponding to the plurality of gaze points are determined.

[0262] Optionally, the first distortion vector fitting expression can be determined based on the optical distortion model of the central display component and / or the peripheral display component, which describes the mapping relationship between the actual virtual image position and the target virtual image position.

[0263] The optical distortion model can include: radial distortion model, tangential distortion model, or combined distortion model.

[0264] After determining the optical distortion model, the distortion coefficient of the optical distortion model can be optimized by minimizing the residual between the actual virtual image position and the model's predicted position.

[0265] For each set pixel position, the distortion vector is calculated based on the distortion coefficients and distortion model obtained from the fitting.

[0266] In other examples, the central display assembly includes a central optical element having a first surface shape, and the peripheral display assembly includes a peripheral optical element array having a second surface shape;

[0267] Based on the distortion vectors of the respective defined pixel positions corresponding to the respective fixation points, the distortion vectors corresponding to each defined pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the respective fixation points are determined, including:

[0268] First, based on the distortion vector corresponding to at least one set pixel position of the central display component in the distortion vector of the set pixel position corresponding to the partial gaze points, and the second distortion vector fitting expression, the distortion vector of each set pixel position of the central display component within the gaze area corresponding to the partial gaze points is determined.

[0269] In this example, the distortion vector belonging to at least one set pixel position of the central display component is extracted from the distortion vector of a partial set pixel position of a partial gaze point.

[0270] It should be understood that the second distortion vector fitting expression can be determined based on the surface shape of the central display component. The second distortion vector fitting expression can be determined based on the optical distortion model of the central display component, which is used to describe the mapping relationship between the actual virtual image position and the target virtual image position.

[0271] The optical distortion model can include: radial distortion model, tangential distortion model, or combined distortion model.

[0272] Optionally, based on the surface shape of the central display component, a suitable distortion model is selected, and then, as described in the previous example, the distortion vector of each set pixel position of the central display component is determined within the gaze area corresponding to each of the partial gaze points. The specific method will not be elaborated here.

[0273] In one specific implementation, when the central display component is shaped like a pancake, its mathematical expression is as follows:

[0274]

[0275] Among them, A, B, C, D, E, and F are constant parameters that determine the specific shape of the surface of the central display component.

[0276] The distortion model of the pancake shape can be represented as:

[0277]

[0278] in, Indicates radial distortion. x and y are the independent variables, representing the coordinates of the set pixel position. Indicates tangential distortion. This indicates a unique distortion characteristic of pancakes.

[0279] Second, based on the distortion vector corresponding to at least one set pixel position of the peripheral display component in the distortion vector of the set pixel position corresponding to the partial gaze points, and the third distortion vector fitting expression, the distortion vector of each set pixel position of the peripheral display component within the gaze area corresponding to the partial gaze points is determined.

[0280] Similarly, in this example, the distortion vector of at least one set pixel position belonging to the peripheral display component is extracted from the distortion vector of a partial set pixel position of a partial gaze point.

[0281] It should be understood that, based on the surface shape of the peripheral display component, a suitable distortion model can be selected, and then, as described in the previous example, the distortion vector of each set pixel position of the peripheral display component within the gaze area corresponding to the respective gaze points can be determined. The specific method will not be elaborated here.

[0282] In one specific implementation, the peripheral display component is a freeform lens array, and the mathematical expression of its sub-lenses is as follows:

[0283]

[0284] Where c is the vertex curvature and k is the conic coefficient. N is the highest order of the polynomial part, which determines the complexity of the polynomial. nm The coefficients are polynomial coefficients used to adjust the weights of each term. x and y are independent variables representing the coordinates of the set pixel position. m and n are the exponents of each term in the polynomial, used to construct different polynomial terms.

[0285] Optionally, the distortion model of the surface shape of the peripheral display components can be a model that fits the distortion distribution using the first 10 Zernike polynomials:

[0286] ;

[0287] Where ρ=sqrt(x) 2 +y 2 ) / R, Let Zn be the polar angle, Zn be the nth Zernike term, and the fitting error be less than 0.15px.

[0288] In other embodiments, the distortion vector of each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points can be determined based on the actual virtual image position of each set pixel position corresponding to the partial gaze points and the target virtual image position of each set pixel position corresponding to the partial gaze points.

[0289] The actual virtual image position of each set pixel position corresponding to the partial gaze point can be obtained based on the actual virtual image position of the partial set pixel position corresponding to the partial gaze point in the aforementioned step S403.

[0290] For example, by using interpolation or other data processing (such as machine learning prediction, nonlinear fitting, etc.), the actual virtual image positions corresponding to some set pixel positions in the central display component and / or the peripheral display component within the field of view corresponding to some gaze points are expanded to the actual virtual image positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to some gaze points.

[0291] S406, based on the distortion vector of each set pixel position corresponding to the partial gaze points, determine the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points.

[0292] It should be understood that the distortion vector represents the offset of the actual virtual image position relative to the target virtual image position. In order to make the actual virtual image position coincide with the target virtual image position, the set pixel positions of the central display component and the peripheral display component need to be pre-corrected. This is so that the virtual image position after distortion based on the pre-corrected pixel positions becomes the target virtual image position.

[0293] In some examples, step S406 may include:

[0294] First, based on the distortion vector of each set pixel position corresponding to each of the partial gaze points, a compensation vector is determined for each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to each of the partial gaze points.

[0295] It should be understood here that the distortion vector refers to the offset between the actual virtual image position and the target virtual image position corresponding to the set pixel position. Based on this distortion vector, the compensation vector for each set pixel position can be derived.

[0296] Therefore, based on the distortion vector of each set pixel position corresponding to each set pixel position of the partial gaze point, the compensation vector of each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze point can be obtained.

[0297] Optionally, the compensation vector is proportional to the magnitude of the distortion vector, but in the opposite direction.

[0298] Then, based on the compensation vector of each set pixel position corresponding to the partial gaze points, the pre-corrected pixel position of each set pixel position in the central display component and / or the peripheral display component is determined within the field of view corresponding to the partial gaze points.

[0299] Optionally, the pre-corrected pixel position can be obtained based on the compensation vector obtained above and the set pixel position.

[0300] For example, the X and Y components of the compensation vector can be extracted, and then added to the X and Y coordinates of the set pixel position to obtain the pre-corrected pixel position. Based on steps S403-S406, the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the partial gaze points can be determined according to the calibration image set corresponding to the partial gaze points.

[0301] S407, based on the pre-corrected pixel position of each set pixel position corresponding to each set pixel position of the partial gaze points, determine the pre-corrected pixel position corresponding to each set pixel position of the central display component and / or the peripheral display component within the gaze area corresponding to multiple gaze points in the field of view.

[0302] In the embodiments of this application, an interpolation algorithm can be used to determine the pre-corrected pixel positions of the remaining gaze points from the pre-corrected pixel positions of the neighboring partial gaze points.

[0303] Among them, the remaining gaze points can be the gaze points other than some of the multiple gaze points within the field of view.

[0304] In some examples, the pre-corrected pixel positions for each set pixel position corresponding to the aforementioned partial gaze points are stored. For example, they are stored in a LUT, with the structure: LUT[partial gaze points][set pixel positions] = pre-corrected pixel positions.

[0305] For the remaining gaze points, any suitable interpolation algorithm, such as bilinear interpolation or nearest neighbor interpolation, can be used to determine the pre-corrected pixel positions of the remaining gaze points from the pre-corrected pixel positions of the neighboring partial gaze points.

[0306] Specifically, first, find the gaze point closest to the other gaze points among the partial gaze points. Then, using the pre-corrected pixel position corresponding to each set pixel position within the gaze region corresponding to the neighboring gaze point, obtain the corresponding pre-corrected pixel position corresponding to each set pixel position within the gaze region of the other gaze points through an interpolation method.

[0307] Then, the pre-corrected pixel position of each set pixel position of the remaining gaze points is stored in the LUT. The specific storage structure can be: LUT[remaining gaze points][set pixel position] = pre-corrected pixel position.

[0308] Based on S403-S407, the pre-correction display parameter set can be determined according to the simulated eye-viewing dataset.

[0309] In an optional implementation, determining the pixel position compensation vector for each of the set pixel positions in the central display component and / or the peripheral display component within the field of view corresponding to each of the partial fixation points, based on the distortion vector of each set pixel position corresponding to each of the partial fixation points, includes the following steps:

[0310] First, based on the distortion vector of each set pixel position corresponding to the partial gaze point and a preset error transfer function, the corrected distortion vector of each set pixel position corresponding to the partial gaze point is determined.

[0311] The error propagation function is determined based on the first error coefficient, the second error coefficient, and the corresponding correction term of the plurality of set pixel positions.

[0312] Optionally, determining the corrected distortion vector for each set pixel position corresponding to each of the partial gaze points, based on the distortion vector for each set pixel position corresponding to each of the partial gaze points and a preset error transfer function, may include the following steps:

[0313] First, based on the distortion vector of each set pixel position corresponding to the partial gaze point, determine the first component and the second component of the distortion vector of each set pixel position.

[0314] The first component can be the X component of the distorted vector, and the second component can be the Y component of the distorted vector.

[0315] Second, based on the first and second components of the distortion vector of each set pixel position corresponding to the partial gaze point, and the correction term, calculate the first error coefficient, the second error coefficient, and the correction coefficient corresponding to the correction term for each set pixel position.

[0316] The correction term is a function of the physical characteristics (such as curvature, optical distortion, etc.) of the central display component or peripheral display components.

[0317] For example, the preset error propagation function model is gk(x,y)=αΔx+βΔy+γH(x,y). α is the first error coefficient, β is the second error coefficient, γ is the correction coefficient, H(x,y) is the correction term, Δx is the first component of the corresponding distortion vector, and Δy is the second component of the corresponding distortion vector.

[0318] Optionally, the first component and the second component of the distortion vector of each set pixel position corresponding to some gaze points are sampled, and the solution set and the verification set are determined according to the corresponding correction terms.

[0319] Optionally, determining α, β, and γ in the model of the aforementioned preset error transfer function may include:

[0320] Initialize the first error coefficient, the second error coefficient, and the correction coefficient. Input the first and second components of the solution set, along with the correction term, into the model of the preset error transfer function. Then, use the least squares method to solve for the first error coefficient, the second error coefficient, and the correction coefficient. Use the first and second components of the validation set, along with the correction term, to optimize the model of the preset error transfer function. When the error exceeds 0.1 pixels, redetermine the solution set and the validation set to solve for new first error coefficients, second error coefficients, and correction coefficients.

[0321] Third, based on the first error coefficient, the second error coefficient, the correction term, and the corresponding correction coefficient in the error transfer function, determine the correction distortion vector for each of the set pixel positions of the central display component and / or the peripheral display component within the gaze regions corresponding to the partial gaze points.

[0322] For each given pixel position, the corrected distortion vector = αΔx + βΔy + γH(x,y). It can be understood that this corrected distortion vector has the same magnitude as the original distortion vector, but in the opposite direction.

[0323] Then, based on the correction distortion vector of each set pixel position corresponding to each of the partial fixation points, the compensation vector of each set pixel position in the central display component and / or the peripheral display component is determined within the field of view corresponding to each of the partial fixation points.

[0324] By determining the compensation vector at the set pixel position based on the correction distortion vector at the set pixel position, the optical distortion of the central display component and the peripheral display group can be corrected, the imaging accuracy of the virtual image can be improved, and the displayed content can be kept clear and distortion-free near the user's gaze point, thereby enhancing the user experience.

[0325] The compensation vector can also achieve seamless splicing of the central display component and the peripheral display group, avoiding misalignment or overlap of the displayed content between the central display component and the peripheral display group.

[0326] In VR / AR devices, precise distortion correction can enhance the user's immersion and make the displayed content more realistic and natural.

[0327] In other embodiments, the compensation vector for the set pixel position can be obtained directly from the distortion vector, without first obtaining the correction distortion vector and then obtaining the compensation vector for the set pixel position from the correction distortion vector.

[0328] In an optional implementation, the above embodiments provide a flowchart of the steps for a display parameter calibration method. Figure 2 (See) Figure 5-8 ) and steps Figure 3 (See) Figure 9 The pixel position in () is the pre-corrected pixel position, which is obtained by offsetting the set pixel position.

[0329] This means that the pre-corrected display parameter set includes at least two parts: pixel position pre-correction parameters and brightness pre-correction parameters. The eye simulation dataset includes data for pre-correcting aberrations and data for pre-improving brightness uniformity (i.e., the third case of the eye simulation dataset).

[0330] Furthermore, before obtaining the brightness pre-calibration display parameters, it is necessary to first obtain the pixel position pre-calibration parameters, and based on the obtained pixel position pre-calibration parameters, pre-calibrate the input pixel positions of the calibration board image to be displayed on the central display component and / or, the peripheral display component. Therefore, it can be understood that after the pixel positions of the image to be displayed on the central display component and / or, the peripheral display component are pre-calibrated, the aforementioned ambient brightness dataset is then acquired by the brightness detection module.

[0331] Given this situation, the display parameter calibration method in this embodiment includes the aforementioned pixel position pre-correction parameter calibration method (such as...). Figure 11 The following is a flowchart of a display parameter calibration method. Figure 4 ) and brightness pre-correction parameter calibration methods (such as Figure 5-8 The following is a flowchart of a display parameter calibration method. Figure 2 Or such as Figure 9 The following is a flowchart of a display parameter calibration method. Figure 3 It consists of two parts.

[0332] As an optional implementation, the central display component used in this embodiment includes a central optical element called a Pancake lens group. This Pancake lens group employs a hyperboloid configuration (R1=-50mm, R2=30mm, PMMA material), with an equivalent focal length of 40mm, and is responsible for high-resolution imaging (ppd≥60) of the central 0°-30° field of view.

[0333] The central display unit includes a 4K×4K main display (each pixel is 6.3μm).

[0334] The peripheral central display assembly includes peripheral optical elements consisting of a freeform lens array. This freeform lens array can be a 3×3 sub-lens matrix, made of glass-silicon composite material (glass portion n=1.52, silicon portion n=1.44), with the focal length of each lens gradually varying with the field of view (40° field of view f=35mm, 60° field of view f=30mm), covering a 30°-60° peripheral field of view.

[0335] The peripheral display components include a 4K×4K peripheral display (6.3μm per pixel), and a 10mm edge area of ​​the peripheral display serves as an algorithm processing transition zone, supporting independent pixel driving.

[0336] The brightness sensor in this embodiment can be a BH1750 digital sensor (accuracy ±1%, response wavelength 400-700nm) to collect brightness data for each field of view;

[0337] The hardware platform used to acquire the calibration image set adopts a heterogeneous computing architecture (FPGA Cyclone V + GPU GTX 1650 + ASIC edge fusion chip) and supports parallel processing: the FPGA is responsible for fixed-point operation of geometric distortion (frequency 150MHz, latency <10μs); the GPU handles high-order aberration compensation and dynamic brightness calculation (computing power 2TOPS, floating-point precision 32-bit).

[0338] The above content provides a detailed description of the display parameter calibration method provided in the embodiments of this application. The near-eye display module to which this display parameter calibration method is applied is described in detail below.

[0339] Optional, refer to Figure 12 , Figure 13 , Figure 14 and Figure 15 The central display component 10 includes a central display 11 and a central optical element 12, and the peripheral display component 20 includes a peripheral display 21 and a peripheral optical element 22.

[0340] In some examples, the central display 11 described above may be a high-resolution and high-refresh-rate OLED or LCD screen, or other suitable screens may be used. This application embodiment does not impose any special limitations on this.

[0341] The aforementioned central optical element 12 is a lens, for example, a freeform surface lens, to optimize the imaging quality of the central field of view.

[0342] The peripheral display 21 can be a flexible OLED or a spliced ​​LCD screen to support curved or irregularly shaped displays, and the screen brightness and contrast of the peripheral display 21 are matched with the central display 11 to ensure display consistency.

[0343] The aforementioned peripheral optical element 22 can be a lens array to extend the peripheral field of view.

[0344] The central optical element 12 is disposed on the display path of the central display 11, and the peripheral optical element 22 is disposed on the display path of the peripheral central display 11.

[0345] For example, the central optical element 12 is located at the light-emitting end of the central display 11 to ensure that the light emitted by the central display 11 is processed by the central optical element 12 before entering the eyes of the person.

[0346] The peripheral optical element 22 is positioned at a certain distance from the light-emitting end of the peripheral display 21 and the central optical element 12 to avoid interference.

[0347] The field of view formed by the central display component 10 and the field of view formed by the peripheral display component 20 are connected or partially overlap.

[0348] It should be understood that by connecting or partially overlapping the fields of view of the central display component 10 and the peripheral display component 20, the field of view of the entire near-eye display module can be expanded. In VR / AR and other display devices, the expanded field of view can enhance the user's sense of immersion and make the displayed content more realistic and natural.

[0349] Optionally, the overlap range between the field of view formed by the central display component 10 and the field of view formed by the peripheral display component 20 is 0.5°-20°. More preferably, the overlap range between the field of view formed by the central display component 10 and the field of view formed by the peripheral display component 20 is 5°-20°.

[0350] It should be understood that the overlapping fields of view can ensure that the fields of view formed by the central display component 10 and the fields of view formed by the peripheral display components 20 are naturally blended at the boundary, avoiding the user's perception of "field of view break" or "screen jump".

[0351] For example, in a VR device, the central display component 10 (high-resolution OLED) is responsible for core information (such as text and icons), while the peripheral display component 20 (low-resolution LCOS) is responsible for environmental enhancements (such as navigation arrows). The overlapping field of view makes the transition between the two visually seamless, improving the user experience.

[0352] In this embodiment of the application, the overlapping range of the field of view can be dynamically adjusted according to the user's head movement or scene requirements. For example, when the user turns their head quickly, the system can expand the overlapping range to 20° to ensure information continuity.

[0353] Furthermore, the aforementioned overlapping range can compensate for partial obstruction of optical elements or display components. For example, in a VR headset, if the central display component 10 obstructs a 5° field of view due to its mechanical structure, the overlapping portion of the peripheral display components 20 (e.g., 10°) can automatically fill the gap, thus preventing information loss.

[0354] In a specific example, such as in AR glasses, the central display uses a Micro-OLED with a 4K resolution and a 30° (horizontal) field of view. The peripheral components use Micro-OLED with a 4K resolution and a 60° (horizontal) field of view. The overlap between their fields of view is 15° to ensure seamless integration of central information (such as navigation arrows) with the surrounding environment (such as roads).

[0355] In another specific example, such as in a VR headset, the central component is an LCD with a refresh rate of 120Hz and a field of view of 110° (horizontal). The peripheral components are OLEDs with a refresh rate of 60Hz and a field of view of 150° (horizontal). The overlap between their fields of view is 20° to compensate for information delay when turning the head quickly.

[0356] Optionally, the MTF of the central display component 10 and the MTF of the peripheral display component 20 are continuous at the point where the fields of view meet or overlap.

[0357] MTF stands for Modulation Transfer Function, which represents the ratio of image modulation to object modulation in an optical system. It is a function of spatial frequency, typically expressed as line logs per millimeter (lp / mm). A higher MTF value indicates better imaging quality and a more accurate transmission of object details and contrast.

[0358] It should be understood that if the MTF of the central display component 10 and the peripheral display component 20 is discontinuous at the overlap, the user will perceive the image as suddenly changing from "clear" to "blurry", resulting in visual discomfort.

[0359] The embodiments of this application optimize the optical system through the above-described scheme, so that the MTF value of the overlapping area transitions smoothly and avoids abrupt changes.

[0360] In AR / VR applications, discontinuous MTF (Mean Transformation Factor) can disrupt the fusion effect between the central and peripheral display components, causing users to perceive a "disjointed screen." This application's embodiment adjusts the MTF of the overlapping area using the aforementioned solution, matching it to the user's gaze point or scene depth, thereby enhancing immersion.

[0361] As an optional implementation, the MTF of the peripheral display component 20 gradually decreases from the third side to the fourth side of the peripheral display component 20, wherein the third side is the side of the peripheral display component 20 closer to the central display component 10, and the fourth side is the side of the peripheral display component 20 farther away from the central display component 10.

[0362] It should be understood that the human visual system is more sensitive to the sharpness of the central field of view, while the requirement for sharpness of the peripheral field of view is lower. The embodiments of this application, through a gradient MTF design, can meet visual requirements.

[0363] For example, if the MTF of the peripheral display component 20 is constant (e.g., full field of view MTF=0.5), a sharpness abrupt change may occur at the overlap between the third side and the central display component 10 (MTF=0.8). However, a gradient design (e.g., near-end MTF=0.7, far-end MTF=0.3) can achieve a smooth transition.

[0364] In this embodiment of the application, the MTF of the peripheral display component 20 can be set to decay more slowly on the third side (e.g., from 0.8 to 0.7) and more quickly on the fourth side (e.g., from 0.5 to 0.3) to conform to the visual characteristics of the human eye (high sensitivity in the center and low sensitivity at the edges).

[0365] For example, from the center to the edge of the central display component 10, the MTF of the central display component 10 gradually decreases from 0.8-0.95 to 0.5. Along the third side of the peripheral display component 20 to the fourth side of the peripheral display component 20, the MTF of the peripheral optical element 22 gradually decreases from 0.5 to 0.2.

[0366] It should be understood that the MTF of the center (e.g., the point of gaze) of the central display component 10 is set to 0.8-0.95 to ensure that key information such as text and icons are highly clear. From the center to the edge of the central display component 10, the MTF of the optical element is linearly or non-linearly attenuated to 0.5 to avoid visual discomfort caused by abrupt changes in sharpness.

[0367] Along the third side to the fourth side of the peripheral display component 20, the MTF of the peripheral optical element 22 gradually decreases from 0.5 to 0.2. This reduces the optical design complexity of the peripheral display component while maintaining a large field of view for the near-eye display module and ensuring the recognizability of edge information. It also reduces pixel density, brightness, and power consumption. Furthermore, the MTF of the optical element on the third side of the peripheral display component 20 is 0.5, matching the MTF of the optical element at the edge of the central display component 10, thus avoiding sharpness gaps in overlapping areas.

[0368] Reference Figure 9 , Figure 10 and Figure 11 The edge pixel imaging of the central display 11 and the peripheral display 21 needs to overlap to ensure that the virtual image A' is to the left of the virtual pixel B'. The larger the overlap area, the better, to improve the robustness of the near-eye display device. The central optical element 12 is responsible for the central 60° viewing angle, with a ppd greater than 60. The MTF of the central display area decreases from 0.85 at the center to 0.5 at the edge, and the peripheral display area decreases from 0.5 to 0.2, which can ensure a natural transition in image quality without abrupt changes. The peripheral optical element 22 consists of multiple lens arrays coupled to the periphery of the central optical element 12.

[0369] Pixel overlap requires addressing both optical design and display calibration.

[0370] In terms of optical design, it is necessary to ensure that the optical paths of the edge pixels of the main peripheral display 21 overlap in the eyebox region, which involves adjusting the lens angle and calibrating the optical axis. For example, adjusting the optical axis angle of the peripheral optical element 22 ensures that the imaging of the edge pixels of the peripheral display 21 covers the imaging area of ​​the edge pixels of the central display 11. Next, a natural transition of MTF requires a gradual aberration design. The MTF of the central display area decreases from the center to the edge, and this is achieved by introducing controllable aberrations, such as field curvature and spherical aberration. The MTF of the peripheral display area decreases further, requiring the design of larger aberrations in the peripheral optical element 22, but attention must be paid to the smoothness of the transition region to avoid abrupt changes. Aspherical or freeform lenses are needed, combined with the material refractive index gradient, to achieve the gradual change of MTF.

[0371] Then, the specific implementation method of pixel overlap is as follows: the imaging of pixel A' on the left edge of the central display 11 and pixel B' on the right edge of the peripheral display 21 needs to overlap. The optical paths of the two parts are precisely calculated to ensure that, in the eye box region, the position of A' is to the left of B' (in... Figure 14 (As shown in the direction below), and with sufficient overlap. Simulate the optical path of edge pixels and adjust lens parameters to ensure the imaging position meets requirements.

[0372] Simultaneously, the display driving circuit needs to calibrate the brightness and color of edge pixels to ensure consistency in overlapping areas. Furthermore, the central optical element 12 has a center viewing angle (ppd) greater than 60, resulting in high resolution. However, the image quality of the peripheral display area closer to the central display area is higher, while the quality is lower on the side farther away. This necessitates a gradual change in resolution for the peripheral optical element 22 based on its position. This can be achieved by using a variable focal length sub-lens array, or by adjusting the size and spacing of the sub-lenses, so that the sub-lenses closer to the central display area have higher resolution and a correspondingly higher MTF, while the sub-lenses farther from the central display area have lower resolution and a correspondingly lower MTF.

[0373] The precision of the mechanical structure ensures the accurate relative positioning of the central and peripheral optical components, avoiding gaps caused by assembly errors. This may require a high-precision positioning structure and calibration process, combined with real-time calibration of the IMU and image sensor, to dynamically adjust the displayed content and compensate for positional deviations.

[0374] Finally, the larger the overlap area of ​​the field of view between the central display component 10 and the peripheral display component 20, the higher the tolerance for user eye and head movements. In optical design, expanding the imaging overlap range of edge pixels, while further eliminating stitching artifacts through software algorithms (such as edge blending), ensures that users can see continuous and natural images from different viewing angles.

[0375] In a specific example, the central display 11 and the peripheral display 21 use the same OLED panel (2.5K×2.5K, 300ppi), and the 3mm edge area of ​​the peripheral display 21 is a splicing transition zone.

[0376] Edge pixel calibration: The imaging coordinates of the left edge pixel A of the central display 11 and the right edge pixel B of the peripheral display 21 satisfy xA′=xB′-2Δx; Δx=0.2mm, corresponding to a 0.5° field of view overlap.

[0377] In this embodiment, the MTF gradient transition optimization scheme for the central display component 10 and the peripheral display component 20 may include:

[0378] Central display area MTF control:

[0379] Aberration gradient distribution: A controllable field curvature (field curvature coefficient) is introduced in the central optical element 12. The MTF (Mean Transformation Factor) and third-order spherical aberration (SPHA = 0.005λ) are optimized using Zemax to make the MTF decrease exponentially from the center (0°) to the edge (30°).

[0380] MTF(f) = 0.85×e^(-0.015f) to 0.5×e^(-0.015f) (f is the spatial frequency, in cycles / mm)

[0381] Material refractive index gradient: Use graded refractive index glass or different lenses with different refractive indices; the larger the field of view, the higher the refractive index (e.g., Schott OG5). The refractive index gradually increases from 30° to 60°, which lengthens the light propagation path at the edge of the field of view by 1.2 times and naturally attenuates the high-frequency response.

[0382] Composite aberration superposition: Coma (COMA=0.01λ) and astigmatism (ASTI=0.008λ) are introduced simultaneously in the peripheral optical element 22, so that the MTF decreases from 0.5 in the boundary region (30° field of view) to 0.2 in the edge (60° field of view), and the MTF slope in the transition region (30°-45°) is controlled within -0.01 / ° to avoid abrupt changes.

[0383] Microstructure surface treatment: Submicron-level cylindrical textures (500nm period, 150nm depth) are processed on the surface of peripheral optical element 22. An additional 15% attenuation is introduced for frequencies above 50 cycles / mm to achieve uniform gradient descent of MTF, simulating the natural resolution reduction of peripheral vision of the human eye.

[0384] In one alternative implementation, the peripheral display component 20 is tilted or perpendicular to the central display component 10.

[0385] It should be understood that by arranging the peripheral display components 20 at an angle or vertically, the horizontal field of view of the near-eye display module can be extended.

[0386] For example, the display surfaces of the peripheral display component 20 and the central display component 10 are arranged at an angle of 15°-90°. The inclined arrangement of the two can not only cover the edge field of view that is difficult to achieve by the traditional coplanar layout, but also reduce the complexity of the optical elements in the peripheral display component 20 and the central display component 10, thereby reducing the thickness of the optical elements in the peripheral display component 20 and the central display component 10.

[0387] For example, the peripheral display component 20 is perpendicular to the central display component 10 to form a three-dimensional display structure, which can support a larger field of view.

[0388] Optionally, the central optical element 12 is a lens, and the peripheral optical element 22 is a lens array.

[0389] The central optical element 12 may employ a freeform lens to reduce aberrations and improve image quality, or a Fresnel lens to achieve a thinner and lighter design.

[0390] The central optical element 12 covers the user's main gaze area, such as the central ±30° field of view of a VR headset.

[0391] The peripheral optical element 22 can be a microlens array to improve the brightness uniformity of the edge region, or it can be a freeform lens array to optimize the imaging quality of the edge field of view through asymmetric surface design.

[0392] The peripheral optical element 22 is used to extend the user's field of view to the edge area, such as the edge 60°-120° field of view of a VR headset.

[0393] As an optional implementation, along the direction from the first side to the second side of the peripheral optical element 22, the focal length of the sub-lens in the peripheral optical element 22 gradually decreases, and / or the refractive index of the peripheral optical element 22 gradually increases; the first side is the side of the peripheral optical element 22 closer to the central optical element 12, and the second side is the side of the peripheral optical element 22 farther away from the central optical element 12.

[0394] It should be understood that along the direction from the first side to the second side of the peripheral optical element 22, the focal length of the sub-lens in the peripheral optical element 22 gradually decreases, which can form an optical gradient from weak convergence to strong convergence. The strong convergence capability of the second side can compensate for the aberrations of edge rays (such as coma and astigmatism), thereby improving the edge imaging quality.

[0395] Furthermore, when expanding the field of view, the edge light rays require stronger converging ability due to the increased incident angle. The focal length gradient design can balance the light intensity distribution in the central and edge areas and reduce brightness attenuation.

[0396] Along the direction from the first side to the second side of the peripheral optical element 22, the refractive index of the peripheral optical element 22 gradually increases to form a high refractive region on the second side of the peripheral optical element 22, which can enhance the refractive effect and improve the light efficiency. In addition, the gradual change in refractive index of the peripheral optical element 22 can replace part of the curved surface design, thereby reducing the number of peripheral optical elements 22.

[0397] It should be understood that, through the synergistic effect of the gradually decreasing focal length of the sub-lens in the peripheral optical element 22 and the gradually increasing refractive index of the peripheral optical element 22 along the direction from the first side to the second side, the converging ability of the edge light rays of the peripheral optical element 22 can be further increased, while reducing aberrations. Furthermore, by adjusting the gradient parameters, the dynamic distribution of the light field of the peripheral display assembly 20 can be achieved.

[0398] As a specific implementation, the focal length of the sub-lens in the peripheral optical element 22 can be gradually reduced along the direction from the first side to the second side by gradually reducing the surface curvature of the sub-lens from the first side to the second side, or by gradually increasing the thickness of the sub-lens from the first side to the second side.

[0399] Along the direction from the first side to the second side of the peripheral optical element 22, the refractive index of the peripheral optical element 22 gradually increases. This can be achieved by changing the material density or doping concentration of the sub-lens, or by introducing microstructures (such as photonic crystals) on or inside the sub-lens and controlling the refractive index through the equivalent medium theory. Alternatively, a complex refractive index distribution can be achieved by printing materials with different refractive indices layer by layer.

[0400] Optionally, along the direction from the first side to the second side of the peripheral optical element 22, the refractive index of the peripheral optical element 22 gradually increases from 1.2 to 2.2.

[0401] As an optional example, such as Figure 16 As shown, the diameter or side length of the sub-lens located on the first side of the peripheral optical element 22 is smaller than the diameter or side length of the sub-lens located on the second side of the peripheral optical element 22.

[0402] The sub-lens on the first side of the peripheral optical element 22 has a smaller diameter, while the sub-lens on the second side has a larger diameter, which can capture more edge light rays and compensate for the light flux attenuation caused by the increase in the field of view. Moreover, the synergistic effect of the sub-lens size gradient and the refractive index / focal length gradient of the peripheral optical element 22 can optimize the optical performance of the edge field of view and reduce brightness unevenness and aberrations.

[0403] Specifically, the large sub-lens located on the second side of the peripheral optical element 22 can collect more edge light rays, increase the light intensity in the edge region of the peripheral optical element 22, and combined with the gradual change in refractive index, the large sub-lens can disperse the incident angle of edge light rays and reduce aberrations (such as field curvature and distortion).

[0404] As another alternative example, the diameter or side length of the sub-lens in the peripheral optical element 22 gradually increases along the direction from the first side to the second side.

[0405] It should be understood that along direction A from the first side 221 to the second side 222 of the peripheral optical element 22, the diameter or side length of the sub-lens gradually increases. This not only achieves the basic function in the previous example that "the diameter or side length of the sub-lens located on the first side 221 of the peripheral optical element 22 is smaller than the diameter or side length of the sub-lens located on the second side of the peripheral optical element 22", but also improves the uniformity of brightness across the entire field of view, reduces the distortion rate at the edge of the field of view, and expands the field of view angle.

[0406] Specifically, the sub-lens on the first side 221 of the peripheral optical element 22 has a smaller diameter or side length, while the sub-lens on the second side 222 has a larger diameter or side length. This allows for the capture of more edge light rays, compensating for the luminous flux attenuation caused by the increased field of view, and improving the uniformity of brightness across the entire field of view. Furthermore, the gradient change in the diameter or size of the sub-lens along direction A from the first side 221 to the second side 222 of the peripheral optical element 22 can disperse the incident angle of edge light rays. Combined with the gradual change in refractive index, this reduces higher-order aberrations (such as field curvature and distortion), thereby reducing the edge field of view distortion rate.

[0407] Furthermore, the diameter or size gradient of the sub-lens of the peripheral optical element 22 along the direction A from the first side 221 to the second side 222 can extend the horizontal field of view, for example, from the conventional 120° to more than 180°.

[0408] As a further definition of this example, along direction A from the first side 221 to the second side 222 of the peripheral optical element 22, the peripheral optical element 22 includes a first sub-lens, a second sub-lens, and a third sub-lens, wherein the ratio of the diameter or side length of the first sub-lens, the second sub-lens, and the third sub-lens is 1:1-20:1-40.

[0409] In this example, the first sub-lens, located closest to the central optical element 12, has the smallest diameter and is adapted to the high-brightness central region, avoiding oversampling or redundant calculations. The second sub-lens, with a medium diameter, balances the light flux between the center and the edges, reducing brightness attenuation caused by the increased field of view. The third sub-lens, with the largest diameter, is used to capture more edge rays, compensating for light energy loss at the edges of the field of view.

[0410] The extra-large size of the third sub-lens (e.g., a ratio of 40 to the size of the first sub-lens) can significantly improve the edge refractive index, allowing the edge pixels of the display screen to refract into the human eye, making them visible.

[0411] Optionally, the peripheral optical element 22 is a freeform lens array.

[0412] Freeform lens arrays allow for independent control of the curvature, tilt angle, and aspherical coefficient of each sub-lens, effectively correcting asymmetric aberrations (such as coma and astigmatism). Therefore, by optimizing the freeform parameters of each sub-lens in the freeform lens array, precise deflection and focusing of light can be achieved, for example, converging edge rays towards the center and improving the luminous flux utilization of the edge field of view.

[0413] It should be understood that the optical performance of traditional spherical or aspherical lenses depends on symmetry (such as rotational symmetry) and requires the use of multiple lenses to correct aberrations (such as spherical aberration, coma, and field curvature). In contrast, freeform lenses can independently control the curvature, tilt angle, and aspherical coefficients at each point, without relying on symmetry. A single freeform lens can achieve the functionality of a traditional multi-lens system, thus significantly reducing the number of sub-lenses in the peripheral optical elements 22.

[0414] For example, in the peripheral field of view, a freeform lens can use localized high curvature to deflect light towards the center, compensating for light divergence at large field angles. In the central field of view, a freeform lens can be designed with low curvature to reduce aberrations.

[0415] Furthermore, in traditional lens assemblies, some lenses are used only to correct specific aberrations (such as chromatic aberration correction lenses and field curvature correction lenses), leading to optical path redundancy. For example, a traditional microscope objective may require three lenses to correct chromatic aberration, spherical aberration, and field curvature respectively. Freeform lenses, however, can correct multiple aberrations simultaneously through multi-parameter synergistic optimization. For example, by adjusting the Zernike polynomial coefficients (such as Z4, Z9, and Z16), coma, astigmatism, and field curvature can be optimized simultaneously. Combined with graded refractive index materials, chromatic aberration can be further corrected. Therefore, a single freeform lens can replace traditional multi-lens systems, significantly reducing the thickness of the peripheral optical element 22, thereby thinning the peripheral display components.

[0416] In one alternative embodiment, the distance between the central display 11 and the central optical element 12 is greater than the distance between the peripheral display 21 and the peripheral optical element 22.

[0417] It should be understood that the distance between the central display 11 and the central optical element 12 is greater than the distance between the peripheral display 21 and the peripheral optical element 22, so that the central display assembly 10 can achieve a higher optical magnification or finer aberration correction through a longer optical path, thereby improving the MTF (e.g., 0.95) of the central region. Similarly, the peripheral display assembly 20 uses a shorter optical path to reduce the complexity of the near-eye display module, while meeting the MTF requirements of the peripheral display assembly 20.

[0418] Optionally, the central display assembly 10 and / or the peripheral display assembly 20 may include a polarizing beam splitter (PBS), a quarter-wave plate (QWP), a beam splitter (BS), and a linear polarizer (LP).

[0419] Among them, reflective polarizers are used to reflect one polarization state (such as S-polarized light) and transmit another polarization state (such as P-polarized light), thereby achieving optical path folding or brightness enhancement. Reflective polarizers can separate ambient light from display light, improving contrast.

[0420] A quarter-wave plate is used to convert linearly polarized light into circularly polarized light (or vice versa), eliminating polarization interference caused by reflection. Quarter-wave plates can reduce ghosting and glare, improving image quality.

[0421] Semi-transparent mirrors are used to partially reflect display light and partially transmit ambient light (or vice versa).

[0422] Linear polarizers allow only light of a specific polarization state to pass through, suppressing stray light and improving contrast.

[0423] Optionally, the central display component 10 can be a Pancake optical system. The specific optical path structure can be that the light emitted from the central display 11 passes through a linear polarizer, a quarter-wave plate, a semi-transparent mirror, a quarter-wave plate, and a reflective polarizer before entering the human eye.

[0424] Based on the above optical path structure, the optical path of the central display component 10 is a folded optical path, which reduces the thickness of the central display component 10 by 50% and improves the contrast by 2-3 times.

[0425] Optionally, the peripheral display component 20 can adopt a Fresnel lens polarization architecture. The specific optical path structure can be as follows: the light emitted by the peripheral display 21 passes through a linear polarizer, a Fresnel lens, and a semi-transparent mirror before entering the human eye.

[0426] Based on the above, costs can be reduced.

[0427] To further reduce the overall thickness of the display components, this application embodiment employs a central display component 10 and a peripheral display component 20 with optical path folding.

[0428] Reference Figure 15 The central display assembly and peripheral display assembly include: a reflective polarizer 101, a quarter-wave plate 102, a semi-transparent mirror 103, and a linear polarizer 104. The folded optical path of the central display assembly 10 and peripheral display assembly 20 is as follows:

[0429] The light emitted from the central display 11 passes through the linear polarizer 104, the quarter-wave plate 102, the semi-transparent mirror 103, the quarter-wave plate 102, and the reflective polarizer 101 before entering the human eye.

[0430] The light emitted from the peripheral display 21 passes through the linear polarizer 104, the quarter-wave plate 102, the semi-transparent mirror 103, the quarter-wave plate 102, and the reflective polarizer 101 before entering the human eye.

[0431] As an example, the distance between the central display 11 and the central optical element 12 is 2 to 5 times the distance between the peripheral display 21 and the peripheral optical element 22.

[0432] In this embodiment, the central display component 10 has a longer optical path (2-5 times that of the peripheral display component 20), which can support more complex optical structures (such as pancake folded optical paths and freeform lenses), thereby achieving high resolution and high contrast within a limited space.

[0433] For example, the Pancake optical system extends the optical path to 3-4 times that of a traditional straight lens by repeatedly reflecting and folding the optical path, while compressing the thickness to less than 10mm.

[0434] The peripheral display component 20 has a short optical path and can employ a simple structure (such as a Fresnel lens) to expand the field of view (FOV) and reduce weight.

[0435] Optionally, the central optical element 12 and the peripheral optical element 22 have the same magnification.

[0436] It should be understood that magnification refers to the ratio of the size of the image of an object formed by an optical system to the actual size of the object, and is usually determined by the focal length, object distance, and image distance.

[0437] The central optical element 12 and the peripheral optical element 22 have the same magnification, which means that their focal length, object distance or image distance must meet a specific relationship, which is usually achieved through optical path compensation or optical element design.

[0438] In one alternative implementation, the central optical element 12 may be made of a high refractive index material, an aspherical design, or a folded optical path to achieve a long optical path, while maintaining the focal length and magnification consistent with the periphery.

[0439] The peripheral optical element 22 can achieve a short optical path through structures such as Fresnel lenses, while compensating for focal length changes to match the central magnification.

[0440] Optionally, the central optical element 12 employs a Pancake optical system, and the peripheral optical element 22 employs a freeform lens array system with a magnification Δβ < ±1.5% to ensure that the displayed image is free from stretching distortion.

[0441] It should be understood that the magnification of both the Pancake optical system and the freeform lens array optical system depends on their effective focal length (EFL) and the distance from the display screen to the optical center. Optical simulation software (such as Zemax and Code V) is used to jointly optimize the EFL, making the image sizes of both systems similar within a unit angle. In the freeform lens array optical system, the focal length of each sub-lens is slightly adjusted, and the overall average EFL is controlled to match that of the Pancake optical system.

[0442] In VR / XR devices, the pancake lens is responsible for imaging the central area (within 60°), while the freeform lens array is responsible for the extended field of view. Both are designed with the same magnification to ensure that the displayed image maintains a consistent display effect in both the central and extended areas.

[0443] Optionally, the central display 11 and the peripheral display 21 are integrated into the same display.

[0444] By using different areas of the same physical display (such as zoned backlighting or pixel-level control) to connect the central display 11 and the peripheral display 21, the use of multiple independent displays can be avoided, thus reducing the system size and weight.

[0445] For example, in AR glasses, a single Micro-OLED display (<1 inch in size) can simultaneously output a central high-resolution image (such as text) and overlay information from the surrounding low-resolution environment.

[0446] In this embodiment, a hybrid optical system consisting of a central pancake lens and a peripheral freeform lens array is constructed to achieve an immersive display with a 180° ultra-wide field of view (FOV), which must meet the following specifications:

[0447] Magnification consistency: The magnification Δβ of the pancake lens and the freeform lens array is less than ±1.5%, ensuring no image stretching or distortion. Specifically, Δβ < ±1.5% ensures that the difference in pixel magnification between the optical systems of the pancake lens and the freeform lens array within a unit viewing angle of visual imaging does not exceed 1.5%. Otherwise, it will cause abrupt changes or overlapping blurring of the image at the stitching point.

[0448] The final magnification of both the pancake lens and the freeform lens array system depends on their effective focal length (EFL) and the distance from the display to the optical center. Optical simulation software (such as Zemax and Code V) is used to jointly optimize the EFL, making the image size of both lenses similar within a unit angle. In the freeform array, the focal length of each sub-lens is slightly adjusted, and the overall average EFL is controlled to match that of the pancake lens.

[0449] Smooth transition in the stitching area: MTF gradient of the boundary area (30°-40° field of view) ≤ 0.01 / °, brightness difference ΔL < 3%.

[0450] Optical axis co-calibration: edge pixel imaging offset < 0.3px, overlapping field of view ≥ 2°.

[0451] Transition function of the boundary surface:

[0452] Define the curvature smoothing function from the edge of the pancake (30° field of view) to the starting point of the freeform lens array (35° field of view): .

[0453] Where θ is the field of view angle, which realizes the curvature from arrive The cosine gradient eliminates abrupt changes in optical power.

[0454] Based on the above description, the near-eye display module in this application embodiment has the following effective effects:

[0455] High-quality imaging: The design of a double-sided freeform lens array significantly improves image quality in a large field of view, especially at the edge of the field of view.

[0456] Miniaturization and thinning: The peripheral display component 20 adopts a lens array design to reduce the thickness of the optical system, which promotes the thinning of VR / XR devices.

[0457] Seamless stitching: By optimizing pixel overlap relationships and distortion compensation algorithms, the problem of stitching gaps is effectively solved, and the robustness of the system is improved.

[0458] Energy efficiency optimization: The brightness uniformity optimization solution improves the energy efficiency of the equipment, reduces the brightness reduction in the external area, and optimizes the visual experience.

[0459] Secondly, referring to Figure 17 This application embodiment also provides a pre-calibration display parameter calibration device 110 for calibrating the display parameters of a near-eye display module; the near-eye display module includes: a central display component and a peripheral display component;

[0460] The device includes: a first processing module 1101 and a first control module 1102;

[0461] The first processing module 1101 is used for:

[0462] Within the field of view of the near-eye display module, a portion of the multiple fixation points are identified;

[0463] Obtain an eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point;

[0464] Based on the eye-simulation dataset, determine the pre-calibrated display parameter set for the central display component and / or the peripheral display component.

[0465] The first control module 1102 is used to control the first processing module to perform the processing as described above.

[0466] Optionally, the device 110 further includes a data acquisition module, which is used to acquire, under the control of the first control module 1102, an eye-simulating dataset of the central display component and / or the peripheral display component at the partial gaze points.

[0467] Optionally, the acquisition module is a camera or a brightness sensor.

[0468] When the acquisition module is a camera, the simulated eye data acquired by the acquisition module is a calibration image set.

[0469] When the acquisition module is a brightness sensor, the simulated eye-viewing data acquired by the acquisition module is an eye-viewing brightness dataset.

[0470] The relevant description and technical effects of the pre-calibration display parameter calibration device 110 can be found in the description of the pre-calibration display calibration method in the first aspect, and will not be repeated here.

[0471] Thirdly, referring to Figure 18 This application also provides a near-eye display method, the method comprising:

[0472] S501, obtain the setting display dataset of the central display component and / or the peripheral display component.

[0473] It should be understood that the setting display dataset for the central display component and / or the peripheral display components is a display dataset pre-configured in the system where the near-eye display module is located. Optionally, the setting display dataset may be pre-stored in the system memory to drive the central display component and / or the peripheral display components to present an image.

[0474] S502, Display the dataset and the data set according to the settings. Figure 1 The embodiments shown in the diagram determine the pre-calibrated display parameter set of the central display component and / or the peripheral display component, and determine the pre-calibrated display dataset of the central display component and / or the peripheral display component.

[0475] It should be understood that because the set display dataset does not take into account the aberrations and differences in luminous efficacy between different optical elements in the hybrid optical system, the presented image exhibits imaging shift at edge pixels and brightness abrupt changes in different display areas. The aforementioned pre-calibrated display dataset is used to correct for these imaging shifts and / or brightness abrupt changes.

[0476] Optionally, the pre-calibrated display dataset can also be the display data corresponding to each pixel position of the central display component and the peripheral display components.

[0477] S503, the near-eye display module is driven to generate and display an image using the pre-calibrated display dataset.

[0478] In this near-eye display method, a pre-calibrated display dataset is determined based on the set display dataset and pre-calibrated display parameter set of the central display component and / or the peripheral display component. The pre-calibrated display dataset is then used to drive the near-eye display module to generate and display an image. This pre-calibrates the brightness abrupt changes and / or imaging shifts of the central display component and / or the peripheral display component, making the brightness transition between the display areas of the central display component and the peripheral display component more natural, reducing the human eye's perception of brightness boundaries, making the brightness of the near-eye display image more uniform, and correcting pixel imaging shifts caused by aberrations in different display areas. This improves the stitching gaps in the near-eye display image and enhances the display quality of the near-eye display device.

[0479] Fourthly, refer to Figure 19 This application also provides a near-eye display method, the method comprising:

[0480] S601, acquire the setting display dataset of the central display component and / or the peripheral display component, wherein the setting display dataset includes setting input parameters for each setting pixel position in the central display component and / or the peripheral display component. The input parameters may be brightness values, color values, or other relevant display parameters. Similarly, the setting display dataset of the central display component and / or the peripheral display component may be a display dataset pre-configured in the system where the near-eye display module is located. Optionally, the setting display dataset may be pre-stored in the system memory for driving the central display component and / or the peripheral display component to present an image.

[0481] S602, Display the dataset and the data set according to the settings. Figure 6 or Figure 7 The embodiments shown define a set of pre-calibrated display parameters for the central display component and / or the peripheral display component, and determine a set of pre-calibrated display data for the central display component and / or the peripheral display component; the pre-calibrated display data is the pre-calibrated input parameters for each set pixel position in the central display component and / or the peripheral display component.

[0482] In some examples, the pre-calibrated display parameter set can also be a brightness weighting matrix corresponding to each pixel position of the central display component and the peripheral display components. The brightness weighting matrix assigns different weight values ​​to each pixel position of the central display component and the peripheral display components to achieve overall brightness uniformity.

[0483] In this example, the pre-correction input parameters for each set pixel position in the central display component and / or the peripheral display component are determined based on the set input parameters for each set pixel position in the central display component and / or the peripheral display component, and the corresponding brightness weight allocation matrix. The pre-correction input parameter for each set pixel position is the product of the set input parameter for each set pixel position and the brightness weight allocation matrix.

[0484] Based on this, the brightness data of each pixel position is corrected using the brightness weight allocation matrix of each pixel position to ensure that the brightness distribution of the entire display component is more uniform and to reduce visual interference caused by uneven brightness.

[0485] S603, the near-eye display module is driven to generate and display an image using the pre-calibrated display dataset.

[0486] Using a pre-calibrated display dataset to drive the near-eye display module to generate and display images can correct for brightness abrupt changes in the central display component and / or peripheral display components, making the brightness transition between the display areas of the central and peripheral display components more natural, reducing the human eye's perception of brightness boundaries, and making the brightness of the near-eye display image more uniform.

[0487] Fifthly, refer to Figure 20 Some embodiments of this application provide a near-eye display method, the method comprising:

[0488] S701 determines the target gaze point based on eye-tracking results.

[0489] In this embodiment of the application, the eye tracking results of the eye tracking module can be used to determine the target gaze point, which changes as the user's eyeballs move.

[0490] S702, based on the target gaze point, and Figure 8 The embodiment shown determines the pre-calibrated display parameter set of the central display component and / or the peripheral display component, and determines the target pre-calibrated display parameter set.

[0491] In some examples, the pre-calibrated display parameter set includes a luminance weight allocation matrix corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze regions corresponding to the plurality of gaze points. The luminance weight allocation matrix assigns weights to each set pixel position within the gaze regions corresponding to the plurality of gaze points, adjusting its luminance contribution at different gaze points to achieve overall brightness uniformity. After determining the target gaze point, a target pre-calibrated display parameter set corresponding to that target gaze point can be determined. The target pre-calibrated display parameter set includes a luminance weight allocation matrix corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze regions corresponding to the target gaze point.

[0492] It is worth noting that after determining the target gaze point, the system first checks whether the target gaze point exists in the pre-calibration display parameter set related to the gaze point. If it does, the target pre-calibration display parameter set corresponding to the target gaze point is directly obtained from the pre-calibration display parameter set. If it does not exist, the pre-calibration display parameter set corresponding to the gaze point closest to the target gaze point is selected from the pre-calibration display parameter set as the target pre-calibration display parameter set. Here, distance can be an angle or a physical distance; this embodiment does not impose any special limitations on this.

[0493] S703, obtain the setting display dataset of the central display component and / or the peripheral display component, wherein the setting display dataset includes the setting input parameters of each setting pixel position in the central display component and / or the peripheral display component.

[0494] Similarly, the configuration display dataset for the central display component and / or the peripheral display component can be a pre-configured display dataset in the system where the near-eye display module is located. Optionally, the configuration display dataset can be pre-stored in the system memory to drive the central display component and / or the peripheral display component to present an image.

[0495] S704, determine the target pre-calibration display dataset based on the set display dataset and target pre-calibration display parameter set of the central display component and / or the peripheral display component.

[0496] The set display dataset includes the central display component and / or the set input parameters for each set pixel position in the peripheral display component.

[0497] The target pre-correction display parameter set includes the brightness weight allocation matrix corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point.

[0498] The target pre-correction display dataset includes pre-correction input parameters for each set pixel position within the gaze region corresponding to the target gaze point, in the central display component, and / or the peripheral display component. The pre-correction input parameter for each set pixel position is the product of the set input parameter for each set pixel position and the luminance weighting matrix.

[0499] S705, the near-eye display module is driven to generate and display an image using the target pre-corrected display dataset.

[0500] Reference Figure 21 Some embodiments of this application provide a near-eye display method, the method comprising:

[0501] S801 determines the target gaze point based on eye-tracking results.

[0502] In this embodiment of the application, the eye tracking results of the eye tracking module can be used to determine the target gaze point, which changes as the user's eyeballs move.

[0503] S802, based on the target gaze point, and Figure 11 The embodiment shown determines the pre-calibrated display parameter set of the central display component and / or the peripheral display component, and determines the target pre-calibrated display parameter set.

[0504] In some examples, the pre-corrected display parameter set includes pre-corrected pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze regions corresponding to the plurality of gaze points.

[0505] After determining the target gaze point, a target pre-correction display parameter set corresponding to that gaze point can be determined. The target pre-correction display parameter set includes the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point.

[0506] It is worth noting that after determining the target gaze point, the system first checks whether the target gaze point exists in the pre-calibration display parameter set related to the gaze point. If it does, the target pre-calibration display parameter set corresponding to the target gaze point is directly obtained from the pre-calibration display parameter set. If it does not exist, the pre-calibration display parameter set corresponding to the gaze point closest to the target gaze point is selected from the pre-calibration display parameter set as the target pre-calibration display parameter set. Here, distance can be an angle or a physical distance; this embodiment does not impose any special limitations on this.

[0507] S803, obtain the setting display dataset of the central display component and / or the peripheral display component, wherein the setting display dataset includes the setting input parameters of each setting pixel position in the central display component and / or the peripheral display component.

[0508] Similarly, the configuration display dataset for the central display component and / or the peripheral display component can be a pre-configured display dataset in the system where the near-eye display module is located. Optionally, the configuration display dataset can be pre-stored in the system memory to drive the central display component and / or the peripheral display component to present an image.

[0509] S804, determine the target pre-calibration display dataset based on the set display dataset and target pre-calibration display parameter set of the central display component and / or the peripheral display component.

[0510] The set display dataset includes the central display component and / or the set input parameters for each set pixel position in the peripheral display component.

[0511] The target pre-correction display parameter set includes the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point.

[0512] The target pre-correction display dataset includes set input parameters for each pre-correction pixel position within the gaze region corresponding to the target gaze point, in the central display component, and / or the peripheral display component. The pre-correction input parameters for each set pixel position are the set input parameters for each pre-correction pixel position.

[0513] S805, the near-eye display module is driven to generate and display an image using the target pre-corrected display dataset.

[0514] In this embodiment, the user's actual target gaze point is determined based on the eye tracking results. The target pre-correction display parameter set of the near-eye display module under the target gaze point is adjusted to pre-correct the pixel imaging offset of the central display component and / or the peripheral display component. This corrects the pixel imaging offset caused by aberrations in different display areas, thereby improving the stitching gap of the near-eye display image and enhancing the display quality of the near-eye display device.

[0515] Reference Figure 22 Other embodiments of this application also provide a near-eye display method, the method comprising:

[0516] S901 determines the target gaze point based on eye-tracking results.

[0517] In this embodiment of the application, the eye tracking results of the eye tracking module can be used to determine the target gaze point, which changes as the user's eyeballs move.

[0518] S902, based on the target gaze point, and Figure 5 and Figure 11 ,or, Figure 9 and Figure 11 The central display component and / or the pre-calibrated display parameter set of the peripheral display components, as determined by the embodiments shown, determine the target pre-calibrated display parameter set.

[0519] The pre-calibrated display parameter set includes the pre-calibrated pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze regions corresponding to the plurality of gaze points, and the brightness weight allocation matrix corresponding to each pre-calibrated pixel position.

[0520] After determining the target gaze point, a target pre-correction display parameter set corresponding to that gaze point can be determined. The target pre-correction display parameter set includes the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point, and a luminance weight allocation matrix corresponding to each pre-correction pixel position.

[0521] In some embodiments, when the luminance weight allocation matrix corresponding to each pre-corrected pixel position is based on the first luminance detection module (see...), Figure 2 ) or a second type of brightness detection module (see Figure 3 When the incoming eye brightness dataset is determined, the pre-correction display parameter set is determined by means of, for example, Figure 6 and Figure 11 or, Figure 7 and Figure 11 The pre-calibration display parameter calibration methods shown are jointly determined, as illustrated in the following example:

[0522] Using a set of calibration images acquired at a field of view of 70° from the fixation point, the pre-corrected pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component are determined within the fixation area corresponding to the fixation point at a field of view of 70°.

[0523] Using the ambient light dataset, determine the light weight allocation matrix corresponding to each pre-corrected pixel position;

[0524] The luminance weight allocation matrix corresponding to each pre-corrected pixel position, and the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the gaze point at a field of view of 70°, are used as the target pre-corrected display parameter set for the target gaze point at a field of view of 70°.

[0525] In the first type of brightness detection module, the brightness acquisition direction of any brightness sensor is perpendicular to the corresponding display component. That is, the brightness dataset of the central display component is acquired by at least one brightness sensor whose brightness acquisition direction is perpendicular to the central display component, and the brightness dataset of the peripheral display component is acquired by at least one brightness sensor whose brightness acquisition direction is perpendicular to the peripheral display component.

[0526] In the second type of brightness detection module, the brightness acquisition direction of any brightness sensor is set along the gaze direction of its corresponding gaze point. For example, the brightness acquisition direction of the brightness sensor with the gaze point at a field of view of 70° is set along the gaze direction of the gaze point at a field of view of 70°.

[0527] In other embodiments, when the luminance weight allocation matrix corresponding to each pre-corrected pixel position is based on a third luminance detection module (see [link to relevant documentation]), Figure 4 When the incoming eye brightness dataset is determined, the pre-correction display parameter set is determined by means of, for example, Figure 8 and Figure 11 The pre-calibration display parameter calibration methods shown are jointly determined, as illustrated in the following example:

[0528] Using a set of calibration images acquired at a field of view of 70° from the fixation point, the pre-corrected pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component are determined within the fixation area corresponding to the fixation point at a field of view of 70°.

[0529] Using the luminance dataset of the eye at a field of view of 70°, we determine the luminance weight allocation matrix corresponding to each pre-corrected pixel position within the fixation area corresponding to the fixation point at a field of view of 70°.

[0530] The pre-corrected pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component, and the brightness weight allocation matrix corresponding to each pre-corrected pixel position, are used as the target pre-corrected display parameter set for the target gaze point at a field of view of 70° within the gaze area corresponding to the gaze point at a field of view of 70°.

[0531] S903, acquire the setting display dataset of the central display component and / or the peripheral display component. The setting display dataset includes setting input parameters for each setting pixel position in the central display component and / or the peripheral display component.

[0532] Similarly, the configuration display dataset for the central display component and / or the peripheral display component can be a pre-configured display dataset in the system where the near-eye display module is located. Optionally, the configuration display dataset can be pre-stored in the system memory to drive the central display component and / or the peripheral display component to present an image.

[0533] S904, determine the target pre-calibration display dataset based on the set display dataset and target pre-calibration display parameter set of the central display component and / or the peripheral display component.

[0534] The set display dataset includes the central display component and / or the set input parameters for each set pixel position in the peripheral display component.

[0535] The target pre-correction display parameter set includes the pre-correction pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point, and the brightness weight allocation matrix corresponding to each pre-correction pixel position.

[0536] The target pre-correction display dataset includes pre-correction input parameters corresponding to each pre-correction pixel position within the gaze region corresponding to the target gaze point, in the central display component, and / or the peripheral display component. The pre-correction input parameter for each pre-correction pixel position is the product of the set input parameter for a set pixel position corresponding to that pre-correction pixel position and the luminance weight allocation matrix for that pre-correction pixel position. In other words, the pre-correction input parameter for the set pixel position is assigned to the pre-correction pixel position corresponding to that set pixel position.

[0537] S905, the near-eye display module is driven to generate and display an image using the target pre-corrected display dataset.

[0538] In this embodiment, the user's actual target gaze point is determined based on the eye-tracking results, and a target pre-corrected display parameter set for the near-eye display module at that target gaze point is obtained. The target pre-corrected display dataset is used to drive the near-eye display module to generate and display images, so as to pre-correct the pixel imaging offset of the central display component and / or the peripheral display component, correct the pixel imaging offset caused by aberrations in different display areas, thereby improving the stitching gap of the near-eye display image, and / or, to pre-correct the brightness abrupt change of the central display component and / or the peripheral display component at the user's target gaze point, so that the brightness transition of the display area of ​​the central display component and the peripheral display component is more natural, reducing the human eye's perception of brightness boundaries, making the brightness of the near-eye display image more uniform, and improving the display quality of the near-eye display device.

[0539] Furthermore, in the near-eye display module, the central optical element of the central display component is set as a lens, and the peripheral optical elements of the peripheral display components are designed as a lens array. This allows for a reduction in the thickness of the peripheral display components while ensuring the imaging quality of the near-eye display module. Additionally, along the direction from the first side to the second side of the peripheral optical element, the focal length of the sub-lenses in the peripheral optical element gradually decreases, and / or the refractive index of the peripheral optical element gradually increases. This results in a gradual decrease in the MTF (Mean Transmission Factor) of the peripheral display components from the side closer to the central display component to the side farther away from the central display component. This approach takes into account that the user's eye has higher requirements for the imaging quality of the central display component and lower requirements for the imaging quality of the peripheral display components. By gradually reducing the MTF of the peripheral display components while ensuring a large field of view for the near-eye display module, the optical design difficulty of the near-eye display module is reduced.

[0540] In one optional implementation, determining the target pre-calibration display dataset based on the set display dataset of the central display component and / or the peripheral display component and the target pre-calibration display parameter set includes:

[0541] First, based on the set input parameters of each set pixel position in the central display component and / or the peripheral display component, and the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point, the set input parameters of each pre-correction pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point are determined.

[0542] In this embodiment, the set input parameters of each set pixel position in the central display component and / or the peripheral display component are used as the set input parameters of the pre-correction pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component.

[0543] Then, based on the set input parameters and luminance weight allocation matrix corresponding to each pre-corrected pixel position in the central display component and / or the peripheral display component within the gaze region corresponding to the target gaze point, the pre-correction input parameters corresponding to each pre-corrected pixel position in the central display component and / or the peripheral display component within the gaze region corresponding to the target gaze point are determined.

[0544] In this embodiment, the set input parameters of each set pixel position are used as the set input parameters of the corresponding pre-corrected pixel position, and the brightness data of the pre-corrected pixel position is corrected by the brightness weight allocation matrix of each pre-corrected pixel position to ensure that the brightness distribution of the entire display component is more uniform and to reduce visual interference caused by uneven brightness.

[0545] It should be understood that since the brightness weighting matrix is ​​determined based on the incoming eye brightness data, it can adapt to changes in the direction of human eye gaze. When the user's eyes are focused at different positions, the near-eye display module can quickly adjust the pixel brightness according to the corresponding brightness weight, so that the display effect always conforms to the visual perception characteristics of the human eye under that gaze direction, reducing visual inconsistency. Therefore, this method can adapt to various display scenarios and user environments. Whether it is static image display or dynamic video playback, regardless of the user's different gaze habits or usage scenarios, it can dynamically adjust the brightness weighting matrix according to the incoming eye brightness dataset to ensure that the system always provides a stable display effect.

[0546] Sixthly, embodiments of this application also provide a near-eye display device, comprising:

[0547] Near-eye display module, used to generate and display images;

[0548] The second processing module is configured to acquire the set display dataset of the central display component and / or the peripheral display component; and to process the set display dataset according to the first aspect. Figure 1 , Figure 5 , Figure 6 , Figure 7 as well as Figure 9 The illustrated embodiment determines the pre-calibrated display parameter set, and determines the pre-calibrated display dataset for the central display component and / or the peripheral display components;

[0549] The second control module is used to control the second processing module to perform the processing as described above, and to drive the near-eye display module to generate and display images using the pre-corrected display dataset.

[0550] In a near-eye display device, a pre-calibrated display dataset is determined based on the set display dataset of the central display component and / or the peripheral display component, and a pre-calibrated display parameter set. The pre-calibrated display dataset is then used to drive the near-eye display module to generate and display an image. This pre-calibrates the brightness abrupt changes of the central display component and / or the peripheral display component, making the brightness transition between the display areas of the central display component and the peripheral display component more natural, reducing the human eye's perception of brightness boundaries, and making the brightness of the near-eye display image more uniform, thereby improving the display quality of the near-eye display device.

[0551] It is worth noting that the beneficial effects of the near-eye display device in this embodiment can be referred to in the first aspect. Figure 1 , Figure 5 , Figure 6 , Figure 7 as well as Figure 9 The description of the embodiments shown will not be repeated here.

[0552] Seventhly, embodiments of this application also provide a near-eye display device, comprising:

[0553] Near-eye display module, used to generate and display images;

[0554] The eye-tracking module is used to collect the user's eye movement data;

[0555] The second processing module is used to determine the target gaze point based on the user's eye movement data collected by the eye-tracking module; and to determine the target gaze point based on the first aspect. Figure 1 , Figure 5 , Figure 8 , Figure 9 and Figure 11The illustrated embodiment determines a pre-calibrated display parameter set and a target pre-calibrated display parameter set; it is used to obtain the set display dataset of the central display component and / or the peripheral display component; and it is used to determine the target pre-calibrated display dataset based on the set display dataset of the central display component and / or the peripheral display component and the target pre-calibrated display parameter set.

[0556] The second control module is used to control the eye-tracking module to collect user eye-tracking data, to control the second processing module to perform the processing as described above, and to drive the near-eye display module to generate and display images using the target pre-correction display dataset.

[0557] In this near-eye display device, a pre-corrected display dataset is determined based on the set display dataset of the central display component and / or the peripheral display component, and a pre-corrected display parameter set. The user's actual target gaze point is determined based on the eye-tracking results, and a target pre-corrected display parameter set for the near-eye display module under the target gaze point is obtained. The target pre-corrected display dataset is then used to drive the near-eye display module to generate and display images, so as to pre-correct the pixel imaging offset of the central display component and / or the peripheral display component, so as to correct the pixel imaging offset caused by aberrations in different display areas, thereby improving the stitching gap of the near-eye display image and improving the display quality of the near-eye display device.

[0558] And / or, in this near-eye display device, a pre-correction display dataset is determined based on the set display dataset of the central display component and / or the peripheral display component, and a pre-correction display parameter set. The user's actual target gaze point is determined based on the eye-tracking results, and a target pre-correction display parameter set for the near-eye display module under the target gaze point is obtained. Then, the target pre-correction display dataset is used to drive the near-eye display module to generate and display an image, so as to pre-correct the brightness abrupt changes of the central display component and / or the peripheral display component, making the brightness transition of the display area of ​​the central display component and the peripheral display component more natural, reducing the human eye's perception of brightness boundaries, making the brightness of the near-eye display image more uniform, and improving the display quality of the near-eye display device.

[0559] Furthermore, in the near-eye display module, the central optical element of the central display component is set as a lens, and the peripheral optical elements of the peripheral display components are designed as a lens array. This allows for a reduction in the thickness of the peripheral display components while ensuring the imaging quality of the near-eye display module. Additionally, along the direction from the first side to the second side of the peripheral optical elements, the focal length of the sub-lenses in the peripheral optical elements gradually decreases, and / or the refractive index of the peripheral optical elements gradually increases. This results in a gradual decrease in the MTF (Mean Transmission Factor) of the peripheral display components from the side closer to the central display component to the side farther away from the central display component. This approach takes into account that the user's eye has higher requirements for the imaging quality of the central display component and lower requirements for the imaging quality of the peripheral display components. By gradually reducing the MTF of the peripheral display components while ensuring a large field of view for the near-eye display module, the optical design difficulty of the near-eye display module is reduced.

[0560] It is worth noting that other beneficial effects of the near-eye display device of this embodiment can be found in the first aspect. Figure 1 , Figure 5 , Figure 8 , Figure 9 and Figure 11 The description of the embodiments shown will not be repeated here.

[0561] The aforementioned near-eye display module includes a central display component and peripheral display components. The central display component includes a central display and a central optical element, and the peripheral display component includes a peripheral display and peripheral optical elements.

[0562] The central optical element is disposed on the display path of the central display, and the peripheral optical element is disposed on the display path of the peripheral central display;

[0563] The field of view formed by the central display component and the field of view formed by the peripheral display components are connected or partially overlap.

[0564] Optionally, the peripheral display component is tilted or perpendicular to the central display component.

[0565] Optionally, the central optical element is a lens, and the peripheral optical element is a lens array.

[0566] Optionally, along the direction from the first side to the second side of the peripheral optical element, the focal length of the sub-lens in the peripheral optical element gradually decreases, and / or the refractive index of the peripheral optical element gradually increases; the first side is the side of the peripheral optical element closer to the central optical element, and the second side is the side of the peripheral optical element farther from the central optical element.

[0567] Optionally, the diameter or side length of the sub-lens located on the first side of the peripheral optical element is smaller than the diameter or side length of the sub-lens located on the second side of the peripheral optical element.

[0568] Optionally, along the direction from the first side to the second side of the peripheral optical element, the diameter or side length of the sub-lens in the peripheral optical element gradually increases.

[0569] Optionally, along the direction from the first side to the second side of the peripheral optical element, the peripheral optical element includes a first sub-lens, a second sub-lens, and a third sub-lens, wherein the ratio of the diameter or side length of the first sub-lens, the second sub-lens, and the third sub-lens is 1:1-20:1-40.

[0570] Optionally, the peripheral optical element is a freeform lens array.

[0571] Optionally, the refractive index of the peripheral optical element gradually increases from 1.2 to 2.2 along the direction from the first side to the second side.

[0572] Optionally, the distance between the central display and the central optical element is greater than the distance between the peripheral display and the peripheral optical element.

[0573] Optionally, the distance between the central display and the central optical element is 2-5 times the distance between the peripheral display and the peripheral optical element.

[0574] Optionally, the central display assembly and / or peripheral display assembly may include a reflective polarizer, a quarter-wave plate, a semi-transparent mirror, and a linear polarizer.

[0575] Optionally, the central optical element and the peripheral optical element have the same magnification.

[0576] Optionally, the central display and the peripheral display are integrated into the same display.

[0577] Optionally, the MTF of the central display component and the MTF of the peripheral display component are continuous at the point where the fields of view meet or overlap.

[0578] Optionally, the MTF of the peripheral display component gradually decreases from the third side to the fourth side of the peripheral display component, wherein the third side is the side of the peripheral display component closer to the central display component, and the fourth side is the side of the peripheral display component farther away from the central display component.

[0579] Optionally, along the third side of the peripheral display assembly to the fourth side of the peripheral display assembly, the MTF of the peripheral optical element gradually decreases from 0.5 to 0.2.

[0580] Optionally, the MTF of the central display component gradually decreases from 0.8-0.95 to 0.5 from the center to the edge.

[0581] Eighthly, this application also provides an electronic device, Figure 23 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 23 As shown, the electronic device may include: transceiver 121, processor 122, and memory 123.

[0582] Processor 122 executes computer execution instructions stored in memory, causing processor 122 to perform the scheme in the above method embodiments. Processor 122 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0583] The memory 123 is connected to the processor 122 via the system bus and completes communication between them. The memory 123 is used to store computer program instructions.

[0584] Transceiver 121 can be used to obtain the task to be run and its configuration information.

[0585] The system bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The system bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the diagram, but this does not indicate that there is only one bus or one type of bus. Transceivers are used to enable communication between database access devices and other computers (e.g., clients, read-write libraries, and read-only libraries). Memory may include random access memory (RAM) and may also include non-volatile memory.

[0586] This application also provides a chip for executing instructions, which is used to execute the technical solutions of the methods described in the above embodiments.

[0587] Ninthly, embodiments of this application also provide a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to perform the technical solutions of the methods described in the above embodiments.

[0588] In a tenth aspect, embodiments of this application also provide a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium, and when the at least one processor executes the computer program, it can implement the technical solutions of the methods described in the above embodiments.

[0589] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or modules, and may be electrical, mechanical, or other forms.

[0590] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to implement the solution of this embodiment according to actual needs.

[0591] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The unit composed of the above modules can be implemented in hardware or in the form of hardware plus software functional units.

[0592] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods of the various embodiments of this application.

[0593] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly manifested as execution by a hardware processor, or execution by a combination of hardware and software modules within the processor.

[0594] The memory may include high-speed RAM, and may also include non-volatile storage (NVM), such as at least one disk storage device, and may also be a USB flash drive, external hard drive, read-only memory, disk or optical disc, etc.

[0595] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0596] The aforementioned storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0597] An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Alternatively, the storage medium can be an integral part of the processor. The processor and storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and storage medium can exist as discrete components in an electronic control unit or main control device.

Claims

1. A method for calibrating pre-calibration display parameters, characterized in that, Used for calibrating the pre-calibration display parameters of near-eye display modules; The near-eye display module includes: a central display component and peripheral display components; The method includes: Within the field of view of the near-eye display module, a portion of the multiple fixation points are identified; Obtain an eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point; Based on the eye-simulation dataset, determine the pre-calibrated display parameter set for the central display component and / or the peripheral display component; The pre-calibrated display parameter set includes the central display component, and / or the brightness weight allocation matrix corresponding to each pixel position in the peripheral display component; And / or, the pre-corrected display parameter set includes, within the gaze regions corresponding to the plurality of gaze points respectively, the pre-corrected pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component.

2. The method according to claim 1, characterized in that: The eye-entry simulation dataset includes the eye-entry brightness datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points. The eye-entry brightness dataset is collected by a brightness detection module, and the brightness detection module includes multiple brightness sensors. The eye-entry brightness dataset of the central display component is collected by at least one brightness sensor facing the central display component, and the eye-entry brightness dataset of the peripheral display component is collected by at least one brightness sensor facing the peripheral display component. The step of determining the pre-calibrated display parameter set for the central display component and / or the peripheral display component based on the eye-simulation dataset includes: Based on the eye brightness datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, a brightness weight allocation matrix is ​​determined for each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial fixation points. Based on the brightness weight allocation matrix corresponding to each pixel position within the field of view of the brightness detection module corresponding to the partial gaze point, the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component is determined.

3. The method according to claim 2, characterized in that, Based on the eye-viewing luminance datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, a luminance weight allocation matrix is ​​determined for each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to the partial fixation points, including: Based on the eye brightness datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, a brightness weight allocation matrix is ​​determined for the partial pixel positions in the central display component and / or the peripheral display component within the acquisition field of the brightness detection module corresponding to the partial fixation points. Based on the luminance weight allocation matrix corresponding to the pixel positions of the partial gaze points, the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to the partial gaze points is determined.

4. The method according to claim 3, characterized in that, Based on the eye-viewing luminance datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, a luminance weight allocation matrix is ​​determined for the partial pixel positions in the central display component and / or the peripheral display component within the acquisition field of view of the luminance detection module corresponding to the partial fixation points, including: Based on the eye brightness datasets of the central display component and / or the peripheral display component corresponding to the partial fixation points, the eye brightness data of some pixel positions in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial fixation points are determined. Based on the eye brightness data of the partial pixel positions corresponding to the partial fixation points, determine the dynamic brightness weights of the partial pixel positions in the central display component and / or the peripheral display component within the acquisition field of the brightness detection module corresponding to the partial fixation points. Based on the dynamic brightness weights corresponding to the pixel positions corresponding to the partial gaze points, the normalized weights corresponding to the pixel positions, and the brightness correction weights corresponding to the pixel positions, a brightness weight allocation matrix is ​​determined for the pixel positions in the central display component and / or the peripheral display component within the acquisition field of view of the brightness detection module corresponding to the partial gaze points.

5. The method according to claim 2, characterized in that, The plurality of brightness sensors correspond to the respective points of gaze, and the field of view of the brightness detection module covers at least a portion of the field of view formed by the central display component and the peripheral display component.

6. The method according to claim 5, characterized in that, The field of view of the brightness detection module covers the entire field of view formed by the central display component and the peripheral display components. Based on the luminance weight allocation matrix of each pixel position within the field of view of the luminance detection module corresponding to the partial fixation point, the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component is determined, including: By combining the luminance weight allocation matrices of each pixel position corresponding to the partial gaze points, the luminance weight allocation matrices corresponding to each pixel position in the central display component and / or the peripheral display component are obtained.

7. The method according to claim 5, characterized in that, The field of view of the brightness detection module covers part of the field of view formed by the central display component and the peripheral display component. Based on the luminance weight allocation matrix of each pixel position within the field of view of the luminance detection module corresponding to the partial fixation point, the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component is determined, including: Based on the brightness weight allocation matrix corresponding to each pixel position within the field of view of the brightness sensor corresponding to each of the partial gaze points, and combined with the interpolation method, the brightness weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component is obtained.

8. The method according to claim 5, characterized in that, The luminance data set of the central display component is collected by at least one luminance sensor with the luminance acquisition direction perpendicular to the central display component, and the luminance data set of the peripheral display component is collected by at least one luminance sensor with the luminance acquisition direction perpendicular to the peripheral display component.

9. The method according to claim 5, characterized in that, The brightness acquisition direction of any brightness sensor in the brightness detection module is set along the gaze direction of its corresponding gaze point.

10. The method according to claim 5, characterized in that, The brightness acquisition direction of the brightness detection module is set along the gaze direction of its corresponding gaze point; Based on the luminance weight allocation matrix of each pixel position within the field of view of the luminance detection module corresponding to the partial fixation point, the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component is determined, including: Based on the position of the gaze point, and according to the luminance weight allocation matrix of each pixel position in the acquisition field of the luminance detection module corresponding to each of the partial gaze points, combined with the interpolation method, the luminance weight allocation matrix corresponding to each pixel position in the central display component and / or the peripheral display component in the acquisition field of the luminance detection module corresponding to the multiple gaze points is obtained.

11. The method according to claim 2, characterized in that, The pixel position is a pre-corrected pixel position, which is obtained by offsetting a set pixel position.

12. The method according to claim 10 or 11, characterized in that, The eye-simulation dataset includes a set of calibration images of the central display component and / or the peripheral display component within the gaze regions corresponding to the respective gaze points. The step of determining the pre-correction display parameter set based on the eye-simulation dataset includes: Based on the calibration image sets corresponding to the partial gaze points, determine the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the partial gaze points; Based on the pre-corrected pixel position of each set pixel position corresponding to the partial gaze points, the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to multiple gaze points in the field of view is determined.

13. The method according to claim 12, characterized in that, The step of determining the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to each of the partial gaze points, based on the calibration image set corresponding to each of the partial gaze points, includes: Based on the calibration image sets corresponding to the partial fixation points, determine the distortion vector of each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial fixation points; Based on the distortion vector of each set pixel position corresponding to the partial gaze points, the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component is determined within the field of view corresponding to the partial gaze points.

14. The method according to claim 13, characterized in that, The step of determining the distortion vector for each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the respective fixation points, based on the calibration image set corresponding to the respective fixation points, includes: Based on the calibration image sets corresponding to the respective fixation points, the actual virtual image positions corresponding to the set pixel positions in the central display component and / or the peripheral display component are determined within the field of view corresponding to the respective fixation points. Obtain the target virtual image positions corresponding to the set pixel positions in the central display component and / or the peripheral display component within the respective gaze regions corresponding to the partial gaze points; Based on the actual virtual image position of the partial set pixel position corresponding to the partial gaze point and the target virtual image position of the partial set pixel position corresponding to the partial gaze point, the distortion vector of each set pixel position in the central display component and / or the peripheral display component is determined within the field of view corresponding to the partial gaze point.

15. The method according to claim 14, characterized in that, Based on the actual virtual image positions of the partial set pixel positions corresponding to the partial gaze points, and the target virtual image positions of the partial set pixel positions corresponding to the partial gaze points, the distortion vector of each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points is determined, including: Based on the actual virtual image position of the partial set pixel position corresponding to the partial gaze point and the target virtual image position of the partial set pixel position corresponding to the partial gaze point, the distortion vector of the partial set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze point is determined. Based on the distortion vectors of the set pixel positions corresponding to the respective partial gaze points, the distortion vectors corresponding to each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the respective partial gaze points are determined.

16. The method according to claim 15, characterized in that, Based on the distortion vectors of the respective defined pixel positions corresponding to the respective fixation points, the distortion vectors corresponding to each defined pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the respective fixation points are determined, including: Based on the distortion vectors of the respective set pixel positions corresponding to the respective gaze points, and the first distortion vector fitting expression, the distortion vectors of each set pixel position of the central display component and / or the peripheral display component within the gaze area corresponding to the respective gaze points are determined.

17. The method according to claim 15, characterized in that, The central display assembly includes a central optical element having a first surface shape, and the peripheral display assembly includes a peripheral optical element array having a second surface shape. Based on the distortion vectors of the respective defined pixel positions corresponding to the respective fixation points, the distortion vectors corresponding to each defined pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the respective fixation points are determined, including: Based on the distortion vector corresponding to at least one set pixel position of the central display component from the distortion vectors of the set pixel positions corresponding to the partial gaze points, and the second distortion vector fitting expression, the distortion vector of each set pixel position of the central display component within the gaze area corresponding to the partial gaze points is determined. Based on the distortion vector corresponding to at least one set pixel position of the peripheral display component from the distortion vectors of the set pixel positions corresponding to the partial gaze points, and the third distortion vector fitting expression, the distortion vector of each set pixel position of the peripheral display component within the gaze area corresponding to the partial gaze points is determined.

18. The method according to claim 13, characterized in that, The step of determining the pre-corrected pixel position corresponding to each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to each of the set pixel positions, based on the distortion vector of each set pixel position corresponding to the set focal points, includes: Based on the distortion vector of each set pixel position corresponding to the partial gaze points, determine the pixel position compensation vector of each set pixel position in the central display component and / or the peripheral display component within the field of view corresponding to the partial gaze points. Based on the pixel position compensation vector of each set pixel position corresponding to the partial gaze points, the pre-corrected pixel position of each set pixel position in the central display component and / or the peripheral display component is determined within the field of view corresponding to the partial gaze points.

19. The method according to claim 12, characterized in that, The central display component forms a core field of view away from the peripheral display components and a first field of view adjacent to the peripheral display components. The peripheral display components form an edge field of view away from the central display component and a second field of view adjacent to the central display component. The first field of view and the second field of view are connected or partially overlap. The number of gaze points in the first field of view is greater than the number of gaze points in the core field of view, and / or the number of gaze points in the second field of view is greater than the number of gaze points in the edge field of view.

20. The method according to any one of claims 1 to 11, characterized in that, The central display component includes a central display and a central optical element, and the peripheral display component includes a peripheral display and a peripheral optical element; The central optical element is disposed on the display path of the central display, and the peripheral optical element is disposed on the display path of the peripheral display; The field of view formed by the central display component and the field of view formed by the peripheral display components are connected or partially overlap.

21. The method according to claim 20, characterized in that, The peripheral display components are tilted or perpendicular to the central display components.

22. The method according to claim 20, characterized in that, The central optical element is a lens, and the peripheral optical element is a lens array.

23. The method according to claim 22, characterized in that, Along the direction from the first side to the second side of the peripheral optical element, the focal length of the sub-lens in the peripheral optical element gradually decreases, and / or the refractive index of the peripheral optical element gradually increases; the first side is the side of the peripheral optical element closer to the central optical element, and the second side is the side of the peripheral optical element farther from the central optical element.

24. The method according to claim 23, characterized in that, The diameter or side length of the sub-lens located on the first side of the peripheral optical element is smaller than the diameter or side length of the sub-lens located on the second side of the peripheral optical element.

25. The method according to claim 24, characterized in that, Along the direction from the first side to the second side of the peripheral optical element, the diameter or side length of the sub-lens in the peripheral optical element gradually increases.

26. The method according to claim 24, characterized in that, Along the direction from the first side to the second side of the peripheral optical element, the peripheral optical element includes a first sub-lens, a second sub-lens, and a third sub-lens, wherein the ratio of the diameter or side length of the first sub-lens, the second sub-lens, and the third sub-lens is 1:1-20:1-40.

27. The method according to claim 22, characterized in that, The peripheral optical element is a freeform lens array.

28. The method according to claim 20, characterized in that, Along the direction from the first side to the second side of the peripheral optical element, the refractive index of the peripheral optical element gradually increases; the first side is the side of the peripheral optical element closer to the central optical element, and the second side is the side of the peripheral optical element farther away from the central optical element.

29. The method according to claim 20, characterized in that, The distance between the central display and the central optical element is greater than the distance between the peripheral display and the peripheral optical element.

30. The method according to claim 29, characterized in that, The distance between the central display and the central optical element is 2 to 5 times the distance between the peripheral display and the peripheral optical element.

31. The method according to claim 20, characterized in that, The central optical element and the peripheral optical element have the same magnification.

32. The method according to claim 20, characterized in that, The central display and the peripheral display are integrated into the same display.

33. The method according to claim 20, characterized in that, The modulation transfer function of the central display component and the modulation transfer function of the peripheral display component are continuous at the point where the fields of view meet or overlap.

34. The method according to claim 33, characterized in that, Along the third side of the peripheral display component to the fourth side of the peripheral display component, the modulation transfer function of the peripheral display component gradually decreases, wherein the third side is the side of the peripheral display component closer to the central display component, and the fourth side is the side of the peripheral display component farther away from the central display component.

35. The method according to claim 34, characterized in that, Along the third side of the peripheral display assembly to the fourth side of the peripheral display assembly, the modulation transfer function of the peripheral optical element gradually decreases from 0.5 to 0.

2.

36. The method according to claim 33, characterized in that, From the center to the edge of the central display component, the modulation transfer function of the central display component gradually decreases from 0.8-0.95 to 0.

5.

37. A near-eye display method, characterized in that, The method includes: Obtain the configuration display dataset for the central display component and / or the peripheral display components; Based on the set display dataset and the pre-calibrated display parameter set of the central display component and / or the peripheral display component, the pre-calibrated display dataset of the central display component and / or the peripheral display component is determined; wherein the pre-calibrated display parameter set of the central display component and / or the peripheral display component is obtained by the pre-calibrated display parameter calibration method according to claim 1; The pre-calibrated display dataset is used to drive the near-eye display module to generate and display images.

38. A near-eye display method, characterized in that, The method includes: Obtain the setting display dataset of the central display component and / or the peripheral display component, wherein the setting display dataset includes the setting input parameters of each setting pixel position in the central display component and / or the peripheral display component; Based on the set display dataset and the pre-calibrated display parameter set of the central display component and / or the peripheral display component, the pre-calibrated display dataset of the central display component and / or the peripheral display component is determined; the pre-calibrated display parameter set of the central display component and / or the peripheral display component is obtained by the pre-calibrated display parameter calibration method according to any one of claims 2-9; the pre-calibrated display dataset includes the pre-calibrated input parameters for each set pixel position in the central display component and / or the peripheral display component; The pre-calibrated display dataset is used to drive the near-eye display module to generate and display images.

39. A near-eye display method, characterized in that, The method includes: Based on eye-tracking results, determine the target fixation point; Based on the target gaze point and the pre-calibrated display parameter set of the central display component and / or the peripheral display component, a target pre-calibrated display parameter set is determined; wherein the pre-calibrated display parameter set of the central display component and / or the peripheral display component is obtained by the pre-calibrated display parameter calibration method according to any one of claims 10-36; Obtain the set display dataset of the central display component and / or the peripheral display component; The target pre-calibration display dataset is determined based on the set display dataset and target pre-calibration display parameter set of the central display component and / or the peripheral display component; The target pre-corrected display dataset is used to drive the near-eye display module to generate and display images.

40. The method according to claim 39, characterized in that: The set display dataset includes the central display component, and / or the set input parameters for each set pixel position in the peripheral display component; The target pre-correction display parameter set consists of the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point, and the brightness weight allocation matrix corresponding to each pre-correction pixel position. The target pre-correction display dataset consists of the pre-correction input parameters corresponding to each pre-correction pixel position in the central display component and / or the peripheral display component within the gaze region corresponding to the target gaze point.

41. The method according to claim 40, characterized in that: The step of determining the target pre-calibration display dataset based on the set display dataset of the central display component and / or the peripheral display component and the target pre-calibration display parameter set includes: Based on the set input parameters of each set pixel position in the central display component and / or the peripheral display component, and the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point, the set input parameters of each pre-correction pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point are determined. Based on the set input parameters and luminance weight allocation matrix corresponding to each pre-corrected pixel position in the central display component and / or the peripheral display component within the gaze region corresponding to the target gaze point, the pre-correction input parameters corresponding to each pre-corrected pixel position in the central display component and / or the peripheral display component within the gaze region corresponding to the target gaze point are determined.

42. The method according to claim 39, characterized in that: The set display dataset includes the central display component, and / or the set input parameters for each set pixel position in the peripheral display component; The target pre-correction display parameter set is the brightness weight allocation matrix corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point; The target pre-correction display dataset consists of the pre-correction input parameters corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point.

43. The method according to claim 39, characterized in that: The set display dataset includes the central display component, and / or the set input parameters for each set pixel position in the peripheral display component; The target pre-correction display parameter set consists of the pre-correction pixel positions corresponding to each set pixel position in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point. The target pre-correction display dataset consists of the set input parameters corresponding to the position of each pre-correction pixel in the central display component and / or the peripheral display component within the gaze area corresponding to the target gaze point.

44. A pre-calibration display parameter calibration device, characterized in that, Used for calibrating the display parameters of near-eye display modules; The near-eye display module includes: a central display component and peripheral display components; The device includes: a first processing module and a first control module; The first processing module is used for: Within the field of view of the near-eye display module, a portion of the multiple fixation points are identified; Obtain an eye-simulation dataset of the central display component and / or the peripheral display component at the partial fixation point; Based on the eye-simulation dataset, determine the pre-calibrated display parameter set for the central display component and / or the peripheral display component; The pre-calibrated display parameter set includes the central display component, and / or the brightness weight allocation matrix corresponding to each pixel position in the peripheral display component; And / or, the pre-corrected display parameter set includes, within the gaze regions corresponding to the plurality of gaze points respectively, the pre-corrected pixel positions corresponding to each set pixel position in the central display component, and / or, the peripheral display component; The first control module is used to control the first processing module to perform the processing as described above.

45. The apparatus according to claim 44, characterized in that, The device also includes a data acquisition module; The acquisition module is used, under the control of the first control module, to acquire an eye-simulating dataset of the central display component and / or the peripheral display component at the partial gaze points.

46. ​​The apparatus according to claim 45, characterized in that, The acquisition module is a camera or a brightness sensor.

47. A near-eye display device, characterized in that, include: Near-eye display module, used to generate and display images; The second processing module is used to obtain the setting display dataset of the central display component and / or the peripheral display components; Used to determine the pre-calibration display dataset of the central display component and / or the peripheral display component based on the set display dataset and the pre-calibration display parameter set; wherein the pre-calibration display parameter set is obtained by the pre-calibration display parameter calibration method according to any one of claims 1-9; The second control module is used to control the second processing module to perform the processing as described above, and to drive the near-eye display module to generate and display images using the pre-corrected display dataset.

48. A near-eye display device, characterized in that, include: Near-eye display module, used to generate and display images; The eye-tracking module is used to collect the user's eye movement data; The second processing module is used to determine the target gaze point based on the user's eye movement data collected by the eye tracking module; The method is used to determine a target pre-calibration display parameter set based on the target gaze point and the pre-calibration display parameter set; to obtain the set display dataset of the central display component and / or the peripheral display component; and to determine the target pre-calibration display dataset based on the set display dataset of the central display component and / or the peripheral display component and the target pre-calibration display parameter set; wherein the pre-calibration display parameter set is obtained by the pre-calibration display parameter calibration method according to any one of claims 10-36. The second control module is used to control the eye-tracking module to collect user eye-tracking data, to control the second processing module to perform the processing as described above, and to drive the near-eye display module to generate and display images using the target pre-correction display dataset.

49. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the program, when executed by the processor, implements the method of any one of claims 1-43.

50. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method of any one of claims 1-43.

51. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method described in any one of claims 1-43.

Images