Adjustment method of head-mounted display device, head-mounted display device, medium and product

Abstract

The present application discloses a method for adjusting a head-mounted display device, a head-mounted display device, a medium, and a product, and relates to the technical field of head-mounted display devices. The method for adjusting the head-mounted display device of the present application specifically includes: detecting a first sight line direction of a wearer and determining a first exit pupil area corresponding to the first sight line direction; playing a standard image and detecting first actual picture information of the standard image in the first exit pupil area, and obtaining first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; determining a first light source adjustment parameter when it is determined that the first actual picture information does not match the first standard picture information; and adjusting the light source module of the head-mounted display device according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information. By using the present application, the image seen by the wearer through the exit pupil area that matches the sight line direction contains complete and accurate picture information.

Description

Technical Field

[0001] The present application relates to the technical field of head-mounted display devices, and in particular to a method for adjusting a head-mounted display device, a head-mounted display device, a storage medium, and a computer program product. Background Art

[0002] With the continuous development of head-mounted display devices, head-mounted display devices such as AR (Augmented Reality) and MR (Mixed Reality) that can integrate virtual information with the real world have become an indispensable and important device in the daily lives of more and more people.

[0003] In related technologies, in order to meet the viewing needs of the wearer when wearing a head-mounted display device, technicians usually use one-dimensional or two-dimensional pupil expansion technology to change the light propagation path within the optical waveguide structure, so that the outgoing light can be effectively dispersed to different exit pupil areas to expand the eye movement range, thereby allowing the wearer to see the corresponding image information even when the line of sight changes.

[0004] However, since it is difficult for light to be evenly diffracted to different exit pupil areas during propagation, there will be certain differences in the consistency of the images in different exit pupil areas, which greatly reduces the wearer's wearing experience. Summary of the Invention

[0005] The main purpose of this application is to provide an adjustment method for a head-mounted display device, a head-mounted display device, a storage medium, and a computer program product, aiming to solve the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas.

[0006] To achieve the above objectives, the present application proposes a method for adjusting a head-mounted display device, comprising:

[0007] Detecting a first sight line direction of the wearer and determining a first exit pupil area corresponding to the first sight line direction;

[0008] Playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area;

[0009] determining a first light source adjustment parameter when it is determined that the first actual picture information does not match the first standard picture information;

[0010] The light source module of the head-mounted display device is adjusted according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information.

[0011] In one embodiment, the step of determining the adjustment parameters of the first light source includes:

[0012] Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0013] Determining each pixel to be screened included in the first exit pupil area based on the first image performance index and the second image performance index;

[0014] receiving a pixel selection result triggered by the wearer, and determining abnormal pixels among the pixels to be screened according to the pixel selection result;

[0015] A first abnormal picture performance index corresponding to the abnormal pixel in the first picture performance index is determined, and a first light source adjustment parameter is determined according to the first abnormal picture performance index.

[0016] In one embodiment, the step of determining the adjustment parameters of the first light source further includes:

[0017] Determining a plurality of preset sight lines and preset light source adjustment parameters that match each of the plurality of preset sight lines;

[0018] screening the plurality of preset sight lines based on the first sight line direction to determine a target sight line direction that matches the first sight line direction;

[0019] The preset light source adjustment parameter that matches the target sight line direction is determined as the first light source adjustment parameter.

[0020] In one embodiment, the step of determining the adjustment parameters of the first light source further includes:

[0021] Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0022] A performance indicator difference between the first picture performance indicator and the second picture performance indicator is determined, and a first light source adjustment parameter is determined according to the performance indicator difference.

[0023] In one embodiment, the step of obtaining first standard image information of a first adjacent exit pupil area that matches the first exit pupil area includes:

[0024] Determining a plurality of preset discrete exit pupil areas and preset standard picture information corresponding to each of the plurality of discrete exit pupil areas;

[0025] Screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area;

[0026] The preset standard picture information corresponding to the first adjacent exit pupil area is determined as the first standard picture information matching the first exit pupil area.

[0027] In one embodiment, the step of screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area includes:

[0028] determining a first distance parameter generated between each of the plurality of discrete exit pupil areas and the first exit pupil area;

[0029] A target first distance parameter having the smallest value is determined among the first distance parameters, and a discrete exit pupil area corresponding to the target first distance parameter is determined as a first adjacent exit pupil area.

[0030] In one embodiment, after the step of adjusting the light source module of the head mounted display device according to the first light source adjustment parameter, the method further includes:

[0031] When a change in the wearer's sight line direction is detected, detecting a second sight line direction of the wearer;

[0032] determining a second exit pupil area corresponding to the second sight line direction, and determining a second light source adjustment parameter when second actual image information of the second exit pupil area does not match second standard image information of a matching second adjacent exit pupil area;

[0033] The light source module is adjusted according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information.

[0034] In one embodiment, the step of detecting the wearer's first line of sight direction includes:

[0035] capturing eye image data including the wearer's eyes;

[0036] Extracting eyeball image features and / or pupil image features from the image data, and determining a first sight line direction of the wearer based on the eyeball image features and / or pupil image features.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a head-mounted display device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the adjustment method of the head-mounted display device as described above.

[0038] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the adjustment method of the head-mounted display device as described above are implemented.

[0039] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, it implements the steps of the adjustment method of the head-mounted display device as described above.

[0040] The adjustment method of the head-mounted display device proposed in this application detects a first line of sight direction of the wearer and determines a first exit pupil area corresponding to the first line of sight direction; plays a standard image, detects first actual picture information of the standard image in the first exit pupil area, and obtains first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; when it is determined that the first actual picture information does not match the first standard picture information, determines a first light source adjustment parameter; and adjusts the light source module of the head-mounted display device according to the first light source adjustment parameter so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information.

[0041] In this embodiment, when the head-mounted display device is in operation, it first detects the wearer's first line of sight direction and determines a first exit pupil area corresponding to the first line of sight direction. Then, the head-mounted display device plays a preset standard image, detects first actual picture information of the standard image in the first exit pupil area, and obtains first standard picture information of the standard image in a first adjacent exit pupil area that matches the first exit pupil area. Then, the head-mounted display device compares the first actual picture information with the first standard picture information, and if it is determined that the first actual picture information does not match the first standard picture information, it determines a first light source adjustment parameter. Finally, the head-mounted display device adjusts the light source module configured therein according to the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information before adjustment.

[0042] In this way, the present application solves the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas. That is, the present application detects the exit pupil area that matches the wearer's line of sight, and when it is determined that the actual picture information of the exit pupil area that matches the wearer's line of sight does not match the standard picture information of the adjacent exit pupil area, it adjusts the light source module configured by itself, so that the actual picture information of the exit pupil area that matches the wearer's line of sight is consistent with the standard picture information of the adjacent exit pupil area before the light source module is adjusted, so that the image seen by the wearer through the exit pupil area that matches the line of sight contains complete and accurate picture information. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0045] Figure 1 A schematic diagram of a module configuration of a head-mounted display device according to an embodiment of a method for adjusting a head-mounted display device of the present application;

[0046] Figure 2 A flowchart of the first embodiment of the method for adjusting a head-mounted display device of the present application is provided;

[0047] Figure 3 This is a schematic diagram of line of sight direction detection involved in an embodiment of a method for adjusting a head-mounted display device of the present application;

[0048] Figure 4 This is a schematic diagram of a pixel selection interface involved in an embodiment of a method for adjusting a head-mounted display device of the present application;

[0049] Figure 5 Schematic diagram of the device structure of the hardware operating environment involved in the adjustment method of the head-mounted display device in the embodiment of the present application.

[0050] The purpose, features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0051] It should be understood that the specific embodiments described herein are merely used to explain the technical solutions of the present application and are not intended to limit the present application.

[0052] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0053] In this embodiment, for ease of description, please refer to Figure 1 , Figure 1 This is a schematic diagram of the module configuration of the head-mounted display device involved in an embodiment of the adjustment method of the head-mounted display device of the present application, such as Figure 1As shown, the following description is based on a head-mounted display device internally configured with an optical waveguide module, a light source module, a tracking module, and a control module, or a terminal such as a mobile terminal, a data storage control terminal, or a PC connected to an electronic control unit supporting the head-mounted display device as the execution subject. The head-mounted display device can specifically be an MR device (such as MR glasses or an MR helmet), an AR device (such as AR glasses or an AR helmet), or a combination thereof.

[0054] It should be noted that the optical waveguide module includes: a lens, a coupling-in region, and a coupling-out region, wherein the coupling-in region and the coupling-out region are configured in the optical waveguide substrate inside the lens, and the coupling-in region is used to allow the light emitted by the light source module to enter the waveguide substrate contained in the lens, so that it is transmitted in the lens and coupled out to the wearer's eyes after passing through the coupling-out region. It can be understood that there is at least one coupling-in region and at least one coupling-out region in each lens. In addition, the coupling-in region and the coupling-out region can be diffraction optical elements such as surface relief gratings, volume holographic gratings, metasurfaces, photonic crystals, etc., or they can be geometric optical elements such as partially transparent films, partially reflecting mirrors, and turning prisms.

[0055] In addition, the light source module includes a light-emitting panel and a lens assembly, wherein the light-emitting panel is a collection of array-type light-emitting units, or the light-emitting panel can also be a combination of a light-emitting component of a certain area and an array-type micro-electromechanical element. It can be understood that the light-emitting panel is used to emit light of a specific wavelength band. At the same time, the light-emitting panel can also adjust the light-emitting capacity of the unit level. Similarly, the lens assembly is used to regulate the light emitted by the light-emitting panel so that the light can be refracted into the lens by the coupling area. Specifically, the light-emitting panel can be a light-emitting device such as LCOS (Liquid Crystal on Silicon), DLP (Digital Light Processing), Micro-OLED (Micro Organic Light-Emitting Diode) or Micro-LED (Micro Light Emitting Diode), which is not specifically limited in this embodiment.

[0056] In addition, the tracking module is composed of an image sensor, which is used to capture the wearer's eye image to determine the relative spatial position and relative angle information generated between the wearer's line of sight and the optical waveguide module. It can be understood that the number of image sensors is at least 1, and the image sensor can be set on the lens surface, interior or outer shell of the head-mounted display device. At the same time, the image sensor can specifically be a photoelectric conversion device such as CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), which is not specifically limited in this embodiment.

[0057] In addition, the control module includes: a processor, an input interface, a control interface and a memory, wherein the input interface is used to input the collected relative spatial position and relative angle information into the memory and processor, and the processor generates light source adjustment parameters based on the relative spatial position and relative angle information, and inputs the light source adjustment parameters to the light source module through the control interface, so that the light source module can adjust the light-emitting panel configured by itself according to the light source adjustment parameters.

[0058] Based on the above-mentioned head-mounted display device, the overall concept of the adjustment method of the head-mounted display device of the present application is proposed here.

[0059] With the continuous development of head-mounted display devices, head-mounted display devices such as AR (Augmented Reality) and MR (Mixed Reality) that can integrate virtual information with the real world have become an indispensable and important device in the daily lives of more and more people. In related technologies, in order to meet the viewing needs of the wearer when wearing a head-mounted display device, technicians usually use one-dimensional or two-dimensional pupil expansion technology to change the light propagation path in the optical waveguide architecture, so that the outgoing light can be effectively dispersed to different exit pupil areas to expand the eye movement range, so that the wearer can see the corresponding picture information even when the line of sight changes. However, since it is difficult to achieve uniform diffraction of light to different exit pupil areas during the propagation process, there will be certain differences in the consistency of the pictures in different exit pupil areas, which greatly reduces the wearer's wearing experience.

[0060] In response to the above phenomenon, the present application provides a method for adjusting a head-mounted display device, which includes: detecting a first line of sight direction of a wearer and determining a first exit pupil area corresponding to the first line of sight direction; playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and obtaining first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; when it is determined that the first actual picture information does not match the first standard picture information, determining a first light source adjustment parameter; and adjusting the light source module of the head-mounted display device according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information.

[0061] In this way, the present application solves the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas. That is, the present application detects the exit pupil area that matches the wearer's line of sight, and when it is determined that the actual picture information of the exit pupil area that matches the wearer's line of sight does not match the standard picture information of the adjacent exit pupil area, it adjusts the light source module configured by itself, so that the actual picture information of the exit pupil area that matches the wearer's line of sight is consistent with the standard picture information of the adjacent exit pupil area before the light source module is adjusted, so that the image seen by the wearer through the exit pupil area that matches the line of sight contains complete and accurate picture information.

[0062] Based on the overall concept of the adjustment method of the head-mounted display device of the present application, the embodiment of the present application provides an adjustment method of the head-mounted display device, referring to Figure 2 , Figure 2 This is a flow chart of the first embodiment of the adjustment method for the head-mounted display device of the present application.

[0063] In this embodiment, the adjustment method of the head mounted display device includes steps S10 to S40:

[0064] Step S10: detecting a first sight line direction of the wearer, and determining a first exit pupil area corresponding to the first sight line direction;

[0065] It should be noted that the first line of sight direction refers to the direction of the wearer's line of sight relative to the optical waveguide module when wearing the head-mounted display device. This first line of sight direction specifically consists of relative spatial position and relative angle information, wherein both the relative spatial position and relative angle information are obtained by detecting the position and angle of the line of sight direction in a coordinate system constructed based on the optical waveguide module. It is understood that the coordinate origin of this coordinate system can be located anywhere within the optical waveguide module, and this application does not impose any restrictions on this. In addition, the first exit pupil area refers to the exit pupil area observed by the user when observing the optical waveguide module in the first line of sight direction.

[0066] In this embodiment, when the wearer wears the head-mounted display device, the control module in the head-mounted display device first generates a gaze tracking instruction and sends the gaze tracking instruction to the tracking module configured on the head-mounted display device, so that the tracking module detects the wearer's eyes according to the gaze tracking instruction, thereby determining the wearer's first gaze direction. The head-mounted display device then detects the optical waveguide module based on the first gaze direction to determine a first exit pupil area corresponding to the first gaze direction in the optical waveguide module.

[0067] Exemplarily, for example, if the head-mounted display device is AR glasses, when the wearer wears the AR glasses for the first time and directs his or her line of sight in a natural state (for example, looking straight ahead or slightly downward), the processor configured in the control module in the AR glasses first generates a line of sight tracking instruction and sends the line of sight tracking instruction to the tracking module configured on the head-mounted display device, so that the tracking module controls the tracking module configured on the AR glasses shell according to the line of sight tracking instruction, thereby enabling the tracking module to detect the relative spatial position and relative angle information generated between the wearer's line of sight and the optical waveguide module. The tracking module then integrates the relative spatial position and relative angle information to obtain a first line of sight direction, and uploads the obtained first line of sight direction to the processor through the access interface configured in the control module. The processor determines the first exit pupil area viewed by the wearer under the first line of sight based on the relative spatial position and relative angle information contained in the first line of sight direction.

[0068] In this way, the head-mounted display device can detect the wearer's line of sight and determine the exit pupil area that matches the line of sight.

[0069] In a feasible implementation, the step of “detecting the wearer’s first sight direction” in the above step S10 may specifically include steps S101 to S102:

[0070] Step S101: capturing eye image data including the wearer's eyes;

[0071] Step S102: extracting eyeball image features and / or pupil image features from the image data, and determining the first sight line direction of the wearer based on the eyeball image features and / or pupil image features.

[0072] In an embodiment, when a wearer wears a head-mounted display device, a control module within the head-mounted display device first generates a gaze tracking instruction and sends the gaze tracking instruction to a tracking module configured on the head-mounted display device. After receiving the gaze tracking instruction issued by the processor, the tracking module first photographs the wearer in accordance with the gaze tracking instruction to capture eye image data containing the wearer's eyes. Thereafter, the tracking module extracts eye image features and / or pupil image features contained in the eye image data, and determines the wearer's gaze based on the eye image features and / or pupil image features, and the relative spatial position and relative angle information generated between the wearer and the coordinate system constructed based on the optical waveguide module. The tracking module integrates the relative spatial position and relative angle information to determine the wearer's first gaze direction.

[0073] For example, see Figure 3 , Figure 3 This is a schematic diagram of the line of sight direction detection involved in an embodiment of the adjustment method of the head-mounted display device of this application, as shown in FIG. Figure 3 As shown, when the wearer wears the AR glasses for the first time and keeps his or her line of sight in a natural state, the processor configured in the control module of the AR glasses first generates a line of sight tracking instruction and sends the line of sight tracking instruction to the tracking module configured on the head-mounted display device, so that the tracking module takes a picture of the wearer according to the line of sight tracking instruction, thereby capturing eye image data containing the wearer's eyes. Afterwards, the tracking module processes the eye image data to extract the eyeball image features and / or pupil image features contained in the eye image data, and determines the relative spatial position and relative angle information between the wearer's line of sight and the origin of the coordinate system in the three-dimensional coordinate system constructed based on the center point of the optical waveguide module based on the eyeball image features and / or pupil image features. The tracking module then integrates the relative spatial position and relative angle information to obtain the wearer's first line of sight direction.

[0074] It should be noted that in this embodiment and another embodiment, after receiving the gaze tracking instruction, the tracking module may also capture only the wearer's eyeball, pupil, eye socket, and other areas to obtain image data, and extract image features within the image data to determine the wearer's gaze direction. It is understood that this application does not limit the areas captured by the tracking module.

[0075] In this way, the head-mounted display device can detect the wearer's line of sight direction, and then determine the exit pupil area viewed by the wearer under the current line of sight based on the line of sight direction.

[0076] Step S20: playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area;

[0077] It should be noted that the picture information is information parameters including a color consistency index representing color consistency and a brightness consistency index representing brightness consistency. It can be understood that the uniformity of the field of view of the exit pupil area can be indicated by each picture information, that is, by judging whether the picture information of the first exit pupil area matching the line of sight direction matches the picture information matching other exit pupil areas, it is possible to judge whether the image information seen by the wearer through the first exit pupil area is complete and accurate.

[0078] In this embodiment, after determining the corresponding first exit pupil area according to the first line of sight direction, the processor controls the light source module to display a standard image on the first exit pupil area, and detects the standard image to determine the first actual picture information corresponding to the standard image in the first exit pupil area. At the same time, the processor determines the first adjacent exit pupil area that matches the first exit pupil area, and determines the first standard picture information corresponding to the first adjacent exit pupil area.

[0079] Exemplarily, for example, after the processor determines the first exit pupil area seen by the wearer according to the first line of sight direction, it first controls the light source module to emit a color waveguide, thereby cyclically displaying a pure color image and a white image on the first exit pupil area. The processor detects the first exit pupil area to determine the first actual picture information corresponding to the first exit pupil area through the pure color image and the white image played in the first exit pupil area. At the same time, the processor reads the memory configured in the control module to obtain the preset standard picture information written in the memory, and filters out the first standard picture information corresponding to the first adjacent exit pupil area adjacent to the first exit pupil area from the preset standard picture information.

[0080] In this way, the head-mounted display device can identify the first actual picture information of the first exit pupil area, and query the first standard picture information of the adjacent exit pupil area adjacent to the first exit pupil area that contains complete and accurate picture information.

[0081] In a feasible implementation manner, the step of “obtaining first standard image information of a first adjacent exit pupil area that matches the first exit pupil area” in the above step S20 may specifically include steps S201 to S203:

[0082] Step S201: determining a plurality of preset discrete exit pupil areas and preset standard image information corresponding to each of the plurality of discrete exit pupil areas;

[0083] Step S202: screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area;

[0084] Step S203: determining the preset standard picture information corresponding to the first adjacent exit pupil area as the first standard picture information matching the first exit pupil area.

[0085] It should be noted that the discrete exit pupil areas are multiple, unconnected exit pupil areas included in the optical waveguide module. Each discrete exit pupil area has matching preset standard image information that allows the user to see a complete image. Furthermore, each discrete exit pupil area and its matching preset standard image information are stored in the aforementioned memory, allowing the processor to directly read the memory and retrieve the information when needed. It is understood that each discrete exit pupil area and each preset standard image information can be obtained by a technician using standard measurement equipment before the head-mounted display device leaves the factory. There are many ways to test the preset standard image information corresponding to the discrete exit pupil areas, and this application does not impose any restrictions on this.

[0086] In this embodiment, after the processor controls the light source module to display a standard image on the first exit pupil area, it can also first read the memory configured in the control module to obtain multiple preset discrete exit pupil areas stored in the memory, and the preset standard screen information corresponding to each of the multiple discrete exit pupil areas. Afterwards, the processor filters the multiple discrete exit pupil areas based on the first exit pupil area to determine a first adjacent exit pupil area adjacent to the first exit pupil area. Finally, the processor determines the preset standard screen information corresponding to the first adjacent exit pupil area as the first standard screen information that matches the first exit pupil area.

[0087] Exemplarily, for example, after the processor cyclically displays the pure color image and the white image through the above-mentioned first exit pupil area, it can also first read the above-mentioned memory to obtain multiple discrete exit pupil areas pre-stored in the memory by the technician, and the preset standard picture information consisting of color consistency indicators and brightness consistency indicators corresponding to each of the multiple discrete exit pupil areas. Afterwards, the processor screens the multiple discrete exit pupil areas based on the first exit pupil area to determine the first adjacent exit pupil area closest to the first exit pupil area. Finally, the processor determines the preset standard picture information corresponding to the first adjacent exit pupil area, and determines the preset standard picture information corresponding to the first adjacent exit pupil area as the first standard picture information used to judge whether the picture consistency of the first exit pupil area matching the wearer's line of sight matches the picture consistency of the first adjacent exit pupil area.

[0088] In this way, the head-mounted display device can query the first standard picture information of the adjacent exit pupil area adjacent to the first exit pupil area, which contains complete and accurate picture information, and then determine whether the image seen by the wearer through the exit pupil area matching the line of sight contains complete and accurate picture information based on the picture information of the exit pupil area matching the wearer's line of sight and the picture information corresponding to the adjacent exit pupil area.

[0089] In a feasible implementation manner, the above step S202 may specifically include steps S2021 to S2022:

[0090] Step S2021: determining a first distance parameter between each of the plurality of discrete exit pupil areas and the first exit pupil area;

[0091] Step S2022: determining a target first distance parameter having the smallest value among the first distance parameters, and determining a discrete exit pupil area corresponding to the target first distance parameter as a first adjacent exit pupil area.

[0092] In this embodiment, after determining multiple preset discrete exit pupil areas, the processor can also first determine the first distance parameters generated between each of the multiple discrete exit pupil areas and the first exit pupil area. Afterwards, the processor determines the target first distance parameter with the smallest value among the multiple first distance parameters, and determines the discrete exit pupil area corresponding to the target first distance parameter as the adjacent exit pupil area corresponding to the first exit pupil area.

[0093] Exemplarily, for example, after reading the memory to obtain multiple discrete exit pupil areas, the processor first calculates the center points of each of the multiple discrete exit pupil areas and the first distance parameters generated between each of the center points of the above-mentioned first exit pupil area. Then, the processor filters each first distance parameter to determine the target first distance parameter with the smallest value. The processor determines the discrete exit pupil area corresponding to the target first distance parameter as the first adjacent exit pupil area closest to the first exit pupil area.

[0094] It should be noted that after the processor determines the target first distance parameter, if it detects that the number of target first distance parameters is greater than 1, it can randomly select a discrete exit pupil area from the discrete exit pupil areas corresponding to each target first distance parameter as the first adjacent exit pupil area adjacent to the first exit pupil area.

[0095] In this way, the head-mounted display device can query the first standard picture information of the adjacent exit pupil area adjacent to the first exit pupil area, which contains complete and accurate picture information, and then determine whether the image seen by the wearer through the exit pupil area matching the line of sight contains complete and accurate picture information based on the picture information of the exit pupil area matching the wearer's line of sight and the picture information corresponding to the adjacent exit pupil area.

[0096] Step S30: determining a first light source adjustment parameter when it is determined that the first actual image information does not match the first standard image information;

[0097] In this embodiment, after obtaining the first standard screen information, the processor can also compare the first actual screen information with the first standard screen information, so as to determine the first light source adjustment parameter for adjusting the light source module when it is determined that the first actual screen information does not match the first standard screen information.

[0098] In a feasible implementation manner, the step of “determining the adjustment parameters of the first light source” in the above step S30 may specifically include steps S301 to S302:

[0099] Step S301: reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0100] Step S302: determining a performance index difference between the first picture performance index and the second picture performance index, and determining a first light source adjustment parameter according to the performance index difference.

[0101] In this embodiment, when the processor determines that the first actual picture information does not match the first standard picture information, it first reads the first picture performance indicator contained in the first actual picture information and reads the second picture performance indicator contained in the first standard picture information. Thereafter, the processor compares the first picture performance indicator with the second picture performance indicator to determine the performance indicator difference between the first picture performance indicator and the second picture performance indicator. The processor then determines the first light source adjustment parameter based on the performance indicator difference.

[0102] Exemplarily, for example, when the processor determines that the first actual picture information does not match the first standard picture information, it first reads the first color consistency index characterizing color consistency contained in the first actual picture information, and reads the second color consistency index characterizing color consistency contained in the first standard picture information, and performs a difference calculation on the first color consistency index and the second color consistency index to obtain a first calculation result. At the same time, the processor reads the first brightness consistency index characterizing brightness consistency contained in the first actual picture information, and reads the second brightness consistency index characterizing brightness consistency contained in the first standard picture information, and performs a difference calculation on the first brightness consistency index and the second brightness consistency index to obtain a second calculation result. The processor thereby determines the brightness consistency index difference parameter based on the first calculation result, and determines the color consistency index difference parameter based on the second calculation result. The processor further determines the first light source adjustment parameter for adjusting the light source module based on the brightness consistency index difference parameter and the color consistency index difference parameter.

[0103] In this way, the head-mounted display device can determine the light source adjustment parameters in a timely manner when the image information of the exit pupil area that matches the line of sight is determined and the image information of the adjacent exit pupil area does not match.

[0104] In a feasible implementation, the step of "determining the adjustment parameters of the first light source" in the above step S30 may further include steps S303 to S306:

[0105] Step S303: reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0106] Step S304: determining each pixel to be screened included in the first exit pupil area based on the first image performance index and the second image performance index;

[0107] Step S305: receiving the pixel selection result triggered by the wearer, and determining abnormal pixels among the pixels to be screened according to the pixel selection result;

[0108] Step S306: determining a first abnormal picture performance index corresponding to the abnormal pixel in the first picture performance index, and determining a first light source adjustment parameter according to the first abnormal picture performance index.

[0109] It should be noted that the pixels to be screened are those within the first exit pupil area where the image information is incomplete (i.e., the color consistency and brightness consistency of the pixels to be screened do not reach the color consistency and brightness consistency of the corresponding standard pixels within the first adjacent exit pupil area). In addition, the pixel selection result is the pixels to be screened that the wearer has selected and that require brightness and color adjustment.

[0110] In this embodiment, when the processor determines that the first actual image information does not match the first standard image information, it may also first read the first image performance index contained in the first actual image information and the second image performance index contained in the first standard image information. Then, the processor filters each pixel contained in the first exit pupil area based on the first image performance index and the second image performance index to determine the pixels to be filtered whose first image performance index is inconsistent with the second image performance index. Then, when the processor detects that its own light source adjustment mode is manual mode, it generates an adjustment option based on each pixel to be filtered and receives a pixel selection result generated when the user triggers the adjustment option. The processor determines each abnormal pixel that matches the pixel selection result among the pixels to be filtered. Finally, the processor determines the first image performance index corresponding to each abnormal pixel as the first abnormal image performance index, and determines the second image performance index corresponding to each first abnormal image performance index in the first adjacent exit pupil area. The processor calculates each first abnormal image performance index and the second image performance index corresponding to each first abnormal image performance index to determine the first light source adjustment parameter.

[0111] For example, see Figure 4 , Figure 4This is a schematic diagram of a pixel selection interface involved in an embodiment of an adjustment method for a head-mounted display device of the present application. When the processor determines that the first actual picture information does not match the first standard picture information, it can also first read the first picture performance indicators contained in the first actual picture information and read the second picture performance indicators contained in the first standard picture information. Afterwards, the processor filters the pixels contained in the first exit pupil area according to the first picture performance indicator and the second picture performance indicator to filter out the pixels to be filtered whose first color consistency indicator does not reach the second color consistency indicator, and / or filters out the pixels to be filtered whose first brightness consistency indicator does not reach the second brightness consistency indicator. Afterwards, the processor detects the adjustment mode of the AR glasses, and when it detects that the AR glasses are in manual adjustment mode, generates the following based on the pixels to be filtered. Figure 4 The pixel selection interface shown is displayed by the processor through the lens in the optical waveguide module. At this time, the wearer views the pixel selection interface and, if it is determined that adjustment is required, selects at least one pixel to be screened in the pixel selection interface to generate a pixel selection result. The processor receives the pixel selection result and determines the abnormal pixel that meets the pixel selection result among multiple pixel points to be screened. Finally, the processor determines the first brightness consistency index / first color consistency index corresponding to the abnormal pixel as the first abnormal picture performance index, and determines the performance index difference between the first abnormal picture performance index and the second brightness consistency index / second color consistency index corresponding to the pixel that matches itself in the first adjacent exit pupil area. The processor then determines the first light source adjustment parameter for adjusting the light source module based on the performance index difference.

[0112] It should be noted that in this embodiment and another embodiment, when the processor detects that the AR glasses are in automatic adjustment mode, it automatically calculates the performance indicator difference between the first image performance indicator corresponding to each pixel to be screened and the second image performance indicator corresponding to each first adjacent exit pupil area. The processor then determines the first light source adjustment parameter for adjusting the light source module based on the performance indicator difference.

[0113] In this way, the head-mounted display device can determine that the image information of the exit pupil area that matches the wearer's line of sight does not match the image information of the adjacent exit pupil area that can display complete and accurate image information. It can then filter out the pixel points for adjustment and display each pixel point to the wearer so that the wearer can choose the pixel points to be adjusted by himself, thereby making the obtained light source adjustment parameters more in line with the wearer's needs, further improving the wearer's wearing experience.

[0114] In a feasible implementation manner, the step of "determining the adjustment parameters of the first light source" in the above step S30 may further include steps S307 to S308:

[0115] Step S307: determining a plurality of preset sight lines and preset light source adjustment parameters that match the plurality of preset sight lines;

[0116] Step S308: screening the plurality of preset sight lines based on the first sight line direction to determine a target sight line direction that matches the first sight line direction;

[0117] Step S309: determining the preset light source adjustment parameter that matches the target sight line direction as the first light source adjustment parameter.

[0118] In this embodiment, when the processor determines that the first actual picture information does not match the first standard picture information, it can also first read the above-mentioned memory to obtain multiple preset line of sight directions and preset light source adjustment parameters that match each of the multiple preset line of sight directions. Afterwards, the processor compares the first line of sight direction with the multiple preset line of sight directions respectively to determine the target line of sight direction that is consistent with the first line of sight direction. Finally, the processor determines the preset light source adjustment parameters that match the target line of sight direction as the first light source adjustment parameters.

[0119] Exemplarily, for example, when the processor determines that the first actual picture information of the first exit pupil area does not match the first standard picture information corresponding to the first adjacent exit pupil area, the processor can also first read the above-mentioned memory to obtain a parameter mapping table containing multiple preset line of sight directions and preset light source adjustment parameters that match each of the multiple preset line of sight directions. Afterwards, the processor queries the parameter mapping table based on the first line of sight direction, and compares the first line of sight direction with the multiple preset line of sight directions contained in the parameter mapping table, thereby determining the target line of sight direction that matches the first line of sight direction among the multiple preset line of sight directions based on the comparison result. Finally, the processor determines the preset light source adjustment parameter that matches the target line of sight direction in the parameter mapping table as the first light source adjustment parameter.

[0120] In this way, the head-mounted display device can more quickly determine the light source adjustment parameters that match the line of sight direction by querying the mapping table, and then adjust the light-emitting panel of the light source module according to the light source adjustment parameters.

[0121] Step S40: adjusting the light source module of the head-mounted display device according to the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information.

[0122] It should be noted that the light source adjustment parameters are parameters used to adjust parameters such as the brightness and RGB channel brightness of each pixel displayed on the exit pupil area (for example, when the light source module emits a monochrome waveguide, the pixel-level brightness of each pixel in the exit pupil area can be adjusted based on the light source adjustment parameters. Similarly, when the light source module emits a color waveguide, the RGB channel brightness of each pixel can be adjusted based on the light source adjustment parameters). It can be understood that through the light source adjustment parameters, when a standard image is displayed on the first exit pupil area, the brightness and RGB channel brightness of each pixel of the standard image in the first exit pupil area are matched with the brightness and RGB channel brightness of each pixel of the standard image in the first adjacent exit pupil area, so that the picture consistency of the first exit pupil area that matches the wearer's line of sight is consistent with the picture consistency of the first adjacent exit pupil area before the light source module is adjusted.

[0123] In this embodiment, after determining the first light source adjustment parameter, the processor sends the first light source adjustment parameter to the light source module through the control interface configured in the control module, so that the light source module adjusts the light-emitting panel configured by itself based on the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area corresponding to the line of sight direction is consistent with the first standard picture information of the first adjacent exit pupil area before the light-emitting panel is adjusted, so that the image seen by the wearer through the first exit pupil area contains complete and accurate picture information.

[0124] Exemplarily, for example, after determining the first light source adjustment parameter, the processor sends the first light source adjustment parameter to the light-emitting panel in the light source module through the control interface configured in the above-mentioned control module, and the light-emitting panel adjusts each light-emitting unit configured in itself according to the first light source adjustment parameter, so that the first actual picture information contained in the image presented in the first exit pupil area by the light emitted by the adjusted light-emitting panel is consistent with the first standard picture information contained in the image presented in the first adjacent exit pupil area before the light-emitting panel is adjusted, so that the image seen by the wearer through the first exit pupil area contains complete and accurate picture information.

[0125] In this embodiment, when the wearer wears the head-mounted display device, the control module in the head-mounted display device first generates a gaze tracking instruction and sends the gaze tracking instruction to the tracking module configured on the head-mounted display device, so that the tracking module detects the wearer's eyes according to the gaze tracking instruction, thereby determining the wearer's first gaze direction. The head-mounted display device then detects the optical waveguide module according to the first gaze direction to determine the first exit pupil area corresponding to the first gaze direction in the optical waveguide module. Thereafter, the processor controls the light source module to display a standard image on the first exit pupil area, and detects the standard image to determine the first actual picture information corresponding to the standard image in the first exit pupil area. At the same time, the processor determines a first adjacent exit pupil area that matches the first exit pupil area, and Determine the first standard picture information corresponding to the first adjacent exit pupil area, and then the processor compares the first actual picture information with the first standard picture information, so as to determine the first light source adjustment parameter for adjusting the light source module when it is determined that the first actual picture information does not match the first standard picture information. Finally, the processor sends the first light source adjustment parameter to the light source module through the control interface configured in the control module, so that the light source module adjusts the light-emitting panel configured by itself based on the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area corresponding to the line of sight direction is consistent with the first standard picture information of the first adjacent exit pupil area before the light-emitting panel is adjusted, so that the image seen by the wearer through the first exit pupil area contains complete and accurate picture information.

[0126] In this way, the present application solves the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas. That is, the present application detects the exit pupil area that matches the wearer's line of sight, and when it is determined that the actual picture information of the exit pupil area that matches the wearer's line of sight does not match the standard picture information of the adjacent exit pupil area, it adjusts the light source module configured by itself, so that the actual picture information of the exit pupil area that matches the wearer's line of sight is consistent with the standard picture information of the adjacent exit pupil area before the light source module is adjusted, so that the image seen by the wearer through the exit pupil area that matches the line of sight contains complete and accurate picture information.

[0127] Based on the first embodiment of the present application, a second embodiment of the present application is proposed. In the second embodiment of the present application, the same or similar contents as those of the above embodiments can be referred to above and will not be described in detail. On this basis, after the above step S40, the adjustment method of the head-mounted display device of the present application can also include steps A10 to A30:

[0128] Step A10: When a change in the wearer's sight line direction is detected, detecting a second sight line direction of the wearer;

[0129] Step A20: determining a second exit pupil area corresponding to the second sight line direction, and determining a second light source adjustment parameter when second actual image information of the second exit pupil area does not match second standard image information of a matching second adjacent exit pupil area;

[0130] Step A30: adjusting the light source module according to the second light source adjustment parameter, so that the second actual image information of the second exit pupil area after adjustment is consistent with the second standard image information.

[0131] It should be noted that the second sight line direction is the sight line direction of the wearer after the wearer's sight line moves away from the first sight line direction. In addition, the second exit pupil area is the exit pupil area observed when the wearer's sight line is in the second sight line direction.

[0132] In this embodiment, after the light source module is adjusted according to the above-mentioned first light source adjustment parameters, the processor can continue to call the above-mentioned tracking module to detect the wearer. When the tracking module detects that the wearer's line of sight has changed, it further detects the wearer's second line of sight direction. Thereafter, the tracking module sends the second line of sight direction to the processor, and the processor calculates the second exit pupil area currently being viewed by the wearer based on the second line of sight direction. The processor reads the above-mentioned memory to determine the second adjacent exit pupil area that matches the second exit pupil area. The processor then determines whether the second actual picture information of the second exit pupil area matches the second standard picture information of the second adjacent exit pupil area based on the second exit pupil area and the second adjacent exit pupil area, and processes the information. When the processor determines that the second actual picture information does not match the second standard picture information, it determines, based on the second actual picture information and the second standard picture information, each abnormal pixel point in the second exit pupil area where the second actual picture information does not meet the second standard picture information. The processor further determines the performance indicator difference corresponding to each abnormal pixel point. The processor further determines the second light source adjustment parameter based on each performance indicator difference. Finally, the processor sends the second light source adjustment parameter to the light source module, and the light source module adjusts the light-emitting panel configured by itself according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information of the second adjacent exit pupil area before the light-emitting panel is adjusted.

[0133] Exemplarily, for example, after the light source module adjusts the light-emitting panel according to the above-mentioned first light source adjustment parameters, the processor may further send a sight detection instruction to the tracking module. After receiving the dynamic tracking instruction, the tracking module detects the wearer's eyes. When it is detected that the wearer's sight direction deviates from the above-mentioned first sight direction, the wearer's face is photographed to obtain second image data, and the wearer's second sight direction is determined based on the second image data. Thereafter, the tracking module inputs the second sight direction to the processor through the access interface. The processor calculates the second exit pupil area in the optical waveguide module where the wearer's exit pupil is located based on the second sight direction. The processor reads the memory to obtain the above-mentioned discrete exit pupil areas. The processor further calculates the second distance parameter generated between each discrete exit pupil area and the second exit pupil area, and determines the second adjacent exit pupil area closest to the second exit pupil area in each discrete exit pupil area based on each second distance parameter. The processor reads the second standard picture information corresponding to the second adjacent exit pupil area in the above-mentioned memory. At the same time, the processor controls the light source module to play the color waveguide, so that a pure color image and a white image are cyclically presented on the second exit pupil area. The processor then detects the second exit pupil area to determine the second actual picture information in the second exit pupil area. The processor then compares the second actual picture information with the second standard picture information. When the comparison shows that the second actual picture information does not reach the second standard picture information, it is determined that there is a deviation in the picture information in the image seen by the wearer through the second exit pupil area. The processor then performs a difference calculation on the third color consistency index representing color consistency contained in the second actual picture information and the fourth color consistency index representing color consistency contained in the second standard picture information to obtain a third calculation result. At the same time, the processor performs a difference calculation on the third brightness consistency index representing brightness consistency contained in the second actual picture information and the fourth brightness consistency index representing brightness consistency contained in the second standard picture information to obtain a fourth calculation result. The processor determines the brightness consistency index difference parameter based on the third calculation result and determines the color consistency index difference parameter based on the fourth calculation result. The processor then determines the second light source adjustment parameter for adjusting the light source module based on the brightness consistency index difference parameter and the color consistency index difference parameter.

[0134] In this way, the head-mounted display device can detect changes in the wearer's line of sight, and when the wearer's line of sight changes, promptly determine the second exit pupil area seen by the wearer after the line of sight direction changes, and adjust the light source module when it is detected that the picture information of the second exit pupil area does not match the picture information of the second adjacent exit pupil area, so that after the wearer moves his line of sight, the image that can be seen in the second exit pupil area with matching line of sight has complete and accurate picture information.

[0135] The present application provides a head-mounted display device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the head-mounted display device adjustment method of the above-mentioned embodiment 1.

[0136] Reference below Figure 5 , which shows a schematic diagram of the structure of a head-mounted display device suitable for implementing the embodiments of the present application. The head-mounted display device in the embodiments of the present application may include, but is not limited to, a head-mounted display device internally configured with an optical waveguide module, a light source module, a tracking module, and a control module, or a terminal such as a mobile terminal, a data storage control terminal, or a PC connected to an electronic control unit supporting the head-mounted display device. Figure 5 The head-mounted display device shown is merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0137] like Figure 5 As shown, the head-mounted display device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes based on programs stored in a read-only memory (ROM) 1002 or programs loaded from a storage device 1003 into a random access memory (RAM) 1004. RAM 1004 also stores various programs and data required for the operation of the head-mounted display device. The processing device 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the head-mounted display device to communicate with other devices wirelessly or wired to exchange data. Although the figure shows a head-mounted display device with various systems, it should be understood that it is not required to implement or have all of the systems shown. More or fewer systems may be implemented or have alternatively.

[0138] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0139] The head-mounted display device provided in this application utilizes the head-mounted display device adjustment method described in the aforementioned embodiment, thereby resolving the technical issue of variations in image consistency across different exit pupil regions in the related art. Compared to the prior art, the head-mounted display device provided in this application achieves the same beneficial effects as the head-mounted display device adjustment method described in the aforementioned embodiment. Other technical features of this head-mounted display device are the same as those disclosed in the aforementioned embodiment and are not further elaborated upon here.

[0140] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0141] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

[0142] The present application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, and the computer-readable program instructions are used to execute the adjustment method of the head-mounted display device in the above embodiment.

[0143] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0144] The computer-readable storage medium may be included in the head-mounted display device, or may exist independently without being incorporated into the head-mounted display device.

[0145] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the head-mounted display device, the head-mounted display device: detects a first line of sight direction of the wearer and determines a first exit pupil area corresponding to the first line of sight direction; plays a standard image, detects first actual picture information of the standard image in the first exit pupil area, and obtains first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; when it is determined that the first actual picture information does not match the first standard picture information, determines a first light source adjustment parameter; and adjusts the light source module of the head-mounted display device according to the first light source adjustment parameter so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information.

[0146] Computer program code for performing the operations of the present application may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0147] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0148] The modules described in the embodiments of the present application may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.

[0149] The computer-readable storage medium provided in this application stores computer-readable program instructions (i.e., a computer program) for executing the aforementioned head-mounted display device adjustment method. This computer-readable storage medium can address the technical issue of discrepancies in image consistency across different exit pupil areas in the related art. Compared to the prior art, the beneficial effects of the computer-readable storage medium provided in this application are similar to those of the head-mounted display device adjustment method provided in the aforementioned embodiment, and are not further elaborated here.

[0150] The present application also provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the adjustment method of the head-mounted display device as described above.

[0151] The computer program product provided in this application can resolve the technical problem of varying image consistency across different exit pupil areas in the related art. Compared to the prior art, the beneficial effects of the computer program product provided in this application are the same as those of the head-mounted display device adjustment method provided in the aforementioned embodiment, and are not further elaborated here.

[0152] The above description is only part of the embodiments of the present application and does not limit the patent scope of the present application. All equivalent structural transformations made by using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect application in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A method for adjusting a head-mounted display device, characterized in that: The adjustment method of the head mounted display device includes: Detecting a first sight line direction of the wearer and determining a first exit pupil area corresponding to the first sight line direction; Playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; determining a first light source adjustment parameter when it is determined that the first actual picture information does not match the first standard picture information; The light source module of the head-mounted display device is adjusted according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information.

2. The method for adjusting a head-mounted display device according to claim 1, wherein: The step of determining the adjustment parameters of the first light source includes: Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information; Determining each pixel to be screened included in the first exit pupil area based on the first image performance index and the second image performance index; receiving a pixel selection result triggered by the wearer, and determining abnormal pixels among the pixels to be screened according to the pixel selection result; A first abnormal picture performance index corresponding to the abnormal pixel in the first picture performance index is determined, and a first light source adjustment parameter is determined according to the first abnormal picture performance index.

3. The method for adjusting a head-mounted display device according to claim 1, wherein: The step of determining the adjustment parameters of the first light source further includes: Determining a plurality of preset sight lines and preset light source adjustment parameters that match each of the plurality of preset sight lines; screening the plurality of preset sight lines based on the first sight line direction to determine a target sight line direction that matches the first sight line direction; The preset light source adjustment parameter that matches the target sight line direction is determined as the first light source adjustment parameter.

4. The method for adjusting a head-mounted display device according to claim 1, wherein: The step of determining the adjustment parameters of the first light source further includes: Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information; A performance indicator difference between the first picture performance indicator and the second picture performance indicator is determined, and a first light source adjustment parameter is determined according to the performance indicator difference.

5. The method for adjusting a head-mounted display device according to claim 1, wherein: The step of obtaining first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area includes: Determining a plurality of preset discrete exit pupil areas and preset standard picture information corresponding to each of the plurality of discrete exit pupil areas; Screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area; The preset standard picture information corresponding to the first adjacent exit pupil area is determined as the first standard picture information matching the first exit pupil area.

6. The method for adjusting a head-mounted display device according to claim 5, wherein: The step of screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area comprises: determining a first distance parameter generated between each of the plurality of discrete exit pupil areas and the first exit pupil area; A target first distance parameter having the smallest value is determined among the first distance parameters, and a discrete exit pupil area corresponding to the target first distance parameter is determined as a first adjacent exit pupil area.

7. The method for adjusting a head mounted display device according to any one of claims 1 to 6, wherein: After the step of adjusting the light source module of the head mounted display device according to the first light source adjustment parameter, the method further includes: When a change in the wearer's sight line direction is detected, detecting a second sight line direction of the wearer; determining a second exit pupil area corresponding to the second sight line direction, and determining a second light source adjustment parameter when second actual image information of the second exit pupil area does not match second standard image information of a matching second adjacent exit pupil area; The light source module is adjusted according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information.

8. The method for adjusting a head-mounted display device according to claim 1, wherein: The step of detecting the wearer's first sight direction includes: capturing eye image data including the wearer's eyes; Extracting eyeball image features and / or pupil image features from the image data, and determining a first sight line direction of the wearer based on the eyeball image features and / or pupil image features.

9. A head-mounted display device, characterized in that: The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the method for adjusting the head-mounted display device according to any one of claims 1 to 8.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the adjustment method of the head-mounted display device according to any one of claims 1 to 8 are implemented.

11. A computer program product, characterized in that The computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the method for adjusting the head-mounted display device according to any one of claims 1 to 8 are implemented.

Images