Adjusting method of head-mounted display device, head-mounted display device, medium and product

Abstract

The invention discloses an adjusting method of a head-mounted display device, the head-mounted display device, a medium and a product, and relates to the technical field of head-mounted display devices.The adjusting method of the head-mounted display device specifically comprises the steps that the first sight line direction of a wearer is detected, and a first exit pupil area corresponding to the first sight line direction is determined; playing the standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area matched with the first exit pupil area; when it is determined that the first actual picture information is not matched with the first standard picture information, determining a first light source adjustment parameter; and adjusting a light source module of the head-mounted display device according to the first light source adjustment parameter, so that the adjusted first actual picture information of the first exit pupil region is consistent with the first standard picture information. According to the invention, the image seen by the wearer through the exit pupil area matched with the sight line direction contains complete and accurate picture information.

Description

Technical Field

[0001] The present application relates to the technical field of head-mounted display devices, and in particular to an adjustment method for a head-mounted display device, a head-mounted display device, a storage medium, and a computer program product. Background Art

[0002] With the continuous development of head-mounted display devices, head-mounted display devices such as AR (Augmented Reality) and MR (Mixed Reality) that can integrate virtual information with the real world have become important devices that are indispensable in the daily lives of more and more people.

[0003] In related technologies, in order to meet the viewing needs of the wearer when wearing a head-mounted display device, technicians usually use one-dimensional or two-dimensional pupil expansion technology to change the light propagation path within the optical waveguide structure, so that the outgoing light can be effectively dispersed to different exit pupil areas to expand the eye movement range, thereby allowing the wearer to see the corresponding picture information when the line of sight changes.

[0004] However, since it is difficult for light to be evenly diffracted to different exit pupil areas during the propagation process, there will be certain differences in the consistency of the images in different exit pupil areas, which greatly reduces the wearer's wearing experience. Summary of the invention

[0005] The main purpose of the present application is to provide an adjustment method for a head-mounted display device, a head-mounted display device, a storage medium and a computer program product, aiming to solve the technical problem in the related art that there are certain differences in the consistency of images in different exit pupil areas.

[0006] To achieve the above objectives, the present application proposes a method for adjusting a head mounted display device, comprising:

[0007] Detecting a first sight line direction of the wearer, and determining a first exit pupil area corresponding to the first sight line direction;

[0008] Playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area matching the first exit pupil area;

[0009] When it is determined that the first actual picture information does not match the first standard picture information, determining a first light source adjustment parameter;

[0010] The light source module of the head mounted display device is adjusted according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information.

[0011] In one embodiment, the step of determining the adjustment parameters of the first light source includes:

[0012] Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0013] Determining each pixel point to be screened included in the first exit pupil area based on the first picture performance index and the second picture performance index;

[0014] Receiving the pixel selection result triggered by the wearer, and determining abnormal pixels among the pixels to be screened according to the pixel selection result;

[0015] A first abnormal picture performance index corresponding to the abnormal pixel in the first picture performance index is determined, and a first light source adjustment parameter is determined according to the first abnormal picture performance index.

[0016] In one embodiment, the step of determining the adjustment parameters of the first light source further includes:

[0017] Determining a plurality of preset sight lines and preset light source adjustment parameters that match each of the plurality of preset sight lines;

[0018] Screening the plurality of preset sight lines based on the first sight line direction to determine a target sight line direction that matches the first sight line direction;

[0019] The preset light source adjustment parameter that matches the target sight line direction is determined as the first light source adjustment parameter.

[0020] In one embodiment, the step of determining the adjustment parameters of the first light source further includes:

[0021] Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0022] A performance indicator difference between the first picture performance indicator and the second picture performance indicator is determined, and a first light source adjustment parameter is determined according to the performance indicator difference.

[0023] In one embodiment, the step of obtaining first standard picture information of a first adjacent exit pupil area matching the first exit pupil area includes:

[0024] Determine a plurality of preset discrete exit pupil areas and preset standard picture information corresponding to each of the plurality of discrete exit pupil areas;

[0025] Screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area;

[0026] The preset standard picture information corresponding to the first adjacent exit pupil area is determined as the first standard picture information matching the first exit pupil area.

[0027] In one embodiment, the step of screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area comprises:

[0028] Determine a first distance parameter generated between each of the plurality of discrete exit pupil areas and the first exit pupil area;

[0029] A target first distance parameter having the smallest value is determined among the first distance parameters, and a discrete exit pupil area corresponding to the target first distance parameter is determined as a first adjacent exit pupil area.

[0030] In one embodiment, after the step of adjusting the light source module of the head mounted display device according to the first light source adjustment parameter, the method further includes:

[0031] When a change in the line of sight of the wearer is detected, detecting a second line of sight of the wearer;

[0032] Determine a second exit pupil area corresponding to the second sight line direction, and determine a second light source adjustment parameter when second actual picture information of the second exit pupil area does not match second standard picture information of a matching second adjacent exit pupil area;

[0033] The light source module is adjusted according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information.

[0034] In one embodiment, the step of detecting the wearer's first sight direction includes:

[0035] capturing eye image data including the wearer's eyes;

[0036] Eyeball image features and / or pupil image features of the image data are extracted, and a first sight line direction of the wearer is determined according to the eyeball image features and / or pupil image features.

[0037] In addition, to achieve the above-mentioned purpose, the present application also proposes a head-mounted display device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the adjustment method of the head-mounted display device as described above.

[0038] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the adjustment method of the head-mounted display device as described above are implemented.

[0039] In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the adjustment method of the head-mounted display device as described above are implemented.

[0040] The adjustment method of the head-mounted display device proposed in the present application detects a first sight line direction of the wearer and determines a first exit pupil area corresponding to the first sight line direction; plays a standard image, detects first actual picture information of the standard image in the first exit pupil area, and obtains first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; determines a first light source adjustment parameter when it is determined that the first actual picture information does not match the first standard picture information; and adjusts a light source module of the head-mounted display device according to the first light source adjustment parameter so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information.

[0041] In this embodiment, when the head-mounted display device is running, it first detects the first sight direction of the wearer and determines the first exit pupil area corresponding to the first sight direction. Then, the head-mounted display device plays a preset standard image, detects the first actual picture information of the standard image in the first exit pupil area, and obtains the first standard picture information of the standard image in the first adjacent exit pupil area that matches the first exit pupil area. Then, the head-mounted display device compares the first actual picture information with the first standard picture information, and when it is determined that the first actual picture information does not match the first standard picture information, determines the first light source adjustment parameter. Finally, the head-mounted display device adjusts the light source module configured by itself according to the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information before adjustment.

[0042] In this way, the present application solves the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas. That is, the present application detects the exit pupil area that matches the wearer's line of sight direction, and when it is determined that the actual picture information of the exit pupil area that matches the wearer's line of sight direction does not match the standard picture information of the adjacent exit pupil area, the present application adjusts the light source module configured by itself to make the actual picture information of the exit pupil area that matches the wearer's line of sight direction consistent with the standard picture information of the adjacent exit pupil area before the light source module is adjusted, so that the image seen by the wearer through the exit pupil area that matches the line of sight direction contains complete and accurate picture information. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0045] Figure 1 A schematic diagram of the module configuration of a head-mounted display device according to an embodiment of a method for adjusting a head-mounted display device of the present application;

[0046] Figure 2 A flowchart of Embodiment 1 of the method for adjusting a head mounted display device of the present application;

[0047] Figure 3 This is a schematic diagram of line of sight direction detection involved in an embodiment of an adjustment method for a head mounted display device of the present application;

[0048] Figure 4 This is a schematic diagram of a pixel point selection interface involved in an embodiment of an adjustment method for a head mounted display device of the present application;

[0049] Figure 5 Schematic diagram of the device structure of the hardware operating environment involved in the adjustment method of the head-mounted display device in the embodiment of the present application.

[0050] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0051] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0052] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0053] In this embodiment, for ease of description, please refer to Figure 1 , Figure 1 FIG. 1 is a schematic diagram of a module configuration of a head-mounted display device according to an embodiment of a method for adjusting a head-mounted display device of the present application. Figure 1As shown, the following is explained with a head-mounted display device internally configured with an optical waveguide module, a light source module, a tracking module and a control module, or a mobile terminal, a data storage control terminal, a PC and other terminals connected to an electronic control unit supporting the head-mounted display device as the execution subject. Among them, the head-mounted display device can specifically be an MR device (such as MR glasses or an MR helmet), an AR device (such as AR glasses or an AR helmet) or a combination thereof.

[0054] It should be noted that the optical waveguide module includes: a lens, a coupling-in area, and a coupling-out area, wherein the coupling-in area and the coupling-out area are configured in the optical waveguide substrate in the lens, and the coupling-in area is used to allow the light emitted by the light source module to be emitted into the waveguide substrate contained in the lens, so as to be transmitted in the lens and coupled out to the wearer's eyes after passing through the coupling-out area. It can be understood that there is at least one coupling-in area and at least one coupling-out area in each lens. In addition, the coupling-in area and the coupling-out area can be diffraction optical elements such as surface relief gratings, volume holographic gratings, metasurfaces, photonic crystals, etc., and can also be geometric optical elements such as partially transparent films, partial reflectors, and turning prisms.

[0055] In addition, the light source module includes a light-emitting panel and a lens assembly, wherein the light-emitting panel is a collection of array-type light-emitting units, or the light-emitting panel can also be a combination of a light-emitting component of a certain area and an array-type micro-electromechanical element. It can be understood that the light-emitting panel is used to emit light of a specific wavelength band, and at the same time, the light-emitting panel can also adjust the light-emitting capacity of the unit level. Similarly, the lens assembly is used to regulate the light emitted by the light-emitting panel so that the light can be refracted into the lens by the coupling area. Among them, the light-emitting panel can specifically be a light-emitting device such as LCOS (Liquid Crystal on Silicon), DLP (Digital Light Processing), Micro-OLED (Micro Organic Light-Emitting Diode) or Micro-LED (Micro Light Emitting Diode), which is not specifically limited in this embodiment.

[0056] In addition, the tracking module is composed of an image sensor, which is used to capture the wearer's eye image to determine the relative spatial position and relative angle information generated between the wearer's line of sight and the optical waveguide module. It can be understood that the number of image sensors is at least 1, and the image sensor can be set on the lens surface, inside or shell of the head-mounted display device. At the same time, the image sensor can specifically be a photoelectric conversion device such as CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), which is not specifically limited in this embodiment.

[0057] In addition, the control module includes: a processor, an input interface, a control interface and a memory, wherein the input interface is used to input the collected relative spatial position and relative angle information into the memory and the processor, the processor generates a light source adjustment parameter based on the relative spatial position and relative angle information, and inputs the light source adjustment parameter to the light source module through the control interface, so that the light source module can adjust the light-emitting panel configured by itself according to the light source adjustment parameter.

[0058] Based on the above-mentioned head-mounted display device, the overall concept of the adjustment method of the head-mounted display device of the present application is proposed here.

[0059] With the continuous development of head-mounted display devices, head-mounted display devices such as AR (Augmented Reality) and MR (Mixed Reality) that can integrate virtual information with the real world have become an indispensable and important device in the daily life of more and more people. In related technologies, in order to meet the viewing needs of the wearer when wearing a head-mounted display device, technicians usually use one-dimensional or two-dimensional pupil expansion technology to change the light propagation path in the optical waveguide architecture, so that the outgoing light can be effectively dispersed to different exit pupil areas to expand the eye movement range, so that the wearer can see the corresponding picture information when the line of sight changes. However, since it is difficult to evenly diffract the light to different exit pupil areas during the propagation process, there will be certain differences in the consistency of the pictures in different exit pupil areas, which greatly reduces the wearer's wearing experience.

[0060] In response to the above phenomenon, the present application provides an adjustment method for a head-mounted display device, which includes: detecting a first line of sight direction of a wearer and determining a first exit pupil area corresponding to the first line of sight direction; playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and obtaining first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; when it is determined that the first actual picture information does not match the first standard picture information, determining a first light source adjustment parameter; and adjusting a light source module of the head-mounted display device according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information.

[0061] In this way, the present application solves the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas. That is, the present application detects the exit pupil area that matches the wearer's line of sight direction, and when it is determined that the actual picture information of the exit pupil area that matches the wearer's line of sight direction does not match the standard picture information of the adjacent exit pupil area, the present application adjusts the light source module configured by itself to make the actual picture information of the exit pupil area that matches the wearer's line of sight direction consistent with the standard picture information of the adjacent exit pupil area before the light source module is adjusted, so that the image seen by the wearer through the exit pupil area that matches the line of sight direction contains complete and accurate picture information.

[0062] Based on the overall concept of the adjustment method of the head-mounted display device of the present application, the embodiment of the present application provides an adjustment method of the head-mounted display device, referring to Figure 2 , Figure 2 This is a flow chart of the first embodiment of the adjustment method of the head mounted display device of the present application.

[0063] In this embodiment, the adjustment method of the head mounted display device includes steps S10 to S40:

[0064] Step S10: detecting a first sight line direction of the wearer, and determining a first exit pupil area corresponding to the first sight line direction;

[0065] It should be noted that the first sight line direction is the direction of the wearer's sight line relative to the optical waveguide module when the wearer wears the head-mounted display device. The first sight line direction is specifically composed of relative spatial position and relative angle information, wherein the relative spatial position and relative angle information are obtained by detecting the position and angle of the sight line direction in the coordinate system constructed based on the optical waveguide module. It can be understood that the coordinate system origin of the coordinate system can be at any position in the optical waveguide module, and this application does not limit this. In addition, the first exit pupil area is the exit pupil area observed by the user when observing the optical waveguide module in the first sight line direction.

[0066] In this embodiment, when the wearer wears the head-mounted display device, the control module in the head-mounted display device first generates a line of sight tracking instruction, and sends the line of sight tracking instruction to the tracking module configured on the head-mounted display device, so as to enable the tracking module to detect the wearer's eyes according to the line of sight tracking instruction, thereby determining the wearer's first line of sight direction. The head-mounted display device then detects the optical waveguide module according to the first line of sight direction to determine a first exit pupil area corresponding to the first line of sight direction in the optical waveguide module.

[0067] Exemplarily, for example, if the head-mounted display device is AR glasses, when the wearer wears the AR glasses for the first time and directs his or her line of sight in a natural state (for example, looking straight ahead or slightly downward), the processor configured in the control module in the AR glasses first generates a line of sight tracking instruction, and sends the line of sight tracking instruction to the tracking module configured on the head-mounted display device, so that the tracking module controls the tracking module configured on the AR glasses shell according to the line of sight tracking instruction, thereby enabling the tracking module to detect the relative spatial position and relative angle information generated between the wearer's line of sight and the optical waveguide module. The tracking module then integrates the relative spatial position and relative angle information to obtain a first line of sight direction, and uploads the acquired first line of sight direction to the processor through the access interface configured in the control module. The processor determines the first exit pupil area viewed by the wearer under the first line of sight based on the relative spatial position and relative angle information contained in the first line of sight direction.

[0068] In this way, the head-mounted display device can detect the wearer's line of sight direction and determine the exit pupil area that matches the line of sight direction.

[0069] In a feasible implementation manner, the step of “detecting the first sight direction of the wearer” in the above step S10 may specifically include steps S101 to S102:

[0070] Step S101: capturing eye image data including the wearer's eyes;

[0071] Step S102: extracting eyeball image features and / or pupil image features of the image data, and determining the first sight direction of the wearer according to the eyeball image features and / or pupil image features.

[0072] In an embodiment, when the wearer wears the head-mounted display device, the control module in the head-mounted display device first generates a line of sight tracking instruction, and sends the line of sight tracking instruction to a tracking module configured on the head-mounted display device. After receiving the line of sight tracking instruction issued by the processor, the tracking module first shoots the wearer according to the line of sight tracking instruction to capture eye image data containing the wearer's eyes. Thereafter, the tracking module extracts eyeball image features and / or pupil image features contained in the eye image data, and determines the wearer's line of sight based on the eyeball image features and / or pupil image features, and the relative spatial position and relative angle information generated between the coordinate system constructed based on the optical waveguide module. The tracking module integrates the relative spatial position and relative angle information to determine the wearer's first line of sight direction.

[0073] For example, see Figure 3 , Figure 3 This is a schematic diagram of line of sight direction detection involved in an embodiment of an adjustment method for a head mounted display device of the present application, such as Figure 3 As shown, when the wearer wears the AR glasses for the first time and makes his or her line of sight in a natural state, the processor configured in the control module in the AR glasses first generates a line of sight tracking instruction, and sends the line of sight tracking instruction to the tracking module configured on the head-mounted display device, so as to make the tracking module shoot the wearer according to the line of sight tracking instruction, thereby capturing eye image data containing the wearer's eyes. After that, the tracking module processes the eye image data to extract the eyeball image features and / or pupil image features contained in the eye image data, and determines the relative spatial position and relative angle information generated between the wearer's line of sight and the origin of the coordinate system in the three-dimensional coordinate system constructed based on the center point of the optical waveguide module based on the eyeball image features and / or pupil image features. The tracking module then integrates the relative spatial position and relative angle information to obtain the wearer's first line of sight direction.

[0074] It should be noted that in this embodiment and another embodiment, after receiving the sight tracking instruction, the tracking module can also only shoot the wearer's eyeball, pupil, eye socket and other areas separately to obtain image data, and extract image features in the image data to determine the wearer's sight direction. It is understandable that this application does not limit the shooting location of the tracking module.

[0075] In this way, the head-mounted display device can detect the wearer's line of sight direction, and then determine the exit pupil area viewed by the wearer under the current line of sight based on the line of sight direction.

[0076] Step S20: playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area matching the first exit pupil area;

[0077] It should be noted that the picture information is information parameters including a color consistency index that characterizes color consistency and a brightness consistency index that characterizes brightness consistency. It can be understood that the uniformity of the field of view of the exit pupil area can be indicated by each picture information, that is, by judging whether the picture information of the first exit pupil area that matches the line of sight direction matches the picture information of other exit pupil areas, it is possible to judge whether the image information seen by the wearer through the first exit pupil area is complete and accurate.

[0078] In this embodiment, after determining the corresponding first exit pupil area according to the first line of sight direction, the processor controls the light source module to display a standard image on the first exit pupil area, and detects the standard image to determine the first actual picture information corresponding to the standard image in the first exit pupil area. At the same time, the processor determines the first adjacent exit pupil area that matches the first exit pupil area, and determines the first standard picture information corresponding to the first adjacent exit pupil area.

[0079] Exemplarily, for example, after the processor determines the first exit pupil area seen by the wearer according to the first line of sight direction, the processor first controls the light source module to emit a color waveguide, thereby cyclically displaying a pure color image and a white image on the first exit pupil area. The processor detects the first exit pupil area to determine the first actual picture information corresponding to the first exit pupil area through the pure color image and the white image played in the first exit pupil area. At the same time, the processor reads the memory configured in the control module to obtain the preset standard picture information written in the memory, and filters out the first standard picture information corresponding to the first adjacent exit pupil area adjacent to the first exit pupil area from the preset standard picture information.

[0080] In this way, the head-mounted display device can identify the first actual picture information of the first exit pupil area, and query the first standard picture information of the adjacent exit pupil area adjacent to the first exit pupil area that contains complete and accurate picture information.

[0081] In a feasible implementation manner, the step of "obtaining first standard picture information of a first adjacent exit pupil area matching the first exit pupil area" in the above step S20 may specifically include steps S201 to S203:

[0082] Step S201: determining a plurality of preset discrete exit pupil areas and preset standard picture information corresponding to each of the plurality of discrete exit pupil areas;

[0083] Step S202: screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area;

[0084] Step S203: determining the preset standard picture information corresponding to the first adjacent exit pupil area as the first standard picture information matching the first exit pupil area.

[0085] It should be noted that the discrete exit pupil area is a plurality of unconnected exit pupil areas contained in the optical waveguide module. At the same time, each discrete exit pupil area has a matching preset standard screen information that allows the user to see the complete image. In addition, each discrete exit pupil area and each matching preset standard screen information are stored in the above-mentioned memory, so that the processor can directly read the memory to obtain it when it needs to query. It can be understood that each discrete exit pupil area and each preset standard screen information can be obtained by the technician by testing the standard measuring equipment before the head-mounted display device leaves the factory. There are many ways to test the preset standard screen information corresponding to the discrete exit pupil area, and this application does not limit this.

[0086] In this embodiment, after the processor controls the light source module to display a standard image on the first exit pupil area, it can also first read the memory configured in the control module to obtain multiple preset discrete exit pupil areas stored in the memory, and preset standard picture information corresponding to each of the multiple discrete exit pupil areas. Afterwards, the processor screens the multiple discrete exit pupil areas based on the first exit pupil area to determine a first adjacent exit pupil area adjacent to the first exit pupil area. Finally, the processor determines the preset standard picture information corresponding to the first adjacent exit pupil area as the first standard picture information that matches the first exit pupil area.

[0087] Exemplarily, for example, after the processor cyclically displays the pure color image and the white image through the above-mentioned first exit pupil area, it can also first read the above-mentioned memory to obtain multiple discrete exit pupil areas pre-stored in the memory by the technician, and preset standard picture information consisting of color consistency indicators and brightness consistency indicators corresponding to each of the multiple discrete exit pupil areas. After that, the processor screens the multiple discrete exit pupil areas based on the first exit pupil area to determine the first adjacent exit pupil area closest to the first exit pupil area. Finally, the processor determines the preset standard picture information corresponding to the first adjacent exit pupil area, and determines the preset standard picture information corresponding to the first adjacent exit pupil area as the first standard picture information used to judge whether the picture consistency of the first exit pupil area matching the wearer's line of sight matches the picture consistency of the first adjacent exit pupil area.

[0088] In this way, the head-mounted display device can query the first standard picture information of the adjacent exit pupil area adjacent to the first exit pupil area that contains complete and accurate picture information, and then determine whether the image seen by the wearer through the exit pupil area matching the line of sight direction contains complete and accurate picture information based on the picture information of the exit pupil area matching the wearer's line of sight and the picture information corresponding to the adjacent exit pupil area.

[0089] In a feasible implementation manner, the above step S202 may specifically include steps S2021 to S2022:

[0090] Step S2021: determining a first distance parameter generated between each of the plurality of discrete exit pupil areas and the first exit pupil area;

[0091] Step S2022: determining a target first distance parameter having the smallest value among the first distance parameters, and determining a discrete exit pupil area corresponding to the target first distance parameter as a first adjacent exit pupil area.

[0092] In this embodiment, after determining multiple preset discrete exit pupil areas, the processor may also first determine the first distance parameters generated between each of the multiple discrete exit pupil areas and the first exit pupil area. Thereafter, the processor determines the target first distance parameter with the smallest value among the multiple first distance parameters, and determines the discrete exit pupil area corresponding to the target first distance parameter as the adjacent exit pupil area corresponding to the first exit pupil area.

[0093] Exemplarily, for example, after reading the memory to obtain multiple discrete exit pupil areas, the processor first calculates the center points of each of the multiple discrete exit pupil areas and the first distance parameters generated between each of the center points of the first exit pupil area. Then, the processor screens the first distance parameters to determine the target first distance parameter with the smallest value. The processor determines the discrete exit pupil area corresponding to the target first distance parameter as the first adjacent exit pupil area closest to the first exit pupil area.

[0094] It should be noted that after the processor determines the target first distance parameter, if it detects that the number of target first distance parameters is greater than 1, it can randomly select a discrete exit pupil area from the discrete exit pupil areas corresponding to each target first distance parameter as the first adjacent exit pupil area adjacent to the first exit pupil area.

[0095] In this way, the head-mounted display device can query the first standard picture information of the adjacent exit pupil area adjacent to the first exit pupil area that contains complete and accurate picture information, and then determine whether the image seen by the wearer through the exit pupil area matching the line of sight direction contains complete and accurate picture information based on the picture information of the exit pupil area matching the wearer's line of sight and the picture information corresponding to the adjacent exit pupil area.

[0096] Step S30: determining a first light source adjustment parameter when it is determined that the first actual picture information does not match the first standard picture information;

[0097] In this embodiment, after acquiring the first standard picture information, the processor can also compare the first actual picture information with the first standard picture information, so as to determine the first light source adjustment parameter for adjusting the light source module when it is determined that the first actual picture information does not match the first standard picture information.

[0098] In a feasible implementation manner, the step of “determining the adjustment parameters of the first light source” in the above step S30 may specifically include steps S301 to S302:

[0099] Step S301: reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0100] Step S302: determining a performance indicator difference between the first picture performance indicator and the second picture performance indicator, and determining a first light source adjustment parameter according to the performance indicator difference.

[0101] In this embodiment, when the processor determines that the first actual picture information does not match the first standard picture information, the processor first reads the first picture performance indicator contained in the first actual picture information, and reads the second picture performance indicator contained in the first standard picture information. Thereafter, the processor compares the first picture performance indicator with the second picture performance indicator to determine the performance indicator difference between the first picture performance indicator and the second picture performance indicator. The processor then determines the first light source adjustment parameter based on the performance indicator difference.

[0102] Exemplarily, for example, when the processor determines that the first actual picture information does not match the first standard picture information, the processor first reads the first color consistency index characterizing color consistency contained in the first actual picture information, and reads the second color consistency index characterizing color consistency contained in the first standard picture information, and performs a difference calculation on the first color consistency index and the second color consistency index to obtain a first calculation result. At the same time, the processor reads the first brightness consistency index characterizing brightness consistency contained in the first actual picture information, and reads the second brightness consistency index characterizing brightness consistency contained in the first standard picture information, and performs a difference calculation on the first brightness consistency index and the second brightness consistency index to obtain a second calculation result. The processor thereby determines a brightness consistency index difference parameter based on the first calculation result, and determines a color consistency index difference parameter based on the second calculation result. The processor further determines a first light source adjustment parameter for adjusting the light source module based on the brightness consistency index difference parameter and the color consistency index difference parameter.

[0103] In this way, the head-mounted display device can determine the light source adjustment parameters in a timely manner when the picture information of the exit pupil area that matches the line of sight direction does not match the picture information of the adjacent exit pupil area.

[0104] In a feasible implementation manner, the step of “determining the adjustment parameters of the first light source” in the above step S30 may further include steps S303 to S306:

[0105] Step S303: reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information;

[0106] Step S304: determining each pixel point to be screened contained in the first exit pupil area based on the first picture performance index and the second picture performance index;

[0107] Step S305: receiving the pixel selection result triggered by the wearer, and determining abnormal pixels among the pixels to be screened according to the pixel selection result;

[0108] Step S306: determining a first abnormal picture performance index corresponding to the abnormal pixel in the first picture performance index, and determining a first light source adjustment parameter according to the first abnormal picture performance index.

[0109] It should be noted that the pixels to be screened are pixels in the first exit pupil area where the image information is incomplete (i.e., the color consistency and brightness consistency of the pixels to be screened do not reach the color consistency and brightness consistency of the corresponding standard pixels in the first adjacent exit pupil area). In addition, the pixel selection result is the pixel to be screened selected by the wearer and needs to be adjusted in brightness and color.

[0110] In this embodiment, when the processor determines that the first actual picture information does not match the first standard picture information, it can also first read the first picture performance index contained in the first actual picture information and read the second picture performance index contained in the first standard picture information. After that, the processor screens each pixel contained in the first exit pupil area based on the first picture performance index and the second picture performance index to determine the pixel points to be screened whose first picture performance index is inconsistent with the second picture performance index. After that, when the processor detects that its own light source adjustment mode is the manual mode, the processor generates an adjustment option based on each pixel point to be screened, and receives the pixel point selection result generated when the user triggers the adjustment option. The processor determines each abnormal pixel point that matches the pixel point selection result among the pixel points to be screened. Finally, the processor determines the first picture performance index corresponding to each abnormal pixel point as the first abnormal picture performance index, and determines the second picture performance index corresponding to each first abnormal picture performance index in the first adjacent exit pupil area. The processor calculates each first abnormal picture performance index and the second picture performance index corresponding to each first abnormal picture performance index to determine the first light source adjustment parameter.

[0111] For example, see Figure 4 , Figure 4This is a schematic diagram of a pixel selection interface involved in an embodiment of an adjustment method for a head-mounted display device of the present application. When the processor determines that the first actual picture information does not match the first standard picture information, it can also first read the first picture performance indicators contained in the first actual picture information, and read the second picture performance indicators contained in the first standard picture information. After that, the processor filters the pixels contained in the first exit pupil area according to the first picture performance indicator and the second picture performance indicator to filter out the pixels to be filtered whose first color consistency indicator does not reach the second color consistency indicator, and / or, filter out the pixels to be filtered whose first brightness consistency indicator does not reach the second brightness consistency indicator. After that, the processor detects the adjustment mode of the AR glasses, and when it detects that the AR glasses are in manual adjustment mode, generates the following based on the pixels to be filtered. Figure 4 The pixel selection interface shown in the figure, the processor displays the pixel selection interface to the outside through the lens in the optical waveguide module. At this time, the wearer views the pixel selection interface, and when it is determined that adjustment is required, selects at least one pixel to be screened in the pixel selection interface to generate a pixel selection result. The processor receives the pixel selection result, and determines the abnormal pixel that meets the pixel selection result among the multiple pixels to be screened. Finally, the processor determines the first brightness consistency index / first color consistency index corresponding to the abnormal pixel as the first abnormal picture performance index, and determines the performance index difference between the first abnormal picture performance index and the second brightness consistency index / second color consistency index corresponding to the pixel that matches itself in the first adjacent exit pupil area. The processor then determines the first light source adjustment parameter for adjusting the light source module according to the performance index difference.

[0112] It should be noted that, in this embodiment and another embodiment, when the processor detects that the AR glasses are in automatic adjustment mode, it automatically calculates the first image performance index corresponding to each pixel to be screened and the performance index difference between the second image performance index corresponding to each first adjacent exit pupil area, and the processor then determines the first light source adjustment parameter for adjusting the light source module based on the performance index difference.

[0113] In this way, the head-mounted display device can determine that the picture information of the exit pupil area that matches the wearer's line of sight does not match the picture information of the adjacent exit pupil area that can display complete and accurate picture information. It can filter out each pixel point for adjustment and display each pixel point to the wearer so that the wearer can choose the pixel point to be adjusted by himself, thereby making the obtained light source adjustment parameters more in line with the wearer's needs, further improving the wearer's wearing experience.

[0114] In a feasible implementation manner, the step of “determining the adjustment parameters of the first light source” in the above step S30 may further include steps S307 to S308:

[0115] Step S307: determining a plurality of preset sight lines and preset light source adjustment parameters that match the plurality of preset sight lines respectively;

[0116] Step S308: screening the plurality of preset sight lines based on the first sight line direction to determine a target sight line direction matching the first sight line direction;

[0117] Step S309: determining the preset light source adjustment parameter that matches the target sight line direction as the first light source adjustment parameter.

[0118] In this embodiment, when the processor determines that the first actual picture information does not match the first standard picture information, it can also first read the above-mentioned memory to obtain multiple preset line of sight directions and preset light source adjustment parameters that match each of the multiple preset line of sight directions. After that, the processor compares the first line of sight direction with the multiple preset line of sight directions respectively to determine a target line of sight direction that is consistent with the first line of sight direction. Finally, the processor determines the preset light source adjustment parameters that match the target line of sight direction as the first light source adjustment parameters.

[0119] Exemplarily, for example, when the processor determines that the first actual picture information of the first exit pupil area does not match the first standard picture information corresponding to the first adjacent exit pupil area, the processor may first read the above-mentioned memory to obtain a parameter mapping table containing multiple preset line of sight directions and preset light source adjustment parameters that match each of the multiple preset line of sight directions. Afterwards, the processor queries the parameter mapping table based on the first line of sight direction, and compares the first line of sight direction with the multiple preset line of sight directions contained in the parameter mapping table, thereby determining the target line of sight direction that matches the first line of sight direction among the multiple preset line of sight directions based on the comparison result. Finally, the processor determines the preset light source adjustment parameters that match the target line of sight direction in the parameter mapping table as the first light source adjustment parameters.

[0120] In this way, the head mounted display device can more quickly determine the light source adjustment parameters that match the sight direction by querying the mapping table, and then adjust the light emitting panel of the light source module according to the light source adjustment parameters.

[0121] Step S40: adjusting the light source module of the head mounted display device according to the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area after adjustment is consistent with the first standard picture information.

[0122] It should be noted that the light source adjustment parameters are parameters used to adjust parameters such as the brightness and RGB channel brightness of each pixel displayed on the exit pupil area (for example, when the light source module emits a monochrome waveguide, the pixel-level brightness of each pixel on the exit pupil area can be adjusted based on the light source adjustment parameters. Similarly, when the light source module emits a color waveguide, the RGB channel brightness of each pixel can be adjusted based on the light source adjustment parameters). It can be understood that through the light source adjustment parameters, when a standard image is displayed on the first exit pupil area, the brightness and RGB channel brightness of each pixel of the standard image in the first exit pupil area are matched with the brightness and RGB channel brightness of each pixel of the standard image in the first adjacent exit pupil area, so that the picture consistency of the first exit pupil area matching the wearer's line of sight is consistent with the picture consistency of the first adjacent exit pupil area before the light source module is adjusted.

[0123] In this embodiment, after determining the first light source adjustment parameter, the processor sends the first light source adjustment parameter to the light source module through the control interface configured in the control module, so that the light source module can adjust the light-emitting panel configured by itself based on the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area corresponding to the line of sight direction is consistent with the first standard picture information of the first adjacent exit pupil area before the light-emitting panel is adjusted, so that the image seen by the wearer through the first exit pupil area contains complete and accurate picture information.

[0124] Exemplarily, for example, after determining the first light source adjustment parameter, the processor sends the first light source adjustment parameter to the light-emitting panel in the light source module through the control interface configured in the above-mentioned control module, and the light-emitting panel adjusts each light-emitting unit configured by itself according to the first light source adjustment parameter, so that the first actual picture information contained in the image presented in the first exit pupil area by the light emitted by the adjusted light-emitting panel is consistent with the first standard picture information contained in the image presented in the first adjacent exit pupil area before the adjustment of the light-emitting panel, so that the image seen by the wearer through the first exit pupil area contains complete and accurate picture information.

[0125] In this embodiment, when the wearer wears the head-mounted display device, the control module in the head-mounted display device first generates a line of sight tracking instruction, and sends the line of sight tracking instruction to the tracking module configured on the head-mounted display device, so as to enable the tracking module to detect the wearer's eyes according to the line of sight tracking instruction, thereby determining the wearer's first line of sight direction. The head-mounted display device then detects the optical waveguide module according to the first line of sight direction to determine a first exit pupil area corresponding to the first line of sight direction in the optical waveguide module. Thereafter, the processor controls the light source module to display a standard image on the first exit pupil area, and detects the standard image to determine first actual picture information corresponding to the standard image in the first exit pupil area. At the same time, the processor determines a first adjacent exit pupil area that matches the first exit pupil area, and Determine the first standard picture information corresponding to the first adjacent exit pupil area, and then, the processor compares the first actual picture information with the first standard picture information, so as to determine the first light source adjustment parameter for adjusting the light source module when it is determined that the first actual picture information does not match the first standard picture information. Finally, the processor sends the first light source adjustment parameter to the light source module through the control interface configured in the control module, so that the light source module can adjust the light-emitting panel configured by itself based on the first light source adjustment parameter, so that the first actual picture information of the first exit pupil area corresponding to the line of sight direction is consistent with the first standard picture information of the first adjacent exit pupil area before the light-emitting panel is adjusted, so that the image seen by the wearer through the first exit pupil area contains complete and accurate picture information.

[0126] In this way, the present application solves the technical problem in the related art that there are certain differences in the image consistency of different exit pupil areas. That is, the present application detects the exit pupil area that matches the wearer's line of sight direction, and when it is determined that the actual picture information of the exit pupil area that matches the wearer's line of sight direction does not match the standard picture information of the adjacent exit pupil area, the present application adjusts the light source module configured by itself to make the actual picture information of the exit pupil area that matches the wearer's line of sight direction consistent with the standard picture information of the adjacent exit pupil area before the light source module is adjusted, so that the image seen by the wearer through the exit pupil area that matches the line of sight direction contains complete and accurate picture information.

[0127] Based on the first embodiment of the present application, a second embodiment of the present application is proposed. In the second embodiment of the present application, the same or similar contents as those of the above embodiments can be referred to the above description and will not be repeated later. On this basis, after the above step S40, the adjustment method of the head mounted display device of the present application can also include steps A10 to A30:

[0128] Step A10: When it is detected that the wearer's line of sight direction changes, detecting a second line of sight direction of the wearer;

[0129] Step A20: determining a second exit pupil area corresponding to the second sight line direction, and determining a second light source adjustment parameter when second actual picture information of the second exit pupil area does not match second standard picture information of a matching second adjacent exit pupil area;

[0130] Step A30: adjusting the light source module according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information.

[0131] It should be noted that the second sight line direction is the sight line direction of the wearer after the wearer's sight line moves away from the first sight line direction. In addition, the second exit pupil area is the exit pupil area observed when the wearer's sight line is in the second sight line direction.

[0132] In the present embodiment, after the light source module is adjusted according to the above-mentioned first light source adjustment parameters, the processor may continue to call the above-mentioned tracking module to detect the wearer. When the tracking module detects that the wearer's line of sight has changed, the tracking module further detects the wearer's second line of sight direction. Thereafter, the tracking module sends the second line of sight direction to the processor, and the processor calculates the second exit pupil area currently being viewed by the wearer based on the second line of sight direction. The processor reads the above-mentioned memory to determine a second adjacent exit pupil area that matches the second exit pupil area. The processor then determines, based on the second exit pupil area and the second adjacent exit pupil area, whether the second actual picture information of the second exit pupil area matches the second standard picture information of the second adjacent exit pupil area. The processor then processes When determining that the second actual picture information does not match the second standard picture information, the processor determines, in the second exit pupil area, each abnormal pixel point where the second actual picture information does not reach the second standard picture information based on the second actual picture information and the second standard picture information, and the processor further determines the performance indicator difference corresponding to each abnormal pixel point, and the processor further determines the second light source adjustment parameter based on each performance indicator difference. Finally, the processor sends the second light source adjustment parameter to the light source module, and the light source module adjusts the light-emitting panel configured by itself according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information of the second adjacent exit pupil area before the light-emitting panel is adjusted.

[0133] Exemplarily, for example, after the light source module adjusts the light-emitting panel according to the above-mentioned first light source adjustment parameter, the processor may also send a sight line detection instruction to the tracking module. After receiving the dynamic tracking instruction, the tracking module detects the wearer's eyes, so that when it is detected that the wearer's sight line direction deviates from the above-mentioned first sight line direction, the wearer's face is photographed to obtain second image data, and the wearer's second sight line direction is determined according to the second image data. After that, the tracking module inputs the second sight line direction to the processor through the access interface, and the processor calculates the second exit pupil area where the exit pupil seen by the wearer is located in the optical waveguide module according to the second sight line direction. The processor reads the memory to obtain the above-mentioned discrete exit pupil areas, and the processor further calculates the second distance parameter generated between each discrete exit pupil area and the second exit pupil area, and determines the second adjacent exit pupil area closest to the second exit pupil area in each discrete exit pupil area according to each second distance parameter. The processor reads the second standard picture information corresponding to the second adjacent exit pupil area in the above-mentioned memory. At the same time, the processor controls the light source module to play the color waveguide, so that the pure color image and the white image are cyclically presented on the second exit pupil area. The processor then detects the second exit pupil area to determine the second actual picture information in the second exit pupil area. The processor then compares the second actual picture information with the second standard picture information. When the comparison shows that the second actual picture information does not reach the second standard picture information, it is determined that there is a deviation in the picture information in the image seen by the wearer through the second exit pupil area. The processor then performs a difference calculation on the third color consistency index representing color consistency contained in the second actual picture information and the fourth color consistency index representing color consistency contained in the second standard picture information to obtain a third calculation result. At the same time, the processor performs a difference calculation on the third brightness consistency index representing brightness consistency contained in the second actual picture information and the fourth brightness consistency index representing brightness consistency contained in the second standard picture information to obtain a fourth calculation result. The processor determines a brightness consistency index difference parameter based on the third calculation result and determines a color consistency index difference parameter based on the fourth calculation result. The processor then determines a second light source adjustment parameter for adjusting the light source module based on the brightness consistency index difference parameter and the color consistency index difference parameter.

[0134] In this way, the head-mounted display device can detect changes in the wearer's line of sight, and when the wearer's line of sight changes, promptly determine the second exit pupil area seen by the wearer after the line of sight changes, and when it is detected that the picture information of the second exit pupil area does not match the picture information of the second adjacent exit pupil area, adjust the light source module so that after the wearer moves his line of sight, the image that can be seen in the second exit pupil area with matching line of sight has complete and accurate picture information.

[0135] The present application provides a head-mounted display device, which includes: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the adjustment method of the head-mounted display device in the above-mentioned embodiment 1.

[0136] Reference below Figure 5 , which shows a schematic diagram of the structure of a head-mounted display device suitable for implementing the embodiment of the present application. The head-mounted display device in the embodiment of the present application may include but is not limited to a head-mounted display device composed of an optical waveguide module, a light source module, a tracking module and a control module, or a mobile terminal, a data storage control terminal, a PC and other terminals connected to an electronic control unit supporting the head-mounted display device. Figure 5 The head mounted display device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0137] like Figure 5 As shown, the head mounted display device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the head mounted display device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the head mounted display device to communicate with other devices wirelessly or wired to exchange data. Although the figure shows a head mounted display device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0138] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0139] The head-mounted display device provided by the present application adopts the adjustment method of the head-mounted display device in the above embodiment, which can solve the technical problem that there are certain differences in the consistency of the images in different exit pupil areas in the related art. Compared with the prior art, the beneficial effects of the head-mounted display device provided by the present application are the same as the beneficial effects of the adjustment method of the head-mounted display device provided by the above embodiment, and the other technical features in the head-mounted display device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0140] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0141] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0142] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the adjustment method of the head-mounted display device in the above-mentioned embodiment.

[0143] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0144] The computer-readable storage medium may be included in the head-mounted display device; or may exist independently without being assembled into the head-mounted display device.

[0145] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the head-mounted display device, the head-mounted display device: detects a first sight line direction of the wearer and determines a first exit pupil area corresponding to the first sight line direction; plays a standard image, detects first actual picture information of the standard image in the first exit pupil area, and obtains first standard picture information of a first adjacent exit pupil area that matches the first exit pupil area; when it is determined that the first actual picture information does not match the first standard picture information, determines a first light source adjustment parameter; and adjusts the light source module of the head-mounted display device according to the first light source adjustment parameter so that the adjusted first actual picture information of the first exit pupil area is consistent with the first standard picture information.

[0146] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0147] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0148] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0149] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the adjustment method of the head-mounted display device described above, and can solve the technical problem that there are certain differences in the consistency of images in different exit pupil areas in the related art. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the adjustment method of the head-mounted display device provided by the above embodiment, and will not be repeated here.

[0150] The present application also provides a computer program product, including a computer program, which implements the steps of the adjustment method of the head-mounted display device as described above when the computer program is executed by a processor.

[0151] The computer program product provided by the present application can solve the technical problem that the image consistency of different exit pupil areas in the related art is different. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the adjustment method of the head-mounted display device provided by the above embodiment, which will not be repeated here.

[0152] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A method for adjusting a head mounted display device, characterized in that: The adjustment method of the head mounted display device comprises: Detecting a first sight line direction of the wearer, and determining a first exit pupil area corresponding to the first sight line direction; Playing a standard image, detecting first actual picture information of the standard image in the first exit pupil area, and acquiring first standard picture information of a first adjacent exit pupil area matching the first exit pupil area; When it is determined that the first actual picture information does not match the first standard picture information, determining a first light source adjustment parameter; The light source module of the head mounted display device is adjusted according to the first light source adjustment parameter so that the first actual picture information of the adjusted first exit pupil area is consistent with the first standard picture information.

2. The method for adjusting a head mounted display device according to claim 1, wherein: The step of determining the adjustment parameters of the first light source includes: Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information; Determining each pixel point to be screened included in the first exit pupil area based on the first picture performance index and the second picture performance index; Receiving the pixel selection result triggered by the wearer, and determining abnormal pixels among the pixels to be screened according to the pixel selection result; A first abnormal picture performance index corresponding to the abnormal pixel in the first picture performance index is determined, and a first light source adjustment parameter is determined according to the first abnormal picture performance index.

3. The method for adjusting a head mounted display device according to claim 1, wherein: The step of determining the adjustment parameters of the first light source further includes: Determining a plurality of preset sight lines and preset light source adjustment parameters that match each of the plurality of preset sight lines; Screening the plurality of preset sight lines based on the first sight line direction to determine a target sight line direction that matches the first sight line direction; The preset light source adjustment parameter that matches the target sight line direction is determined as the first light source adjustment parameter.

4. The method for adjusting a head mounted display device according to claim 1, wherein: The step of determining the adjustment parameters of the first light source further includes: Reading a first picture performance index included in the first actual picture information, and reading a second picture performance index included in the first standard picture information; A performance indicator difference between the first picture performance indicator and the second picture performance indicator is determined, and a first light source adjustment parameter is determined according to the performance indicator difference.

5. The method for adjusting a head mounted display device according to claim 1, wherein: The step of acquiring first standard picture information of a first adjacent exit pupil area matching the first exit pupil area comprises: Determine a plurality of preset discrete exit pupil areas and preset standard picture information corresponding to each of the plurality of discrete exit pupil areas; Screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area; The preset standard picture information corresponding to the first adjacent exit pupil area is determined as the first standard picture information matching the first exit pupil area.

6. The method for adjusting a head mounted display device according to claim 5, wherein: The step of screening the plurality of discrete exit pupil areas to determine a first adjacent exit pupil area corresponding to the first exit pupil area comprises: Determine a first distance parameter generated between each of the plurality of discrete exit pupil areas and the first exit pupil area; A target first distance parameter having the smallest value is determined among the first distance parameters, and a discrete exit pupil area corresponding to the target first distance parameter is determined as a first adjacent exit pupil area.

7. The method for adjusting a head mounted display device according to any one of claims 1 to 6, characterized in that: After the step of adjusting the light source module of the head mounted display device according to the first light source adjustment parameter, the method further includes: When a change in the line of sight of the wearer is detected, detecting a second line of sight of the wearer; Determine a second exit pupil area corresponding to the second sight line direction, and determine a second light source adjustment parameter when second actual picture information of the second exit pupil area does not match second standard picture information of a matching second adjacent exit pupil area; The light source module is adjusted according to the second light source adjustment parameter, so that the second actual picture information of the second exit pupil area after adjustment is consistent with the second standard picture information.

8. The method for adjusting a head mounted display device according to claim 1, wherein: The step of detecting the wearer's first sight direction comprises: capturing eye image data including the wearer's eyes; Eyeball image features and / or pupil image features of the image data are extracted, and a first sight line direction of the wearer is determined according to the eyeball image features and / or pupil image features.

9. A head mounted display device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the method for adjusting the head mounted display device according to any one of claims 1 to 8.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the method for adjusting the head-mounted display device according to any one of claims 1 to 8 are implemented.

11. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the method for adjusting the head mounted display device according to any one of claims 1 to 8 are implemented.

Images