Brightness adjusting method and device, equipment and medium

Abstract

The embodiment of the invention discloses a brightness adjusting method and device, equipment and a medium, and the method comprises the steps: obtaining the current pupil diameter of a user under the condition that the user wears head-mounted display equipment; according to preset first mapping data, obtaining a parameter value of a brightness adjustment parameter corresponding to the current pupil diameter as a target value of the brightness adjustment parameter; wherein the first mapping data is data reflecting the corresponding relation between the parameter value of the brightness adjusting parameter and the pupil diameter; and adjusting the screen brightness of the head-mounted display device according to the target value of the brightness adjustment parameter.

Description

Technical Field

[0001] This disclosure relates to the field of brightness adjustment technology, and more specifically, to a brightness adjustment method, apparatus, device, and medium. Background Technology

[0002] In the field of augmented reality (AR) devices, such as AR glasses, display brightness needs to automatically adjust according to changes in ambient light to ensure clear vision and comfort for the wearer. One related technology is to detect ambient light intensity using an ambient light sensor and adjust the screen brightness accordingly. However, this approach requires an additional ambient light sensor and often does not consider the wearer's experience, failing to meet personalized brightness adjustment needs. Summary of the Invention

[0003] The purpose of this disclosure is to provide a new technical solution for brightness adjustment.

[0004] According to a first aspect of the present disclosure, a brightness adjustment method is provided, applied to a head-mounted display device, the method comprising: While the user is wearing the head-mounted display device, the user's current pupil diameter is obtained; Based on the preset first mapping data, the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter is obtained as the target value of the brightness adjustment parameter; wherein, the first mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter; The screen brightness of the head-mounted display device is adjusted according to the target value of the brightness adjustment parameter. Optionally, obtaining the user's current pupil diameter while the user is wearing the head-mounted display device includes: When a user is wearing the head-mounted display device, the user's eyes are illuminated by an infrared light installed on the head-mounted display device, and the user's current eye image is captured by an infrared camera installed on the head-mounted display device; Identify the pupil region in the current eye image; Determine the current pupil diameter of the pupil region. Optionally, the method further includes the step of obtaining the first mapping data. The step of obtaining the first mapping data includes: With different test subjects wearing the head-mounted display device in a set dark light stimulation environment, the display area of ​​the head-mounted display device is controlled to display a set test screen; For any of the test subjects, when the set test screen is displayed in the display area, the value of the brightness adjustment parameter is adjusted from low to high within a preset range, and the pupil diameter of the test subject is obtained and recorded under each parameter value. Based on each parameter value within the preset range and its corresponding pupil diameter of the test subject, second mapping data of the test subject is obtained; wherein, the second mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter of the test subject; The first mapping data is obtained based on the second mapping data corresponding to each of the different testers. Optionally, the method further includes: Eye-tracking detection is performed on the user at set time intervals to obtain the user's gaze direction information; The user's gaze area is determined based on the gaze direction information; If the gaze area is a real-world area, then the step of obtaining the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter based on the preset first mapping data is performed. Optionally, the method further includes the step of updating the first mapping data. Updating the first mapping data includes: Traverse the first mapping data and sort the adjacent two groups of mapping relationships according to the parameter values ​​of the brightness adjustment parameter. If the difference between the pupil diameters corresponding to the parameter values ​​in the two adjacent groups of mapping relationships is less than a set value, merge the two adjacent groups of mapping relationships into a target mapping relationship. Wherein, the value of the brightness adjustment parameter in the target mapping relationship is the average value of the brightness adjustment parameter in two adjacent mapping relationships, and the pupil diameter corresponding to the value of the brightness adjustment parameter in the target mapping relationship is the average pupil diameter in two adjacent mapping relationships.

[0005] Optionally, the method further includes updating the first mapping data. Updating the first mapping data includes: If the current pupil diameter is greater than the maximum pupil diameter in the first mapping data, the maximum pupil diameter is updated to the current pupil diameter; or, If the current pupil diameter measured within a first preset number of consecutive measurements is less than or equal to the maximum pupil diameter, the maximum pupil diameter is updated to the maximum value measured within the first preset number of consecutive measurements; or... If the current pupil diameter is less than the minimum pupil diameter in the first mapping data, the minimum pupil diameter is updated to the current pupil diameter; or, If the current pupil diameter measured within a second consecutive preset number of times is greater than or equal to the minimum pupil diameter, the minimum pupil diameter is updated to the minimum value measured within the second consecutive preset number of times.

[0006] Optionally, the method further includes: Obtain the first difference between the maximum pupil diameter and the minimum pupil diameter in the first mapping data before it was updated; Obtain the second difference between the maximum pupil diameter and the minimum pupil diameter in the updated first mapping data; If the difference between the first difference and the second difference meets the set conditions, the pupil diameter adjustment coefficient is determined based on the first difference and the second difference; The pupil diameter in each group of mapping relationships in the updated first mapping data is adjusted according to the pupil diameter adjustment coefficient. According to a second aspect of the present disclosure, a brightness adjustment device is provided, applied to a head-mounted display device, the device comprising: The first acquisition module is used to acquire the user's current pupil diameter when the user is wearing the head-mounted display device; The second acquisition module is used to obtain the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter according to the preset first mapping data, and use it as the target value of the brightness adjustment parameter; wherein, the first mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter; An adjustment module is used to adjust the screen brightness of the head-mounted display device according to the target value of the brightness adjustment parameter. According to a third aspect of the present disclosure, a head-mounted display device is provided, comprising: a memory for storing executable computer instructions; and a processor for executing the method described in accordance with the first aspect above, under the control of the executable computer instructions.

[0007] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided that stores computer instructions thereon, which, when executed by a processor, perform the method described in the first aspect above.

[0008] One beneficial effect of this disclosure is that the wearer's current pupil diameter can reflect changes in ambient light. The head-mounted display device can obtain the wearer's current pupil diameter and search for a parameter value that matches the current pupil diameter from a preset mapping data that reflects the correspondence between the brightness adjustment parameter value and the pupil diameter, thereby obtaining the target value of the brightness adjustment parameter. Then, the screen brightness of the head-mounted display device is adjusted according to the target value of the brightness adjustment parameter, thus realizing personalized brightness adjustment.

[0009] Other features and advantages of this specification will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0010] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of this specification and, together with their description, serve to explain the principles of this specification.

[0011] Figure 1 This is a schematic diagram of the hardware configuration of the head-mounted display device provided in an embodiment of this disclosure; Figure 2 This is a schematic flowchart of the brightness adjustment method provided in the embodiments of this disclosure; Figure 3 This is a block diagram of the brightness adjustment device provided in the embodiments of this disclosure; Figure 4 This is a block diagram of a head-mounted display device provided in an embodiment of this disclosure. Detailed Implementation

[0012] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the embodiments of the present disclosure.

[0013] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use.

[0014] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0015] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0016] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0017] <Hardware Configuration> Figure 1 This is a block diagram of the hardware configuration of a head-mounted display device 1000 according to an embodiment of the present disclosure. The head-mounted display device may be smart glasses, such as AR glasses or MR glasses.

[0018] In one embodiment, such as Figure 1 As shown, the head-mounted display device 1000 may include a processor 1100, a memory 1200, a communication device 1300, a display device 1400, an input device 1500, a speaker 1600, a microphone 1700, an eye-tracking device 1800, etc.

[0019] The processor 1100 may include, but is not limited to, a central processing unit (CPU) or a microprocessor (MCU). The memory 1200 may include, for example, ROM (Read-Only Memory), RAM (Random Access Memory), or non-volatile memory such as a hard disk. The communication device 1300 may be capable of wired or wireless communication. The display device 1400 may be, for example, a liquid crystal display (LCD), an LED display, or a touchscreen. The input device 1500 may include, for example, a touchscreen, a keyboard, or a gamepad. The head-mounted display device 1000 may output audio information via a speaker 1600 and acquire audio information via a microphone 1700. The eye-tracking device 1800 may include an infrared lamp and an infrared camera; when the infrared lamp illuminates the wearer's eyes, the infrared camera can acquire the wearer's current eye image.

[0020] Those skilled in the art should understand that, although in Figure 1 The present specification shows a number of devices for a head-mounted display device 1000. However, the head-mounted display device 1000 of the embodiments described herein may involve only some of the devices, or may include other devices, which is not limited herein.

[0021] In this embodiment, the memory 1200 of the head-mounted display device 1000 is used to store instructions for controlling the processor 1100 to operate in order to implement or support the implementation of a brightness adjustment method according to any embodiment. Those skilled in the art can design instructions based on the schemes disclosed in this specification. How the instructions control the processor to operate is well known in the art and will not be described in detail here.

[0022] In the above description, those skilled in the art can design instructions based on the solutions provided in this disclosure. How the instructions control the processor to operate is well known in the art, and therefore will not be described in detail here.

[0023] Figure 1 The head-mounted display devices shown are illustrative only and are by no means intended to limit this disclosure, its application, or its use.

[0024] <Method Implementation> Figure 2 This disclosure illustrates a brightness adjustment method according to an embodiment of the present disclosure. This brightness adjustment method can be performed by a head-mounted display device, which may be... Figure 1 The head-mounted display device 1000 is shown. (For example...) Figure 2 As shown, the brightness adjustment method of this embodiment may include the following steps S2100 to S2300: Step S2100: While the user is wearing the head-mounted display device, obtain the user's current pupil diameter.

[0025] Normally, the diameter of the human pupil automatically constricts or dilates depending on the ambient brightness. Higher ambient brightness results in greater pupil constriction and a smaller pupil diameter, while lower ambient brightness results in greater pupil dilation and a larger pupil diameter. Therefore, when a user wears a head-mounted display device, the device can, for example, measure the user's current pupil diameter in real time. And based on the current pupil diameter Perform an adaptive adjustment step for the screen brightness of the subsequent display.

[0026] In one example, when a user is wearing a head-mounted display device, obtaining the user's current pupil diameter can be achieved as follows: When the user is wearing a head-mounted display device, the user's eyes are illuminated by an infrared light set on the head-mounted display device, and the user's current eye image is captured by an infrared camera set on the head-mounted display device; the pupil region in the current eye image is identified; and the current pupil diameter of the pupil region is determined.

[0027] After performing step S2100 above, with the user wearing the head-mounted display device, and obtaining the user's current pupil diameter, proceed to: Step S2200: Based on the preset first mapping data, obtain the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter, and use it as the target value of the brightness adjustment parameter.

[0028] The first mapping data reflects the correspondence between the brightness adjustment parameter value and the pupil diameter. This first mapping data can be pre-stored in the memory of the head-mounted display device. It can be a mapping table, typically including multiple mapping relationships, each consisting of a brightness adjustment parameter value and the corresponding pupil diameter.

[0029] Brightness adjustment parameters can be used to control the screen brightness of a head-mounted display device. These parameters can be the drive current of the display. Generally, the higher the current value, the brighter the screen; conversely, the lower the current value, the dimmer the screen. In other words, the screen brightness can be determined by controlling the value of the drive current, which can be a current level or a current index value.

[0030] Specifically, the display's driving circuit can typically support current level adjustment in the range of [0-255], including a total of 256 discrete current level values, each of which is an integer. Furthermore, each current value uniquely corresponds to a fixed screen brightness level.

[0031] Taking the brightness adjustment parameter as the driving current as an example, the first mapping data can be data that reflects the correspondence between the current level value of the driving current and the pupil diameter. Since the current level value directly determines the screen brightness, the first mapping data can reflect the correspondence between the screen brightness and the pupil diameter.

[0032] In this embodiment, the head-mounted display device can acquire the user's current pupil diameter in real time and find the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter from the preset first mapping data, as the target value of the brightness adjustment parameter. Taking the brightness adjustment parameter as the driving current as an example, the head-mounted display device can find the current level value corresponding to the current pupil diameter from the first mapping data reflecting the correspondence between the current level value of the driving current and the pupil diameter, as the target value of the driving current.

[0033] After performing the above step S2200, obtaining the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter based on the preset first mapping data, and using it as the target value of the brightness adjustment parameter, the process proceeds to: Step S2300: Adjust the screen brightness of the head-mounted display device according to the target value of the brightness adjustment parameter.

[0034] In this embodiment, the head-mounted display device can adjust the screen brightness of the display screen according to the target value of the drive current of the display screen.

[0035] In this embodiment, the user's current pupil diameter can be continuously collected at fixed intervals. When the difference between adjacent pupil diameters collected multiple times is less than a preset difference, it indicates that the user's pupil state has stabilized. At this point, the pupil no longer contracts or dilates significantly due to iterative adjustments of screen brightness, meaning that the current screen brightness matches the user's ambient brightness and meets the user's visual comfort requirements. Based on this, after multiple dynamic iterative adjustments, the screen brightness will eventually reach a suitable brightness value that stabilizes the pupil. The system will then stop further adjusting the screen brightness, maintaining this suitable brightness value to preserve the best visual experience.

[0036] Through the embodiments of this disclosure, the wearer's current pupil diameter can reflect changes in ambient light. The head-mounted display device can obtain the wearer's current pupil diameter and find the parameter value that matches the current pupil diameter from the preset mapping data that reflects the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter, thereby obtaining the target value of the brightness adjustment parameter. Then, the screen brightness of the head-mounted display device is adjusted according to the target value of the brightness adjustment parameter, thus realizing personalized brightness adjustment.

[0037] In one embodiment, the brightness adjustment method of this disclosure may further include: performing eye-tracking detection on the user based on a set time interval to obtain the user's gaze direction information; determining the wearer's gaze area based on the gaze direction information; and, if the gaze area is a real-world area, performing the step of determining the relative position of the current pupil diameter within the user's pupil change range.

[0038] Among them, the set time interval It is usually related to the value of the brightness adjustment parameter; the higher the value of the brightness adjustment parameter, the more frequent the eye movement detection.

[0039] In this embodiment, eye-tracking detection of the user can be performed using the pupil-corneal reflex method.

[0040] This embodiment adjusts screen brightness based on the current pupil diameter while the user is looking at a real-world area. This avoids the stimulation of the pupil by the screen's own light, ensures that the current pupil diameter can accurately reflect the ambient light intensity, and enables the screen brightness to accurately match the external environment, thereby improving the visual consistency of virtual and real integration in augmented reality.

[0041] In one embodiment, the brightness adjustment method of this disclosure further includes acquiring first mapping data, which can be implemented in the following manner: When different test subjects wear head-mounted display devices in a set dark light stimulation environment, the display area of ​​the head-mounted display device is controlled to display a set test screen; for any test subject, when the set test screen is displayed in the display area, the parameter value of the brightness adjustment parameter is adjusted from low to high within a preset range, and the pupil diameter of the test subject at each parameter value is acquired and recorded; based on each parameter value within the preset range and its corresponding pupil diameter of the test subject, second mapping data of the test subject is obtained; and first mapping data is obtained based on the second mapping data corresponding to different test subjects.

[0042] The second mapping data is data reflecting the correspondence between the value of the brightness adjustment parameter and the pupil diameter of the test subject.

[0043] The test screen can be a pure white test image.

[0044] The setting of a dark light stimulation environment can be a low-light environment that allows the user's pupils to fully dilate to a stable state. The low-light environment can be an environment with an illuminance less than or equal to the set illuminance, for example, less than 10 lux.

[0045] It should be noted that when light changes from bright to dark, the pupil automatically dilates to increase the amount of light entering the eye. This process relies on the relaxation of the iris sphincter muscle, and its physiological reaction time is relatively long, usually taking several seconds. When the environment changes from dark to bright, the pupil automatically constricts to prevent excessive light from entering the eye, thus protecting the retina. This process relies on the contraction of the iris sphincter muscle, and its physiological reaction time is short, completed within a few hundred milliseconds. Based on the above physiological regulatory characteristics of the human eye, this scheme chooses a dark-to-bright calibration method because the pupillary adjustment response is faster and more sensitive, reducing sample data errors caused by reaction delays during calibration and ensuring more accurate calibration results.

[0046] Taking brightness adjustment parameter as the driving current as an example, the first mapping data in this embodiment can be generated through the following calibration process, with the specific steps as follows: For any test subject, the test subject wears a head-mounted display device in a set dark light stimulation environment and remains still in the set dark light stimulation environment for a set time, such as 4 minutes, to allow the eyes to fully adapt to the ambient light. The display screen of the head-mounted display device displays a pure white test image, and the current level value of the driving current of the display screen is sequentially set to all discrete current level values ​​in the range of [0-255]. At each current level value, the infrared lamp is activated to illuminate the user's eyes, and the infrared camera captures the user's eye image. The head-mounted display device identifies the pupil area in the eye image and determines the pupil diameter of the pupil area. The head-mounted display device records and saves the correspondence between the driving current value and the test subject's pupil diameter as the test subject's second mapping data. Collect second mapping data for all test subjects. For each current level value within the range of [0-255], extract the pupil diameter corresponding to that current level value for all test subjects and calculate the average (or other statistical methods such as mode, median, weighted average, etc.). Use this average as the pupil diameter for the corresponding current level value. Finally, the correspondence between all current levels and their corresponding pupil diameters can be integrated to form the first mapping data.

[0047] Through the embodiments of this disclosure, first mapping data can be generated that corresponds to the brightness adjustment parameters and pupil diameters applicable to most user groups.

[0048] In one embodiment, the brightness adjustment method of this disclosure may further include updating the first mapping data. The updating of the first mapping data may be implemented in the following manner: traversing the two adjacent mapping relationships in the first mapping data sorted according to the parameter values ​​of the brightness adjustment parameters, and merging the two adjacent mapping relationships into a target mapping relationship when the difference between the pupil diameters corresponding to the parameter values ​​of the brightness adjustment parameters in the two adjacent mapping relationships is less than a set value.

[0049] Here, sorting by the brightness adjustment parameter values ​​can be done either by sorting from low to high or from high to low.

[0050] Among them, the value of the brightness adjustment parameter in the target mapping relationship can be the average value of the brightness adjustment parameter in two adjacent mapping relationships, and the pupil diameter corresponding to the value of the brightness adjustment parameter in the target mapping relationship can be the average value of the pupil diameter in two adjacent mapping relationships.

[0051] Of course, the value of the brightness adjustment parameter in the target mapping relationship can also be the minimum value of the brightness adjustment parameter in two adjacent mapping relationships, and the pupil diameter corresponding to the value of the brightness adjustment parameter in the target mapping relationship can be the minimum value of the pupil diameter in two adjacent mapping relationships.

[0052] Of course, the value of the brightness adjustment parameter in the target mapping relationship can also be the maximum value of the brightness adjustment parameter in two adjacent mapping relationships, and the pupil diameter corresponding to the value of the brightness adjustment parameter in the target mapping relationship can be the maximum value of the pupil diameter in two adjacent mapping relationships.

[0053] This embodiment reduces the amount of data in the first mapping data, saving storage space and improving the data retrieval efficiency of the first mapping data, thus making the brightness adjustment response more timely.

[0054] In one embodiment, updating the first mapping data in this disclosure can be implemented in the following ways: if the current pupil diameter is greater than the maximum pupil diameter in the first mapping data stored in the memory, the maximum pupil diameter can be updated to the current pupil diameter; or, if the current pupil diameter measured within a consecutive first preset number of times is less than or equal to the maximum pupil diameter in the first mapping data stored in the memory, the maximum pupil diameter can be updated to the maximum value measured within the consecutive first preset number of times; or, if the current pupil diameter is less than the minimum pupil diameter in the first mapping data stored in the memory, the minimum pupil diameter can be updated to the current pupil diameter; or, if the current pupil diameter measured within a consecutive second preset number of times is greater than or equal to the minimum pupil diameter in the first mapping data stored in the memory, the minimum pupil diameter can be updated to the minimum value measured within the consecutive second preset number of times.

[0055] The first preset number of times and the second preset number of times can be the same or different. For example, the first preset number of times and the second preset number of times can be 1000.

[0056] In one example, while a user is wearing a head-mounted display, the display can measure the user's current pupil diameter in real time. If the user's current pupil diameter value Less than the minimum pupil diameter in the first mapping data stored in memory. This allows for the setting of the minimum pupil diameter. Updated to the current pupil diameter value If the user's current pupil diameter value is measured multiple times consecutively... All are greater than or equal to the minimum pupil diameter in the first mapping data stored in memory. This allows for the setting of the minimum pupil diameter. Updated to the user's current pupil diameter value measured multiple times consecutively. The minimum value in.

[0057] In one example, while a user is wearing a head-mounted display, the display can measure the user's current pupil diameter in real time. If the user's current pupil diameter value Greater than the maximum pupil diameter in the first mapping data stored in memory This allows the maximum pupil diameter to be... Updated to the current pupil diameter value If the user's current pupil diameter value is measured multiple times consecutively... All are less than or equal to the maximum pupil diameter in the first mapping data stored in memory. This allows the maximum pupil diameter to be... Updated to the user's current pupil diameter value measured multiple times consecutively. The maximum value in.

[0058] In this embodiment, the maximum pupil diameter in the first mapping data before the update can also be obtained. and minimum pupil diameter The first difference between ; Retrieve the maximum pupil diameter in the updated first mapping data and minimum pupil diameter The second difference between If the difference between the first difference and the second difference meets the set conditions, the pupil diameter adjustment coefficient is determined based on the first difference and the second difference; the pupil diameter in each group of mapping relationships in the updated first mapping data is adjusted according to the pupil diameter adjustment coefficient.

[0059] The setting condition can be that the absolute value of the difference between the first difference and the second difference is greater than the difference threshold, which can be 0.5 mm.

[0060] Specifically, the pupil diameter adjustment coefficient is determined based on the first difference and the second difference. The following formula can be used:

[0061] in, It is the maximum pupil diameter in the first mapping data before the update. and minimum pupil diameter The first difference between them, It is the maximum pupil diameter in the updated first mapping data. and minimum pupil diameter The second difference between them.

[0062] Specifically, the pupil diameter in any set of mapping relationships in the updated first mapping data can be adjusted based on the pupil diameter adjustment coefficient. Scaling adjustments can be made in various ways, such as... .in, This refers to the current level value for the drive current of the display screen, which is an integer between 1 and n, where n is the maximum current level value for the drive current. n can be 255, and k is the pupil diameter adjustment coefficient. To adjust the current range value in the first mapping data before adjustment Corresponding pupil diameter The current range value in the first mapped data after adjustment The corresponding pupil diameter.

[0063] In this embodiment, the head-mounted display device automatically and continuously tracks and dynamically updates the maximum and minimum pupil diameters of the current user during wear, so as to accurately capture the user's true pupil adjustment range under different ambient light and screen brightness. Based on the real-time updated maximum and minimum pupil diameters, the stored first mapping data is optimized to generate exclusive mapping data that highly matches the current user's eye characteristics, ensuring that the screen brightness adjustment always meets the user's individual needs.

[0064] <Device Embodiment> Figure 3 This is a schematic diagram of a brightness adjustment device according to one embodiment, applied to a head-mounted display device, see reference. Figure 3 As shown, the brightness adjustment device 300 may include a first acquisition module 310, a second acquisition module 320, and an adjustment module 330.

[0065] The first acquisition module 310 is used to acquire the user's current pupil diameter when the user is wearing the head-mounted display device; The second acquisition module 320 is used to obtain, according to the preset first mapping data, the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter, as the target value of the brightness adjustment parameter; wherein, the first mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter; The adjustment module 330 is used to adjust the screen brightness of the head-mounted display device according to the target value of the brightness adjustment parameter.

[0066] In one embodiment, the first acquisition module 310 is specifically used to, when the user is wearing the head-mounted display device, illuminate the user's eyes with an infrared lamp set on the head-mounted display device and acquire the user's current eye image with an infrared camera set on the head-mounted display device; identify the pupil region in the current eye image; and determine the current pupil diameter of the pupil region.

[0067] In one embodiment, the device 300 further includes a third acquisition module (not shown in the figure).

[0068] The third acquisition module is used to control the display area of ​​the head-mounted display device to display a set test screen when different test subjects wear the head-mounted display device in a set dark light stimulation environment; for any test subject, when the set test screen is displayed in the display area, the parameter value of the brightness adjustment parameter is adjusted from low to high within a preset range, and the pupil diameter of the test subject is acquired and recorded for each parameter value; based on each parameter value within the preset range and its corresponding pupil diameter of the test subject, second mapping data of the test subject is obtained; wherein, the second mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter of the test subject; based on the second mapping data corresponding to different test subjects, first mapping data is obtained. In one embodiment, the device 300 further includes an eye-tracking module and a determination module (both not shown in the figure).

[0069] The eye-tracking module is used to perform eye-tracking detection on the user based on a set time interval to obtain the user's gaze direction information; The determination module is used to determine the user's gaze area based on the gaze direction information; The second acquisition module 320 is further configured to, when the gaze area is a real-world area, obtain the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter based on the preset first mapping data. In one embodiment, the device 300 further includes a first update module (not shown in the figure).

[0070] The first update module is used to traverse the first mapping data, sorted by the parameter values ​​of the brightness adjustment parameter, between two adjacent groups of mapping relationships. If the difference between the pupil diameters corresponding to the parameter values ​​in the two adjacent groups of mapping relationships is less than a set value, the two adjacent groups of mapping relationships are merged into a target mapping relationship. The parameter value of the brightness adjustment parameter in the target mapping relationship is the average value of the parameter values ​​of the brightness adjustment parameter in the two adjacent groups of mapping relationships, and the pupil diameter corresponding to the parameter value of the brightness adjustment parameter in the target mapping relationship is the average pupil diameter in the two adjacent groups of mapping relationships.

[0071] In one embodiment, the device 300 further includes a second update module (not shown in the figure).

[0072] The second update module is configured to: ... In one embodiment, the device 300 further includes a third update module (not shown in the figure).

[0073] The third update module is used to obtain a first difference between the maximum and minimum pupil diameter values ​​in the first mapping data before the update; obtain a second difference between the maximum and minimum pupil diameter values ​​in the updated first mapping data; determine a pupil diameter adjustment coefficient based on the first and second differences if the difference between the first and second differences meets a set condition; and adjust the pupil diameter in each group of mapping relationships in the updated first mapping data according to the pupil diameter adjustment coefficient. According to embodiments of this disclosure, the wearer's current pupil diameter can reflect changes in ambient light. The head-mounted display device can obtain the wearer's current pupil diameter and search for a parameter value that matches the current pupil diameter from a preset mapping data that reflects the correspondence between the brightness adjustment parameter value and the pupil diameter. This allows the device to obtain a target value for the brightness adjustment parameter and then adjust the screen brightness of the head-mounted display device according to the target value of the brightness adjustment parameter, thus achieving personalized brightness adjustment.

[0074] <Equipment Example> Figure 4 This is a schematic diagram of the hardware structure of a head-mounted display device according to one embodiment. Figure 4 As shown, the head-mounted display device 1000 includes a processor 1100 and a memory 1200.

[0075] The memory 1200 can be used to store executable computer instructions.

[0076] The processor 1100 can be used to execute a brightness adjustment method according to an embodiment of the present disclosure, under the control of executable computer instructions.

[0077] The head-mounted display device 1000 can be as follows: Figure 1 The head-mounted display device 1000 shown may also be a device with other hardware structures, which are not limited here.

[0078] In another embodiment, the head-mounted display device 1000 may include the above-mentioned brightness adjustment device 300. In one embodiment, each module of the brightness adjustment device 300 can be implemented by the processor 1100 running computer instructions stored in the memory 1200.

[0079] Computer-readable storage media This disclosure also provides a computer-readable storage medium storing computer instructions thereon, which, when executed by a processor, perform the brightness adjustment method provided in this disclosure.

[0080] This disclosure can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this disclosure.

[0081] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination of the foregoing. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0082] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0083] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0084] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0085] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0086] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0087] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be known to those skilled in the art that implementation in hardware, implementation in software, and implementation in a combination of software and hardware are equivalent.

[0088] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, and are not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein. The scope of this disclosure is defined by the appended claims.

Claims

1. A brightness adjustment method applied to a head-mounted display device, the method comprising: While the user is wearing the head-mounted display device, the user's current pupil diameter is obtained; Based on the preset first mapping data, the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter is obtained as the target value of the brightness adjustment parameter; wherein, the first mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter; The screen brightness of the head-mounted display device is adjusted according to the target value of the brightness adjustment parameter.

2. The method according to claim 1, wherein, The step of obtaining the user's current pupil diameter while the user is wearing the head-mounted display device includes: When a user is wearing the head-mounted display device, the user's eyes are illuminated by an infrared light installed on the head-mounted display device, and the user's current eye image is captured by an infrared camera installed on the head-mounted display device; Identify the pupil region in the current eye image; Determine the current pupil diameter of the pupil region.

3. The method according to claim 1, wherein, The method further includes the step of obtaining the first mapping data. The step of obtaining the first mapping data includes: With different test subjects wearing the head-mounted display device in a set dark light stimulation environment, the display area of ​​the head-mounted display device is controlled to display a set test screen; For any of the test subjects, when the set test screen is displayed in the display area, the value of the brightness adjustment parameter is adjusted from low to high within a preset range, and the pupil diameter of the test subject is obtained and recorded under each parameter value. Based on each parameter value within the preset range and its corresponding pupil diameter of the test subject, second mapping data of the test subject is obtained; wherein, the second mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter of the test subject; The first mapping data is obtained based on the second mapping data corresponding to each of the different testers.

4. The method according to claim 1, wherein, The method further includes: Eye-tracking detection is performed on the user at set time intervals to obtain the user's gaze direction information; The user's gaze area is determined based on the gaze direction information; If the gaze area is a real-world area, then the step of obtaining the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter based on the preset first mapping data is performed.

5. The method according to claim 1, wherein, The method further includes the step of updating the first mapping data. Updating the first mapping data includes: Traverse the first mapping data and sort the adjacent two groups of mapping relationships according to the parameter values ​​of the brightness adjustment parameter. If the difference between the pupil diameters corresponding to the parameter values ​​in the two adjacent groups of mapping relationships is less than a set value, merge the two adjacent groups of mapping relationships into a target mapping relationship. Wherein, the value of the brightness adjustment parameter in the target mapping relationship is the average value of the brightness adjustment parameter in two adjacent mapping relationships, and the pupil diameter corresponding to the value of the brightness adjustment parameter in the target mapping relationship is the average pupil diameter in two adjacent mapping relationships.

6. The method according to claim 1, wherein, The method further includes updating the first mapping data. Updating the first mapping data includes: If the current pupil diameter is greater than the maximum pupil diameter in the first mapping data, the maximum pupil diameter is updated to the current pupil diameter; or, If the current pupil diameter measured within a first preset number of consecutive measurements is less than or equal to the maximum pupil diameter, the maximum pupil diameter is updated to the maximum value measured within the first preset number of consecutive measurements; or... If the current pupil diameter is less than the minimum pupil diameter in the first mapping data, the minimum pupil diameter is updated to the current pupil diameter; or, If the current pupil diameter measured within a second consecutive preset number of times is greater than or equal to the minimum pupil diameter, the minimum pupil diameter is updated to the minimum value measured within the second consecutive preset number of times.

7. The method according to claim 6, wherein, The method further includes: Obtain the first difference between the maximum pupil diameter and the minimum pupil diameter in the first mapping data before it was updated; Obtain the second difference between the maximum pupil diameter and the minimum pupil diameter in the updated first mapping data; If the difference between the first difference and the second difference meets the set conditions, the pupil diameter adjustment coefficient is determined based on the first difference and the second difference; The pupil diameter in each group of mapping relationships in the updated first mapping data is adjusted according to the pupil diameter adjustment coefficient.

8. A brightness adjustment device, applied to a head-mounted display device, the device comprising: The first acquisition module is used to acquire the user's current pupil diameter when the user is wearing the head-mounted display device; The second acquisition module is used to obtain the parameter value of the brightness adjustment parameter corresponding to the current pupil diameter according to the preset first mapping data, and use it as the target value of the brightness adjustment parameter; wherein, the first mapping data is data reflecting the correspondence between the parameter value of the brightness adjustment parameter and the pupil diameter; An adjustment module is used to adjust the screen brightness of the head-mounted display device according to the target value of the brightness adjustment parameter.

9. A head-mounted display device, comprising: Memory is used to store executable computer instructions; A processor configured to execute the method according to any one of claims 1-7, under the control of the executable computer instructions.

10. A computer-readable storage medium having stored thereon computer instructions that, when executed by a processor, perform the method of any one of claims 1-7.

Images