Backlight brightness adjusting method and head display device

Abstract

The invention discloses a backlight brightness adjusting method and head-mounted display equipment, and the head-mounted display equipment comprises a processor which is configured to receive a brightness test instruction inputted by a user; in response to a received brightness test instruction input by a user, respectively displaying test images under the plurality of different test backlight brightness values; when the test image is displayed under each test backlight brightness value, detecting a first pupil size of the user, and receiving a first visual perception score input by the user; and based on each test backlight brightness value, each first pupil size and each first visual perception score, constructing a target brightness prediction function corresponding to the user. By introducing the visual perception score of the user into the target brightness prediction function, the sensitive degree of the user to each backlight brightness can be captured. In this way, the constructed target brightness prediction function can better adapt to the visual comfort of the current user, and more personalized brightness adjustment is achieved.

Description

Technical Field

[0001] This application relates to the field of display technology, and more particularly to a method for adjusting backlight brightness and a head-mounted display device. Background Technology

[0002] In today's digital age, head-mounted displays have become a bridge connecting users to the digital world, bringing them an unprecedented immersive experience. However, while opening the door to a new world for users, head-mounted displays have also introduced a series of potential visual health problems, among which visual fatigue is an issue that cannot be ignored.

[0003] The backlight brightness of a head-up display is a significant factor affecting user visual fatigue. For example, if the backlight brightness is too high, the user's eyes will be subjected to excessive light stimulation, causing the pupils to constrict and leading to symptoms of visual fatigue such as dry eyes, stinging, and blurred vision. Conversely, if the backlight brightness is too low, although light stimulation is reduced, the user will unconsciously dilate their pupils to see the screen content clearly, which can also easily cause visual fatigue.

[0004] Therefore, it is important to provide a backlight brightness adjustment solution that can alleviate user visual fatigue. Summary of the Invention

[0005] In some embodiments of this application, the head-mounted display device includes:

[0006] The processor is configured as follows:

[0007] Receive brightness test commands input by the user;

[0008] In response to receiving a brightness test command from the user, the test image is displayed under multiple different test backlight brightness values;

[0009] When displaying test images at each test backlight brightness value, the system detects the user's first pupil size corresponding to each test backlight brightness value, and receives the user's first visual perception score corresponding to each test backlight brightness value.

[0010] Based on the backlight brightness values ​​of each test, the first pupil size of each test, and the first visual perception score of each test, a target brightness prediction function corresponding to the user is constructed.

[0011] By incorporating the user's visual perception score into the target brightness prediction function, the user's sensitivity to various backlight brightness levels can be captured. This allows the constructed target brightness prediction function to better adapt to the user's current visual comfort, enabling more personalized brightness adjustment and improving the accuracy of the predicted backlight brightness values. Furthermore, the backlight brightness adjusted using the target brightness prediction function is more adaptable to the user's visual comfort, avoiding significant pupil constriction and thus enhancing overall visual comfort.

[0012] In some embodiments of this application, a backlight brightness adjustment method is applied to a head-mounted display device. The method includes: receiving a brightness test command input by a user; in response to receiving the brightness test command input by the user, displaying test images at multiple different test backlight brightness values; while displaying the test images at each test backlight brightness value, detecting the user's first pupil size corresponding to each test backlight brightness value, and receiving a first visual perception score input by the user corresponding to each test backlight brightness value; and constructing a target brightness prediction function corresponding to the user based on each test backlight brightness value, each first pupil size, and each first visual perception score. Attached Figure Description

[0013] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0014] Figure 1 A scenario illustrating the adjustment of backlight brightness in a head-mounted display device according to some embodiments is shown;

[0015] Figure 2 The diagram illustrates the fluctuations between backlight brightness and pupil size during the adjustment of backlight brightness in a head-mounted display device according to some embodiments.

[0016] Figure 3 A software configuration block diagram of a head-mounted display device according to some embodiments is shown;

[0017] Figure 4 A flowchart of a backlight brightness adjustment method according to some embodiments is shown;

[0018] Figure 5 A user interface display diagram is shown in a head-mounted display device according to some embodiments;

[0019] Figure 6 Another user interface display diagram is shown in a head-mounted display device according to some embodiments;

[0020] Figure 7 Another user interface display diagram is shown in a head-mounted display device according to some embodiments. Detailed Implementation

[0021] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0022] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0023] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0024] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0025] In today's digital age, head-mounted displays have become a bridge connecting users to the digital world, bringing them an unprecedented immersive experience. However, while opening the door to a new world for users, head-mounted displays have also introduced a series of potential visual health problems, among which visual fatigue is an issue that cannot be ignored.

[0026] The backlight brightness of a head-up display is a significant factor affecting user visual fatigue. For example, if the backlight brightness is too high, the user's eyes will be subjected to excessive light stimulation, causing the pupils to constrict and leading to symptoms of visual fatigue such as dry eyes, stinging, and blurred vision. Conversely, if the backlight brightness is too low, although light stimulation is reduced, the user will unconsciously dilate their pupils to see the screen content clearly, which can also easily cause visual fatigue.

[0027] In some embodiments, the head-mounted display device can adjust the backlight brightness of the device to a state that meets the user's eye comfort based on the user's pupil size. That is, the adjusted backlight brightness will not cause the user's pupils to dilate or constrict, but will keep the user's pupil size at an average state, thereby improving the user's eye fatigue.

[0028] For example, such as Figure 1 As shown, the head-mounted display device 100 may include an image acquisition unit 110, a display 120, a backlight module 130, and a processor 140.

[0029] Image acquisition device 110 can be used to acquire eye images of a user wearing a head-mounted display device, and then send the eye images to processor 140. Image acquisition device 110 can be an eye-tracking camera, etc., and this embodiment of the application does not limit it to this type.

[0030] The processor 140 can detect the user's current pupil size based on the eye image. Then, the processor 140 can determine the target backlight brightness corresponding to the current pupil size based on a preset correspondence between pupil size and backlight brightness. Afterward, the processor 140 can control the backlight module 130 to provide the target backlight brightness to the display 120.

[0031] For example, the preset correspondence between pupil size and backlight brightness can be shown in Table 1 below.

[0032] Table 1

[0033] Pupil diameter (mm) Backlight brightness (nits) ≤2.0 200 2.1-2.5 275 2.6-3.0 350 3.1-3.5 425 3.6-4.0 500 4.0-4.5 575 5.0≤ 650

[0034] It's important to note that unlike the backlight brightness of electronic devices such as mobile phones, which is affected by ambient light, head-mounted displays (HMDs) are enclosed devices. The closed eye shield of an HMD isolates the user from ambient light. Therefore, the light source for the user's eyes comes entirely from the screen's backlight brightness. This creates a strong correlation between pupil size and backlight brightness. Consequently, when adjusting the backlight brightness based on the relationship shown in Table 1, a strong fluctuation-dependent relationship will exist between backlight brightness and pupil size until they reach a stable state.

[0035] For example, such as Figure 2 As shown in Figure A, the current pupil diameter is matched with the current backlight brightness. Figure 2 As shown in B1, the user's pupils suddenly dilate. For example, when the human eye experiences emotional fluctuations or a sudden stimulus, the sympathetic nervous system is activated, causing the pupils to dilate. In this situation, such as... Figure 2 As shown in C, the head-mounted display will increase the backlight brightness. For example... Figure 2 As shown in Figure D, increasing the backlight brightness will stimulate pupil constriction. Therefore, to alleviate eye strain from the backlight, the head-mounted display will reduce the backlight brightness. Next, as... Figure 2 As shown in E, the pupils dilate to adapt to the reduced backlight brightness. (As...) Figure 2 As shown in Figure F, to alleviate eye strain from the backlight brightness, the head-mounted display will further increase the backlight brightness. For example... Figure 2 As shown in G, increasing the backlight brightness will stimulate the pupils to shrink.

[0036] Similarly, such as Figure 2 As shown in B1 and C2, when the backlight brightness is suddenly increased, the pupils constrict in response to the increased backlight intensity. Afterwards, the following steps are performed... Figure 2 For details regarding processes D, E, F, and G, please refer to the descriptions above; they will not be repeated here.

[0037] Similarly, such as Figure 2 As shown in B3, the user's pupils suddenly constrict. Afterwards, the following is executed: Figure 4 For details regarding processes D, E, F, and G, please refer to the descriptions above; they will not be repeated here.

[0038] It is evident that pupil size is strongly correlated with backlight brightness, and different users may have varying sensitivities to brightness. Therefore, when adjusting backlight brightness based on the correspondence shown in Table 1, the user's pupil constriction response may be significant. This necessitates multiple adjustments to the backlight brightness to achieve a stable state between the user's pupil size and the backlight brightness. During this adjustment process, the user's eyes need to frequently adjust their pupils to adapt to the current backlight brightness, which can easily lead to visual fatigue.

[0039] To address the aforementioned issues, this application provides a method for adjusting backlight brightness. This method constructs a brightness prediction function tailored to different users based on pupil size, visual perception score, and backlight brightness. Then, the backlight brightness is adjusted using the brightness prediction function corresponding to the current user wearing the head-mounted display. Because the brightness prediction function incorporates the current user's visual perception score, it can more accurately predict the backlight brightness that best suits the user's visual comfort level based on the brightness prediction function and the current user's pupil diameter. This prevents significant pupil constriction during backlight brightness adjustment, allowing the user's pupil size and backlight brightness to quickly reach a stable state, thus improving the user's visual comfort.

[0040] In some embodiments, the following can be adopted: Figure 3 The software architecture shown implements backlight brightness adjustment. For example... Figure 3 As shown, this software architecture includes at least a framework layer and a driver layer. The framework layer may include a display power controller service, an eye tracking service, an eye tracking algorithm, and a camera server. The driver layer may include an eye-tracking camera and a display.

[0041] like Figure 3As shown, the eye-tracking camera in the driver layer can acquire eye images from the eye-tracking camera in the hardware layer. Specifically, the hardware-layer eye-tracking camera is used to capture the user's eye images. Then, the driver-layer eye-tracking camera provides the eye images to the camera service, which, after obtaining the eye images through the camera service interface, passes them to the eye-tracking algorithm.

[0042] After obtaining an eye image, the eye-tracking algorithm can calculate the pupil size based on the image. The algorithm then returns the calculated pupil size to the eye-tracking service. The eye-tracking service can then calculate the backlight brightness value based on the pupil size and a brightness prediction function. This backlight brightness value is then passed to the display service's brightness adjustment interface, which in turn notifies the display driver to adjust the monitor's backlight brightness according to the value, thus achieving backlight brightness adjustment.

[0043] It should be noted that, Figure 3 The software architecture shown is only for illustrating the implementation process of backlight brightness adjustment and does not represent a limitation on the software architecture of the head-mounted display device. For example, the software architecture of a head-mounted display device may also include an application layer (referred to as the "application layer"), an application framework layer (referred to as the "framework layer"), an Android runtime, and a system library layer (referred to as the "system runtime library layer"). Furthermore, the driver layer may also include audio drivers, Bluetooth drivers, Wi-Fi drivers, USB drivers, and power drivers, etc.

[0044] The following section provides an example of how to construct the brightness prediction function.

[0045] Figure 4 Flowcharts illustrating methods for constructing brightness prediction functions in some embodiments are shown. These methods can be applied to head-mounted display devices, such as... Figure 4 As shown, the method may include the following steps:

[0046] S201 receives the brightness test command input by the user.

[0047] In some embodiments, after detecting that a user is wearing the head-mounted display (HMD), the HMD can first determine whether it has a pre-stored brightness prediction function. If the HMD does not have a pre-stored brightness prediction function, it can generate a first prompt message. The first prompt message prompts the user to perform a brightness test in order to construct a target brightness prediction function corresponding to the user.

[0048] In some embodiments, the settings application of the head-mounted display (HMD) may include a setting option for an automatic brightness adjustment function. Users can choose to enable or disable the HMD's automatic brightness adjustment function. After detecting that a user is wearing the HMD, the HMD can first determine whether the automatic brightness adjustment function is enabled. If it is determined that the automatic brightness adjustment function is enabled, it can then determine whether a brightness prediction function is pre-stored in the HMD. If no brightness prediction function is pre-stored in the HMD, it can generate a first prompt message.

[0049] If the automatic brightness adjustment function is determined to be off, the head-mounted display (HMD) can generate a second prompt message to remind the user to turn on the automatic brightness adjustment function. Then, if the HMD detects that the automatic brightness adjustment function has switched from off to on, it can determine whether a brightness prediction function is pre-stored in the HMD. If no brightness prediction function is pre-stored in the HMD, it can generate a first prompt message.

[0050] For example, such as Figure 5 As shown, the head-mounted display can show a first user interface, which includes first prompt information. After the user selects "Yes" via the control handle or gesture, the head-mounted display can receive the brightness test command input by the user and then begin performing a brightness test on the user.

[0051] It should be noted that the first prompt information can be text information displayed on the monitor of the head-mounted display device, or it can be voice information broadcast through the speaker of the head-mounted display device. This application embodiment does not limit this.

[0052] S202, in response to receiving a brightness test command input by the user, displays test images under multiple different test backlight brightness values.

[0053] It should be noted that the image content and position of the test image are the same under different backlight brightness values; only the backlight brightness value is different.

[0054] S203, when displaying the test image under each test backlight brightness value, detect the first pupil size of the user corresponding to each test backlight brightness value, and receive the first visual perception score input by the user corresponding to each test backlight brightness value.

[0055] S204: When displaying the test image under each test backlight brightness value, receive the user's input first visual perception score corresponding to each test backlight brightness value.

[0056] In some embodiments, a test image of a preset duration is displayed at each test backlight brightness value. Within the preset duration, the user's first pupil size and a first visual perception score input by the user can be detected.

[0057] For example, such as Figure 6 As shown, when displaying test images at various backlight brightness values, an input box can be displayed on the head-mounted display device's screen for users to input their first visual perception rating of the displayed test images.

[0058] For example, when the test backlight brightness of the test image displayed on the head-mounted display is 200 nits, the first visual perception score received from the user is 5. When the test backlight brightness of the test image displayed on the head-mounted display is 350 nits, the first visual perception score received from the user is 8. These are not listed individually here; please refer to Table 2 below.

[0059] After completing the brightness test, the user's corresponding test data can be obtained. The user's test data includes the backlight brightness value for each test, the first pupil size corresponding to each test backlight brightness value, and the first visual perception score corresponding to each test backlight brightness value.

[0060] For example, after completing the brightness test, the test data shown in Table 2 can be obtained. For instance, when displaying a test image with a backlight brightness of 200 nits, if the user's pupil diameter is detected to be ≤2.0mm, the user's first visual perception score for displaying the test image at 200 nits is 5 points. As another example, when displaying a test image with a backlight brightness of 500 nits, if the user's pupil diameter is detected to be in the range of 3.6-4.0mm, the user's first visual perception score for displaying the test image at 500 nits is 9 points.

[0061] Table 2

[0062] Pupil diameter (mm) First visual impression rating Backlight brightness test (nits) ≤2.0 5 200 2.1-2.5 7 275 2.6-3.0 8 350 3.1-3.5 6 425 3.6-4.0 9 500 4.0-4.5 6 575 5.0≤ 9 650

[0063] It should be noted that a higher first visual perception score indicates a more comfortable visual experience, or a higher first visual perception score indicates a less comfortable visual experience; however, the embodiments of this application are not limited in this respect.

[0064] S205, based on each test backlight brightness value, each first pupil size, and each first visual perception score, constructs a target brightness prediction function corresponding to the user.

[0065] After obtaining the user's test data, a target brightness prediction function can be constructed based on the user's test data.

[0066] Because the target brightness prediction function incorporates the user's visual perception score, the backlight brightness adjusted using the target brightness prediction function is more adaptable to the user's visual comfort and will not cause the user's pupils to constrict significantly. This allows the user's pupil size and backlight brightness to quickly reach a stable state, improving the user's visual comfort.

[0067] In some embodiments, constructing a target brightness prediction function for a user based on the user's corresponding test data can be achieved in the following manner: constructing a feature matrix based on each first pupil size and each first visual perception score; constructing a target vector based on each test backlight brightness value; determining the average value of the user's pupil size based on each first pupil size; setting the weight of the first pupil size that meets the average value as a first weight, and setting the weight of the first pupil size that does not meet the average value as a second weight, wherein the first weight is greater than the second weight; and constructing a target brightness prediction function for the user based on the feature matrix, the target vector, the first weight, and the first weight.

[0068] The following example illustrates how to construct a target brightness prediction function based on the test data in Table 2.

[0069] First, a multiple regression function is constructed as y = β0 + β1x + β2z; where y represents the backlight brightness value (nits), x represents the pupil diameter (mm), z represents the visual perception score; and β0, β1, and β2 are regression coefficients.

[0070] Then, based on the first pupil size and the first visual perception score in Table 2, the feature matrix X is constructed as follows:

[0071] Furthermore, the target vector Y is constructed based on the backlight brightness values ​​tested in Table 2 as follows:

[0072]

[0073] Then, the weight value corresponding to pupil diameters of 3.0mm-4.0mm is set to 1, and the weight value corresponding to other pupil diameters is set to 0.8. This yields the weight matrix W:

[0074]

[0075] Then, the regression coefficients β0, β1, and β2 can be calculated according to the following formula (1):

[0076] β=(X T WX) -1 X T WY formula(1)

[0077] Substituting the feature matrix X, the target vector Y, and the weight matrix W into the above formula (1), the regression coefficient matrix β is calculated, namely: β0=71.16, β1=63.63, β2=17.71.

[0078]

[0079] Finally, substituting the regression coefficients β0, β1, and β2 into the multiple regression function y = β0 + β1x + β2z, we obtain the multiple regression function y = 71.16 + 63.63x + 17.71z. This constructed multiple regression function is the target brightness prediction function.

[0080] In a multiple regression function, a larger weight means a higher proportion of the data point in the regression analysis, and a data point with a larger weight has a greater impact on the final regression result. Therefore, by setting the weight of stable and reliable data points (e.g., data points corresponding to the average pupil size) higher than the weight of abnormal and noisy data points (e.g., data points corresponding to pupil sizes other than the average pupil size), the impact of abnormal fluctuations on the multiple regression function can be reduced. In this way, when the user's pupils suddenly dilate and constrict, the weighted multiple regression function can accurately predict the backlight brightness, thereby quickly adjusting the backlight brightness to meet the user's visual comfort.

[0081] Since different users may experience visual fatigue differently, this application embodiment incorporates a visual perception score into the user's corresponding test data to capture the different users' sensitivity to backlight brightness. In this way, the constructed target brightness prediction function can better adapt to the current user's visual comfort, achieving more personalized brightness adjustment and improving the accuracy of the target brightness prediction function.

[0082] In some embodiments, a head-mounted display (HMD) can pre-store a brightness prediction function. This allows the user to construct a target brightness prediction function according to the above embodiments when first wearing the HMD. Subsequently, the target brightness prediction function can be directly invoked to adjust the backlight brightness of the HMD.

[0083] In some embodiments, a head-mounted display device can pre-store multiple brightness prediction functions. These multiple brightness prediction functions are constructed based on brightness test data from different users.

[0084] To differentiate the brightness prediction functions for different users, the head-mounted display can create accounts corresponding to each brightness prediction function. Each account corresponds to a different brightness prediction function.

[0085] In some embodiments, after detecting that a user is wearing a head-mounted display device, the display of the head-mounted display device may display, as shown below. Figure 7 The second user interface is shown. This second user interface displays a list of accounts, for example, including accounts 1, 2, and 3 corresponding to user 1, user 2, and user 3, respectively. Specifically, the first brightness prediction function associated with account 1 is constructed based on user 1's brightness test data; the second brightness prediction function associated with account 2 is constructed based on user 2's brightness test data; and the third brightness prediction function associated with account 3 is constructed based on user 3's brightness test data.

[0086] Assuming the user currently wearing the head-mounted display is User 1, User 1 can select Account 1. In response to User 1's selection command for Account 1, the head-mounted display calls the first brightness prediction function corresponding to Account 1 to adjust the backlight brightness of the head-mounted display.

[0087] Of course, if the user currently wearing the head-mounted display is user 2, then user 2 can select account 2. In this way, the head-mounted display responds to user 2's input command to select account 2, and calls the second brightness prediction function corresponding to account 2 to adjust the backlight brightness of the head-mounted display.

[0088] like Figure 7 The second user interface shown can also include a "New" option, so that users can create their own accounts if the account corresponding to the current user is not included in the account list.

[0089] For example, in response to receiving a user's instruction to create a new account, the head-mounted display device displays as follows: Figure 5 The first user interface shown prompts the user to perform a brightness test. Upon receiving the user's brightness test command, the system begins the brightness test. After the brightness test is completed, a brightness prediction function corresponding to the user can be constructed based on the user's brightness test data. Finally, this newly constructed brightness prediction function is associated with a newly created account. For example, the newly created account is account 4.

[0090] In this way, the head-mounted display device can respond to the user's input command to select account 4 and call the brightness prediction function corresponding to account 4 to adjust the backlight brightness of the head-mounted display device.

[0091] In some embodiments, after detecting that a user is wearing a head-mounted display, the head-mounted display may first determine whether the account list is empty. If the account list is not empty, the head-mounted display may display, as shown below. Figure 7 The second user interface is shown below. If the account list is empty, the head-mounted display can directly display something like this. Figure 5 The first user interface shown.

[0092] It should be noted that the method for constructing corresponding brightness prediction functions for different users can be found in the description of the method for constructing target brightness prediction functions above, and will not be repeated here.

[0093] The following is an exemplary description of a method for adjusting the backlight brightness of a head-mounted display device using a target brightness prediction function.

[0094] In some embodiments, for a scenario where a head-mounted display device has a pre-stored brightness prediction function, after constructing the target brightness prediction function corresponding to the user, the backlight brightness can be adjusted in the following manner: detect the user's second pupil size; use the target brightness prediction function to predict the first backlight brightness value corresponding to the second pupil size and the second visual perception score; the second visual perception score is used to characterize the most comfortable visual perception state; adjust the backlight brightness of the head-mounted display device based on the first backlight brightness value.

[0095] In some embodiments, for a scenario where a head-mounted display device pre-stores multiple brightness prediction functions, after constructing the target brightness prediction function corresponding to the user, the backlight brightness can be adjusted in the following manner: receiving a user's input instruction to select a target account; in response to receiving the user's input instruction to select a target account, determining the target brightness prediction function corresponding to the target account; detecting the user's second pupil size; using the target brightness prediction function, predicting a first backlight brightness value corresponding to the second pupil size and the second visual perception score; and adjusting the backlight brightness of the head-mounted display device based on the first backlight brightness value.

[0096] First, it should be noted that the head-mounted display can detect the user's second pupil size in real time, or the head-mounted display can detect the user's second pupil size at preset time intervals.

[0097] The embodiments of this application do not limit the specific implementation method of detecting the user's second pupil size.

[0098] In some embodiments, detecting a user's second pupil size can be achieved by: acquiring an image of the user's eyes using an eye-tracking camera in the head-mounted display device; then preprocessing the eye image by performing grayscale analysis and noise removal; subsequently, using an edge detection algorithm to identify the eyeball contour in the preprocessed eye image; and then using algorithms such as Hough transform to identify the circular boundary of the pupil and calculate the second pupil size. For example, the second pupil size is the pupil diameter.

[0099] In some embodiments, the detection of the user's second pupil size can also be achieved by using a distance sensor (e.g., an infrared receiver) in the head-mounted display to detect the distance D between the user's eyes and the screen. Then, based on the correspondence between distance and pupil size pre-stored in the VR device, the second pupil size corresponding to distance D is determined.

[0100] After calculating the second pupil size, it can be further verified to ensure its accuracy.

[0101] In some embodiments, the verification of the second pupil size can be achieved as follows: First, determine the user's gender, age group, and second pupil size; then, determine the reference pupil size corresponding to the user's gender and age group. Determine whether the second pupil size meets the reference pupil size; if the second pupil size does not meet the reference pupil size, the second pupil size can be further corrected. If the second pupil size meets the reference pupil size, no correction is needed.

[0102] Since the ratio between eyeball size and pupil size is basically the same for users of different genders and age groups, this ratio can be preset. Then, based on the user's eyeball size and this ratio, a second pupil size is determined. The head-mounted display device (HMD) has significantly higher accuracy in detecting eyeball size than in detecting pupil size.

[0103] In this embodiment, the pupil size corresponding to a user's visually comfortable state can be referred to as the comfortable pupil size range. For example, the comfortable pupil size range can be the average of the pupil sizes in Table 2. For instance, the comfortable pupil size range can be a pupil diameter range of 3.0-4.0 mm.

[0104] When the second pupil size is within the comfortable pupil size range, the user will not experience significant visual fatigue. Therefore, in this case, the backlight brightness does not need to be adjusted to ensure the display effect.

[0105] When the second pupil size is outside the comfortable pupil size range—for example, if the second pupil size is too large or too small—the user will experience noticeable visual fatigue. Therefore, in such cases, it is necessary to adjust the backlight brightness to alleviate visual fatigue.

[0106] Based on the above considerations, in some embodiments, after detecting a second pupil size, it can be first determined whether the second pupil size is within the comfortable pupil size range. If the second pupil size is not within the comfortable pupil size range, then the first backlight brightness value is predicted using the target brightness prediction function, and subsequent steps are performed. If the second pupil size is within the comfortable pupil size range, then the first backlight brightness value is not predicted using the target brightness prediction function, and subsequent steps are not performed. That is, when the second pupil size is within the comfortable pupil size range, the current backlight brightness can be maintained without adjusting the backlight brightness of the head-mounted display device.

[0107] It should be noted that, even with the same backlight brightness, different images displayed on the headset can cause changes in the user's pupil size.

[0108] For example, the head-mounted display might show a brief bright or dark image. For instance, the head-mounted display might show an explosion scene. The bright image corresponding to the explosion scene might cause the user's pupils to suddenly shrink.

[0109] Another example is that the head-mounted display device may display a bright or dark image for an extended period of time. For instance, the head-mounted display device may display a nighttime scene. The dark image corresponding to a nighttime scene may cause the user's pupils to dilate suddenly.

[0110] While brief bursts of bright or dark images may cause users' pupils to dilate or shrink excessively, the display effect is generally good. However, prolonged exposure to bright or dark images can easily cause eye strain and seriously damage users' visual health.

[0111] In some embodiments, to balance display quality and visual fatigue, after detecting the second pupil size, it can be first determined whether the second pupil size is within the comfortable pupil size range. If the second pupil size is not within the comfortable pupil size range, the abnormal pupil state of the user's pupil is timed. Then, it is determined whether the timed duration has reached a duration threshold; if the timed duration has not reached the duration threshold, a brightness maintenance command can be sent to the backlight module through the processor of the head-mounted display device. The brightness maintenance command is used to instruct the backlight module to maintain the current backlight brightness.

[0112] Abnormal pupillary state refers to a pupil size that is not within the range of comfortable pupil size, such as a second pupil size that is too large or too small.

[0113] By timing abnormal pupil states in users, the duration of these abnormal states can be monitored. If the timed duration does not reach a threshold, the abnormal pupil state can be assumed to be caused by a brief period of bright or dark visuals. In this case, prioritizing display quality, i.e., maintaining the current backlight brightness, is sufficient.

[0114] If the timed duration reaches a duration threshold, the user's third pupil size is detected. Then, using a target brightness prediction function, a second backlight brightness value corresponding to the third pupil size and the second visual perception score is predicted; the backlight brightness of the head-mounted display is adjusted based on the second backlight brightness value.

[0115] The third pupil size can be the value of the first pupil size detected after the timing duration reaches the duration threshold.

[0116] Thus, if the duration of the timer reaches the duration threshold, it can be assumed that the abnormal pupil state is caused by prolonged bright or dark images. In this case, user visual comfort can be prioritized.

[0117] In the step of predicting the first backlight brightness value using the target brightness prediction function, to ensure that the first backlight brightness value predicted by the target brightness prediction function approaches the most comfortable visual state for the user, so as to quickly bring the user's pupil size and backlight brightness to a stable state, one of the variables corresponding to the target brightness prediction function, "visual perception score," can be taken as a second visual perception score that represents the most comfortable visual perception state.

[0118] For example, after constructing the target brightness prediction function corresponding to the user, one of the variables in the target brightness prediction function, "visual perception score," can be determined as the second visual perception score. For instance, if the visual perception score corresponding to the most comfortable visual state is 10 points, then the second visual perception score can be set to 10 points. In this way, the second pupil size and the second visual perception score can be used as inputs to the target brightness prediction function to more accurately predict the first backlight brightness value required by the user.

[0119] In this way, each adjustment of the backlight brightness value puts the user in a visually comfortable state, thus preventing the user's pupils from constricting significantly.

[0120] For example, when the second pupil size is 4.3, the target brightness prediction function can be used to predict a first backlight brightness value of 451 nits. This first backlight brightness value of 451 nits can enable the user's pupil size to quickly recover to 3.0-4.0, thereby achieving a visually comfortable state.

[0121] It should be noted that the target brightness prediction function is used to predict the second backlight brightness value corresponding to the third pupil size and the second visual perception score. For details on the prediction of the first backlight brightness value, please refer to the description of the prediction of the first backlight brightness value. It will not be repeated here.

[0122] In some embodiments, after predicting the first backlight brightness value, the backlight brightness of the head-mounted display device can be directly adjusted to the first backlight brightness value.

[0123] In some embodiments, after predicting the first backlight brightness value, the current backlight brightness value of the head-mounted display device can also be obtained first. Then, it is determined whether the difference between the first backlight brightness value and the current backlight brightness value is greater than a brightness adjustment threshold. If the difference between the first backlight brightness value and the current backlight brightness value is greater than the brightness adjustment threshold, the backlight brightness of the head-mounted display device is adjusted to the first backlight brightness value. If the difference between the first backlight brightness value and the current backlight brightness value is less than or equal to the brightness adjustment threshold, the current backlight brightness is maintained.

[0124] For example, if the difference between the first backlight brightness value and the current backlight brightness value is greater than a brightness adjustment threshold, the processor of the head-mounted display device can send a first instruction to the backlight module, which instructs the backlight module to adjust the backlight brightness to the first backlight brightness value. If the difference between the first backlight brightness value and the current backlight brightness value is less than or equal to the brightness adjustment threshold, the processor of the head-mounted display device can send a second instruction (also called a brightness maintenance instruction) to the backlight module, which instructs the backlight module to maintain the current backlight brightness.

[0125] It should be noted that the brightness adjustment threshold can be the minimum brightness level that the head-mounted display device can adjust. Different head-mounted displays may have different minimum brightness levels. For example, the minimum level could be 50 nits, 5 nits, etc. Different head-mounted displays can set their own brightness adjustment thresholds based on their respective minimum brightness levels, and this application does not limit this.

[0126] In this embodiment, the above method allows for the construction of corresponding brightness prediction functions for different users. Then, the target brightness prediction function for the user wearing the head-mounted display can be used to predict the first backlight brightness value corresponding to the detected second pupil size. Finally, the backlight brightness of the head-mounted display is adjusted based on the first backlight brightness value. Because the user's visual perception score is incorporated into the target brightness prediction function, the first backlight brightness value that meets the user's visual comfort can be predicted more accurately based on the target brightness prediction function and the user's second pupil diameter. Thus, when adjusting the backlight brightness based on the first backlight brightness value, it does not cause significant pupil constriction, thereby quickly stabilizing the user's pupil size and backlight brightness, improving the user's visual comfort.

[0127] It is understood that the above embodiments are merely examples, and modifications can be made to the above embodiments in actual implementation. Those skilled in the art will understand that any modifications to the above embodiments that do not require creative effort fall within the protection scope of one or more embodiments of this specification, and will not be described again in the embodiments.

[0128] Based on the same inventive concept, one or more embodiments of this specification also provide a head-mounted display device, which may be VR glasses, VR helmets, AR glasses, AR helmets, MR glasses, MR helmets, etc., which will not be listed here.

[0129] In some embodiments, the head-mounted display device is configured with a processor, which can be used to perform the following operations: receiving a brightness test command input by a user; in response to receiving the brightness test command input by the user, displaying test images at multiple different test backlight brightness values; while displaying the test images at each test backlight brightness value, detecting the user's first pupil size corresponding to each test backlight brightness value, and receiving a first visual perception score input by the user corresponding to each test backlight brightness value; and constructing a target brightness prediction function corresponding to the user based on each test backlight brightness value, each first pupil size, and each first visual perception score.

[0130] In some embodiments, the processor may be configured to perform the following operations: construct a feature matrix based on each first pupil size and each first visual perception score; construct a target vector based on each test backlight brightness value; determine the average value of the user's pupil size based on each first pupil size; set the weight of the first pupil size that satisfies the average value as a first weight, and set the weight of the first pupil size that does not satisfy the average value as a second weight, wherein the first weight is greater than the second weight; and construct a target brightness prediction function corresponding to the user based on the feature matrix, the target vector, the first weight, and the first weight.

[0131] In some embodiments, after constructing the target brightness prediction function corresponding to the user, the processor may perform the following operations: detect the user's second pupil size; predict a first backlight brightness value corresponding to the second pupil size and the second visual perception score using the target brightness prediction function; the second visual perception score is used to characterize the most comfortable visual perception state; and adjust the backlight brightness of the head-mounted display device based on the first backlight brightness value.

[0132] In some embodiments, before receiving a brightness test command input by the user, the processor may perform the following operations: determine whether an existing account exists in the account list; the account list is used to record accounts corresponding to different brightness prediction functions; if no existing account exists in the account list, a first user interface is displayed on the head-mounted display device's screen, the first user interface including prompt information to prompt the user to perform a brightness test to establish a target account corresponding to the user; if an existing account exists in the account list, a second user interface is displayed, the second user interface including a new account option; receive a new account command input by the user; in response to receiving the new account command input by the user, the first user interface is displayed on the head-mounted display device's screen.

[0133] In some embodiments, after constructing the target brightness prediction function corresponding to the user, the processor may perform the following operations: receiving a user input instruction to select a target account; in response to receiving the user input instruction to select a target account, determining the target brightness prediction function corresponding to the target account; detecting the user's second pupil size; using the target brightness prediction function, predicting a first backlight brightness value corresponding to the second pupil size and the second visual perception score; and adjusting the backlight brightness of the head-mounted display device based on the first backlight brightness value.

[0134] In some embodiments, the processor may be configured to perform the following operations: determine whether the second pupil size is within the comfortable pupil size range; the comfortable pupil size range refers to the pupil size corresponding to a user's visually comfortable state; if it is determined that the second pupil size is not within the comfortable pupil size range, then use a target brightness prediction function to predict the first backlight brightness value corresponding to the second pupil size and the second visual perception score.

[0135] In some embodiments, the processor may be used to perform the following operation: if it is determined that the second pupil size is within the range of comfortable pupil size, send a brightness maintenance command to the backlight module of the head-mounted display device, the brightness maintenance command being used to instruct the backlight module to maintain the current backlight brightness.

[0136] In some embodiments, the processor may be configured to perform the following operations: determine whether the second pupil size is within the comfortable pupil size range; the comfortable pupil size range refers to the pupil size corresponding to a user's visually comfortable state; if the second pupil size is not within the comfortable pupil size range, then time an abnormal pupil state of the user's pupil; an abnormal pupil state refers to a state where the pupil size is not within the comfortable pupil size range; determine whether the duration of the timekeeping reaches a duration threshold; if the duration of the timekeeping reaches the duration threshold, then detect the user's third pupil size; predict the second backlight brightness value corresponding to the third pupil size and the second visual perception score using a target brightness prediction function; and adjust the backlight brightness of the head-mounted display device based on the second backlight brightness value.

[0137] In some embodiments, the processor may be used to perform the following operation: if the duration of the timing does not reach the duration threshold, a brightness maintenance command is sent to the backlight module of the head-mounted display device, the brightness maintenance command being used to instruct the backlight module to maintain the current backlight brightness.

[0138] It should also be noted that, unless otherwise specified, one or more embodiments of this specification and the features thereof can be combined with each other. This specification is not limited to any single aspect, nor to any single embodiment, nor to any combination and / or substitution of such aspects and / or embodiments. Furthermore, each aspect and / or embodiment of one or more embodiments of this specification can be used alone or in combination with one or more other aspects and / or embodiments thereof.

[0139] According to the method provided in the embodiments of this application, the embodiments of this application also provide a computer storage medium storing a computer program or instructions, which, when run on a computer, causes the computer to perform the method of any one of the embodiments of the method.

[0140] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0141] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A head-mounted display device, characterized in that, include: The processor is configured as follows: Receive brightness test commands input by the user; In response to receiving the brightness test command input by the user, test images are displayed under multiple different test backlight brightness values; When displaying the test image under each of the test backlight brightness values, the system detects the first pupil size of the user corresponding to each of the test backlight brightness values, and receives the first visual perception score input by the user corresponding to each of the test backlight brightness values. Based on the test backlight brightness values, the first pupil size, and the first visual perception score, a target brightness prediction function corresponding to the user is constructed.

2. The head-mounted display device according to claim 1, characterized in that, The processor is configured to construct a target brightness prediction function corresponding to the user based on each of the test backlight brightness values, each of the first pupil sizes, and each of the first visual perception scores, including: The processor is configured as follows: Based on each of the first pupil sizes and each of the first visual perception scores, a feature matrix is ​​constructed; Construct a target vector based on the test backlight brightness values; Based on each of the first pupil sizes, determine the average pupil size of the user; The weight of the first pupil size that satisfies the average value among all the first pupil sizes is set as the first weight, and the weight of the first pupil size that does not satisfy the average value among all the first pupil sizes is set as the second weight, wherein the first weight is greater than the second weight; Based on the feature matrix, the target vector, the first weight, and the first weight, a target brightness prediction function corresponding to the user is constructed.

3. The head-mounted display device according to claim 1, characterized in that, After constructing the target brightness prediction function corresponding to the user, the processor is further configured to: The visual perception score of the target brightness prediction function is determined as the second visual perception score, which is used to characterize the most comfortable visual perception state. Detect the user's second pupil size; Using the target brightness prediction function, a first backlight brightness value is predicted; wherein, the first backlight brightness value is the backlight brightness value corresponding to the second pupil size and the second visual perception score; The backlight brightness of the head-mounted display is adjusted based on the first backlight brightness value.

4. The head-mounted display device according to claim 1, characterized in that, Before receiving a brightness test command input by the user, the processor is further configured to: Determine if any existing accounts exist in the account list; the account list is used to record the accounts corresponding to different brightness prediction functions. If no existing account is found in the account list, a first user interface is displayed on the head-mounted display device. The first user interface includes a prompt message that prompts the user to perform a brightness test in order to establish a target account corresponding to the user. If an existing account exists in the account list, a second user interface is displayed, which includes the option to create a new account. Receive the user's instruction to create a new account; In response to receiving the user's instruction to create a new account, the first user interface is displayed on the monitor of the head-mounted display device.

5. The head-mounted display device according to claim 4, characterized in that, After constructing the target brightness prediction function corresponding to the user, the processor is further configured to: Receive the user's input instruction to select a target account; In response to receiving the user's input instruction to select a target account, determine the target brightness prediction function corresponding to the target account; The visual perception score of the target brightness prediction function is determined as the second visual perception score, which is used to characterize the most comfortable visual perception state. Detect the user's second pupil size; Using the target brightness prediction function, a first backlight brightness value is predicted; wherein, the first backlight brightness value is the backlight brightness value corresponding to the second pupil size and the second visual perception score; The backlight brightness of the head-mounted display is adjusted based on the first backlight brightness value.

6. The head-mounted display device according to claim 3 or 5, characterized in that, The processor is configured to predict a first backlight brightness value using the target brightness prediction function, including: The processor is configured as follows: Determine whether the second pupil size is within the comfortable pupil size range; the comfortable pupil size range refers to the pupil size corresponding to a user's visually comfortable state; If it is determined that the second pupil size is not within the range of comfortable pupil size, then the first backlight brightness value is predicted using the target brightness prediction function.

7. The head-mounted display device according to claim 6, characterized in that, The processor is also configured to: If it is determined that the second pupil size is within the comfortable pupil size range, a brightness maintenance command is sent to the backlight module of the head-mounted display device. The brightness maintenance command is used to instruct the backlight module to maintain the current backlight brightness.

8. The head-mounted display device according to claim 3 or 5, characterized in that, The processor is also configured to: Determine whether the second pupil size is within the comfortable pupil size range; the comfortable pupil size range refers to the pupil size corresponding to a user's visually comfortable state; If the second pupil size is not within the comfortable pupil size range, then the abnormal pupil state of the user's pupil is timed; The abnormal pupil state refers to a state where the pupil size is not within the comfortable pupil size range; Determine whether the duration of the timing has reached a duration threshold; If the duration of the timed event reaches a duration threshold, the user's third pupil size is detected. Using the target brightness prediction function, a second backlight brightness value is predicted; wherein, the second backlight brightness value is the backlight brightness value corresponding to the third pupil size and the second visual perception score; The backlight brightness of the head-mounted display is adjusted based on the second backlight brightness value.

9. The head-mounted display device according to claim 8, characterized in that, The processor is also configured to: If the duration of the timeout does not reach the duration threshold, a brightness maintenance command is sent to the backlight module of the head-mounted display device. The brightness maintenance command is used to instruct the backlight module to maintain the current backlight brightness.

10. A method for adjusting backlight brightness, characterized in that, The method is applied to a head-mounted display device, and the method includes: Receive brightness test commands input by the user; In response to receiving the brightness test command input by the user, test images are displayed under multiple different test backlight brightness values; When displaying the test image under each of the test backlight brightness values, the system detects the first pupil size of the user corresponding to each of the test backlight brightness values, and receives the first visual perception score input by the user corresponding to each of the test backlight brightness values. Based on the test backlight brightness values, the first pupil size, and the first visual perception score, a target brightness prediction function corresponding to the user is constructed.

Images