Display parameter adjusting method, head-mounted display device, readable medium and product

Abstract

The embodiment of the invention discloses a display parameter adjusting method, head-mounted display equipment, a readable medium and a product. A specific embodiment of the method comprises the following steps: collecting an eye image of a user through a camera device included in the head-mounted display equipment; based on the collected eye images of the users, recognizing blinking actions of the users; determining blinking frequency information according to the recognized blinking action; and adjusting the refresh rate of at least one display screen of the head-mounted display equipment in response to determining that the blinking frequency information meets a preset eye protection starting condition. According to the embodiment, the wearing user can be actively induced to blink, and the wearing experience of the user is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technology, and particularly to a method for adjusting display parameters, a head-mounted display device, a readable medium, and a product. Background Art

[0002] Smart glasses have broad application prospects in the field of augmented reality. However, long-term wearing of smart glasses may cause eye fatigue, resulting in symptoms such as dryness and soreness. Current eye protection technologies mainly rely on manual settings or simple reminders, and cannot adjust display parameters in real time and intelligently to protect eye health, thus leading to a poor wearing experience for users.

[0003] The above information disclosed in this background art section is only used to enhance the understanding of the background of the inventive concept, and thus, it may include information that does not form the prior art known to those of ordinary skill in the art. Summary of the Invention

[0004] The content part of the present disclosure is used to briefly introduce concepts, which will be described in detail in the following detailed implementation part. The content part of the present disclosure is not intended to identify the key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0005] Some embodiments of the present disclosure propose a method for adjusting display parameters, a head-mounted display device, a readable medium, and a product to solve one or more of the technical problems mentioned in the above background art section.

[0006] In a first aspect, some embodiments of the present disclosure provide a method for adjusting display parameters, the method including: collecting user eye images through a camera device included in the head-mounted display device; identifying a user's blinking action based on the collected user eye images; determining blinking frequency information according to the identified blinking action; and adjusting the refresh rate of at least one display screen of the head-mounted display device in response to determining that the blinking frequency information meets a preset eye protection start condition.

[0007] Optionally, determining the blinking frequency information according to the identified blinking action includes: determining the number of blinking actions identified within a preset time period; and generating blinking frequency information according to the time interval corresponding to the preset time period and the number.

[0008] Optionally, the method further includes: determining a blinking frequency information sequence; generating blinking frequency change information according to the blinking frequency information sequence; and adjusting the refresh rate of each display screen in the at least one display screen in response to determining that the blinking frequency change information meets a preset optimization adjustment condition.

[0009] Optionally, adjusting the refresh rate of at least one display screen of the above-mentioned head-mounted display device includes: performing the following adjustment steps on the at least one display screen: adjusting the refresh rate of each display screen in the at least one display screen according to a preset refresh rate; determining the blink frequency information after adjustment; in response to the blink frequency information after adjustment meeting the preset eye protection start condition, performing the above adjustment steps again; in response to the blink frequency information after adjustment not meeting the preset eye protection start condition, ending the above adjustment steps.

[0010] Optionally, the at least one display screen includes a left display screen and a right display screen; and adjusting the refresh rate of each display screen in the at least one display screen includes: adjusting the refresh rate of the left display screen according to a first adjustment method; adjusting the refresh rate of the right display screen according to a second adjustment method.

[0011] Optionally, adjusting the refresh rate of at least one display screen of the above-mentioned head-mounted display device includes: adjusting the display parameters of the at least one display screen of the above-mentioned head-mounted display device, where the display parameters include the refresh rate and at least one of the following: brightness and contrast.

[0012] Optionally, the above adjustment steps further include: in response to determining that the execution times of the above adjustment steps reach a preset number of times, displaying blink prompt information on the above-mentioned head-mounted display device.

[0013] In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, including: at least one display screen for imaging in front of a user's eyes; one or more processors; a storage device storing one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the method described in any implementation manner of the first aspect above.

[0014] In a third aspect, some embodiments of the present disclosure provide a computer-readable medium storing a computer program, where the program, when executed by a processor, implements the method described in any implementation manner of the first aspect above.

[0015] In a fourth aspect, some embodiments of the present disclosure provide a computer program product including a computer program, which when executed by a processor, implements the method described in any implementation manner of the first aspect above.

[0016] The above embodiments of the present disclosure have the following beneficial effects: Through the display parameter adjustment method of some embodiments of the present disclosure, the user wearing the device can be actively induced to blink, improving the user's wearing experience. Specifically, the reason for the poor user wearing experience is that it relies on manual settings or simple reminders and cannot adjust the display parameters in real time and intelligently to protect eye health, resulting in a poor user wearing experience. Based on this, in some embodiments of the display parameter adjustment method of the present disclosure, first, the user's eye image is collected through the camera device included in the head-mounted display device. Thus, the acquisition of the user's eye monitoring image can be realized. Then, based on the collected user eye images, the user's blinking action is recognized. Thus, the blinking action of the user during the process of wearing the head-mounted display device can be recognized. Next, according to the recognized blinking action, the blinking frequency information is determined. Thus, the frequency-related information of the user's blinking during the process of wearing the head-mounted display device can be determined. Finally, in response to determining that the above blinking frequency information meets the preset eye protection activation condition, the refresh rate of at least one display screen of the above head-mounted display device is adjusted. Thus, when the blinking frequency information meets the preset eye protection activation condition, the refresh rate of the display screen can be adjusted to induce the user to blink, so that the user can be induced to blink in real time and directly, the eye fatigue caused by the user's long-time viewing of the display screen can be alleviated, and further the user's wearing experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In combination with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages and aspects of the various embodiments of the present disclosure will become more obvious. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the elements and elements are not necessarily drawn to scale.

[0018] Figure 1 is a flowchart of some embodiments of the display parameter adjustment method according to the present disclosure;

[0019] Figure 2 is a flowchart of other embodiments of the display parameter adjustment method according to the present disclosure;

[0020] Figure 3 is a schematic structural diagram of a head-mounted display device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0022] In addition, it should be noted that for ease of description, only parts related to the relevant invention are shown in the drawings. Without conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0023] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence relationship of the functions performed by these devices, modules or units.

[0024] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless clearly specified otherwise in the context, it should be understood as "one or more".

[0025] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0026] For operations such as collection, storage, and use of the user's personal information (such as the user's eye image) involved in the present disclosure, before performing the corresponding operations, relevant organizations or individuals shall fulfill obligations including conducting a personal information security impact assessment, fulfilling the obligation of informing the personal information subject, and obtaining the prior authorization and consent of the personal information subject.

[0027] The present disclosure will be described in detail below with reference to the drawings and in conjunction with the embodiments.

[0028] Figure 1 Flow 100 of some embodiments of a display parameter adjustment method according to the present disclosure is shown. The display parameter adjustment method includes the following steps:

[0029] Step 101, collecting a user's eye image through a camera device included in a head-mounted display device.

[0030] In some embodiments, the execution subject of the display parameter adjustment method (such as a head-mounted display device) can collect user eye images through a camera device included in the head-mounted display device. Among them, the head-mounted display device can be a display device for wearing on the head to view imaging content. The above-mentioned head-mounted display device can include but is not limited to: AR glasses, VR glasses, and MR glasses. The above-mentioned camera device can include a built-in camera, which can be used to capture images of the eyes of the wearing user. The above-mentioned built-in camera can be an infrared camera. The above-mentioned user eye image can be an image of the eyes of the wearing user captured by the built-in camera. In practice, the above-mentioned execution subject can control the above-mentioned built-in camera to collect user eye images at a preset acquisition frequency.

[0031] Step 102: Based on the collected user eye images, identify the user's blinking action.

[0032] In some embodiments, the above-mentioned execution subject can identify the user's blinking action based on the collected user eye images. In practice, the above-mentioned execution subject can use a deep learning model or a computer vision algorithm to identify the user's blinking action by using the collected user eye images. For example, the above-mentioned deep learning model can include but is not limited to: CNN, ResNet, LSTM. The above-mentioned computer vision algorithms can include but are not limited to: blinking detection methods based on feature point detection, optical flow methods.

[0033] Step 103: Determine the blinking frequency information according to the identified blinking action.

[0034] In some embodiments, the above-mentioned execution subject can determine the blinking frequency information according to the identified blinking action. In practice, the above-mentioned execution subject can determine the ratio of the number of blinking actions identified within a preset time period to the time interval corresponding to the preset time period as the blinking frequency information. For example, the preset time period can be the time period corresponding to the most recent 5 minutes. The time interval can be 5 minutes.

[0035] In some optional implementation manners of some embodiments, the above-mentioned execution subject can determine the blinking frequency information according to the identified blinking action through the following steps:

[0036] The first step: Determine the number of blinking actions identified within a preset time period. For example, the above-mentioned preset time period can be the time period corresponding to the most recent 1 minute.

[0037] Step 2: Generate blink frequency information based on the time interval corresponding to the above preset time period and the above number of times. In practice, the above execution entity may first determine the ratio of the above number of times to the time interval corresponding to the above preset time period as the initial blink frequency information. Then, the average value of a preset number of consecutive initial blink frequency information can be determined as the blink frequency information. For example, the above preset number may be 5. Thus, the comprehensive blink frequency within a recent time period can be determined.

[0038] Step 104: In response to determining that the blink frequency information meets the preset eye protection activation condition, adjust the refresh rate of at least one display screen of the head-mounted display device.

[0039] In some embodiments, the above execution entity may, in response to determining that the above blink frequency information meets the preset eye protection activation condition, adjust the refresh rate of at least one display screen of the above head-mounted display device. Among them, the above preset eye protection activation condition may be that the blink frequency information is less than a preset threshold. When the blink frequency information is less than the preset threshold, it can be determined that the user is in an eye fatigue state and the eye protection function needs to be turned on, that is, the refresh rate of at least one display screen of the above head-mounted display device needs to be adjusted. In practice, the above execution entity may adjust the refresh rate of at least one display screen of the above head-mounted display device to a preset refresh rate, so that the refresh rate of at least one display screen changes, thereby inducing the user to blink. It can be understood that the refresh rate of any one display screen can be adjusted, or the refresh rates of all display screens can be adjusted. It should be noted that the adjustment of the refresh rate is performed within a preset time, and after the adjustment is completed, the refresh rate of the display screen can be restored to the original refresh rate.

[0040] In some alternative implementation manners of some embodiments, the above execution entity may adjust the display parameters of at least one display screen of the above head-mounted display device. Among them, the above display parameters include the refresh rate and at least one of the following: brightness and contrast. For example, the brightness and contrast of at least one display screen can be adjusted while adjusting the refresh rate of at least one display screen. As an example, the brightness and contrast can be increased by a preset value. Thus, the refresh rate of the display screen and other display attributes can be adjusted simultaneously to enhance the effect of inducing blinking.

[0041] In some alternative implementation manners of some embodiments, the above execution entity may adjust the refresh rate of at least one display screen of the above head-mounted display device through the following steps:

[0042] Execute the following adjustment steps on the above at least one display screen:

[0043] First step: Adjust the refresh rate of each display screen among the at least one display screen according to a preset refresh rate. In practice, the above-mentioned execution entity can increase the refresh rate of each display screen by the preset refresh rate. The above-mentioned execution entity can also decrease the refresh rate of each display screen by the preset refresh rate. For example, the preset refresh rate can be 5 Hz.

[0044] Second step: Determine the adjusted blink frequency information. The determination method of the adjusted blink frequency information can refer to the determination method of the blink frequency information in steps 101 - 103, which will not be elaborated here.

[0045] Third step: In response to the adjusted blink frequency information satisfying the preset eye protection start condition, execute the above adjustment steps again.

[0046] Fourth step: In response to the adjusted blink frequency information not satisfying the preset eye protection start condition, end the above adjustment steps. Thus, the refresh rate of each display screen can be continuously adjusted until it no longer satisfies the preset eye protection start condition, so that the refresh rate can be dynamically adjusted.

[0047] Optionally, the above adjustment steps may further include: In response to determining that the execution times of the above adjustment steps reach the preset times, display a blink prompt message on the above head-mounted display device. Among them, the above blink prompt message can be used to prompt the user to blink actively. The above blink prompt message may include at least one of the following: text, picture, animated picture. Thus, when the user is not sensitive to the adjusted refresh rate, the user can be prompted to blink by an active prompt method.

[0048] Optionally, the above-mentioned execution entity may also execute the following steps:

[0049] First step: For each acquired user eye image, execute the following steps:

[0050] First sub-step: Identify the eyelid contour in the above user eye image to obtain an eyelid contour image. In practice, the above-mentioned execution entity can use an edge detection algorithm (such as Canny) to identify the eyelid contour in the above user eye image to obtain an eyelid contour image.

[0051] Second sub-step: Generate eyelid opening and closing information according to the above eyelid contour image. In practice, the above-mentioned execution entity can measure the distance between the upper and lower eyelids in the eyelid contour image as the eyelid opening and closing information.

[0052] Third sub-step: Identify the pupil center position in the above user eye image. In practice, the above-mentioned execution entity can use open source libraries such as Pupil Labs to locate the pupil center.

[0053] Fourth sub-step: Generate a line of sight direction based on the above pupil center position. In practice, the above execution entity can use calibration data to convert the pupil center position into a line of sight direction. The calibration data can include a center point and a scale factor. The center point can be the geometric center of the glasses or the average value of all pupil positions during the calibration process. The scale factor can be the proportional relationship between the distance from the pupil position to each calibration point and the actual line of sight angle, which is used to convert the pixel distance into an actual angular change and can include scale factors in the horizontal and vertical directions. For example, the difference between the abscissa of the pupil center position and the abscissa of the above center point can be determined as the abscissa offset. Then, the difference between the ordinate of the pupil center position and the ordinate of the above center point can be determined as the ordinate offset. Next, the product of the abscissa offset and the scale factor in the horizontal direction can be determined as the line of sight angle in the horizontal direction. Secondly, the product of the ordinate offset and the scale factor in the vertical direction can be determined as the line of sight angle in the vertical direction. Finally, the line of sight angle in the horizontal direction and the line of sight angle in the vertical direction can be determined as the line of sight direction.

[0054] Fifth sub-step: Identify the pupil boundary in the above user eye image to obtain a pupil boundary image. In practice, the above execution entity can use an edge detection algorithm to identify the pupil boundary in the above user eye image to obtain a pupil boundary image.

[0055] Sixth sub-step: Generate a pupil size based on the above pupil boundary image. In practice, the above execution entity can measure the area or diameter of the boundary in the pupil boundary image as the pupil size.

[0056] Second step: Determine the determined blink frequency information as a blink frequency information sequence. In practice, the determined blink frequency information can be determined as a blink frequency information sequence in ascending order of time.

[0057] Third step: Determine the generated eyelid opening and closing information as an eyelid opening and closing information sequence. In practice, the generated eyelid opening and closing information can be determined as an eyelid opening and closing information sequence in ascending order of time.

[0058] Fourth step: Determine the generated line of sight directions as a line of sight direction sequence. In practice, the generated line of sight directions can be determined as a line of sight direction sequence in ascending order of time.

[0059] Fifth step: Determine the generated pupil sizes as a pupil size sequence. In practice, the generated pupil sizes can be determined as a pupil size sequence in ascending order of time.

[0060] Step 6: Collect physiological signal data to obtain a physiological signal data sequence. Among them, the above-mentioned physiological signal data may include, but is not limited to: heart rate. The heart rate can be collected by a bracelet connected through communication.

[0061] Step 7: Perform time-step integration processing on the above-mentioned blink frequency information sequence, the above-mentioned eyelid opening and closing information sequence, the above-mentioned line-of-sight direction sequence, and the above-mentioned pupil size sequence to obtain an eye feature data sequence. It should be noted that the collection time steps of the above data sequences can be the same or different. When the collection time steps of the above data sequences are different, the data sequence with a shorter time step can be converted to a longer time step in an averaging manner. Then, for each converted time step, the blink frequency information, eyelid opening and closing information, line-of-sight direction, and pupil size corresponding to the above time step can be selected from the above-mentioned blink frequency information sequence, the above-mentioned eyelid opening and closing information sequence, the above-mentioned line-of-sight direction sequence, and the above-mentioned pupil size sequence to be combined into eye feature data. Finally, the combined eye feature data can be determined as the eye feature data sequence.

[0062] Step 8: Input the above-mentioned physiological signal data sequence and the above-mentioned eye feature data sequence into the feature extraction layer included in the pre-trained eye behavior prediction model to obtain a fused feature vector. Among them, the eye behavior prediction model can be a neural network model that takes the physiological signal data sequence and the eye feature data sequence as inputs and the action probability distribution as outputs. The above-mentioned neural network model can be a hybrid model combining reinforcement learning and deep learning. The action probability distribution can represent the probability distribution of whether to perform blink induction. The above-mentioned eye behavior prediction model can include a feature extraction layer, a state representation layer, a policy network, a value network, and a feedback adjustment layer. The feature extraction layer can use a convolutional neural network or a recurrent neural network to capture spatial and temporal features in time series data. For example, a convolutional neural network can detect edges and textures in an image, and a recurrent neural network is good at dealing with dynamic changes in time series data. Thus, the feature extraction layer can fuse data from different sources to generate a unified feature representation for subsequent modules to use.

[0063] Step 9: Input the above-mentioned fused feature vector into the above-mentioned state representation layer to obtain a state vector. The state representation layer can further compress the extracted features into a compact state representation to meet the requirements of reinforcement learning. The state representation layer can be implemented using a fully connected layer or a self-attention mechanism. The fully connected layer can map high-dimensional features to a low-dimensional state vector, and the self-attention mechanism can help the model better understand the relationship between features, especially in the case of multi-modal data. The state vector can be a key input in reinforcement learning, representing the current state of the environment and used to guide the decisions of the policy network and the value network.

[0064] Step 10: Input the above state vector into the above policy network to obtain the action probability distribution. The policy network can generate the probability distribution of actions based on the current state and determine which action to take. The goal of the policy network can be to maximize the long-term reward, that is, to induce the user to blink at an appropriate time point. The policy network is usually a multi-layer perceptron composed of multiple fully connected layers. Each layer applies a non-linear activation function (such as ReLU) to increase the expressive power of the model. The output action probability distribution represents the possibility of each action being selected. For example, the policy network can output the probabilities of "perform blink induction" and "do not perform induction".

[0065] Step 11: Input the above state vector into the above value network to obtain the state value. The value network can be used to evaluate the value of taking a certain action in the current state, help optimize the policy network, and estimate the total reward that can be obtained by following the current policy starting from the current state. The value network can also be a multi-layer perceptron, similar to the policy network, but its output is a scalar value representing the value of the current state. By calculating the state value, the value network can help determine which states are favorable and guide the policy network to make better decisions.

[0066] Step 12: Determine the induction action according to the above action probability distribution. In practice, the above execution entity can determine the action type with a higher probability as the induction action. For example, the probability of "perform blink induction" can be 70%, and the probability of "do not perform induction" can be 30%, then the induction action can be "perform blink induction".

[0067] Step 13: Execute the induction operation corresponding to the above induction action. Here, the induction operation can be to adjust the refresh rate of at least one display screen of the above head-mounted display device. The specific implementation method can refer to Figure 1 Step 104 in the corresponding embodiments, which will not be elaborated here.

[0068] Step 14: Determine the user response action of the user to the above induction operation. The user response action can characterize whether the user blinks under the above induction operation.

[0069] Step 15: Input the above user response action, the above state vector, and the above induction action into the above feedback adjustment layer to obtain the updated policy parameters. The feedback adjustment layer can adjust the parameters of the policy network according to the user's response, so that the model can better adapt to the user's behavior pattern. A reinforcement learning algorithm (such as the Actor-Critic method) can be used for parameter update. After each interaction, the model can adjust the weights of the policy network and the value network according to the difference between the user's actual response and the expected result (i.e., the TD error).

[0070] In the sixteenth step, update the above-mentioned policy network and value network according to the above-mentioned policy parameters and state values to optimize and update the eye behavior prediction model. Thus, through continuous learning and adjustment, the model can gradually optimize its policy, improve the success rate of inducing users to blink, and enhance the user experience.

[0071] The above steps 1-16 are an inventive point of the embodiments of the present disclosure, which solve the technical problem of "determining blink induction based on threshold judgment or fixed rules, being difficult to cope with complex and changeable actual environments and user behavior habits, resulting in poor accuracy in determining the timing of blink induction and causing a poor wearing experience for users". The factors that lead to a poor wearing experience for users are often as follows: determining blink induction based on threshold judgment or fixed rules, being difficult to cope with complex and changeable actual environments and user behavior habits, resulting in poor accuracy in determining the timing of blink induction. If the above factors are solved, the effect of improving the user's wearing experience can be achieved. To achieve this effect, the present disclosure adopts a hybrid model combining reinforcement learning and deep learning to capture the user's real-time eye state, predict the user's current state, and decide when to induce the user to blink, and can also dynamically adjust the prompting strategy according to historical data. Thereby, the prediction accuracy of the model is improved, the accuracy of determining the timing of blink induction is improved, and thus the user's wearing experience is improved.

[0072] The above-mentioned embodiments of the present disclosure have the following beneficial effects: Through the display parameter adjustment method of some embodiments of the present disclosure, the wearing user can be actively induced to blink, improving the user's wearing experience. Specifically, the reason for the poor wearing experience of users is that relying on manual settings or simple reminders, it is impossible to adjust the display parameters in real time and intelligently to protect eye health, resulting in a poor wearing experience for users. Based on this, the display parameter adjustment method of some embodiments of the present disclosure first collects the user's eye images through the camera device included in the head-mounted display device. Thus, the collection of the user's eye monitoring images can be realized. Then, based on the collected user eye images, the user's blink action is recognized. Thus, the blink action of the user during the wearing of the head-mounted display device can be recognized. Next, according to the recognized blink action, the blink frequency information is determined. Thus, the frequency-related information of the user's blink during the wearing of the head-mounted display device can be determined. Finally, in response to determining that the above blink frequency information meets the preset eye protection start condition, the refresh rate of at least one display screen of the above head-mounted display device is adjusted. Thus, when the blink frequency information meets the preset eye protection start condition, the refresh rate of the display screen can be adjusted to induce the user to blink, so that the user can be induced to blink in real time and directly, the eye fatigue caused by the user's long-term viewing of the display screen can be relieved, and thus the user's wearing experience can be improved.

[0073] For further referenceFigure 2 , which shows the process 200 of some other embodiments of the display parameter adjustment method. The process 200 of the display parameter adjustment method includes the following steps:

[0074] Step 201, collect user eye images through a camera device included in the head-mounted display device.

[0075] Step 202, identify the user's blinking action based on the collected user eye images.

[0076] Step 203, determine the blinking frequency information according to the identified blinking action.

[0077] Step 204, in response to determining that the blinking frequency information meets the preset eye protection activation condition, adjust the refresh rate of at least one display screen of the head-mounted display device.

[0078] In some embodiments, the specific implementation and the technical effects brought by steps 201-204 can refer to Figure 1 Steps 101-104 in the corresponding embodiments, which will not be elaborated here.

[0079] Step 205, determine the blinking frequency information sequence.

[0080] In some embodiments, in some embodiments, the execution subject of the display parameter adjustment method (such as the head-mounted display device) can determine the blinking frequency information sequence. In practice, the above execution subject can sequentially combine the determined blinking frequency information into a blinking frequency information sequence. Each blinking frequency information can correspond to a time period.

[0081] Step 206, generate blinking frequency change information according to the blinking frequency information sequence.

[0082] In some embodiments, the above execution subject can generate blinking frequency change information according to the above blinking frequency information sequence. In practice, the above execution subject can sequentially combine the differences between the respective blinking frequency information in the above blinking frequency information sequence and the above preset threshold into the blinking frequency change information.

[0083] Step 207, in response to determining that the blinking frequency change information meets the preset optimization adjustment condition, adjust the refresh rate of each display screen in at least one display screen.

[0084] In some embodiments, the above-mentioned execution entity may adjust the refresh rate of each display screen among the at least one display screen in response to determining that the above-mentioned blink frequency change information meets a preset optimization adjustment condition. Among them, the above-mentioned preset optimization adjustment condition may be that each difference corresponding to the most recent preset period in the blink frequency change information is less than 0. For example, the above-mentioned most recent preset period may be the time period corresponding to the most recent 10 minutes, which may indicate that when the blink frequency information is less than the preset threshold for 10 minutes, it is necessary to adjust the refresh rate of each display screen among the at least one display screen. The at least one display screen may include a left display screen and a right display screen. In practice, the above-mentioned execution entity may adjust the refresh rate of the left display screen according to a first adjustment method, and may adjust the refresh rate of the right display screen according to a second adjustment method. The above-mentioned first adjustment method and the above-mentioned second adjustment method may be two different adjustment methods. For example, the first adjustment method may be to increase the original refresh rate by a preset value. The second adjustment method may be to decrease the original refresh rate by a preset value. The increased preset value and the decreased preset value may be the same or different. For example, the increased preset value and the decreased preset value may both be 5Hz. Here, the specific settings of the first adjustment method and the second adjustment method are not limited. It should be noted that the adjustment of the refresh rate is performed within a preset time, and after the adjustment is completed, the refresh rate of the display screen may be restored to the original refresh rate.

[0085] It can be seen from Figure 2 that compared with the description of some embodiments corresponding to Figure 1 the process 200 of the display parameter adjustment method in some embodiments corresponding to Figure 2 embodies steps for expanding further refresh rate adjustments. Thus, the solutions described in these embodiments can monitor changes in the user's blinking actions over a longer time period, so that when the preset optimization adjustment conditions are met, different adjustment methods can be applied to each display screen, thereby increasing the degree of induction of blinking, and thus optimizing the eye protection effect.

[0086] Next, refer to Figure 3 , which shows a schematic structural diagram of a head-mounted display device 300 (such as an AR glasses) suitable for implementing some embodiments of the present disclosure. Figure 3 The head-mounted display device shown is only an example and should not impose any limitations on the functions and usage scopes of the embodiments of the present disclosure.

[0087] As shown in Figure 3As shown, the head-mounted display device 300 may include a processing device 301 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from a storage device 308 into a random access memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the head-mounted display device 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other through a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0088] Generally, the following devices may be connected to the I / O interface 305: an input device 306 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 307 including, for example, a micro display, a speaker, a vibrator, etc.; and a communication device 309. The communication device 309 may allow the head-mounted display device 300 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 3 a head-mounted display device 300 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. Instead, more or fewer devices may be implemented or had. Figure 3 Each block shown in may represent a device or, as needed, multiple devices.

[0089] In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program codes for performing the methods shown in the flowcharts. In such some embodiments, the computer program may be downloaded and installed from a network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. When the computer program is executed by the processing device 301, the above functions defined in the methods of some embodiments of the present disclosure are executed.

[0090] It should be noted that the computer-readable media described in some embodiments of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, the computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0091] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed network.

[0092] The above computer-readable medium may be included in the above head-mounted display device; or it may exist separately without being assembled into the head-mounted display device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the head-mounted display device, the head-mounted display device is caused to: collect user eye images through a camera device included in the head-mounted display device; recognize the user's blinking actions based on the collected user eye images; determine blinking frequency information according to the recognized blinking actions; and in response to determining that the above blinking frequency information meets a preset eye protection start condition, adjust the refresh rate of at least one display screen of the above head-mounted display device.

[0093] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages or combinations thereof. The above programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, by using an Internet service provider to connect through the Internet).

[0094] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0095] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0096] Some embodiments of the present disclosure also provide a computer program product, including a computer program which, when executed by a processor, implements any of the above display parameter adjustment methods.

[0097] The above description is only some preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, technical solutions formed by mutually replacing the above features with technical features having similar functions (but not limited to) disclosed in the embodiments of the present disclosure.

Claims

1. A display parameter adjustment method, applied to a head mounted display device, comprising: Capturing an eye image of the user through a camera device included in the head mounted display device; Based on the collected eye images of each user, identifying the user's blinking action; Determine blink frequency information according to the identified blink action; In response to determining that the blink frequency information meets a preset eye protection start condition, a refresh rate of at least one display screen of the head mounted display device is adjusted.

2. The method according to claim 1, wherein: Determining the blink frequency information according to the identified blink action includes: Determining the number of blinks recognized within a preset time period; Blink frequency information is generated according to the time interval corresponding to the preset time period and the number of times.

3. The method according to claim 1, wherein: The method further comprises: Determine the blink frequency information sequence; generating blink frequency change information according to the blink frequency information sequence; In response to determining that the blink frequency change information satisfies a preset optimization adjustment condition, the refresh rate of each display screen in the at least one display screen is adjusted.

4. The method according to claim 1, wherein: The adjusting the refresh rate of at least one display screen of the head mounted display device comprises: The following adjustment steps are performed on the at least one display screen: Adjusting the refresh rate of each display screen in the at least one display screen according to a preset refresh frequency; Determine the blink frequency information after adjustment; In response to the adjusted blink frequency information satisfying the preset eye protection start condition, performing the adjustment step again; In response to the adjusted blink frequency information not satisfying the preset eye protection start condition, the adjustment step is ended.

5. The method according to claim 3, wherein: The at least one display screen includes a left display screen and a right display screen; and adjusting the refresh rate of each display screen in the at least one display screen includes: According to the first adjustment method, adjusting the refresh rate of the left display screen; According to the second adjustment method, the refresh rate of the right display screen is adjusted.

6. The method according to claim 1, wherein: The adjusting the refresh rate of at least one display screen of the head mounted display device comprises: The display parameters of at least one display screen of the head mounted display device are adjusted, wherein the display parameters include a refresh rate and at least one of the following: brightness and contrast.

7. The method according to claim 4, wherein: The adjusting step further comprises: In response to determining that the number of executions of the adjustment step reaches a preset number of times, blink prompt information is displayed in the head mounted display device.

8. A head mounted display device, comprising: at least one display screen for forming an image in front of the user's eyes; one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

9. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 7.

Images