Data processing method, apparatus and device

By obtaining the position of the upper eyelid and the area of ​​the open eyes of the terminal device user, the lighting and display are adjusted to determine the intensity of visual stimulation, thus solving the problem of the harmful effects of display screens on eye health and achieving effective protection.

CN114494672BActive Publication Date: 2026-04-21崔刚
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
崔刚
Filing Date
2021-12-13
Publication Date
2026-04-21

AI Technical Summary

Technical Problem

In the existing technology, the display screen of terminal devices is quite harmful to eye health, and manual adjustment based on experience cannot effectively reduce the damage to users' eyes caused by the display screen.

Method used

By acquiring multiple upper eyelid positions and multiple eye opening areas within a user's preset time period, the lighting of the lighting device and/or the display of the terminal device are adjusted to determine the intensity of visual stimulation, and adjustments are made according to the intensity of visual stimulation to protect the user's eyes.

Benefits of technology

Accurately adjust lighting and display to reduce damage to users' eyes from display screens and reduce the harm of terminal devices to eye health.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114494672B_ABST
    Figure CN114494672B_ABST
Patent Text Reader

Abstract

This application provides a data processing method, apparatus, and device applied to a terminal device. The method includes: acquiring multiple upper eyelid positions and multiple eye opening areas within a preset time period; adjusting the illumination of a lighting device and / or the display of the terminal device based on the multiple upper eyelid positions and multiple eye opening areas, wherein the lighting device is used to provide ambient lighting to the terminal device. This reduces the harm of the terminal device to the user's eye health.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of visual technology, and in particular to a data processing method, apparatus, and device. Background Technology

[0002] With the development of screen technology, most commonly used terminal devices will be equipped with display screens (such as mobile phones, computers, etc.). The widespread use of display screens poses a threat to users' eye health.

[0003] Currently, screen parameters can be adjusted based on human experience to reduce eye strain. For example, in bright light (e.g., outdoors), screen brightness can be set to maximum, while in dim light (e.g., indoors at night), brightness can be set to minimum. However, the intensity of stimulation to the eyes varies in different scenarios. Adjusting screen brightness based on human experience alone cannot effectively reduce eye strain, ultimately leading to significant harm to eye health from terminal device displays. Summary of the Invention

[0004] This application provides a data processing method, apparatus, and device to address the technical problem in the prior art that the display screen of terminal devices poses a significant risk to eye health.

[0005] In a first aspect, this application provides a data processing method applied to a terminal device, the method comprising:

[0006] Obtain multiple upper eyelid positions and multiple eye opening areas within a user-preset time period;

[0007] Based on the multiple upper eyelid positions and multiple eye opening areas, the lighting of the lighting device and / or the display of the terminal device are adjusted, wherein the lighting device is used to provide ambient lighting to the terminal device.

[0008] In one possible implementation, adjusting the illumination of the lighting device and / or the display of the terminal device based on the plurality of upper eyelid positions and the plurality of eye opening areas includes:

[0009] The intensity of visual stimulation to the user's eyes is determined based on the multiple upper eyelid positions and the multiple eye opening areas, and the intensity of visual stimulation is used to indicate the degree of stimulation received by the user's eyes;

[0010] Adjust the illumination of the lighting device and / or the display of the terminal device according to the intensity of the visual stimulus.

[0011] In one possible implementation, determining the intensity of visual stimulation to the user's eyes based on the plurality of upper eyelid positions and the plurality of eye opening areas includes:

[0012] Based on the multiple upper eyelid positions, determine the first change information of the upper eyelid within the preset time period;

[0013] Based on the multiple eye opening areas, determine the second change information of the eye opening area within the preset time period;

[0014] The intensity of visual stimulation to the user's eyes is determined based on the first change information and the second change information.

[0015] In one possible implementation, the first change information is a first waveform, and the second change information is a second waveform; determining the intensity of visual stimulation to the user's eye based on the first change information and the second change information includes:

[0016] Based on the first waveform, determine the first average value of the upper eyelid position within the preset time period;

[0017] Based on the second waveform, determine the second average value of the eye opening area within the preset time period;

[0018] The intensity of visual stimulation to the user's eyes is determined based on the first average value and the second average value.

[0019] In one possible implementation, determining the intensity of visual stimulation to the user's eye based on the first average value and the second average value includes:

[0020] The first average value and the second average value are input into a preset model to obtain the visual stimulus intensity of the user's eyes;

[0021] The preset model is learned from multiple sets of samples, each set of samples including the first average value of the samples, the second average value of the samples, and the intensity of the visual stimulus of the samples.

[0022] In one possible implementation, acquiring multiple upper eyelid positions and multiple eye opening areas within a preset time period includes:

[0023] Acquire multiple eye images of the user collected within the preset time period;

[0024] Based on the multiple eye images, the positions of the multiple upper eyelids and the opening areas of the multiple eyes are determined.

[0025] In one possible implementation, adjusting the illumination of the lighting device and / or the display of the terminal device according to the intensity of the visual stimulus includes:

[0026] If the intensity of the visual stimulus is less than the first threshold, the lighting of the lighting device and / or the display of the terminal device will not be adjusted.

[0027] If the intensity of the visual stimulus is greater than or equal to the first threshold, then the illumination brightness, color temperature, and / or the backlight intensity, background color, text information, and screen reflection of the lighting device are adjusted according to the intensity of the visual stimulus.

[0028] In another possible implementation, after adjusting the illumination of the lighting device and / or the display of the terminal device according to the intensity of the visual stimulus, the method further includes:

[0029] Acquire the intensity of the second visual stimulus;

[0030] Based on the intensity of the second visual stimulus, a prompt message is generated, which includes recommended usage time information for the terminal device.

[0031] In one possible implementation, a cue message is generated based on the intensity of the second visual stimulus, including:

[0032] Obtain a first preset relationship, which includes at least one visual stimulus intensity and duration recommendation information corresponding to each visual stimulus intensity;

[0033] The prompt information is generated based on the intensity of the second visual stimulus and the first preset relationship.

[0034] Secondly, embodiments of this application provide a data processing apparatus applied to a terminal device, the data processing apparatus comprising a first acquisition module and an adjustment module, wherein:

[0035] The first acquisition module is used to acquire multiple upper eyelid positions and multiple eye opening areas within a preset time period for the user;

[0036] The adjustment module is used to adjust the lighting of the lighting device and / or the display of the terminal device according to the multiple upper eyelid positions and multiple eye opening areas, wherein the lighting device is used to provide ambient lighting to the terminal device.

[0037] In one possible implementation, the adjustment module is specifically used for:

[0038] The intensity of visual stimulation to the user's eyes is determined based on the multiple upper eyelid positions and the multiple eye opening areas, and the intensity of visual stimulation is used to indicate the degree of stimulation received by the user's eyes;

[0039] Adjust the illumination of the lighting device and / or the display of the terminal device according to the intensity of the visual stimulus.

[0040] In one possible implementation, the adjustment module is specifically used for:

[0041] Based on the multiple upper eyelid positions, determine the first change information of the upper eyelid within the preset time period;

[0042] Based on the multiple eye opening areas, determine the second change information of the eye opening area within the preset time period;

[0043] The intensity of visual stimulation to the user's eyes is determined based on the first change information and the second change information.

[0044] In one possible implementation, the adjustment module is specifically used for:

[0045] Based on the first waveform, determine the first average value of the upper eyelid position within the preset time period;

[0046] Based on the second waveform, determine the second average value of the eye opening area within the preset time period;

[0047] The intensity of visual stimulation to the user's eyes is determined based on the first average value and the second average value.

[0048] In one possible implementation, the adjustment module is specifically used for:

[0049] The first average value and the second average value are input into a preset model to obtain the visual stimulus intensity of the user's eyes;

[0050] The preset model is learned from multiple sets of samples, each set of samples including the first average value of the samples, the second average value of the samples, and the intensity of the visual stimulus of the samples.

[0051] In one possible implementation, the first acquisition module is specifically used for:

[0052] Acquire multiple eye images of the user collected within the preset time period;

[0053] Based on the multiple eye images, the positions of the multiple upper eyelids and the opening areas of the multiple eyes are determined.

[0054] In one possible implementation, the adjustment module is specifically used for:

[0055] If the intensity of the visual stimulus is less than the first threshold, the lighting of the lighting device and / or the display of the terminal device will not be adjusted.

[0056] If the intensity of the visual stimulus is greater than or equal to the first threshold, then the illumination brightness, color temperature, and / or the backlight intensity, background color, text information, and screen reflection of the lighting device are adjusted according to the intensity of the visual stimulus.

[0057] In another possible implementation, the data processing apparatus further includes a second acquisition module, the second acquisition module being used for:

[0058] Acquire the intensity of the second visual stimulus;

[0059] Based on the intensity of the second visual stimulus, a prompt message is generated, which includes recommended usage time information for the terminal device.

[0060] In one possible implementation, the second acquisition module is specifically used for:

[0061] Obtain a first preset relationship, which includes at least one visual stimulus intensity and duration recommendation information corresponding to each visual stimulus intensity;

[0062] The prompt information is generated based on the intensity of the second visual stimulus and the first preset relationship.

[0063] Thirdly, embodiments of this application provide an image processing device, including: a processor and a memory;

[0064] The memory stores computer-executed instructions;

[0065] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the data processing method described in the first aspect and various possible designs of the first aspect.

[0066] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the data processing method described in the first aspect and various possible designs of the first aspect.

[0067] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the data processing method described in the first aspect and various possible designs of the first aspect.

[0068] This application provides a data processing method, apparatus, and device applied to a terminal device. The terminal device acquires multiple upper eyelid positions and multiple eye opening areas within a preset time period for the user. Based on these multiple upper eyelid positions and eye opening areas, it adjusts the lighting of a lighting device and / or the display of the terminal device. The lighting device provides ambient lighting to the terminal device. In this method, since the upper eyelid positions and eye opening areas accurately reflect the impact of the display screen on the user's eyes, the terminal device can accurately adjust the lighting of the lighting device and / or the display of the terminal device based on these parameters. Furthermore, by jointly adjusting the lighting device and the display of the terminal device, the damage to the user's eyes from the display screen can be effectively reduced, thereby reducing the harm of the terminal device to the user's eye health. Attached Figure Description

[0069] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of this application;

[0070] Figure 2 A flowchart illustrating a data processing method provided in an embodiment of this application;

[0071] Figure 3 A schematic diagram of a first waveform provided in an embodiment of this application;

[0072] Figure 4 A schematic diagram providing a second waveform for an embodiment of this application;

[0073] Figure 5 A schematic diagram illustrating the adjustment of a lighting device and a terminal device display, provided as an embodiment of this application;

[0074] Figure 6 This application provides a schematic flowchart of a method for generating prompt information using a terminal device.

[0075] Figure 7 This is a schematic diagram illustrating the generation of prompt information provided in an embodiment of this application;

[0076] Figure 8 This is a schematic diagram of a data processing method provided in an embodiment of this application;

[0077] Figure 9 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0078] Figure 10 This is a schematic diagram of another data processing apparatus provided in an embodiment of this application;

[0079] Figure 11 A schematic diagram of the hardware structure of the data processing device provided in this application. Detailed Implementation

[0080] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0081] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0082] In related technologies, users can adjust the screen parameters based on their experience to reduce eye strain. For example, in bright light, users can maximize screen brightness for better viewing, while in dim light, they can minimize brightness. Alternatively, the device can automatically adjust brightness based on ambient light. However, these methods fail because the intensity of stimulation to the eyes varies in different scenarios, and individual eye conditions differ. Therefore, adjusting the screen manually or automatically by the device cannot effectively reduce eye strain, ultimately leading to a significant risk to eye health from the device's display.

[0083] To address the technical problem that the display screens of terminal devices pose a significant risk to eye health in related technologies, this application provides a data processing method applied to a terminal device. The terminal device acquires multiple upper eyelid positions and multiple eye opening areas within a preset time period for the user. Based on the multiple upper eyelid positions and multiple eye opening areas, the visual stimulation intensity of the terminal device on the user's eyes is determined. The visual stimulation intensity is used to indicate the degree of stimulation received by the user's eyes. Based on the visual stimulation intensity, the lighting of the lighting device and / or the display of the terminal device are adjusted. The aforementioned data processing method, applied to terminal devices, eliminates the need for server interaction, reducing system complexity. By accurately reflecting the impact of the display screen on the user's eyes based on the upper eyelid position and eye opening area, and digitizing the degree of visual stimulation intensity, the terminal device can precisely adjust the lighting and / or display. Furthermore, by jointly adjusting both the lighting and display, the user's environment can be optimized, preventing environmental factors from damaging the user's eyes (e.g., even with the screen brightness adjusted to its lowest setting in dimly lit environments, significant eye damage can still occur). This effectively reduces the damage to the user's eyes from the display screen and minimizes the harm to the user's eye health posed by the terminal device.

[0084] Below, in conjunction with Figure 1 This paper introduces the application scenarios to which this application applies.

[0085] Figure 1 This is a schematic diagram illustrating an application scenario provided by an embodiment of this application. Please refer to [link / reference]. Figure 1 This includes terminal devices and lighting devices. The terminal devices and lighting devices are communicatively connected. For example, the terminal devices and lighting devices can connect via Bluetooth, Wi-Fi, or other communication methods, and then transmit data via Bluetooth or Wi-Fi. The terminal devices include pages 101 and 102. Page 101 includes the text "Hello," and the lighting devices provide ambient lighting to the terminal devices.

[0086] Please see Figure 1 When the terminal device obtains multiple upper eyelid positions and multiple eye opening areas within a preset time period, the terminal device can increase the font size of the text "Hello" on the screen, decrease the brightness of the terminal device's display screen, and send a brightness reduction control command to the lighting device based on the multiple upper eyelid positions and multiple eye opening areas.

[0087] Please refer to page 102, which is the page displayed after the terminal device adjusts its display. Page 102 includes the text "Hello," with a larger font size than the "Hello" text on page 101. The brightness of the display screen on page 102 is lower than that on page 101, and the light intensity of the lighting device is reduced after the terminal device adjusts its lighting. In this way, the terminal device can accurately adjust the lighting and / or the display of the terminal device based on the user's upper eyelid position and eye opening area. By jointly adjusting the lighting device and the display of the terminal device, damage to the user's eyes from the display screen can be effectively reduced, thereby reducing the harm to the user's eye health posed by the terminal device.

[0088] The technical solutions shown in this application will now be described in detail through specific embodiments. It should be noted that the following specific embodiments can be combined with each other, and the same or similar content will not be repeated in different embodiments.

[0089] Figure 2 This is a flowchart illustrating a data processing method provided in an embodiment of this application. Please refer to [link / reference]. Figure 2 The method may include:

[0090] S201. Obtain multiple upper eyelid positions and multiple eye opening areas within a user-preset time period.

[0091] The execution entity in this application embodiment can be a terminal device or a data processing device installed in the terminal device. Optionally, the data processing device can be implemented by software or by a combination of software and / or hardware. Optionally, the terminal device can be any device with image display capabilities. For example, the terminal device may include a mobile phone, computer, tablet computer, projector, etc.

[0092] The upper eyelid position can be the location of the user's upper eyelid within the eye. For example, the user's upper eyelid position could be in the middle, upper side, or lower side of the eye. Optionally, the user's upper eyelid position can also be the distance between the user's upper and lower eyelids. For example, the user's upper eyelid position could be 0.5 cm from the lower eyelid, 1 cm from the lower eyelid, etc.

[0093] Optionally, the user's upper eyelid position can be normalized to digitize it for easier data processing. For example, the maximum distance between the user's upper and lower eyelids can be normalized, resulting in an upper eyelid position less than or equal to 1. For instance, if the maximum distance between the user's upper and lower eyelids is 2 centimeters, this distance can be normalized. When the distance between the user's upper and lower eyelids is 1 centimeter, the user's upper eyelid position is 0.5, thus digitizing the upper eyelid position through normalization.

[0094] Upper eyelid position is used to indicate the degree of eye opening and closing. For example, the user's upper eyelid position is directly proportional to the degree of eye opening and closing; the larger the upper eyelid position, the wider the user's eyes are open, and vice versa. For instance, if the user's upper eyelid position is 0.8, a change of 0.5 indicates a smaller eye opening, while a change of 0.9 indicates a larger eye opening.

[0095] Eye opening area is used to indicate the degree to which a user squints. For example, when a user squints, the eyelids around the eyes move closer to the center of the eyes, thus changing the area of ​​the user's open eyes. Optionally, the user's eye opening area is inversely proportional to the degree of squinting. For example, a higher degree of squinting indicates a smaller eye opening area, and a lower degree of squinting indicates a larger eye opening area.

[0096] Optionally, the area of ​​the user's open eyes can be normalized to digitize it. For example, the maximum area of ​​the user's open eyes can be normalized, and then represented by a number less than or equal to 1, thus digitizing the area of ​​the open eyes. For instance, if the maximum area of ​​the user's open eyes is 2 square centimeters, then 2 square centimeters can be normalized. When the user's open eye area is 1 square centimeter, the user's open eye area can be determined to be 0.5, and thus digitized through normalization.

[0097] Because of individual differences among users (e.g., user A's maximum eye opening area is 4 square centimeters, while user B's is 2 square centimeters), normalizing the upper eyelid position and eye opening area allows for a unified representation of eye features across different users. For example, user A's maximum eye opening area may be larger than user B's. However, when both users A and B squint to the same degree, the digitized eye opening area can represent their squinting level (e.g., if both user A and user B have an eye opening area of ​​0.5, although their actual eye opening areas differ, their squinting level is the same, meaning their eye features are identical).

[0098] The preset time period can be any set duration. For example, if the preset time period is 10 minutes, the terminal device can obtain multiple upper eyelid positions and multiple eye opening areas of the user within the past 10 minutes; if the preset time period is 1 hour, the terminal device can obtain multiple upper eyelid positions and multiple eye opening areas of the user within the past 1 hour; if the preset time period is 1 day, the terminal device can obtain multiple upper eyelid positions and multiple eye opening areas of the user within the past 1 day.

[0099] Optionally, multiple upper eyelid positions and multiple eyelid opening areas within a preset time period can be obtained according to the following feasible implementation method: acquire multiple eye images of the user collected within the preset time period, and determine multiple upper eyelid positions and multiple eye opening areas based on the multiple eye images.

[0100] Optionally, the eye image can be an image that includes the user's eyes. For example, the eye image can be an image of the user's face, an image of the user's eyes, etc. Optionally, the terminal device can obtain multiple eye images of the user through a camera device. For example, mobile phones typically have a front-facing camera on the screen, which can capture the user's eye images in real time when the user uses the phone. Optionally, when the user uses the terminal device, the terminal device's camera can acquire a video stream including the user's face, and then determine multiple eye images of the user from the video stream. For example, a mobile phone camera can acquire a 10-second video stream including the user's face, and then extract a frame from the video stream as the user's eye image. For example, a mobile phone camera can determine the frame with the highest clarity from the video stream including the user's eyes, and identify the frame with the highest clarity as the user's eye image.

[0101] Optionally, when the terminal device acquires multiple eye images of the user within a preset time period, each eye image includes the corresponding acquisition time. For example, if the terminal device acquires a user's eye image at 8:00 AM, then the acquisition time corresponding to that eye image is 8:00 AM.

[0102] Optionally, multiple upper eyelid positions and multiple eye opening areas can be determined according to the following feasible implementation method: Multiple eye images are processed using a first model to obtain the upper eyelid position and eye opening area corresponding to each eye image. The first model is learned from multiple sets of samples, each set of samples including a sample eye image, a sample upper eyelid position, and a sample eye opening area. These multiple sets of samples can be pre-labeled samples. For example, for sample eye image 1, the sample upper eyelid position 1 and sample eye opening area 1 corresponding to sample eye image 1 are obtained, resulting in a set of samples including sample eye image 1, sample upper eyelid position 1, and sample eye opening area 1. Using this method, multiple sets of samples can be obtained. For example, multiple sets of samples can be shown in Table 1:

[0103] Table 1

[0104] Multiple samples Sample eye images upper eyelid position of the sample Sample eye opening area First group of samples Sample eye image 1 Sample upper eyelid position 1 Sample eye opening area 1 Second group of samples Sample eye image 2 Sample upper eyelid position 2 Sample eye opening area 2 Third group of samples Sample eye image 3 Sample upper eyelid position 3 Sample eye opening area 3 …… …… …… ……

[0105] It should be noted that Table 1 is only an example to illustrate multiple sets of samples, and is not a limitation on multiple sets of samples.

[0106] For example, if the eye image input to the first model is the same as the sample eye image 1, then the upper eyelid position corresponding to the eye image is the sample upper eyelid position 1, and the eye opening area corresponding to the eye image is the sample eye opening area 1; if the eye image input to the first model is the same as the sample eye image 2, then the upper eyelid position corresponding to the eye image is the sample upper eyelid position 2, and the eye opening area corresponding to the eye image is the sample eye opening area 2; if the eye image input to the first model is the same as the sample eye image 3, then the upper eyelid position corresponding to the eye image is the sample upper eyelid position 3, and the eye opening area corresponding to the eye image is the sample eye opening area 3.

[0107] S202. Adjust the lighting of the lighting device and / or the display of the terminal device according to multiple upper eyelid positions and multiple eye opening areas.

[0108] Optionally, the lighting device is used to provide ambient lighting to the terminal device. For example, the lighting device can be any device with intelligent brightness adjustment function. For example, the lighting device can be a smart table lamp, a smart chandelier, etc. The terminal device can control the lighting of the lighting device, and the terminal device can connect to the lighting device wirelessly. For example, the terminal device can connect to the lighting device via Bluetooth, WIFI (Wireless Fidelity), etc.

[0109] Optionally, the terminal device can adjust the lighting of the lighting device by adjusting its brightness and / or color temperature. For example, the terminal device can adjust the brightness parameter of the lighting device to adjust its brightness, and the terminal device can adjust the color parameter of the lighting device to adjust its color temperature. For example, the terminal device can increase or decrease the brightness of the lighting device, or it can decrease the color temperature of the lighting device, etc.

[0110] Optionally, the display of the terminal device may include at least one of the following: backlight intensity, background color, text information, and screen reflection. Backlight intensity refers to the display brightness of the terminal device's screen. For example, the backlight intensity of the terminal device may be 500 nits. Background color refers to the color of the background displayed on the terminal device's screen. For example, the background color of the terminal device may be green, gray, white, etc. Text information may be the text information displayed by the terminal device. For example, the text information of the terminal device may include the displayed text font size, text color, text layout, etc. Screen reflection may be bright spots on the surface of the terminal device's display screen. For example, in practical applications, the light from an illumination device can form strong bright spots on the surface of the terminal device's display screen.

[0111] Optionally, before adjusting the lighting of the lighting device and / or the display of the terminal device, the terminal device may determine whether an adjustable lighting device exists. If the terminal device determines that an adjustable lighting device exists, then the terminal device may adjust the lighting of the lighting device and / or the display of the terminal device. For example, if the terminal device does not have a controllable lighting device, then the terminal device can only adjust the display of the terminal device and cannot adjust the lighting of the lighting device; if the terminal device has a controllable lighting device, then the terminal device can adjust the display of the terminal device and / or the lighting of the lighting device.

[0112] The lighting of the lighting device and / or the display of the terminal device can be adjusted according to the following feasible implementation: The visual stimulation intensity of the user's eyes is determined based on multiple upper eyelid positions and multiple eye opening areas; the lighting of the lighting device and / or the display of the terminal device are then adjusted according to the visual stimulation intensity. Here, visual stimulation intensity indicates the degree of stimulation received by the user's eyes. For example, a higher visual stimulation intensity indicates a greater degree of stimulation from the display screen, and a lower visual stimulation intensity indicates a lesser degree of stimulation. For instance, in practical applications, a lower visual stimulation intensity indicates less harm to the user's eyes; when the visual stimulation intensity is at a preset value (0 or close to 0), the user's eyes will not be harmed by the display screen.

[0113] Optionally, the visual stimulus intensity to the user's eyes can be determined according to the following feasible implementation: First, based on multiple upper eyelid positions, determine first change information of the upper eyelids within a preset time period; based on multiple eye opening areas, determine second, change information of the eye opening area within the preset time period; and based on the first and second change information, determine the visual stimulus intensity to the user's eyes. Optionally, the first change information indicates the change in the upper eyelid position within the preset time period. For example, the first change information can be a first waveform graph, where the horizontal axis of the first waveform graph represents time, and the vertical axis represents the upper eyelid position. The second change information indicates the change in the eye opening area within the preset time period. For example, the second change information can be a second waveform graph, where the horizontal axis of the second waveform graph represents time, and the vertical axis represents the eye opening area.

[0114] Optionally, a first waveform can be obtained based on the acquisition time corresponding to the position of the upper eyelid, and a second waveform can be obtained based on the acquisition time corresponding to the eye opening area. Optionally, when determining the first and second waveforms, the position of the upper eyelid and the eye opening area can be normalized so that the vertical axis of the first and second waveforms is in the range of 0-1.

[0115] Below, in conjunction with Figure 3 The first waveform diagram will be explained.

[0116] Figure 3 This is a schematic diagram of a first waveform provided in an embodiment of this application. Please refer to... Figure 3 The horizontal axis of the first waveform graph represents time, and the vertical axis represents the position of the upper eyelid. The upper eyelid position ranges from 0 to 1. Within a preset time period, the upper eyelid position changes over time; a higher upper eyelid position results in a lower curve in the waveform graph, and vice versa. By analyzing the waveform graph corresponding to the upper eyelid position, the initial changes in the upper eyelid position within the preset time period can be accurately obtained.

[0117] Below, in conjunction with Figure 4 The second waveform will be explained.

[0118] Figure 4 This is a schematic diagram providing a second waveform for an embodiment of this application. Please refer to... Figure 4 The horizontal axis of the second waveform represents time, and the vertical axis represents the area of ​​the eyes open. The value of the eye-opening area ranges from 0 to 1. Within a preset time period, the eye-opening area changes over time; a larger eye-opening area results in a higher curve in the waveform, and a smaller eye-opening area results in a lower curve. By analyzing the waveform corresponding to the eye-opening area, one can accurately obtain the second change information of the eye-opening area within the preset time period.

[0119] Optionally, the first change information is a first waveform diagram, and the second change information is a second waveform diagram. Based on the first change information and the second change information, the visual stimulation intensity of the user's eyes is determined. Specifically, based on the first waveform diagram, a first average value of the upper eyelid position within a preset time period is determined; based on the second waveform diagram, a second average value of the eye opening area within the preset time period is determined; and based on the first and second average values, the visual stimulation intensity of the user's eyes is determined. The first average value can be the average of multiple upper eyelid positions within the preset time period. For example, if the terminal device acquires 5 upper eyelid positions within the preset time period, the first average value is the average of the 5 upper eyelid positions. For example, if the terminal device acquires upper eyelid positions of 0.5 and 0.7 within the preset time period, the first average value is 0.6. The second average value can be the average of multiple eye opening areas within the preset time period. For example, if the terminal device acquires 10 eye opening areas within the preset time period, the second average value is the average of the 10 eye opening areas. For example, if the terminal device acquires eye opening areas of 0.3 and 0.5 within the preset time period, the second average value is 0.4.

[0120] Optionally, the visual stimulus intensity of the user's eyes can be determined according to the following feasible implementation method: inputting the first average value and the second average value into a preset model to obtain the visual stimulus intensity of the user's eyes. The preset model is learned from multiple sets of samples, each set of samples including the first average value, the second average value, and the visual stimulus intensity. The multiple sets of samples can be pre-labeled samples. For example, for the first average value 1 and the second average value 1, the corresponding visual stimulus intensity 1 is obtained to form a set of samples, which includes the first average value 1, the second average value 1, and the visual stimulus intensity 1. Using this method, multiple sets of samples can be obtained. For example, multiple sets of samples can be as shown in Table 2:

[0121] Table 2

[0122] Multiple samples First Mean of Sample Second Mean of Sample Sample visual stimulus intensity First group of samples First mean of the sample 1 Second mean of the sample 1 Sample visual stimulus intensity 1 Second group of samples First sample mean 2 Second mean of the sample 2 Sample visual stimulus intensity 2 Third group of samples First sample mean 3 Second mean of the sample 3 Sample visual stimulus intensity 3 …… …… …… ……

[0123] It should be noted that Table 2 is only an example to illustrate multiple sets of samples, and is not a limitation on multiple sets of samples.

[0124] For example, if the first average value in the input preset model is the first average value 1 and the second average value is the second average value 1, then the visual stimulus intensity of the user's eyes is the sample visual stimulus intensity 1; if the first average value in the input preset model is the first average value 2 and the second average value is the second average value 2, then the visual stimulus intensity of the user's eyes is the sample visual stimulus intensity 2; if the first average value in the input preset model is the first average value 3 and the second average value is the second average value 3, then the visual stimulus intensity of the user's eyes is the sample visual stimulus intensity 3.

[0125] Optionally, in practical applications, the preset model and the first model can be set in the target model. For example, the target model includes the functions of the preset model and the first model. When the user's eye image is input into the target model, the target model can output the intensity of the visual stimulus to the user's eyes.

[0126] Adjusting the lighting of the lighting device and / or the display of the terminal device based on the intensity of the visual stimulus can be done in two ways:

[0127] Case 1: The intensity of the visual stimulus is less than the first threshold.

[0128] If the intensity of the visual stimulus is less than a first threshold, the lighting of the lighting device and / or the display of the terminal device will not be adjusted. For example, if the intensity of the visual stimulus to the user's eyes obtained by the terminal device is less than the first threshold, it means that the terminal device is providing less stimulation to the user's eyes under the current ambient light conditions, and the terminal device does not need to adjust the lighting of the lighting device or the display of the terminal device.

[0129] Case 2: The intensity of the visual stimulus is greater than or equal to the first threshold.

[0130] If the intensity of the visual stimulus is greater than or equal to a first threshold, the lighting brightness, color temperature, and / or the backlight intensity, background color, text information, and screen reflection of the terminal device are adjusted according to the intensity of the visual stimulus. For example, if the intensity of the visual stimulus to the user's eyes obtained by the terminal device is greater than the first threshold, it means that the terminal device is stimulating the user's eyes to a greater degree under the current ambient light conditions. The terminal device can then adjust the lighting of the lighting device and the display of the terminal device to make the intensity of the visual stimulus less than or equal to the first threshold.

[0131] Optionally, based on the intensity of the visual stimulus, target lighting parameters and target screen parameters are determined, and based on the target lighting parameters and target screen parameters, at least one of the following is adjusted: lighting brightness and color temperature of the lighting device, backlight intensity of the terminal device, background color, text information, and screen reflection. The target lighting parameters include the lighting brightness and color temperature of the lighting device, and the target screen parameters include the backlight intensity, background color, text information, and screen reflection of the terminal device screen.

[0132] Optionally, the target lighting parameters and target screen parameters make the visual stimulus intensity less than the first threshold. For example, if the terminal device can adjust the lighting parameters of the lighting device to the target lighting parameters and adjust the screen parameters of the terminal device to the target screen parameters, then the visual pressure on the user's eyes from the screen of the terminal device will be less than the first threshold.

[0133] Optionally, the terminal device can adjust the lighting of the lighting device and the display of the terminal device based on the correspondence between the visual stimulus intensity and the lighting parameters of the lighting device and the screen parameters of the terminal device, in order to reduce the visual stimulus intensity. For example, the correspondence between the visual stimulus intensity and the lighting parameters of the lighting device and the screen parameters of the terminal device can be shown in Table 3:

[0134] Table 3

[0135] Visual stimulus intensity Lighting parameters Screen parameters Visual stimulus intensity 1 Lighting parameter 1 Screen parameter 1 Visual stimulus intensity 2 Lighting parameter 2 Screen parameter 2 Visual stimulus intensity 3 Lighting parameter 3 Screen parameter 3 …… …… ……

[0136] It should be noted that Table 3 is only an example illustrating the correspondence between visual stimulus intensity and the lighting parameters of the lighting device and the screen parameters of the terminal device, and is not a limitation on this correspondence.

[0137] Lighting parameters may include the brightness and color temperature of the lighting device, while screen parameters may include the backlight intensity, background color, text information, and screen reflection (screen reflection can be adjusted by adjusting the lighting device).

[0138] Based on the visual stimulus intensity and the correspondence between visual stimulus intensity and the lighting parameters of the lighting device and the screen parameters of the terminal device, the target lighting parameters and target screen parameters are determined. For example, if the visual stimulus intensity is visual stimulus intensity 1, then the target lighting parameter is lighting parameter 1, and the target screen parameter is screen parameter 1; if the visual stimulus intensity is visual stimulus intensity 2, then the target lighting parameter is lighting parameter 2, and the target screen parameter is screen parameter 2; if the visual stimulus intensity is visual stimulus intensity 3, then the target lighting parameter is lighting parameter 3, and the target screen parameter is screen parameter 3.

[0139] Based on the target lighting parameters and target screen parameters, adjust at least one of the following: lighting brightness, color temperature of the lighting device, backlight intensity of the terminal device, background color, text information, and screen reflection. For example, if the lighting parameters are a yellow color temperature and a brightness of 1000 nits, and the screen parameters are a backlight intensity of 500 nits, a green background color, a font size of 14, and a black font color, then the terminal device can adjust the lighting of the lighting device and the display of the terminal device according to the above lighting and screen parameters.

[0140] Optionally, the screen parameters of the terminal device and the illumination of the lighting device can be adjusted according to the following feasible implementation method: Determine a set of standard parameters. These standard parameters include the standard illumination brightness of the lighting device, standard color temperature, and / or the standard backlight intensity of the terminal device, standard background color, standard text information, and standard screen reflectivity. Optionally, the standard parameters ensure that the visual stimulus intensity is less than or equal to a preset value. For example, the standard parameters can ensure that the visual stimulus intensity of the terminal device's screen for the user is 0.

[0141] Based on the standard parameters, at least one of the following is adjusted: the illumination brightness of the lighting device, the color temperature, the backlight intensity of the terminal device, the background color, the text information, and the screen reflection. For example, since the standard parameters can make the visual stimulus intensity zero, the screen parameters of the terminal device and the illumination parameters of the lighting device can be adjusted towards the standard parameters to reduce the visual stimulus intensity of the terminal device's screen on the user's eyes. Optionally, the illumination parameters and screen parameters corresponding to the visual stimulus intensity are used to reduce the visual stimulus intensity so that the visual stimulus intensity is less than or equal to a first threshold. For example, if the first threshold is 10% and the visual stimulus intensity is 50%, then the illumination parameters and screen parameters corresponding to the visual stimulus intensity can make the visual stimulus intensity to the user's eyes less than 10%.

[0142] Optionally, in practical applications, if the visual stimulus intensity still exceeds the first threshold after adjusting the lighting and display of the lighting device and terminal device due to screen limitations, the terminal device will adjust the lighting and display to the minimum lighting and screen parameters corresponding to the minimum visual stimulus intensity. For example, if the first threshold is 10%, and the terminal device can only adjust the visual stimulus intensity to 20%, then the terminal device will adjust the lighting and display according to the lighting and screen parameters corresponding to 20% visual stimulus intensity.

[0143] Below, in conjunction with Figure 5 The process of adjusting the lighting of the lighting device and / or the display of the terminal device according to the intensity of visual stimuli.

[0144] Figure 5This is a schematic diagram illustrating an adjustment of a lighting device and a terminal device display, provided as an embodiment of this application. Please refer to... Figure 5 This includes a terminal device. The terminal device displays the text "Hello" on its screen, and its background color is white. When the terminal device determines that the visual stimulus intensity to the user's eyes exceeds a first threshold based on multiple upper eyelid positions and eye opening areas, it determines screen and lighting parameters and adjusts the display and lighting of the terminal device accordingly. Specifically, the terminal device increases the font size of the "Hello" text, adjusts the background color to gray, and sends a brightness reduction control command to the lighting device to lower its brightness.

[0145] This application provides a data processing method applied to a terminal device. The method acquires multiple upper eyelid positions and multiple eye opening areas within a preset time period. Based on the multiple upper eyelid positions, it determines first change information of the upper eyelids within the preset time period. Based on the multiple eye opening areas, it determines second change information of the eye opening areas within the preset time period. Based on the first and second change information, it determines the visual stimulation intensity of the user's eyes. Based on the visual stimulation intensity, it adjusts the lighting of the lighting device and / or the display of the terminal device. In the above method, the data processing method is applied to the terminal device without interacting with the server, reducing system complexity. Due to the position of the upper eyelid and the area of ​​the open eye, it can accurately reflect the impact of the display screen on the user's eyes. Furthermore, by digitizing the degree of impact of the screen on the user's eyes through the intensity of visual stimulation, the terminal device can accurately adjust the lighting of the lighting device and / or the display of the terminal device. By jointly adjusting the lighting device and the display of the terminal device, the user's environment can be adjusted to avoid damage to the user's eyes from environmental factors (e.g., in a dimly lit scene, even if the screen brightness is adjusted to the lowest level, it will still cause significant damage to the user's eyes). This effectively reduces the damage of the display screen to the user's eyes and reduces the harm of the terminal device to the user's eye health.

[0146] exist Figure 2 Based on the illustrated embodiment, after the terminal device adjusts the lighting of the lighting device and / or the display of the terminal device, the embodiments of this application may further include a process of generating prompting information based on the intensity of visual stimuli. The following, in conjunction with... Figure 6 The method for generating prompt messages will be explained.

[0147] Figure 6 This is a schematic flowchart illustrating a method for generating prompt information on a terminal device, as provided in an embodiment of this application. Please refer to... Figure 6 The method includes:

[0148] S601, Obtain the intensity of the second visual stimulus.

[0149] The second visual stimulus intensity is the degree of stimulation received by the user's eyes after the terminal device adjusts the illumination of the lighting device and / or the display of the terminal device. Optionally, after the terminal device adjusts the illumination of the lighting device and / or the display of the terminal device, the terminal device can also acquire an image of the user's eyes, thereby obtaining multiple upper eyelid positions and multiple eye opening areas, and then, according to the method in step S201, obtain the degree of stimulation received by the user's eyes after the terminal device adjusts the illumination of the lighting device and / or the display of the terminal device.

[0150] S602. Generate prompt information based on the intensity of the second visual stimulus.

[0151] The prompt information includes recommended usage time for the terminal device. For example, the recommended usage time could be a suggested duration for the user to use the terminal device in the current environment. For instance, the recommended usage time could be 30 minutes, 1 hour, etc. Optionally, in practical applications, due to limitations of lighting devices and the terminal device's screen, the terminal device may not be able to reduce the visual stimulus intensity to below a first threshold value. The terminal device can then recommend usage time to the user based on this second visual stimulus intensity to reduce the harm to the user's eyes from the terminal device's display screen.

[0152] Optionally, the prompt information can be generated according to the following feasible implementation method: Obtain a first preset relationship. The first preset relationship includes at least one visual stimulus intensity and recommended duration information corresponding to each visual stimulus intensity. The first preset relationship can be as shown in Table 4:

[0153] Table 4

[0154] Visual stimulus intensity Duration Recommendation Information Visual stimulus intensity 1 20 minutes Visual stimulus intensity 2 30 minutes Visual stimulus intensity 3 50 minutes …… ……

[0155] It should be noted that Table 4 is only an example to illustrate the first preset relationship, and is not a limitation on the first preset relationship.

[0156] Based on the intensity of the second visual stimulus and the first preset relationship, a prompt message is generated. For example, if the intensity of the second visual stimulus is visual stimulus intensity 1, the prompt message is "Recommended to use the terminal device for 20 minutes"; if the intensity of the second visual stimulus is visual stimulus intensity 2, the prompt message is "Recommended to use the terminal device for 30 minutes"; if the intensity of the second visual stimulus is visual stimulus intensity 3, the prompt message is "Recommended to use the terminal device for 50 minutes".

[0157] Below, in conjunction with Figure 7 This section explains the process by which terminal devices generate prompt messages.

[0158] Figure 7This is a schematic diagram illustrating the generation of prompt information according to an embodiment of this application. Please refer to [link / reference]. Figure 7 This includes the terminal device. The terminal device's display screen shows a second visual stimulus intensity of 30%, indicating that after adjustments to the lighting and display settings, the terminal device's screen provides a high level of eye stimulation. Based on this second visual stimulus intensity, the terminal device can determine a recommended usage time of 40 minutes and generate a prompt message. This prompt message suggests using the terminal device for 40 minutes.

[0159] This application provides a method for generating prompt information in a terminal device. After adjusting the lighting of a lighting device and / or the display of the terminal device, the terminal device acquires a second visual stimulus intensity and generates prompt information based on this intensity. Thus, if the adjusted lighting and display of the terminal device still cause harm to the user's eyes, the terminal device can generate prompt information to indicate the optimal usage time of the terminal device under the current visual stimulus intensity, thereby reducing the damage to the user's eyes caused by the terminal device's display screen and ultimately reducing the harm to the user's eye health.

[0160] Based on any of the above embodiments, the following, in conjunction with Figure 8 The process of the above data processing method will be explained.

[0161] Figure 8 This is a schematic diagram illustrating a data processing method provided in an embodiment of this application. Please refer to... Figure 8 This includes a terminal device. The terminal device displays the text "Hello" on its screen. The terminal device acquires multiple upper eyelid positions and multiple eye opening areas within a preset time period. Based on these positions and areas, the terminal device determines the visual stimulus intensity to be 50%. Using the lighting and screen parameters corresponding to this 50% visual stimulus intensity, the terminal device increases the font size of the text "Hello," decreases the brightness of its screen, and sends a brightness reduction control command to the lighting device to reduce its brightness.

[0162] Please see Figure 8After the terminal device adjusts the lighting of the lighting device and the display of the terminal device, it can again acquire multiple upper eyelid positions and multiple eye-opening areas. Based on these data, it determines the intensity of the second visual stimulus to be 30%. Using this 30% intensity, the terminal device determines a recommended usage time of 40 minutes and generates a prompt message suggesting 40 minutes of use. This allows the terminal device to accurately adjust the lighting of the lighting device and / or the display. By jointly adjusting both the lighting and the display, it can adjust the user's environment, preventing environmental factors from harming the user's eyes. Furthermore, if the adjusted lighting and display still cause eye damage, the terminal device can generate a prompt message to indicate the optimal usage time under the current visual stimulus intensity, thereby reducing the damage to the user's eyes caused by the display screen and minimizing the harm to the user's eye health.

[0163] Figure 9 This is a schematic diagram of a data processing apparatus provided in an embodiment of this application. Please refer to... Figure 9 The data processing device 10 includes a first acquisition module 11 and an adjustment module 12, wherein:

[0164] The first acquisition module 11 is used to acquire multiple upper eyelid positions and multiple eye opening areas within a user-preset time period;

[0165] The adjustment module 12 is used to adjust the lighting of the lighting device and / or the display of the terminal device according to the multiple upper eyelid positions and multiple eye opening areas, wherein the lighting device is used to provide ambient lighting to the terminal device.

[0166] In one possible implementation, the adjustment module 12 is specifically used for:

[0167] The intensity of visual stimulation to the user's eyes is determined based on the multiple upper eyelid positions and the multiple eye opening areas, and the intensity of visual stimulation is used to indicate the degree of stimulation received by the user's eyes;

[0168] Adjust the illumination of the lighting device and / or the display of the terminal device according to the intensity of the visual stimulus.

[0169] In one possible implementation, the adjustment module 12 is specifically used for:

[0170] Based on the multiple upper eyelid positions, determine the first change information of the upper eyelid within the preset time period;

[0171] Based on the multiple eye opening areas, determine the second change information of the eye opening area within the preset time period;

[0172] The intensity of visual stimulation to the user's eyes is determined based on the first change information and the second change information.

[0173] In one possible implementation, the adjustment module 12 is specifically used for:

[0174] Based on the first waveform, determine the first average value of the upper eyelid position within the preset time period;

[0175] Based on the second waveform, determine the second average value of the eye opening area within the preset time period;

[0176] The intensity of visual stimulation to the user's eyes is determined based on the first average value and the second average value.

[0177] In one possible implementation, the adjustment module 12 is specifically used for:

[0178] The first average value and the second average value are input into a preset model to obtain the visual stimulus intensity of the user's eyes;

[0179] The preset model is learned from multiple sets of samples, each set of samples including the first average value of the samples, the second average value of the samples, and the intensity of the visual stimulus of the samples.

[0180] In one possible implementation, the first acquisition module 11 is specifically used for:

[0181] Acquire multiple eye images of the user collected within the preset time period;

[0182] Based on the multiple eye images, the positions of the multiple upper eyelids and the opening areas of the multiple eyes are determined.

[0183] In one possible implementation, the adjustment module 12 is specifically used for:

[0184] If the intensity of the visual stimulus is less than the first threshold, the lighting of the lighting device and / or the display of the terminal device will not be adjusted.

[0185] If the intensity of the visual stimulus is greater than or equal to the first threshold, then the illumination brightness, color temperature, and / or the backlight intensity, background color, text information, and screen reflection of the lighting device are adjusted according to the intensity of the visual stimulus.

[0186] The data processing device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0187] Figure 10 This is a schematic diagram of another data processing apparatus provided in an embodiment of this application. Figure 9 Based on the illustrated embodiments, please refer to Figure 10 The data processing device 10 further includes a second acquisition module 13, which is used for:

[0188] Acquire the intensity of the second visual stimulus;

[0189] Based on the intensity of the second visual stimulus, a prompt message is generated, which includes recommended usage time information for the terminal device.

[0190] In one possible implementation, the second acquisition module 13 is specifically used for:

[0191] Obtain a first preset relationship, which includes at least one visual stimulus intensity and duration recommendation information corresponding to each visual stimulus intensity;

[0192] The prompt information is generated based on the intensity of the second visual stimulus and the first preset relationship.

[0193] The data processing device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0194] Figure 11 A schematic diagram of the hardware structure of the data processing device provided in this application. Please refer to [link / reference]. Figure 11 The data processing device 20 may include a processor 21 and a memory 22, wherein the processor 21 and the memory 22 can communicate; for example, the processor 21 and the memory 22 communicate via a communication bus 23, the memory 22 is used to store program instructions, and the processor 21 is used to call the program instructions in the memory to execute the data processing method shown in any of the above method embodiments.

[0195] Optionally, the data processing device 20 may also include a communication interface, which may include a transmitter and / or a receiver.

[0196] Optionally, the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0197] This application provides a readable storage medium storing a computer program; the computer program is used to implement the data processing method as described in any of the above embodiments.

[0198] This application provides a computer program product, which includes instructions that, when executed, cause a computer to perform the data processing method described above.

[0199] All or part of the steps in the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a readable memory. When the program is executed, it performs the steps of the above method embodiments; and the aforementioned memory (storage medium) includes: read-only memory (ROM), RAM, flash memory, hard disk, solid-state drive, magnetic tape, floppy disk, optical disk, and any combination thereof.

[0200] This application describes embodiments with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0201] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0202] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0203] Obviously, those skilled in the art can make various modifications and variations to the embodiments of this application without departing from the spirit and scope of this application. Therefore, if these modifications and variations to the embodiments of this application fall within the scope of the claims of this application and their equivalents, this application also intends to include these modifications and variations.

[0204] In this application, the term "comprising" and its variations can refer to non-limiting inclusion; the term "or" and its variations can refer to "and / or". The terms "first", "second", etc., in this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. In this application, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

Claims

1. A data processing method, characterized in that, Applied to a terminal device, the method includes: Obtain multiple upper eyelid positions and multiple eye opening areas within a user-preset time period; Based on the multiple upper eyelid positions, the multiple upper eyelid positions are normalized, and a first waveform of the upper eyelid within the preset time period is determined; the horizontal axis of the first waveform is time, and the vertical axis is the normalized upper eyelid position, which is used to indicate the change information of the upper eyelid position over time within the preset time period; Based on the multiple eye opening areas, the multiple eye opening areas are normalized, and a second waveform of the eye opening area within the preset time period is determined. The horizontal axis of the second waveform is time, and the vertical axis is the normalized eye opening area, which is used to indicate the change information of the eye opening area with time within the preset time period. Based on the first waveform diagram and the second waveform diagram, determine the first average value of the upper eyelid position and the second average value of the eye opening area within the preset time period, respectively. The first average value and the second average value are input into a preset model to obtain the visual stimulus intensity of the user's eyes; wherein, the visual stimulus intensity is used to indicate the degree of stimulation received by the user's eyes; the preset model is learned from multiple sets of samples, each set of samples includes a first average value, a second average value, and a visual stimulus intensity; If the visual stimulus intensity is greater than or equal to a preset first threshold, then target lighting parameters and target screen parameters are determined based on the visual stimulus intensity, and the lighting of the lighting device and / or the display of the terminal device are adjusted such that the visual stimulus intensity is less than the first threshold; the lighting device is used to provide ambient lighting to the terminal device; If the minimum visual stimulus intensity corresponding to the terminal device is greater than the first threshold, then adjusting the illumination of the lighting device and / or the display of the terminal device includes: Adjust the lighting of the lighting device and the display of the terminal device according to the lighting parameters and screen parameters corresponding to the minimum visual stimulus intensity; The intensity of the second visual stimulus is obtained after the terminal device adjusts the illumination of the lighting device and / or the display of the terminal device. If the intensity of the second visual stimulus is greater than or equal to the first threshold, a first preset relationship is obtained, which includes at least one visual stimulus intensity and duration recommendation information corresponding to each visual stimulus intensity; based on the second visual stimulus intensity and the first preset relationship, a prompt message is generated; the prompt message includes usage duration recommendation information of the terminal device.

2. The method according to claim 1, characterized in that, Obtain multiple upper eyelid positions and multiple eye opening areas within a user-preset time period, including: Acquire multiple eye images of the user collected within the preset time period; Based on the multiple eye images, the positions of the multiple upper eyelids and the opening areas of the multiple eyes are determined.

3. The method according to claim 1, characterized in that, Also includes: If the intensity of the visual stimulus is less than the first threshold, the lighting of the lighting device and / or the display of the terminal device will not be adjusted.

4. The method according to claim 1, characterized in that, The target lighting parameters include the lighting brightness and color temperature of the lighting device, and the target screen parameters include the backlight intensity, background color, text information, and screen reflection of the terminal device screen. Adjusting the lighting of the lighting device and / or the display of the terminal device includes: Based on the target lighting parameters and the target screen parameters, adjust at least one of the following: lighting brightness and color temperature of the lighting device, backlight intensity of the terminal device, back background color, text information, and screen reflection.

5. The method according to claim 3, characterized in that, Adjusting the illumination brightness, color temperature, and / or the backlight intensity, background color, text information, and screen reflectivity of the lighting device includes: A set of standard parameters is determined, including the standard illumination brightness, standard color temperature and / or the standard backlight intensity, standard back color, standard text information and standard screen reflectivity of the lighting device, wherein the standard parameters make the visual stimulus intensity less than or equal to a preset value. According to the standard parameters, adjust at least one of the following: the illumination brightness of the lighting device, the color temperature, the backlight intensity of the terminal device, the background color, the text information, and the screen reflection.

6. A data processing apparatus, characterized in that, Applied to terminal devices, the data processing device includes a first acquisition module and an adjustment module, wherein: The first acquisition module is used to acquire multiple upper eyelid positions and multiple eye opening areas within a preset time period for the user; The adjustment module is used to normalize the multiple upper eyelid positions according to the multiple upper eyelid positions, and determine the first waveform of the upper eyelid within the preset time period. The horizontal axis of the first waveform is time, and the vertical axis is the normalized upper eyelid position, which is used to indicate the change information of the upper eyelid position with time within the preset time period. Based on the multiple eye opening areas, the multiple eye opening areas are normalized, and a second waveform of the eye opening area within the preset time period is determined. The horizontal axis of the second waveform is time, and the vertical axis is the normalized eye opening area, which is used to indicate the change information of the eye opening area with time within the preset time period. Based on the first waveform diagram and the second waveform diagram, determine the first average value of the upper eyelid position and the second average value of the eye opening area within the preset time period, respectively. The first average value and the second average value are input into a preset model to obtain the visual stimulus intensity of the user's eyes; wherein, the visual stimulus intensity is used to indicate the degree of stimulation received by the user's eyes; the preset model is learned from multiple sets of samples, each set of samples includes a first average value, a second average value, and a visual stimulus intensity; If the visual stimulus intensity is greater than or equal to a preset first threshold, then target lighting parameters and target screen parameters are determined based on the visual stimulus intensity, and the lighting of the lighting device and / or the display of the terminal device are adjusted such that the visual stimulus intensity is less than the first threshold; the lighting device is used to provide ambient lighting to the terminal device; If the minimum visual stimulus intensity corresponding to the terminal device is greater than the first threshold, then when adjusting the lighting of the lighting device and / or the display of the terminal device, the specific method is to: adjust the lighting of the lighting device and the display of the terminal device according to the lighting parameters and screen parameters corresponding to the minimum visual stimulus intensity. After the terminal device adjusts the lighting of the lighting device and / or the display of the terminal device, a second visual stimulus intensity is obtained; if the second visual stimulus intensity is greater than or equal to a first threshold, a first preset relationship is obtained, the first preset relationship including at least one visual stimulus intensity and duration recommendation information corresponding to each visual stimulus intensity; based on the second visual stimulus intensity and the first preset relationship, a prompt message is generated; the prompt message includes usage duration recommendation information of the terminal device.

7. A data processing device, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the data processing method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the data processing method as described in any one of claims 1 to 5.

9. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the data processing method as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Terminal control method and terminal

    CN110007758A

  • Equipment control method, device and equipment based on full vision

    CN112506338A