Tablet computer eye protection system and method

By acquiring tablet usage data to assess user eye fatigue and adjusting screen parameters, the problem of not being able to personalize eye care in existing technologies is solved, thus improving the user experience.

CN117472315BActive Publication Date: 2024-11-26SHENZHEN ALLDO CUBE TECH & SCI CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202311555502.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-21
Publication Date
2024-11-26
Estimated Expiration
2043-11-21

AI Technical Summary

Technical Problem

Existing tablet eye protection systems cannot effectively assess users' eye fatigue, making it impossible to provide personalized eye protection adjustments for different users and reducing the user experience.

Method used

The tablet acquires user data through an application data acquisition module, a touch sensing module, and an environmental sensing module. It then uses the processor to assess the user's cumulative eye fatigue value and adjusts parameters such as screen color temperature and brightness based on this value.

Benefits of technology

It enables personalized eye care adjustments based on the user's eye fatigue level, improving the practicality of eye care methods and the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117472315B_ABST
    Figure CN117472315B_ABST
Patent Text Reader

Abstract

The embodiments of the present specification provide a tablet computer eye protection system and method, the system includes an application data acquisition module, a touch sensing module, an environment sensing module, and a processor, the processor being configured to: acquire user usage data from the application data acquisition module, the touch sensing module, and the environment sensing module, the user usage data including a sequence of images presented by the tablet computer and user operation data on the tablet computer within a first preset time period, the first preset time period at least including a current moment, the operation data including application usage data and environment data; based on the user usage data, evaluate the user's cumulative eye fatigue value; according to the cumulative eye fatigue value, determine eye protection parameters and eye protection prompt information, the eye protection parameters including at least one of an adjustment amount of the screen color temperature and an adjustment amount of the screen brightness of the tablet computer.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of tablet computer eye protection, and more particularly to a tablet computer eye protection system and method. Background Art

[0002] The continuous development of science and technology has brought about a wave of popularization of smart terminals. People's dependence on electronic products such as tablets has gradually increased, and the duration of use has also increased accordingly. However, long-term and continuous viewing of the screen may easily cause users to suffer from eye diseases such as decreased vision due to excessive eye use.

[0003] In view of this, in order to achieve intelligent and effective eye protection, CN109995942B provides an eye protection method and system for smart terminals, which uses a distance sensor to collect the distance between the user's eyes and the smart terminal screen, identifies the user's identity through a camera, and uses eye protection software to monitor the displayed content and perform data analysis, thereby automatically adjusting the screen brightness and color temperature, adjusting the display mode, automatically limiting the usage time, switching to basic communication functions, etc. However, this method cannot effectively evaluate the user's eye fatigue status, and it is difficult to achieve eye protection adjustment for different users using tablet computers.

[0004] Therefore, there is an urgent need to provide a tablet computer eye protection system and method, which can evaluate the eye usage situation through the data of users using the tablet computer, and then adjust the screen-related parameters of the tablet computer in a targeted manner to achieve eye protection functions that meet the needs of different users. Summary of the invention

[0005] One or more embodiments of the present specification provide a tablet computer eye protection system, the system comprising an application data acquisition module, a touch sensing module, an environment sensing module, and a processor, wherein the processor is configured to: acquire user usage data from the application data acquisition module, the touch sensing module, and the environment sensing module, the user usage data comprising a sequence of images presented by a tablet computer and user operation data on the tablet computer within a first preset time period, the first preset time period at least comprising a current moment, the operation data comprising application usage data and environment data; evaluate the user's eye fatigue accumulation value based on the user usage data; determine eye protection parameters and eye protection prompt information according to the eye fatigue accumulation value, the eye protection parameters comprising at least one of an adjustment amount of the tablet computer's screen color temperature and an adjustment amount of the screen brightness.

[0006] One or more embodiments of the present specification provide a tablet computer eye protection method, which is implemented by a processor of a tablet computer eye protection system, and the method includes: obtaining user usage data, the user usage data including a screen sequence presented by the tablet computer and user operation data on the tablet computer within a first preset time period, the first preset time period at least including a current moment, the operation data including application usage data and environmental data; based on the user usage data, evaluating the user's cumulative eye fatigue value; determining eye protection parameters and eye protection prompt information according to the cumulative eye fatigue value, the eye protection parameters including at least one of an adjustment amount of the screen color temperature and an adjustment amount of the screen brightness of the tablet computer.

[0007] One or more embodiments of the present specification provide a tablet computer eye protection device, the device comprising at least one processor and at least one memory; the at least one memory is used to store computer instructions; the at least one processor is used to execute at least part of the computer instructions to implement a tablet computer eye protection method.

[0008] One or more embodiments of the present specification provide a computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes a tablet computer eye protection method. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0010] Figure 1 is an exemplary module diagram of a tablet computer eye protection system according to some embodiments of this specification;

[0011] Figure 2 is an exemplary flow chart of a tablet computer eye protection method according to some embodiments of this specification;

[0012] Figure 3 is a schematic diagram of evaluating the cumulative value of eye fatigue of a user according to some embodiments of this specification;

[0013] Figure 4 It is a schematic diagram of determining eye protection parameters according to some embodiments of this specification. Implementation

[0014] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0015] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0016] As shown in this specification and claims, unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "comprise" and "include" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0017] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0018] At present, "smart terminals" such as tablet computers have gradually become an indispensable part of people's lives. Since the constantly changing light and shadow on the screen of such video terminals will cause continuous stimulation to the eyes, in order to achieve intelligent and effective eye protection for different users' eye conditions, CN109995942B provides an eye protection method and system for smart terminals, which can use distance sensors to collect the distance between the user's eyes and the screen of the smart terminal, use cameras to identify the user's identity, and use eye protection software to monitor the display content and perform data analysis, so as to achieve automatic adjustment of screen brightness, automatic adjustment of screen color temperature, adjustment of display mode, automatic restriction of usage time, switching to basic communication functions, etc. However, such a method cannot effectively evaluate the eye fatigue condition, and cannot achieve eye protection adjustment for different users using tablet computers based on the degree of eye fatigue, which reduces the user experience.

[0019] Therefore, it is hoped to provide a tablet computer eye protection method, which can provide targeted eye protection functions by evaluating the user's eye fatigue and making corresponding parameter adjustments to the tablet computer, realize adaptive updates for different users, and improve the practicality and effectiveness of the eye protection method as well as the user experience.

[0020] Figure 1 is an exemplary module diagram of a tablet computer eye protection system according to some embodiments of this specification. Figure 1 As shown, the tablet computer eye protection system 100 may include an application data acquisition module 110, a touch sensor module 120, an environment sensor module 130, and a processor 140. The system 100 involved in the embodiments of this specification will be described in detail below. It should be noted that the following embodiments are only used to explain this specification and do not constitute a limitation on this specification.

[0021] The application data acquisition module 110 is a module for acquiring usage data of applications in the tablet computer. In some embodiments, the application data acquisition module may include a hard disk and the like.

[0022] The touch sensing module 120 is a module for acquiring the touch data of the tablet computer by the user. In some embodiments, the touch sensing module may include a capacitive touch sensor and the like.

[0023] The environment sensing module 130 is a module used to obtain data related to the environment in which the tablet computer is located. In some embodiments, the environment sensing module may include a light sensor, a gyroscope sensor, and the like.

[0024] The processor 140 can process data and / or information obtained from other modules of the tablet computer eye protection system 100, and process the obtained data and / or information to implement the functions described in one or more embodiments of this specification.

[0025] In some embodiments, the processor 140 can be used to obtain user usage data from an application data acquisition module, a touch sensing module, and an environmental sensing module. The user usage data may include a sequence of images presented by the tablet computer and user operation data on the tablet computer within a first preset time period. The first preset time period may at least include the current moment. The operation data may include application usage data and environmental data. Based on the user usage data, the user's cumulative eye fatigue value is evaluated. Based on the cumulative eye fatigue value, eye protection parameters and eye protection prompt information are determined. The eye protection parameters may include at least one of the adjustment amount of the screen color temperature and the adjustment amount of the screen brightness of the tablet computer.

[0026] In some embodiments, the processor 140 may also be used to determine user usage characteristics based on user usage data; and evaluate the user's eye fatigue accumulation value based on the user usage characteristics and the user usage status.

[0027] In some embodiments, the processor 140 can also be used to generate one or more candidate eye protection parameters according to the user's current eye fatigue rate and eye fatigue cumulative value; evaluate the eye protection degree of the candidate eye protection parameters; and determine the eye protection parameters based on the eye protection degree of the candidate eye protection parameters.

[0028] In some embodiments, the processor 140 may also be configured to extract one or more screen features based on a screen sequence presented by the tablet computer within a second preset time period; and determine the user's current eye fatigue rate based on the screen features.

[0029] In some embodiments, processor 140 may include one or more sub-processing devices (eg, a single-core processing device or a multi-core multi-core processing device). As an example only, processor 140 may include a central processing unit (CPU), an application specific integrated circuit (ASIC), etc., or any combination thereof.

[0030] For more details about the above-mentioned user usage data, eye fatigue accumulation value, eye protection parameters and other parameters, please refer to other parts of this manual (such as Figure 2 ) description.

[0031] It should be noted that the above description of the tablet computer eye protection system 100 and its modules is only for the convenience of description and does not limit the present specification to the scope of the embodiments. It is understandable that for those skilled in the art, after understanding the principle of the system, they may arbitrarily combine the modules or form a subsystem to connect with other modules without deviating from this principle. In some embodiments, Figure 1 The application data acquisition module 110, the touch sensor module 120, the environment sensor module 130, and the processor 140 disclosed in the specification can be different modules in a system, or one module can realize the functions of two or more of the above modules. For example, each module can share a storage module, or each module can have its own storage module. Such variations are all within the scope of protection of this specification.

[0032] Figure 2 is an exemplary flow chart of a tablet computer eye protection method according to some embodiments of this specification. Figure 2 As shown, the process 200 may include the following steps. In some embodiments, the process 200 may be executed by a processor.

[0033] Step 210, obtaining user usage data.

[0034] User usage data refers to data related to the user's behavior habits when using the tablet computer. In some embodiments, the user usage data may include a screen sequence presented by the tablet computer and user operation data on the tablet computer within a first preset time period, and may also include time data of the user using the tablet computer.

[0035] The first preset time period refers to a preset time period during which the user uses the tablet computer. In some embodiments, the first preset time period may at least include the current time.

[0036] The screen sequence presented by the tablet computer refers to an image sequence composed of screens presented by the tablet computer screen. In some embodiments, the processor may obtain the screen sequence presented by the tablet computer from the application data acquisition module.

[0037] Operational data refers to data related to user operations. In some embodiments, the operational data may include application usage data and environmental data.

[0038] The application usage data refers to data related to the user's use of applications in the tablet computer, such as the type of applications used, the usage time of each application, etc. In some embodiments, the processor can obtain the application usage data from the application data acquisition module.

[0039] Environmental data refers to data related to the environment in which the tablet computer is located, for example, light intensity of the environment, etc. In some embodiments, the processor can obtain environmental data from an environmental sensing module.

[0040] In some embodiments, the operation data may also include operation habit data. The operation habit data refers to data related to the user's habit of operating the tablet computer, for example, the tilt angle of the screen when using the tablet computer. In some embodiments, the processor may obtain the operation habit data from the environment sensing module.

[0041] The time data refers to data related to the user's time habits when using the tablet computer, for example, the start and close time of the tablet computer, the usage time of the tablet computer, etc. In some embodiments, the processor may obtain the time data from the application data acquisition module.

[0042] In some embodiments, the processor may obtain user usage data from an application data acquisition module, a touch sensing module, and an environment sensing module.

[0043] Step 220: Evaluate the user's eye fatigue accumulation value based on the user usage data.

[0044] The eye fatigue cumulative value refers to a cumulative value used to reflect the degree of eye fatigue of the user. The eye fatigue cumulative value can be represented by a value of 0-10, and a larger value indicates a higher eye fatigue cumulative value.

[0045] In some embodiments, the processor may evaluate the user's eye fatigue accumulation value by a variety of methods based on the user's usage data. For example, the processor may determine the user's eye fatigue accumulation value by looking up a first preset relationship table including the correspondence between the user's usage data and the eye fatigue accumulation value. The first preset relationship table may be determined based on historical data or manual experience.

[0046] In some embodiments, the processor may also evaluate the user's cumulative eye fatigue value based on data such as user usage characteristics. For more information about this section, please refer to Figure 3 and its related description.

[0047] In some embodiments, the processor may also determine the user's eye fatigue accumulation value based on the user's sight sequence data within the first preset time period. Figure 3 and its related description.

[0048] Step 230, determining eye protection parameters and eye protection prompt information according to the accumulated value of eye fatigue.

[0049] The eye protection parameter refers to a parameter of the tablet screen related to realizing the eye protection function. The eye protection parameter may include at least one of the adjustment amount of the screen color temperature and the adjustment amount of the screen brightness of the tablet.

[0050] The adjustment amount of the screen color temperature refers to the change amount of the screen color temperature. In some embodiments, the processor can subtract the difference between the adjusted screen color temperature and the screen color temperature before adjustment as the adjustment amount of the screen color temperature.

[0051] In some embodiments, the adjustment amount of the screen color temperature may be represented by a numerical value, a positive value may represent an increase in the screen color temperature, and a negative value may represent a decrease in the screen color temperature.

[0052] The adjustment amount of the screen brightness refers to the change amount of the screen brightness. In some embodiments, the processor can subtract the difference between the adjusted screen brightness and the screen brightness before adjustment as the adjustment amount of the screen brightness.

[0053] In some embodiments, the adjustment amount of the screen brightness can be represented by a numerical value, a positive value can represent an increase in the screen brightness, and a negative value can represent a decrease in the screen brightness.

[0054] In some embodiments, the processor may determine the eye protection parameters by a variety of methods based on the eye fatigue accumulation value. For example, the processor may determine the eye protection parameters by looking up a second preset relationship table including the correspondence between the eye fatigue accumulation value and the eye protection parameter. The second preset relationship table may be determined based on historical data or manual experience.

[0055] In some embodiments, the processor can generate candidate eye protection parameters based on the user's current eye fatigue rate and eye fatigue accumulation value, and evaluate its eye protection degree to determine the eye protection parameters. For more information about this part, please refer to Figure 4 and its related description.

[0056] Eye protection prompt information refers to relevant information that issues eye protection reminders to users. In some embodiments, the form of eye protection prompt information may include but is not limited to text pop-up window warnings, voice playback prompts, etc.

[0057] In some embodiments, the processor can determine the eye protection prompt information in a variety of ways according to the accumulated value of eye fatigue. For example, the processor can preset a third preset relationship table including the correspondence between the value range of the accumulated value of eye fatigue and the eye protection prompt information, determine the value range of the accumulated value of the user's eye fatigue, and determine the corresponding eye protection prompt information by looking up the table based on the value range of the accumulated value of the eye fatigue. The third preset relationship table can be determined based on historical data or manual experience.

[0058] In some embodiments of the present specification, the user usage data obtained from different modules is used to comprehensively evaluate the user's accumulated eye fatigue value, and then according to the accumulated eye fatigue value of different users, eye protection parameters and eye protection prompt information are determined in a targeted manner, thereby improving the practicality and effectiveness of the eye protection method and the user experience.

[0059] Figure 3 It is a schematic diagram of evaluating the cumulative value of eye fatigue of a user according to some embodiments of the present specification.

[0060] In some embodiments, the user usage data may also include a tilt sequence of the tablet computer. Figure 3 As shown, the processor may determine a user usage feature 320 based on the user usage data 310 ; and evaluate a user's eye fatigue accumulation value 340 based on the user usage feature 320 and the user usage state 330 .

[0061] The tilt sequence of the tablet computer refers to a sequence of tilt angles of the tablet computer screen. In some embodiments, the processor can obtain multiple tilt angles of the tablet computer screen within a first preset time period from an environmental sensing module (such as a gyroscope sensing device) to construct a tilt sequence of the tablet computer within the first preset time period.

[0062] User usage characteristics refer to the behavioral characteristics of the user when using the tablet computer. In some embodiments, the user usage characteristics may include the type of operation content of the user on the tablet computer, such as playing games, watching videos, browsing websites, etc.

[0063] In some embodiments, the processor may determine user usage features based on user usage data by modeling or using various classification algorithms, such as K-Nearest Neighbor (KNN) and Support Vector Machine (SVM). For example, the processor may input user usage data and output user usage features by using a classification model trained with a large amount of historical data.

[0064] The user usage state refers to the posture of the user when using the tablet computer, for example, sitting, lying sideways, etc.

[0065] In some embodiments, the processor may determine the user usage status through vector matching based on the tilt sequence of the tablet computer.

[0066] In some embodiments, the processor may evaluate the user's eye fatigue accumulation value through a variety of methods based on the user's usage characteristics and the user's usage status. For example, the processor may determine the historical eye fatigue accumulation value corresponding to the current user's usage characteristics and the historical eye fatigue accumulation value corresponding to the current user's usage status based on historical data, and perform weighted summation of the above historical eye fatigue accumulation values ​​to determine the user's current eye fatigue accumulation value.

[0067] As an example only, the user's current eye fatigue cumulative value is calculated using the following formula (1):

[0068] T= × + × (1)

[0069] Among them, T, , They represent the user's cumulative eye fatigue value, the historical cumulative eye fatigue value corresponding to the user's usage characteristics, and the historical cumulative eye fatigue value corresponding to the user's usage status. , Respectively represent , The weight of . , It can be set manually based on experience or by system default.

[0070] In some embodiments, the tablet computer eye protection system may further include an eye feature acquisition device, which may be configured to acquire images containing the user's eyes.

[0071] In some embodiments, the processor can determine the accumulated value of eye fatigue based on the user's line of sight sequence, blink characteristics, and line of sight content sequence within a first preset time period. The line of sight sequence and blink characteristics can be determined based on the user's facial image.

[0072] The eye feature acquisition device refers to a device for acquiring eye features, such as a camera, etc. In some embodiments, the eye feature acquisition device can be used to acquire images containing the user's eyes, and the images containing the user's eyes can include user facial images, etc.

[0073] The sight sequence refers to a sequence composed of the positions of the sight points of each sight line. The sight sequence can reflect the position distribution of the user's sight point. The sight point refers to the intersection of the sight line and the tablet screen.

[0074] The sight point content sequence refers to a sequence composed of screen contents corresponding to the sight points of each sight line. The sight point content sequence can reflect the distribution of screen contents corresponding to the sight points of the user.

[0075] In some embodiments, the processor can determine the positions of the corresponding multiple sight points through the sight tracking algorithm based on multiple user facial images, and then construct a sight sequence; the processor can determine the multiple time nodes corresponding to the positions of the multiple sight points, and determine the screen content of the multiple time nodes in combination with the multiple screen sequences presented by the tablet computer corresponding to the multiple time nodes, and then construct a sight point content sequence. Among them, the sight tracking algorithm can include but is not limited to the pupil-corneal reflection tracking method, etc.

[0076] Blink features refer to features that reflect blinking conditions, such as blinking frequency.

[0077] In some embodiments, the processor may identify the user's eyes based on the user's facial image and determine the blinking feature through a video target recognition algorithm, wherein the video target recognition algorithm may include but is not limited to a recurrent neural network (RNN), a multi-frame feature aggregation with optical flow, and the like.

[0078] In some embodiments, the processor can determine the accumulated value of eye fatigue in a variety of ways based on the user's line of sight sequence, blinking characteristics, and line of sight content sequence within a first preset time period.

[0079] In some embodiments, the processor may determine the eye fatigue accumulation value by using an eye fatigue accumulation value prediction model.

[0080] The eye fatigue accumulation value prediction model can be a machine learning model with a custom structure as described below, or can be other neural network models, such as a convolutional neural network model.

[0081] In some embodiments, the input of the eye fatigue cumulative value prediction model may include a line of sight sequence, a blink feature, and a line of sight content sequence, and the output may be an eye fatigue cumulative value.

[0082] In some embodiments, the eye fatigue cumulative value prediction model can be obtained by training a plurality of first training samples with first labels.

[0083] In some embodiments, the first training sample may include a sample sight sequence, a sample blink feature, and a sample sight point content sequence of a sample user. The first training sample may be obtained based on historical data, for example, using a historical sight sequence, a historical blink feature, and a historical sight point content sequence of a historical user as the first training sample. The first label may include an actual eye fatigue accumulation value of the sample user.

[0084] In some embodiments, the first tag can be determined based on the user's subsequent behavior. For example, the processor can obtain the user's video within the first preset time period through the camera; identify whether the user has self-soothing behavior (such as rubbing eyes, dropping eye drops, etc.) within the first preset time period through the video target recognition algorithm, detect the user's subsequent screen usage time; and determine the user's eye fatigue accumulation value using a preset formula based on the frequency of the user's self-soothing behavior and the user's subsequent screen usage time.

[0085] For example only, the preset formula is shown in the following formula (2):

[0086] T= ×m+ ÷n (2)

[0087] Among them, T, m, and n represent the user's cumulative eye fatigue value, the frequency of the user's self-soothing behavior, and the user's subsequent screen time, respectively. , The order of magnitude balance parameters of m and n can be set manually through experiments.

[0088] In some embodiments of the present specification, an eye feature acquisition device is used to obtain user eye data, and then the user's line of sight sequence, blink characteristics, and line of sight content sequence are processed through a model to determine the accumulated value of eye fatigue. This can simultaneously consider the influence of multiple factors, making the determination of the current accumulated value of eye fatigue more efficient and accurate.

[0089] In some embodiments of the present specification, user usage characteristics are determined through user usage data, and the accuracy of assessing the user's cumulative eye fatigue value is improved by combining the user usage characteristics and the user usage status, which is conducive to the subsequent targeted and reasonable adjustment of screen parameters to achieve better eye protection effects.

[0090] Figure 4It is a schematic diagram of determining eye protection parameters according to some embodiments of this specification.

[0091] In some embodiments, Figure 4 As shown, the processor can generate one or more candidate eye protection parameters 420 (e.g., 420-1, 420-2, ..., 420-n) according to the user's current eye fatigue rate 410 and the eye fatigue accumulated value 340; evaluate the eye protection degree 430 of the candidate eye protection parameters; and determine the eye protection parameters 440 based on the eye protection degree 430 of the candidate eye protection parameters.

[0092] Eye fatigue rate refers to the rate at which users feel eye fatigue.

[0093] The cumulative value of eye fatigue is the degree of eye fatigue of the user judged based on the user's objective behavior, and the eye fatigue rate is the rate at which the user experiences eye fatigue, which can reflect the user's comfort and experience. For example, if the degree of eye fatigue reached by a user using a tablet for two hours and half an hour is similar, the eye fatigue rate corresponding to two hours of use is relatively slow, and the user's comfort and experience are better. Therefore, it is necessary to further determine the eye protection parameters in combination with the eye fatigue rate.

[0094] In some embodiments, the processor may determine the current eye fatigue rate of the user as a ratio of the current eye fatigue accumulation value of the user to the time to reach the eye fatigue accumulation value, wherein the time to reach the eye fatigue accumulation value may refer to the usage time of the tablet computer.

[0095] In some embodiments, the processor may extract one or more screen features based on a screen sequence presented by the tablet computer within a second preset time period; and determine the user's current eye fatigue rate based on the screen features.

[0096] The second preset time period refers to a time period within the first preset time period during which the user uses the tablet computer. In some embodiments, the second preset time period is within the first preset time period and is shorter than the first preset time period.

[0097] Picture features refer to the relevant features of the picture presented by the tablet screen. For example, picture features may include light intensity change frequency, picture switching frequency, color change frequency, etc. Among them, light intensity change frequency refers to the frequency of screen brightness change; picture switching frequency refers to the frequency of changes in the picture on the tablet screen; color change frequency refers to the frequency of changes in the color of the tablet screen. For another example, picture features may also include other change frequencies related to the tablet screen picture (such as color temperature change frequency, etc.).

[0098] In some embodiments, the processor can calculate picture characteristics such as light intensity change frequency, picture switching frequency, and color change frequency by analyzing the picture sequence presented by the tablet computer within the second preset time period.

[0099] For example, the processor can calculate the average light intensity of each frame presented in the second preset time period, and determine the average light intensity change rate between adjacent frames as the light intensity change frequency; the processor can calculate the number of different pictures presented on the tablet computer screen within a fixed time (e.g., one second), and determine it as the picture switching frequency; the processor can calculate the number of times the color change amplitude of the tablet computer screen exceeds a preset threshold within a fixed time (e.g., one second), and determine it as the color change frequency.

[0100] Among them, the average light intensity change rate between adjacent frames refers to the ratio of the difference between the average light intensity of the next frame and the average light intensity of the previous frame to the average light intensity of the previous frame. The color change amplitude refers to the RGB change between two adjacent frames. The RGB change between two adjacent frames can refer to the difference between the main color RGB value of the next frame and the main color RGB value of the previous frame, or the difference between the RGB values ​​of the top three colors in the next frame and the RGB values ​​of the top three colors in the previous frame. The preset threshold can be set manually based on experience or by system default.

[0101] In some embodiments, the processor may determine the user's current eye fatigue rate based on the picture features in a variety of ways. For example, the processor may directly determine an extracted picture feature as the user's current eye fatigue rate, or average multiple extracted picture features and determine the average value as the user's current eye fatigue rate.

[0102] In some embodiments, the processor may determine the user's current eye fatigue rate by weighting based on the image features; the weight of the weighting is related to the user's current line of sight.

[0103] In some embodiments, the formula for determining the user's current eye fatigue rate is as follows (3):

[0104] h= ×e+ ×f+ ×g (3)

[0105] Among them, h, e, f, and g represent the user's current eye fatigue rate, light intensity change frequency, screen switching frequency, and color change frequency, respectively. , , are the weights of e, f, and g respectively. The weights may be related to the user's current sight point, for example, : : =The frequency of light intensity changes at the sight point: the frequency of screen switching: the frequency of color changes.

[0106] In some embodiments of the present specification, the determined eye fatigue rate is made more accurate by taking a weighted sum of multiple screen features and weighing multiple factors at the same time, and the weight is determined based on the user's current line of sight, which helps to further improve the real-time accuracy and effectiveness of the eye fatigue rate.

[0107] In some embodiments of the present specification, picture features are extracted from a picture sequence presented by a tablet computer, taking full account of the multi-angle changes of the tablet computer screen picture, so that the accuracy and effectiveness of the eye fatigue rate determined based on the picture features are improved.

[0108] The candidate eye protection parameters refer to candidate parameters used to determine the final eye protection parameters.

[0109] In some embodiments, the processor may generate one or more candidate eye protection parameters through a preset table according to the user's current eye fatigue rate and eye fatigue cumulative value.

[0110] For example, the preset table may be as shown in Table 1 below:

[0111] Table 1

[0112] Eye fatigue rate range Eye fatigue cumulative value range Eye protection parameters

[0113] ( , ) ( , ) ( , )

[0114] ( , ) ( , ) ( , )

[0115] ( , ) ( , ) ( , )

[0116] … … …

[0117] The first column in Table 1 represents the range of eye fatigue rates; the second column represents the range of eye fatigue cumulative values; and the third column represents eye protection parameters.

[0118] In some embodiments, according to Table 1, the processor can determine the eye fatigue rate range to which the user's current eye fatigue rate belongs, and the eye fatigue cumulative value range to which the user's current eye fatigue cumulative value belongs; determine the eye protection parameters corresponding to the eye fatigue rate range and the eye fatigue cumulative value range; and freely combine the elements of the eye protection parameters to generate multiple candidate eye protection parameters. For example, the eye fatigue rate range to which the user's current eye fatigue rate belongs is ( , ), the user's current eye fatigue cumulative value belongs to the eye fatigue cumulative value range ( , ), then the candidate eye protection parameters can be ( , )、( , )、( , )、( , ).

[0119] Eye protection refers to the degree of eye protection that can be achieved by eye protection parameters. Eye protection can be represented by a value of 0-10, with a larger value indicating a higher eye protection.

[0120] In some embodiments, the processor can evaluate the eye protection degree of the candidate eye protection parameters in a variety of ways. For example, the processor can determine the eye protection degree corresponding to the candidate eye protection parameters by looking up a fourth preset relationship table including the correspondence between the candidate eye protection parameters and the eye protection degree. The fourth preset relationship table can be determined based on historical data or manual experience.

[0121] In some embodiments, the degree of eye protection may also be related to the accumulated value of eye fatigue of the user at one or more moments in the future; for each candidate eye protection parameter, the processor may estimate the accumulated value of eye fatigue of the user at one or more moments in the future based on the candidate eye protection parameter; and determine the eye protection degree of the candidate eye protection parameter based on the accumulated value of eye fatigue.

[0122] In some embodiments, the processor may estimate the cumulative value of eye fatigue of the user at one or more moments in the future by various methods based on the candidate eye protection parameters. For example, the processor may estimate the cumulative value of eye fatigue of the user at one or more moments in the future by vector matching based on the candidate eye protection parameters.

[0123] In some embodiments, the processor can determine the accumulated eye fatigue value of the user at one or more moments in the future corresponding to the candidate eye protection parameters through an eye protection parameter evaluation and prediction model based on the candidate eye protection parameters, the sequence of screens presented by the tablet computer within a third preset time period, the user's usage status, the user's facial image, the user's current accumulated eye fatigue value, and the user's current eye fatigue rate.

[0124] The third preset time period refers to a time period before the current moment when the user uses the tablet computer. In some embodiments, the third preset time period is within the first preset time period and is shorter than the first preset time period.

[0125] The future time or time periods refers to one or more time periods after the current time period.

[0126] The eye protection parameter evaluation prediction model can be a machine learning model with a custom structure as described below, or other neural network models, such as a convolutional neural network model.

[0127] In some embodiments, the input of the eye protection parameter evaluation prediction model may include candidate eye protection parameters, a sequence of screens presented by the tablet computer within a third preset time period, a user's usage status, a user's facial image, a user's current cumulative value of eye fatigue, and a user's current rate of eye fatigue, and the output may be a cumulative value of eye fatigue for the user at one or more moments in the future. For more information about the candidate eye protection parameters, a sequence of screens presented by the tablet computer within a third preset time period, a user's usage status, a user's facial image, a user's current cumulative value of eye fatigue, a user's current rate of eye fatigue, and a cumulative value of eye fatigue for the user at one or more moments in the future, please refer to the relevant description above.

[0128] In some embodiments, the eye protection parameter evaluation prediction model can be trained by multiple second training samples with second labels.

[0129] In some embodiments, the second training sample may include multiple groups of second training samples, and each group of second training samples and the corresponding second label may be obtained based on historical data. For example, the historical time period is divided into multiple sub-historical time periods, and each sub-historical time period is divided into a first time period and a second time period, wherein the first time period precedes the second time period. For multiple sub-historical time periods, the processor may obtain multiple groups of second training samples and corresponding second labels. Each group of second training samples may include sample eye protection parameters of the second time period of the sub-historical time period, sample screen features of the first time period and the second time period of the sub-historical time period, sample user usage status of the second time period of the sub-historical time period, sample user facial images of the first time period and the second time period of the sub-historical time period, sample eye fatigue cumulative value of the first time period of the sub-historical time period, and sample eye fatigue rate of the second time period of the sub-historical time period. The second label may refer to the actual eye fatigue cumulative value of the second time period of the sub-historical time period. Among them, the time length of the historical time period may be the same as the third preset time period.

[0130] For a sub-historical time period, the processor can obtain a group of second training samples and corresponding second labels through the following steps: taking the historical eye protection parameters of the second time period of the sub-historical time period, the historical user usage status of the second time period of the sub-historical time period, and the historical user facial images of the first and second time periods of the sub-historical time period as sample eye protection parameters of the second time period, sample user usage status of the second time period, and sample user facial images of the first and second time periods, respectively; based on the historical picture sequences of the first and second time periods presented by the tablet computer within the sub-historical time period, respectively extract the historical picture features of the first and second time periods, and determine them as sample picture features of the first and second time periods; based on the historical picture sequences of the second time period presented by the tablet computer within the sub-historical time period, determine the historical actual eye fatigue rate of the user in the second time period, and use it as the sample eye fatigue rate of the second time period; use the predicted eye fatigue cumulative value of the first time period of the sub-historical time period as the sample eye fatigue cumulative value of the first time period; and use the actual eye fatigue cumulative value of the second time period of the sub-historical time period as the second label corresponding to the group of second training samples.

[0131] The processor can determine the historical sight sequence, historical blink features, and historical sight point content sequence of the first period based on the historical user facial images of the first period and the historical screen sequence of the first period presented by the tablet computer; input the historical sight sequence, historical blink features, and historical sight point content sequence of the first period into the eye fatigue cumulative value prediction model, output the predicted eye fatigue cumulative value of the first period, and determine it as the sample eye fatigue cumulative value of the first period. For more information about the above process (such as determining the historical sight sequence, historical blink features, historical sight point content sequence, extracting screen features, outputting eye fatigue cumulative values, etc.), please refer to Figure 3 and its related description.

[0132] Using the eye fatigue cumulative value output by the eye fatigue cumulative value prediction model as the second training sample and the second label can unify the evaluation criteria and simplify the difficulty of obtaining the second label, while increasing the uniqueness of the second label, making the eye protection parameter evaluation prediction model obtained through training more accurate.

[0133] In some embodiments of the present specification, a model is used to determine the cumulative value of eye fatigue of the user at one or more moments in the future, so that the estimation of the cumulative value of eye fatigue is more accurate, thereby improving the accuracy of the eye protection degree of the candidate eye protection parameters, which is conducive to the subsequent selection of the most effective final eye protection parameters.

[0134] In some embodiments, for each candidate eye protection parameter, the processor may determine the eye protection degree of the candidate eye protection parameter based on the eye fatigue accumulation value through a preset rule. The preset rule may be manually set based on experience or set by system default. For example, the preset rule may mean that the eye protection degree of the candidate eye protection parameter is negatively correlated to the eye fatigue accumulation value (or the growth rate of the eye fatigue accumulation value) of the user at one or more future moments.

[0135] In some embodiments of the present specification, full consideration is given to the fact that when the eye protection mode is turned on, if the screen is too dark, the pupil will become larger in order to increase the amount of light entering the eye. The pupil will be in a tense and dilated state for a long time, which will cause eye tension, fatigue and sleepiness, and increase the possibility of worsening myopia. Therefore, the setting of the eye protection parameters does not mean that the screen is as dark as possible. The eye protection effect of the candidate eye protection parameters is accurately determined by estimating the cumulative value of eye fatigue of the user using the tablet computer under the candidate eye protection parameters in the future and combining the cumulative value of eye fatigue.

[0136] In some embodiments, the processor may determine the eye protection parameter in a variety of ways based on the eye protection levels of the candidate eye protection parameters. For example, the processor may select the candidate eye protection parameter with the highest eye protection level as the final eye protection parameter.

[0137] In some embodiments of the present specification, one or more candidate eye protection parameters can be generated based on the user's current eye fatigue rate and cumulative eye fatigue value, the eye protection degree of each candidate eye protection parameter can be accurately evaluated, and the final eye protection parameter can be selected from them based on the eye protection degree to achieve the optimal eye protection effect of the eye protection parameter, which is conducive to improving user comfort and experience.

[0138] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0139] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0140] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0141] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0142] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining the digits. Although the numerical domains and parameters used to confirm the breadth of the range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0143] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification is hereby incorporated by reference in its entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0144] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A tablet computer eye protection system, characterized in that: It includes an application data acquisition module, a touch sensing module, an environment sensing module, and a processor, wherein the processor is configured as follows: Acquire user usage data from the application data acquisition module, the touch sensing module, and the environment sensing module, wherein the user usage data includes a screen sequence presented by the tablet computer and user operation data on the tablet computer within a first preset time period, wherein the first preset time period includes at least the current moment, and the operation data includes application usage data and environment data; Based on the user usage data, evaluating the cumulative value of the user's eyestrain, the cumulative value of the eyestrain is used to reflect the cumulative value of the user's eyestrain degree; Determining eye protection parameters and eye protection prompt information according to the eye fatigue accumulation value and the eye fatigue rate, wherein the eye protection parameters include at least one of an adjustment amount of screen color temperature and an adjustment amount of screen brightness of the tablet computer; Wherein, the processor is further configured to: Extracting one or more screen features based on a screen sequence presented by the tablet computer within a second preset time period; Based on the picture features, determine the user's current eye fatigue rate by weighting; wherein the weight of the weighting is related to the user's current sight point; The step of determining the current eye fatigue rate of the user by weighting based on the picture features includes: calculating the average light intensity of each frame presented in the second preset time period, and determining the average light intensity change rate between adjacent frames as the light intensity change frequency; calculating the number of different pictures presented by the tablet computer per second, and determining it as the picture switching frequency; calculating the number of times the color change amplitude of the tablet computer exceeds a preset threshold per second, and determining it as the color change frequency, the average light intensity rate between adjacent frames refers to the ratio of the difference between the average light intensity of the next frame and the average light intensity of the previous frame to the average light intensity of the previous frame, and the color change amplitude refers to the RGB change amount between two adjacent frames; Determining eye protection parameters according to the eye fatigue accumulation value and the eye fatigue rate includes: Generate one or more candidate eye protection parameters according to the user's current eye fatigue rate and the eye fatigue cumulative value; The formula for determining the user's current eye fatigue rate is as follows: h Among them, h, , , They represent the user's current eye fatigue rate, light intensity change frequency, screen switching frequency, and color change frequency. , , They are , , The weight of Evaluate the eye protection degree of the candidate eye protection parameter, where the eye protection degree refers to the degree of eye protection that can be achieved by the eye protection parameter; The eye protection parameter is determined based on the eye protection degree of the candidate eye protection parameter.

2. The tablet computer eye protection system according to claim 1, characterized in that: The environmental sensing module further includes a gyroscope sensing device, and the user usage data further includes a tilt sequence of the tablet computer; The processor is further configured to: Determining user usage characteristics based on the user usage data; Based on the user usage characteristics and the user usage status, the accumulated value of the user's eyestrain is evaluated.

3. A tablet computer eye protection method, characterized in that: The method is implemented by a processor of the tablet computer eye protection system according to claim 1, and the method comprises: Acquire user usage data, the user usage data including a screen sequence presented by the tablet computer and user operation data on the tablet computer within a first preset time period, the first preset time period at least including the current moment, the operation data including application usage data and environment data; Based on the user usage data, evaluating the cumulative value of the user's eyestrain, the cumulative value of the eyestrain is used to reflect the cumulative value of the user's eyestrain degree; Determining eye protection parameters and eye protection prompt information according to the eye fatigue accumulation value and the eye fatigue rate, wherein the eye protection parameters include at least one of an adjustment amount of screen color temperature and an adjustment amount of screen brightness of the tablet computer; Wherein, the method further comprises: Extracting one or more screen features based on a screen sequence presented by the tablet computer within a second preset time period; Based on the picture features, determine the user's current eye fatigue rate by weighting; wherein the weight of the weighting is related to the user's current sight point; The step of determining the current eye fatigue rate of the user by weighting based on the picture features includes: calculating the average light intensity of each frame presented in the second preset time period, and determining the average light intensity change rate between adjacent frames as the light intensity change frequency; calculating the number of different pictures presented by the tablet computer per second, and determining it as the picture switching frequency; calculating the number of times the color change amplitude of the tablet computer exceeds a preset threshold per second, and determining it as the color change frequency, the average light intensity rate between adjacent frames refers to the ratio of the difference between the average light intensity of the next frame and the average light intensity of the previous frame to the average light intensity of the previous frame, and the color change amplitude refers to the RGB change amount between two adjacent frames; Determining eye protection parameters according to the eye fatigue accumulation value and the eye fatigue rate includes: Generate one or more candidate eye protection parameters according to the user's current eye fatigue rate and the eye fatigue cumulative value; The formula for determining the user's current eye fatigue rate is as follows: h Among them, h, , , They represent the user's current eye fatigue rate, light intensity change frequency, screen switching frequency, and color change frequency. , , They are , , The weight of Evaluate the eye protection degree of the candidate eye protection parameter, where the eye protection degree refers to the degree of eye protection that can be achieved by the eye protection parameter; The eye protection parameter is determined based on the eye protection degree of the candidate eye protection parameter.

4. The tablet computer eye protection method according to claim 3, characterized in that: The user usage data also includes a tilt sequence of the tablet computer; The evaluating the cumulative value of the user's eye fatigue based on the user usage data includes: Determining user usage characteristics based on the user usage data; Based on the user usage characteristics and the user usage status, the accumulated value of the user's eyestrain is evaluated.

5. A tablet computer eye protection device, characterized in that: The apparatus comprises at least one processor and at least one memory; The at least one memory is used to store computer instructions; The at least one processor is used to execute at least part of the computer instructions to implement the tablet computer eye protection method as described in any one of claims 3 to 4.

6. A computer-readable storage medium, characterized in that: The storage medium stores computer instructions. When the computer reads the computer instructions in the storage medium, the computer executes the tablet computer eye protection method as described in any one of claims 3 to 4.

Citation Information

Cited By

  • Education tablet computer screen intelligent adjusting method based on image processing

    CN119889254A

  • A screen intelligent adjustment method for educational tablet computer based on image processing

    CN119889254B