Terminal equipment control method and device, electronic equipment and storage medium

Abstract

The invention relates to a terminal equipment control method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining the baseline blink data of a watching object, the baseline blink data being the blink data of the watching object under the condition that the watching object does not watch the content displayed on the terminal equipment; under the condition that the watching object watches the content displayed on the terminal equipment, determining current blink data of the watching object; and comparing the baseline blinking data with the current blinking data, and controlling contents displayed on the terminal equipment according to a comparison result. And the comparison result can represent the eye fatigue degree of the watching object, that is, the content displayed on the terminal equipment is controlled according to the eye fatigue degree, and the myopia problem caused by eye fatigue can be improved.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and in particular to a terminal device control method, device, electronic device and storage medium. Background Art

[0002] With the development of network and computer technology, the application field of terminal equipment is showing a trend of wide application. Among them, mobile phones, computers, etc. refer to terminal equipment with development platforms, operating systems, the ability to install and uninstall applications, and continuous upgrades and functional expansion. Teenagers and children spend a long time watching mobile phones and computers, and their parents cannot monitor them in real time, resulting in a high incidence of myopia among teenagers and children.

[0003] In the related art, in order to reduce the damage to the eyes of teenagers and children caused by watching mobile phones and computers, it is usually adopted to set "eye protection mode" for mobile phones and computers, which includes such features as blue light weakening, sitting posture correction, distance correction, etc. Although setting "eye protection mode" can reduce the damage to the eyes of teenagers and children to a certain extent, if teenagers and children watch mobile phones and computers for a long time, it will still cause eye fatigue and cause myopia. Summary of the invention

[0004] In order to solve the technical problem that the above-mentioned setting of "eye protection mode" can reduce the damage to the eyes of teenagers and children to a certain extent, but if teenagers and children watch mobile phones, computers, etc. for a long time, it will still cause eye fatigue and cause myopia, this application provides a terminal device control method, device, electronic device and storage medium. The specific technical solution is as follows:

[0005] In a first aspect, the present application provides a terminal device control method, the method comprising:

[0006] Acquire baseline blink data of the viewing object, where the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on the terminal device;

[0007] In a case where the viewing object is viewing content displayed on the terminal device, determining current blink data of the viewing object;

[0008] The baseline blink data is compared with the current blink data, and content displayed on the terminal device is controlled according to the comparison result.

[0009] In an optional embodiment, the acquiring baseline blink data of the viewing object includes:

[0010] The eye blinking data of the viewing object is measured by a wearable eye tracking device to obtain the viewing object's baseline eye blinking data;

[0011] or,

[0012] Acquire a daily video of the viewing object, where the daily video is a video of the viewing object when the viewing object is not viewing content displayed on a terminal device;

[0013] The eye state of the viewing object in the daily video is identified, and according to the eye state, the baseline blink data of the viewing object is determined.

[0014] In an optional implementation, determining the current blink data of the viewed object includes:

[0015] Acquire a motion factor data set corresponding to a facial expression feature motion factor, wherein the motion factor data set includes motion factor data within a preset time period of the facial expression feature motion factor;

[0016] Acquire a predefined blinking change process, and count the number of blinks corresponding to the motion factor data set according to the blinking change process;

[0017] Determine the blink duration corresponding to the number of blinks, and determine current blink data of the viewed object according to the number of blinks and the blink duration.

[0018] In an optional implementation, the step of obtaining a motion factor data set corresponding to a facial expression feature motion factor includes:

[0019] At any viewing moment, collecting depth data of the face of the viewing object, and setting motion factor data corresponding to the facial expression motion factor according to the depth data;

[0020] Determine a left eye motion factor or a right eye motion factor in the facial expression motion factor, and obtain a motion factor data set corresponding to the left eye motion factor or the right eye motion factor;

[0021] The motion factor data set is motion factor data of the left eye motion factor or the right eye motion factor within a preset time period.

[0022] In an optional embodiment, the blinking change process is a process in which the eye state changes from an open state to a squinting state to a closed state, and from the closed state to an open state through a squinting state again;

[0023] The open state requires the motion factor data to be less than a preset first threshold, the squinting state requires the motion factor data to be greater than or equal to the preset first threshold and less than or equal to the preset second threshold, and the closed eye state requires the motion factor data to be greater than a preset second threshold.

[0024] In an optional embodiment, the baseline blink data is a baseline blink frequency, and the current blink data is a current blink frequency;

[0025] The comparing the baseline blink data with the current blink data comprises:

[0026] Dividing the current blinking frequency by the baseline blinking frequency to obtain the eye fatigue intensity of the viewing object;

[0027] The controlling of the content displayed on the terminal device according to the comparison result includes:

[0028] When the eye fatigue intensity is greater than a preset first intensity threshold, maintaining normal display of the content displayed on the terminal device;

[0029] When the eye fatigue intensity is less than a preset first intensity threshold and greater than a preset second intensity threshold, displaying a blinking animation in the content displayed on the terminal device;

[0030] When the eye fatigue intensity is less than a preset second intensity threshold, the display of the content displayed on the terminal device is paused, and a prompt message for blinking and taking a break is displayed.

[0031] In an optional embodiment, the baseline blink data is a baseline blink interval, and the current blink data is a current blink interval;

[0032] The comparing the baseline blink data with the current blink data comprises:

[0033] Dividing the current blink interval by the baseline blink interval to obtain the eye fatigue intensity of the viewing object;

[0034] The controlling of the content displayed on the terminal device according to the comparison result includes:

[0035] When the eye fatigue intensity is less than a preset first intensity threshold, maintaining normal display of the content displayed on the terminal device;

[0036] When the eye fatigue intensity is greater than a preset first intensity threshold and less than a preset second intensity threshold, displaying a blinking animation in the content displayed on the terminal device;

[0037] When the eye fatigue intensity is greater than a preset second intensity threshold, the display of the content displayed on the terminal device is paused, and a prompt message for blinking and taking a break is displayed.

[0038] In a second aspect, the present application provides a terminal device control device, the device comprising:

[0039] A data acquisition module, used to acquire baseline blink data of a viewing object, wherein the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on a terminal device;

[0040] A data determination module, configured to determine current blink data of the viewing object when the viewing object is viewing content displayed on the terminal device;

[0041] The device control module is used to compare the baseline blink data with the current blink data, and control the content displayed on the terminal device according to the comparison result.

[0042] In a third aspect, an electronic device is provided, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0043] Memory, used to store computer programs;

[0044] The processor is used to implement any terminal device control method described in the first aspect above when executing the program stored in the memory.

[0045] In a fourth aspect, a storage medium is also provided, wherein instructions are stored in the storage medium, and when the storage medium is run on a computer, the computer executes any terminal device control method described in the first aspect.

[0046] In a fifth aspect, a computer program product comprising instructions is also provided, which, when executed on a computer, enables the computer to execute any of the terminal device control methods described above.

[0047] The above-mentioned technical solution provided by the embodiment of the present application has the following advantages compared with the prior art: the method provided by the embodiment of the present application obtains the baseline blink data of the viewing object, the baseline blink data is the blink data of the viewing object when not watching the content displayed on the terminal device, and when the viewing object watches the content displayed on the terminal device, determines the current blink data of the viewing object, compares the baseline blink data with the current blink data, and controls the content displayed on the terminal device according to the comparison result.

[0048] By obtaining the baseline blink data of the viewing object, and determining the current blink data of the viewing object when the viewing object is viewing the content displayed on the terminal device, the baseline blink data is compared with the current blink data, and the content displayed on the terminal device is controlled according to the comparison result. The comparison result can characterize the degree of eye fatigue of the viewing object, that is, it is possible to control the content displayed on the terminal device according to the degree of eye fatigue, which can improve the myopia problem caused by eye fatigue. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0050] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0051] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0052] Figure 1 A schematic diagram of an implementation flow of a terminal device control method provided in an embodiment of the present application;

[0053] Figure 2 A schematic diagram of an implementation flow of another terminal device control method provided in an embodiment of the present application;

[0054] Figure 3 A schematic diagram of a blinking animation provided in an embodiment of the present application;

[0055] Figure 4 A schematic diagram of the structure of a terminal device control device provided in an embodiment of the present application;

[0056] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0058] The disclosure below provides many different embodiments or examples to realize the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0059] In the embodiment of the present application, for teenagers and children, using mobile phones and other terminal devices for one hour can lead to reduced eye comfort, reduced blinking frequency, and increased blink interval. For example, using mobile phones and other terminal devices will quickly reduce children's blinking frequency, from 20.8 blinks / minute to 8.9 blinks / minute; the blink interval between blinks is longer, and the blink interval increases from 2.9 seconds to 8.7 seconds.

[0060] Based on this, the embodiment of the present application first obtains the daily baseline blinking frequency and blink interval of the viewing object (such as the above-mentioned teenagers, children, etc.), and then determines the blinking frequency and blink interval of the viewing object when watching the content displayed on the viewing terminal device, and compares the difference between the two. When the difference is greater than a certain threshold, a blink prompt animation is given, and the blinking frequency and blink interval continue to be observed. If there is no improvement, the normal display of the content displayed on the terminal device is paused, and a voice eye rest prompt is given.

[0061] Based on the above invention concept, Figure 1 FIG. 1 is a schematic diagram of an implementation flow of a terminal device control method provided in an embodiment of the present application. The method is applied to an electronic device and may specifically include the following steps:

[0062] S101, obtaining baseline blink data of a viewing object, where the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on a terminal device.

[0063] In the embodiment of the present application, the baseline blink data of the viewing object is obtained. The baseline blink data of the viewing object refers to the blink data of the viewing object when the viewing object is not viewing the content displayed on the terminal device, which means the blink data of the viewing object in daily life (not concentrating on doing things, such as chatting, walking).

[0064] For example, the baseline blink data of children refers to the blink data of children in daily life (not doing things with concentration, such as chatting, walking). The baseline blink data includes the baseline blink frequency and the baseline blink interval. The baseline blink frequency refers to the number of times a child blinks within one minute in daily life (not doing things with concentration, such as chatting, walking), and the baseline blink interval refers to the average time interval between multiple blinks within a certain period of time in daily life (not doing things with concentration, such as chatting, walking).

[0065] The baseline blink data of the viewing object can be obtained in the following ways:

[0066] 1. Use a wearable eye tracking device on the subject, which allows blink measurement without restricting head movement. The device can obtain eye movement data, and then use open source eye tracking software to identify blinks in the eye movement data, output the blink time value (millisecond level) within a period of time, and calculate the baseline blink data based on the blink time value, that is, the baseline blink frequency and baseline blink interval. To this end, the wearable eye tracking device is used to measure the blinks of the subject and obtain the baseline blink data of the subject.

[0067] 2. Record the daily video of the viewing object, identify the viewing object's eye state in the daily video with the help of face recognition algorithm, and calculate the baseline blink data, that is, the baseline blink frequency and baseline blink interval. To this end, obtain the viewing object's daily video, which is the video of the viewing object without watching the content displayed on the terminal device; identify the viewing object's eye state in the daily video, and determine the viewing object's baseline blink data based on the eye state.

[0068] S102: When the viewing object is viewing content displayed on the terminal device, current blink data of the viewing object is determined.

[0069] In an embodiment of the present application, for a viewing object, when the viewing object is viewing content displayed on a terminal device, current blink data of the viewing object is determined. The current blink data includes a current blink frequency and a current blink interval, which means that when the viewing object is viewing content displayed on a terminal device, the current blink frequency and the current blink interval of the viewing object are determined.

[0070] It should be noted that the content displayed on the terminal device may be a video being played, so that when the viewing object is watching the video, the current blinking frequency and the current blinking interval of the viewing object are determined. For example, when a child is watching a video, the current blinking frequency and the current blinking interval of the child are determined, which is not limited in the embodiments of the present application.

[0071] S103, comparing the baseline blink data with the current blink data, and controlling the content displayed on the terminal device according to the comparison result.

[0072] In an embodiment of the present application, for the baseline blink data and the current blink data of the viewing object, the baseline blink data and the current blink data can be compared to obtain a comparison result, and the content displayed on the terminal device can be controlled based on the comparison result.

[0073] Among them, the comparison results can represent the degree of eye fatigue of the viewing object, so that the content displayed on the terminal device can be controlled according to the degree of eye fatigue, which can improve the myopia problem caused by eye fatigue.

[0074] Through the above description of the technical solution provided in the embodiment of the present application, the baseline blink data of the viewing object is obtained, and the baseline blink data is the blink data of the viewing object when not viewing the content displayed on the terminal device. When the viewing object watches the content displayed on the terminal device, the current blink data of the viewing object is determined, the baseline blink data is compared with the current blink data, and the content displayed on the terminal device is controlled according to the comparison result.

[0075] By obtaining the baseline blink data of the viewing object, and determining the current blink data of the viewing object when the viewing object is viewing the content displayed on the terminal device, the baseline blink data is compared with the current blink data, and the content displayed on the terminal device is controlled according to the comparison result. The comparison result can characterize the degree of eye fatigue of the viewing object, that is, it is possible to control the content displayed on the terminal device according to the degree of eye fatigue, which can improve the myopia problem caused by eye fatigue.

[0076] like Figure 2 FIG. 1 is a schematic diagram of an implementation flow of another terminal device control method provided in an embodiment of the present application. The method is applied to an electronic device and may specifically include the following steps:

[0077] S201, obtaining baseline blink data of a viewing object, where the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on a terminal device.

[0078] In the embodiment of the present application, this step is similar to the above-mentioned step S101, and the embodiment of the present application will not be described one by one here.

[0079] S202, when the viewing object views the content displayed on the terminal device, obtaining a motion factor data set corresponding to the facial expression feature motion factor.

[0080] S203, obtaining a predefined blinking change process, and counting the number of blinks corresponding to the motion factor data set according to the blinking change process.

[0081] S204, determining the blink duration corresponding to the number of blinks, and determining current blink data of the viewing object according to the number of blinks and the blink duration.

[0082] In an embodiment of the present application, when the viewing object is viewing the content displayed on the terminal device, a motion factor data set corresponding to the facial expression feature motion factor is obtained. The motion factor data set includes motion factor data of the facial expression feature motion factor within a preset time period, and the motion factor data is a floating point type value between 0 and 1. A predefined blinking change process is obtained, and according to the blinking change process, the number of blinks corresponding to the motion factor data set is counted, and the blink duration corresponding to the number of blinks is determined. According to the number of blinks and the blink duration, the current blink data of the viewing object, that is, the current blink frequency and the current blink interval, are determined.

[0083] Taking the iOS system of Apple mobile phones as an example, the system library ARKit provides a more abstract way to represent facial expressions, which is called Blend Shapes. Technically, Blend Shapes is a set of dictionaries that store facial expression feature motion factors, which contains 52 sets of facial expression feature motion factors. ARKit will set the corresponding facial expression feature motion factor motion factor data, that is, floating point type value, between 0 and 1, based on the depth data of the face collected by the depth camera.

[0084] ARKit can use these facial expression feature motion factors to drive 2D or 3D models, which will show the same expression as the user in real time. The above 52 groups of facial expression feature motion factors specifically include 7 groups of left eye motion factors, 7 groups of right eye motion factors, 27 groups of mouth and chin motion factors, 10 groups of eyebrow, cheek and nose motion factors, and 1 group of tongue motion factors. In the embodiment of this application, only eye-related motion factors are concerned.

[0085] Each set of facial expression feature motion factors represents a facial expression feature recognized by ARKit. Each set of facial expression feature motion factors includes a locator representing a specific facial expression and a floating-point value representing the degree of expression. The floating-point value ranges from 0 to 1, where 0 represents no expression and 1 represents full expression. For example, when the floating-point value corresponding to the mouth motion factor is 0, it means that the mouth has no expression and is in a closed state. When it is 1, it means that the mouth has full expression and is in a fully open state.

[0086] The embodiments of the present application focus on eye-related motion factors, namely the left eye motion factor (ARBlendShapeLocationEyeBlinkLeft) and the right eye motion factor (ARBlendShapeLocationEyeBlinkRight). The closer the motion factor data in the left eye motion factor and the right eye motion factor returned by ARKit is to 1, the more closed the left eye and the right eye are (closed eyes); the closer the motion factor data in the left eye motion factor and the right eye motion factor returned by ARKit is to 0, the less closed the left eye and the right eye are (eyes are open). And the degree of opening and closing of the left and right eyes is consistent, that is, the amplitude and frequency of blinking are exactly the same.

[0087] Based on this, for any viewing moment, the depth data of the face of the viewing object is collected, and the motion factor data corresponding to the corresponding facial expression motion factor (that is, the above-mentioned floating-point type value) is set according to the depth data of the face of the viewing object. In this way, there are multiple motion factor data (that is, the above-mentioned floating-point type value) in the facial expression motion factor in time order, and the left eye motion factor or the right eye motion factor in the facial expression motion factor is determined, and the motion factor data set corresponding to the left eye motion factor or the right eye motion factor is obtained. The motion factor data set is a plurality of motion factor data in time order within a preset time period of the left eye motion factor or the right eye motion factor, as shown in Table 1 below.

[0088]

[0089]

[0090] Table 1

[0091] In this way, multiple motion factor data in time sequence within a preset time period of the left eye motion factor or the right eye motion factor can be obtained, that is, the motion factor data of the left eye motion factor or the right eye motion factor within a period of time in time sequence (that is, the above-mentioned floating-point type value), and then the predefined blinking change process can be obtained. According to the blinking change process, the number of blinks corresponding to the motion factor data set is counted, and the blink duration corresponding to the number of blinks is determined. According to the number of blinks and the blink duration, the current blink data of the viewing object, that is, the current blink frequency and the current blink interval, are determined.

[0092] For the predefined blinking change process, it can be understood that the eye state changes from the open state to the squinting state to the closed state, and from the closed state to the open state through the squinting state again, and the open state requires the motion factor data (i.e. the above floating point type value) to be less than the preset first threshold (e.g. 0.2), the squinting state requires the motion factor data to be greater than or equal to the preset first threshold and less than or equal to the preset second threshold (e.g. 0.6), and the closed state requires the motion factor data to be greater than the preset second threshold. The specific algorithm for calculating the blinking frequency and blinking interval within a period of time is:

[0093] A: Set blinkCount to 0, set the initial time point startTime of the first blink process to nil, set the current state lastState of the single process to nil, and set the last recorded time endTime to nil;

[0094] B: traverse the motion factor data set. If the current traversed motion factor data is less than 0.2 (given threshold), the current traversed motion factor data is considered to be in the open eye state. If blinkCount is 0, set startTime to the viewing time corresponding to the current traversed motion factor data; set lastState to Open;

[0095] C: Continue to traverse the motion factor data set. If the current traversed motion factor data is greater than 0.2 (given threshold) and less than 0.6 (given threshold) and lastState is Open, set lastState to Squint.

[0096] D: Continue to traverse the motion factor data set. If the current traversed motion factor data is greater than 0.6 and lastState is Squint, set lastState to Closed; otherwise, if lastState is Open, it is considered invalid data and the next open eye state is found again.

[0097] E: Continue to traverse the motion factor data set. If the current traversed motion factor data is greater than 0.2 (given threshold) and less than 0.6 (given threshold), if lastState is Closed, set lastState to Squint.

[0098] F: Continue to traverse the motion factor data set. If the current traversed motion factor data is less than 0.2, if lastState is Squint, set lastState to Open, and increment blinkCount by 1.

[0099] G: Repeat the above process until the last motion factor data, and determine endTime as the viewing time corresponding to the last motion factor data.

[0100] H: Subtract the endTime from the startTime, and the difference is the blink duration. Divide the difference by one minute to get the number of minutes. Divide blinkCount by the number of minutes, and the result is the blink frequency.

[0101] I: Subtract the endTime from the startTime, and the difference is the blink duration. Divide the difference by blinkCount, and the result is the blink interval. Alternatively, divide one minute by the blink frequency to get the blink interval.

[0102] S205, comparing the baseline blink data with the current blink data, and controlling the content displayed on the terminal device according to the comparison result.

[0103] In an embodiment of the present application, for the baseline blink data and the current blink data of the viewing object, the baseline blink data and the current blink data can be compared to obtain a comparison result, and the content displayed on the terminal device can be controlled based on the comparison result.

[0104] The baseline blink data is the baseline blink frequency, and the current blink data is the current blink frequency. Therefore, comparing the baseline blink data with the current blink data is essentially comparing the difference between the baseline blink frequency and the current blink frequency.

[0105] To this end, the current blinking frequency is divided by the baseline blinking frequency. The result is the intensity of eye fatigue of the viewing object, and prompts and suggestions can be made based on the intensity of eye fatigue.

[0106] Specifically, when the eye fatigue intensity is greater than a preset first intensity threshold (eg, 0.8), it indicates that the blinking frequency of the viewing object is normal and no processing is performed, that is, the content displayed on the terminal device is kept displayed normally.

[0107] When the eye fatigue intensity is less than a preset first intensity threshold and greater than a preset second intensity threshold (for example, 0.4), a blinking animation is displayed in the content displayed on the terminal device.

[0108] For example, a blinking animation is played on the top of the content displayed on the terminal device, and the animation disappears after three seconds. The purpose is to guide children to blink without interrupting their viewing. The content of the animation is the process of a cartoon character opening his eyes, squinting, and then closing his eyes, so as to remind children to blink / close their eyes for a rest. Figure 3 shown.

[0109] When the eye fatigue intensity is less than the preset second intensity threshold, the viewing of the content is blocked, that is, the display of the content displayed on the terminal device is paused, and a prompt message for blinking and taking a break is displayed. In addition, the prompt message for blinking and taking a break can also be announced by voice.

[0110] For example, if the eye fatigue intensity is less than 0.4, the content viewing is blocked and a blinking and resting reminder text is given on the page. At the same time as the page prompt, a voice prompt "Child, please blink your eyes and take a break!" is played. Only when the child has blinked frequently and rested for a period of time can the content be played again. Repeat the above detection steps when playing the content again.

[0111] In addition, the baseline blink data is the baseline blink interval, and the current blink data is the current blink interval. Therefore, comparing the baseline blink data with the current blink data is essentially comparing the difference between the baseline blink interval and the current blink interval.

[0112] To this end, the current blink interval is divided by the baseline blink interval to obtain the eye fatigue intensity of the viewing object, and prompt suggestions can be made based on the eye fatigue intensity.

[0113] Specifically, when the eye fatigue intensity is less than a preset first intensity threshold, the content displayed on the terminal device is kept displayed normally; when the eye fatigue intensity is greater than the preset first intensity threshold and less than a preset second intensity threshold, a blinking animation is displayed in the content displayed on the terminal device; when the eye fatigue intensity is greater than the preset second intensity threshold, the display of the content displayed on the terminal device is paused, and a prompt message for blinking and taking a break is displayed.

[0114] By obtaining the baseline blink data of the viewing object, and determining the current blink data of the viewing object when the viewing object is viewing the content displayed on the terminal device, the baseline blink data is compared with the current blink data, and the content displayed on the terminal device is controlled according to the comparison result. The comparison result can characterize the degree of eye fatigue of the viewing object, that is, it is possible to control the content displayed on the terminal device according to the degree of eye fatigue, which can improve the myopia problem caused by eye fatigue.

[0115] Corresponding to the above method embodiment, the present application embodiment also provides a terminal device control device, such as Figure 4 As shown, the apparatus may include: a data acquisition module 410 , a data determination module 420 , and a device control module 430 .

[0116] The data acquisition module 410 is used to acquire baseline blink data of the viewing object, where the baseline blink data is blink data of the viewing object when the viewing object is not viewing the content displayed on the terminal device;

[0117] A data determination module 420, configured to determine current blink data of the viewing object when the viewing object is viewing the content displayed on the terminal device;

[0118] The device control module 430 is used to compare the baseline blink data with the current blink data, and control the content displayed on the terminal device according to the comparison result.

[0119] The present application also provides an electronic device, such as Figure 5 As shown, it includes a processor 51, a communication interface 52, a memory 53 and a communication bus 54, wherein the processor 51, the communication interface 52, and the memory 53 communicate with each other through the communication bus 54.

[0120] A memory 53, for storing computer programs;

[0121] The processor 51 is used to execute the program stored in the memory 53 to implement the following steps:

[0122] Acquire baseline blink data of the viewing object, wherein the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on the terminal device; determine current blink data of the viewing object when the viewing object is viewing content displayed on the terminal device; compare the baseline blink data with the current blink data, and control content displayed on the terminal device based on the comparison result.

[0123] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0124] The communication interface is used for communication between the above electronic device and other devices.

[0125] The memory may include a random access memory (RAM) or a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0126] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0127] In another embodiment provided in the present application, a storage medium is also provided, in which instructions are stored. When the storage medium is run on a computer, the computer executes the terminal device control method described in any of the above embodiments.

[0128] In another embodiment provided in the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute the terminal device control method described in any one of the above embodiments.

[0129] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a storage medium, or transmitted from one storage medium to another storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive Solid State Disk (SSD)), etc.

[0130] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0131] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0132] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the protection scope of the present application.

Claims

1. A terminal device control method, characterized in that: The method comprises: Acquire baseline blink data of the viewing object, where the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on the terminal device; In a case where the viewing object is viewing content displayed on the terminal device, determining current blink data of the viewing object; The baseline blink data is compared with the current blink data, and content displayed on the terminal device is controlled according to the comparison result.

2. The method according to claim 1, characterized in that The step of obtaining baseline blink data of the viewing object comprises: The eye blinking data of the viewing object is measured by a wearable eye tracking device to obtain the viewing object's baseline eye blinking data; or, Acquire a daily video of the viewing object, where the daily video is a video of the viewing object when the viewing object is not viewing content displayed on a terminal device; The eye state of the viewing object in the daily video is identified, and according to the eye state, the baseline blink data of the viewing object is determined.

3. The method according to claim 1, characterized in that The determining current blink data of the viewing object comprises: Acquire a motion factor data set corresponding to a facial expression feature motion factor, wherein the motion factor data set includes motion factor data within a preset time period of the facial expression feature motion factor; Acquire a predefined blinking change process, and count the number of blinks corresponding to the motion factor data set according to the blinking change process; Determine the blink duration corresponding to the number of blinks, and determine current blink data of the viewed object according to the number of blinks and the blink duration.

4. The method according to claim 3, characterized in that: The step of obtaining a motion factor data set corresponding to a facial expression feature motion factor comprises: At any viewing moment, collecting depth data of the face of the viewing object, and setting motion factor data corresponding to the facial expression motion factor according to the depth data; Determine a left eye motion factor or a right eye motion factor in the facial expression motion factor, and obtain a motion factor data set corresponding to the left eye motion factor or the right eye motion factor; The motion factor data set is motion factor data of the left eye motion factor or the right eye motion factor within a preset time period.

5. The method according to claim 3, characterized in that: The blinking change process is a process in which the eye state changes from an open state to a squinting state to a closed state, and from a closed state to an open state through a squinting state again; The open state requires the motion factor data to be less than a preset first threshold, the squinting state requires the motion factor data to be greater than or equal to the preset first threshold and less than or equal to the preset second threshold, and the closed state requires the motion factor data to be greater than a preset second threshold.

6. The method according to claim 1, characterized in that The baseline blink data is the baseline blink frequency, and the current blink data is the current blink frequency; The comparing the baseline blink data with the current blink data comprises: Dividing the current blinking frequency by the baseline blinking frequency to obtain the eye fatigue intensity of the viewing object; The controlling of the content displayed on the terminal device according to the comparison result includes: When the eye fatigue intensity is greater than a preset first intensity threshold, maintaining normal display of the content displayed on the terminal device; When the eye fatigue intensity is less than a preset first intensity threshold and greater than a preset second intensity threshold, displaying a blinking animation in the content displayed on the terminal device; When the eye fatigue intensity is less than a preset second intensity threshold, the display of the content displayed on the terminal device is paused, and a prompt message for blinking and taking a break is displayed.

7. The method according to claim 1, characterized in that The baseline blink data is the baseline blink interval, and the current blink data is the current blink interval; The comparing the baseline blink data with the current blink data comprises: Dividing the current blink interval by the baseline blink interval to obtain the eye fatigue intensity of the viewing object; The controlling of the content displayed on the terminal device according to the comparison result includes: When the eye fatigue intensity is less than a preset first intensity threshold, maintaining normal display of the content displayed on the terminal device; When the eye fatigue intensity is greater than a preset first intensity threshold and less than a preset second intensity threshold, displaying a blinking animation in the content displayed on the terminal device; When the eye fatigue intensity is greater than a preset second intensity threshold, the display of the content displayed on the terminal device is paused, and a prompt message for blinking and taking a break is displayed.

8. A terminal device control device, characterized in that: The device comprises: A data acquisition module, used to acquire baseline blink data of a viewing object, wherein the baseline blink data is blink data of the viewing object when the viewing object is not viewing content displayed on a terminal device; A data determination module, configured to determine current blink data of the viewing object when the viewing object is viewing content displayed on the terminal device; The device control module is used to compare the baseline blink data with the current blink data, and control the content displayed on the terminal device according to the comparison result.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing any of the methods described in claims 1-7 when executing a program stored in a memory.

10. A storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images