Electronic device, its control method and device, and readable storage medium

Abstract

The present application discloses an electronic device, a control method and device thereof, and a readable storage medium, belonging to the field of communication technologies. The control method of the electronic device includes: when the electronic device recognizes target person information, determining the actual line of sight and the line-of-sight divergence degree of the target person according to the target person information; determining the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line-of-sight divergence degree and the screen parameters of the electronic device; controlling the operation of the electronic device according to the comparison result between the attention probability and a preset threshold; wherein the target person information includes at least one of the following: face recognition information, torso recognition information.

Description

Technical Field

[0001] This application belongs to the field of communication technologies, and particularly relates to an electronic device, a control method and device thereof, and a readable storage medium. Background Art

[0002] With the development of Internet technologies, the scope of use of mobile electronic devices has become increasingly wide, and how to prevent users from being snooped on when using mobile electronic devices has also become an important topic. However, in existing anti-snooping technology means for mobile electronic devices, the accuracy of the judgment result of whether there is someone snooping on the mobile electronic device is relatively low, and the problem of misjudgment easily occurs, thereby reducing the accuracy of the implementation of the anti-snooping strategy of the mobile electronic device. For the anti-snooping means of other fixed electronic devices (such as self-service terminal devices in banks), complex iris recognition devices and eye tracking devices are often required to achieve, and its anti-snooping means are difficult to implement in mobile electronic devices. Summary of the Invention

[0003] The purpose of the embodiments of this application is to provide an electronic device, a control method and device thereof, and a readable storage medium, which can solve the problem that the accuracy of the implementation of the anti-snooping strategy of mobile electronic devices in the prior art is relatively low.

[0004] In a first aspect, the embodiments of this application provide a control method for an electronic device, and the method includes: when the electronic device recognizes target person information, determining the actual line of sight and the line-of-sight divergence degree of the target person according to the target person information; determining the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line-of-sight divergence degree and the screen parameters of the electronic device; controlling the operation of the electronic device according to the comparison result between the attention probability and a preset threshold; where the target person information includes at least one of the following: face recognition information, torso recognition information.

[0005] In a second aspect, the embodiments of this application provide a control device for an electronic device, and the device includes: a processing unit, configured to determine the actual line of sight and the line-of-sight divergence degree of the target person according to the target person information when the electronic device recognizes the target person information; the processing unit is further configured to determine the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line-of-sight divergence degree and the screen parameters of the electronic device; a control unit, configured to control the operation of the electronic device according to the comparison result between the attention probability and a preset threshold; where the target person information includes at least one of the following: face recognition information, torso recognition information.

[0006] In a third aspect, the embodiments of this application provide an electronic device, and the electronic device includes a processor and a memory, and the memory stores a program or instruction that can run on the processor, and when the program or instruction is executed by the processor, the steps of the control method for the electronic device as described in the first aspect are implemented.

[0007] Fourthly, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the control method of the electronic device in the first aspect are implemented.

[0008] Fifthly, an embodiment of the present application provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor, and the processor is configured to run a program or instruction to implement the steps of the control method of the electronic device in the first aspect.

[0009] Sixthly, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the control method of the electronic device in the first aspect.

[0010] In the embodiment of the present application, when the electronic device recognizes the target person information, the actual line of sight and the line-of-sight divergence degree of the target person are determined according to the target person information; according to the actual line of sight, the line-of-sight divergence degree and the screen parameters of the electronic device, the attention probability of the target person to the display screen of the electronic device is determined; according to the comparison result between the attention probability and a preset threshold, the electronic device is controlled to work; wherein, the target person information includes at least one of the following: face recognition information, torso recognition information. Through the above control method of the electronic device, when the electronic device detects the face of the target person, the target person information is recognized, and the actual viewing line of sight and the line-of-sight divergence degree of the target person are determined according to the recognized target person information. On this basis, according to the actual line of sight, the line-of-sight divergence degree of the target person and the screen parameters of the electronic device, the peeping probability of the target person, that is, the attention probability of the target person to the display screen of the electronic device is determined, and the anti-peeping screen strategy is implemented or not implemented on the electronic device according to the determined attention probability.

[0011] In this way, the peeping probability of the target person can be determined only through the recognition information of the target person, reducing the device requirements for implementing the anti-peeping screen means, thereby improving the ease of implementing the anti-peeping screen means and reducing the production cost of the electronic device. At the same time, determining the peeping probability of the target person through the actual line of sight and the line-of-sight divergence degree of the target person avoids the situation of misjudging whether the target person peeps at the screen by the electronic device, and improves the accuracy of implementing the anti-peeping screen strategy of the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is a schematic flowchart of the control method of the electronic device provided by the embodiment of the present application;

[0013] Figure 2 is one of the schematic diagrams of the principle of the control method of the electronic device provided by the embodiment of the present application;

[0014] Figure 3 The second schematic diagram of the control method of the electronic device provided by the embodiment of the present application;

[0015] Figure 4 The third schematic diagram of the control method of the electronic device provided by the embodiment of the present application;

[0016] Figure 5 The fourth schematic diagram of the control method of the electronic device provided by the embodiment of the present application;

[0017] Figure 6 The structural block diagram of the control device of the electronic device provided by the embodiment of the present application;

[0018] Figure 7 The first hardware schematic diagram of the electronic device provided by the embodiment of the present application;

[0019] Figure 8 The second hardware schematic diagram of the electronic device provided by the embodiment of the present application. Detailed implementation manners

[0020] Next, the technical solutions in the embodiments of the present application will be clearly described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.

[0021] The terms "first", "second", etc. in the description and claims of the present application are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. generally belong to the same category, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the description and claims means at least one of the connected objects, and the character " / " generally means an "or" relationship between the related objects before and after.

[0022] An embodiment of the first aspect of the present application proposes a control method for an electronic device. The execution subject of the technical solution of the control method of the electronic device provided by the embodiment of the present application can be a control device of the electronic device, which can be specifically determined according to actual usage requirements, and the embodiments of the present application do not make limitations. To more clearly describe the control method of the electronic device provided by the embodiments of the present application, the following method embodiments will exemplarily illustrate with the execution subject of the control method of the electronic device being a control device of the electronic device.

[0023] The following will combine the accompanying drawings and, through specific embodiments and their application scenarios, elaborate in detail on the control method of the electronic device provided by the embodiments of the present application.

[0024] As Figure 1 shown, the embodiments of the present application provide a control method for an electronic device, and this method may include the following steps S102 to step S106:

[0025] Step S102: Determine the actual line of sight and the line-of-sight divergence of the target person according to the target person information.

[0026] Among them, the above-mentioned electronic device is a mobile electronic device equipped with a display screen, a shooting device, and a face recognition function. Specifically, the electronic device can be a mobile device such as a smart phone or a tablet computer. For the specific type of the electronic device, it can be selected according to the actual situation and will not be specifically limited here.

[0027] Furthermore, the above-mentioned target person information is the identification information of the target person whose face information is not stored in the above-mentioned electronic device, and the above-mentioned target person information can also be the identification information of other target persons except the owner of the electronic device.

[0028] Furthermore, the above-mentioned target person information may specifically include the face recognition information and the torso recognition information of the target person. In the actual application process, the face recognition information and the torso recognition information of the target person recognized by the shooting device of the electronic device are used to determine the actual viewing line of sight of the target person and the corresponding line-of-sight divergence, so as to subsequently determine the peeping probability of the target person on the display screen of the electronic device according to the determined actual viewing line of sight and the corresponding line-of-sight divergence.

[0029] Specifically, during the use of the electronic device, one or more faces appearing within the shooting area of the shooting device of the electronic device can be recognized in real time. On this basis, when the shooting device of the electronic device recognizes the face of the above-mentioned target person, the target face and the target torso corresponding to the target person are recognized, and then the actual current viewing line of sight of the target person and the corresponding line-of-sight divergence are determined according to the recognized target face information and target torso information, so as to subsequently determine the peeping probability of the target person on the display screen of the electronic device according to the actual viewing line of sight and the line-of-sight divergence of the target person.

[0030] It can be understood that the actual viewing line of sight and the line of sight divergence of the target person determine the actual line of sight area range that the target person can view. On this basis, according to the actual viewing line of sight, the line of sight divergence of the target person, and the screen parameters of the electronic device, the peeping probability of the target person on the display screen of the electronic device is determined, ensuring the accuracy of determining the peeping probability of the target person. In this way, it is avoided that when the face of the target person faces the display screen of the electronic device, but the actual line of sight of the target person does not view the display screen, the behavior of the target person is misjudged as a peeping behavior, and it is also avoided that when the face of the target person does not face the display screen of the electronic device, but the actual line of sight of the target person is viewing the display screen, the behavior of the target person is misjudged as a non-peeping behavior, improving the accuracy of implementing the anti-peeping strategy of the electronic device.

[0031] In addition, in the actual application process, the 3D structured light can also be used to replace the camera device to identify the target person, and no specific restrictions are made here.

[0032] Step S104: Determine the attention probability of the target person on the display screen of the electronic device according to the actual line of sight, the line of sight divergence, and the screen parameters of the electronic device.

[0033] Among them, the above-mentioned actual line of sight and line of sight divergence are determined according to the face recognition information and torso recognition information of the target person.

[0034] It can be understood that the line of sight area range of the human eye is a conical-like area range, and moreover, the objects closer to the line of sight axis will be more concerned. The actual viewing line of sight and the line of sight divergence of the target person determine the actual line of sight area range that the target person can view. Further, the screen parameters of the electronic device will also affect the amount of content that the human eye can obtain from the display screen of the electronic device. Therefore, it is possible to determine the peeping probability of the target person on the electronic device, that is, the attention probability of the target person on the display screen of the electronic device, according to the actual viewing line of sight, the line of sight divergence of the target person, and the screen parameters of the electronic device.

[0035] Specifically, a probability density function related to the actual viewing line of sight of the target person, the divergence degree of the line of sight, and the screen parameters of the electronic device can be constructed. Then, based on the integral values of the probability density function within the actual line of sight area range of the target person and the area range of the display screen of the electronic device, the peeping probability of the target person, that is, the attention probability of the target person to the display screen of the electronic device, can be determined. In this way, based on the actual line of sight area range of the target person, the peeping probability of the target person is determined, ensuring the accuracy of the determination of the peeping probability of the target person. Furthermore, during the subsequent implementation process of the anti-peeping strategy of the electronic device, the accuracy of the implementation of the anti-peeping strategy of the electronic device is improved, thereby enhancing the usage performance of the electronic device.

[0036] Step S106: Control the electronic device to work according to the comparison result between the attention probability and the preset threshold.

[0037] Among them, the above-mentioned attention probability is the attention probability of the target person to the display screen of the electronic device, which represents the peeping probability of the target person to the electronic device. Specifically, the above-mentioned attention probability is in a direct proportional relationship with the peeping probability. The higher the above-mentioned attention probability, the higher the peeping probability of the target person to the electronic device, that is, the greater the possibility that the target person is peeping; and the lower the above-mentioned attention probability, the lower the peeping probability of the target person to the electronic device, that is, the smaller the possibility that the target person is peeping.

[0038] Specifically, after determining the attention probability of the target person to the display screen of the electronic device according to the actual viewing line of sight of the target person and the corresponding divergence degree of the line of sight, the attention probability is compared with the preset threshold. Then, according to the comparison result of the two, the electronic device is controlled to continue to work normally, or the electronic device is controlled to implement the corresponding anti-peeping strategy to protect user privacy.

[0039] Specifically, when the above-mentioned attention probability is greater than or equal to the preset threshold, it indicates that the current peeping probability of the target person to the electronic device is relatively high. At this time, it is considered that the target person is peeping, and the electronic device is controlled to implement the corresponding anti-peeping strategy to prevent the target person from snooping on user privacy. When the above-mentioned attention probability is less than the preset threshold, it indicates that the current peeping probability of the target person to the electronic device is relatively low. At this time, it is considered that the target person does not have a peeping behavior, and the electronic device is controlled to continue to work normally without implementing the anti-peeping strategy.

[0040] Among them, the above-mentioned preset threshold can be a value set according to the prior knowledge of the user. In the actual application process, the user can set the specific value of the above-mentioned preset threshold according to the actual situation, and no specific limitation is made here.

[0041] Further, the above anti-peeping screen strategy may specifically be: displaying a prompt message on the display screen of the electronic device, or giving a warning by means of indicator light flashing, etc., so as to timely inform the user that someone is peeping at the screen currently, so that the user can perform corresponding anti-peeping screen operations to protect their own privacy. The above anti-peeping screen strategy may also be: reducing the brightness of the display screen of the electronic device or directly turning off the screen, so as to automatically perform anti-peeping screen operations when it is detected that someone is peeping at the screen, thereby protecting the user's privacy. In the actual application process, the user can select the above anti-peeping screen strategy according to the actual situation, and no specific restrictions are made here.

[0042] In addition, in the anti-peeping screen method of the electronic device proposed in this embodiment, the historical peeping behavior of the target person can also be recorded to automatically give a warning when the target person enters the shooting range area of the shooting device of the electronic device.

[0043] In the control method of the electronic device provided in the embodiment of the present application, when the electronic device recognizes the target person information, the actual line of sight and the line of sight divergence of the target person are determined according to the target person information; according to the actual line of sight, the line of sight divergence and the screen parameters of the electronic device, the attention probability of the target person to the display screen of the electronic device is determined; according to the comparison result between the attention probability and the preset threshold, the electronic device is controlled to work; wherein, the target person information includes at least one of the following: face recognition information, torso recognition information. Through the above control method of the electronic device, when the electronic device detects the face of the target person, the target person information is recognized, and the actual viewing line of sight and the line of sight divergence of the target person are determined according to the recognized target person information. On this basis, according to the actual line of sight, the line of sight divergence of the target person and the screen parameters of the electronic device, the peeping probability of the target person, that is, the attention probability of the target person to the display screen of the electronic device is determined, and the anti-peeping screen strategy is implemented or not implemented on the electronic device according to the determined attention probability.

[0044] In this way, without relying on other complex detection devices (such as iris recognition devices, eye tracking devices, infrared sensors, etc.), the peeping probability of the target person can be determined only through the recognition information of the target person, reducing the equipment requirements for implementing the anti-peeping screen means, thereby improving the ease of implementing the anti-peeping screen means and reducing the production cost of the electronic device. At the same time, by determining the peeping probability of the target person through the actual line of sight and the line of sight divergence of the target person, the situation of misjudging whether the target person is peeping by the electronic device is avoided, improving the accuracy of implementing the anti-peeping screen strategy of the electronic device, and thus improving the performance of the electronic device.

[0045] In the embodiment of the present application, the above step S104 may specifically include the following steps S104a and S104b:

[0046] Step S104a: Update the preset probability density according to the actual line of sight, the line-of-sight divergence, and the screen parameters to obtain the target probability density function.

[0047] Among them, the above-mentioned actual line of sight and line-of-sight divergence are determined according to the face recognition information and torso recognition information of the target person. The above-mentioned screen parameters include the screen reflectivity and the preset influence factor.

[0048] Furthermore, the above-mentioned screen reflectivity is the reflectivity of the display screen of the electronic device to light, which can affect the amount of content obtained by the human eye from the display screen. Specifically, the higher the above-mentioned screen reflectivity, the more obvious the light reflection phenomenon of the display screen, and the lower the above-mentioned screen reflectivity, the weaker the light reflection phenomenon of the display screen. According to the different intensities of the light reflection phenomenon, the amount of content obtained by the human eye from the display screen is also different.

[0049] Furthermore, the above-mentioned preset influence factor is related to the material of the display screen, and the viewing angles of display screens of different materials are different. For example, the viewing angle of an IPS (In-Plane Switching) screen can reach 178 degrees, while the viewing angle of an ordinary TN screen is only 90 degrees. Therefore, the above-mentioned preset influence factor is specifically the influence factor of the color change of different types of display screens with the change of the viewing angle, and this preset influence factor is used to express the influence of the screen material on the amount of content obtained by the human eye.

[0050] It can be understood that the range of the line-of-sight area of the human eye is a conical-like area range, and the objects closer to the line-of-sight axis are more likely to be noticed. At the same time, the viewing distance of the human eye is not infinitely far. The farther the distance between the object and the human eye, the more blurred the human eye sees the object. Furthermore, the amount of content that the human eye can obtain from the display screen of the electronic device is also related to the viewing angle of the human eye. For example, the amount of content obtained when the human eye is perpendicular to the display screen is more than that when the human eye is horizontal to the display screen. In addition, when viewing different types of display screens at the same viewing angle, due to the differences in the screen reflectivity of the display screen and the influence factor of the color change of the display screen with the change of the viewing angle (i.e., the above-mentioned preset influence factor), the amount of content obtained by the human eye is also different.

[0051] Thus, the actual viewing line of sight and line-of-sight divergence of the target person, as well as the screen reflectivity and preset influence factor of the display screen, determine the amount of content that the target person can actually obtain from the display screen, that is, determine the attention probability of the target person to the display screen of the electronic device.

[0052] Therefore, in the embodiments of the present application, modeling is performed based on the actual line of sight and line-of-sight divergence of the target person, as well as the screen reflectivity and preset influence factor of the display screen of the electronic device. Specifically, asFigure 2 As shown in the figure, taking the center point O of the display screen of the electronic device as the origin, the plane where the display screen is located as the plane of the x-axis and the y-axis, and the vertically upward direction perpendicular to the plane where the display screen is located as the positive direction of the z-axis, a three-dimensional coordinate system is established. For any point in this three-dimensional coordinate system, substitute the above-mentioned actual line of sight, line-of-sight divergence, screen reflectivity, and preset influence factor into the preset probability density function. Specifically, substitute the specific values of the above-mentioned line-of-sight divergence, screen reflectivity, preset influence factor, and multiple target parameters determined according to the above-mentioned actual line of sight into the above-mentioned preset probability density function to define the probability density that the target person can observe this point, and obtain the target probability density function of the target person's attention probability for this point.

[0053] Among them, the above-mentioned preset probability density function is a function with the above-mentioned line-of-sight divergence, screen reflectivity, preset influence factor, and multiple target parameters determined according to the actual line of sight as variables.

[0054] Furthermore, as Figure 2 shown in the figure, for the actual line of sight of the above-mentioned target person, its axis line can be represented by a determined straight line in the above-mentioned three-dimensional coordinate system. On this basis, for any point in the above-mentioned three-dimensional coordinate system, the above-mentioned target parameters determined according to the actual line of sight specifically may include: the distance between this point and the human eye, the angle between the line connecting this point and the pupil and the axis line of the line of sight, and the angle between the line connecting this point and the human eye and the plane where the display screen is located.

[0055] Specifically, for any point in the above-mentioned three-dimensional coordinate system, its corresponding preset probability density function can be represented by the following formula:

[0056]

[0057] Among them, α is the line-of-sight divergence of the target person; θ is the angle between the line connecting this point and the pupil of the target person and the axis line of the actual line of sight of the target person; d represents the distance from this point to the pupil of the target person; represents the angle between the line connecting this point and the pupil and the plane where the display screen is located, that is, the viewing angle of the target person watching the display screen; reflectRatio represents the screen reflectivity of the display screen; screenType represents the material of the display screen, which is the influence factor (i.e., the above-mentioned preset influence factor) expressing the change of the color of the display screen with the change of the viewing angle.

[0058] It can be seen from this that the preset probability density function p(α,θ, d,reflectRatio,screenType) consists of f(α,θ), g(d), and h( It consists of three sub-functions: f(α, θ), p(x, y), and h(

[0059] Among them, f(α, θ) represents the attenuation function of the attention of the human eye to the display screen of the electronic device with respect to the viewing angle. And since the line-of-sight area range of the human eye is a cone-like area range, and the object closer to the line-of-sight axis is more likely to be noticed, therefore, the above f(α, θ) is monotonically increasing with respect to α and monotonically decreasing with respect to θ. That is to say, for any point in the above three-dimensional coordinate system, the larger the divergence angle α of the target person's line of sight, the smaller the angle θ between the line connecting this point and the pupil of the target person and the axis line of the target person's actual line of sight, and the higher the attention probability of the target person to this point. Based on the above rules, in the embodiment of the present application, f(α, θ) is specifically modeled by a normal distribution, denoted as θ ∼ N(0, α).

[0060] Furthermore, p(x, y) is monotonically increasing with respect to g(d). And since the viewing distance of the human eye is not infinite, the farther the distance between the object and the human eye, the blurrier the object is seen by the human eye. Therefore, the above g(d) is a monotonically decreasing function with respect to d. That is to say, the larger the distance from any point in the above three-dimensional coordinate system to the pupil of the target person, the lower the attention probability of the target person to this point.

[0061] Among them, with respect to the position coordinates (x1, y1, z1) of the pupil in the three-dimensional coordinate system, for each point (x, y, 0) in the plane where the display screen is located, the specific form of g(d) can be expressed by the following formula:

[0062]

[0063] Furthermore, h( reflectRatio, screenType) represents the probability density function of the target person seeing the content on the display screen at different viewing angles, which is related to the size of the viewing angle, the screen reflectivity of the display screen, and the screen material. The screen material is also related to the influence factor of the screen color change with the viewing angle change, that is, the above preset influence factor.

[0064] It can be understood that the probability that a human eye can view content from the display screen of an electronic device is related to the viewing angle of the human eye. The closer the viewing angle is to 90 degrees, the greater the probability that the human eye can view content from the display screen of the electronic device. Further, the probability that a human eye can view content from the display screen of an electronic device is also related to the screen reflectivity. When the viewing angle is close to 90 degrees, the greater the screen reflectivity of the display screen, the greater the probability that the human eye can view content from the display screen of the electronic device; when the viewing angle is far from 90 degrees, the greater the screen reflectivity of the display screen, the smaller the probability that the human eye can view content from the display screen of the electronic device.

[0065] Further, the probability that a human eye can view content from the display screen of an electronic device is also related to the viewing angle of the display screen. When the viewing angle is far from 90 degrees, the greater the viewing angle of the display screen, the greater the probability that the human eye can view content from the display screen of the electronic device. The viewing angle of the display screen is related to the screen material, and the screen material affects the above-mentioned preset influence factor. Specifically, in the embodiments of the present application, the above-mentioned preset influence factor is a monotonically decreasing function of the viewing angle of the display screen.

[0066] In summary, in the embodiments of the present application, as Figure 3 shown, the above h( reflectRatio, screenType) follows a normal distribution with respect to the viewing angle, where the mean μ of the normal distribution is 90 and the standard deviation σ is A(screenType)×reflectRatio, that is, (90, A(screenType)×reflectRatio). Wherein, A(screenType) represents the above-mentioned preset influence factor.

[0067] In the actual application process, the above-mentioned divergence of the line of sight, screen reflectivity, and preset influence factor are all fixed values determined according to the actual situation.

[0068] Further, as Figure 2As shown, for the actual line of sight of the above-mentioned target person, its axis can be represented by a determined line in the above three-dimensional coordinate system. On this basis, it can be understood that when the position of the human eye, the position of the pupil, and the axis of the line of sight have been determined, for any point in the above three-dimensional coordinate system, the distance between this point and the human eye, the angle between the line connecting this point and the pupil and the axis of the line of sight, and the angle between the line connecting this point and the human eye and the plane where the display screen is located, the above target parameters can all be represented by the coordinates (i.e., x, y, z) of this point in the above three-dimensional coordinate system. On this basis, in the above three-dimensional coordinate system, the vertical coordinate value of the plane where the display screen of the electronic device is located is zero (i.e., z = 0). Therefore, for any point in the plane where the display screen of the electronic device is located, the above target parameters corresponding to this point can all be represented only by the two variables x and y.

[0069] Therefore, for any point in the above three-dimensional coordinate system, after substituting the specific values of the above-mentioned line-of-sight divergence, screen reflectivity, preset influence factor, and the above target parameters determined according to the actual line of sight of the target person into the above preset probability density function, a binary function with x and y as variables can be obtained, that is, the above target probability density function.

[0070] Specifically, for any point in the above three-dimensional coordinate system, its corresponding target probability density function p(x, y) can be represented by the following formula:

[0071]

[0072] θ~N(0,α),

[0073]

[0074]

[0075] Among them, (x1, y1, z1) is the position coordinate of the pupil in the three-dimensional coordinate system, (x, y, 0) is the position coordinate of any point in the plane where the display screen is located, and θ is the angle between the line connecting this point and the pupil of the target person and the axis of the actual line of sight of the target person; represents the angle between the line connecting this point and the pupil and the plane where the display screen is located. For the calculation of θ and specifically involves the calculation principle of the angle between two lines. When the position coordinates of the pupil and the equation of the axis are known, the above θ and can be obtained through the calculation principle of the angle between two lines.

[0076] Further, α is the divergence degree of the target person's line of sight; d is the distance from this point to the pupil of the target person; reflectRatio is the screen reflectivity of the display screen; screenType is the material of the display screen, and A(screenType) is the influence factor of the color change of the display screen with the viewing angle change (i.e., the above-mentioned preset influence factor).

[0077] Step S104b: Determine the attention probability according to the probability expectation value of the target probability density function.

[0078] Among them, the target probability density function is the probability density function of the attention degree of the target person to any point in the above three-dimensional coordinate system, which represents the probability that the target person can observe any point in the above three-dimensional coordinate system. Therefore, after constructing the above target probability density function, the overall attention probability of the target person to the display screen of the electronic device can be represented by the probability expectation value of the target probability density function.

[0079] It can be understood that for a continuous probability density function, the probability expectation value of the probability density function in a specific region can be determined by means of integral operation. Since the above target probability density function is a binary function with x and y as variables, therefore, the actual line of sight range region and the display screen region can be used as the integration regions respectively, and the double integral operation is performed on the above target probability density function to respectively determine the first probability expectation value of the target probability density function in the actual line of sight range region of the target person, and its second probability expectation value in the display screen range region of the electronic device, and then the attention probability of the target person to the electronic device is determined according to the first probability expectation value and the second probability expectation value.

[0080] Specifically, the above first probability expectation value and second probability expectation value can be determined by the following formulas:

[0081] score = ∫ (x,y)∈S p(x, y)dS,

[0082] score’ = ∫ (x,y)∈M p(x, y)dM,

[0083] Among them, M is the display screen region, S is the range region of the actual line of sight in the plane where the display screen is located, p(x, y) is the target probability density function, x is the abscissa of the point in the plane where the display screen is located, y is the ordinate of the point in the plane where the display screen is located, score is the first probability expectation value, and score’ is the second probability expectation value.

[0084] In the above embodiments provided by the present application, when determining the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line-of-sight divergence, and the screen parameters of the electronic device, the target probability density function is determined according to the actual line of sight, the line-of-sight divergence, the screen reflectivity, and the preset influence factor related to the material of the display screen of the target person, and then the above attention probability is determined according to the probability expectation value of the target probability density function. In this way, by combining the actual line-of-sight situation of the target person and the relevant parameters of the display screen, the attention probability of the target person to the display screen of the electronic device is determined, further ensuring the accuracy of the determination of the attention probability, thereby improving the accuracy of the implementation of the anti-peeping screen strategy of the electronic device and improving the use performance of the electronic device.

[0085] In the embodiment of the present application, the above step S104b may specifically include the following steps S104b1 to S104b3:

[0086] Step S104b1: Determine the actual line-of-sight range area of the target person according to the actual line of sight and the line-of-sight divergence.

[0087] Among them, the above actual line of sight and the line-of-sight divergence are determined according to the face recognition information and the torso recognition information of the target person.

[0088] It can be understood that the line-of-sight range of the human eye is a region range similar to a conical body, and moreover, the objects closer to the line-of-sight axis will be more concerned, and the actual viewing line of sight and the line-of-sight divergence of the target person determine the actual line-of-sight range area of the target person.

[0089] Therefore, in the embodiment of the present application, after determining the actual line of sight and the line-of-sight divergence of the target person, the actual line-of-sight range area of the target person is determined according to the actual line of sight and the line-of-sight divergence of the target person. Specifically, according to the line-of-sight axis line of the actual line of sight of the target person and the line-of-sight divergence, the line-of-sight divergence boundary of the target person is determined, and then, with the line-of-sight axis line of the actual line of sight of the target person as the central axis and the line-of-sight divergence boundary of the target person as the generatrix, a conical body region similar to the actual line of sight of the target person is determined, and then the intersection region of the conical body region and the plane where the display screen is located is determined, and this intersection region is the actual line-of-sight range area of the target person.

[0090] Among them, it should be noted that the above actual line of sight and the line-of-sight divergence are the actual line of sight and the line-of-sight divergence of both eyes of the target person. In the actual application process, according to the actual line of sight and the line-of-sight divergence of each eye of the target person, the actual line-of-sight range area of this eye is determined, and then two actual line-of-sight range areas corresponding to the two eyes of the target person are obtained.

[0091] Step S104b2: Determine the first probability expectation value and the second probability expectation value of the target probability function by using the actual line-of-sight range area and the display screen area as the integration areas respectively.

[0092] It can be understood that after establishing the above three-dimensional coordinate system, any point in the three-dimensional coordinate system and the position of the eyes of the target person can be converted into coordinate points in this three-dimensional coordinate system. On this basis, when the position of the eyes of the above person has been determined, the above parameters related to the position of the eyes of the target person, such as the distance d from any point in the three-dimensional coordinate system to the pupil of the target person, can be represented by the coordinates (i.e., x, y, z) of this point in the above three-dimensional coordinate system. For any point in the plane where the display screen of the electronic device is located, since the vertical coordinate of this point is zero (i.e., z = 0), therefore, the parameters related to the position of this point and the human eye can be represented only by two variables x and y. That is to say, the above target probability density function is a binary function with x and y as variables.

[0093] It should be noted that the above target probability density function is the target probability density function of the two eyes of the target person. According to the different coordinate positions of the two eyes of the target person in the above three-dimensional coordinate system, the corresponding target probability density functions are also different.

[0094] On this basis, after obtaining two actual line-of-sight range areas corresponding to the two eyes of the target person according to the actual line of sight and the line-of-sight divergence of each eye of the target person, for each eye of the target person, use the corresponding actual line-of-sight range area as the restricted area, and then perform a double integral on the corresponding target probability density function to determine the probability expectation of the target probability density function within the actual line-of-sight range area of this eye, that is, to determine the above first probability expectation value. At the same time, for each eye of the target person, use the display screen area as the restricted area, and then perform a double integral on the corresponding target probability density function to determine the probability expectation of the corresponding target probability density function within the display screen area, that is, to determine the above second probability expectation value.

[0095] The determination methods of the above first probability expectation value and the second probability expectation value can be specifically implemented by the following formulas:

[0096]

[0097]

[0098] score’1 = ∫ (x,y)∈M p1(x,y)dM,

[0099] score’2 = ∫ (x,y)∈M p2(x,y)dM,

[0100] Among them, M is the display screen area, p1(x, y) is the first target probability density function corresponding to the left eye of the target person, x is the abscissa of the point in the plane where the display screen is located, y is the ordinate of the point in the plane where the display screen is located, S1 is the first actual line-of-sight range area of the left eye, score1 is the probability expectation of the first target probability density function within the first actual line-of-sight range area (i.e., the first probability expectation value corresponding to the left eye of the target person), score’1 is the probability expectation of the first target probability density function within the display screen area (i.e., the second probability expectation value corresponding to the left eye of the target person), p2(x, y) is the second target probability density function corresponding to the right eye of the target person, S2 is the second actual line-of-sight range area of the right eye, score2 is the probability expectation of the second target probability density function within the second actual line-of-sight range area (i.e., the first probability expectation value corresponding to the right eye of the target person), score’2 is the probability expectation of the second target probability density function within the display screen area (i.e., the second probability expectation value corresponding to the right eye of the target person).

[0101] Step S104b3: Determine the attention probability according to the first probability expectation value and the second probability expectation value.

[0102] Specifically, after determining the target probability density function corresponding to each eye of the target person, the first probability expectation value within the actual line-of-sight range area of this eye, and the second probability expectation value within the display screen area, the attention probability of the target person to the display screen of the electronic device is determined according to the first probability expectation value and the second probability expectation value corresponding to each eye.

[0103] Among them, the above attention probability can be specifically realized by the following formula:

[0104]

[0105] Among them, p is the above attention probability, score1 is the first probability expectation value corresponding to the left eye of the target person, score’1 is the second probability expectation value corresponding to the left eye of the target person, score2 is the first probability expectation value corresponding to the right eye of the target person, and score’2 is the second probability expectation value corresponding to the right eye of the target person.

[0106] In the above embodiments provided by the present application, when determining the attention probability according to the probability expectation value of the target probability density function, the actual line-of-sight range area corresponding to each eye of the target person is determined according to the actual line of sight and the line-of-sight divergence degree of each eye of the target person, and then the first probability expectation value of the target probability density function corresponding to each eye within the corresponding actual line-of-sight range area and the second probability expectation value within the display screen area are determined. Furthermore, the attention probability is determined according to the first probability expectation values and the second probability expectation values of the two eyes of the target person. In this way, the accuracy of determining the attention probability is ensured, thereby improving the accuracy of implementing the anti-peeping screen strategy of the electronic device and enhancing the performance of the electronic device.

[0107] In the embodiments of the present application, the above determination of the actual line of sight of the target person according to the target person information may specifically include the following steps S108 and S110:

[0108] Step S108: Determine the position offset of the pupil of the target person, the first relative position between the pupil and the display screen, and the first offset angle between the target face and the display screen according to the target person information.

[0109] Wherein, the above target face is the face of the target person corresponding to the target person information.

[0110] Furthermore, the position offset of the pupil is the position offset of the pupil center relative to the center of the eyeball (or eye) where it is located, and it can be represented by the offset of coordinate points by establishing a two-dimensional coordinate system. It should be noted that the scale relationship when establishing the above two-dimensional coordinate system and the above three-dimensional coordinate system should be the same so that the data determined according to the two coordinate systems can be mutually converted.

[0111] Furthermore, the above target person information may specifically include the face recognition information and the torso recognition information of the target person. The above pupil includes the left eye pupil and the right eye pupil of the target person. On this basis, the above position offset and the first relative position respectively correspond to the relevant parameters of the left eye pupil and the right eye pupil.

[0112] In the actual application process, the face recognition information and the torso recognition information of the target person are recognized by the shooting device of the electronic device, and then the position offsets of the two pupils of the target person, the relative positions of the two pupils and the display screen (i.e., the above first relative position), and the relative angle between the target face and the display screen (i.e., the above first offset angle) are determined according to the recognized face information and torso information.

[0113] Step S110: Determine the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle.

[0114] Specifically, after obtaining the first offset angle between the target face and the display screen, and the above-mentioned first relative positions and pupil position offsets corresponding to each eye of the target person, for each eye, based on the corresponding first relative position, pupil position offset, and the first offset angle between the target face and the display screen, the actual viewing line of sight of this eye is determined, so as to subsequently determine the attention probability of the target person to the display screen of the electronic device according to the actual lines of sight of the two eyes of the target person.

[0115] In the above embodiments provided by the present application, when determining the actual line of sight of the target person according to the target person information, first, the position offsets of the two pupils of the target person, the first relative positions of the two pupils with respect to the display screen respectively, and the first offset angle between the target face and the display screen are determined according to the target person information. Then, based on the first offset angle, and the first relative positions and position offsets corresponding to the two pupils, the actual lines of sight of the two eyes of the target person are determined. In this way, the accuracy of determining the actual line of sight of the target person is ensured, thereby ensuring the accuracy of determining the screen peeping probability of the target person, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the usage performance of the electronic device.

[0116] In the embodiments of the present application, the target person information includes face recognition information. The above-mentioned determination of the position offset of the pupil of the target person according to the target person information may specifically include the following steps S112 and S114:

[0117] Step S112: Determine the eye position and pupil position in the target face according to the face recognition information.

[0118] Specifically, during the use of the electronic device, one or more faces appearing within the shooting area of the shooting device of the electronic device can be recognized in real time. On this basis, when the shooting device of the electronic device recognizes the face of the above-mentioned target person, the target face corresponding to the target person is recognized, and then, according to the recognized target face information, the positions of the two eyes and the corresponding two pupils in the target face are determined.

[0119] Step S114: Determine the position offset of the pupil relative to the center point of the eye according to the eye position and pupil position.

[0120] Specifically, after determining the positions of the two eyes and the corresponding two pupils in the target face, for each eye, according to the eye position and the pupil position therein, the position offset of the pupil center point in this eye relative to the eye center point is determined.

[0121] Among them, for the position offset of each pupil, a two-dimensional coordinate system can be established to represent it by the offset of coordinate points. It should be noted that the scale relationship when establishing this two-dimensional coordinate system and the above three-dimensional coordinate system should be the same, so that the data determined according to the two coordinate systems can be mutually converted.

[0122] Specifically, as Figure 4 shown, for each eye, a two-dimensional rectangular coordinate system is established with the center point O of the eye as the origin. On this basis, the position offset of the pupil in this eye can be represented by the coordinate points of the pupil center O1 in this two-dimensional coordinate system. As Figure 4 shown, at this time, the position offset of the pupil in this eye can be expressed as (x1, y1).

[0123] In the above embodiments provided by the present application, the target person information includes face recognition information. On this basis, when determining the position offset of the pupil of the target person according to the target person information, for each eye, the eye position and pupil position in the target face are determined according to the face recognition information, and then the position offset of the pupil relative to the center point of the eye is determined according to the eye position and pupil position. In this way, the accuracy of determining the position offset of the pupil of the target person is ensured, and then the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the usage performance of the electronic device is improved.

[0124] In the embodiments of the present application, the target person information further includes torso recognition information. The above-mentioned determination of the first relative position between the pupil and the display screen according to the target person information specifically may include the following steps S116 to step S122:

[0125] Step S116: Determine the first position of the pupil in the target face according to the face recognition information.

[0126] Specifically, during the use of the electronic device, one or more faces appearing within the shooting area of the shooting device of the electronic device can be recognized in real time. On this basis, when the shooting device of the electronic device recognizes the face of the above-mentioned target person, the target face corresponding to the target person is recognized, and then according to the recognized target face information, the relative positions of the two pupils of the target person in the target face are determined, that is, the area where the target face is located is regarded as a reference area, and then the corresponding positions of the two pupils in this reference area are determined.

[0127] Step S118: Determine the second relative position between the target torso and the display screen according to the torso recognition information and a preset algorithm.

[0128] Among them, the above preset algorithm is algorithm data related to the size relationship and perspective relationship of people pre-stored in the electronic device, and can be directly retrieved and used in the actual application process.

[0129] Specifically, during the use of the electronic device, one or more human faces appearing within the shooting area of the shooting device of the electronic device can be recognized in real time. On this basis, when the shooting device of the electronic device recognizes the human face of the above target person, the torso of the target person appearing within the shooting area of the shooting device is recognized, and then, based on the recognized torso information and the preset algorithm, the second relative position between the target torso of the target person and the display screen is determined. For this second relative position, it can be determined with the help of the above-established three-dimensional coordinate system, and the relative position between the target torso and the center point of the display screen is represented by the coordinate points in the three-dimensional coordinate system.

[0130] Step S120: Determine the third relative position of the pupil and the target torso according to the first position and the corresponding relationship between the target torso and the target face.

[0131] Specifically, after determining the relative position (i.e., the first position) of the two pupils of the target person in the target face, according to this first position and the pre-stored human torso structure relationship in the electronic device (i.e., the above corresponding relationship between the target torso and the target face), the relative position of the two pupils of the target person in the target torso is determined. That is, the area where the target torso is located is regarded as a reference area, and then the corresponding positions of the two pupils in this reference area are determined.

[0132] Step S122: Determine the first relative position according to the second relative position and the third relative position.

[0133] Among them, the above second relative position is the relative position between the target torso and the center point of the display screen, and the above third relative position is the relative position of the two pupils of the target person in the target torso. On this basis, according to the above second relative position and the third relative position, the relative position of the two pupils of the target person relative to the center point of the display screen can be determined, that is, the above first relative position is determined.

[0134] Specifically, for this third relative position, it can be determined with the help of the above-established three-dimensional coordinate system, and the relative position between the two pupils of the target person and the center point of the display screen is represented by the coordinate points in the three-dimensional coordinate system. For example, in the case of establishing a three-dimensional coordinate system with the center point of the display screen as the origin, the relative position between the left eye pupil of the target person and the center point of the display screen can be expressed as (x1, y1, z1), and the relative position between the left eye pupil of the target person and the center point of the display screen can be expressed as (x2, y2, z2).

[0135] In the above embodiments provided by the present application, the target person information further includes torso recognition information. On this basis, when determining the first relative position between the pupil and the display screen according to the target person information, for each pupil of the target person, the first position of the pupil in the target face is determined according to the face recognition information. Then, according to the torso recognition information and the preset algorithm, the second relative position between the target torso and the display screen is determined, and according to the first position and the corresponding relationship between the target torso and the target face, the third relative position between the pupil and the target torso is determined. Furthermore, the first relative position corresponding to the pupil is determined according to the second relative position and the third relative position. In this way, the accuracy of determining the first relative position between the pupil of the target person and the display screen is ensured, and then the accuracy of determining the actual line of sight of the target person is ensured, and the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, thereby improving the performance of the electronic device.

[0136] In the embodiments of the present application, the above-mentioned determination of the first offset angle between the target face and the display screen according to the target person information specifically may include the following steps S124 and S126:

[0137] Step S124: Determine multiple feature points in the target face according to the face recognition information.

[0138] Among them, the above-mentioned multiple feature points are feature points that can represent the current orientation of the target face, such as key feature points like the tip of the nose, eyebrows, eyes, mouth, etc.

[0139] Specifically, during the use of the electronic device, one or more faces appearing within the shooting area of the shooting device of the electronic device can be recognized in real time through the shooting device of the electronic device. On this basis, when the shooting device of the electronic device recognizes the face of the above-mentioned target person, the target face corresponding to the target person is recognized, and then according to the recognized target face information, multiple feature points in the target face are extracted to determine the current face orientation of the target person according to the extracted multiple facial feature points.

[0140] Step S126: Perform recognition and analysis on the multiple feature points, and determine the first offset angle according to the analysis result.

[0141] Specifically, after extracting multiple key feature points (such as the tip of the nose, eyebrows, eyes, mouth, etc.) in the target face according to the recognized target face information, perform recognition and analysis on the extracted multiple facial feature points to determine the current face orientation of the target person according to the extracted multiple facial feature points, and then determine the first offset angle between the target face and the display screen, that is, the deflection angle of the target face relative to the display screen.

[0142] In the above embodiments provided by the present application, when determining the first offset angle between the target face and the display screen according to the target person information, first, multiple feature points in the target face are extracted according to the face recognition information, and then the multiple feature points are recognized and analyzed, and the first offset angle between the target face and the display screen is determined according to the analysis result. In this way, the accuracy of determining the first offset angle between the target face and the display screen is ensured, and further, the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the peeping probability of the target person is ensured, the accuracy of implementing the anti-peeping strategy of the electronic device is improved, and thus the usage performance of the electronic device is improved.

[0143] In the embodiment of the present application, the above step S110 may specifically include the following steps S110a to S110c:

[0144] Step S110a: Determine the second offset angle of the pupil line of sight of the target person according to the position offset of the pupil.

[0145] Specifically, for each pupil of the target person, after obtaining the position offset of the pupil center point relative to the center point of the eye where it is located, the offset angle of the pupil line of sight of the pupil (i.e., the second offset angle) is determined according to the position offset. Among them, the second offset angle can be determined by establishing a spatial coordinate system. It should be noted that the scale relationship when establishing this spatial coordinate system and the above three-dimensional coordinate system and two-dimensional coordinate system should be the same, so that the data determined according to the three coordinate systems can be mutually converted.

[0146] Specifically, as Figure 5 shown, for each eye, a spatial coordinate system is established with the center point O of the eye as the origin. At this time, as Figure 5 shown, the position offset of the pupil in this eye can be expressed as (x1, y1). On this basis, as Figure 5 shown, if the distance from the human eye lens to the retina is h, then according to the calculation principle of trigonometric functions, the second offset angle of the pupil line of sight can be obtained as:

[0147]

[0148] where h is the distance from the human eye lens to the retina, x1 is the abscissa of the position offset of the pupil, and y1 is the ordinate of the position offset of the pupil.

[0149] In the actual application process, the distance from the human eye lens to the retina changes very little and can be considered a constant. Therefore, the offset angle of the pupil line of sight (i.e., the above second offset angle) can be represented only by the pupil position offset.

[0150] Step S110b: Determine the actual offset angle between the actual line of sight and the display screen according to the first offset angle and the second offset angle.

[0151] Among them, the above-mentioned first offset angle is the deflection angle of the target face relative to the display screen, and the above-mentioned second offset angle is the offset angle of the pupil line of sight of the pupil. Therefore, after determining the above-mentioned first offset angle and the second offset angle, the actual offset angle between the actual line of sight of the target person and the display screen can be determined according to the first offset angle and the second offset angle.

[0152] Specifically, the actual offset angle between the actual line of sight of the target person and the display screen can be specifically expressed as the sum of the above-mentioned first offset angle and the second offset angle. That is, specifically, the actual offset angle between the actual line of sight of the target person and the display screen can be determined by the following formula:

[0153]

[0154] (θ2, ) is the actual offset angle between the actual line of sight of the target person and the display screen, (θ, ) is the above-mentioned first offset angle, and (θ1, ) is the second offset angle.

[0155] Step S110c: Determine the actual line of sight according to the first relative position and the actual offset angle.

[0156] Among them, the above-mentioned first relative position is the relative position of the pupil center point of the target person relative to the center point of the display screen. In a three-dimensional coordinate system established with the center point of the display screen as the origin, for each pupil of the target person, its first relative position can be expressed as (x1, y1, z1).

[0157] Furthermore, the above-mentioned actual deflection angle is the actual offset angle between the actual line of sight of the target person and the display screen, which can be expressed as (θ2, ).

[0158] On this basis, for each eye of the target person, according to the calculation principle of the straight line equation in the three-dimensional coordinate system, the actual line of sight of this eye can be expressed as a straight line in the three-dimensional coordinate system established with the center point of the display screen as the origin:

[0159] a(x - x1) + b(y - y1) + c(z - z1) = 0,

[0160] Wherein, x1 is the abscissa of the first relative position of the pupil of this eye, y1 is the ordinate of the first relative position of the pupil of this eye, z1 is the vertical coordinate of the first relative position of the pupil of this eye, and a, b, and c are constant coefficients for defining the straight line equation. According to the calculation principle of trigonometric functions and the calculation principle of the straight line equation in a three-dimensional coordinate system, it can be known that a, b, and c should satisfy the following conditions:

[0161]

[0162] Wherein, (θ2, ) is the actual offset angle between the actual line of sight of the target person and the display screen.

[0163] In the above embodiments provided by the present application, when determining the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle, for each pupil, the second offset angle of the pupil line of sight of the target person is determined according to the position offset of the pupil, and then the actual offset angle between the actual line of sight and the display screen is determined according to the first offset angle and the second offset angle, and the actual line of sight is determined according to the first relative position and the actual offset angle. In this way, the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the performance of the electronic device is improved.

[0164] In the embodiments of the present application, the above-mentioned determination of the line of sight divergence of the target person according to the target person information specifically may include the following steps S128 and S130:

[0165] Step S128: Determine the pupil divergence of the target person according to the target person information.

[0166] Specifically, during the use of the electronic device, one or more human faces appearing within the shooting area of the shooting device of the electronic device can be recognized in real time. On this basis, when the shooting device of the electronic device recognizes the human face of the above-mentioned target person, the target human face corresponding to the target person is recognized, and then according to the recognized target human face information, specifically according to the recognized eye information, the pupil divergence of the target person is determined.

[0167] Step S130: Determine the line of sight divergence according to the pupil divergence.

[0168] Specifically, after determining the pupil divergence of the target person, the line of sight divergence of the target person is determined according to the corresponding relationship between the pupil divergence and the line of sight divergence pre-stored in the electronic device.

[0169] Among them, the line-of-sight divergence is a value between 0 and 1. The closer the line-of-sight divergence is to 1, the more concentrated the line of sight of the target person is.

[0170] In the above embodiments provided by the present application, when determining the line-of-sight divergence of the target person according to the target person information, specifically, the pupil divergence of the target person is determined according to the target person information, and then the line-of-sight divergence is determined according to the pupil divergence. In this way, the accuracy of determining the line-of-sight divergence of the target person is ensured, and then the accuracy of determining the screen-peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the usage performance of the electronic device is improved.

[0171] In summary, the control method of the electronic device proposed in the embodiments of the present application can achieve the following beneficial effects: 1. Different from common infrared sensors and 3D structured light solutions, only analyze and process the face recognition result to obtain the relative position between the target person and the electronic device; 2. By introducing the pupil offset to correct the line-of-sight angle of the target person, it avoids missing reports of the situation where although the face is not directly facing the screen but the eyes are actually staring at the screen; 3. By modeling the attention of the target face, calculate the attention probability of the target person to the screen, with simple calculation, strong interpretability and high accuracy.

[0172] The control method of the electronic device provided in the embodiments of the first aspect of the present application may be executed by a control device of the electronic device. In the embodiments of the present application, taking the control device of the electronic device executing the above control method of the electronic device as an example, the control device of the electronic device provided in the embodiments of the second aspect of the present application is described.

[0173] As Figure 6 shown, the embodiments of the present application provide a control device 600 for an electronic device, and the device includes a processing unit 602 and a control unit 604 described below.

[0174] The processing unit 602 is configured to determine the actual line of sight and the line-of-sight divergence of the target person according to the target person information when the electronic device recognizes the target person information;

[0175] The processing unit 602 is further configured to determine the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line-of-sight divergence and the screen parameters of the electronic device;

[0176] The control unit 604 is configured to control the operation of the electronic device according to the comparison result between the attention probability and a preset threshold;

[0177] Among them, the target person information includes at least one of the following: face recognition information, torso recognition information.

[0178] In the embodiment of the present application, when the electronic device recognizes the target person information, the control device 600 of the electronic device recognizes the target person information through the processing unit 602, and determines the actual viewing line of sight and the line of sight divergence degree of the target person according to the recognized target person information. On this basis, the processing unit 602 determines the peeping probability of the target person, that is, the attention probability of the target person to the display screen of the electronic device, according to the actual line of sight, the line of sight divergence degree of the target person, and the screen parameters of the electronic device, and the control unit 604 controls the electronic device to implement or not implement the anti-peeping strategy according to the determined attention probability. In this way, without relying on other complex detection devices (such as iris recognition devices, eye tracking devices, infrared sensors, etc.), the peeping probability of the target person can be determined only through the recognition information of the target person, reducing the device requirements for implementing the anti-peeping means, thereby improving the ease of implementing the anti-peeping means and reducing the production cost of the electronic device. At the same time, determining the peeping probability of the target person through the actual line of sight and the line of sight divergence degree of the target person avoids the misjudgment of whether the target person peeps at the electronic device, improves the accuracy of implementing the anti-peeping strategy of the electronic device, and thus improves the performance of the electronic device.

[0179] In the embodiment of the present application, the processing unit 602 is specifically configured to: update a preset probability density function according to the actual line of sight, the line of sight divergence degree, and the screen parameters to obtain a target probability density function; determine the attention probability according to the probability expectation value of the target probability density function; wherein, the screen parameters include the screen reflectivity and a preset influence factor, and the preset influence factor is related to the material of the display screen.

[0180] In the above embodiment provided by the present application, when the processing unit 602 determines the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line of sight divergence degree, and the screen parameters, a target probability density function is determined according to the actual line of sight, the line of sight divergence degree, the screen reflectivity of the target person, and the preset influence factor related to the material of the display screen, and then the above attention probability is determined according to the probability expectation value of the target probability density function. In this way, combining the actual line of sight situation of the target person and the relevant parameters of the display screen, the attention probability of the target person to the display screen of the electronic device is determined, further ensuring the accuracy of determining the attention probability, thereby improving the accuracy of implementing the anti-peeping strategy of the electronic device and improving the performance of the electronic device.

[0181] In the embodiment of the present application, the processing unit 602 is further specifically configured to: determine the actual line-of-sight range area of the target person according to the actual line of sight and the line-of-sight divergence degree; respectively use the actual line-of-sight range area and the display screen area as integration areas to determine the first probability expectation value and the second probability expectation value of the target probability density function; and determine the attention probability according to the first probability expectation value and the second probability expectation value.

[0182] In the above embodiment provided by the present application, when the processing unit 602 determines the attention probability according to the probability expectation value of the target probability density function, the actual line-of-sight range area corresponding to each eye of the target person is determined according to the actual line of sight and the line-of-sight divergence degree of each eye of the target person, and then the first probability expectation value of the target probability density function corresponding to each eye within the corresponding actual line-of-sight range area and the second probability expectation value within the display screen area are determined. Furthermore, the attention probability is determined according to the first probability expectation value and the second probability expectation value of the two eyes of the target person. In this way, the accuracy of the determined attention probability is ensured, thereby improving the accuracy of the anti-peeping screen strategy implementation of the electronic device and enhancing the usage performance of the electronic device.

[0183] In the embodiment of the present application, the processing unit 602 may be specifically configured to: determine the position offset of the pupil of the target person, the first relative position between the pupil and the display screen, and the first offset angle between the target face and the display screen according to the target person information; and determine the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle.

[0184] In the above embodiment provided by the present application, when the processing unit 602 determines the actual line of sight of the target person according to the target person information, first, the position offsets of the two pupils of the target person, the first relative positions between the two pupils and the display screen respectively, and the first offset angle between the target face and the display screen are determined according to the target person information. Then, according to the first offset angle, and the first relative positions and position offsets corresponding to the two pupils, the actual lines of sight of the two eyes of the target person are determined. In this way, the accuracy of determining the actual line of sight of the target person is ensured, thereby ensuring the accuracy of determining the peeping probability of the target person, improving the accuracy of the anti-peeping screen strategy implementation of the electronic device, and thus enhancing the usage performance of the electronic device.

[0185] In the embodiment of the present application, the target person information includes face recognition information, and the processing unit 602 may be specifically configured to: determine the eye position and pupil position in the target face according to the face recognition information; and determine the position offset of the pupil relative to the center point of the eye according to the eye position and the pupil position.

[0186] In the above embodiments provided by the present application, the target person information includes face recognition information. On this basis, when the processing unit 602 determines the position offset of the pupil of the target person according to the target person information, for each eye, the eye position and pupil position in the target face are determined according to the face recognition information, and then the position offset of the pupil relative to the center point of the eye is determined according to the eye position and pupil position. In this way, the accuracy of determining the position offset of the pupil of the target person is ensured, and then the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the usage performance of the electronic device is improved.

[0187] In the embodiments of the present application, the target person information further includes torso recognition information. Specifically, the processing unit 602 is configured to: determine the first position of the pupil in the target face according to the face recognition information; determine the second relative position between the target torso and the display screen according to the torso recognition information and a preset algorithm; determine the third relative position between the pupil and the target torso according to the first position and the corresponding relationship between the target torso and the target face; and determine the first relative position according to the second relative position and the third relative position.

[0188] In the above embodiments provided by the present application, the target person information further includes torso recognition information. On this basis, when the processing unit 602 determines the first relative position between the pupil and the display screen according to the target person information, for each pupil of the target person, the first position of the pupil in the target face is determined according to the face recognition information, and then the second relative position between the target torso and the display screen is determined according to the torso recognition information and a preset algorithm, and the third relative position between the pupil and the target torso is determined according to the first position and the corresponding relationship between the target torso and the target face, and then the first relative position corresponding to the pupil is determined according to the second relative position and the third relative position. In this way, the accuracy of determining the first relative position between the pupil of the target person and the display screen is ensured, and then the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the usage performance of the electronic device is improved.

[0189] In the embodiments of the present application, the processing unit 602 may specifically be configured to: determine multiple feature points in the target face according to the face recognition information; perform recognition and analysis on the multiple feature points, and determine the first offset angle according to the analysis result.

[0190] In the above embodiments provided by this application, when the processing unit 602 determines the first offset angle between the target face and the display screen according to the target person information, it first extracts a plurality of feature points in the target face according to the face recognition information, and then performs recognition and analysis on the plurality of feature points, and determines the first offset angle between the target face and the display screen according to the analysis result. In this way, the accuracy of determining the first offset angle between the target face and the display screen is ensured, and further the accuracy of determining the actual line of sight of the target person is ensured, and the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the usage performance of the electronic device.

[0191] In the embodiments of this application, the processing unit 602 is further specifically configured to: determine the second offset angle of the pupil line of sight of the target person according to the position offset of the pupil; determine the actual offset angle between the actual line of sight and the display screen according to the first offset angle and the second offset angle; determine the actual line of sight according to the first relative position and the actual offset angle.

[0192] In the above embodiments provided by this application, when the processing unit 602 determines the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle, for each pupil, it determines the second offset angle of the pupil line of sight of the target person according to the position offset of the pupil, and then determines the actual offset angle between the actual line of sight and the display screen according to the first offset angle and the second offset angle, and determines the actual line of sight according to the first relative position and the actual offset angle. In this way, the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the usage performance of the electronic device.

[0193] In the embodiments of this application, the processing unit 602 is further specifically configured to: determine the pupil divergence of the target person according to the target person information; determine the line of sight divergence according to the pupil divergence.

[0194] In the above embodiments provided by this application, when the processing unit 602 determines the line of sight divergence of the target person according to the target person information, it specifically determines the pupil divergence of the target person according to the target person information, and then determines the line of sight divergence according to the pupil divergence. In this way, the accuracy of determining the line of sight divergence of the target person is ensured, and further the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the usage performance of the electronic device.

[0195] The control device 600 of the electronic device in the embodiments of the present application may be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or other devices other than the terminal. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an in-vehicle electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It may also be a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc. The embodiments of the present application do not make specific limitations.

[0196] The control device 600 of the electronic device in the embodiments of the present application may be a device with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems. The embodiments of the present application do not make specific limitations.

[0197] The control device 600 of the electronic device provided in the second aspect embodiments of the present application can implement Figure 1 each process implemented by the method embodiments. To avoid repetition, it will not be elaborated here.

[0198] Optionally, as Figure 7 shown, the embodiments of the present application further provide an electronic device 700, including a processor 702 and a memory 704. A program or instruction that can run on the processor 702 is stored on the memory 704. When the program or instruction is executed by the processor 702, it implements each step of the method embodiments of the control method of the electronic device in the first aspect above, and can achieve the same technical effects. To avoid repetition, it will not be elaborated here.

[0199] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0200] Figure 8 A schematic diagram of the hardware structure of an electronic device for implementing the embodiments of the present application.

[0201] The electronic device 800 includes, but is not limited to, components such as a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.

[0202] Those skilled in the art can understand that the electronic device 800 may further include a power source (such as a battery) for powering each component. The power source can be logically connected to the processor 810 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system. Figure 8 The structure of the electronic device shown does not limit the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0203] The electronic device 800 in the embodiments of the present application can be used to implement each step of the control method embodiment of the electronic device in the above first aspect.

[0204] Among them, the processor 810 is used to determine the actual line of sight and the line of sight divergence of the target person according to the target person information when the electronic device recognizes the target person information;

[0205] The processor 810 is further used to determine the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line of sight divergence, and the screen parameters of the electronic device;

[0206] The processor 810 is further used to control the operation of the electronic device according to the comparison result between the attention probability and a preset threshold;

[0207] Among them, the target person information includes at least one of the following: face recognition information, torso recognition information.

[0208] The electronic device 800 proposed in the embodiment of the present application, when the target person information is recognized, the processor 810 recognizes the target person information, and determines the actual viewing line of sight and the line of sight divergence degree of the target person according to the recognized target person information. On this basis, the processing unit 602 determines the peeping probability of the target person, that is, the attention probability of the target person to the display screen of the electronic device, according to the actual line of sight, the line of sight divergence degree of the target person, and the screen parameters of the electronic device, and the control unit 604 controls the electronic device to implement or not implement the anti-peeping screen strategy according to the determined attention probability. In this way, without relying on other complex detection devices (such as iris recognition devices, eye tracking devices, infrared sensors, etc.), the peeping probability of the target person can be determined only through the recognition information of the target person, reducing the device requirements for implementing the anti-peeping screen means, thereby improving the ease of implementing the anti-peeping screen means and reducing the production cost of the electronic device. At the same time, determining the peeping probability of the target person through the actual line of sight and the line of sight divergence degree of the target person avoids the situation of misjudging whether the target person peeps at the screen by the electronic device, improves the accuracy of implementing the anti-peeping screen strategy of the electronic device, and thus improves the performance of the electronic device.

[0209] Optionally, the processor 810 may specifically be used to: update the preset probability density function according to the actual line of sight, the line of sight divergence degree, and the screen parameters to obtain the target probability density function; determine the attention probability according to the probability expectation value of the target probability density function; where the screen parameters include the screen reflectivity and the preset influence factor, and the preset influence factor is related to the material of the display screen.

[0210] In the above embodiment provided by the present application, when the processor 810 determines the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line of sight divergence degree, and the screen parameters, the target probability density function is determined according to the actual line of sight, the line of sight divergence degree, the screen reflectivity of the target person, and the preset influence factor related to the material of the display screen, and then the above attention probability is determined according to the probability expectation value of the target probability density function. In this way, combining the actual line of sight situation of the target person and the relevant parameters of the display screen, the attention probability of the target person to the display screen of the electronic device is determined, further ensuring the accuracy of determining the attention probability, thereby improving the accuracy of implementing the anti-peeping screen strategy of the electronic device and improving the performance of the electronic device.

[0211] Optionally, the processor 810 may specifically further be used to: determine the actual line of sight range area of the target person according to the actual line of sight and the line of sight divergence degree; respectively use the actual line of sight range area and the display screen area as the integration areas to determine the first probability expectation value and the second probability expectation value of the target probability density function; determine the attention probability according to the first probability expectation value and the second probability expectation value.

[0212] In the above embodiments provided by the present application, when the processor 810 determines the attention probability according to the probability expectation value of the target probability density function, the actual line-of-sight range area corresponding to each eye of the target person is determined according to the actual line of sight and the line-of-sight divergence degree of each eye of the target person, and then the first probability expectation value of the target probability density function corresponding to each eye within the corresponding actual line-of-sight range area and the second probability expectation value within the display screen area are determined. Furthermore, the attention probability is determined according to the first probability expectation values and the second probability expectation values of the two eyes of the target person. In this way, the accuracy of the attention probability determination is ensured, thereby improving the accuracy of the implementation of the anti-peeping screen strategy of the electronic device and enhancing the performance of the electronic device.

[0213] Optionally, the processor 810 may specifically be configured to: determine the position offset of the pupil of the target person, the first relative position between the pupil and the display screen, and the first offset angle between the target face and the display screen according to the target person information; and determine the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle.

[0214] In the above embodiments provided by the present application, when the processor 810 determines the actual line of sight of the target person according to the target person information, first, the position offsets of the two pupils of the target person, the first relative positions between the two pupils and the display screen respectively, and the first offset angle between the target face and the display screen are determined according to the target person information. Then, according to the first offset angle, and the first relative positions and position offsets corresponding to the two pupils, the actual lines of sight of the two eyes of the target person are determined. In this way, the accuracy of the determination of the actual line of sight of the target person is ensured, thereby ensuring the accuracy of the determination of the peeping probability of the target person, improving the accuracy of the implementation of the anti-peeping screen strategy of the electronic device, and thus enhancing the performance of the electronic device.

[0215] Optionally, the target person information includes face recognition information, and the processor 810 is specifically configured to: determine the eye position and pupil position in the target face according to the face recognition information; and determine the position offset of the pupil relative to the center point of the eye according to the eye position and the pupil position.

[0216] In the above embodiments provided by the present application, the target person information includes face recognition information. On this basis, when the processor 810 determines the position offset of the pupil of the target person according to the target person information, for each eye, the eye position and pupil position in the target face are determined according to the face recognition information, and then the position offset of the pupil relative to the center point of the eye is determined according to the eye position and pupil position. In this way, the accuracy of determining the position offset of the pupil of the target person is ensured, and then the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the performance of the electronic device is improved.

[0217] Optionally, the target person information further includes torso recognition information. The processor 810 is specifically configured to: determine the first position of the pupil in the target face according to the face recognition information; determine the second relative position between the target torso and the display screen according to the torso recognition information and a preset algorithm; determine the third relative position between the pupil and the target torso according to the first position and the corresponding relationship between the target torso and the target face; and determine the first relative position according to the second relative position and the third relative position.

[0218] In the above embodiments provided by the present application, the target person information further includes torso recognition information. On this basis, when the processor 810 determines the first relative position between the pupil and the display screen according to the target person information, for each pupil of the target person, the first position of the pupil in the target face is determined according to the face recognition information, and then the second relative position between the target torso and the display screen is determined according to the torso recognition information and a preset algorithm, and the third relative position between the pupil and the target torso is determined according to the first position and the corresponding relationship between the target torso and the target face, and then the first relative position corresponding to the pupil is determined according to the second relative position and the third relative position. In this way, the accuracy of determining the first relative position between the pupil of the target person and the display screen is ensured, and then the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, the accuracy of implementing the anti-screen-peeping strategy of the electronic device is improved, and thus the performance of the electronic device is improved.

[0219] Optionally, the processor 810 is specifically configured to: determine a plurality of feature points in the target face according to the face recognition information; perform recognition and analysis on the plurality of feature points, and determine the first offset angle according to the analysis result.

[0220] In the above embodiments provided by the present application, when the processor 810 determines the first offset angle between the target face and the display screen according to the target person information, it first extracts multiple feature points in the target face according to the face recognition information, then performs recognition and analysis on the multiple feature points, and determines the first offset angle between the target face and the display screen according to the analysis result. In this way, the accuracy of determining the first offset angle between the target face and the display screen is ensured, and further the accuracy of determining the actual line of sight of the target person is ensured, and the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the performance of the electronic device.

[0221] Optionally, the processor 810 is further specifically configured to: determine a second offset angle of the pupil line of sight of the target person according to the position offset of the pupil; determine the actual offset angle between the actual line of sight and the display screen according to the first offset angle and the second offset angle; and determine the actual line of sight according to the first relative position and the actual offset angle.

[0222] In the above embodiments provided by the present application, when the processor 810 determines the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle, for each pupil, it determines the second offset angle of the pupil line of sight of the target person according to the position offset of the pupil, then determines the actual offset angle between the actual line of sight and the display screen according to the first offset angle and the second offset angle, and determines the actual line of sight according to the first relative position and the actual offset angle. In this way, the accuracy of determining the actual line of sight of the target person is ensured, the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the performance of the electronic device.

[0223] Optionally, the processor 810 is further specifically configured to: determine the pupil divergence of the target person according to the target person information; and determine the line of sight divergence according to the pupil divergence.

[0224] In the above embodiments provided by the present application, when the processor 810 determines the line of sight divergence of the target person according to the target person information, it specifically determines the pupil divergence of the target person according to the target person information, and then determines the line of sight divergence according to the pupil divergence. In this way, the accuracy of determining the line of sight divergence of the target person is ensured, and further the accuracy of determining the screen peeping probability of the target person is ensured, improving the accuracy of implementing the anti-screen-peeping strategy of the electronic device, and thus improving the performance of the electronic device.

[0225] It should be understood that in the embodiments of the present application, the input unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042. The GPU 8041 processes the image data of static pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of, for example, a liquid crystal display or an organic light emitting diode. The user input unit 807 includes at least one of a touch panel 8071 and other input devices 8072. The touch panel 8071 is also referred to as a touch screen. The touch panel 8071 may include two parts: a touch detection device and a touch controller. The other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, and a joystick, which will not be elaborated herein.

[0226] The memory 809 can be used to store software programs and various data. The memory 809 mainly includes a first storage area for storing programs or instructions and a second storage area for storing data. Among them, the first storage area can store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.).

[0227] In addition, the memory 809 may include volatile memory or non-volatile memory, or the memory 809 may include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 809 in the embodiments of the present application includes but is not limited to these and any other suitable types of memory.

[0228] The processor 810 may include one or more processing units; optionally, the processor 810 integrates an application processor and a modem processor. Among them, the application processor mainly processes operations related to the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above modem processor may not be integrated into the processor 810 either.

[0229] The embodiments of the present application further provide a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, it implements each process of the control method embodiment of the electronic device in the first aspect above, and can achieve the same technical effect. To avoid repetition, it will not be elaborated here.

[0230] Among them, the processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk, or an optical disc, etc.

[0231] Another embodiment of the present application further provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is configured to run programs or instructions to implement each process of the control method embodiment of the electronic device in the first aspect above, and can achieve the same technical effects. To avoid repetition, details are not described herein again.

[0232] It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, system chip, chip system, or system-on-chip, etc.

[0233] The embodiments of the present application provide a computer program product, which is stored in a storage medium and is executed by at least one processor to implement each process of the control method embodiment of the electronic device in the first aspect above, and can achieve the same technical effects. To avoid repetition, details are not described herein again.

[0234] It should be noted that in this article, the terms "include", "comprise" or any other variation thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the methods and devices in the embodiments of the present application are not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in a reverse order according to the functions involved. For example, the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0235] Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general hardware platform. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, in essence, or the part that makes a contribution to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions for causing a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of the present application.

[0236] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative rather than restrictive. Those of ordinary skill in the art, under the inspiration of the present application and without departing from the purpose of the present application and the scope protected by the claims, can also make many forms, all of which fall within the protection scope of the present application.

Claims

1. A control method for an electronic device, characterized in that, Including: When the electronic device recognizes the target person information, determining the actual line of sight and the line of sight divergence degree of the target person according to the target person information; Determining the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line of sight divergence degree and the screen parameters of the electronic device; Controlling the operation of the electronic device according to the comparison result between the attention probability and a preset threshold; Wherein, the target person information includes at least one of the following: face recognition information, torso recognition information; The determining the actual line of sight of the target person according to the target person information specifically includes: Determining the position offset of the pupil of the target person, the first relative position between the pupil and the display screen, and the first offset angle between the target face and the display screen according to the target person information; Determining the actual line of sight according to the first relative position, the position offset of the pupil and the first offset angle; The determining the first offset angle between the target face and the display screen according to the target person information specifically includes: Determining a plurality of feature points in the target face according to the face recognition information; Performing recognition and analysis on the plurality of feature points, and determining the first offset angle according to the analysis result.

2. The control method of the electronic device according to claim 1, wherein The determining the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line of sight divergence degree and the screen parameters of the electronic device specifically includes: Updating a preset probability density function according to the actual line of sight, the line of sight divergence degree and the screen parameters to obtain a target probability density function; Determining the attention probability according to the probability expectation value of the target probability density function; Wherein, the screen parameters include a screen reflectivity and a preset influence factor, and the preset influence factor is related to the material of the display screen.

3. The control method of the electronic device according to claim 2, wherein, The determining the attention probability according to the probability expectation value of the target probability density function specifically includes: Determining the actual line of sight range area of the target person according to the actual line of sight and the line of sight divergence degree; Respectively taking the actual line of sight range area and the display screen area as integration areas, and determining the first probability expectation value and the second probability expectation value of the target probability density function; Determining the attention probability according to the first probability expectation value and the second probability expectation value.

4. The control method of the electronic device according to claim 1, characterized in that, The determining the position offset of the pupil of the target person according to the target person information specifically includes: Determining the eye position and the pupil position in the target face according to the face recognition information; Determining the position offset of the pupil relative to the center point of the eye according to the eye position and the pupil position.

5. The control method of the electronic device according to claim 1, wherein, The determining the first relative position between the pupil and the display screen according to the target person information specifically includes: Determining the first position of the pupil in the target face according to the face recognition information; Determining the second relative position between the target torso and the display screen according to the torso recognition information and a preset algorithm; Determining the third relative position between the pupil and the target torso according to the first position and the corresponding relationship between the target torso and the target face; Determine the first relative position according to the second relative position and the third relative position.

6. The control method of the electronic device according to claim 1, wherein The determining of the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle specifically includes: Determine a second offset angle of the pupil line of sight of the target person according to the position offset of the pupil; Determine the actual offset angle between the actual line of sight and the display screen according to the first offset angle and the second offset angle; Determine the actual line of sight according to the first relative position and the actual offset angle.

7. The control method of an electronic device according to any one of claims 1 to 6, characterized in that Determine the line-of-sight divergence of the target person according to the target person information, specifically including: Determine the pupil divergence of the target person according to the target person information; Determine the line-of-sight divergence according to the pupil divergence.

8. A control device for an electronic device, characterized in that, Include: A processing unit, configured to, when the electronic device recognizes target person information, determine the actual line of sight and the line-of-sight divergence of the target person according to the target person information; The processing unit is further configured to determine the attention probability of the target person to the display screen of the electronic device according to the actual line of sight, the line-of-sight divergence, and the screen parameters of the electronic device; A control unit, configured to control the operation of the electronic device according to the comparison result between the attention probability and a preset threshold; Wherein, the target person information includes at least one of the following: face recognition information, torso recognition information; The processing unit is specifically configured to: Determine the position offset of the pupil of the target person, the first relative position between the pupil and the display screen, and the first offset angle between the target face and the display screen according to the target person information; Determine the actual line of sight according to the first relative position, the position offset of the pupil, and the first offset angle; The processing unit is specifically further configured to: Determine a plurality of feature points in the target face according to the face recognition information; Perform recognition and analysis on the plurality of feature points, and determine the first offset angle according to the analysis result.

9. An electronic device, characterized in that, It includes a processor and a memory, and the memory stores a program or instruction that can run on the processor. When the program or instruction is executed by the processor, the steps of the control method of the electronic device according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that, A program or instruction is stored on the readable storage medium. When the program or instruction is executed by the processor, the steps of the control method of the electronic device according to any one of claims 1 to 7 are implemented.

Images