Information processing method and apparatus, electronic device, and storage medium

Abstract

The present disclosure relates to an information processing method and device, electronic equipment and storage medium. The information processing method comprises: determining that a target is watching a screen; detecting a state parameter of the target watching the screen when the target is watching the screen; and performing a vision protection operation of the target when the state parameter indicates that the state of the target watching the screen is not a preset state.

Description

Technical Field

[0001] This disclosure relates to the field of electronic technology, and in particular to an information processing method and apparatus, electronic equipment and storage medium. Background Technology

[0002] In recent years, people have become increasingly reliant on electronic products, with smartphones and tablets becoming an indispensable part of daily life. However, prolonged use of electronic products or improper usage can negatively impact eyesight. For example, when using electronic products, especially focusing on mobile games, it's difficult to maintain a proper distance between the device and the eyes. The eyes unconsciously move closer and closer to the screen, easily leading to nearsightedness. Furthermore, using electronic products while lying on one's side puts significant pressure on the eyes, which can also cause visual discrepancies between the two eyes. In addition, when lying on one's side, the pillow can also cause insufficient blood supply to the eyes, leading to a feeling of swelling and temporary double vision over time. In severe cases, it can even lead to dry eye syndrome. Summary of the Invention

[0003] This disclosure provides an information processing method and apparatus, an electronic device, and a storage medium.

[0004] According to a first aspect of the present disclosure, an information processing method is provided, applied in an electronic device, comprising:

[0005] Identify the target on the viewing screen;

[0006] When the target is viewing the screen, the state parameters of the target viewing the screen are detected;

[0007] When the status parameter indicates that the target's screen viewing state is not a preset state, the target's vision protection operation is executed.

[0008] Based on the above scheme, determining that the target is on the viewing screen includes:

[0009] Capture a first image of the screen facing the space;

[0010] When the first image includes a face region, determine whether the target's gaze falls on the screen based on the face region;

[0011] When the target's gaze falls on the screen, it is determined that the target is watching the screen.

[0012] Based on the above scheme, when the first image includes a face region, determining whether the target's gaze falls on the screen based on the face region includes:

[0013] Determine the direction of the line connecting the two eyes in the face region;

[0014] Based on the angle between the direction of the line and the display plane of the screen, it is determined whether the target's line of sight falls on the screen.

[0015] Based on the above scheme, determining whether the target's line of sight falls on the screen according to the angle between the direction of the connecting line and the display plane of the screen includes:

[0016] When the angle between the direction of the connecting line and the display plane of the screen is less than a preset value, it is determined that the target's line of sight falls on the screen;

[0017] When the angle between the direction of the connecting line and the display plane of the screen is greater than or equal to the preset value, it is determined that the target's line of sight falls outside the screen.

[0018] Based on the above scheme, detecting the state parameters of the target viewing screen includes:

[0019] Determine the distance difference between each of the target's eyes and the screen;

[0020] And / or,

[0021] Detect the target's body posture when viewing the screen.

[0022] Based on the above scheme, determining the distance difference between each of the target's eyes and the screen includes:

[0023] Acquire a second image of the target user as they view the screen;

[0024] Based on the similarity between the binocular regions of the target in the second image and the binocular regions in the sample image, it is determined whether the distance difference between each of the target's eyes and the screen meets a preset requirement; wherein, the sample image is an image in which the distance difference between each of the target's eyes and the screen meets the preset requirement;

[0025] The method further includes:

[0026] If the distance difference between the target's eyes and the screen does not meet the preset requirement, it is determined that the target's viewing state of the screen is not the preset state.

[0027] Based on the above scheme, detecting the target's body posture while viewing the screen further includes:

[0028] Acquire a third image of the target viewing the screen;

[0029] Determine whether the third image contains images of objects in the environment where the target was lying down;

[0030] The method further includes:

[0031] When the third image contains an image of objects in the environment where the target is lying down, it is determined that the state in which the target is viewing the screen is not a preset state.

[0032] Based on the above scheme, determining whether the third image contains images of objects in the environment where the target was lying down includes at least one of the following:

[0033] Determine whether the third image contains an image of a pillow that is in contact with the target face;

[0034] Determine whether the third image contains an image of a bed that is in contact with the target face;

[0035] Determine whether the third image contains an image of a sofa that is in contact with the target face.

[0036] Based on the above scheme, the vision protection operation for the target includes:

[0037] Display a message prompting the target to adjust their viewing posture;

[0038] or,

[0039] If the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the screen display update is paused.

[0040] According to a second aspect of the present disclosure, an information processing apparatus is provided, applied in an electronic device, comprising:

[0041] The first determining module is used to determine whether the target is on the viewing screen;

[0042] The detection module is used to detect the state parameters of the target viewing the screen when the target is viewing the screen;

[0043] An execution module is used to perform vision protection operations on the target when the status parameters indicate that the target's viewing screen state is not a preset state.

[0044] Based on the above scheme, the first determining module is specifically used to acquire a first image of the screen facing the space; when the first image includes a face region, it determines whether the target's gaze is on the screen based on the face region; when the target's gaze is on the screen, it determines that the target is watching the screen.

[0045] Based on the above scheme, the first determining module is specifically used to determine that the target's line of sight falls on the screen when the angle between the connecting line direction and the display plane of the screen is less than a preset value; and to determine that the target's line of sight falls outside the screen when the angle between the connecting line direction and the display plane of the screen is greater than or equal to the preset value.

[0046] Based on the above scheme, the detection module is specifically used to determine the distance difference between the target's eyes and the screen; and / or to detect the target's body posture when viewing the screen.

[0047] Based on the above scheme, the detection module is specifically used to acquire a second image when the target user is viewing the screen;

[0048] The device further includes:

[0049] The second determining module is used to determine whether the distance difference between each eye of the target and the screen meets a preset requirement based on the similarity between the eye regions of the target in the second image and the eye regions in the sample image; wherein, the sample image is an image in which the distance difference between each eye and the screen meets the preset requirement;

[0050] If the distance difference between the target's eyes and the screen does not meet the preset requirement, it is determined that the target's viewing state of the screen is not the preset state.

[0051] Based on the above scheme, the detection module is used to acquire a third image of the target when it is viewing the screen; and to determine whether the third image contains images of objects in the environment where the target is lying down.

[0052] The second determining module is used to determine that the target's state of viewing the screen is not a preset state when the third image contains an image of objects in the environment where the target is lying down.

[0053] Based on the above scheme, the detection module is specifically used to determine whether the third image contains images of objects in the environment where the target was lying down, including at least one of the following:

[0054] Determine whether the third image contains an image of a pillow that is in contact with the target face;

[0055] Determine whether the third image contains an image of a bed that is in contact with the target face;

[0056] Determine whether the third image contains an image of a sofa that is in contact with the target face.

[0057] Based on the above scheme, the execution module is used to display a message prompt to prompt the target to adjust its viewing posture;

[0058] or,

[0059] If the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the screen display update is paused.

[0060] A third aspect of the present disclosure provides an electronic device, comprising:

[0061] Memory used to store processor-executable instructions;

[0062] The processor is connected to the memory;

[0063] The processor is configured to execute the information processing method described above.

[0064] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, which, when the instructions in the storage medium are executed by a computer's processor, enables the computer to perform the information processing method described above.

[0065] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:

[0066] As can be seen from the above embodiments, the technical solution provided by this disclosure determines whether the target is viewing a screen. When the target is viewing a screen, it detects the state parameters of the target viewing the screen, and when it is determined that the state parameters indicate that the target's screen viewing state is not a preset state, it performs a vision protection operation on the target. Thus, in this embodiment of the disclosure, by obtaining the state parameters of the user when viewing the screen, it determines whether the user's viewing posture is correct. When the viewing posture is incorrect, a vision protection operation is implemented to protect the user's vision. It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the present invention. Attached Figure Description

[0067] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0068] Figure 1 This is a flowchart illustrating an information processing method according to an exemplary embodiment;

[0069] Figure 2 This is a flowchart illustrating another information processing method according to an exemplary embodiment;

[0070] Figure 3This is a flowchart illustrating yet another information processing method according to an exemplary embodiment;

[0071] Figure 4 This is a flowchart illustrating another information processing method according to an exemplary embodiment;

[0072] Figure 5 This is a flowchart illustrating another information processing method according to an exemplary embodiment;

[0073] Figure 6 This is a flowchart illustrating another information processing method according to an exemplary embodiment;

[0074] Figure 7 This is a flowchart illustrating another information processing method according to an exemplary embodiment;

[0075] Figure 8 This is a structural block diagram of an information processing apparatus according to an exemplary embodiment;

[0076] Figure 9 This is a block diagram illustrating the structural composition of an information processing apparatus according to an exemplary embodiment. Detailed Implementation

[0077] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses consistent with some aspects of this disclosure as detailed in the appended claims.

[0078] The terminology used in this embodiment of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments of the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of the invention and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more of the associated listed items.

[0079] It should be understood that although the terms first, second, third, etc., may be used to describe various information in embodiments of the present invention, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of embodiments of the present invention, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to a determination."

[0080] like Figure 1 As shown, this disclosure provides an information processing method applied in an electronic device, including:

[0081] 101: Identify the target on the viewing screen;

[0082] 102: When the target is viewing the screen, detect the state parameters of the target viewing the screen;

[0083] 103: When the status parameter indicates that the target's viewing screen state is not a preset state, execute the target's vision protection operation.

[0084] In this embodiment of the disclosure, the electronic device includes, but is not limited to, at least one of the following electronic devices: mobile phone, tablet computer, television or game console, etc.

[0085] In step 101, it can be determined whether the target is watching the screen based on the sensing data of the first sensor; when the target is not watching the screen, the display continues according to the display requirements of the screen; when the target is watching the screen, step 102 is executed.

[0086] In one embodiment, the first sensor may be a camera, for example, using image data collected by the camera to determine whether the target is looking at the screen.

[0087] In another embodiment, the first sensor may be an eye tracker, which can detect the target's gaze data and determine whether the target is looking at the screen based on the gaze data.

[0088] In this embodiment of the disclosure, the first sensor can enter a running state according to a trigger command or configuration information to trigger an operation to determine whether the target is viewing the screen. The trigger command may be an instruction to enable the vision protection function. The configuration information may include: permission configuration information based on user operation or the determined monitoring target's viewing of the screen, or event configuration information that satisfies the trigger event for executing the vision protection function, etc.

[0089] For example, if a specific target (e.g., a child or adolescent) is detected as the object of vision protection, a triggering event for performing vision protection is determined.

[0090] In some embodiments, the sensing data acquired by the first sensor is not uploaded to the server. This can protect the privacy of the target while using the electronic device and improve the security of personal information. That is, the terminal device can determine whether the target is watching the screen based on the sensing data.

[0091] In other embodiments, the sensing data acquired by the first sensor can be sent to the server after being desensitized, and the server can determine whether the target is watching the screen. The terminal device receives the determination result from the server indicating whether the target user is watching the screen.

[0092] In step 102, the state parameters of the target viewing the screen can be: the distance difference between the target's eyes and the screen, the target's body posture when viewing the screen, and / or the target's eyes when viewing the screen.

[0093] In this embodiment, the electronic device also needs to have a second sensor. The second sensor is used to determine the position and orientation of the plane on which the screen of the electronic device is located. For example, it can be a gyroscope or a gravity sensor, which can be used to detect the posture of the electronic device and determine the screen's location and orientation. In summary, in this embodiment, at least the display plane and / or display posture of the screen can be determined based on the sensing data of the second sensor. For example, for a rectangular screen, the second sensor can be a sensor used to detect whether the screen is in landscape or portrait display posture.

[0094] In step 103, the preset state indicates that the state parameter indicates that the target's posture while viewing the screen is correct or that the target's posture while viewing the screen is healthy.

[0095] In some embodiments, when it is determined that the state parameter indicates that the target's posture while viewing the screen is not a correct or healthy posture, a vision protection operation for the target is performed; wherein, performing the vision protection operation for the target includes: displaying a message prompt to prompt the target to adjust its viewing posture; or, if the target's posture is not adjusted (i.e., maintaining a posture that is detrimental to vision monitoring) within a preset time after the message prompt, turning off the screen for a preset time, or pausing the playback of the screen's display updates; the preset time can be 2 seconds, 3 seconds, or 5 seconds, and the preset time can be defined by the user or use a system-recommended duration.

[0096] In other embodiments, performing the vision protection operation on the target may further include reducing the target's access rights to the electronic device from a first access level to a second access level. For example, if the target originally had access to all online videos, after the access rights are reduced, the terminal device may not play videos other than educational videos.

[0097] This disclosure provides an information processing method that determines whether a target is viewing a screen. When the target is viewing a screen, it detects the target's screen viewing status parameters. If the status parameters indicate that the target's screen viewing status is not a preset state, it performs a vision protection operation on the target. Thus, in this disclosure, by acquiring the user's screen viewing status parameters, it determines whether the user's viewing posture is correct or healthy. When the viewing posture is incorrect or unhealthy, a vision protection operation is implemented to protect the user's eyesight.

[0098] In some embodiments, such as Figure 2 As shown, based on Figure 1 Determining that the target is on the viewing screen in step 101 above may include:

[0099] 1011: Acquire the first image of the screen facing the space;

[0100] In this embodiment, the first image is acquired according to a first preset frequency. This allows for real-time monitoring of whether the target is viewing the screen. The first preset frequency can be a default value or a user-defined value, without specific limitations. For example, the first preset frequency can be once every 3 seconds to once every 30 seconds. Preferably, the first preset frequency is once every 10 seconds. This improves the energy efficiency of the electronic device, ensuring its functionality while determining its energy consumption.

[0101] Specifically, the camera captures a first image of the screen facing the space at a first preset frequency. The first image indicates people, objects, etc. in the space facing the screen. In this way, the first image of the screen facing the space can be updated in a timely manner, thereby ensuring the accuracy of the face area in the first image, reducing the acquisition deviation caused by user movement, improving the accuracy of image acquisition, and ensuring the accuracy of judging whether the target is watching the screen.

[0102] 1012: When the first image includes a face region, determine whether the target's gaze falls on the screen based on the face region;

[0103] In this embodiment of the disclosure, prior to step 1012, the method further includes: determining whether the first image contains a face region; the face region includes at least the eye regions.

[0104] Specifically, it is determined whether there is a face region containing both eyes in the first image; if the first image contains the face region, it is determined whether the target's gaze is on the screen based on the face region; if the first image does not contain the face region or a complete face region, it indicates that the target is not looking at the screen.

[0105] 1013: When the target's gaze falls on the screen, it is determined that the target is viewing the screen.

[0106] In some embodiments, if the face region contained in the first image does not include an image of both eyes, it is determined that the target's gaze is not falling on the screen; for example, if it only contains an image of one eye, it is determined that the target's gaze is not falling on the screen. In some embodiments, such as... Figure 3 As shown, based on Figure 2 In step 1012 above, when the first image includes a face region, determining whether the target's gaze falls on the screen based on the face region includes:

[0107] 10121: Determine the direction of the line connecting the two eyes in the face region;

[0108] The line connecting the two eyes can be obtained by connecting the pupils of both eyes or by connecting the eye sockets of both eyes.

[0109] 10122: Determine whether the target's line of sight falls on the screen based on the angle between the direction of the line and the display plane of the screen.

[0110] For example, the display plane of the screen is determined by the gyroscope, and a coordinate system is established with the center of the display plane of the screen as the origin, the horizontal direction is the X-axis of the coordinate system, and the perpendicular direction to the horizontal direction is the Y-axis of the coordinate system; the angle between the direction of the connecting line and the X-axis of the coordinate system is used to determine whether the line of sight of the target falls on the screen.

[0111] In this embodiment of the disclosure, the coordinate system of the display plane of the screen can be generated quickly and accurately by using a gyroscope. Combined with the direction of the line connecting the two eyes determined by the camera, it can be determined whether the target user's gaze is on the screen. No additional hardware facilities are required, which reduces hardware costs and has a wide range of applications.

[0112] In some embodiments, such as Figure 4 As shown, in step 10122 above, determining whether the target's line of sight falls on the screen based on the angle between the direction of the connecting line and the display plane of the screen includes:

[0113] 10122a: When the angle between the direction of the connecting line and the display plane of the screen is less than a preset value, it is determined that the line of sight of the target falls on the screen;

[0114] Specifically, when the angle between the direction of the connecting line and the X-axis is less than a first preset value, it is determined that the line of sight of the target falls on the screen; the first preset value can be a system default value; for example, the first preset value can be any value from 0 degrees to 45 degrees, preferably, the first preset value can be 20 or 30 degrees.

[0115] 10122b: When the angle between the direction of the connecting line and the display plane of the screen is greater than or equal to the preset value, it is determined that the line of sight of the target falls outside the screen.

[0116] Specifically, when the angle between the direction of the connecting line and the X-axis is greater than or equal to a first preset value, it is determined that the line of sight of the target falls on the screen.

[0117] In some embodiments, such as Figure 5 As shown, the detection of the state parameters of the target viewing screen in step 102 above includes:

[0118] 1021: Determine the distance difference between each of the target's eyes and the screen;

[0119] And / or,

[0120] 1022: Detect the target's body posture when viewing the screen.

[0121] The body postures mentioned include, but are not limited to, standing, sitting, lying down or side-lying postures; for example, standing and sitting postures are body postures allowed by preset states.

[0122] In some embodiments, such as Figure 6 As shown, determining the distance difference between the target's two eyes and the screen in step 1021 above includes:

[0123] 10211: Acquire a second image of the target user viewing the screen;

[0124] In this embodiment of the disclosure, the second image can be captured by a camera at a second preset frequency, and the second image is a facial image captured by the target user while watching the screen.

[0125] 10212: Based on the similarity between the binocular regions of the target in the second image and the binocular regions in the sample image, determine whether the distance difference between each of the target's eyes and the screen meets a preset requirement; wherein, the sample image is an image in which the distance difference between each of the target's eyes and the screen meets the preset requirement;

[0126] The preset requirement is that the distance difference between the target's two eyes and the screen is less than a second preset value. In this case, it indicates that the target's viewing state of the screen is a preset state. When the distance difference between the target's two eyes and the screen does not meet the preset requirement, it is determined that the target's viewing state of the screen is not a preset state. Here, the second preset value can be a system default value or any custom value selected by the user based on the distance difference between the two eyes and the screen set by the system that will not affect vision.

[0127] For example, the distance between the left eye and the screen is defined as the first distance, and the distance between the right eye and the screen is defined as the second distance. The distance difference between each eye and the screen is equal to the absolute value of the difference between the first distance and the second distance. The sample image is an image in which the distance difference between each eye and the screen is less than a second preset value.

[0128] In some embodiments, the similarity between the binocular regions of the target in the second image and the binocular regions in the sample image is compared. The higher the similarity, the closer the distance difference between the target's two eyes and the screen is to the preset requirement; the lower the similarity, the less the distance difference between the target's two eyes and the screen meets the preset requirement. When the similarity is greater than or equal to a third preset value, it is determined that the distance difference between the target's two eyes and the screen in the second image meets the preset requirement; when the similarity is less than the third preset value, it is determined that the distance difference between the target's two eyes and the screen in the second image does not meet the preset requirement. Here, the third preset value can be a system-defined value.

[0129] In this embodiment of the disclosure, sample images in which the distance difference between each eye and the screen meets a preset requirement are pre-stored. By comparing the similarity of the eye regions between the second image and the sample images, the distance difference between each of the target's eyes and the screen in the second image is determined. In this way, by comparing images, it is possible to quickly determine whether the target's viewing state of the screen meets the preset state, without having to frequently measure the distance difference between each of the target's eyes and the screen, thus reducing the amount of computation and improving the efficiency of detecting the distance difference between each of the target's eyes and the screen.

[0130] For example, in other embodiments, the distance difference between the target's two eyes and the screen can be detected based on distance sensors such as TOF modules, infrared sensors, ultrasonic distance sensors or laser distance sensors.

[0131] In some embodiments, such as Figure 7 As shown, step 1022 above, which detects the target's body posture while viewing the screen, further includes:

[0132] 10221: Acquire a third image of the target viewing the screen;

[0133] In this embodiment of the disclosure, the third image can be acquired by a camera according to the second preset frequency, and the third image is a face image of the target user and a background image of the target user acquired while the target user is viewing the screen.

[0134] 10222: Determine whether the third image contains images of objects in the environment where the target was lying down;

[0135] The step of determining whether the third image contains images of objects in the environment where the target is lying down includes at least one of the following: determining whether the third image contains an image of a pillow that is in contact with the target's face; determining whether the third image contains an image of a bed that is in contact with the target's face; determining whether the third image contains an image of a sofa that is in contact with the target's face.

[0136] In this embodiment, when the third image contains an image of objects in the environment where the target is lying down, it is determined that the state in which the target is viewing the screen is not a preset state.

[0137] Specifically, when the third image contains at least one of the following: an image of a pillow that is in contact with the target's face, an image of a bed that is in contact with the target's face, or an image of a sofa that is in contact with the target's face, it is determined that the target is in a lying-down state, indicating that the target's state of viewing the screen is not a preset state.

[0138] In this embodiment, by recognizing the image of objects in the third image, it is determined whether the target is lying down when viewing the screen. This not only ensures the distance between the user's eyes and the screen, but also ensures the user's body posture when viewing the screen. When the distance between the user's eyes and the screen is unequal or too close, or when the user is lying down while viewing the screen, vision protection operations are performed. Combined with the body posture when viewing the screen, vision is protected more comprehensively.

[0139] The information processing method provided in this disclosure will be further illustrated below through specific embodiments.

[0140] This disclosure provides an information processing method, the specific process of which may include the following steps:

[0141] Step 1: Determine if the user is looking at the phone screen using the camera;

[0142] Step 1.1: Capture the first image of the phone screen facing the space using the camera, and determine whether the first image contains a human face region;

[0143] Specifically, if the first image contains a face region, then step 1.2 is executed; if it does not contain a face region, then step 1.1 is executed.

[0144] Step 1.2: Determine if the user's gaze is on the screen;

[0145] Specifically, the plane where the screen display is located is determined by the gyroscope, and a coordinate system is established with the center of the screen display as the origin, the horizontal direction as the X-axis of the coordinate system, and the perpendicular direction to the horizontal direction as the Y-axis of the coordinate system; the angle between the line connecting the eyes in the face area and the X-axis of the coordinate system is determined; when the angle is less than a fourth preset value, it is determined that the user's gaze is on the screen, and step 2 is executed; when the angle is greater than the fourth preset value, it is determined that the user's gaze is not on the screen, and step 1.1 is executed.

[0146] Step 2: Detect the status parameters when the user is viewing the screen;

[0147] The state parameters include the distance difference between the target's two eyes and the screen; and / or the target's body posture when viewing the screen.

[0148] Step 2.1: Determine the distance difference between each of the target's eyes and the screen;

[0149] Specifically, the system uses the front-facing camera to determine the user's face image while viewing the screen, and compares the similarity between the eye regions in the face image and the eye regions in a sample image. Here, the sample image is the user's face image when the distance difference between each eye and the phone screen is less than a first threshold, i.e., a face image that conforms to the correct viewing posture. When the similarity is greater than a second threshold, it is determined that the distance difference between the user's eyes and the screen does not meet the requirements for correct viewing, and step 3 is executed. When the similarity is less than or equal to the second threshold, it is determined that the distance difference between the user's eyes and the screen meets the requirements for correct viewing, and step 2 is executed again after a preset time period.

[0150] Step 2.2: Detect the target's body posture while viewing the screen;

[0151] Step 2.2.1: Capture the background image when the user is viewing the screen;

[0152] Step 2.2.2: Identify whether there are images of objects in the environment where the user was lying down in the background image;

[0153] Specifically, the imaging of objects in the environment where the user is lying down includes at least one of the following: an imaging of a pillow that is in contact with the target face, an imaging of a bed that is in contact with the target face, and an imaging of a bed that is in contact with the target face; when it is determined that there is an imaging of objects in the environment where the user is lying down in the background image, it indicates that the user does not meet the requirements for correct viewing, and step 3 is executed; when it is determined that there is an imaging of objects in the environment where the user is lying down in the background image, it indicates that the user meets the requirements for correct viewing, and step 2 is executed again after a preset time period.

[0154] Step 3: Perform vision protection procedures;

[0155] Specifically, a message prompt is displayed to prompt the target to adjust its viewing posture; or, if the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the display update of the screen is paused.

[0156] Figure 8 This is a structural block diagram of an information processing apparatus according to an exemplary embodiment. (Refer to...) Figure 8 The information processing device 800 may include: a first determining module 810, a detection module 820, and an execution module 830, wherein,

[0157] The first determining module 810 is used to determine that the target is on the viewing screen;

[0158] The detection module 820 is used to detect the state parameters of the target viewing the screen when the target is viewing the screen;

[0159] The execution module 830 is used to perform vision protection operations on the target when the status parameter indicates that the target's viewing screen state is not a preset state.

[0160] In some embodiments, the first determining module 810 is specifically configured to: acquire a first image of the screen facing the space; when the first image includes a face region, determine whether the target's gaze is falling on the screen based on the face region; when the target's gaze is falling on the screen, determine that the target is watching the screen.

[0161] In some embodiments, the first determining module 810 is further configured to: determine that the target's line of sight falls on the screen when the angle between the connecting line direction and the display plane of the screen is less than a preset value; and determine that the target's line of sight falls outside the screen when the angle between the connecting line direction and the display plane of the screen is greater than or equal to the preset value.

[0162] In some embodiments, the detection module 820 is specifically used to: determine the distance difference between the target's eyes and the screen respectively; and / or detect the target's body posture when viewing the screen.

[0163] In some embodiments, the detection module 820 is specifically used to: acquire a second image of the target user viewing the screen;

[0164] In some embodiments, the apparatus further includes: a second determining module 840;

[0165] The second determining module 840 is used to determine whether the distance difference between the target's eyes and the screen meets a preset requirement based on the similarity between the target's eye regions in the second image and the eye regions in the sample image; wherein, the sample image is an image in which the distance difference between the target's eyes and the screen meets the preset requirement; when the distance difference between the target's eyes and the screen does not meet the preset requirement, it is determined that the target's viewing state of the screen is not a preset state.

[0166] In some embodiments, the detection module 820 is used to acquire a third image of the target viewing the screen; and determine whether the third image contains images of objects in the environment where the target is lying down;

[0167] The second determining module 840 is used to determine that the target's state of viewing the screen is not a preset state when the third image contains an image of objects in the environment where the target is lying down.

[0168] In some embodiments, the detection module 820 is specifically used to determine whether the third image contains an image of an object in the environment where the target was lying down, including at least one of the following:

[0169] Determine whether the third image contains an image of a pillow that is in contact with the target face;

[0170] Determine whether the third image contains an image of a bed that is in contact with the target face;

[0171] Determine whether the third image contains an image of a sofa that is in contact with the target face.

[0172] In some embodiments, the execution module 830 is configured to display a message prompting the target to adjust its viewing posture; or, if the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the display update of the screen is paused.

[0173] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0174] In an exemplary embodiment, the first determining module 810, the detection module 820, the execution module 830, and the second determining module 840 may be implemented by one or more central processing units (CPUs), graphics processing units (GPUs), baseband processors (BPs), application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to perform the aforementioned method.

[0175] Figure 9 This is a block diagram illustrating an apparatus 900 for information processing according to an exemplary embodiment. For example, apparatus 900 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0176] Reference Figure 9 The device 900 may include one or more of the following components: a processing component 902, a memory 904, a power supply component 906, a multimedia component 908, an audio component 910, an input / output (I / O) interface 912, a sensor component 914, and a communication component 916.

[0177] Processing component 902 typically controls the overall operation of device 900, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 902 may include one or more processors 920 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 902 may include one or more modules to facilitate interaction between processing component 902 and other components. For example, processing component 902 may include a multimedia module to facilitate interaction between multimedia component 908 and processing component 902.

[0178] Memory 904 is configured to store various types of data to support the operation of device 900. Examples of this data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, etc. Memory 904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0179] Power supply component 906 provides power to various components of device 900. Power supply component 906 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 900.

[0180] Multimedia component 908 includes a screen that provides an output interface between the device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 908 includes a front-facing camera and / or a rear-facing camera. When the device 900 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0181] Audio component 910 is configured to output and / or input audio signals. For example, audio component 910 includes a microphone (MIC) configured to receive external audio signals when device 900 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 904 or transmitted via communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.

[0182] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0183] Sensor assembly 914 includes one or more sensors for providing status assessments of various aspects of device 900. For example, sensor assembly 914 may detect the on / off state of device 900, the relative positioning of components such as the display and keypad of device 900, changes in position of device 900 or a component of device 900, the presence or absence of user contact with device 900, orientation or acceleration / deceleration of device 900, and temperature changes of device 900. Sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 914 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0184] Communication component 916 is configured to facilitate wired or wireless communication between device 900 and other devices. Device 900 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 916 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 916 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0185] In an exemplary embodiment, the apparatus 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0186] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions, which can be executed by a processor 920 of the device 900 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0187] After the instruction is executed by the processor, it can perform the following operations:

[0188] Identify the target on the viewing screen;

[0189] When the target is viewing the screen, the state parameters of the target viewing the screen are detected;

[0190] When the status parameter indicates that the target's screen viewing state is not a preset state, the target's vision protection operation is executed.

[0191] Understandably, determining that the target is on the viewing screen includes:

[0192] Capture a first image of the screen facing the space;

[0193] When the first image includes a face region, determine whether the target's gaze falls on the screen based on the face region;

[0194] When the target's gaze falls on the screen, it is determined that the target is watching the screen.

[0195] Understandably, when the first image includes a face region, determining whether the target's gaze falls on the screen based on the face region includes:

[0196] Determine the direction of the line connecting the two eyes in the face region;

[0197] Based on the angle between the direction of the line and the display plane of the screen, it is determined whether the target's line of sight falls on the screen.

[0198] Understandably, determining whether the target's line of sight falls on the screen based on the angle between the direction of the connecting line and the display plane of the screen includes:

[0199] When the angle between the direction of the connecting line and the display plane of the screen is less than a preset value, it is determined that the target's line of sight falls on the screen;

[0200] When the angle between the direction of the connecting line and the display plane of the screen is greater than or equal to the preset value, it is determined that the target's line of sight falls outside the screen.

[0201] Understandably, detecting the state parameters of the target viewing screen includes:

[0202] Determine the distance difference between each of the target's eyes and the screen;

[0203] And / or,

[0204] Detect the target's body posture when viewing the screen.

[0205] Understandably, determining the distance difference between the target's two eyes and the screen includes:

[0206] Acquire a second image of the target user as they view the screen;

[0207] Based on the similarity between the binocular regions of the target in the second image and the binocular regions in the sample image, it is determined whether the distance difference between each of the target's eyes and the screen meets a preset requirement; wherein, the sample image is an image in which the distance difference between each of the target's eyes and the screen meets the preset requirement;

[0208] The method further includes:

[0209] If the distance difference between the target's eyes and the screen does not meet the preset requirement, it is determined that the target's viewing state of the screen is not the preset state.

[0210] Understandably, detecting the target's body posture while viewing the screen also includes:

[0211] Acquire a third image of the target viewing the screen;

[0212] Determine whether the third image contains images of objects in the environment where the target was lying down;

[0213] The method further includes:

[0214] When the third image contains an image of objects in the environment where the target is lying down, it is determined that the state in which the target is viewing the screen is not a preset state.

[0215] Understandably, determining whether the third image contains images of objects within the environment where the target was lying down includes at least one of the following:

[0216] Determine whether the third image contains an image of a pillow that is in contact with the target face;

[0217] Determine whether the third image contains an image of a bed that is in contact with the target face;

[0218] Determine whether the third image contains an image of a sofa that is in contact with the target face.

[0219] Understandably, the vision protection operation performed to achieve the target includes:

[0220] Display a message prompting the target to adjust their viewing posture;

[0221] or,

[0222] If the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the screen display update is paused.

[0223] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the claims.

[0224] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. An information processing method, characterized in that, Applied to electronic devices, the method includes: Identify the target on the viewing screen; When the target is viewing the screen, detect the state parameters of the target viewing the screen; When the status parameter indicates that the target's viewing state is not a preset state, a vision protection operation is performed on the target; wherein, the preset state indicates that the status parameter indicates that the target's posture when viewing the screen is correct; The detection of the target's viewing state parameters includes: Acquire a second image of the target viewing the screen; Based on the similarity between the binocular regions of the target in the second image and the binocular regions in the sample image, it is determined whether the distance difference between each of the target's eyes and the screen meets a preset requirement; wherein, the sample image is an image in which the distance difference between each of the eyes and the screen meets the preset requirement, the distance difference between each of the eyes and the screen is the absolute value of a first distance and a second distance difference, the first distance is the distance from the left eye to the screen, the second distance is the distance from the right eye to the screen, and the preset requirement is that the distance difference is less than a second preset value.

2. The method according to claim 1, characterized in that, The determination of the target on the viewing screen includes: Capture a first image of the screen facing the space; When the first image includes a face region, determine whether the target's gaze falls on the screen based on the face region; When the target's gaze falls on the screen, it is determined that the target is watching the screen.

3. The method according to claim 2, characterized in that, When the first image includes a face region, determining whether the target's gaze falls on the screen based on the face region includes: Determine the direction of the line connecting the two eyes in the face region; Based on the angle between the direction of the line and the display plane of the screen, it is determined whether the target's line of sight falls on the screen.

4. The method according to claim 3, characterized in that, Determining whether the target's line of sight falls on the screen based on the angle between the direction of the connecting line and the display plane of the screen includes: When the angle between the direction of the connecting line and the display plane of the screen is less than a preset value, it is determined that the target's line of sight falls on the screen; When the angle between the direction of the connecting line and the display plane of the screen is greater than or equal to the preset value, it is determined that the target's line of sight falls outside the screen.

5. The method according to claim 1, characterized in that, The detection of the target's viewing state parameters includes: Detect the target's body posture when viewing the screen.

6. The method according to claim 1, characterized in that, The method further includes: If the distance difference between the target's eyes and the screen does not meet the preset requirement, it is determined that the target's viewing state of the screen is not the preset state.

7. The method according to claim 5, characterized in that, The detection of the target's body posture when viewing the screen further includes: Acquire a third image of the target viewing the screen; Determine whether the third image contains images of objects in the environment where the target was lying down; The method further includes: When the third image contains an image of objects in the environment where the target is lying down, it is determined that the state in which the target is viewing the screen is not the preset state.

8. The method according to claim 7, characterized in that, Determining whether the third image contains images of objects within the environment where the target was lying down includes at least one of the following: Determine whether the third image contains an image of a pillow that is in contact with the target face; Determine whether the third image contains an image of a bed that is in contact with the target face; Determine whether the third image contains an image of a sofa that is in contact with the target face.

9. The method according to claim 1, characterized in that, The vision protection operation performed to achieve the target includes: Display a message prompting the target to adjust their viewing posture; or, If the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the screen display update is paused.

10. An information processing device, characterized in that, Used in electronic devices, including: The first determining module is used to determine whether the target is on the viewing screen; The detection module is used to detect the state parameters of the target viewing the screen when the target is viewing the screen; The second determining module is used to detect the state parameters of the target viewing the screen when the target is viewing the screen; An execution module is configured to perform vision protection operations on the target when the status parameter indicates that the target's viewing posture on the screen is not a preset state; wherein, the preset state indicates that the status parameter indicates that the target's viewing posture on the screen is correct; The detection module is specifically used to acquire a second image of the target when it is viewing the screen; The second determining module is specifically used to determine whether the distance difference between each eye of the target and the screen meets a preset requirement based on the similarity between the eye regions of the target in the second image and the eye regions in the sample image; wherein, the sample image is an image in which the distance difference between each eye and the screen meets the preset requirement, the distance difference between each eye and the screen is the absolute value of a first distance and a second distance difference, the first distance is the distance from the left eye to the screen, the second distance is the distance from the right eye to the screen, and the preset requirement is that the distance difference is less than a second preset value.

11. The apparatus according to claim 10, characterized in that, The first determining module is specifically used to acquire a first image of the screen facing the space; when the first image includes a face region, it determines whether the target's gaze is on the screen based on the face region; when the target's gaze is on the screen, it determines that the target is looking at the screen.

12. The apparatus according to claim 11, characterized in that, The first determining module is specifically used to determine the direction of the line connecting the eyes in the face region; when the angle between the line direction and the display plane of the screen is less than a preset value, it is determined that the target's gaze falls on the screen; when the angle between the line direction and the display plane of the screen is greater than or equal to the preset value, it is determined that the target's gaze falls outside the screen.

13. The apparatus according to claim 10, characterized in that, The detection module is also used to detect the target's body posture when viewing the screen.

14. The apparatus according to claim 13, characterized in that, The second determining module is further configured to determine that the target's viewing state of the screen is not the preset state when the distance difference between the target's eyes and the screen does not meet the preset requirement.

15. The apparatus according to claim 10, characterized in that, The detection module is used to acquire a third image of the target when it is viewing the screen; and to determine whether the third image contains images of objects in the environment where the target is lying down. The second determining module is used to determine that the target's state of viewing the screen is not the preset state when the third image contains an image of objects in the environment where the target is lying down.

16. The apparatus according to claim 15, characterized in that, The detection module is specifically used to determine whether the third image contains images of objects in the environment where the target was lying down, including at least one of the following: Determine whether the third image contains an image of a pillow that is in contact with the target face; Determine whether the third image contains an image of a bed that is in contact with the target face; Determine whether the third image contains an image of a sofa that is in contact with the target face.

17. The apparatus according to claim 10, characterized in that, The execution module is configured to display a message prompting the target to adjust its viewing posture; or, if the target's posture is not adjusted within a preset time after the message prompt, the screen is turned off for a preset time, or the display update of the screen is paused.

18. An electronic device, characterized in that, include: Memory used to store processor-executable instructions; The processor is connected to the memory; The processor is configured to perform the information processing method provided in any one of claims 1 to 9.

19. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of a computer, enable the computer to perform any one of the information processing methods as claimed in claims 1 to 9.

Images