Prompt method, electronic device, chip system, storage medium and product

Abstract

The application provides a prompting method, an electronic device, a chip system, a storage medium and a product, and is applied to the terminal technical field.The method comprises the following steps: the electronic device can collect images in the visual angle range thereof through a camera; if an unauthorized user exists in the images, and the gaze range of the unauthorized user is in an unauthorized visual angle range, and the gaze duration is greater than or equal to a threshold value, the electronic device can send a prompt to an electronic ink screen on the same side as the camera, and the prompt can prompt the unauthorized user. In this way, the unauthorized visual angle range is gazed at by the unauthorized user for a long time, which indicates that a person or object that does not want to be gazed at is gazed at by an irrelevant person for a long time, the electronic device can prompt the unauthorized user through the electronic ink screen, and the information security and the privacy security are protected.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a prompting method, electronic device, chip system, storage medium, and product. Background Technology

[0002] With the development of terminal technology, users are increasingly using electronic devices in public places. In public, users not only face the risk of their electronic devices being viewed by others, but also the possibility of being watched by others. This unnecessary attention can cause user discomfort and raise potential privacy and security issues.

[0003] Currently, electronic devices can include one or more of the following features: notification hiding, app lock, or privacy space. Notification hiding allows notifications to be displayed only when the user views the device. App lock uses authentication methods such as passwords, fingerprints, or facial recognition to allow only verified users to access the application. Privacy space provides a private space separate from the main storage for storing the user's personal data.

[0004] However, while these methods can prevent information on electronic devices from being seen by others, they cannot reduce the user from being watched by others. Therefore, how to reduce the user from being watched by others has become an urgent problem to be solved. Summary of the Invention

[0005] This application provides a notification method, electronic device, chip system, storage medium, and product, which are applied in the field of terminal technology. When a user is being watched by others, the user notifies others to protect the user's safety and privacy.

[0006] Firstly, this application provides a notification method that can be applied to an electronic device, a chip in the electronic device, or a chip system in an electronic device. This application will be described using an electronic device as an example.

[0007] The method may include: identifying whether a first user exists within the field of view of the camera, wherein the first user is a user who has not been authorized by the electronic device; if the first user exists within the field of view of the camera, the first user's gaze range is within the field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a first threshold, sending a first prompt to the e-ink screen, wherein the e-ink screen and the camera are located on the same side of the electronic device, and the first prompt is used to prompt the first user.

[0008] The notification method provided in this application indicates that if an unauthorized user gazes at a field of view that is not allowed to be gazed at for a period of time exceeding a threshold, it suggests that people or objects within the unauthorized field of view may be being excessively observed by irrelevant individuals. Electronic devices can provide notifications to unauthorized users through an e-ink screen, which is beneficial for protecting information security and privacy.

[0009] In one possible implementation, the unapproved viewing angle includes at least one of the following: the user, the mobile phone, or the computer. The user is the owner or administrator of the electronic device. This approach allows for wider applicability and more diverse applications.

[0010] In one possible implementation, the first threshold is one of multiple thresholds, and the multiple thresholds correspond one-to-one with multiple prompts. The first prompt is the prompt among the multiple prompts that corresponds to the first threshold.

[0011] By setting multiple thresholds, each corresponding to a prompt, the appropriate prompt can be displayed based on the duration of gaze, which is more conducive to protecting information security and privacy.

[0012] In one possible implementation, the method further includes: when a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a second threshold, sending a second prompt to the e-ink screen, the second prompt being used to prompt the first user, the second threshold being greater than the first threshold, and the content of the second prompt being different from the content of the first prompt.

[0013] In this way, different thresholds correspond to different prompts, and the corresponding prompts can be displayed according to different gaze durations, which is beneficial for prompting unauthorized users.

[0014] In one possible implementation, the method further includes: playing a ringtone or vibrating when a first user is present within the camera's field of view, the first user's gaze is within an unpermitted field of view, and the first user's gaze duration is greater than or equal to a third threshold. This method of using a ringtone or vibration to alert the user is beneficial in attracting their attention.

[0015] Optionally, the third threshold is greater than the second threshold. Thus, if an unauthorized user's gaze duration exceeds the second threshold, the electronic device can display a notification via the e-ink screen. When the unauthorized user's gaze duration is greater than or equal to the third threshold (which is greater than the second threshold), indicating an excessive gaze duration, the device owner can be alerted via a ringtone or vibration to take measures to avoid being stared at by others, thus protecting information security and privacy.

[0016] In one possible implementation, the electronic device further includes a display screen, which is located on a different side of the electronic device from the e-ink screen. The method further includes: if a first user is present within the camera's field of view, the first user's gaze is within an unpermitted field of view, and the first user's gaze duration is greater than or equal to a fourth threshold, then a third prompt is displayed on the display screen to indicate the presence of the first user. Thus, displaying the third prompt on the display screen helps to attract the user's attention, allowing the user to take measures to avoid being stared at by others.

[0017] Optionally, the fourth threshold can be the same as the first or second threshold mentioned above. In this way, the electronic device can send a first or second prompt to the e-ink screen and also display a third prompt on the screen. This serves both to alert unauthorized users and to attract the owner's attention, allowing the owner to take measures to avoid being watched by others.

[0018] Optionally, the fourth threshold can be the same as the third threshold mentioned above. Thus, if the first user's gaze is within an unpermitted viewing angle and the first user's gaze duration is greater than or equal to the fourth threshold, the electronic device can display a third prompt on the screen, or provide a prompt via a ringtone or vibration. There are two parallel implementation methods, and the electronic device can deploy either one.

[0019] In one possible implementation, the method further includes: acquiring first information, the first information including one or more of the acceleration of the electronic device or the geographical location of the electronic device; and sending a first prompt to the electronic ink screen, including: sending a first prompt to the electronic ink screen based on the first information.

[0020] In this way, the electronic device can determine the first prompt to send to the e-ink screen based on one or more of the electronic device's acceleration or geographical location, which is beneficial for application in more scenarios.

[0021] In one possible implementation, the first piece of information satisfies a first condition, which is one of multiple conditions. These multiple conditions correspond to multiple prompts, and the first prompt is the one among the multiple prompts that corresponds to the first condition. This approach offers greater flexibility by displaying prompts corresponding to different conditions, compared to displaying the same prompt regardless of the conditions.

[0022] In one possible implementation, sending the first prompt to the e-ink screen includes sending the first prompt to the e-ink screen via a wireless communication link. This approach is suitable for scenarios where the electronic device does not include an e-ink screen, thus broadening its application.

[0023] In one possible implementation, identifying whether a first user exists within the camera's field of view includes: acquiring an image within the camera's field of view; and identifying whether a first user exists in the image.

[0024] In one possible implementation, identifying whether a first user exists in an image within the field of view of the camera includes: identifying first facial information in the image; and determining whether a first user exists in the image based on whether the first facial information includes facial information other than facial information stored in an electronic device.

[0025] In this way, recognizing whether the first user is present in the image within the camera's field of view through facial information helps identify unauthorized users.

[0026] Secondly, this application provides a prompting device, which can be an electronic device, or a chip or chip system within an electronic device. The prompting device may include a processing unit and a transmitting unit. When the prompting device is an electronic device, the processing unit may be a processor. The prompting device may also include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to cause the electronic device to implement a prompting method described in the first aspect or any possible implementation of the first aspect. When the prompting device is a chip or chip system within an electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit to cause the electronic device to implement a prompting method described in the first aspect or any possible implementation of the first aspect. The storage unit may be a storage unit within the chip (e.g., a register, cache, etc.), or a storage unit located outside the chip within the electronic device (e.g., a read-only memory, random access memory, etc.).

[0027] For example, the processing unit is used to identify whether a first user exists within the field of view of the camera, wherein the first user is a user who is not authorized by the electronic device; the sending unit is used to send a first prompt to the e-ink screen when the first user exists within the field of view of the camera, the first user's gaze range is within the field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a first threshold, wherein the e-ink screen and the camera are located on the same side of the electronic device, and the first prompt is used to prompt the first user.

[0028] In one possible implementation, the content included within the unapproved viewing angle range can be referred to the above description, and will not be repeated here.

[0029] In one possible implementation, the correspondence between the first threshold and the prompt can be referred to the above description, and will not be repeated here.

[0030] In one possible implementation, the sending unit is further configured to: send a second prompt to the e-ink screen when a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a second threshold; the second prompt is used to prompt the first user that the second threshold is greater than the first threshold, and the content of the second prompt is different from the content of the first prompt.

[0031] In one possible implementation, the processing unit is further configured to: play a ringtone or vibrate when a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a third threshold.

[0032] Optionally, the relationship between the third threshold and the second threshold can be referred to the above description, and will not be repeated here.

[0033] In one possible implementation, the electronic device further includes a display screen, which is located on a different side of the electronic device from the e-ink screen; the processing module is further configured to: control the display screen to display a third prompt when a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a fourth threshold, the third prompt being used to indicate the presence of the first user.

[0034] In one possible implementation, the processing module is further configured to: acquire first information, the first information including one or more of the acceleration of the electronic device or the geographical location of the electronic device; the sending unit is further configured to: send a first prompt to the electronic ink screen according to the first information.

[0035] In one possible implementation, the relationship between the first information and the first prompt can be referred to the above description, and will not be repeated here.

[0036] In one possible implementation, the transmitting unit is also used to: send a first prompt to the e-ink screen via a wireless communication link.

[0037] In one possible implementation, the processing unit is also used to: acquire images within the field of view of the camera; and identify whether a first user exists in the images.

[0038] In one possible implementation, the processing unit is further configured to: identify first facial information in the image; and determine whether a first user exists in the image based on whether the first facial information includes facial information other than facial information stored in the electronic device.

[0039] Thirdly, this application provides an electronic device including one or more processors and a memory; the memory is coupled to one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the methods described in the first aspect or any possible implementation of the first aspect.

[0040] Fourthly, this application provides a computer-readable storage medium storing a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any possible implementation thereof.

[0041] Fifthly, this application provides a computer program product, which includes computer program code that, when run on an electronic device, causes the electronic device to perform the methods described in the first aspect or any possible implementation thereof.

[0042] In a sixth aspect, this application provides a chip or chip system applied to an electronic device, the chip or chip system including at least one or more processors, the one or more processors being configured to invoke computer instructions to perform the methods described in the first aspect or any possible implementation thereof.

[0043] In one possible implementation, the chip or chip system described above in this application further includes at least one memory storing instructions. The memory can be an internal storage unit of the chip, such as a register or cache, or it can be a storage unit of the chip itself (e.g., read-only memory, random access memory, etc.).

[0044] It should be understood that the second to sixth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0045] Figure 1 This is a schematic diagram of an interface for enabling the message notification hiding function provided in an embodiment of this application;

[0046] Figure 2 This is a schematic diagram of an interface for enabling the application lock function provided in an embodiment of this application;

[0047] Figure 3 This is a schematic diagram of an interface for explaining the privacy space function provided in an embodiment of this application;

[0048] Figure 4This is a schematic diagram of a mobile phone case provided in an embodiment of this application;

[0049] Figure 5 This is a schematic diagram illustrating an application scenario provided in an embodiment of this application;

[0050] Figures 6 to 8 This is a schematic diagram of an interface that provides prompts via images, as provided in an embodiment of this application.

[0051] Figure 9 This is a schematic diagram of an interface that provides prompts via vibration, as provided in an embodiment of this application.

[0052] Figure 10 and Figure 11 This is a schematic diagram of an interface that provides prompts via a mobile phone display screen, as provided in an embodiment of this application.

[0053] Figure 12 These are schematic diagrams of interfaces that provide prompts when different thresholds are met in different scenarios, as provided in the embodiments of this application.

[0054] Figure 13 This is a schematic diagram illustrating another application scenario provided by an embodiment of this application;

[0055] Figure 14 This is a schematic diagram of a prompting method provided in an embodiment of this application;

[0056] Figure 15 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;

[0057] Figure 16 This is a schematic diagram of the hardware and software structure of an electronic device provided in an embodiment of this application;

[0058] Figure 17 This is a schematic diagram of the structure of a chip provided in an embodiment of this application. Detailed Implementation

[0059] To facilitate understanding of the embodiments of this application, the following description is provided first:

[0060] In the embodiments of this application, terms such as "first" and "second" are used to distinguish identical or similar items with essentially the same function and effect. For example, "first prompt" and "second prompt" are merely used to distinguish different prompts and do not limit their order. Those skilled in the art will understand that terms such as "first" and "second" do not limit the quantity or execution order, and that terms such as "first" and "second" do not necessarily imply that they are different.

[0061] It should be noted that, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0062] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, and c can be single or multiple.

[0063] With the development of terminal technology, users are increasingly using electronic devices in public places. In public, users not only face the risk of their electronic devices being viewed by others, but also the possibility of being watched by others. This unnecessary attention can cause user discomfort and raise potential privacy and security issues.

[0064] In related technologies, electronic devices may include one or more of the following functions: message notification hiding, app lock, or privacy space. The functions of message notification hiding, app lock, and privacy space are explained in detail below.

[0065] The notification hiding function allows notification content to be displayed only when the user views the device. The user can also be referred to as the device owner or device administrator; this embodiment does not limit this terminology.

[0066] For example, Figure 1 A schematic diagram of an interface for enabling the message notification hiding function is shown. For example... Figure 1 As shown, users can enable or disable the function of hiding notification content, set desktop icon badges, and enable or disable notification screen wake-up prompts in the notification management interface. When the function of hiding notification content is enabled, the electronic device can intelligently recognize faces, and the notification content will only be displayed when the owner views the device.

[0067] The application lock function allows users to access an application only by setting authentication methods such as passwords, fingerprints, or facial recognition. The term "application" can also be used interchangeably with "application" in this embodiment.

[0068] For example, Figure 2 A schematic diagram of an interface for enabling the application lock function is shown. For example... Figure 2 As shown, users can enable or disable the app lock function on the app lock interface. If the app lock function is enabled, the electronic device can authenticate the user when it detects a locked app being opened. If authentication is successful, the locked app's interface will be displayed. Authentication methods can include password, fingerprint, or facial recognition. If facial recognition is used for authentication, and a change in user identity is detected in good lighting conditions, the electronic device can authenticate the user again.

[0069] The Privacy Space feature provides a private space separate from the main storage space for storing users' private data.

[0070] For example, Figure 3 A schematic diagram illustrating the interface function of the privacy space is shown. Figure 3 As shown, the Privacy Space is a private space separate from the Main Space where personal data can be stored. The owner can set a different password for the Privacy Space than the Main Space to switch to access it from the lock screen and settings.

[0071] Depend on Figures 1 to 3 As can be seen, the notification hiding function prevents notification content from being seen by anyone other than the user, which is beneficial for information security and privacy protection. The app lock function prevents unverified users from opening locked apps, thus preventing others from opening locked apps even when using the electronic device, which is beneficial for information security and privacy protection. The privacy space function provides a private space independent of the main storage space, so even if others use the electronic device to view the main storage space, they cannot view the contents of the privacy space, which is beneficial for information security and privacy protection.

[0072] However, while these methods can prevent information on electronic devices from being seen by others, they cannot reduce the user from being watched by others. Therefore, how to reduce the user from being watched by others has become an urgent problem to be solved.

[0073] To address this issue, this application provides a notification method that identifies whether an unauthorized user exists within the field of view of the camera in an electronic device. If such a user exists and their gaze is within an unauthorized field of view, and the gaze duration exceeds a first threshold, it indicates that impolite behavior has been detected. A notification can then be displayed on an e-ink screen located on the same side as the camera to alert the unauthorized user, thereby protecting the user's safety and privacy.

[0074] In this context, an unauthorized user can refer to any user other than the device owner or users the owner allows to look at (e.g., the owner's family, friends, etc.). The unauthorized viewing angle range is determined based on the user's likely location when holding the electronic device, to facilitate detection of whether an unauthorized user is looking at the user. The e-ink screen can be a screen on the electronic device or a screen outside the electronic device; this application embodiment does not limit this. If the e-ink screen is a screen outside the electronic device, in some examples, it can be a screen on the protective case of the electronic device, and the electronic device can establish a wireless communication link with the e-ink screen. Wireless communication can refer to methods such as Wi-Fi, Bluetooth, or Near Field Communication (NFC); ​​this application embodiment does not limit this. An e-ink screen can also be called an ink screen; this application embodiment does not limit this.

[0075] To facilitate understanding of the methods provided in the embodiments of this application, the following is combined with... Figures 4 to 6 This section describes the scenarios in which the methods provided in the embodiments of this application are applicable. Figures 4 to 6 The scenario shown is illustrated using a mobile phone as the electronic device and an e-ink screen as a screen on the phone case.

[0076] like Figure 4 As shown, area 401 in the phone case 400 is the area where the phone's camera module is placed. The camera module may include one or more cameras, but this embodiment does not limit this. Area 402 in the phone case is the area where the e-ink screen is located. When the phone case 400 is installed, the phone can establish a wireless communication link with the e-ink screen. After establishing the wireless communication link, the phone can send images to the e-ink screen as patterns on the phone case, according to the user's needs. This provides greater flexibility and better meets user needs compared to phone cases with only one pattern.

[0077] In this embodiment, after the mobile phone establishes a wireless communication link with the e-ink screen, the mobile phone can also identify whether there is an unauthorized user within the field of view of one of the cameras in the camera module.

[0078] like Figure 5 As shown, the phone belongs to user 501, who is holding the phone with the front facing them. The back of the phone includes a camera module. If... Figure 5 The phone shown includes a display screen; therefore, the front of the phone is the plane where the display screen is located. If... Figure 5 The mobile phone shown includes multiple displays. The front of the phone is the plane where the main display is located among the multiple displays. The main display is the display that the phone assigns by default to display the main user interface.

[0079] The mobile phone can identify that user 502 and user 503 exist within the field of view of one of the cameras in the camera module, and determine whether user 502 and user 503 are unauthorized users respectively.

[0080] In some examples, the mobile phone can provide a human-computer interaction interface (HCI) that allows the phone to register the facial information of authorized users. Thus, the phone can store the facial information of authorized users. When users 502 and 503 are identified, the phone can match their facial information with the stored facial information. If a match is successful, it means the user is not an unauthorized user, or in other words, the user is authorized. If a match fails, it means the user is not an authorized user, or in other words, the user is not authorized.

[0081] In some examples, authorized users can include one or more of the following: registered users, family users, or associated users. Registered users are those who complete identity verification through the phone's registration process (such as entering account information, password, fingerprint information, facial recognition information, etc.) and bind an identity identifier (such as a phone number or email address). Family users are sub-account users associated with the main account through the family sharing function; their permissions can be assigned by the main account. Associated users are those who obtain partial or full access permissions through the same protocol across multiple devices (such as multi-screen collaboration) or third-party authorization (such as third-party applications logging into associated devices). When users 502 and 503 are identified, the phone can determine whether users 502 and 503 are authorized users, respectively.

[0082] Optionally, in order to reduce the power consumption of the mobile phone, the mobile phone can use a low-power chip to determine whether user 502 and user 503 are unauthorized users.

[0083] If both users 502 and 503 are unauthorized users, the phone can determine whether their gaze ranges are within an unauthorized viewing angle. In some examples, the phone can determine the gaze ranges of users 502 and 503 based on their eye images, and then determine whether their gaze ranges are within an unauthorized viewing angle.

[0084] In one example, the mobile phone may also include an infrared camera and an infrared light source. When the infrared light source illuminates the eyes of users 502 and 503, the infrared camera can capture the emitted light from the eyes. The mobile phone can process the image captured by the infrared camera to detect the positions of the pupil and corneal reflection points. Using the positions of the pupil and corneal reflection points, and a known geometric model, the mobile phone can calculate the gaze points of users 502 and 503. Based on the dynamic changes in the gaze points of users 502 and 503, the gaze range of users 502 and 503 can be determined. The mobile phone can then convert the gaze ranges of users 502 and 503 to the field of view of the mobile phone camera, and determine whether this field of view falls within an area where gaze is not permitted.

[0085] In other examples, the phone can acquire eye images of user 502 and user 503 separately, and input them into machine learning models (such as convolutional neural networks) to obtain the gaze points of user 502 and user 503. The machine learning model is used to calculate the gaze points from the eye images. The phone can determine the gaze range of user 502 and user 503 based on the dynamic changes in their gaze points, and convert this gaze range to the field of view of the phone's camera to determine whether it falls within an area where gaze is not permitted.

[0086] Optionally, in order to further reduce the power consumption of the mobile phone, the mobile phone can use a low-power chip, such as a low-power neural processing unit (NPU) chip, to determine whether the gaze range of user 502 and user 503 is within the field of view that is not allowed to be gazed at.

[0087] Optionally, such as Figure 5 As shown, user 502 is looking at user 501, and their gaze range is within the unauthorized gaze range. User 503 is not looking at user 501, and their gaze position is far from user 501; therefore, their gaze range is not within the unauthorized gaze range. The unauthorized gaze range is determined based on the user's likely location when holding the electronic device, to facilitate the detection of whether an unauthorized user is looking at the user. For example, as... Figure 5As shown, the phone's camera has a field of view of (-60°, 60°) and an unpermitted field of view of (0°, 20°). The phone can convert the gaze ranges of users 502 and 503 into the camera's field of view. After converting user 502's gaze range into the camera's field of view, the converted field of view falls within the unpermitted field of view. After converting user 503's gaze range into the camera's field of view, the converted field of view does not fall within the unpermitted field of view.

[0088] The mobile phone can time the behavior of user 502 looking at user 501. If the duration of user 502's gaze at user 501 is greater than or equal to a first threshold, the mobile phone can send a prompt to the e-ink screen via a wireless communication link to alert user 502. The e-ink screen can display the prompt, or in other words, the e-ink screen can switch (or replace) the previously displayed content with the prompt.

[0089] In this embodiment, if the duration for which user 502 gazes at user 501 equals a first threshold, the mobile phone can send a prompt to the e-ink screen via a wireless communication link to alert user 502. In other examples, if the duration for which user 502 gazes at user 501 equals the first threshold, the mobile phone may not send a prompt to the e-ink screen. That is, if the duration for which user 502 gazes at user 501 equals the first threshold, the mobile phone may or may not send a prompt to the e-ink screen via a wireless communication link; this embodiment does not limit this.

[0090] The above-mentioned prompts can take many forms and can be implemented in various ways. For example, a prompt can be one or more of the following: sound, text, image, or vibration. In some examples, such as... Figure 6 As shown, a mobile phone can send an image to an e-ink screen via a wireless communication link. The image includes the text "Please do not peek". It should be noted that "Please do not peek" is just one example. Other examples could include "Please stop looking", "Please do not look", "Looking is impolite", "Peeking is impolite", "Not stopping looking is impolite", "Continuing to look is impolite", "I will call the police if you peek again", "I will call the police if you look again", "I will call the police if you do not stop looking", or "Please pay attention to other things", etc. This application embodiment does not limit this.

[0091] In this embodiment of the application, the image used for prompting may be pre-stored in the mobile phone or set by the user. The source of the image may be local or remote, and this embodiment of the application does not limit this.

[0092] In some examples, the phone can be pre-loaded with images for prompts before leaving the factory. When a user meeting the specified criteria is detected, a prompt can be displayed. This eliminates the need for the user to set their own image, reducing the number of steps and lowering the barrier to entry for users.

[0093] In other examples, the phone can provide a human-computer interaction interface that allows users to set images for prompts according to their own needs and preferences, offering greater flexibility.

[0094] Optionally, in this embodiment of the application, the mobile phone may store multiple images for prompting, and these multiple images for prompting correspond one-to-one with multiple thresholds. When the gaze range of an unauthorized user is within the unallowed gaze range and the gaze duration is greater than or equal to a certain threshold, the mobile phone may display the image corresponding to the threshold to prompt the unauthorized user.

[0095] For example, the first threshold mentioned above is one of multiple thresholds. User 502 is an unauthorized user whose gaze is within an unauthorized viewing angle and whose gaze duration is greater than or equal to the first threshold. The mobile phone can acquire an image corresponding to the first threshold. In some examples, the image may include the text "Please do not peek," and the mobile phone can send the image to the e-ink screen via a wireless communication link, as described above. Figure 6 As shown. In other examples, the image may include the text "It is impolite to peek." The mobile phone can send the image to the e-ink screen via a wireless communication link, such as... Figure 7 As shown. In some other examples, the image may include the text "I'll call the police if you peek again." The mobile phone can send the image to the e-ink screen via a wireless communication link, such as... Figure 8 As shown.

[0096] For example, the second threshold is one of multiple thresholds. The second threshold differs from the first threshold and can be greater than or less than the first threshold; this embodiment does not limit this. User 502 is an unauthorized user whose gaze range is within an unauthorized viewing angle range, and whose gaze duration is greater than or equal to the second threshold. The mobile phone can acquire the image corresponding to the second threshold. The image corresponding to the second threshold is different from the image corresponding to the first threshold.

[0097] For example, if the image corresponding to the first threshold includes "Please do not peek," then the image corresponding to the second threshold could include the text "Peeking is impolite." The mobile phone can send this image to the e-ink screen via a wireless communication link, such as... Figure 7As shown. Alternatively, if the image corresponding to the first threshold includes the text "It's impolite to peek," then the image corresponding to the second threshold can include the text "I'll call the police if you peek again." The mobile phone can send this image to the e-ink screen via a wireless communication link, such as... Figure 8 As shown.

[0098] From the above Figures 6 to 8 As can be seen, different thresholds correspond to different prompts. In some examples, the larger the threshold, the stronger the prompt intensity. Here, prompt intensity represents the strength of the prompt to unauthorized users; the stronger the prompt intensity, the greater the prompt's strength. Prompt intensity can also be called prompt degree, prompt strength, or prompt level, and this application embodiment does not limit this terminology.

[0099] For example, if the second threshold is greater than the first threshold, then the cue strength corresponding to the second threshold is greater than the cue strength corresponding to the first threshold. For instance, the image used to prompt the second threshold includes "It is impolite to peek," while the image used to prompt the first threshold includes "Please do not peek." The cue strength of "It is impolite to peek" is greater than the cue strength of "Please do not peek."

[0100] Alternatively, the image used as a prompt for the second threshold includes "I'll call the police if you peek again," while the image used as a prompt for the first threshold includes "Peeking is impolite." The prompt strength of "I'll call the police if you peek again" is greater than that of "Peeking is impolite."

[0101] It should be noted that this embodiment uses two thresholds (i.e., a first threshold and a second threshold) as an example for illustration. In other examples, multiple thresholds may include threshold 1, threshold 2, and threshold 3, where threshold 1 is less than threshold 2, and threshold 2 is less than threshold 3. The image used for prompting threshold 1 includes "Please do not peek," the image used for prompting threshold 2 includes "Peeking is impolite," and the image used for prompting threshold 3 includes "I will call the police if you peek again." The prompt strength of "I will call the police if you peek again" is greater than that of "Peeking is impolite," and the prompt strength of "Peeking is impolite" is greater than that of "Please do not peek."

[0102] Optionally, to improve the flexibility of the prompts, the mobile phone can provide a human-computer interaction interface for the user, which can support the user to change the text in the image, adjust the correspondence between the image and the threshold, and change the image, etc.

[0103] The above Figures 6 to 8 The prompt shown is an image used to notify unauthorized users. The following describes the format for prompting the account owner.

[0104] In one possible implementation, the mobile phone alerts the owner via ringtone or vibration.

[0105] In some examples, user 502 is an unauthorized user whose gaze is within an unauthorized field of view and whose gaze duration is greater than or equal to a third threshold. In such cases, the phone can play a ringtone or vibrate. This method of alerting the user through ringtones or vibrations is beneficial in drawing the user's attention.

[0106] For example, such as Figure 9 As shown, mobile phones can use vibration to alert users, which helps to draw the user's attention and allow them to take measures to avoid being stared at by others.

[0107] In this embodiment, the third threshold may be the same as, greater than or less than the first or second threshold, and this embodiment does not limit the specific threshold.

[0108] In some examples, the third threshold can be the same as the first or second threshold. In this case, user 502 is an unauthorized user whose gaze is within an unauthorized viewing angle and whose gaze duration is greater than or equal to the third threshold. The phone can then acquire the image corresponding to the third threshold and send it to the e-ink screen via the wireless communication link, while simultaneously playing a ringtone or vibrating. This serves to both alert the unauthorized user and attract the attention of the phone's owner.

[0109] In other examples, the third threshold may be greater than the second threshold, the second threshold may be greater than the first threshold, the cue strength corresponding to the third threshold may be greater than the cue strength corresponding to the second threshold, and the cue strength corresponding to the second threshold may be greater than the cue strength corresponding to the first threshold.

[0110] Thus, the longer the gaze duration, the stronger the cue intensity, which helps to enhance the cueing for unauthorized users and reduce the probability of being gazed at by others.

[0111] In another possible implementation, the phone also includes a display screen, located on a different side of the phone from the e-ink screen. The phone can display prompts on the display screen for the owner to use. In some examples, such as... Figure 10 As shown, user 502 is an unauthorized user whose gaze is within an unauthorized viewing angle and whose gaze duration is greater than or equal to the fourth threshold. The phone can display an image on the screen containing the text "Someone is peeping." This helps to attract the owner's attention, allowing the owner to take measures to avoid being watched by others.

[0112] The aforementioned fourth threshold can be the same as the aforementioned first or second threshold, and this application embodiment does not limit this. It is understood that if the fourth threshold is the same as the aforementioned first or second threshold, the mobile phone can both send the image corresponding to the fourth threshold to the e-ink screen and display the image on the screen. This allows for both notification to unauthorized users and attention from the phone owner, enabling the owner to take measures to avoid being watched by others.

[0113] If the fourth threshold is the same as the third threshold mentioned above, then the mobile phone can provide a notification by ringing or vibrating, or by displaying a notification on the screen. These are two parallel implementation methods, and either method can be deployed on the mobile phone.

[0114] In other examples, the fourth threshold can be greater than the third threshold, meaning the cue intensity corresponding to the fourth threshold is greater than the cue intensity corresponding to the third threshold. In other words, it can be considered that the cue intensity of a display screen notification is greater than the cue intensity of a ringtone or vibration notification. Alternatively, the fourth threshold can be less than the third threshold, meaning the cue intensity corresponding to the fourth threshold is less than the cue intensity corresponding to the third threshold. In other words, it can be considered that the cue intensity of a display screen notification is less than the cue intensity of a ringtone or vibration notification.

[0115] The specific settings can be preset based on survey research, or users can set them according to their own needs; this application embodiment does not limit this. In this way, different thresholds correspond to different prompts, providing greater flexibility.

[0116] Optionally, to avoid affecting the user's normal use of the phone, the image may disappear after being displayed for a period of time, such as a few seconds. Alternatively, the phone may not display the image after detecting a user's triggering action on it, thereby reducing the impact on the user's normal phone use. The triggering action on the image may be a click, double-click, swipe up, swipe down, swipe right, or swipe left, etc., and this application embodiment does not limit the specific actions involved.

[0117] In other examples, such as Figure 11 As shown, user 502 is an unauthorized user whose gaze is within an unauthorized viewing angle and whose gaze duration is greater than or equal to the fourth threshold. The phone can display a notification on the screen to inform the owner that someone is spying on them. This effectively draws the owner's attention without interfering with normal use of the phone.

[0118] As can be seen from the above, the embodiments of this application involve a first threshold, a second threshold, a third threshold, and a fourth threshold. To avoid confusion, these thresholds will be further explained below.

[0119] The first and second thresholds are set to display different prompts depending on the duration of gaze. As mentioned above, when the second threshold is greater than the first threshold, the gaze duration exceeds the first threshold, and the phone displays the first prompt. If the gaze duration continues to increase and exceeds the second threshold, the phone displays the second prompt, which is different from the first prompt.

[0120] The third and fourth thresholds are set to determine when to remind the user. Reminding the user can be achieved in two ways: one is through a ringtone or vibration, and the other is through a display screen. Therefore, two thresholds are set to correspond to these two methods respectively. These two thresholds can be the same or different; this application does not limit this.

[0121] Furthermore, in this embodiment, the prompt sent by the mobile phone to the e-ink screen can also be related to the scene in which the mobile phone is located. For example, there may be a one-to-one or many-to-one relationship between the scene in which the mobile phone is located and the prompt. The mobile phone can identify the scene in which it is located and determine the prompt corresponding to the scene from the correspondence between the scene and the prompt, and then send the prompt to the e-ink screen.

[0122] For example, a mobile phone can detect one or more of the phone's acceleration and its geographical location, and determine the scene in which the phone is located based on one or more of the phone's acceleration and its geographical location.

[0123] For example, when the phone's acceleration meets condition A, the phone can determine that it is in a subway or bus scenario. Being in a subway or bus scenario can be understood as the phone being on a subway or bus. Acceleration condition A can include: the phone's horizontal acceleration being greater than or equal to an acceleration threshold 'a'. Alternatively,

[0124] When the phone's acceleration meets condition B, the phone can be determined to be in an elevator scenario. Being in an elevator scenario can be understood as the phone being on an elevator. Condition B for the phone's acceleration can include: the phone's vertical acceleration being greater than or equal to an acceleration threshold b. Alternatively,

[0125] If the phone's geographical location meets condition C, then the phone can be determined to be in a shopping mall setting. Being in a shopping mall setting can be understood as the phone being inside the mall. Meeting condition C can include: the phone's geographical location being within the shopping mall's geographical area. Alternatively,

[0126] If the phone's geographical location meets condition D, then the phone can be determined to be in an office setting. Being in an office setting can be understood as the phone being in an office. Meeting condition D can include the phone's geographical location being within the geographical area of ​​the office.

[0127] In some examples, if there is a one-to-one relationship between the context of the phone and the prompt, then the prompts will differ depending on the context. These differences can manifest as different prompt formats, or the same prompt format but different content.

[0128] For example, in a subway setting, the phone might send a notification via an image. In a shopping mall setting, it might send a notification via a ringtone or vibration. Alternatively, in both subway and shopping mall settings, the phone might send a notification via an image, but in the subway setting, the image might include the text "Please do not peek," while in the shopping mall setting, the image might include the text "Peeking is impolite."

[0129] In this way, different prompts are given for different scenarios, making it more flexible.

[0130] In other examples, if the scenario in which the phone is located and the prompt have a many-to-one relationship, then there may be some scenarios with the same prompt.

[0131] For example, in subways, buses, and elevators, the phone sends a notification via an image with the text "Please do not peek." In offices or shopping malls, the phone sends a notification via an image with the text "Peeking is impolite."

[0132] In this way, the prompts are the same for some scenarios, making implementation simple.

[0133] Optionally, the mobile phone can also store the correspondence between scenes, thresholds, and prompts. In a certain scene, when the gaze duration is greater than or equal to a certain threshold, the mobile phone can obtain the corresponding prompt and send the prompt to the e-ink screen.

[0134] For example, the correspondence between scenarios, thresholds, and prompts may include: a subway or bus scenario, threshold 1, corresponding to an image used for prompting that includes the message "Please do not peek"; a subway or bus scenario, threshold 2, corresponding to an image used for prompting that includes the message "Peeking is impolite"; and a subway or bus scenario, threshold 3, corresponding to an image used for prompting that includes the message "Peeking is impolite". Threshold 3 can be greater than threshold 2, and threshold 2 can be greater than threshold 1.

[0135] In subway or bus scenarios, if an unauthorized user's gaze falls within an unauthorized area and the gaze duration is greater than or equal to a threshold of 1, the phone acquires a corresponding image. This image may include the message "Please do not peek," as described above. Figure 6 As shown. Alternatively, in subway or bus scenarios, if an unauthorized user's gaze falls within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 2, the phone acquires a corresponding image, which may include the message "peeking is impolite," as mentioned above. Figure 7 As shown. In subway or bus scenarios, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 3, the phone acquires a corresponding image. This image may include the message "I'll call the police if you keep looking at me," as mentioned above. Figure 8 As shown.

[0136] For example, the correspondence between scenes, thresholds, and prompts may include: an elevator scene, threshold 4, corresponding to the image used for prompts containing "X1X1X1X1X1"; an elevator scene, threshold 5, corresponding to the image used for prompts containing "X2X2X2X2X2"; and an elevator scene, threshold 6, corresponding to the image used for prompts containing "X3X3X3X3X3". Threshold 6 can be greater than threshold 5, and threshold 5 can be greater than threshold 4.

[0137] In an elevator scenario, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 4, the phone acquires the corresponding image. This image may include "X1X1X1X1X1", as described above. Figure 12 As shown in 'a'. Alternatively, in an elevator scenario, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 5, the phone acquires the corresponding image, which may include "X2X2X2X2X2", as described above. Figure 12 As shown in b. In the elevator scenario, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 6, the phone acquires the corresponding image. This image may include "X3X3X3X3X3", as described above. Figure 12 As shown in c in the figure.

[0138] For example, the correspondence between scenes, thresholds, and prompts may include: an office scene, threshold 7, corresponding to the image used for prompts containing "Y1Y1Y1Y1Y1"; an office scene, threshold 8, corresponding to the image used for prompts containing "Y2Y2Y2Y2Y2"; and an office scene, threshold 9, corresponding to the image used for prompts containing "Y3Y3Y3Y3Y3". Threshold 9 can be greater than threshold 8, and threshold 8 can be greater than threshold 7.

[0139] In an office setting, if an unauthorized user's gaze falls within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 7, the phone acquires the corresponding image. This image may include "Y1Y1Y1Y1Y1", as described above. Figure 12 As shown in d. Alternatively, in an office setting, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to threshold 8, the phone acquires the corresponding image, which may include "Y2Y2Y2Y2Y2", as described above. Figure 12 As shown in 'e'. In an office setting, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to threshold 9, the phone acquires the corresponding image, which may include "Y3Y3Y3Y3Y3", as described above. Figure 12 As shown in f in the figure.

[0140] For example, the correspondence between scenes, thresholds, and prompts may include: a shopping mall scene, threshold 10, corresponding to the image used for prompts containing "Z1Z1Z1Z1Z1"; a shopping mall scene, threshold 11, corresponding to the image used for prompts containing "Z2Z2Z2Z2Z2"; and a shopping mall scene, threshold 12, corresponding to the image used for prompts containing "Z3Z3Z3Z3Z3". Threshold 12 may be greater than threshold 11, and threshold 11 may be greater than threshold 10.

[0141] In a shopping mall setting, if an unauthorized user's gaze falls within an unauthorized gaze range and the gaze duration is greater than or equal to a threshold of 10, the phone acquires the corresponding image. This image may include "Z1Z1Z1Z1Z1", as described above. Figure 12 As shown in g in the diagram. Alternatively, in a shopping mall scenario, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to the threshold 11, the phone acquires the corresponding image, which may include "Z2Z2Z2Z2Z2", as described above. Figure 12 As shown in h in the diagram. In a shopping mall scenario, if an unauthorized user's gaze is within an unauthorized gaze range and the gaze duration is greater than or equal to the threshold 12, the phone acquires the corresponding image, which may include "Z3Z3Z3Z3Z3", as described above. Figure 12 As shown in i in the diagram.

[0142] This allows for more flexible display of corresponding prompts under different scenarios and thresholds.

[0143] It should be noted that in the above examples, the content of the prompts corresponding to different thresholds in the same scene is different. In other examples, the content of the prompts corresponding to different thresholds in the same scene may be the same, but the visual presentation may be different. For example, the text content in the image may be the same, but the background color or the background pattern may be different, etc. This application embodiment does not limit this.

[0144] As can be seen from the above embodiments, the mobile phone can detect whether a user not authorized by the electronic device is looking at a field of view that is not permitted. The field of view that is not permitted is determined based on the user's possible location when holding the electronic device. In other scenarios, if there are people or objects other than the owner within the field of view that is not permitted, the mobile phone can use the above function to protect the privacy of other people or objects besides the owner.

[0145] For example, such as Figure 13 As shown, the unauthorized viewing angle includes the computer screen. If the mobile phone detects an unauthorized user whose viewing range is within the allowed viewing angle and whose viewing duration exceeds the first threshold, it indicates that the phone has detected someone staring at the computer screen for an extended period. The mobile phone can then display a prompt on the e-ink screen to alert the unauthorized user, which helps reduce the probability of information on the computer screen being leaked.

[0146] To better understand the embodiments of this application, the prompting method provided by the embodiments of this application is described below with reference to flowchart.

[0147] For example, Figure 14 This is a schematic flowchart illustrating a prompting method provided in an embodiment of this application. This method can be executed by an electronic device. Figure 14 As shown, the method may include the following steps:

[0148] S1401. The electronic device identifies whether a first user exists within the field of view of the camera. The first user is a user who has not been authorized by the electronic device. The first user can be determined by referring to the above. Figure 5 User 502.

[0149] Optionally, the electronic device identifies whether a first user exists within the field of view of the camera, including: acquiring an image within the field of view of the camera; and identifying whether a first user exists in the image.

[0150] S1402. If a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a first threshold, the electronic device sends a first prompt to the e-ink screen, wherein the e-ink screen and the camera are located on the same side of the electronic device, and the first prompt is used to prompt the first user.

[0151] The first tip can be found above. Figures 6 to 8 The images in the text will not be described further here.

[0152] The notification method provided in this application embodiment indicates that if an unauthorized user gazes at a field of view that is not allowed to be gazed at, and the gazing time exceeds a threshold, it means that people or objects within the unauthorized field of view may be being excessively focused on by irrelevant people. The electronic device notifies the unauthorized user through the e-ink screen, which is beneficial to protecting information security and privacy.

[0153] Optionally, the unpermitted viewing angle includes at least one of the user, a mobile phone, or a computer. The user is the owner or administrator of the electronic device. This allows for wider applicability and more diverse applications.

[0154] Optionally, the first threshold can be one of multiple thresholds, with each threshold corresponding to a specific prompt. The first prompt is the one among the multiple prompts that corresponds to the first threshold. By setting multiple thresholds, each corresponding to a prompt, the appropriate prompt can be displayed based on the duration of gaze, which is more conducive to protecting information security and privacy.

[0155] Optionally, the above method further includes: when a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a second threshold, sending a second prompt to the e-ink screen, the second prompt being used to prompt the first user, the second threshold being greater than the first threshold, and the content of the second prompt being different from the content of the first prompt.

[0156] In this way, different thresholds correspond to different prompts, and the corresponding prompts can be displayed according to different gaze durations, which is beneficial for prompting unauthorized users.

[0157] Optionally, the above method further includes: playing a ringtone or vibrating when a first user is present within the camera's field of view, the first user's gaze is within an unpermitted field of view, and the first user's gaze duration is greater than or equal to a third threshold. This method of using a ringtone or vibration to alert the user is beneficial in attracting their attention.

[0158] Optionally, the third threshold is greater than the second threshold. Thus, if an unauthorized user's gaze duration exceeds the second threshold, the electronic device can display a notification via the e-ink screen. When the unauthorized user's gaze duration is greater than or equal to the third threshold (which is greater than the second threshold), indicating an excessive gaze duration, the device owner can be alerted via a ringtone or vibration to take measures to avoid being stared at by others, thus protecting information security and privacy.

[0159] Optionally, the electronic device also includes a display screen, which is located on a different side of the electronic device from the e-ink screen; the method further includes: displaying a third prompt on the display screen when a first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a fourth threshold, the third prompt being used to indicate the presence of the first user.

[0160] The third tip can be found above. Figure 10 or Figure 11 The relationship between the fourth threshold and the first, second, and third thresholds mentioned above can be found in the above description and will not be repeated here.

[0161] In this way, displaying a third prompt on the screen helps to attract the owner's attention, so that the owner can take measures to avoid being watched by others.

[0162] Optionally, the method further includes: acquiring first information, the first information including one or more of the acceleration of the electronic device or the geographical location of the electronic device; sending a first prompt to the electronic ink screen, including: sending a first prompt to the electronic ink screen based on the first information.

[0163] Electronic devices can determine the first prompt to send to the e-ink screen based on one or more of the electronic device's acceleration or geographical location, which is beneficial for application in more scenarios.

[0164] Optionally, the first information satisfies the first condition, which is one of multiple conditions. The multiple conditions correspond to multiple prompts, and the first prompt is the prompt that corresponds to the first condition among the multiple prompts.

[0165] The electronic device can determine which of several conditions the first information satisfies. If the first information satisfies the first condition, the electronic device can obtain the first prompt corresponding to the first condition and send the first prompt to the e-ink screen. The first condition can refer to one or more of the above conditions A, B, C, or D, which will not be elaborated here.

[0166] This approach allows for displaying prompts corresponding to different conditions, offering greater flexibility compared to displaying the same prompt regardless of the conditions.

[0167] Optionally, sending a first prompt to the e-ink screen can be achieved by sending the first prompt to the e-ink screen via a wireless communication link. This makes it suitable for scenarios where the electronic device does not include an e-ink screen, thus broadening its application.

[0168] Optionally, identifying whether a first user exists in the image within the field of view of the camera includes: identifying first facial information in the image; and determining whether a first user exists in the image based on whether the first facial information includes facial information other than facial information stored in the electronic device.

[0169] In this way, recognizing whether the first user is present in the image within the camera's field of view through facial information helps identify unauthorized users.

[0170] In one embodiment, the electronic device of this application may include a handheld device with a camera and an in-vehicle device including a camera. For example, some electronic devices are: mobile phones, tablet computers, PDAs, laptops, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, cellular phones, cordless phones, session initiation protocol (SIP) phones, wireless local loop (WLL) stations, personal digital assistants (PDAs), handheld devices with cameras, computing devices or other processing devices including cameras, in-vehicle devices, and wearable devices. This application embodiment is not limited to these.

[0171] The electronic devices in the embodiments of this application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication equipment, user agent, or user device, etc.

[0172] To facilitate understanding of the embodiments of this application, the hardware structure of the electronic device provided in the embodiments of this application will be described below.

[0173] Figure 15 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application is shown. For example... Figure 15 As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, an indicator 191, a camera 192, and a display screen 193, etc.

[0174] Optionally, the aforementioned sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0175] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0176] Camera 192 may include one or more cameras, all of which can be used to capture images. Camera 192 may also be described as camera module 192, but this embodiment of the application does not limit it in this way.

[0177] In some examples, camera 192 may include a main camera, a telephoto camera, and an ultra-wide-angle camera. The main camera can capture images in 1x optical zoom mode. The telephoto camera can capture images in different telephoto modes. For example, the telephoto camera can capture images in 2x optical zoom mode, or in 4x optical zoom mode, or in 10x optical zoom mode. The ultra-wide-angle camera can capture images in ultra-wide-angle shooting mode.

[0178] In other examples, camera 192 may include a front-facing camera and a rear-facing camera. The front-facing camera may be a camera mounted on the front of the electronic device. The rear-facing camera may be a camera mounted on the back of the electronic device.

[0179] The display screen 193 can be an electronic ink screen, a liquid crystal display screen, or a light-emitting diode display screen; this application embodiment does not limit this.

[0180] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLAN) (such as Wi-Fi), Bluetooth, global navigation satellite system (GNSS), frequency modulation (FM), and other wireless communication technologies.

[0181] The processor 110 can execute the method provided in this application embodiment to acquire an image captured by the camera 192 and identify whether the image includes a user who is not authorized by the electronic device. If the image includes a user who is not authorized by the electronic device, and the user's gaze range is within the unauthorized viewing angle range, and the gaze duration exceeds a first threshold, a prompt is displayed on the e-ink screen to alert the user who is not authorized by the electronic device.

[0182] If the display screen 193 is an e-ink screen, the processor 110 can display a prompt on the display screen 193 to alert unauthorized users of the electronic device. If the display screen 193 is not an e-ink screen, the processor 110 can send a prompt to the e-ink screen via the wireless communication module 160 to alert unauthorized users of the electronic device through the e-ink screen.

[0183] The software systems of electronic devices can adopt layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. Layered architecture can employ... The system can also adopt The system can also be the Harmony OS, but this application does not limit this embodiment. The following uses the layered architecture of the Harmony OS as an example to illustrate the software structure of the electronic device.

[0184] For example, Figure 16 A schematic diagram of the software architecture of an electronic device according to an embodiment of this application is shown. Figure 16 As shown, the layered architecture divides the Harmony system into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Harmony system can be divided into four layers, from top to bottom: applications, application framework, system infrastructure services, and kernel.

[0185] The application layer may include applications such as camera applications, chat applications, and game applications. The application layer may also include a recognition command issuing module, a prompting decision module, and a communication module. The recognition command issuing module is used to issue commands for eye and face recognition, so as to identify whether there is an unauthorized user within the camera's field of view based on facial information and eye movement characteristics, and, if an unauthorized user is present, whether their gaze is within an unauthorized field of view. The commands for eye and face recognition can also be called image recognition commands, and this application embodiment does not limit this terminology.

[0186] The prompt decision module receives facial information and the duration of eye gaze within the unauthorized viewing area from the application framework layer. Based on the facial information, it determines whether an unauthorized user exists. If an unauthorized user is present, the module determines the specific content of the prompt based on the duration of their gaze within the unauthorized viewing area. The communication module communicates with the e-ink screen and sends prompts to it.

[0187] Understandable, Figure 16 Let's take an e-ink screen as an example, where the e-ink screen is a screen outside the electronic device. If the e-ink screen is a screen within the electronic device, the application layer may not include a communication module. The prompt decision module can transmit prompts through the application framework layer, system basic service layer, and kernel layer to the e-ink screen in the hardware layer, so that the prompts can be displayed on the e-ink screen.

[0188] The application framework layer provides Harmony system applications with multi-language user program frameworks and meta-capability frameworks in languages ​​such as Java, C, C++, and JavaScript, as well as multi-language application programming interfaces (APIs) for various software and hardware services. The application framework layer includes some predefined functions. For example... Figure 16 As shown, the application framework layer may include a context-aware module. This module can transmit eye and face recognition instructions from the application layer to the hardware layer via the system's basic service layer and kernel layer to control the low-power camera to capture images within its field of view. The context-aware module can also receive recognition results from the hardware layer via the system's basic service layer and kernel layer, and transmit these results to the application layer. The recognition results may include facial information in the image and the duration of eye fixation within the unauthorized gaze range.

[0189] The system's basic service layer is the core capability set of the Harmony system, enabling it to provide application services through the framework layer in multi-device deployment scenarios. For example... Figure 16 As shown, this layer may include a basic system capability subsystem, a basic software service subsystem, and an enhanced service software subsystem.

[0190] The Harmony system employs a multi-kernel design, allowing the kernel layer to include the Linux kernel, the Harmony microkernel, and LiteOS. This design enables devices with varying capabilities to select the appropriate system kernel.

[0191] The hardware layer can include a low-power camera and a low-power NPU chip. The low-power camera is a camera operating in low-power mode that can capture images within its field of view. The low-power NPU chip can acquire images captured by the low-power camera, identify facial information in the images and the duration of human eye fixation within the unauthorized gaze range, and transmit the recognition results to the application framework layer through the kernel layer and the system basic service layer.

[0192] It should be noted that the module names involved in the embodiments of this application can all be defined as other names, as long as they can achieve the function of each module, and no specific restrictions are placed on the module names.

[0193] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0194] The above description of the prompting method in the embodiments of this application is now followed by a description of the apparatus provided in the embodiments of this application for performing the above method. Those skilled in the art will understand that the methods and apparatus can be combined with and referenced in each other, and the related apparatus provided in the embodiments of this application can perform the steps in the above list sorting method.

[0195] Figure 17 This is a schematic diagram of a chip structure provided in an embodiment of this application. Figure 17 As shown, chip 170 includes one or more processors 1701, communication lines 1702, communication interfaces 1703, and memory 1704.

[0196] In some implementations, memory 1704 stores elements such as executable modules or data structures, or subsets thereof, or extended sets thereof.

[0197] The prompting method described in the embodiments of this application can be applied to, or implemented by, processor 1701. Processor 1701 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the prompting method can be completed by integrated logic circuits in the hardware of processor 1701 or by instructions in software form. Processor 1701 may be a general-purpose processor (e.g., a microprocessor or conventional processor), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gates, transistor logic devices, or discrete hardware components. Processor 1701 can implement or execute the processing-related methods, steps, and logic block diagrams disclosed in the embodiments of this application.

[0198] The steps of the prompting method disclosed in the embodiments of this application can be directly manifested as execution by a hardware decoding processor, or execution by a combination of hardware and software modules in the decoding processor. The software modules can be located in mature storage media in the art, such as random access memory, read-only memory, programmable read-only memory, or electrically erasable programmable read-only memory (EEPROM). This storage medium is located in memory 1704, and processor 1701 reads information from memory 1704 and, in conjunction with its hardware, completes the steps of the above method.

[0199] The processor 1701, memory 1704 and communication interface 1703 can communicate with each other via communication line 1702.

[0200] In the above embodiments, the instructions stored in the memory for execution by the processor can be implemented in the form of a computer program product. This computer program product can be pre-written into the memory, or it can be downloaded and installed into the memory as software.

[0201] The prompting method provided in this application can be applied to electronic devices. Electronic devices include terminal devices, and the specific device form of a terminal device can be referred to the above-described related features, which will not be repeated here.

[0202] This application provides a terminal device, which includes: one or more processors and a memory; the memory is coupled to one or more processors, and the memory is used to store computer program code, which includes computer instructions, and the one or more processors call the computer instructions to cause the terminal device to perform the above-described method.

[0203] This application provides a chip. The chip or chip system is applied to an electronic device and includes at least one or more processors. These processors invoke computer instructions to execute the technical solutions described in the above embodiments. Its implementation principle and technical effects are similar to the related embodiments described above, and will not be repeated here.

[0204] This application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program or instructions. When the computer program or instructions are executed by an electronic device, they implement the methods described above. The methods described in the above embodiments can be implemented wholly or partially by software, hardware, firmware, or any combination thereof. If implemented in software, the functionality can be stored as one or more instructions or code on or transmitted over the computer-readable medium. The computer-readable medium can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0205] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage or other magnetic storage devices, or any other medium targeted to carry or to store the required program code in the form of instructions or data structures, and accessible by a computer. Furthermore, any connection is appropriately referred to as a computer-readable medium. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. As used herein, disks and optical discs include optical discs, laser discs, optical discs, Digital Versatile Discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers. Combinations of the above should also be included within the scope of computer-readable media.

[0206] This application provides a computer program product, which includes a computer program. When the computer program code is run on an electronic device, the electronic device performs the above-described method.

[0207] This application describes embodiments of methods, apparatus (systems), and computer program products according to embodiments of this application with reference to flowchart illustrations and / or block diagrams. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, special-purpose computer, embedded processor, or other programmable device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable data processing device, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0208] The above specific embodiments further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above are merely specific embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of the present invention should be included within the scope of protection of the present invention.

Claims

1. A prompting method, characterized in that, Applied to an electronic device including a camera, the method includes: The system identifies whether a first user exists within the field of view of the camera, wherein the first user is a user who has not been authorized by the electronic device. If the first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a first threshold, a first prompt is sent to the e-ink screen, wherein the e-ink screen and the camera are located on the same side of the electronic device, and the first prompt is used to prompt the first user.

2. The method according to claim 1, characterized in that, The first threshold is one of a plurality of thresholds, and the plurality of thresholds correspond one-to-one with a plurality of prompts. The first prompt is the prompt among the plurality of prompts that corresponds to the first threshold.

3. The method according to claim 1 or 2, characterized in that, The method further includes: If the first user is present within the field of view of the camera, the first user's gaze is within an unpermitted field of view, and the first user's gaze duration is greater than or equal to a second threshold, a second prompt is sent to the e-ink screen. The second prompt is used to prompt the first user, the second threshold is greater than the first threshold, and the content of the second prompt is different from the content of the first prompt.

4. The method according to any one of claims 1 to 3, characterized in that, The method further includes: If the first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a third threshold, then a ringtone or vibration is played.

5. The method according to any one of claims 1 to 4, characterized in that, The electronic device also includes a display screen, which is located on a different side of the electronic device from the e-ink screen; The method further includes: If the first user is present within the field of view of the camera, the first user's gaze is within a field of view that is not allowed to be gazed at, and the first user's gaze duration is greater than or equal to a fourth threshold, a third prompt will be displayed on the screen to indicate the presence of the first user.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Obtain first information, which includes one or more of the electronic device's acceleration or the electronic device's geographical location; Sending the first prompt to the e-ink screen includes: Based on the first information, the first prompt is sent to the e-ink screen.

7. The method according to claim 6, characterized in that, The first information satisfies a first condition, which is one of multiple conditions. The multiple conditions correspond to multiple prompts, and the first prompt is the prompt among the multiple prompts that corresponds to the first condition.

8. The method according to any one of claims 1 to 7, characterized in that, Sending the first prompt to the e-ink screen includes: The first prompt is sent to the e-ink screen via a wireless communication link.

9. The method according to any one of claims 1 to 8, characterized in that, The step of identifying whether a first user exists within the field of view of the camera includes: Acquire images within the field of view of the camera; Identify whether the first user is present in the image.

10. The method according to claim 9, characterized in that, The step of identifying whether the first user exists in the image includes: Identify the first facial information in the image; The presence of the first user in the image is determined based on whether the first facial information includes facial information other than that stored in the electronic device.

11. An electronic device, characterized in that, The electronic device includes: one or more processors, memory, and a camera; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-10.

12. A chip, characterized in that, The chip is applied to an electronic device, the chip including one or more processors, the one or more processors being configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-10.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1-10.

14. A computer program product, characterized in that, The computer program product includes computer program code that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1-10.

Images