Terminal control method, device, terminal and storage medium

Abstract

The present disclosure proposes a terminal control method, device, terminal and storage medium, the method comprising: when determining that the terminal has a call function turned on, obtaining a scene image of the terminal, determining that an ear-touching event has occurred in the terminal according to the scene image, and then controlling the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen. Through the present disclosure, since the scene image when the terminal turns on the call function is combined to determine whether the terminal has an ear-touching event, the accuracy and convenience of the ear-touching event determination can be effectively improved, and the application scenarios of the ear-touching event determination can be effectively expanded. When the ear-touching event occurs in the terminal, the terminal is controlled to be in a state where the touch operation of the display screen can be shielded, which can more accurately avoid the terminal from being triggered by a false triggering operation during the ear-touching call, ensure the stability of the terminal ear-touching call effect, and improve the terminal call control effect.

Description

Technical Field

[0001] The present disclosure relates to the field of terminal technology, and in particular to a terminal control method, device, terminal and storage medium. Background Art

[0002] When using the terminal, users are accustomed to putting the terminal close to their ears when talking on a call. When the terminal is in a state that can respond to touch operations on the display screen, it is easy for the user's ear to touch the display screen, causing an erroneous triggering operation on the terminal.

[0003] In the related art, the determination of whether the terminal has an ear-to-ear event is not accurate enough, not convenient enough, and the application effect is poor, which affects the effect of the terminal's ear-to-ear call.

[0004] Public Content

[0005] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0006] To this end, the purpose of the present disclosure is to propose a terminal control method, device, terminal, storage medium and computer program product. Since the terminal is combined with the scene image when the call function is turned on to determine whether an ear-to-ear event occurs, the accuracy and convenience of the ear-to-ear event determination can be effectively improved, and the application scenarios of the ear-to-ear event determination can be effectively expanded. When an ear-to-ear event occurs at the terminal, the terminal is controlled to be in a state where the touch operation of the display screen can be shielded, which can more accurately avoid false triggering operations on the terminal during the ear-to-ear call, ensure the stability of the terminal's ear-to-ear call effect, and improve the terminal call control effect.

[0007] The terminal control method proposed in the embodiment of the first aspect of the present disclosure includes: when determining that the terminal has a call function turned on, obtaining a scene image of the terminal; determining, based on the scene image, that an ear-touching event occurs in the terminal; and controlling the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen.

[0008] A terminal control method proposed in an embodiment of the first aspect of the present disclosure obtains a scene image of the terminal when determining that the terminal has a call function turned on, determines that an ear-touching event has occurred in the terminal based on the scene image, and then controls the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen. Since whether an ear-touching event has occurred in the terminal is determined in combination with the scene image when the call function is turned on, the accuracy and convenience of the ear-touching event determination can be effectively improved, and the application scenarios of the ear-touching event determination can be effectively expanded. When an ear-touching event occurs in the terminal, the terminal is controlled to be in a state where the touch operation of the display screen can be shielded, which can more accurately avoid erroneous triggering operations on the terminal during the ear-touching call, ensure the stability of the ear-touching call effect of the terminal, and improve the call control effect of the terminal.

[0009] The terminal control device proposed in the second aspect of the embodiment of the present disclosure includes: a first acquisition module, used to acquire a scene image of the terminal when it is determined that the terminal has a call function turned on; a determination module, used to determine, based on the scene image, that an ear-touching event has occurred in the terminal; and a control module, used to control the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen.

[0010] The terminal control device proposed in the second aspect of the embodiment of the present disclosure obtains a scene image of the terminal when determining that the terminal has a call function turned on, determines that an ear-touching event has occurred in the terminal based on the scene image, and then controls the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen. Since whether an ear-touching event has occurred in the terminal is determined in combination with the scene image when the call function is turned on, the accuracy and convenience of the ear-touching event determination can be effectively improved, and the application scenarios of the ear-touching event determination can be effectively expanded. When the ear-touching event occurs in the terminal, the terminal is controlled to be in a state where the touch operation of the display screen can be shielded, which can more accurately avoid erroneous triggering operations on the terminal during the ear-touching call, ensure the stability of the ear-touching call effect of the terminal, and improve the call control effect of the terminal.

[0011] The third aspect of the present disclosure provides a terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the terminal control method provided in the first aspect of the present disclosure is implemented.

[0012] The fourth aspect embodiment of the present disclosure proposes a non-temporary computer-readable storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the terminal control method proposed in the first aspect embodiment of the present disclosure.

[0013] The fifth aspect embodiment of the present disclosure proposes a computer program product, including a computer program. When the instruction processor in the computer program product executes, it executes the terminal control method proposed in the first aspect embodiment of the present disclosure.

[0014] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description or learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0016] Figure 1 is a flowchart of a terminal control method proposed in an embodiment of the present disclosure;

[0017] Figure 2is a flowchart of a terminal control method proposed in another embodiment of the present disclosure;

[0018] Figure 3 is a flowchart of a terminal control method proposed in another embodiment of the present disclosure;

[0019] Figure 4 is a flowchart of a terminal control method proposed in another embodiment of the present disclosure;

[0020] Figure 5 is a schematic diagram of a process for processing terminal-related data in an embodiment of the present disclosure;

[0021] Figure 6 is a schematic diagram of the structure of a terminal control device proposed in an embodiment of the present disclosure;

[0022] Figure 7 is a schematic diagram of the structure of a terminal control device proposed in another embodiment of the present disclosure;

[0023] Figure 8 A block diagram of an exemplary terminal suitable for implementing the embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0024] Embodiments of the present disclosure are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present disclosure, and are not to be construed as limitations of the present disclosure. On the contrary, the embodiments of the present disclosure include all changes, modifications, and equivalents that fall within the spirit and connotation of the appended claims.

[0025] Figure 1 It is a flowchart of a terminal control method proposed in an embodiment of the present disclosure.

[0026] It should be noted that the execution subject of the terminal control method of this embodiment is a terminal control device, which can be implemented by software and / or hardware, and can be configured in a terminal, without limitation.

[0027] The application scenarios of the embodiments of the present disclosure include but are not limited to call scenarios. For example, scenarios in which a user listens to voice information, plays audio and video, etc. are all applicable to the terminal control method and are not limited to this.

[0028] like Figure 1 As shown, the terminal control method includes:

[0029] S101: When it is determined that the call function of the terminal is turned on, a scene image of the terminal is obtained.

[0030] The call function refers to a function for voice / video communication between a terminal and other devices. The call function may be a call function preset for the terminal, or may be a call function in a real-time communication application installed in the terminal. There is no restriction on this.

[0031] Among them, the terminal control method in the embodiment of the present disclosure is applicable to the terminal on the call initiating side, and can also be applied to the terminal on the call receiving side, without any limitation.

[0032] Among them, the scene image can be obtained by the camera device of the terminal. The data information in the scene image can reflect the distance between the user's ear and the terminal, the user's ear characteristics and other related information to a certain extent. The proportion of the ear in the scene image is correlated with the above distance. By analyzing the size of the ear proportion in the scene image, or analyzing any other possible characteristics of the ear, it is determined whether an ear-sticking event occurs.

[0033] It is understandable that when the user puts the terminal close to the ear, the scene image of the terminal may carry different information compared to the scene image when it is not close to the ear. Therefore, in the embodiments of the present disclosure, the scene image of the terminal can be captured in real time or at preset intervals, and a determination can be made based on the scene image whether the terminal is close to the ear during a call. Please refer to the subsequent steps for details.

[0034] S102: Determine, based on the scene image, that an ear-touching event occurs on the terminal.

[0035] Among them, the ear-touching event is an event in which the terminal display screen touches the user's ear.

[0036] It is understandable that when the call function is turned on the terminal and the terminal is in a state that can respond to touch operations on the display screen, if an ear-touching event occurs, it is easy to cause false triggering operations on the terminal, affecting the stability of the call effect. Therefore, based on the scene image when the call function is turned on, the embodiment of the present disclosure can take corresponding countermeasures in time to ensure the stability of the call effect when it is determined that an ear-touching event occurs in the terminal.

[0037] In the disclosed embodiment, the occurrence of the ear-touching event at the terminal is determined based on the scene image. The scene image may be input into a pre-trained ear-touching event determination model (the ear-touching event determination model may be obtained in advance based on an artificial intelligence training method) to determine the occurrence of the ear-touching event at the terminal. Alternatively, the scene image may be compared with a scene image in the ear-touching event for similarity, and whether the ear-touching event occurs at the terminal may be determined based on the comparison result. There is no limitation on this.

[0038] S103: Control the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen.

[0039] The touch operation may be generated by a user's body part or other object touching the terminal screen, and the terminal may trigger a related touch screen function in response to an instruction generated by the touch operation.

[0040] The first state indicates that the terminal can shield the touch operation of the display screen.

[0041] When the control terminal is in the first state, the disclosed embodiment can control the terminal to turn off the screen, or intercept the instructions generated by the touch operation to avoid triggering the touch screen function related to the terminal according to the touch operation, and there is no limitation on this.

[0042] That is to say, when it is determined that the terminal has an ear-touching event, the embodiment of the present disclosure can control the terminal to be in the first state, so that the terminal shields the touch operation of the display screen, thereby effectively avoiding erroneous operation of the terminal caused by the contact between the user's ear and the terminal display screen during the call, thereby ensuring the call quality and call stability.

[0043] In the embodiment of the present disclosure, by acquiring a scene image of the terminal when determining that the terminal has turned on a call function, determining that an ear-touching event has occurred in the terminal based on the scene image, and then controlling the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen. Since whether an ear-touching event has occurred in the terminal is determined in combination with the scene image when the call function is turned on, the accuracy and convenience of the ear-touching event determination can be effectively improved, and the application scenarios of the ear-touching event determination can be effectively expanded. When an ear-touching event occurs in the terminal, the terminal is controlled to be in a state where the touch operation of the display screen can be shielded, which can more accurately avoid false triggering operations on the terminal during the ear-touching call, ensure the stability of the ear-touching call effect of the terminal, and improve the call control effect of the terminal.

[0044] Figure 2 It is a flowchart of a terminal control method proposed in another embodiment of the present disclosure.

[0045] like Figure 2 As shown, the terminal control method includes:

[0046] S201: When it is determined that the call function of the terminal is turned on, a scene image of the terminal is obtained.

[0047] The description of S201 can be specifically referred to the above embodiment, which will not be repeated here.

[0048] S202: Determine ear image features according to the scene image.

[0049] The ear image feature refers to feature information about the ear in the scene image acquired by the terminal camera device. The ear image feature may be specific information such as shape, size, depth, etc., and there is no limitation on this.

[0050] In the disclosed embodiments, the ear image features are determined based on the scene image. The obtained scene image can be input into a pre-trained ear image feature detection model to obtain the ear image features. Alternatively, an engineering method can be used to determine the ear image features based on the scene image. There is no limitation to this.

[0051] S203: Determine, based on the ear image features, that an ear-touching event occurs on the terminal.

[0052] In some other embodiments, the ear image features may also be processed in combination with any other possible detection and determination method to determine whether an ear-touching event occurs at the terminal. For example, a reference ear image feature of an ear-touching event may be compared with an ear image feature determined based on a scene image for confidence comparison analysis. Alternatively, feature threshold matching may be performed on the ear image features based on threshold matching to determine whether an ear-touching event occurs at the terminal. There is no limitation on this.

[0053] In the embodiments of the present disclosure, the relative position information between the ear and the terminal can be determined according to the ear image features, and whether the terminal has an ear contact event can be determined based on the relative position information. For details, please refer to the subsequent embodiments.

[0054] Therefore, after acquiring the scene image of the terminal, the embodiment of the present disclosure can determine the ear image features according to the scene image, and then determine that an ear-touching event has occurred at the terminal according to the ear image features. Therefore, when analyzing whether an ear-touching event has occurred at the terminal based on the ear image features identified from the scene image, the accuracy of the detection and judgment can be effectively improved. In addition, the ear image features can accurately characterize the interaction between the terminal and the ear in the call scenario. Therefore, when determining whether an ear-touching event has occurred based on the ear image features analyzed from the scene image, it is possible to avoid relying on the detection sensors provided in the terminal, and the rationality, convenience and effect of the detection and judgment of the ear-touching event at the terminal can be effectively improved.

[0055] S204: Control the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen.

[0056] The description of S204 can be specifically referred to the above embodiment, which will not be repeated here.

[0057] S205: Determine, based on the scene image, that no ear-touching event occurs on the terminal.

[0058] It is understandable that, during a call, the terminal may not have an ear-to-ear event, or the user may stop the ear-to-ear call process due to personal needs.

[0059] In the disclosed embodiments, determining that the terminal has not had an ear-touching event based on the scene image may be by determining ear image features based on the scene image, and then determining that the terminal has not had an ear-touching event based on the ear image features. Alternatively, determining that the terminal has not had an ear-touching event may be based on the scene image in any other possible manner, such as an artificial intelligence model manner, a threshold detection and determination manner, etc., without limitation thereto.

[0060] S206: Control the terminal to be in a second state, wherein the second state indicates that the terminal can respond to a touch operation of the display screen.

[0061] Among them, the second state indicates that the terminal can respond to the touch operation of the display screen. When the control terminal is in the second state, the embodiment of the present disclosure can be to light up the screen of the control terminal, or to release the interception of the instructions generated by the touch operation, and there is no limitation on this.

[0062] That is to say, when it is determined based on the scene image that no ear-touching event has occurred at the terminal, the embodiment of the present disclosure can control the terminal to be in the second state, so that the terminal can respond to the touch operation of the display screen. Thus, the terminal can be controlled to be in different states according to the actual situation of whether an ear-touching event has occurred at the terminal determined by the scene image, thereby effectively improving the applicability and flexibility of the terminal control method and ensuring the ear-touching call effect and stability.

[0063] In the embodiment of the present disclosure, when determining that the terminal turns on the call function, the scene image of the terminal is obtained, the ear image features are determined according to the scene image, and the terminal is determined to have an ear-touching event according to the ear image features, and the terminal is controlled to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen, and according to the scene image, it is determined that the terminal has not had an ear-touching event, and the terminal is controlled to be in a second state, wherein the second state indicates that the terminal can respond to the touch operation of the display screen, thereby, the terminal can be controlled to be in different states according to the actual situation of whether the terminal has an ear-touching event determined by the scene image, effectively improving the applicability and flexibility of the terminal control method, and ensuring the ear-touching call effect and stability. When analyzing whether the terminal has an ear-touching event based on the ear image features identified from the scene image, the accuracy of the detection and judgment can be effectively improved, and the ear image features can accurately characterize the interaction between the terminal and the ear in the call scene, so that when determining whether the ear-touching event has occurred based on the ear image features analyzed from the scene image, it is avoided to rely on the detection sensor set in the terminal, and the detection and judgment rationality, convenience and detection and judgment effect of the ear-touching event of the terminal can be effectively improved.

[0064] Figure 3 It is a flowchart of a terminal control method proposed in another embodiment of the present disclosure.

[0065] like Figure 3 As shown, the terminal control method includes:

[0066] S301: When it is determined that the call function of the terminal is turned on, multiple frames of scene images and acceleration data of the terminal are obtained.

[0067] It is understandable that the embodiments of the present disclosure can obtain multiple frames of image scenes according to multiple pre-configured acquisition time points when determining that the terminal has turned on the call function, so as to facilitate the analysis of changes in ear image features carried in the scene image during the call.

[0068] Among them, the acceleration data can, to a certain extent, map the motion state of the terminal when receiving a call request, and the motion state can be subsequently used to assist in determining whether an ear contact event occurs.

[0069] In the disclosed embodiment, the acceleration data of the terminal may be acquired through an acceleration sensor pre-configured in the terminal, or a third-party acceleration detection device may be used to detect the terminal and transmit the detected acceleration data to the terminal, and there is no limitation on this.

[0070] S302: Determine an initial probability value according to the acceleration data.

[0071] Among them, the initial probability value can be used to describe the probability of the terminal moving in parallel. It can be understood that if an ear-touching event occurs, a period of parallel movement may be generated when the terminal is close to the ear. Therefore, the embodiment of the present disclosure can predict the probability of a period of parallel movement generated when the terminal is close to the ear, thereby realizing the detection and determination of the probability of the ear-touching event.

[0072] Optionally, in some embodiments, the initial probability value is determined based on the acceleration data. The acceleration data can be analyzed to obtain multiple acceleration features corresponding to multiple coordinate axes, which constitute a world coordinate system. The multiple acceleration features are then input into a probability analysis model to obtain an initial probability value output by the probability analysis model. Therefore, when the initial probability value is determined by combining multiple acceleration features and the probability analysis model, the accuracy of the obtained initial probability value in characterizing the probability of the terminal performing parallel motion can be effectively improved.

[0073] Of course, in some embodiments, a preconfigured relationship table can be used to record the probability values ​​applicable to the acceleration data, and the probability values ​​applicable to the acceleration data in the relationship table can be used as the initial probability values. Alternatively, a third-party processing device (the third-party processing device can be, for example, a big data processing server) can be used to assist in the implementation, that is, the obtained acceleration data is input into the third-party processing device to obtain the initial probability value, and there is no limitation to this.

[0074] That is to say, when determining that the terminal has turned on the call function, the embodiment of the present disclosure can obtain the acceleration data of the terminal, and determine the initial probability value based on the acceleration data. Thereby, the obtained initial probability value can accurately characterize the probability of the terminal moving in parallel from the dimension of the acceleration data, which can effectively improve the rationality of the judgment logic and support the subsequent corresponding processing of the initial probability value to analyze whether an ear-touching event occurs in the terminal.

[0075] S303: Respectively identify multiple frames of scene images to obtain corresponding multiple ear morphological features.

[0076] Among them, the ear morphology feature may refer to a feature related to the ear morphology in the obtained multiple frames of scene images. The feature may be an area feature, a color feature, an angle feature, etc., and there is no limitation on this.

[0077] In the embodiments of the present disclosure, multiple frames of scene images are identified separately to obtain multiple corresponding ear morphological features. For example, multiple frames of scene images can be identified separately to obtain multiple corresponding ear clarity features, and the multiple ear clarity features can be used as multiple ear features. Alternatively, multiple frames of scene images can be identified separately to obtain multiple corresponding ear angle features, and the multiple ear angle features can be used as multiple ear features. There is no limitation to this.

[0078] S304: Determine feature change information between different ear morphological features, wherein the feature change information describes changes in the ear morphological features corresponding to different acquisition time points from far to near.

[0079] The acquisition time point refers to the time point corresponding to when the terminal camera device acquires each frame of scene image.

[0080] In the disclosed embodiment, feature change information is obtained by analyzing the ear morphological features corresponding to different acquisition time points from far to near. The feature change information can reflect to a certain extent the changing trend of the interaction between the terminal and the ear during this period, thereby determining whether the terminal will have an ear-sticking event. For details, please refer to the subsequent steps.

[0081] In the disclosed embodiments, multiple frames of scene images are identified separately to obtain multiple corresponding ear morphological features. For example, multiple frames of scene images can be identified separately to obtain multiple corresponding ear clarity features, and the multiple ear clarity features are respectively used as multiple ear features, wherein the feature change information describes the clarity change of the ear clarity features corresponding to different acquisition time points from far to near. Alternatively, multiple frames of scene images can be identified separately to obtain multiple corresponding ear angle features, and the multiple ear angle features are respectively used as multiple ear features, wherein the feature change information describes the angle change of the ear angle features corresponding to different acquisition time points from far to near, and there is no limitation to this.

[0082] S305: Using the feature change information as ear image features.

[0083] In the disclosed embodiment, by using feature change information as ear image features, the ear image features can reflect the changing trend of the interaction between the terminal and the ear to a certain extent, thereby effectively improving the correlation between the ear image features and the detection and judgment of ear-touching events, and effectively ensuring the detection and judgment effect of whether the terminal has an ear-touching event.

[0084] That is to say, after determining the initial probability value based on the acceleration data, the embodiment of the present disclosure can separately identify multiple frames of scene images to obtain corresponding multiple ear morphological features, and determine the feature change information between different ear morphological features, wherein the feature change information describes the change of the ear morphological features corresponding to different acquisition time points from far to near, and the feature change information is used as the ear image feature. Therefore, when the corresponding multiple ear morphological features are obtained based on the multiple frames of scene images, the feature change information between different ear morphological features obtained can effectively characterize the changing trend of the interaction between the terminal and the ear after the call function is turned on. When the feature change information is used as the ear image feature, the correlation between the ear image feature and the detection and judgment of the ear-touching event can be effectively improved, thereby effectively improving the detection and judgment effect of whether the terminal has a ear-touching event.

[0085] S306: Processing the initial probability value according to the ear image features to obtain a target probability value.

[0086] Among them, the value obtained by processing the initial probability value with relevant data information (such as ear image features, touch information, etc.), which is used to characterize the probability of the terminal being close to the ear from both acceleration data and scene images, can be called the target probability value.

[0087] In the disclosed embodiments, the initial probability value is processed according to the ear image features to obtain the target probability value. For example, the ear image features and the initial probability value can be input into a pre-trained processing model (the processing model can be obtained in advance based on an artificial intelligence training method) to obtain the target probability value. Alternatively, the ear image features can be analyzed and processed to obtain a probability value, and then the obtained probability value and the initial probability value are weighted to obtain the target probability value. There is no limitation to this.

[0088] Optionally, in some embodiments, when it is determined that the terminal has turned on the call function, the touch data of the terminal can be obtained, and the contact part type can be obtained based on the touch data. If the contact part type is an ear type, it is determined that an ear-touching event has occurred in the terminal, and the terminal is controlled to be in a first state. Thus, when the contact part type determined based on the touch data is an ear type, it can be directly determined that an ear-touching event has occurred in the terminal, which can effectively improve the accuracy of the determination, and greatly improve the determination efficiency, improve the terminal response speed, and avoid the determination logic from introducing delays in the terminal response.

[0089] The touch data may come from the terminal display screen, and the touch data may refer to the shape, area, and other related data of the user's touch area sensed by the terminal display screen, and there is no limitation on this.

[0090] It is understandable that the shape characteristics of the user's ear are significantly different from other parts of the human body, so when the touch data meets the ear characteristics, it can be quickly determined that the target event has occurred in the terminal.

[0091] Among them, contact refers to the contact operation between the user's body part detected by the terminal and the terminal display screen after the terminal turns on the call function, and the contact part type refers to the type of body part of the user that contacts the terminal display screen, such as fingers, ears, etc., and there is no restriction on this.

[0092] It is understandable that when different parts of the human body touch the terminal display screen, the touch data may be different due to the different contact parts. In the embodiment of the present disclosure, analysis and processing can be performed based on the touch data, such as the shape data and area data of the touched part, to determine the type of contact part, and assist in subsequent judgment of whether the terminal has an ear-touching event.

[0093] Optionally, in some embodiments, when the contact part type is not the ear type, the initial probability value can be reduced to obtain a target probability value. Thus, when the contact part type is not the ear type, the initial probability value can be processed based on the similarity between the contact part type and the ear type, so that the obtained target probability value can characterize the probability of an ear-touching event occurring in the terminal by combining acceleration data and touch data, which can effectively improve the flexibility of obtaining the target probability value, and when analyzing whether an ear-touching event occurs based on the target probability value, it can have a more accurate detection and judgment effect.

[0094] S307: If the target probability value is greater than or equal to the probability threshold, it is determined that an ear-to-ear event occurs in the terminal, and the terminal is controlled to be in the first state.

[0095] Among them, the probability threshold refers to a threshold value set within the target probability value range and used to indicate the probability of a parallel motion generated when the terminal occurs an ear-to-ear event. The probability threshold can be based on big data statistics of the parallel motion characteristics of the terminal's ear-to-ear event and feature analysis, or it can be pre-configured according to user instructions, and there is no restriction on this.

[0096] In an embodiment of the present disclosure, when the obtained target probability value is greater than or equal to the probability threshold, it indicates that there is a high probability that the terminal will experience an ear-to-ear event. At this time, it is determined that the terminal has experienced an ear-to-ear event, and the terminal is controlled to be in the first state, which can effectively prevent the terminal from responding to an erroneous operation due to an erroneous touch.

[0097] S308: If the target probability value is less than the probability threshold, it is determined that no ear-to-ear event occurs in the terminal, and the terminal is controlled to be in the second state.

[0098] In an embodiment of the present disclosure, when the target probability value is less than the probability threshold, it indicates that there is a high probability that the terminal has not experienced the ear-touching event. At this time, it is determined that the terminal has not experienced the ear-touching event, and the terminal is controlled to be in the second state, which can ensure the normal use of the touch function of the terminal display.

[0099] That is to say, after obtaining the ear image feature, the embodiment of the present disclosure can process the initial probability value according to the ear image feature to obtain the target probability value. If the target probability value is greater than or equal to the probability threshold, it is determined that an ear-touching event has occurred at the terminal. If the target probability value is less than the probability threshold, it is determined that no ear-touching event has occurred at the terminal. Therefore, when the initial probability value is processed according to the ear image feature, the obtained target probability value can be used to characterize the probability of the terminal's ear-touching event occurring from both the acceleration data and the scene image. Then, by comparing the obtained target probability value with the probability threshold to determine whether the terminal has an ear-touching event, the subsequent steps are triggered, thereby effectively improving the rationality and accuracy of determining whether an ear-touching event has occurred at the terminal in the terminal control method, and effectively improving the applicability and reliability of the terminal control method.

[0100] In the implementation of the present disclosure, by obtaining the acceleration data of the terminal when determining that the terminal turns on the call function, and determining the initial probability value based on the acceleration data, the obtained initial probability value can accurately characterize the probability of the terminal moving in parallel from the dimension of the acceleration data, which can effectively improve the rationality of the judgment logic and support the subsequent corresponding processing of the initial probability value to analyze whether the terminal has an ear-touching event. When the initial probability value is determined by combining multiple acceleration features and a probability analysis model, the accuracy of the characterization of the probability of the terminal moving in parallel by the obtained initial probability value can be effectively improved. When the corresponding multiple ear morphological features are obtained based on multiple frames of scene images, the feature change information between the different ear morphological features can effectively characterize the changing trend of the interaction between the terminal and the ear after the call function is turned on. When the feature change information is used as the ear image feature, the correlation between the ear image feature and the detection and judgment of the ear-touching event can be effectively improved, thereby effectively improving the detection and judgment effect of whether the terminal has an ear-touching event. When the initial probability value is processed according to the ear image feature, the obtained target probability value can be used to characterize the probability of the terminal having an ear-sticking event from the two aspects of acceleration data and scene image, and then the obtained target probability value is compared with the probability threshold to determine whether the terminal has an ear-sticking event, thereby triggering the subsequent steps, effectively improving the rationality and accuracy of the terminal control method in determining whether the terminal has an ear-sticking event, and effectively improving the applicability and reliability of the terminal control method. When the contact part type determined based on the touch data is an ear type, it can be directly determined that the terminal has an ear-sticking event, which can effectively improve the accuracy of the determination, and greatly improve the determination efficiency, improve the terminal response speed, and avoid the determination logic from bringing delays to the terminal response. When the contact part type is not an ear type, the initial probability value can be processed based on the similarity between the contact part type and the ear type, so that the obtained target probability value can be combined with the acceleration data and the touch data to characterize the probability of the terminal having an ear-sticking event, which can effectively improve the flexibility of obtaining the target probability value, and when analyzing whether the ear-sticking event occurs based on the target probability value, it can have a more accurate detection and determination effect.

[0101] Figure 4 It is a flowchart of a terminal control method proposed in another embodiment of the present disclosure.

[0102] like Figure 4 As shown, the terminal control method includes:

[0103] S401: When it is determined that the call function of the terminal is turned on, the scene image and acceleration data of the terminal are obtained.

[0104] S402: Determine an initial probability value according to the acceleration data.

[0105] The description of S401 - S402 can be specifically referred to the above embodiment, which will not be repeated here.

[0106] S403: Respectively identify multiple frames of scene images to obtain corresponding multiple ear area features.

[0107] The ear area feature refers to the quantitative feature (such as area size, proportion, etc.) of the area occupied by the ear in a single image scene in multiple frames of scene images.

[0108] Optionally, in some embodiments, after obtaining multiple corresponding ear area features, if the ear area feature corresponding to the collection time point closest to the current time point is less than or equal to the area threshold, the initial probability value is increased according to the target ear area feature to obtain the target probability value. Thus, when the ear area feature corresponding to the collection time point closest to the current time point is less than or equal to the area threshold, it indicates that the distance between the terminal and the ear is relatively far, and there is a high probability that the terminal has not had an ear-touching event. At this time, increasing the initial probability value according to the target ear area feature can greatly improve the accuracy of the obtained target probability value in representing the ear-touching event occurring at the terminal.

[0109] The area threshold refers to a threshold value set within the value range of the ear area feature and used to process the initial probability value in combination with the ear area corresponding to the most recent acquisition time point.

[0110] Optionally, in some embodiments, after obtaining the corresponding multiple ear area features, if the ear area feature corresponding to the collection time point closest to the current time point is greater than the area threshold, it is determined that the terminal has an ear-touching event. Thus, when the ear area feature corresponding to the collection time point closest to the current time point is greater than the area threshold, it indicates that the distance between the terminal and the ear is relatively close. At this time, there is a high probability that an ear-touching event has occurred at the terminal. It can be directly determined that the ear-touching event has occurred at the terminal, thereby promptly triggering subsequent steps and controlling the terminal to be in the first state, thereby avoiding false triggering operations on the terminal during ear-touching calls, and greatly improving the execution efficiency of the terminal control method.

[0111] For example, the area threshold is pre-set to 0.8. If the ear area corresponding to the closest collection time point to the current time point is 0.5, the ear area 0.5 can be subtracted from the area threshold 0.8, and then the initial probability value can be adaptively increased according to the obtained difference size 0.3 to obtain the target probability value; when the ear area corresponding to the closest collection time point to the current time point is 0.9, it can be directly determined that the terminal has an ear-touching event.

[0112] S404: Using the plurality of ear area features as a plurality of ear morphological features respectively.

[0113] It is understandable that the distance between the terminal and the user's ear is correlated with the ear area features in multiple scene images. Therefore, the multiple ear area features can be used as multiple ear morphological features to assist in analyzing whether the terminal is close to the ear.

[0114] That is to say, after determining the initial probability value according to the acceleration data, the embodiment of the present disclosure can respectively identify multiple frames of scene images to obtain corresponding multiple ear area features, and then use the multiple ear area features as multiple ear morphological features. Therefore, when the corresponding multiple ear area features are obtained based on the multiple frames of scene images and used as multiple ear features, the feature change information subsequently determined based on the multiple ear features can effectively characterize the area change of the ear area features corresponding to different acquisition time points from far to near. The area change can characterize the distance change relationship between the terminal and the ear within the corresponding time period, and is thereby used to assist in analyzing whether an ear-sticking event occurs at the terminal, thereby effectively improving the rationality of the terminal control method.

[0115] S405: Determine feature change information between different ear morphological features, wherein the feature change information describes the area change of the ear area features corresponding to different acquisition time points from far to near.

[0116] S406: Using the feature change information as ear image features.

[0117] The description of S405-S406 can be specifically referred to the above embodiment, which will not be repeated here.

[0118] S407: Determine relative motion information between the ear and the terminal according to the ear image features.

[0119] Among them, relative motion refers to the position change between the terminal and the ear when the two are used as reference objects, and relative motion information can refer to the speed, direction or distance between the two at a certain point in time of the above position change, etc., and there is no limitation on this.

[0120] It can be understood that the relative motion information can represent whether the movement trend of the terminal relative to the ear is approaching or moving away during the corresponding time period, thereby triggering subsequent steps to determine whether the terminal has an ear contact event.

[0121] S408: If the relative motion information indicates that the ear is gradually approaching the terminal, the initial probability value is increased to obtain a target probability value.

[0122] In the disclosed embodiment, when the relative motion information is that the ear is gradually approaching the terminal, it indicates that there is a greater probability of an ear contact event occurring in the motion trend of the current terminal, and thus the initial probability value may be increased to obtain a target probability value.

[0123] S409: If the relative motion information indicates that the ear is gradually moving away from the terminal, the initial probability value is reduced to obtain a target probability value.

[0124] In the embodiment of the present disclosure, when the relative motion information is that the ear is gradually moving away from the terminal, it indicates that the motion trend of the current terminal may not cause an ear contact event, so the initial probability value can be reduced to obtain the target probability value.

[0125] That is to say, after obtaining the ear image features, the embodiments of the present disclosure can determine the relative motion information between the ear and the terminal based on the ear image features. If the relative motion information is that the ear is gradually approaching the terminal, the initial probability value is increased to obtain the target probability value. If the relative motion information is that the ear is gradually moving away from the terminal, the initial probability value is reduced to obtain the target probability value. Thus, the initial probability value can be processed in combination with the relative motion information between the ear and the terminal, and according to the movement trend of the terminal relative to the ear, the obtained target probability value can effectively improve the accuracy of characterizing the probability of the terminal occurrence of an ear-touching event.

[0126] S410: If the target probability value is greater than or equal to the probability threshold, it is determined that an ear-to-ear event occurs in the terminal, and the terminal is controlled to be in the first state.

[0127] S411: If the target probability value is less than the probability threshold, it is determined that no ear-to-ear event occurs in the terminal, and the terminal is controlled to be in the second state.

[0128] The description of S410 - S411 can be specifically referred to the above embodiment, which will not be repeated here.

[0129] For example, Figure 5 It is a flow chart of processing terminal-related data in an embodiment of the present disclosure. After receiving a call request, the terminal control method can turn on the terminal's acceleration sensor and front camera, and simultaneously obtain touch data from the terminal display. The three different data sources are calculated separately, and finally combined to analyze whether an ear-touching event occurs in the terminal.

[0130] Among them, the calculation process of the acceleration sensor can be to use a three-axis acceleration sensor (Acceleration sensor, acc), mark its coordinate axis acc as the x-axis, y-axis and z-axis respectively, record 256 data respectively, and update the data once every 20 data are received, and calculate the eigenvalues ​​(the eigenvalues ​​include: pitch angle, mean, standard deviation, quartile, AC component of acc on the z-axis, and mean, standard deviation, quartile, AC component of acc_z difference. Among them, pitch angle = arctan (acc_y / acc_z), AC component = current value - average value, acc_z difference = acc_z[n]-acc_z[n-1]), and then put the obtained eigenvalues ​​into a machine learning classifier (which can be based on support vector machines (SVM), dimensionality reduction method linear discriminant analysis (LDA), linear regression, principal component analysis technology (PCA), deep neural network (Deep Neural Networks, DNN) and other technologies) calculate the probability of parallel movement in a certain direction and record it as the initial probability value p(acc), without any restriction.

[0131] Among them, the calculation process of the front camera can be to obtain image data, and put it into the target detection model after preprocessing (which can be cropping, color change, rotation, etc.) to find the area occupied by the ear or part of the ear in the image, and then calculate the area of ​​the area, take the ear area in multiple frames of images for comparison, when the trend of the area change is increasing, if the area increases to a preset threshold value x, it can be determined that there is a high probability that the terminal has an ear-touching event in this state. If the area does not increase to the threshold value x, p(acc) can be adaptively increased according to the changes in the ear area calculated in the last few times as the target probability value. When the trend of the area change is decreasing, p(acc) can be adaptively reduced according to the trend of the area reduction as the target probability value.

[0132] Among them, the calculation process of touch data can be to obtain touch data through the terminal display screen, and the accuracy of the touch data in representing the ear-touching event of the terminal is approximately equal to the low-precision image data. When the ear touches the terminal screen, the touch data has easy-to-identify characteristics: when there is no contact, there is no touch data; when it is lightly touched, there will be multiple circles of data; when it is heavily touched, there will be a large area of ​​contact with a hole in the middle. The touch data in this case is significantly different from the touch data generated by finger touch. Neural network technology can be used to determine whether it belongs to ear touch or finger touch. When it is determined to be an ear touch, it can be directly determined that the terminal has an ear-touching event. When it is determined to be a finger touch, p(acc) can be greatly reduced as the target probability value. When there is no touch data, it does not affect other calculation processes.

[0133] After the above three calculation processes, it is possible to determine whether an ear-touching event occurs at the terminal by judging the relationship between the obtained target probability value and the preset threshold. When it is determined to be an ear-touching event, the terminal is controlled to answer the call when the call has not been answered, and the terminal is controlled to turn off the screen when the call has been answered. When it is determined to be a non-ear-touching event, the terminal is controlled to enable touch, screen display and other functions.

[0134] In the disclosed embodiment, by obtaining corresponding multiple ear area features based on multiple frames of scene images and using them as multiple ear features, the feature change information subsequently determined based on the multiple ear features can effectively characterize the area change of the ear area features corresponding to different acquisition time points from far to near, and the area change can characterize the distance change relationship between the terminal and the ear in the corresponding time period, so as to be used to assist in analyzing whether the terminal has an ear-sticking event, and effectively improve the rationality of the terminal control method. By processing the initial probability value in combination with the relative motion information between the ear and the terminal, the accuracy of the characterization of the probability of the terminal having an ear-sticking event is effectively improved according to the motion trend of the terminal relative to the ear. When the ear area feature corresponding to the closest acquisition time point to the current time point is less than or equal to the area threshold, it is characterized that the distance between the terminal and the ear is relatively far, and the terminal has a high probability of not having an ear-sticking event. At this time, increasing the initial probability value according to the target ear area feature can greatly improve the accuracy of the characterization of the terminal having an ear-sticking event. When the ear area feature corresponding to the collection time point closest to the current time point is greater than the area threshold, it indicates that the distance between the terminal and the ear is relatively close. At this time, there is a high probability that an ear-touching event has occurred at the terminal. It can be directly determined that an ear-touching event has occurred at the terminal, thereby triggering subsequent steps in time and controlling the terminal to be in the first state, thereby avoiding false triggering operations on the terminal during an ear-touching call, and greatly improving the execution efficiency of the terminal control method.

[0135] Figure 6 A schematic diagram of the structure of a terminal control device proposed according to an embodiment of the present disclosure.

[0136] like Figure 6 As shown, the terminal control device 60 includes:

[0137] The first acquisition module 601 is used to acquire a scene image of the terminal when it is determined that the call function of the terminal is turned on;

[0138] A determination module 602 is used to determine, based on the scene image, whether an ear-touching event occurs at the terminal; and

[0139] The control module 603 is used to control the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen.

[0140] In some embodiments of the present disclosure,

[0141] The determination module 602 is further configured to determine, after acquiring the scene image of the terminal, that no ear contact event occurs on the terminal according to the scene image;

[0142] The control module 603 is further used to control the terminal to be in a second state, wherein the second state indicates that the terminal can respond to a touch operation of the display screen.

[0143] In some embodiments of the present disclosure, Figure 7 As shown, Figure 7 6 is a schematic diagram of the structure of a terminal control device proposed in another embodiment of the present disclosure, wherein the determination module 602 includes:

[0144] A first determination submodule 6021 is used to determine ear image features according to the scene image;

[0145] The second determination submodule 6022 is used to determine whether the terminal has an ear contact event based on ear image features.

[0146] In some embodiments of the present disclosure, the number of frames of the scene image is multiple frames, and the multiple frames of scene images correspond to multiple acquisition time points respectively;

[0147] The first determining submodule 6021 is specifically used for:

[0148] Respectively identifying multiple frames of scene images to obtain corresponding multiple ear morphological features;

[0149] Determine feature change information between different ear morphological features, wherein the feature change information describes the change of the ear morphological features corresponding to different acquisition time points from far to near;

[0150] The feature change information is used as ear image features.

[0151] In some embodiments of the present disclosure, the second determining submodule 6022 includes:

[0152] The processing unit 60221 is used to process the initial probability value according to the ear image feature to obtain a target probability value, wherein the initial probability value describes the probability of the terminal moving in parallel;

[0153] The first determining unit 60222 is configured to determine that an ear contact event occurs at the terminal when the target probability value is greater than or equal to a probability threshold;

[0154] The second determination unit 60223 is configured to determine that no ear contact event occurs at the terminal when the target probability value is less than a probability threshold.

[0155] In some embodiments of the present disclosure, the processing unit 60221 is specifically configured to:

[0156] Determine the relative motion information between the ear and the terminal according to the ear image features;

[0157] When the relative motion information is that the ear is gradually approaching the terminal, the initial probability value is increased to obtain the target probability value;

[0158] When the relative motion information is that the ear is gradually moving away from the terminal, the initial probability value is reduced to obtain the target probability value.

[0159] In some embodiments of the present disclosure, the first determining submodule 6021 is further configured to:

[0160] Respectively identifying multiple frames of scene images to obtain corresponding multiple ear area features;

[0161] The multiple ear area features are respectively used as multiple ear morphological features, wherein the feature change information describes the area change of the ear area features corresponding to different acquisition time points from far to near.

[0162] In some embodiments of the present disclosure, the processing unit 60221 is further configured to:

[0163] When the ear area feature corresponding to the closest collection time point to the current time point is less than or equal to the area threshold, the initial probability value is increased according to the target ear area feature to obtain the target probability value.

[0164] In some embodiments of the present disclosure, the first determining unit 60222 is further configured to:

[0165] When the ear area feature corresponding to the collection time point closest to the current time point is greater than the area threshold, it is determined that an ear contact event occurs on the terminal.

[0166] In some embodiments of the present disclosure, the terminal control device 60 further includes:

[0167] The second acquisition module 604 is used to acquire the touch data of the terminal when it is determined that the call function of the terminal is turned on;

[0168] A third acquisition module 605 is used to acquire the contact part type according to the touch data;

[0169] The second determining submodule 6022 is further used to determine that an ear contact event occurs when the contact part type is an ear type.

[0170] In some embodiments of the present disclosure, the processing unit 60221 is further configured to:

[0171] When the contact part type is not the ear type, the initial probability value is reduced to obtain the target probability value.

[0172] In some embodiments of the present disclosure, the terminal control device 60 further includes:

[0173] The fourth acquisition module 606 is used to acquire the acceleration data of the terminal when it is determined that the call function of the terminal is turned on;

[0174] The analysis module 607 is used to determine an initial probability value according to the acceleration data.

[0175] In some embodiments of the present disclosure, the analysis module 607 is specifically used to:

[0176] The acceleration data is analyzed to obtain a plurality of acceleration features corresponding to a plurality of coordinate axes, wherein the plurality of coordinate axes constitute a world coordinate system;

[0177] A plurality of acceleration characteristics are input into the probability analysis model to obtain an initial probability value output by the probability analysis model.

[0178] It should be noted that the above explanation of the terminal control method is also applicable to the terminal control device of this embodiment and will not be repeated here.

[0179] In the embodiment of the present disclosure, by acquiring a scene image of the terminal when determining that the terminal has turned on a call function, determining that an ear-touching event has occurred in the terminal based on the scene image, and then controlling the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen. Since whether an ear-touching event has occurred in the terminal is determined in combination with the scene image when the call function is turned on, the accuracy and convenience of the ear-touching event determination can be effectively improved, and the application scenarios of the ear-touching event determination can be effectively expanded. When an ear-touching event occurs in the terminal, the terminal is controlled to be in a state where the touch operation of the display screen can be shielded, which can more accurately avoid false triggering operations on the terminal during the ear-touching call, ensure the stability of the ear-touching call effect of the terminal, and improve the call control effect of the terminal.

[0180] In order to implement the above embodiments, the present disclosure further proposes a terminal, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the terminal control method proposed in the above embodiments of the present disclosure is implemented.

[0181] In order to implement the above embodiments, the present disclosure further proposes a non-temporary computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the terminal control method proposed in the above embodiments of the present disclosure is implemented.

[0182] In order to implement the above embodiments, the present disclosure further proposes a computer program product. When an instruction processor in the computer program product executes, the terminal control method proposed in the above embodiments of the present disclosure is executed.

[0183] Figure 8 A block diagram of an exemplary terminal suitable for implementing the embodiments of the present disclosure is shown.

[0184] Figure 8 The terminal 12 shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure. Figure 8 As shown, the terminal 12 is in the form of a general purpose computing device. The components of the terminal 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 connecting different system components (including the system memory 28 and the processing unit 16).

[0185] The bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnection (PCI) bus.

[0186] Terminal 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by terminal 12, including volatile and non-volatile media, removable and non-removable media.

[0187] The memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The terminal 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Figure 8 Not shown, often called a "hard drive").

[0188] although Figure 8 Not shown in the figure, a disk drive for reading and writing a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing a removable non-volatile optical disk (e.g., a compact disc read only memory (CD-ROM), a digital versatile disc read only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the various embodiments of the present disclosure.

[0189] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in the memory 28, such program modules 42 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 42 generally perform the functions and / or methods of the embodiments described in the present disclosure.

[0190] The terminal 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the terminal 12, and / or any device that enables the terminal 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input / output (I / O) interface 22. Furthermore, the terminal 12 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 20.

[0191] As shown, the network adapter 20 communicates with other modules of the terminal 12 via the bus 18. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the terminal 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0192] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the terminal control method mentioned in the above embodiment.

[0193] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the disclosure disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0194] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

[0195] It should be noted that, in the description of the present disclosure, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present disclosure, unless otherwise specified, the meaning of "plurality" is two or more.

[0196] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present disclosure includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present disclosure belong.

[0197] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0198] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0199] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0200] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0201] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0202] Although the embodiments of the present disclosure have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present disclosure. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present disclosure.

Claims

1. A terminal control method, characterized in that: include: When it is determined that the call function of the terminal is turned on, obtaining a scene image of the terminal; Determining, according to the scene image, that an ear-touching event occurs on the terminal, where the ear-touching event is an event in which a display screen of the terminal touches an ear of a user; as well as Controlling the terminal to be in a first state, wherein the first state indicates that the terminal can shield a touch operation of a display screen; The determining, according to the scene image, that an ear-touching event occurs at the terminal includes: Determining ear image features according to the scene image; Determining, according to the ear image feature, that the terminal has the ear contact event; The number of frames of the scene image is multiple frames, and the multiple frames of the scene image correspond to multiple acquisition time points respectively; Wherein, determining the ear image feature according to the scene image includes: Respectively identifying a plurality of frames of the scene image to obtain a plurality of corresponding ear morphological features; Determining feature change information between different ear morphological features, wherein the feature change information describes the change of the ear morphological features corresponding to different acquisition time points from far to near; Using the feature change information as the ear image feature; The determining, according to the ear image feature, that the terminal has the ear contact event includes: Processing an initial probability value according to the ear image feature to obtain a target probability value, wherein the initial probability value describes a probability situation that the terminal is in parallel motion; If the target probability value is greater than or equal to the probability threshold, determining that the ear-touching event occurs on the terminal; If the target probability value is less than the probability threshold, it is determined that the ear-touching event does not occur on the terminal.

2. The method according to claim 1, characterized in that After acquiring the scene image of the terminal, the method further includes: Determining, according to the scene image, that the terminal does not have the ear-touching event; The terminal is controlled to be in a second state, wherein the second state indicates that the terminal can respond to the touch operation of the display screen.

3. The method according to claim 2, characterized in that The processing of the initial probability value according to the ear image feature to obtain the target probability value includes: determining relative motion information between the ear and the terminal according to the ear image feature; If the relative motion information is that the ear is gradually approaching the terminal, increasing the initial probability value to obtain the target probability value; If the relative motion information is that the ear is gradually moving away from the terminal, the initial probability value is reduced to obtain the target probability value.

4. The method according to claim 2, characterized in that The identifying of the plurality of frames of the scene images respectively to obtain the corresponding plurality of ear morphological features includes: Respectively identifying a plurality of frames of the scene image to obtain a plurality of corresponding ear area features; The multiple ear area features are respectively used as the multiple ear morphological features, wherein the feature change information describes the area change of the ear area features corresponding to different acquisition time points from far to near.

5. The method according to claim 4, characterized in that The processing of the initial probability value according to the ear image feature to obtain the target probability value includes: If the ear area feature corresponding to the collection time point closest to the current time point is less than or equal to the area threshold, the initial probability value is increased according to the target ear area feature to obtain the target probability value.

6. The method according to claim 4, characterized in that The determining, according to the ear image feature, that the terminal has the ear contact event includes: If the ear area feature corresponding to the collection time point closest to the current time point is greater than the area threshold, it is determined that an ear-touching event occurs at the terminal.

7. The method according to claim 2, characterized in that Also includes: When it is determined that the call function of the terminal is turned on, acquiring touch data of the terminal; Acquire the contact part type according to the touch data; If the contact part type is an ear type, it is determined that an ear contact event occurs on the terminal.

8. The method according to claim 7, characterized in that The determining, according to the contact part type, that the terminal has an ear contact event includes: If the contact part type is not the ear type, the initial probability value is reduced to obtain the target probability value.

9. The method according to any one of claims 2 to 8, characterized in that: Also includes: When determining that the call function of the terminal is turned on, acquiring acceleration data of the terminal; The initial probability value is determined according to the acceleration data.

10. The method according to claim 9, characterized in that Determining the initial probability value according to the acceleration data includes: Analyzing the acceleration data to obtain a plurality of acceleration features corresponding to a plurality of coordinate axes, wherein the plurality of coordinate axes constitute a world coordinate system; The plurality of acceleration features are input into a probability analysis model to obtain the initial probability value output by the probability analysis model.

11. A terminal control device, characterized in that: include: A first acquisition module, configured to acquire a scene image of the terminal when determining that a call function of the terminal is turned on; A determination module, configured to determine, based on the scene image, that an ear-touching event occurs on the terminal, where the ear-touching event is an event in which a terminal display screen touches an ear of a user; as well as A control module, used to control the terminal to be in a first state, wherein the first state indicates that the terminal can shield the touch operation of the display screen; The determining module comprises: A first determination submodule, used to determine ear image features according to the scene image; A second determination submodule is used to determine, based on the ear image feature, that the terminal has the ear contact event; The number of frames of the scene image is multiple frames, and the multiple frames of the scene image correspond to multiple acquisition time points respectively; Wherein, the first determining submodule is specifically used for: Respectively identifying a plurality of frames of the scene image to obtain a plurality of corresponding ear morphological features; Determining feature change information between different ear morphological features, wherein the feature change information describes the change of the ear morphological features corresponding to different acquisition time points from far to near; Using the feature change information as the ear image feature; The second determining submodule includes: A processing unit, configured to process an initial probability value according to the ear image feature to obtain a target probability value, wherein the initial probability value describes a probability situation that the terminal is in parallel motion; A first determining unit, configured to determine that the ear-touching event occurs on the terminal when the target probability value is greater than or equal to a probability threshold; The second determining unit is configured to determine that the ear-touching event does not occur on the terminal when the target probability value is less than the probability threshold.

12. The device according to claim 11, characterized in that in, The determination module is further configured to determine, after acquiring the scene image of the terminal, that the terminal has not experienced the ear contact event according to the scene image; The control module is further used to control the terminal to be in a second state, wherein the second state indicates that the terminal can respond to the touch operation of the display screen.

13. The device according to claim 12, characterized in that The processing unit is used for: determining relative motion information between the ear and the terminal according to the ear image feature; When the relative motion information indicates that the ear is gradually approaching the terminal, increasing the initial probability value to obtain the target probability value; When the relative motion information indicates that the ear is gradually moving away from the terminal, the initial probability value is reduced to obtain the target probability value.

14. The device according to claim 12, characterized in that The first determining submodule is specifically used for: Respectively identifying a plurality of frames of the scene image to obtain a plurality of corresponding ear area features; The multiple ear area features are respectively used as the multiple ear morphological features, wherein the feature change information describes the area change of the ear area features corresponding to different acquisition time points from far to near.

15. The device according to claim 14, characterized in that The processing unit is further used for: When the ear area feature corresponding to the collection time point closest to the current time point is less than or equal to the area threshold, the initial probability value is increased according to the target ear area feature to obtain the target probability value.

16. The device according to claim 14, characterized in that The first determining unit is further configured to: When the ear area feature corresponding to the collection time point closest to the current time point is greater than the area threshold, it is determined that an ear-touching event occurs on the terminal.

17. The device according to claim 12, characterized in that Also includes: A second acquisition module, configured to acquire touch data of the terminal when determining that the call function of the terminal is turned on; A third acquisition module, used for acquiring a contact part type according to the touch data; The second determining submodule is further configured to determine that an ear contact event occurs at the terminal when the contact part type is an ear type.

18. The device according to claim 17, characterized in that in, The processing unit is further configured to reduce the initial probability value to obtain the target probability value when the contact part type is not the ear type.

19. The device according to any one of claims 12 to 18, characterized in that Also includes: A fourth acquisition module, configured to acquire acceleration data of the terminal when determining that the call function of the terminal is turned on; An analysis module is used to determine the initial probability value according to the acceleration data.

20. The device according to claim 19, characterized in that The analysis module is specifically used for: Analyzing the acceleration data to obtain a plurality of acceleration features corresponding to a plurality of coordinate axes, wherein the plurality of coordinate axes constitute a world coordinate system; The plurality of acceleration features are input into a probability analysis model to obtain the initial probability value output by the probability analysis model.

21. A terminal, comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 10.

22. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1 to 10.

23. A computer program product comprising a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 10.

Images