Control method, intelligent terminal and storage medium

Abstract

The invention provides a control method, an intelligent terminal and a storage medium, and the control method can be applied to the intelligent terminal, and comprises the step of performing preset function control in response to meeting a first condition. According to the technical scheme, the user operation in the target function positioning process can be simplified, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent terminals, and in particular to a control method, an intelligent terminal and a storage medium. Background Art

[0002] With the development of smart terminal technology, not only has performance been optimized, but more and more attention has been paid to improving user experience.

[0003] During the process of conceiving and implementing this application, the inventors discovered that there are at least the following problems: in order to meet the user's needs for various scenario functions, the functional module design of the terminal has become increasingly detailed. When the user needs to activate a certain function, there are problems such as difficult positioning and complicated operation, resulting in a poor user experience. For example, when turning on the under-screen camera, it is usually necessary to open the shooting application first, and then enter the corresponding start-up command in the application before the under-screen camera can be turned on.

[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0005] In response to the above technical problems, the present application provides a control method, an intelligent terminal and a storage medium, which can simplify user operations during the target positioning function and improve user experience.

[0006] The present application provides a control method, comprising the steps of: S1: In response to a first condition being met, performing a preset function control.

[0007] Optionally, the control method further includes at least one of the following: The controlling of the preset function includes controlling at least one of turning on, turning off, and adjusting parameters of the preset function; The first condition is satisfied, including at least one of the following: The preset component receives a contact operation or a contactless operation; Recognize the target text and / or target semantics; Run the preset object.

[0008] Optionally, step S1 comprises the steps of: S11: Verify the contactless operation; S12: If the verification is passed, the preset function control is performed.

[0009] Optionally, step S11 includes at least one of the following: Verify contactless operations through preset AI models; Determine whether the contactless operation is triggered by a living body; Determine whether the contactless operation is an erroneous operation.

[0010] Optionally, passing the verification includes at least one of the following: Verified by the preset AI model; The non-contact operation is triggered by living organisms; Contactless operation is not an incorrect operation.

[0011] Optionally, the control method further includes at least one of the following: The preset functions include at least one of shooting, voice, locking / unlocking, and screenshot; The contact operation includes at least one of clicking, blocking, and sliding; The non-contact operation includes at least one of gesture operation, eye movement operation, voice operation, expression operation, identity authentication operation, and body sensing operation.

[0012] Optionally, the method for determining that the contactless operation is not an erroneous operation includes at least one of the following: If the parameter of the gesture operation is within at least one of a preset force range, a preset gesture speed range, and a preset gesture accuracy range, then it is determined that the non-contact operation is not an erroneous operation; If the parameter of the eye movement operation is within at least one of a preset eye movement speed range and a preset eye movement accuracy range, it is determined that the non-contact operation is not an erroneous operation; If the parameter of the voice operation is within at least one of a preset volume range, a preset speech speed range, and a preset voice accuracy range, then it is determined that the non-contact operation is not an erroneous operation; If the parameter of the expression operation is within at least one of a preset expression speed range and a preset expression accuracy range, it is determined that the non-contact operation is not an erroneous operation; If the parameter of the somatosensory operation is in at least one of a preset acceleration range, a preset tilt angle range, and a preset rotation angle range, it is determined that the non-contact operation is not an erroneous operation.

[0013] Optionally, the preset component includes a first component and / or a multiplexing module.

[0014] Optionally, when the preset component is a light sensor or an image sensor, step S1 includes: In response to receiving the gesture operation, displaying the gesture operation; In response to the gesture operation satisfying the second condition, a preset function control is performed.

[0015] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a control program is stored in the memory, and when the control program is executed by the processor, the steps of any of the control methods described above are implemented.

[0016] The present application also provides a storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any of the control methods described above are implemented.

[0017] As described above, the control method of the present application includes: in response to satisfying the first condition, performing preset function control. Through the above technical solution, the preset function control can be quickly performed, thereby simplifying the user operation in the process of locating the target function and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0019] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application; Figure 2 A communication network system architecture diagram provided for an embodiment of the present application; Figure 3 is a flow chart of a control method according to the first embodiment; Figure 4 is a flow chart of a control method according to the second embodiment; Figure 5 is a flow chart of a control method according to a third embodiment; Figure 6 is a flow chart of a control method according to a fourth embodiment; Figure 7 It is a schematic diagram of receiving gesture operation according to an embodiment of the present application.

[0020] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0021] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0022] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0023] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0024] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0025] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0026] It should be noted that in this article, step codes such as S1 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence.

[0027] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0028] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0029] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0030] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0031] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0032] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal: The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution), TDD-LTE (Time Division Duplexing- Long Term Evolution), 5G and 6G, etc.

[0033] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.

[0034] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0035] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0036] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0037] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0038] The user input unit 107 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by users using fingers, styluses, or any other suitable objects or accessories on or near the touch panel 1071), and drive corresponding connection devices according to a pre-set program. The touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may also include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0039] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.

[0040] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0041] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0042] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0043] The mobile terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0044] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0045] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0046] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0047] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0048] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0049] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving GateWay) 2034, PGW (PDN Gate Way) 2035, and PCRF (Policy and Charging Rules Function) 2036. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as a home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE 201. PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0050] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0051] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0052] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0053] First embodiment Reference Figure 3 , Figure 3 is a flow chart of a control method according to the first embodiment. The control method of the embodiment of the present application comprises step S1: Step S1: in response to satisfying a first condition, performing a preset function control.

[0054] Optionally, the controlling of the preset function includes controlling at least one of turning on, turning off, and adjusting parameters of the preset function; Optionally, the preset function includes at least one of shooting, voice, locking / unlocking, and screenshot; Optionally, the preset function control may be to turn on the shooting function, turn off the shooting function, or adjust parameters of the shooting function, such as adjusting saturation, exposure, etc.

[0055] Optionally, the preset function control may be to turn on the voice function, turn off the voice function, and adjust parameters of the voice function, such as adjusting the volume, adjusting the background noise, etc.

[0056] Optionally, satisfying the first condition includes at least one of the following: The preset component receives a contact operation or a contactless operation; The target text and / or target semantics are recognized.

[0057] Optionally, the preset components are components on a smart terminal, including sensors, cameras, fingerprint recognition modules, volume adjustment modules, etc.

[0058] Optionally, the sensor may be a pressure sensor, a light sensor or an image sensor, a distance sensor, a touch sensor, a fingerprint sensor, an acceleration sensor, or a sound sensor.

[0059] Optionally, the camera may be a front camera, a rear camera, or the like.

[0060] Optionally, the preset component may also be a multiplexing module, such as multiplexing a sensor with a camera, multiplexing a sensor with a volume adjustment module, and so on.

[0061] Optionally, the first condition may be met for at least one preset component to receive a contact operation or a contactless operation. For example, the first condition may be met for a pressure sensor to receive a contact operation, the first condition may also be met for an optical sensor or an image sensor to receive a contactless operation, the first condition may also be met for a sound sensor to receive a contactless operation, and the fingerprint recognition module may receive a contact operation.

[0062] Optionally, if the first condition is met, the multiplexing module may receive a contact operation or a contactless operation. For example, the multiplexing module of the fingerprint sensor and the volume adjustment module receives a contact operation.

[0063] Optionally, the contact operation includes at least one of clicking, blocking, and sliding; Optionally, the contactless operation received by the light sensor or the image sensor may be triggered by the user covering the light sensor or the image sensor.

[0064] Optionally, the contact operation received by the light sensor or the image sensor may be triggered by the user clicking a specific opening corresponding to the light sensor or the image sensor in the smart terminal.

[0065] Optionally, the contact operation received by the touch sensor may be triggered by the user sliding a finger on the touch sensor.

[0066] Optionally, you can double-click with your finger just above the under-screen camera to quickly turn on the under-screen camera.

[0067] Optionally, you can slide your finger twice just above the under-screen camera to quickly turn on the AI ​​assistant function.

[0068] Optionally, a pressure sensing layer (i.e., pressure sensor) can be added at the opening of the under-screen camera. By pressing it with your finger, you can quickly turn on the under-screen camera and enter the photo mode.

[0069] Optionally, the non-contact operation includes at least one of gesture operation, eye movement operation, voice operation, expression operation, identity authentication operation, and somatosensory operation.

[0070] Optionally, the contactless operation received by the camera may be triggered by a gesture operation performed by the user, or may be triggered by an eye movement operation and / or an expression operation performed by the user.

[0071] Optionally, the contactless operation received by the distance sensor may be triggered by a gesture operation performed by the user.

[0072] Optionally, the sound sensor receives the contactless operation, which may be triggered by a voice operation performed by the user.

[0073] Optionally, the contactless operation received by the fingerprint sensor, and / or the pupil recognition module, and / or the voiceprint recognition module, and / or the facial recognition module, etc. can be triggered by the user's identity authentication operation.

[0074] Optionally, the contactless operation received by the acceleration sensor may be triggered by a somatosensory operation performed by the user.

[0075] Optionally, a light sensor or an image sensor can be added at the opening of the under-screen camera. As long as the light sensor or the image sensor is blocked continuously for a preset number of times (such as 2 times), the light sensor or the image sensor will sense the signal and send the signal to the microcontroller MCU for processing. The microcontroller MCU sends an instruction to the under-screen camera to turn on the under-screen camera.

[0076] Optionally, a distance sensor can be added at the camera opening under the screen. As long as the distance sensor is continuously blocked for a preset number of times (e.g., 2 times) at a preset distance, the screenshot function can be enabled.

[0077] Optionally, when the first condition is met, the preset function control may also be performed when the preset object is run, that is, when the preset object is run and the preset component receives a contact operation or a non-contact operation, or recognizes the target text and / or target semantics.

[0078] Optionally, the preset object may be a pre-set application, program, service, function, etc.

[0079] Optionally, when there is a new message or an incoming call, and the light sensor or the image sensor receives a blocking operation, the camera is quickly turned on for a video call or a voice call is quickly turned on.

[0080] Optionally, in a game or social media application, when the touch sensor receives a sliding operation, the camera is quickly turned on to capture the user's expression or action, which is applied to the game character's action or social dynamics.

[0081] Optionally, satisfying the first condition may also mean recognizing target text and / or target semantics.

[0082] Optionally, by monitoring whether the text input by the user in the smart terminal is the target text, for example, if the user inputs "turn on the camera" in the smart terminal, the camera is turned on.

[0083] Optionally, it is possible to monitor whether the text input by the user in the smart terminal conforms to the target semantics, or monitor whether the user's voice content conforms to the target semantics. For example, if the user's voice content is "I want to look in the mirror to see what I look like now", the front camera is turned on.

[0084] Optionally, in response to satisfying the first condition, feedback is provided through at least one of vibration, sound prompt, flashing indicator light, flashing flash, screen flashing, and pop-up of a preset component.

[0085] Optionally, in response to satisfying the first condition, timely feedback may be provided to improve the user experience.

[0086] Optionally, if the user's voice content is "I want to look in the mirror to see what I look like now", the front camera is turned on and feedback is given by flashing at the camera hole.

[0087] Through the technical solution of the embodiment of the present application, preset function control can be quickly performed, thereby simplifying user operations in the process of locating the target function and improving user experience.

[0088] Second embodiment Based on the above first embodiment, the second embodiment of the present application is proposed, referring to Figure 4 , Figure 4is a flow chart of a control method according to the second embodiment, wherein step S1 includes step S11 and step S12: Step S11: verifying the contactless operation; Step S12: If the verification is passed, the preset function control is performed.

[0089] Optionally, since the interaction between the user and the mobile phone is prone to misoperation in the contactless operation mode, the contactless operation needs to be verified. In order to prevent fraud, such as unlocking the mobile phone or making payments through deceptive means such as photos, videos or 3D printed faces, or to avoid sensors being exploited by hackers or malware to attack or steal information, contactless operations generally also need to be verified.

[0090] Optionally, verifying the contactless operation may include: determining whether the contactless operation is a live operation, determining whether the contactless operation is an erroneous operation, determining whether the contactless operation is a malicious attack, etc.

[0091] Optionally, when a contactless operation is received, the contactless operation is verified, and if the verification is passed, a preset function control is performed.

[0092] Optionally, when a preset object is run and a contactless operation is received, the contactless operation is verified, and if the verification is passed, the preset function control is performed. For example, when there is a new message or an incoming call, and a voice command is received, the voice command is verified, and if the verification is passed, the camera is quickly turned on for a video call or a voice call; for another example, in a game or social media application, when a contactless operation is received, the contactless operation is verified, and if the verification is passed, the camera is quickly turned on to capture the user's expression or action, which is applied to the game character action or social dynamics.

[0093] Through the technical solution of the embodiment of the present application, preset function control can be performed quickly and safely, thereby simplifying user operations in the process of locating the target function and improving user experience.

[0094] Third embodiment Based on the above second embodiment, the third embodiment of the present application is proposed, referring to Figure 5 , Figure 5 is a flow chart of a control method according to the third embodiment, wherein step S11 includes at least one of step S111, step S112 and step S113: Step S111, verifying the contactless operation through a preset AI model; Optionally, an AI model such as a feedforward neural network, a convolutional neural network, or a recurrent neural network may be selected for training, and the contactless operation may be verified by the trained model. If the verification of the preset AI model is passed, the preset function control is performed.

[0095] Optionally, when a preset object is run and a contactless operation is received, the contactless operation is verified by a preset AI model, and if the verification is successful, the preset function control is performed. For example, when there is a new message or an incoming call, and a voice command is received, the voice command is verified by a preset AI model, and if the verification is successful, the camera is quickly turned on for a video call or a voice call; for another example, in a game or social media application, when a contactless operation is received, the contactless operation is verified by a preset AI model, and if the verification is successful, the camera is quickly turned on to capture the user's expression or action, which is applied to the game character action or social dynamics.

[0096] Optionally, the AI ​​model can be optimized based on the user's operating habits, user feedback, user usage scenarios, etc., so that the AI ​​model can more accurately analyze the user's intentions.

[0097] Optionally, when there is a new message or an incoming call and a voice command is received, the voice command is verified by the optimized AI model. If the verification is passed, the camera is quickly turned on for a video call or a voice call is quickly started.

[0098] Optionally, in games or social media applications, when a contactless operation is received, the contactless operation is verified by the optimized AI model. If the verification passes, the camera is quickly turned on to capture the user's expression or action, which is applied to game character actions or social dynamics.

[0099] Step S112, determining whether the non-contact operation is triggered by a living body; Optionally, technologies such as subtle facial movements (such as blinking, opening the mouth, etc.), 3D face reconstruction, infrared face detection, etc. can be used to determine whether the non-contact operation is triggered by a living body.

[0100] Optionally, when a preset object is running and a contactless operation is received, it is determined whether the contactless operation is triggered by a live body. If the verification is successful, the preset function control is performed. For example, when there is a new message or an incoming call, and a voice command is received, it is determined whether the voice command is triggered by a live body. If the verification is successful, the camera is quickly turned on for a video call or a voice call. For another example, in a game or social media application, when a contactless operation is received, it is determined whether the contactless operation is triggered by a live body. If the verification is successful, the camera is quickly turned on to capture the user's expression or action, which is applied to the game character action or social dynamics.

[0101] Step S113, determining whether the non-contact operation is an erroneous operation.

[0102] Optionally, a behavior pattern analysis and / or other information may be performed to determine whether the contactless operation is an erroneous operation.

[0103] Optionally, behavioral pattern analysis can analyze the user's operating habits and behavioral patterns to determine whether the current operation is consistent with the user's regular behavior; optionally, the time, location, device status and other information of the current operation can be combined to determine whether the operation is reasonable.

[0104] Optionally, a recognition threshold may be set, and when the non-contact operation meets the preset recognition threshold, the non-contact operation is judged as not being an erroneous operation. For example, for gesture operation, a recognition threshold of gesture parameters may be set, and only when the user's gesture meets at least one of the preset strength, preset speed, and preset accuracy, will it be recognized as a valid gesture, and the non-contact operation will be judged as not being an erroneous operation.

[0105] Optionally, when a preset object is running and a contactless operation is received, it is determined whether the contactless operation is an erroneous operation. If the verification is successful, the preset function control is performed. For example, when there is a new message or an incoming call, and a voice command is received, it is determined whether the voice command is an erroneous operation. If the verification is successful, the camera is quickly turned on for a video call or a voice call; for another example, in a game or social media application, when a contactless operation is received, it is determined whether the contactless operation is an erroneous operation. If the verification is successful, the camera is quickly turned on to capture the user's expression or action, which is applied to the game character action or social dynamics.

[0106] Optionally, the passing of verification in step S12 includes at least one of the following: Verified by the preset AI model; The non-contact operation is triggered by living organisms; Contactless operation is not an incorrect operation.

[0107] Optionally, the method for determining that the contactless operation is not an erroneous operation includes at least one of the following: If the parameter of the gesture operation is within at least one of a preset force range, a preset gesture speed range, and a preset gesture accuracy range, then it is determined that the non-contact operation is not an erroneous operation; If the parameter of the eye movement operation is within at least one of a preset eye movement speed range and a preset eye movement accuracy range, it is determined that the non-contact operation is not an erroneous operation; If the parameter of the voice operation is within at least one of a preset volume range, a preset speech speed range, and a preset voice accuracy range, then it is determined that the non-contact operation is not an erroneous operation; If the parameter of the expression operation is within at least one of a preset expression speed range and a preset expression accuracy range, it is determined that the non-contact operation is not an erroneous operation; If the parameter of the somatosensory operation is in at least one of a preset acceleration range, a preset tilt angle range, and a preset rotation angle range, it is determined that the non-contact operation is not an erroneous operation.

[0108] That is, the verification of whether the contactless operation complies with the user's triggering habits includes at least one of the following: Verifying whether a parameter of the gesture operation is within at least one of a preset force range, a preset gesture speed range, and a preset gesture accuracy range; Verifying whether the parameters of the eye movement operation are within at least one of a preset eye movement speed range and a preset eye movement accuracy range; Verifying whether a parameter of the voice operation is within at least one of a preset volume range, a preset speech speed range, and a preset voice accuracy range; Verify whether the parameter of the expression operation is within at least one of a preset expression speed range and a preset expression accuracy range; Verify whether the parameter of the somatosensory operation is within at least one of a preset acceleration range, a preset tilt angle range, and a preset rotation angle range.

[0109] Optionally, the preset force range is the habitual force range of the user when triggering an action calculated by the AI ​​model. Similarly, the preset gesture speed range, preset gesture accuracy range, preset eye movement speed range, preset eye movement accuracy range, preset volume range, preset speaking speed range, preset voice accuracy range, preset expression speed range, preset expression accuracy range, preset acceleration range, preset tilt angle range, and preset rotation angle range are also habitual ranges of the user when triggering an action calculated by the AI ​​model.

[0110] Optionally, for the force monitoring of gesture operations, the gesture operations can be analyzed through a pre-trained AI model to analyze the force of the gesture operations.

[0111] Optionally, the AI ​​model can be trained with a large amount of gesture data so that the AI ​​model can analyze the strength of different gesture operations.

[0112] Optionally, gesture accuracy refers to the degree of matching between the user gesture and a preset standard gesture.

[0113] Optionally, the expression speed is the speed of completing a whole expression.

[0114] Optionally, for gesture operations, if the preset force range is 2-5 Newtons, the preset gesture speed range is 0.5-1.5 seconds / complete gesture, and the preset gesture accuracy range is 90%-100%, if the user's gesture operation satisfies at least one of the above items, it is judged that the non-contact operation is not an erroneous operation.

[0115] Optionally, for eye movement operation, if the preset eye movement speed range is 30-60 degrees / second, and the preset eye movement accuracy range is 85%-100%, if the user's eye movement operation meets at least one of the above items, it is judged that the non-contact operation is not an erroneous operation.

[0116] Optionally, for voice operation, if the preset volume range is 60-80 decibels, the preset speech speed range is 120-180 words / minute, and the preset voice accuracy range is 90%-100%, if the user voice meets at least one of the above items, it is judged that the non-contact operation is not an erroneous operation.

[0117] Optionally, for expression operation, if the preset expression speed range is 1-3 seconds / complete expression, and the preset expression accuracy range is 80%-100%, if the user's expression operation satisfies at least one of the above items, it is judged that the non-contact operation is not an erroneous operation.

[0118] Optionally, for somatosensory operation, if the preset acceleration range is 0.5-2 m / s², the preset tilt angle range is 10°-45°, and the preset rotation angle range is 30°-90°, if the user's somatosensory operation of the smart terminal meets at least one of the above conditions, it is determined that the non-contact operation is not an erroneous operation.

[0119] Optionally, the user's operating habits may be learned, and / or the judgment interval of the non-contact operating parameters may be optimized according to the user's feedback.

[0120] Optionally, in contactless scenarios, users are prone to make misoperations. For example, for voice operations, the smart terminal needs to distinguish whether the user has issued a voice command or mentioned keywords in daily communication. At this time, the judgment interval of the contactless operation parameters can be optimized based on the user's operating habits, user feedback, and user usage scenarios.

[0121] Optionally, for gesture operation, the user's gesture operation habits when using gesture operation to trigger the camera to turn on can be obtained, and at least one of the preset force range, preset gesture speed and preset gesture accuracy range can be optimized according to the user's feedback, thereby improving the user experience. For example, the gesture operation to turn on shooting is to make an "ok" gesture. User A is used to making an "ok" gesture on the top of his head, and user B is used to making an "ok" gesture on his chest. At this time, the preset gesture accuracy range can be adjusted. When user B makes an "ok" gesture on the top of his head, it will be judged as a wrong operation, and the camera will not be turned on for user B. This is smarter and can further improve the user experience.

[0122] Optionally, when the preset object is running and a contactless operation is received, the contactless operation is judged by the optimized AI model, or whether the contactless operation is triggered by a living body is judged in combination with the user's operating habits and user feedback, or whether the contactless operation is an erroneous operation is judged in combination with the user's operating habits and user feedback. If the verification passes, the preset function control is performed.

[0123] Through the technical solution of the embodiment of the present application, preset function control can be performed quickly, safely and intelligently, thereby simplifying user operations in the process of positioning the target function and improving user experience.

[0124] Fourth embodiment Based on any of the above embodiments, a fourth embodiment of the present application is proposed, referring to Figure 6 , Figure 6 It is a flow chart of a control method according to the third embodiment, wherein the preset component includes a first component and / or a multiplexing module.

[0125] Optionally, the first component includes at least one of a front camera, a rear camera, a fingerprint recognition module, a volume adjustment module, an eye tracking module, a temperature sensor, a pressure sensor, a light sensor or an image sensor, a distance sensor, and a posture sensor of the target terminal. For example, by tapping the rear camera a preset number of times and / or at a preset frequency, the front camera can be turned on, and by sliding on the rear camera, the focus of the front camera can be adjusted.

[0126] For example, by blocking the front camera for a preset number of times and / or at a preset frequency, the rear camera can be turned on, and by sliding on the front camera, the focal length of the rear camera can be adjusted.

[0127] Optionally, the first component includes a multiplexing module, such as a posture multiplexing module, such as an accelerometer, a gyroscope, a magnetometer, etc. For example, when the posture multiplexing module receives that the smart terminal rotates 10 degrees, the step counting function can be turned on; for another example, when the posture multiplexing module receives that the smart terminal rotates 30 degrees, the map navigation function can be turned on; for another example, when the posture multiplexing module receives that the smart terminal rotates 180 degrees, the screen rotation function can be turned on.

[0128] When the preset component is a light sensor or an image sensor, the step S1 includes steps S13 and S14: Step S13, in response to receiving the gesture operation, displaying the gesture operation; Reference Figure 7 , Figure 7 It is a schematic diagram of receiving gesture operation according to an embodiment of the present application.

[0129] Optionally, the intelligent terminal may emit visible light, such as infrared light.

[0130] The user performs gesture operations in infrared light, and the red light is reflected by the user's gesture and received and processed by the light sensor or image sensor. As a result, the smart terminal can construct a three-dimensional visual point cloud and display the gesture operations in the three-dimensional visual point cloud.

[0131] Step S14, in response to the gesture operation satisfying the second condition, performing preset function control.

[0132] Optionally, satisfying the second condition may be that the gesture operation matches a preset gesture.

[0133] Optionally, the preset function may be at least one of shooting, voice, locking / unlocking, and screenshot.

[0134] Optionally, if the user makes an "ok" gesture with his finger in visible light, the shooting function is turned on.

[0135] Optionally, if the user makes a thumbs-up gesture in visible light, the screenshot function is enabled.

[0136] Optionally, the control method may further include: the smart terminal provides feedback, such as feedback through at least one of vibration, sound prompt, visible light flashing, indicator light flashing, flash light flashing, screen flashing, and preset component pop-up, so as to improve user experience.

[0137] Optionally, the smart terminal can also learn the user's usage habits and optimize the accuracy and sensitivity of gesture recognition based on the user's feedback. For example, the threshold of gesture matching can be automatically adjusted to adapt to the operating habits of different users.

[0138] Through the technical solution of the embodiment of the present application, preset function control can be quickly performed, thereby simplifying user operations in the process of locating the target function and improving user experience.

[0139] An embodiment of the present application also provides an intelligent terminal, including a memory and a processor. A control program is stored in the memory. When the control program is executed by the processor, the steps of the control method in any of the above embodiments are implemented.

[0140] An embodiment of the present application further provides a storage medium having a control program stored thereon. When the control program is executed by a processor, the steps of the control method in any of the above embodiments are implemented.

[0141] In the embodiments of the smart terminal and storage medium provided in the present application, all technical features of any of the above-mentioned control method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0142] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0143] An embodiment of the present application also provides a chip, including a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0144] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0145] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0146] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0147] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0148] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0149] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0150] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0151] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0152] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0153] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A control method, characterized in that: Includes steps: S1: in response to satisfying a first condition, performing a preset function control; Step S1, comprising the steps of: S11: in response to receiving the contactless operation, verifying the contactless operation; S12: If the verification is passed, the preset function control is performed; Step S11 includes: Use a preset AI model to verify whether the contactless operation complies with the user's triggering habits, and / or verify whether the contactless operation is triggered by a living body.

2. The control method according to claim 1, characterized in that: Include at least one of the following: The controlling of the preset function includes controlling at least one of turning on, turning off, and adjusting parameters of the preset function; The first condition is satisfied, including at least one of the following: The preset component receives a contact operation or a contactless operation; Recognize the target text and / or target semantics; Run the preset object.

3. The control method according to claim 2, characterized in that: Verification of contactless operations through preset AI models includes: Optimize the AI ​​model based on user operating habits, user feedback, and user usage scenarios; Verify contactless operation through optimized AI model.

4. The control method according to claim 1, characterized in that: Pass verification includes at least one of the following: Verified by the preset AI model; The contactless operation is triggered by living organisms.

5. The control method according to claim 1, characterized in that: Include at least one of the following: The preset functions include at least one of shooting, voice, locking / unlocking, and screenshot; The contact operation includes at least one of clicking, blocking, and sliding; The non-contact operation includes at least one of gesture operation, eye movement operation, voice operation, expression operation, identity authentication operation, and body sensing operation.

6. The control method according to any one of claims 1 to 5, characterized in that: The verification of whether the contactless operation complies with the user's triggering habits includes at least one of the following: Verifying whether a parameter of the gesture operation is within at least one of a preset force range, a preset gesture speed range, and a preset gesture accuracy range; Verifying whether the parameters of the eye movement operation are within at least one of a preset eye movement speed range and a preset eye movement accuracy range; Verifying whether a parameter of the voice operation is within at least one of a preset volume range, a preset speech speed range, and a preset voice accuracy range; Verify whether the parameter of the expression operation is within at least one of a preset expression speed range and a preset expression accuracy range; Verify whether the parameter of the somatosensory operation is within at least one of a preset acceleration range, a preset tilt angle range, and a preset rotation angle range.

7. The control method according to any one of claims 2 to 3, characterized in that: The preset component includes a first component and / or a multiplexing module.

8. The control method according to any one of claims 2 to 3, characterized in that: When the preset component is a light sensor or an image sensor, step S1 includes: In response to receiving the gesture operation, displaying the gesture operation; In response to the gesture operation satisfying the third condition, a preset function control is performed.

9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a control program is stored in the memory, and when the control program is executed by the processor, the steps of the control method according to any one of claims 1 to 8 are implemented.

10. A storage medium, characterized in that: The storage medium stores a computer program, which, when executed by a processor, implements the steps of the control method according to any one of claims 1 to 8.

Images