Control method, intelligent terminal and storage medium
The environment parameters are obtained through sensors in the smart terminal and the touch screen parameters are adjusted according to the scene information, which solves the problem of accidentally touching caused by the interference of the touch screen droplets, and achieves accurate touch and improves the user experience.
Patent Information
- Application Number
- CN202411011667.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2024-11-19
AI Technical Summary
When there are droplets in the touch screen, it is easy to cause errors or inability to accurately touch, which affects the user experience.
By using sensors in the smart terminal to obtain the current environment parameters, determine the suppression strategy based on the scene information, adjust the screen control parameters of the touch screen to eliminate droplet interference, and achieve accurate touch control.
It effectively solves the problem of accidentally touching the touch screen when there are droplets and the problem of inability to accurately touch, improves the user experience, and realizes the wet screen touch function.
Smart Images

Figure CN118981255A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal control technology, and in particular to a control method, an intelligent terminal and a storage medium. Background Art
[0002] With the continuous development of electronic technology, touch screens have been widely used in various electronic products. For example, smart phones, smart home appliances, tablet computers and other terminal products are equipped with touch screens to support touch operations, and the field of touch screen technology has also achieved rapid development. Currently, the commonly used types of touch screens are capacitive screens.
[0003] In the process of conceiving and realizing the present application, the inventors found that there are at least the following problems: when there are droplets on the touch screen, there may be false touches or precise touches cannot be performed.
[0004] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention
[0005] In response to the above technical problems, the present application provides a control method, a smart terminal and a storage medium, so that when a user operates a touch screen with liquid droplets, the user can accurately touch the touch screen and / or avoid or reduce false touches, thereby improving the user experience.
[0006] The present application provides a control method which can be applied to a smart terminal, comprising the following steps: S1, in response to a touch operation, executing a corresponding operation instruction by eliminating interference from droplets according to a suppression strategy corresponding to a current usage scenario.
[0007] Optionally, the current usage scenario can be obtained in at least one of the following ways:
[0008] Obtaining a current environmental parameter fed back by at least one sensor, and determining corresponding scene information from a parameter-scene mapping relationship;
[0009] A current environmental parameter fed back by at least one sensor is obtained, and the scene classification model analyzes the current environmental parameter to obtain scene information;
[0010] In response to the setting operation, scene information is determined.
[0011] Optionally, the method further includes the following steps: S2, sending the suppression strategy to associated terminals within a preset distance range.
[0012] Optionally, the method further includes the following steps: S3, adjusting the screen control parameters of the touch screen according to the detected current environmental parameters in accordance with the first preset strategy.
[0013] Optionally, the first preset strategy includes at least one of the following:
[0014] When it is detected that the current ambient temperature is lower than a preset temperature threshold, the touch sensitivity of at least a part of the touch screen is increased;
[0015] When it is detected that the current touch area is larger than a preset area threshold, reducing the touch sensitivity of at least a part of the touch screen;
[0016] When it is detected that the current moving speed is greater than a preset speed value, the touch sensitivity and / or display parameters of the non-target area in the touch screen are reduced.
[0017] Optionally, the following steps are also included: S4, according to the second preset strategy, based on the detected current environmental parameters, closing at least part of the currently running applications and / or tools.
[0018] Optionally, the second preset strategy includes at least one of the following:
[0019] When it is detected that the current moving speed is greater than a preset speed value, closing at least part of the currently running applications and / or tools;
[0020] Speed-application / tool mapping relationship, close the application and / or tool corresponding to the current movement speed;
[0021] When it is detected that the current ambient temperature is greater than a preset temperature value, closing at least part of the currently running applications and / or tools;
[0022] Temperature-application / tool mapping relationship, close the application and / or tool corresponding to the current ambient temperature.
[0023] Optionally, the following steps are also included: S0, when it is detected that the ambient temperature difference between the current usage scenario and the previous usage scenario is greater than a preset temperature difference value, execute S1.
[0024] The present application also provides an intelligent terminal, including: a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the control method described in any one of the above items are implemented.
[0025] The present application also provides a storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the control method described in any one of the above items are implemented.
[0026] As described above, the present application provides a control method, a smart terminal and a storage medium. The control method can be applied to a smart terminal, and includes the following steps: S1, in response to a touch operation, according to a suppression strategy corresponding to the current usage scenario, eliminating the interference of liquid droplets to execute the corresponding operation instructions. Through the technical solution of the present application, when a touch operation is performed on the touch screen and there are liquid droplets on the touch screen, a suitable suppression strategy can be selected based on the current usage scenario to eliminate the interference of liquid droplets on the touch screen, so that the operation instructions corresponding to the touch operation can be accurately identified and executed. In this way, the technical solution of the present application can realize a wet screen touch function, solve the problem of false touch when there are liquid droplets on the touch screen and / or the problem of inability to perform precise touch, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.
[0028] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application;
[0029] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application;
[0030] Figure 3 A flow chart of a control method shown in an embodiment of the present application;
[0031] Figure 4 A schematic diagram of the classification process of the scene classification model shown in this application;
[0032] Figure 5 A schematic diagram of the classification process of the droplet recognition model shown in this application;
[0033] Figure 6 This is a schematic diagram of the function activation interface shown in this application.
[0034] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0035] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0036] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.
[0037] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.
[0038] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
[0039] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0040] It should be noted that in this article, step codes such as S1 and S2 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the order. When implementing the step, those skilled in the art may execute S2 first and then S1, etc., but these should all be within the scope of protection of this application.
[0041] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0042] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.
[0043] The intelligent terminal may be implemented in various forms. For example, the intelligent terminal described in the present application may include intelligent terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.
[0044] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.
[0045] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0046] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:
[0047] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile Communications), GPRS (Generic Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplex-Long Term Evolution), TDD-LTE (Time Division Duplex-Long Term Evolution), and the like. ion, time-division duplex long-term evolution), 5G and 6G, etc.
[0048] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not an essential component of the mobile terminal and can be omitted as needed without changing the essence of the invention.
[0049] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.
[0050] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.
[0051] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.
[0052] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
[0053] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.
[0054] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.
[0055] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
[0056] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0057] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.
[0058] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.
[0059] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.
[0060] In order to facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.
[0061] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.
[0062] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.
[0063] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022, etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203, and eNodeB 2021 may provide UE 201 with access to EPC 203.
[0064] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MME 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node for processing signaling between UE 201 and EPC 203, providing bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE201. PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).
[0065] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.
[0066] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.
[0067] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.
[0068] Reference Figure 3 , Figure 3 The control method according to the embodiment of the present application is a flow chart of the control method. The control method according to the embodiment of the present application can be applied to a smart terminal (such as a mobile phone), and includes the following steps (for example, step S1):
[0069] Step S1, in response to a touch operation, according to a suppression strategy corresponding to the current usage scenario, the corresponding operation instruction is executed while eliminating the interference of droplets.
[0070] Optionally, the current usage scenario may be obtained in at least one of the following ways, but is not limited to:
[0071] Get the current environment parameters and determine the corresponding scene information from the parameter-scene mapping relationship;
[0072] Acquire current environment parameters, and the scene classification model analyzes the current environment parameters to obtain scene information;
[0073] In response to the setting operation, scene information is determined.
[0074] Optionally, the current usage scenario can be determined by the aforementioned method of acquiring the scenario information.
[0075] Optionally, the current environmental parameters include at least one first specific parameter fed back by at least one sensor and a second specific parameter obtained in other ways.
[0076] Optionally, the first specific parameter (or sensor data) fed back by the sensor includes, but is not limited to: ambient light data fed back by the photosensitive device (or light sensor), ambient sound data fed back by the microphone, ambient picture data fed back by the camera, touch data fed back by the touch screen, temperature data fed back by the temperature sensor, humidity data fed back by the humidity sensor, etc.
[0077] Optionally, the at least one sensor includes but is not limited to at least one of a photosensitive device, a microphone, a camera, a temperature sensor, a humidity sensor, a touch screen, etc.
[0078] Optionally, the second specific parameters obtained by other means (for example, parameters related to the environment obtained by means other than sensors) include but are not limited to location data fed back by a positioning device, weather data corresponding to the location data obtained by networking, current operating information fed back by a processor of a smart terminal, etc.
[0079] Optionally, the environmental parameters include but are not limited to one or more of ambient light data, ambient sound data, ambient image data, touch data, temperature data, humidity data, location data, weather data, etc.
[0080] Optionally, the current usage scenario may correspond to the current usage environment of the smart terminal. For example, in a faucet environment, it may be determined as an extreme water exposure scenario (e.g., a scenario where the phone cools down or the touch screen is dirty and the touch screen is washed), or a daily water exposure scenario (e.g., a scenario where water gets on the touch screen when washing hands or vegetables, or a scenario where oil stains the screen when washing dishes); for another example, in an environment where walking in the rain at different temperatures is performed, it may be determined as a rain walking scenario (e.g., it may be refined to include a high temperature and heavy rain walking scenario, a high temperature and moderate rain walking scenario, a high temperature and light rain walking scenario, a low temperature and heavy rain walking scenario, a low temperature and moderate rain walking scenario, a low temperature and moderate rain walking scenario, a low temperature and moderate rain walking scenario, etc.) based on weather data, temperature data, and / or location data. For example, in a bathing environment, it can be determined as a bathing scene according to the ambient sound data, temperature data and / or position data (for example, it can be refined to include a bathing water touch scene, a bathing water mist scene, etc.); for example, in a daily environment, it can be determined as a daily emergency scene according to the current operation information (for example, it can be refined to include a game sudden splashing water scene, other operation interface sudden splashing water scene, etc.); for example, in an extreme environment, it can be determined as an extreme scene according to the temperature difference change data and / or position data (for example, it can be refined to include a cold and hot environment alternation scene, a steam room scene, a hot spring / swimming pool scene, a tropical rain climate scene, etc.).
[0081] Optionally, the corresponding scene information method is determined from the parameter-scene mapping relationship. The amount of data processing in the smart terminal is small, so it can be applied to smart terminals of various configuration levels and has the advantage of universality.
[0082] Optionally, the scene classification model can be obtained by training a classification model based on a pre-constructed data set.
[0083] Optionally, this embodiment illustrates a method for building a scene classification model in a smart terminal, including but not limited to at least one of the following:
[0084] 1. Collect a certain number of environmental parameters and finely annotate the scenes corresponding to each environmental parameter to build a data set;
[0085] Optionally, each environmental parameter may include one or more of weather data, location data, environmental sound data, environmental picture data, and other sensor data;
[0086] 2. Build a scene classification tree model framework based on lightgbm;
[0087] 3. Based on the data set, the scene classification tree model framework is trained to obtain a classification tree model;
[0088] 4. Debug the classification tree model to commercial standards for application in smart terminals.
[0089] Alternatively, see Figure 4 In this embodiment, a scene classification model is used to analyze the acquired current environmental parameters to obtain scene information: weather data, location data, ambient sound data, ambient image data, and other sensor data in an unknown scene are obtained and then imported into a classification tree model. The classification tree model first performs characterization processing on the aforementioned environmental parameters to obtain feature 1, feature 2, feature 3, feature 4, and feature n. The classification tree model then determines the target category to which the unknown scene belongs (for example, one of a faucet environment, walking in the rain at different temperatures, riding a motorcycle in the rain, a shower environment, daily splashing, an extreme environment, and a wiping scene) based on the aforementioned features through a lightgbm classifier to determine the scene information (for example, the current usage scene).
[0090] Optionally, using a scene classification model to analyze the current environmental parameters to obtain scene information can make the recognition of scene information more accurate, and the scene classification model can also realize a self-learning function. Among them, the self-learning function can be triggered in response to a modification operation on the target scene information after the target scene information is obtained through the scene classification model. Optionally, the self-learning function is implemented, for example, after analyzing the first environmental parameters according to the scene classification model to obtain the first usage scene, in response to switching the first usage scene to the second usage scene, the first environmental parameters are associated with the second usage scene, and input into the scene classification model to perform a model training operation. In this way, a long-term self-learning mechanism is established, which can automatically improve the recognition accuracy of the scene classification model.
[0091] Optionally, setting operations include, but are not limited to: click events of virtual function keys, gestures / slide tracks, voice commands, and other operations that can be used to select scene options.
[0092] Optionally, the suppression strategy corresponding to the current usage scenario may characterize a processing method of capacitance data and / or a control method of an application program / tool corresponding to the current usage scenario for eliminating droplet interference.
[0093] Optionally, the suppression strategy includes but is not limited to at least one of the following:
[0094] Exclude the droplet data from the capacitance data;
[0095] Reporting touch data and / or droplet data exceeding a first threshold in the capacitance data, wherein the first threshold is associated with a current usage scenario;
[0096] When the application / tool corresponding to the reported point is a disabled application / tool associated with the current usage scenario, the application corresponding to the reported point is disabled.
[0097] Optionally, the step of eliminating droplet interference to execute corresponding operation instructions may include: identifying touch data and / or droplet data from the original capacitance data according to the current usage scenario; performing reporting point control on the touch data and / or droplet data according to the suppression strategy corresponding to the current usage scenario to eliminate droplet interference to execute corresponding operation instructions.
[0098] Optionally, the touch data and / or drop data may be reported by controlling the reporting point according to the suppression strategy corresponding to the current usage scenario, thereby obtaining corresponding operation instructions according to events such as clicks and slides determined by the reporting points.
[0099] Optionally, the method of identifying touch data and / or droplet data from the original capacitance data according to the current usage scenario includes but is not limited to at least one of the following:
[0100] Determine a first threshold for suppressing droplet point reporting from the point reporting suppression threshold relationship information according to the current usage scenario, and determine touch data from the original capacitance data based on the first threshold for suppressing droplet point reporting;
[0101] Use the droplet recognition model to identify touch data and droplet data based on the current usage scenario and original capacitance data.
[0102] Optionally, the point reporting suppression threshold relationship information includes a correspondence between scene information (ie, usage scene) and a first threshold for suppressing droplet reporting.
[0103] Optionally, the reporting point suppression threshold relationship information is preset in the intelligent terminal to realize the determination of the touch reporting point, and the implementation method is simple and convenient for application implementation.
[0104] Optionally, this embodiment illustrates a method for building a droplet recognition model in a smart terminal, including but not limited to at least one of the following:
[0105] 1. Collect a certain number of data combinations including usage scenarios (i.e., scenario information), original capacitance data, etc., and finely annotate the data types (touch data / droplet data) corresponding to the original capacitance data to obtain a data set;
[0106] 2. Characterize the usage scenario according to one-hot, with the dimension equal to the screen report point width W of the smart terminal to obtain the scene feature; the original capacitance data is arranged according to the screen report point pixel size of the smart terminal: HxW to obtain the capacitance feature. The scene feature is superimposed on each row of the capacitance data in the capacitance feature to complete the feature fusion. Then connect a fully connected network and add a layer of convolutional network to increase the dimension to 224x244x3;
[0107] 3. Build a droplet recognition model framework based on CNN and ResNet;
[0108] 4. Based on the aforementioned data set, the droplet recognition model framework is trained to obtain a droplet recognition model;
[0109] 5. Adjust the droplet recognition model to commercial standards for application in smart terminals.
[0110] Alternatively, see Figure 5 This embodiment illustrates a process of using a droplet recognition model to identify touch data and droplet data according to the current usage scenario and the original capacitance data after obtaining the current usage scenario and the original capacitance data: the current usage scenario and the original capacitance data are imported into the droplet recognition model, the droplet recognition model first performs feature processing and feature fusion on the current usage scenario and the original capacitance data to obtain fusion features, and then upgrades the fusion features to 224x244x3 to obtain upgraded features, and performs capacitance classification based on the upgraded features at the binary classification nodes in the droplet recognition model to obtain touch data and droplet data.
[0111] Optionally, the touch data may be capacitance data, or other data converted based on the capacitance data. Optionally, the drop data may be capacitance data, or other data converted based on the capacitance data.
[0112] Optionally, a droplet recognition model is used to recognize touch data and droplet data according to the current usage scenario and original capacitance data, so that the recognition of touch data and droplet data can be more accurate.
[0113] In the technical solution of this embodiment, the data set for training the droplet recognition model may include the original capacitance data corresponding to the data superposition caused by water stains + hand touch, so that the trained droplet recognition model can realize the data superposition caused by water stains + hand touch and can also accurately distinguish the touch data and droplet data. The technical solution of this embodiment can suppress the droplet point reporting after accurately acquiring the touch data and droplet data, thereby avoiding ghost points, touch point elimination, jump points, line bending or line break, etc., so that the technical solution of this embodiment can realize accurate touch control of the touch screen and / or avoid or reduce false touches.
[0114] Optionally, the smart terminal of this embodiment may preset a function corresponding to the liquid drop touch situation, so that after the function is turned on, step S1 may be executed. Figure 6 Turn on the "Rain Function" in the settings interface.
[0115] The technical solution of this embodiment includes the steps: S1, in response to a touch operation, according to a suppression strategy corresponding to the current usage scenario, eliminating the interference of liquid droplets to execute the corresponding operation instructions. Through the technical solution of the present application, when a touch operation is performed on the touch screen and there are liquid droplets on the touch screen, it is possible to select a suitable suppression strategy based on the current usage scenario to eliminate the interference of liquid droplets on the touch screen, so that the operation instructions corresponding to the touch operation can be accurately identified and executed. In this way, the technical solution of this embodiment can realize the wet screen touch function, solve the problem of false touches and / or the problem of inability to perform precise touches when there are liquid droplets on the touch screen. Therefore, the technical solution of this embodiment can enable the user to accurately touch the touch screen and / or avoid or reduce false touches when operating the touch screen with liquid droplets, thereby improving the user experience.
[0116] Optionally, the method of this embodiment may further include the following steps: S2, sending the suppression strategy to associated terminals within a preset distance range.
[0117] Optionally, the associated terminal may be another terminal that establishes a communication connection with the smart terminal or another terminal that is logged in using the same account as the smart terminal.
[0118] The technical solution of this embodiment can transplant the suppression strategy to other terminals of the user in the same usage environment, so that the user can accurately touch the touch screen of the associated terminal and / or avoid or reduce false touches in the same usage environment, thereby improving the user experience. In addition, the technical solution of this embodiment can also enable the associated terminal that is not directly configured with the wet screen touch function in hardware and / or software to have the wet screen touch function.
[0119] Optionally, the method of this embodiment may further include the following steps: S3, adjusting the screen control parameters of the touch screen according to the detected current environmental parameters according to the first preset strategy. In this way, the technical solution of this embodiment can adjust the screen control parameters of the touch screen according to the current use environment to achieve precise touch and / or avoid or reduce false touches, thereby improving the user experience.
[0120] Optionally, the first preset strategy includes but is not limited to at least one of the following:
[0121] When it is detected that the current ambient temperature is lower than a preset temperature threshold, the touch sensitivity of at least a part of the touch screen is increased;
[0122] When it is detected that the current touch area is larger than a preset area threshold, reducing the touch sensitivity of at least a part of the touch screen;
[0123] When it is detected that the current moving speed is greater than a preset speed value, the touch sensitivity and / or display parameters of the non-target area in the touch screen are reduced.
[0124] Optionally, the option to adjust the sensitivity specifically improves the screen sensitivity through the following principles:
[0125] 1. Adjust the touch threshold
[0126] The sensitivity option usually allows users to adjust the touch threshold, which is the minimum force or signal strength required for the screen to recognize a touch action. By lowering this threshold, the screen can more easily detect weak touch signals, thereby increasing touch sensitivity. In this way, even a slight touch can be accurately captured and responded to by the screen.
[0127] 2. Optimizing signal processing technology
[0128] Adjusting the sensitivity option may also involve optimizing the touch signal processing technology. There will be a set of algorithms inside the phone to process touch signals. By adjusting these algorithms, touch input can be interpreted more accurately, reducing false touches and delays, thereby improving touch sensitivity.
[0129] 3. Improve capacitive sensing
[0130] For capacitive touch screens (capacitive screens for short), sensitivity options may also include adjustments to capacitive sensing. Capacitive screens determine touch locations by sensing changes in capacitance between a finger and the screen. Adjusting sensitivity can optimize the sensitivity and accuracy of capacitive sensing, allowing the capacitive screen to respond to touch operations more quickly.
[0131] 4. Enhanced signal amplification and filtering
[0132] Improving sensitivity may also include amplifying and filtering the touch signal. By increasing the amplification factor of the signal, weak touch signals can be captured more accurately. At the same time, by filtering out noise and interference signals, the accuracy and sensitivity of touch can be further improved.
[0133] Optionally, a strategy for increasing the touch sensitivity of at least part of the touch screen when it is detected that the current ambient temperature is lower than a preset temperature threshold can be applied in low-temperature rain scenarios where the user may be wearing gloves. Increasing the touch sensitivity of the touch screen of the entire smart terminal can improve the touch experience.
[0134] Optionally, when it is detected that the current touch area is larger than the preset area threshold, the strategy of reducing the touch sensitivity of at least part of the touch screen can be applied in scenes such as wiping / flushing / splashing water to reduce the sensitivity of the touch screen and avoid accidental touches. Specific situations where the current touch area is detected to be larger than the preset area threshold include touching the screen after wiping with mist or water droplets, rubbing water with clothes or hands after rain, suddenly encountering water splashing in the game, or when the mobile phone is placed on the desktop and hot water, coffee, or cold water is suddenly spilled.
[0135] Optionally, after detecting that the current touch area is larger than a preset area threshold, reducing the touch sensitivity of at least part of the touch screen area, it may include: detecting that the current humidity reaches the humidity threshold, terminating the target application and / or powering off. In this way, the technical solution of this embodiment can terminate the target application and / or power off after determining that there is a risk of water ingress when there is a sudden splash of water to minimize the possibility of moisture and damage to electrical components.
[0136] Optionally, when it is detected that the current moving speed is greater than a preset speed value, the strategy of reducing the touch sensitivity and / or display parameters of non-target areas in the touch screen can be applied in riding scenarios (for example, motorcycle riding scenarios for deliverymen). Thus, when the moving speed is high, only the touch sensitivity of some commonly used areas is retained to ensure riding safety, and / or the display parameters of non-target areas in the touch screen are reduced (including but not limited to display brightness, display resolution, display color gamut, etc.), so that the user's line of sight can be quickly located in the target area and the content of the target area can be quickly viewed when riding.
[0137] Optionally, the method of this embodiment further includes the following steps: S4, according to the second preset strategy, according to the detected current environment parameters, closing at least part of the currently running applications and / or tools. In this way, the technical solution of this embodiment can close at least part of the currently running applications and / or tools according to the current use environment to avoid or reduce false touches and / or optimize the operating state, thereby improving the user experience.
[0138] Optionally, the second preset strategy includes but is not limited to at least one of the following:
[0139] When it is detected that the current moving speed is greater than a preset speed value, closing at least part of the currently running applications and / or tools;
[0140] Speed-application / tool mapping relationship, close the application and / or tool corresponding to the current movement speed;
[0141] When it is detected that the current ambient temperature is greater than a preset temperature value, closing at least part of the currently running applications and / or tools;
[0142] Temperature-application / tool mapping relationship, close the application and / or tool corresponding to the current ambient temperature.
[0143] Optionally, when it is detected that the current moving speed is greater than a preset speed value, the strategy of closing at least part of the currently running applications and / or tools can be applied to riding scenarios (such as motorcycle riding scenarios for deliverymen, bicycle riding scenarios, etc.). Therefore, when the riding speed is too fast on rainy days, entertainment applications (such as video playback applications, game applications, etc.) and information input tools (such as keyboards, information input boxes, etc.) mainly implemented by visual interfaces can be closed to avoid or reduce accidental touches and / or only retain voice input tools to ensure riding safety, thereby improving the user experience.
[0144] Optionally, when it is detected that the current moving speed is greater than a preset speed value, the main interface of at least part of the currently running applications and / or tools is closed, and the commonly used function buttons in the aforementioned applications and / or tools are retained. In this way, the technical solution of this embodiment can facilitate user touch.
[0145] Optionally, when it is detected that the current ambient temperature is greater than a preset temperature value, a strategy is adopted to shut down at least some of the currently running applications and / or tools. When the ambient temperature is overheated, applications and / or tools with higher computing power or higher running heat can be shut down to optimize the running status and prevent the smart terminal from further overheating.
[0146] Optionally, the following steps are further included: S0, when it is detected that the ambient temperature difference between the current usage scene and the previous usage scene is greater than a preset temperature difference value, execute S1. In this way, the technical solution of this embodiment can determine that when the ambient temperature difference is lower than a certain value, when it is determined that there may be droplets on the touch screen (such as water droplets formed by hot air meeting cold air) that will affect the touch accuracy, then a suitable suppression strategy can be selected based on the current usage scene to eliminate the droplet interference on the touch screen, so that the operation instruction corresponding to the touch operation can be accurately identified and executed.
[0147] An embodiment of the present application further provides an intelligent terminal, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the steps of the control method in any of the above embodiments are implemented.
[0148] An embodiment of the present application further provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the control method in any of the above embodiments are implemented.
[0149] In the embodiments of the smart terminal and storage medium provided in the present application, all technical features of any of the above-mentioned control method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.
[0150] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.
[0151] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.
[0152] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0153] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0154] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0155] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0156] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.
[0157] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0158] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.
[0159] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.
[0160] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integration. Available media can be magnetic media, (e.g., floppy disk, storage disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state storage disk So lid State Dis sk (SSD)), etc.
[0161] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A control method, characterized in that: The following steps are involved: S1, in response to a touch operation, according to a suppression strategy corresponding to the current usage scenario, eliminating the interference of droplets and executing the corresponding operation instruction.
2. The control method according to claim 1, characterized in that: The current usage scenario is obtained by at least one of the following methods: Obtaining a current environmental parameter fed back by at least one sensor, and determining corresponding scene information from a parameter-scene mapping relationship; A current environment parameter fed back by at least one sensor is obtained, and a scene classification model analyzes the current environment parameter to obtain scene information; In response to the setting operation, scene information is determined.
3. The control method according to claim 2, characterized in that: The following steps are also included: S2: Send the suppression strategy to associated terminals within a preset distance range.
4. The control method according to claim 1, characterized in that: The following steps are also included: S3, adjusting the screen control parameters of the touch screen according to the detected current environmental parameters according to the first preset strategy.
5. The control method according to claim 4, characterized in that: The first preset strategy includes at least one of the following: When it is detected that the current ambient temperature is lower than a preset temperature threshold, the touch sensitivity of at least a part of the touch screen is increased; When it is detected that the current touch area is larger than a preset area threshold, reducing the touch sensitivity of at least a part of the touch screen; When it is detected that the current moving speed is greater than a preset speed value, the touch sensitivity and / or display parameters of the non-target area in the touch screen are reduced.
6. The control method according to claim 1, characterized in that: The following steps are also included: S4: According to a second preset strategy and based on the detected current environment parameters, close at least part of the currently running application programs and / or tools.
7. The control method according to claim 6, characterized in that: The second preset strategy includes at least one of the following: When it is detected that the current moving speed is greater than a preset speed value, closing at least part of the currently running applications and / or tools; Speed-application / tool mapping relationship, close the application and / or tool corresponding to the current movement speed; When it is detected that the current ambient temperature is greater than a preset temperature value, closing at least part of the currently running applications and / or tools; Temperature-application / tool mapping relationship, close the application and / or tool corresponding to the current ambient temperature.
8. The control method according to any one of claims 1 to 7, characterized in that: The following steps are also included: S0, when it is detected that the ambient temperature difference between the current usage scenario and the previous usage scenario is greater than a preset temperature difference value, execute S1.
9. An intelligent terminal, characterized in that: include: A memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the control method according to any one of claims 1 to 8 is implemented.
10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the control method according to any one of claims 1 to 8 is implemented.
Citation Information
Cited By
Scene classification method and device applied to touch system
TWI904969B
