Touch operation method and electronic device

Abstract

The present application discloses a touch operation method and an electronic device, belonging to the field of terminal technology, the method includes responding to a user's one-handed mode trigger operation, the electronic device enters the one-handed operation mode; when the electronic device is in the one-handed operation mode, in response to a first touch operation input by the user via a pressure-sensitive key, at least one controllable item in the target control area in the first interface is sequentially in a selectable state; when the target controllable item is in a selectable state, in response to a second touch operation input by the user via a pressure-sensitive key, the target controllable item in the selectable state is selected, and the function corresponding to the target controllable item in the selectable state is triggered. In this way, even when the electronic device is held in one hand, each area on the screen can be controlled by the pressure-sensitive key, thereby improving the user's touch experience when holding the electronic device in one hand.

Description

Technical Field

[0001] The present application belongs to the field of terminal technology, and in particular relates to a touch operation method and an electronic device. Background Art

[0002] With the development of electronic devices such as smart phones, the screen size of electronic devices is getting larger and larger. Users can interact with electronic devices by touching the screen. Large-size screens can bring users a wider control area and more comfortable visual enjoyment, improving user experience.

[0003] However, large-size screens also bring some operational inconveniences to users. For example, when a user holds an electronic device in one hand, due to the large screen size of the electronic device, the finger is usually unable to control all areas of the screen, thereby affecting the user's control experience.

[0004] Therefore, how to improve the control experience when holding an electronic device with one hand is a technical problem that urgently needs to be solved. Summary of the invention

[0005] The present application provides a touch operation method and an electronic device, which can solve the problem that all areas of the screen cannot be controlled when holding the electronic device with one hand.

[0006] In a first aspect, the present application provides a touch operation method, which is applied to an electronic device, wherein the electronic device includes at least one pressure-sensitive button, and the at least one pressure-sensitive button is used to receive a touch operation input by a user. The method includes: the electronic device displays a first interface, wherein the first interface includes at least one controllable item; in response to a user's one-handed mode trigger operation, the electronic device enters a one-handed operation mode; when the electronic device is in the one-handed operation mode, in response to a first touch operation input by the user via the pressure-sensitive button, at least one controllable item in a target control area in the first interface is sequentially in a selectable state; when a target controllable item among the at least one controllable item is in a selectable state, in response to a second touch operation input by the user via the pressure-sensitive button, the target controllable item in the selectable state is selected, and a function corresponding to the target controllable item in the selectable state is triggered.

[0007] In this way, the user can input different touch operations on the pressure-sensitive buttons that can be touched by one hand to control the content of any area in the user interface. In this way, even when holding the electronic device with one hand, the pressure-sensitive buttons can be used to control each area on the screen, thereby improving the user's touch experience when holding the electronic device with one hand.

[0008] In one implementable manner, in response to a first touch operation input by a user via the pressure-sensitive button, before at least one controllable item in the target control area in the first interface is sequentially in a selectable state, it also includes: determining the target control area in the first interface based on an eye movement recognition algorithm or an angle recognition algorithm; displaying a second interface based on the target control area; displaying the target control area in the second interface using a first display mode, and displaying the area in the second interface other than the target control area using a second display mode, and the first display mode and the second display mode are different.

[0009] In this way, based on the eye movement recognition algorithm or the angle recognition algorithm, the selection area can be narrowed down, thereby quickly locating the target controllable item.

[0010] In one implementable manner, based on the eye movement recognition algorithm, the target control area is determined in the first interface, including: when the electronic device is in a one-handed operation mode, collecting a user's facial image; processing the user's facial image to obtain the user's eye movement data; and based on the eye movement data, determining the target control area in the first interface.

[0011] In this way, when the user gazes at the target controllable item, the user's facial image can be collected, and eye movement recognition processing can be performed on the user's facial image to determine the user's gaze area, that is, the target control area.

[0012] In one implementable manner, based on the angle recognition algorithm, the target control area is determined in the first interface, including: when the electronic device is in a one-handed operation mode, obtaining a first angle of the electronic device; when the angle of the electronic device changes from the first angle to a second angle, and the electronic device maintains the second angle for a period longer than a second preset period, determining the tilt angle of the electronic device based on the first angle and the second angle; based on the tilt angle of the electronic device, determining the target control area in the first interface.

[0013] When a user holds an electronic device with one hand, the tilt angle of the electronic device can reflect the screen range that the user expects to manipulate. Therefore, the present application can use an angle recognition algorithm to identify the tilt angle of the electronic device when the user holds the electronic device, and then determine the target manipulation area that the user expects to manipulate based on the tilt angle of the electronic device.

[0014] In one implementable method, based on the tilt angle, the target control area is determined in the first interface, including: obtaining a mapping relationship between multiple preset angles and each display area of ​​the electronic device; based on the mapping relationship, determining the target control area corresponding to the tilt angle in the first interface.

[0015] In one implementable manner, displaying a second interface based on the target control area includes: encircling the target control area in a graphic frame on the second interface; or, displaying each controllable item in the target control area in the first display style on the second interface, and displaying the controllable items in the second interface except the target control area in the second display style, wherein the first display style is different from the second display style.

[0016] In this way, the user can determine the location of the target control area through the second interface displayed on the screen.

[0017] In one implementable manner, in response to a first touch operation input by a user via the pressure-sensitive button, at least one controllable item in a target control area in the first interface is sequentially in a selectable state, including: within a first preset time period starting from the start of the electronic device displaying the second interface, in response to a first touch operation input by a user via the pressure-sensitive button, at least one controllable item in the target control area in the first interface is sequentially in a selectable state.

[0018] In an implementable manner, the first touch operation includes a sliding operation, and the second touch operation includes a pressing operation.

[0019] In one implementable manner, in response to a first touch operation input by a user via the pressure-sensitive key, at least one controllable item in a target control area in the first interface is sequentially in a selectable state, including: in response to a first sub-touch operation input by a user via the pressure-sensitive key, determining a starting position of a cursor, and moving the cursor along a first coordinate axis in the first interface; wherein, when the cursor resides on a first controllable item in the target control area, the first controllable item is in a selectable state; the first controllable item is any one of the at least one controllable items; and / or, in response to a second sub-touch operation input by a user via the pressure-sensitive key, the cursor moves along a second coordinate axis in the first interface, and the first coordinate axis and the second coordinate axis are perpendicular to each other; wherein the first touch operation includes the first sub-touch operation and / or the second sub-touch operation.

[0020] In this way, by inputting different touch operation types to the pressure-sensitive buttons, the cursor can be controlled to move in two dimensions, the X-axis and the Y-axis, so that a controllable item at any position on the user interface can be selected by the cursor.

[0021] In an implementable manner, the first sub-touch operation includes a sliding operation, the second sub-touch operation includes a hands-on pressing operation, and the second touch operation includes a hands-off operation.

[0022] In one implementable manner, the cursor moves along the second coordinate axis on the first interface, including: obtaining the pressure value of the second sub-touch operation; determining the target movement direction of the cursor along the second coordinate axis on the first interface based on the pressure value; and the cursor moves in the target movement direction along the second coordinate axis.

[0023] In this way, by applying different pressures to the pressure-sensitive buttons, the cursor can be controlled to move freely in two directions of a coordinate axis. In this way, even when holding the electronic device with one hand, every area on the screen can be controlled, improving the user's touch experience when holding the electronic device with one hand.

[0024] In one implementable method, based on the pressure value, the target moving direction of the cursor along the second coordinate axis in the first interface is determined, including: when the pressure value gradually increases, the target moving direction is determined to be the first direction of the second coordinate axis; when the pressure value gradually decreases, the target moving direction is determined to be the second direction of the second coordinate axis; the first direction and the second direction are two opposite directions.

[0025] In one implementable manner, the at least one pressure-sensitive button includes a first pressure-sensitive button and a second pressure-sensitive button, and the first pressure-sensitive button and the second pressure-sensitive button are relatively arranged on two sides of the electronic device; determining the starting position of the cursor includes: determining the pressure-sensitive button that receives the first sub-touch operation; when the pressure-sensitive button that receives the first sub-touch operation is the first pressure-sensitive button, determining the starting position of the cursor to be a position away from the first pressure-sensitive button; when the pressure-sensitive button that receives the first sub-touch operation is the second pressure-sensitive button, determining the starting position of the cursor to be a position away from the second pressure-sensitive button.

[0026] In this way, the optimal starting position of the cursor is determined based on the left and right hands of the user holding the electronic device, so that the cursor is focused from the optimal starting position and the target controllable item can be selected as quickly as possible.

[0027] In one implementable manner, in response to a user's one-handed mode trigger operation, the electronic device enters the one-handed operation mode, including: in response to a third touch operation input by the user via the pressure-sensitive button, the electronic device enters the one-handed operation mode; or, in response to a click operation input by the user via the one-handed operation mode control on the first interface, the electronic device enters the one-handed operation mode; wherein the third touch operation is a single press operation or a double press operation, and wherein the time interval between the two press operations is less than a preset time interval.

[0028] In this way, the one-handed mode can be triggered in a variety of ways.

[0029] In an implementable manner, a display style of the target controllable item when it is in a selectable state is different from a display style of other controllable items in the first interface except the target controllable item.

[0030] In this way, the user can determine the controllable items that are currently in a selectable state based on the display styles of the controllable items in the user interface.

[0031] In an implementable manner, the display styles include a highlight display style, a suspended display style, a dynamic display style, an enlarged display style, and a reduced display style.

[0032] In one achievable manner, the manipulable items include controls and links.

[0033] In a second aspect, the present application provides a touch operation method, which is applied to an electronic device, wherein the electronic device includes a pressure-sensitive button, and the pressure-sensitive button is used to receive a touch operation input by a user. The method includes: the electronic device displays a first interface; in response to a fourth touch operation input by the user via the pressure-sensitive button, upon receiving a zoomable notification message, determining a target zoom area in the first interface; wherein the zoomable notification message is used to notify that the first interface includes zoomable content; determining a zoom focus for zooming the zoomable content in the target zoom area; and in response to a fifth touch operation input by the user via the pressure-sensitive button, zooming the zoomable content based on the zoom focus.

[0034] In this way, if the user interface includes scalable content, the target zoom area can be determined based on the eye movement recognition algorithm or the angle recognition algorithm. The zoom focus is further determined in the target zoom area. In this way, the zoomable content can be zoomed based on the zoom focus by sliding up or sliding down on the pressure-sensitive key input. In this way, even when the electronic device is held in one hand, the function of zooming each area on the screen can be realized, thereby improving the touch experience of the user when holding the electronic device in one hand.

[0035] In an implementable manner, determining a zoom focus for zooming the zoomable content in the target zoom area includes: determining a center of the target zoom area as the zoom focus for zooming the zoomable content.

[0036] In one implementable manner, in response to a fifth touch operation input by the user via a pressure-sensitive key, a zoom operation is performed on the zoomable content based on the zoom focus, including: when the fifth touch operation is an upward sliding operation, based on the zoom focus, a zoomable content is enlarged based on the zoom focus; when the fifth touch operation is a downward sliding operation, a zoomable content is reduced based on the zoom focus; or, when the fifth touch operation is a downward sliding operation, a zoomable content is enlarged based on the zoom focus; when the fifth touch operation is an upward sliding operation, a zoomable content is reduced based on the zoom focus.

[0037] In one implementable manner, in response to a fifth touch operation input by a user via a pressure-sensitive key, after performing a zoom operation on the zoomable content based on the zoom focus, the further comprising: displaying a third interface after the zoom operation on the zoomable content, the third interface comprising at least one controllable item; in response to a first touch operation input by a user via the pressure-sensitive key, at least one controllable item in a target control area in the third interface is sequentially in a selectable state; when a target controllable item among the at least one controllable item is in a selectable state, in response to a second touch operation input by the user to the pressure-sensitive key, the target controllable item in the selectable state is selected, and a function corresponding to the target controllable item in the selectable state is triggered.

[0038] In a third aspect, the present application provides an electronic device, comprising a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, the computer program code comprises computer instructions, and when the processor executes the computer instructions, the electronic device executes a method as described in any one of the first aspect or the second aspect.

[0039] In a fourth aspect, the present application provides a computer-readable storage medium, characterized in that a computer program or instructions is stored in the computer-readable storage medium, and when the computer program or instructions are executed on a computer, the computer executes a method as described in any one of the first aspect or the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the embodiments or the technical solutions in the prior art will be briefly introduced below in conjunction with the accompanying drawings. Obviously, the accompanying drawings only show some embodiments of the present invention. For ordinary technicians in this field, other embodiments can be obtained based on these embodiments without paying creative work.

[0041] Figure 1 A schematic diagram of an application scenario of a touch operation provided in an embodiment of the present application;

[0042] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0043] Figure 3 A software framework diagram of an electronic device provided in an embodiment of the present application;

[0044] Figure 4 A schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application;

[0045] Figure 5 A schematic diagram of a workflow of a touch operation method provided in Embodiment 1 of the present application;

[0046] Fig. 6A An example diagram of a user interface including a gaze area provided in an embodiment of the present application;

[0047] Figure 6B Another example diagram of a user interface including a gaze area provided in an embodiment of the present application;

[0048] Figure 7 This is an example diagram of a user interface corresponding to a focus change operation provided in the first embodiment of the present application;

[0049] Figure 8 A schematic diagram of a workflow of a touch operation method provided in Embodiment 2 of the present application;

[0050] Fig. 9 A schematic diagram of a work flow of a touch operation method provided in Embodiment 3 of the present application;

[0051] Fig. 10A This is an example diagram of a user interface corresponding to a focus change operation provided in Embodiment 3 of the present application;

[0052] Fig. 10B This is another example diagram of a user interface corresponding to performing a focus change operation provided in Embodiment 3 of the present application;

[0053] Fig.11 A schematic diagram of a workflow diagram of a touch operation method provided in Embodiment 4 of the present application;

[0054] Fig.12 An example diagram of a user interface corresponding to a zoom operation provided in Embodiment 4 of the present application;

[0055] Fig.13 A schematic diagram of a workflow diagram of a touch operation method provided in an embodiment of the present application;

[0056] Fig.14 A schematic diagram of a workflow diagram of another touch operation method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] With the development of electronic devices such as smart phones, the screen size of electronic devices is getting larger and larger. Large screens can provide users with a wider control area and more comfortable visual enjoyment, improving user experience. However, large screens also bring some operational inconveniences to users. For example, when a user holds an electronic device with one hand, due to the large screen size of the electronic device, the finger usually cannot control all areas of the screen, thus affecting the user's control experience.

[0058] For example, Figure 1 As shown, when the user holds the electronic device 100 in one hand, the finger can touch the display area 3 well, but it is difficult for the finger to touch the display area 1, the display area 2 and the display area 4.

[0059] To solve the above problems, an embodiment of the present application provides a touch operation method, which is applied to an electronic device with a pressure-sensitive button. After entering the one-handed operation mode, if the method detects a first touch operation of the user on the pressure-sensitive button, the controllable items in the user interface of the electronic device are controlled to be in a selectable state in sequence; if the target controllable item is in a selectable state, in response to detecting a second touch operation on the pressure-sensitive button, the target controllable item is selected, and the function corresponding to the target controllable item is triggered. In this way, the user can input different touch operations on the pressure-sensitive buttons that can be touched by one hand to realize the control of the content of any area in the user interface, thereby improving the user's control experience when holding the electronic device with one hand.

[0060] In the embodiments of the present application, the electronic device may be a device with a touch screen and pressure-sensitive buttons, including but not limited to smart phones, tablet computers, wearable devices, augmented reality (AR) / virtual reality (VR) devices, netbooks, personal digital assistants (PDA), artificial intelligence (AI) terminals, and other terminal devices. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0061] The following takes the electronic device 100 as a smart phone as an example to exemplarily illustrate the hardware structure of the electronic device 100.

[0062] like Figure 2 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0063] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0064] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0065] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0066] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0067] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0068] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0069] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0070] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0071] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0072] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0073] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0074] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0075] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0076] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0077] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0078] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0079] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0080] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0081] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0082] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0083] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0084] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0085] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0086] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0087] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0088] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0089] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0090] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0091] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0092] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0093] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0094] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0095] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0096] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A. A plurality of speakers 170A can be provided in the electronic device 100. For example, a speaker 170A can be provided on the top of the electronic device 100, and a speaker 170A can also be provided on the bottom, and so on.

[0097] The receiver 170B, also called a "receiver", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the receiver 170B can be placed close to the human ear to receive the voice. In some embodiments, the speaker 170A and the receiver 170B can also be set as one component, which is not limited in the present application.

[0098] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0099] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0100] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0101] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0102] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0103] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0104] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0105] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0106] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0107] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0108] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0109] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0110] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0111] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0112] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0113] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0114] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0115] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0116] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0117] Figure 3 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0118] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0119] The application layer can include a series of application packages.

[0120] like Figure 3 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0121] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0122] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0123] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0124] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0125] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0126] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0127] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0128] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0129] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0130] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0131] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0132] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0133] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0134] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0135] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0136] A 2D graphics engine is a drawing engine for 2D drawings.

[0137] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0138] The touch operation method of the embodiment of the present application is described in detail below.

[0139] The touch operation method provided in the embodiment of the present application can be applied to an electronic device with a pressure-sensitive button. First, the pressure-sensitive button in the embodiment of the present application is described.

[0140] like Figure 4 As shown, a touch-sensitive button, also called a pressure-sensitive button 190A, is provided on the electronic device 100. The pressure-sensitive button 190A can be provided at a position that can be touched by a finger when the electronic device is held in one hand. For example, the pressure-sensitive button 190A can be located on the side of the electronic device 100, at the same position as the volume button.

[0141] In the embodiment of the present application, the electronic device 100 may include one or more pressure-sensitive buttons 190A. For example, two pressure-sensitive buttons 190A may be included. If the electronic device 100 includes two pressure-sensitive buttons 190A, the two pressure-sensitive buttons 190A may be respectively arranged on two opposite sides of the electronic device 100. In this way, when the user holds the electronic device with one hand in the left hand, the pressure-sensitive button 190A located on the left side of the electronic device can be touched; when the user holds the electronic device with one hand in the right hand, the pressure-sensitive button 190A located on the right side of the electronic device can be touched.

[0142] When a finger touches the pressure-sensitive key 190A, the pressure-sensitive key 190A can identify touch information such as the pressure, position, and duration of the finger touching the pressure-sensitive key 190A, and can determine the type of touch operation based on the touch information.

[0143] Exemplarily, the touch operation types in the embodiments of the present application may include: a press operation, a slide operation, a press operation without releasing the hand, and a release operation.

[0144] A pressing operation refers to a touch operation that acts on the same touch position for a short time. That is, after the finger touches the pressure-sensitive key 190A, it quickly leaves the pressure-sensitive key 190A. The time the finger stays on the pressure-sensitive key 190A is less than the pressing time threshold.

[0145] The pressing operation can be divided into multiple pressing operation types according to the size of the touch pressure of the touch pressure-sensitive key 190A. For example, the pressing operation where the touch pressure value F satisfies F<F1 can be called a light touch pressing operation; the pressing operation where the touch pressure value F satisfies F1≤F<F2 can be called a light press pressing operation; and the pressing operation where the touch pressure value F satisfies F2≤F can be called a heavy press pressing operation. Among them, 0≤F1<F2.

[0146] The sliding operation refers to an operation in which a finger touches the pressure-sensitive key 190A and generates a displacement on the pressure-sensitive key 190A that is greater than or equal to the movement threshold. The sliding operation can be divided into an upward sliding operation and a downward sliding operation. Among them, the upward sliding operation refers to the finger sliding on the pressure-sensitive key 190A from bottom to top, and the downward sliding operation refers to the finger sliding on the pressure-sensitive key 190A from top to bottom.

[0147] The continuous pressing operation refers to a touch operation that acts on the same touch position for a long time. That is, after the finger touches the pressure-sensitive key 190A, it continues to press the pressure-sensitive key 190A for a period of time without leaving the pressure-sensitive key 190A. The time that the finger stays on the pressure-sensitive key 190A is greater than or equal to the pressing time threshold.

[0148] The hand-off operation refers to the operation in which the finger leaves the pressure-sensitive button 190A after completing a touch operation such as a pressing operation or a sliding operation.

[0149] It should be noted that the above description only uses the examples that the touch operation types may include: press operation, press operation without releasing the hand, slide operation and release operation, and does not represent a limitation on the touch operation types. In actual applications, more operation types can be designed according to the application scenarios.

[0150] It should also be noted that the above only uses the pressing operation including light touch pressing operation, light press pressing operation and hard press pressing operation as an example for illustrative explanation. In actual applications, the pressure value can be divided into more pressure levels according to the actual application scenario, so as to design more operation types.

[0151] The touch operation method provided in the embodiment of the present application is described below with reference to the accompanying drawings.

[0152] Embodiment 1

[0153] Figure 5 This is a flow chart of a touch operation method provided in Embodiment 1 of the present application. Figure 5 As shown, the method may include the following steps:

[0154] S201, detecting whether the screen status of the electronic device is in a bright screen status.

[0155] The screen status of an electronic device includes a screen-on status and a screen-off status.

[0156] In some embodiments, the detection of the screen state of the electronic device can be implemented in the following manner: since the screen can light up the screen in response to the screen lighting instruction sent by the application framework layer, the screen state of the electronic device is the screen-on state. Based on this, the embodiment of the present application can detect whether the screen of the electronic device receives the screen lighting instruction, and when it is detected that the screen of the electronic device receives the screen lighting instruction, the screen state is determined to be the screen-on state. When it is not detected that the screen of the electronic device receives the screen lighting instruction, the screen state is determined to be the screen-off state.

[0157] It should be noted that the above embodiment is only illustrative of detecting whether the screen of an electronic device receives a screen lighting instruction, and does not limit the method of detecting the screen state of the electronic device. For example, other parameters or instructions of the electronic device that can characterize the screen state of the electronic device can also be detected.

[0158] S202: When the screen is in the on state, determine whether a light touch and press operation of a pressure-sensitive key by a user is detected.

[0159] When the screen is in the bright screen state, a user interface is displayed on the screen of the electronic device, and the user interface may include one or more controllable items such as application controls and links.

[0160] If the screen area currently desired to be touched is an area that cannot be touched when holding the electronic device with one hand, the user can lightly touch and press the pressure-sensitive button to trigger the one-hand operation mode. In the one-hand operation mode, the user can control the screen area by inputting different touch operations on the pressure-sensitive button.

[0161] In this way, if the electronic device detects a light touch and press operation on the pressure-sensitive key, it enters the one-handed operation mode and further executes the following step 203; otherwise, the following step 203 will not be triggered to reduce the power consumption of the electronic device.

[0162] S203: when a light touch and press operation of the user on the pressure-sensitive button is detected, an eye movement recognition function is started, and an eye movement recognition algorithm in the eye movement recognition function is used to determine a gaze area of ​​the user.

[0163] For example, Figure 1 As shown, when the user operates the electronic device with one hand in the right hand and wants to control a controllable item in the display area 1, the finger cannot touch the display area 1. In this case, the user can touch the pressure-sensitive button to trigger the eye movement recognition function and run the eye movement recognition algorithm in the eye movement recognition function. After touching the pressure-sensitive button, the user can look at the controllable item that the user wants to control, so that the electronic device can identify the gaze area including the controllable item that the user wants to control based on the eye movement recognition algorithm.

[0164] Eye movement recognition algorithm is a technology that tracks the user's eye movements through the camera device of an electronic device and then analyzes the user's gaze area to achieve human-computer interaction.

[0165] In one possible implementation, determining the user's gaze area based on the eye movement recognition algorithm can be implemented in the following manner: in response to detecting the user's light touch and press operation on the pressure-sensitive button, the camera device of the electronic device captures the image to be recognized of the user's face, and performs eye movement recognition processing on the image to be recognized through the eye movement recognition algorithm, thereby obtaining the user's current eye movement data; based on the user's current eye movement data, the user's gaze area can be predicted. The gaze area is the screen area that the user wants to touch.

[0166] It should be noted that the eye movement recognition algorithm in the embodiment of the present application can be any eye movement recognition algorithm in the related art. For example, the eye movement recognition algorithm can be a pre-trained eye movement recognition model, so that after the camera device captures the image to be recognized of the user's face, the image to be recognized is input into the eye movement recognition model to obtain the user's gaze area.

[0167] It should also be noted that the size of the gaze area in the embodiment of the present application may be related to the accuracy of the eye movement recognition algorithm. If the accuracy of the eye movement recognition algorithm is high, the size of the identified gaze area may be relatively small. If the accuracy of the eye movement recognition algorithm is poor, the size of the identified gaze area may be relatively large. For example, some eye movement recognition algorithms can directly locate the gaze area to an area that only includes target controllable items. For another example, some eye movement recognition algorithms can locate the gaze area to an area that includes multiple controllable items (e.g., the gaze area is one sixteenth of the total area of ​​the screen of the electronic device). In this way, the gaze area can cover an area of ​​content on the user interface, thereby reducing the range of selecting target controllable items on the screen.

[0168] S204: Lock the gaze area on the user interface of the electronic device.

[0169] After the gaze area is determined, the gaze area is locked in the user interface of the electronic device so that the user can distinguish the gaze area from other areas in the user interface.

[0170] The embodiments of the present application do not limit the specific implementation method of locking the gaze area in the user interface of the electronic device, as long as the gaze area can be distinguished from other areas in the user interface.

[0171] In one possible implementation, the fixation area can be enclosed in a graphic frame in the user interface. In this way, the user can determine that the area enclosed by the graphic frame is the fixation area based on the displayed user interface. Fig. 6A As shown, the gaze area includes a clock control, a calendar control, a file management control, and a calculator control.

[0172] In one possible implementation, the controllable items in the gaze area may be displayed in a first display style in the user interface, and the controllable items in other areas of the user interface except the gaze area may be displayed in a second display style; the first display style is different from the second display style. The display style of the controllable items may include a highlight display style, a suspended display style, a dynamic display style, an enlarged display style, a reduced display style, etc. As long as the controllable items in the gaze area can be distinguished from other items, this application does not limit the specific form of the display style.

[0173] For example, Figure 6B As shown, the clock control, calendar control, file management control and calculator control in the fixation area can be enlarged and displayed, and the size of the application controls in other areas can be kept unchanged. In this way, the user can determine the location of the fixation area based on the display of the user interface.

[0174] S205: Determine whether a sliding operation of the user on the pressure-sensitive key is detected within a preset time period.

[0175] The preset duration refers to the preset duration from when the electronic device locks the gaze area. If a sliding operation of the user on the pressure-sensitive key is detected within the preset duration, the following step S206 is executed; otherwise, the process ends.

[0176] S206: When a sliding operation of the user on the pressure-sensitive button is detected within a preset time period, a focus operation is performed on each controllable item in the gaze area, so that each controllable item in the gaze area is sequentially in a selectable state.

[0177] After the user interface locks the gaze area, the user can perform a sliding operation on the pressure-sensitive button to trigger a focus-shifting operation on each controllable item in the gaze area. The focus-shifting operation refers to controlling each controllable item in the gaze area to be in a selectable state in turn.

[0178] The embodiments of the present application do not limit the specific implementation method of the focus operation on each controllable item in the gaze area. For example, after a sliding operation is input to the pressure-sensitive button once, the focus operation is automatically performed on each controllable item in the gaze area according to a preset starting position and a preset path. For another example, the focus operation can also be performed on each controllable item in the gaze area by inputting multiple sliding operations to the pressure-sensitive button. Among them, each time a sliding operation is input, the controllable item in the selectable state is changed once.

[0179] For example, if a sliding operation on a pressure-sensitive key is detected within a preset time after the user interface locks the gaze area, a cursor may be generated (the cursor may or may not be displayed on the user interface). Then, the cursor resides on each controllable item in the gaze area for a preset residence time. The state of the controllable item where the cursor resides is a selectable state.

[0180] The display style of the controllable item when it is in a selectable state is different from the display style of other controllable items in the user interface. For example, the controllable item currently in a selectable state (the controllable item where the cursor currently resides) is displayed in the user interface in a suspended display style, a dynamic display style, etc., to distinguish the controllable item currently in a selectable state from other controllable items that are not in a selectable state.

[0181] In this way, the user can determine whether the controllable item currently in the selectable state is the item that the user wants to control based on the user interface. If the controllable item in the selectable state is the item that the user wants to control (i.e., the target controllable item), the user can perform a light press operation on the pressure-sensitive button to select the target controllable item. After the target controllable item is selected, the focus operation stops. If the controllable item in the selectable state is not the target controllable item, the focus operation continues until the controllable item in the selectable state is the target controllable item, and the user performs a light press operation on the pressure-sensitive button to select the target controllable item and trigger the function corresponding to the target controllable item.

[0182] S207 , when the target controllable item is in a selectable state, in response to detecting a light pressing operation of the pressure-sensitive key by the user, selecting the target controllable item and triggering a function corresponding to the target controllable item.

[0183] In the embodiment of the present application, the operation of selecting the target controllable item is equivalent to the operation of clicking the target controllable item on the touch screen. That is to say, after the target controllable item is selected, the function corresponding to the target controllable item is triggered to execute. For example, if the target controllable item is an application control, then after the application control is selected, the user interface switches to the main interface of the application. For another example, if the target controllable item is a music playback link, then after the music playback link is selected, the user interface switches to the music playback interface or directly plays the music corresponding to the music playback link.

[0184] For example, Figure 7 As shown, it is assumed that the current user interface is the main interface of the electronic device, such as Figure 7 As shown in (a), the fixation area displayed on the user interface includes controls corresponding to four applications, namely a clock control, a file management control, a calculator control, and a calendar control. Figure 7 As shown in (a), after the user inputs a sliding operation through the pressure-sensitive key, a cursor is generated, and the cursor resides on the clock control, indicating that the current clock control is a selectable control. Figure 7 As shown in (b), the cursor stays on the clock control within the preset dwell time. If no light press operation input by the user is detected, it means that the user has not selected the clock control. In this way, the cursor moves to the file management control. Figure 7As shown in (c), the cursor stays on the file management control within the preset dwell time. If no light press operation input by the user is detected, the cursor continues to move to the calculator control. Assuming that the user's desired operation is to open the calculator of the electronic device, when the cursor continues to move to the calculator control and the calculator control is in a selectable state, the user can input a light press operation through the pressure-sensitive key. In this way, Figure 7 As shown in (d), after the electronic device detects a light press operation input by the user, it selects the calculator control that is currently in a selectable state and switches the user interface to the main interface of the calculator.

[0185] It can be seen that the touch operation method provided in the first embodiment of the present application first locates the control range to the gaze area based on the eye movement recognition algorithm. Then, by inputting a sliding operation on the pressure-sensitive button, each controllable item in the gaze area is controlled to be in a selectable state in turn. When the target controllable item is in a selectable state, the target controllable item is selected by inputting a light press operation on the pressure-sensitive button, and the function corresponding to the target controllable item is triggered. In this way, even when holding the electronic device with one hand, every area on the screen can be controlled, thereby improving the user's touch experience when holding the electronic device with one hand.

[0186] Embodiment 2

[0187] Figure 8 This is a flow chart of a touch operation method provided in Embodiment 2 of the present application. Figure 8 As shown, the method may include the following steps:

[0188] S301, detecting whether the screen status of the electronic device is in a bright screen status.

[0189] S302: When the screen is in the on state, determine whether a light touch and press operation of a pressure-sensitive key by a user is detected.

[0190] Among them, step S301 can refer to the description of step S201 in embodiment 1, and step S302 can refer to the description of step S202 in embodiment 1, which will not be repeated here.

[0191] S303: When a light touch and press operation of the pressure-sensitive button by the user is detected, an angle recognition function is started, and a target control area is determined based on an angle recognition algorithm in the angle recognition function.

[0192] When a user holds an electronic device with one hand, the tilt angle of the electronic device can be associated with the screen range that the user expects to manipulate. Therefore, the second embodiment of the present application can use an angle recognition algorithm to recognize the tilt angle of the electronic device when the user holds the electronic device, and then determine the target manipulation area that the user expects to manipulate based on the tilt angle of the electronic device.

[0193] In one possible implementation, the target control area is determined based on the angle recognition algorithm, which can be implemented in the following manner: after detecting a light touch and press operation on a pressure-sensitive button, the eye movement recognition function is started, and the eye movement recognition algorithm in the eye movement recognition function is run. The eye movement recognition algorithm can specifically include: obtaining a first angle of the electronic device. After the user inputs a light touch and press operation on the pressure-sensitive button, the user changes the posture of holding the mobile phone, and the changed posture is the grip corresponding to the desired touch control area. In this way, the electronic device can detect the second angle of the electronic device after the user changes the grip. Among them, the second angle of the electronic device is different from the first angle, and the duration of the electronic device maintaining the second angle is greater than the preset duration. That is, the first angle is the angle of the electronic device before the user tilts the electronic device; the second angle is the angle of the electronic device after the user tilts the electronic device. In this way, based on the first angle and the second angle, the tilt angle of the electronic device can be determined. Finally, the target control area can be determined based on the tilt angle of the electronic device. For example, the mapping relationship between multiple preset angles and each display area of ​​the electronic device can be first obtained; based on the mapping relationship, the target control area corresponding to the above tilt angle is determined.

[0194] In an embodiment of the present application, an inertial measurement unit (IMU) in an electronic device can be used to detect the angle of the electronic device. The IMU can use an accelerometer and a gyroscope to measure the three-axis attitude angle of the electronic device. In this way, the angles obtained twice include the three-axis attitude angle. Correspondingly, the tilt angle of the electronic device is also the three-axis attitude angle. That is, the tilt angle includes the tilt angle of the electronic device in the X-axis direction, the tilt angle in the Y direction, and the tilt angle in the Z-axis direction.

[0195] The embodiment of the present application can pre-establish the correspondence between the tilt angle and the display area by simulating the posture of the user when operating different display areas of the screen when holding the electronic device with one hand. Exemplarily, when the tilt angle of the electronic device is (α1, β1, γ1), the corresponding display area is the upper left corner area of ​​the electronic device. When the tilt angle of the electronic device is (α2, β2, γ2), the corresponding display area is the upper right corner area of ​​the electronic device. Among them, α1 and α2 represent the tilt angles relative to the X-axis, β1 and β2 represent the tilt angles relative to the Y-axis, and γ1 and γ2 represent the tilt angles relative to the Z-axis.

[0196] In this way, after the tilt angle of the electronic device is calculated, the display area corresponding to the currently calculated tilt angle can be determined based on the corresponding relationship between the tilt angle and the display area.

[0197] S304, locking the target control area in the user interface of the electronic device.

[0198] S305: Determine whether a sliding operation of the user on the pressure-sensitive key is detected within a preset time period.

[0199] S306: When a sliding operation of the user on the pressure-sensitive button is detected within a preset time period, a focus operation is performed on each controllable item in the target control area, so that each controllable item in the target control area is sequentially in a selectable state.

[0200] S307 , when the target controllable item is in a selectable state, in response to detecting a light pressing operation of the user on the pressure-sensitive key, selecting the target controllable item and triggering a function corresponding to the target controllable item.

[0201] The target control area in the second embodiment of the present application is equivalent to the gaze area in the first embodiment. Among them, step S304 can refer to the description of step S204 in the first embodiment, step S305 can refer to the description of step S205 in the first embodiment, step S306 can refer to the description of step S206 in the first embodiment, and step S307 can refer to the description of step S706 in the first embodiment, which will not be repeated here.

[0202] It can be seen that the touch operation method provided in the second embodiment of the present application first locates the control range to the target control area based on the angle recognition algorithm. Then, by inputting a sliding operation on the pressure-sensitive button, each controllable item in the target control area is controlled to be in a selectable state in turn. When the target controllable item is in a selectable state, the target controllable item is selected by inputting a light pressing operation on the pressure-sensitive button, and the function corresponding to the target controllable item is triggered. In this way, even when holding the electronic device with one hand, every area on the screen can be controlled, thereby improving the user's touch experience when holding the electronic device with one hand.

[0203] Embodiment 3

[0204] Fig. 9 This is a flow chart of a touch operation method provided in Embodiment 3 of the present application. Fig. 9 As shown, the method may include the following steps:

[0205] S401, detecting whether the screen status of the electronic device is in a bright screen status.

[0206] S402: When the screen is in the on state, determine whether to enter the one-handed operation mode.

[0207] The user can enter the one-handed operation mode by using a shortcut key, for example, the user can enter the one-handed operation mode by quickly clicking the pressure-sensitive key twice. In this way, if the electronic device detects that the user inputs two press operations, and the time interval between the two press operations is less than the preset time interval, the one-handed operation mode is entered, that is, the following step S403 can be executed.

[0208] For another example, the user can also enter the one-handed operation mode by clicking a "one-handed operation mode" control on the user interface, wherein the "one-handed operation mode" control is located in an area on the user interface that can be touched by the user with one hand.

[0209] If the one-handed operation mode is entered, the following step S403 is executed.

[0210] S403: After entering the one-handed operation mode, determine whether a sliding operation of the user on the pressure-sensitive key is detected.

[0211] S404, when a sliding operation of the user on the pressure-sensitive button is detected, the starting position of the cursor is determined, and the cursor is controlled to move along the first coordinate axis in the user interface (i.e., a focus operation is performed on each controllable item in the user interface along the first coordinate axis), so that each controllable item located on the first coordinate axis is in a selectable state in turn.

[0212] If the target controllable item is not on the first coordinate axis that is currently out of focus, the following steps S405 to S406 are performed. If the target controllable item is on the first coordinate axis that is currently out of focus, the following step S407 is performed.

[0213] S405, when a continuous pressing operation on the pressure-sensitive button is detected, the cursor is controlled to move along the second coordinate axis in the user interface (i.e., a focus operation is performed on each controllable item in the user interface along the second coordinate axis), so that each controllable item located on the second coordinate axis is in a selectable state in turn.

[0214] S406 , when the target controllable item is in a selectable state, in response to detecting a hand-off operation, selecting the target controllable item and triggering a function corresponding to the target controllable item.

[0215] S407 , when the target controllable item is in a selectable state, in response to detecting a light pressing operation on the pressure-sensitive key, selecting the target controllable item and triggering a function corresponding to the target controllable item.

[0216] After entering the one-handed operation mode, the user can input a sliding operation on the pressure-sensitive button to trigger the cursor to perform a focus operation on each controllable item in the user interface along the first coordinate axis starting from a preset starting position.

[0217] In some embodiments, the cursor can automatically perform a focus operation on each controllable item in the user interface along the first coordinate axis from a preset starting position according to a preset path.

[0218] In some embodiments, the cursor can be controlled to move from a preset starting position to an upward or downward movement along the first coordinate axis by inputting an upward sliding operation or a downward sliding operation on the pressure-sensitive key. For example, if the electronic device detects an upward sliding operation input by the user, the cursor is controlled to move upward movement along the first coordinate axis; if the electronic device detects a downward sliding operation input by the user, the cursor is controlled to move downward movement along the first coordinate axis.

[0219] When the cursor moves along the first coordinate axis, the user can input two touch operations on the pressure-sensitive button.

[0220] The first type: if the target controllable item is a controllable item on the current focus path of the first coordinate axis, when the cursor moves to the target controllable item on the first coordinate axis, the user can lightly touch and press the pressure-sensitive button to select the target controllable item.

[0221] The second method: If the target controllable item is not on the current focus path of the first coordinate axis, when the cursor moves to the row where the target controllable item is located, the user can press the pressure-sensitive button without releasing the finger to trigger focus on the second coordinate axis. When the cursor moves to the target controllable item on the second coordinate axis, the user can lift his finger and leave the pressure-sensitive button to select the target controllable item.

[0222] The first coordinate axis may be the X axis or the Y axis of the screen of the electronic device. If the first coordinate axis is the X axis, the second coordinate axis is the Y axis; if the first coordinate axis is the Y axis, the second coordinate axis is the X axis.

[0223] For example, Fig. 10A As shown, the starting position of the out-of-focus is the upper left corner position, the first coordinate axis is the Y axis, and the target controllable item is an email control as an example. In response to detecting a sliding operation input by the user, a cursor is generated, and the cursor stays on the clock control, and the clock control is in a selectable state. If the cursor resides on the clock control within a preset dwell time and no pressing operation input by the user is detected, it indicates that the user has not selected the clock control. In this way, the cursor moves along the Y axis to the next control, such as a file management control. Similarly, when the cursor moves along the Y axis to the email control, the user can tap the pressure-sensitive button to select the email control where the cursor resides. In this way, after the electronic device receives the light touch and press operation input by the user, it stops focusing on the Y axis and selects the email control.

[0224] Another exemplary embodiment, combined with Fig. 10A and10B As shown, the starting position of the focus is the upper left corner, the first coordinate axis is the Y axis, the second coordinate axis is the X axis, and the target controllable item is the weather control. Fig. 10A As shown, when the cursor moves along the Y-axis to the row where the weather control is located (that is, when the cursor resides on the email control), the user can press the pressure-sensitive button without letting the cursor go, stop the cursor from moving on the Y-axis, and control the direction of movement of the cursor on the X-axis by controlling the pressing pressure on the pressure-sensitive button, until the cursor moves along the X-axis to the weather control, and the user lifts his finger and lets the finger leave the pressure-sensitive button to select the weather control.

[0225] In an embodiment of the present application, when the pressing operation is performed without removing the hand, the electronic device can detect the pressure value of the pressure-sensitive button, and based on the pressure value, control the cursor to move in the positive or negative direction along the X-axis. For example, as the pressing pressure gradually increases, the cursor moves in the positive direction along the X-axis, that is, from left to right; as the pressing pressure gradually weakens, the cursor moves in the negative direction along the X-axis, that is, from right to left. For another example, a mapping relationship between the pressure value and the position of the cursor on the X-axis can also be established. In this way, after the pressure value is detected, the cursor position corresponding to the current pressure value can be determined based on the mapping relationship between the pressure value and the position of the cursor on the X-axis, and the cursor can be moved to this position.

[0226] For example, Fig. 10B As shown, taking the target controllable item as the weather control as an example, when the cursor moves along the Y axis to the row where the weather control is located, the user keeps pressing the pressure-sensitive button and gradually increases the pressing strength. In this way, after the electronic device detects the user's hands-free pressing operation, based on the detected pressing pressure, the cursor moves forward along the X axis until the cursor moves to the weather button, and the user lifts his finger and lets the finger leave the pressure-sensitive button to select the weather control.

[0227] It should be noted that the above description is based on the example of selecting the target controllable item after detecting the hand-off operation, which does not represent a limitation here. For example, after detecting the hand-off operation, the target controllable item can be locked first and the cursor movement can be stopped. Then, the user selects the target controllable item by lightly pressing the pressure-sensitive button once. In this way, the possibility of accidental touch can be reduced.

[0228] The starting position of the focus loss may be any position on the user interface, and this embodiment of the present application does not limit this.

[0229] In some embodiments, considering that the user cannot usually touch the edge area of ​​the screen when holding the electronic device with one hand, the starting position of the out-of-focus may be set at the upper left corner, upper right corner, lower left corner, lower right corner, left edge center, right edge center, upper edge center or lower edge center of the screen. Specifically, the starting position of the out-of-focus may be represented by coordinates, for example, the starting position of the out-of-focus is (x1, y1), where x1 represents the coordinate point on the X-axis of the screen, and y1 represents the coordinate point on the Y-axis of the screen.

[0230] In some embodiments, considering that the left-handed operation and the right-handed operation have different corresponding touchable ranges, it is possible to first identify whether the user is holding the electronic device with the left hand or the right hand. Then, based on the identification result, determine the starting position of the focus deviation.

[0231] For example, if it is recognized that the user inputs the touch operation through the pressure-sensitive button on the left, it can be determined that the user is holding the electronic device with his left hand; if it is recognized that the user inputs the touch operation through the pressure-sensitive button on the right, it can be determined that the user is holding the electronic device with his right hand.

[0232] Correspondingly, if it is recognized that the user is holding the electronic device with his left hand, the starting position of the focus loss can be determined as a position close to the right side of the screen, for example, the starting position of the focus loss is the upper right corner, the lower right corner, or the center of the right edge of the screen. If it is recognized that the user is holding the electronic device with his right hand, the starting position of the focus loss can be determined as a position close to the left side of the screen, for example, the starting position of the focus loss is the upper left corner, the lower left corner, or the center of the left edge of the screen.

[0233] It should be noted that when the focus operation is performed in the third embodiment of the present application, the display status corresponding to each controllable item can refer to the description of the first embodiment, and will not be repeated here.

[0234] It can be seen that the touch operation method provided in the third embodiment of the present application can control the cursor to move in two dimensions, the X-axis and the Y-axis, by inputting different touch operation types to the pressure-sensitive buttons. In this way, the cursor can be used to select a controllable item at any position on the user interface. In addition, the cursor can be controlled to move freely in two directions of a coordinate axis by applying different pressures to the pressure-sensitive buttons. In this way, even when holding the electronic device with one hand, every area on the screen can be controlled, thereby improving the user's touch experience when holding the electronic device with one hand.

[0235] Embodiment 4

[0236] Fig.11 This is a flow chart of a touch operation method provided in the fourth embodiment of the present application. Fig.11 As shown, the method may include the following steps:

[0237] S501, detecting whether the screen status of the electronic device is in a bright screen status.

[0238] S502: When the screen is in the on state, determine whether a sliding operation of a user on a pressure-sensitive key is detected.

[0239] S503: When a sliding operation of the user on the pressure-sensitive key is detected, determine whether scalable notification information is received.

[0240] In the embodiment of the present application, after detecting the user's sliding operation on the pressure-sensitive key, the kernel layer generates a corresponding point reporting event based on the sliding operation, and reports the point reporting event to the application layer. In this way, after receiving the point reporting event, the application layer can determine whether the current user interface includes scalable content.

[0241] If the application layer determines that the current user interface includes scalable content, the application layer can respond to the sliding operation according to the zoom operation. Correspondingly, the application layer can send a zoomable notification message to the system to notify that the current user interface includes scalable content, that is, a zoom operation can be performed on the current user interface. If the application layer determines that the current user interface does not include scalable content, the application layer will not respond to the sliding operation according to the zoom operation. Correspondingly, the application layer will not send a zoomable notification message.

[0242] In this way, if the scalable notification information is received, the following step S504 is executed; otherwise, the process ends.

[0243] The scalable content refers to the content that can be enlarged or reduced in the user interface, such as images, maps, etc.

[0244] S504: When the zoomable notification information is received, determine a target zoom area in the user interface.

[0245] The target zoom area refers to the location where the user expects to perform a zoom operation on the zoomable content.

[0246] In the embodiment of the present application, the target zoom area may be determined based on an eye movement recognition algorithm or an angle recognition algorithm.

[0247] The method for determining the target zoom area based on the eye movement recognition algorithm can refer to the description of embodiment 1. The method for determining the target zoom area based on the angle recognition algorithm can refer to the description of embodiment 2, which will not be repeated here.

[0248] S505: Determine a zoom focus for performing a zoom operation on the zoomable content in the target zoom area.

[0249] The zoom focus is any point in the target zoom area. For example, the zoom focus may be the center point of the target zoom area.

[0250] S506: Determine whether an upward sliding operation of the user on the pressure-sensitive key is detected.

[0251] S507: When an upward sliding operation of the user on the pressure-sensitive key is detected, a zooming operation is performed on the zoomable content based on the zoom focus.

[0252] S508: When no upward sliding operation of the user on the pressure-sensitive key is detected, determine whether a downward sliding operation of the user on the pressure-sensitive key is detected.

[0253] S509: When a downward sliding operation of the pressure-sensitive key by the user is detected, a zoom-out operation is performed on the zoomable content based on the zoom focus.

[0254] For example, Fig.12 As shown in (a), the target zoom area is determined in the user interface ( Fig.12 The center of the target zoom area is taken as the zoom focus. Fig.12 As shown in (b), after the user interface is zoomed in based on the zoom focus, the user interface zooms in and displays the content around the zoom focus.

[0255] In some embodiments, after performing a zoom operation on the zoomable content based on the zoom focus, if the user interface includes controllable items, different touch operations can be further input to the pressure-sensitive keys to select the target controllable item in the user interface and trigger the function corresponding to the target controllable item.

[0256] The method of selecting a target controllable item in the user interface by inputting different touch operations to the pressure-sensitive buttons can be specifically described in the first, second and third embodiments, which will not be described again here.

[0257] It should be noted that the above implementation is only illustrative of the example of first determining whether an upward sliding operation is detected. It is also possible to first determine whether a downward sliding operation is detected. The embodiment of the present application is not limited to this.

[0258] It can be seen that the touch operation method provided in the fourth embodiment of the present application, if receiving zoomable notification information, can determine the target zoom area based on the eye movement recognition algorithm or the angle recognition algorithm. Further determine the zoom focus in the target zoom area. In this way, the zoomable content can be zoomed based on the zoom focus by sliding up or sliding down on the pressure-sensitive button input. In this way, even when the electronic device is held in one hand, the function of zooming each area on the screen can be realized, thereby improving the user's touch experience when holding the electronic device in one hand.

[0259] In summary, if Fig.13 As shown, the touch operation provided in the embodiment of the present application may include the following steps:

[0260] S601, the electronic device displays a first interface, where the first interface includes at least one controllable item.

[0261] When the screen state of the electronic device is the screen-on state, the electronic device displays the first interface. The screen-on state detection method can refer to the description of the first embodiment, which will not be repeated here.

[0262] S602: In response to a one-handed mode triggering operation by a user, the electronic device enters a one-handed operation mode.

[0263] The specific form of the one-handed mode triggering operation is not limited in the present application embodiment. For example, it can be a light touch and press operation in the first embodiment; it can also be a shortcut key method in the third embodiment or a method of clicking the "one-handed operation mode" control on the user interface.

[0264] S603, when the electronic device is in a one-handed operation mode, in response to a first touch operation input by a user via a pressure-sensitive key, at least one controllable item in a target control area in the first interface is sequentially in a selectable state.

[0265] In one possible implementation, the target control area can be determined in the first interface based on an eye movement recognition algorithm or an angle recognition algorithm; then, based on the target control area, the second interface is displayed; finally, in response to the first touch operation input by the user via a pressure-sensitive key, at least one controllable item in the target control area in the second interface is sequentially in a selectable state. The target control area in the second interface is displayed in a first display mode, and the area other than the target control area in the second interface is displayed in a second display mode, and the first display mode and the second display mode are different.

[0266] In one implementable manner, determining a target control area in a first interface based on an eye movement recognition algorithm may include: when the electronic device is in a one-handed operation mode, capturing a user's facial image; processing the user's facial image to obtain the user's eye movement data; and determining a target control area in the first interface based on the eye movement data.

[0267] In one implementable manner, determining a target control area in a first interface based on an angle recognition algorithm may include: when the electronic device is in a one-handed operation mode, acquiring a first angle of the electronic device; when the angle of the electronic device changes from a first angle to a second angle, and the time length for which the electronic device maintains the second angle is greater than a second preset time length, determining a tilt angle of the electronic device based on the first angle and the second angle; and determining a target control area in the first interface based on the tilt angle of the electronic device.

[0268] In one implementable manner, determining a target control area in a first interface based on a tilt angle may include: obtaining a mapping relationship between multiple preset angles and each display area of ​​the electronic device; and determining a target control area corresponding to the tilt angle in the first interface based on the mapping relationship.

[0269] In one implementable manner, displaying a second interface based on a target control area may include: encircling the target control area in a graphic frame on the second interface; or, displaying each controllable item in the target control area in a first display style on the second interface, and displaying the controllable items in the second interface except the target control area in a second display style, the first display style being different from the second display style.

[0270] In an implementable manner, the first touch operation may include a sliding operation, and the second touch operation may include a pressing operation. It should be understood that the first touch operation and the second touch operation may also adopt other types of touch operations.

[0271] The above implementation methods can be referred to the description of Embodiment 1 and Embodiment 2, which will not be repeated here.

[0272] In one possible implementation, the first touch operation may include a first sub-touch operation and / or a second sub-touch operation. In response to the first sub-touch operation input by the user via the pressure-sensitive key, the starting position of the cursor is determined, and the cursor moves along the first coordinate axis on the first interface; wherein, when the cursor resides on the first controllable item in the target control area, the first controllable item is in a selectable state; the first controllable item is any one of the at least one controllable item; and / or, in response to the second sub-touch operation input by the user via the pressure-sensitive key, the cursor moves along the second coordinate axis on the first interface, and the first coordinate axis and the second coordinate axis are perpendicular to each other.

[0273] In one implementation, the first sub-touch operation includes a sliding operation, the second sub-touch operation includes a press operation without releasing the hand, and the second touch operation includes a release operation. It should be understood that the first sub-touch operation, the second sub-touch operation, and the second touch operation may also use other types of touch operations.

[0274] In one possible implementation, controlling the cursor to move along the second coordinate axis on the first interface may include: obtaining a pressure value of a second sub-touch operation; determining a target movement direction of the cursor along the second coordinate axis on the first interface based on the pressure value; and moving the cursor in the target movement direction along the second coordinate axis.

[0275] In one implementable manner, determining a target moving direction of a cursor moving along a second coordinate axis on a first interface based on a pressure value may include: when the pressure value gradually increases, determining the target moving direction to be a first direction of the second coordinate axis; when the pressure value gradually decreases, determining the target moving direction to be a second direction of the second coordinate axis; the first direction and the second direction are two opposite directions.

[0276] In one implementable manner, the electronic device includes a first pressure-sensitive button and a second pressure-sensitive button, and the first pressure-sensitive button and the second pressure-sensitive button are relatively arranged on two sides of the electronic device; determining the starting position of the cursor includes: determining the pressure-sensitive button that receives the first sub-touch operation; when the pressure-sensitive button that receives the first sub-touch operation is the first pressure-sensitive button, determining the starting position of the cursor to be a position away from the first pressure-sensitive button; when the pressure-sensitive button that receives the first sub-touch operation is the second pressure-sensitive button, determining the starting position of the cursor to be a position away from the second pressure-sensitive button.

[0277] The above-mentioned implementation method can be referred to the description of Embodiment 3, which will not be repeated here.

[0278] S604, when a target controllable item among at least one controllable item is in a selectable state, in response to a second touch operation input by the user via the pressure-sensitive key, the target controllable item in the selectable state is selected, and a function corresponding to the target controllable item in the selectable state is triggered.

[0279] For step S604, please refer to the description of Embodiment 1, Embodiment 2 and Embodiment 3, which will not be described again here.

[0280] It should be noted that, for the first embodiment, the target controllable item refers to the gaze area. Corresponding to the third embodiment, the target controllable item refers to the entire user interface.

[0281] It should also be noted that the first touch operation, the second touch operation, the first sub-touch operation, the second sub-touch operation, and the third touch operation in the embodiments of the present application can be any controllable operation, and are not limited to the touch operation types exemplified in the above-mentioned embodiments one, two, and three.

[0282] Fig.14 A flowchart of another touch operation provided in an embodiment of the present application. Fig.14 As shown, the method may include the following steps:

[0283] S701, the electronic device displays a first interface.

[0284] S702, in response to a fourth touch operation input by the user via a pressure-sensitive key, when zoomable notification information is received, determining a target zoom area in the first interface; wherein the zoomable notification information is used to notify that the first interface includes zoomable content.

[0285] S703: Determine a zoom focus for performing a zoom operation on the zoomable content in the target zoom area.

[0286] S704: In response to a fifth touch operation input by the user via the pressure-sensitive key, a zoom operation is performed on the zoomable content based on the zoom focus.

[0287] In one possible implementation, when the fifth touch operation is an upward sliding operation, the zoomable content is enlarged based on the zoom focus; when the fifth touch operation is a downward sliding operation, the zoomable content is reduced based on the zoom focus; or, when the fifth touch operation is a downward sliding operation, the zoomable content is enlarged based on the zoom focus; when the fifth touch operation is an upward sliding operation, the zoomable content is reduced based on the zoom focus.

[0288] In one achievable manner, a third interface is displayed after a zoom operation is performed on the zoomable content, and the third interface includes at least one controllable item; in response to a first touch operation input by a user via a pressure-sensitive key, at least one controllable item in a target control area in the third interface is sequentially in a selectable state; when a target controllable item in at least one controllable item is in a selectable state, in response to a second touch operation input by a user via a pressure-sensitive key, the target controllable item in a selectable state is selected, and a function corresponding to the target controllable item in a selectable state is triggered. The above steps S701 to S704 can refer to the description of the fourth embodiment, and will not be repeated here.

[0289] The various method embodiments described in this document may be independent solutions or may be combined according to internal logic, and these solutions all fall within the protection scope of this application.

[0290] It can be understood that, in the above-mentioned various method embodiments, the methods and operations implemented by the electronic device can also be implemented by components (such as chips or circuits) that can be used in the electronic device.

[0291] The above embodiments introduce the touch operation method provided by the present application. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0292] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0293] It should be noted that the processor in the embodiment of the present application can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor can be combined and performed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0294] It can be understood that the memory in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0295] According to the method provided in the embodiments of the present application, the embodiments of the present application also provide a computer program product, which includes: a computer program or instructions, when the computer program or instructions are run on a computer, the computer executes the method of any one of the embodiments of the method.

[0296] According to the method provided by the embodiments of the present application, the embodiments of the present application also provide a computer storage medium, which stores a computer program or instructions. When the computer program or instructions are run on a computer, the computer executes the method of any one of the embodiments of the method.

[0297] According to the method provided by an embodiment of the present application, an embodiment of the present application also provides an electronic device, including a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device executes the method of any one of the embodiments of the method embodiment.

[0298] Those of ordinary skill in the art will appreciate that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0299] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0300] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0301] The computer storage medium, computer program product, and electronic device provided in the above-mentioned embodiments of the present application are all used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the corresponding beneficial effects of the method provided above, and will not be repeated here.

[0302] It should be understood that in each embodiment of the present application, the execution order of each step should be determined by its function and internal logic, and the size of the sequence number of each step does not mean the order of execution and does not limit the implementation process of the embodiment.

[0303] Each part of this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the embodiments of the device, computer storage medium, computer program product, and electronic device, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

[0304] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0305] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A touch operation method, characterized in that: The method is applied to an electronic device, the electronic device includes at least one pressure-sensitive button, and the at least one pressure-sensitive button is used to receive a touch operation input by a user. The method includes: The electronic device displays a first interface, wherein the first interface includes at least one controllable item; In response to a one-handed mode triggering operation by a user, the electronic device enters a one-handed operation mode; When the electronic device is in a one-handed operation mode, in response to a first touch operation input by a user via the pressure-sensitive key, at least one controllable item in a target control area in the first interface is sequentially in a selectable state; When a target manipulable item among the at least one manipulable item is in a selectable state, in response to a second touch operation input by a user via the pressure-sensitive key, the target manipulable item in the selectable state is selected, and a function corresponding to the target manipulable item in the selectable state is triggered; In response to a first touch operation input by a user via the pressure-sensitive key, before at least one controllable item in a target control area in the first interface is sequentially in a selectable state, the method further includes: determining the target control area in the first interface based on an eye movement recognition algorithm or an angle recognition algorithm; Based on the target control area, a second interface is displayed; the target control area in the second interface is displayed in a first display mode, and the area other than the target control area in the second interface is displayed in a second display mode, and the first display mode and the second display mode are different.

2. The method according to claim 1, characterized in that Determining the target manipulation area in the first interface based on the eye movement recognition algorithm includes: When the electronic device is in a one-handed operation mode, collecting a user's facial image; Processing the user's facial image to obtain eye movement data of the user; Based on the eye movement data, the target manipulation area is determined in the first interface.

3. The method according to claim 1, characterized in that Based on the angle recognition algorithm, determining the target control area in the first interface includes: When the electronic device is in a one-handed operation mode, acquiring a first angle of the electronic device; When the angle of the electronic device changes from the first angle to the second angle, and the duration for which the electronic device maintains the second angle is greater than a second preset duration, determining the tilt angle of the electronic device based on the first angle and the second angle; Based on the tilt angle of the electronic device, the target control area is determined in the first interface.

4. The method according to claim 3, characterized in that Determining the target control area in the first interface based on the tilt angle includes: Acquire a mapping relationship between a plurality of preset angles and each display area of ​​the electronic device; Based on the mapping relationship, the target control area corresponding to the tilt angle in the first interface is determined.

5. The method according to any one of claims 1 to 4, characterized in that The displaying of a second interface based on the target control area includes: In the second interface, the target control area is enclosed in a graphic frame; or, The controllable items in the target control area are displayed in the second interface in the first display style, and the controllable items in the second interface except the target control area are displayed in the second display style, and the first display style is different from the second display style.

6. The method according to any one of claims 1 to 4, characterized in that In response to the first touch operation input by the user via the pressure-sensitive key, at least one controllable item in the target control area in the first interface is sequentially in a selectable state, including: Within a first preset time period starting from when the electronic device displays the second interface, in response to a first touch operation input by the user via the pressure-sensitive button, at least one controllable item in the target control area in the first interface is sequentially in a selectable state.

7. The method according to claim 1, characterized in that The first touch operation includes a sliding operation, and the second touch operation includes a pressing operation.

8. The method according to claim 1, characterized in that In response to a first touch operation input by a user via the pressure-sensitive key, at least one controllable item in a target control area in the first interface is sequentially in a selectable state, including: In response to a first sub-touch operation input by a user via the pressure-sensitive key, a starting position of a cursor is determined, and the cursor moves along a first coordinate axis on the first interface; wherein, when the cursor resides on a first controllable item in the target control area, the first controllable item is in a selectable state; the first controllable item is any one of the at least one controllable item; and / or, In response to a second sub-touch operation input by the user via the pressure-sensitive key, the cursor moves along a second coordinate axis on the first interface, and the first coordinate axis is perpendicular to the second coordinate axis; The first touch operation includes the first sub-touch operation and / or the second sub-touch operation.

9. The method according to claim 8, characterized in that The first sub-touch operation includes a sliding operation, the second sub-touch operation includes a pressing operation without releasing the hand, and the second touch operation includes a releasing operation.

10. The method according to claim 8, characterized in that The cursor moves along the second coordinate axis on the first interface, including: Acquire the pressure value of the second sub-touch operation; Based on the pressure value, determining a target moving direction of the cursor along a second coordinate axis on the first interface; The cursor moves in a target moving direction along the second coordinate axis.

11. The method according to claim 10, characterized in that Determining a target moving direction of the cursor along the second coordinate axis on the first interface based on the pressure value includes: When the pressure value gradually increases, determining the target moving direction to be the first direction of the second coordinate axis; When the pressure value gradually decreases, the target moving direction is determined to be the second direction of the second coordinate axis; the first direction and the second direction are two opposite directions.

12. The method according to claim 8, characterized in that The at least one pressure-sensitive key includes a first pressure-sensitive key and a second pressure-sensitive key, and the first pressure-sensitive key and the second pressure-sensitive key are arranged on two sides of the electronic device in a relative manner; and determining the starting position of the cursor includes: Determining a pressure-sensitive key that receives the first sub-touch operation; In a case where the pressure-sensitive key receiving the first sub-touch operation is a first pressure-sensitive key, determining the starting position of the cursor to be a position away from the first pressure-sensitive key; In a case where the pressure-sensitive key receiving the first sub-touch operation is a second pressure-sensitive key, the starting position of the cursor is determined to be a position away from the second pressure-sensitive key.

13. The method according to claim 1, characterized in that In response to a user's one-handed mode triggering operation, the electronic device enters the one-handed operation mode, comprising: In response to a third touch operation input by the user via the pressure-sensitive key, the electronic device enters the one-handed operation mode; or, In response to a click operation input by a user via the one-handed operation mode control on the first interface, entering the one-handed operation mode; The third touch operation is a single press operation or a double press operation, wherein a time interval between the two press operations is less than a preset time interval.

14. The method according to claim 1, characterized in that The display style of the target controllable item when it is in a selectable state is different from the display styles of other controllable items in the first interface except the target controllable item.

15. The method according to claim 14, characterized in that The display styles include a highlight display style, a suspended display style, a dynamic display style, an enlarged display style and a reduced display style.

16. The method according to claim 1, characterized in that The controllable items include controls and links.

17. The method according to claim 1, characterized in that After the electronic device displays the first interface, the method further includes: In response to a fourth touch operation inputted by the user via the pressure-sensitive key, when zoomable notification information is received, determining a target zoom area in the first interface; wherein the zoomable notification information is used to notify that the first interface includes zoomable content; Determining a zoom focus for performing a zoom operation on the zoomable content in the target zoom area; In response to a fifth touch operation input by the user via the pressure-sensitive key, a zoom operation is performed on the zoomable content based on the zoom focus.

18. The method according to claim 17, characterized in that Determining a zoom focus for performing a zoom operation on the zoomable content in the target zoom area includes: The center of the target zoom area is determined as a zoom focus for zooming the zoomable content.

19. The method according to claim 17, characterized in that In response to a fifth touch operation input by the user via the pressure-sensitive key, performing a zoom operation on the zoomable content based on the zoom focus, including: When the fifth touch operation is an upward sliding operation, the zoomable content is zoomed in based on the zoom focus; when the fifth touch operation is a downward sliding operation, the zoomable content is zoomed out based on the zoom focus; or When the fifth touch operation is a downward sliding operation, a zoom-in operation is performed on the zoomable content based on the zoom focus; when the fifth touch operation is an upward sliding operation, a zoom-out operation is performed on the zoomable content based on the zoom focus.

20. The method according to claim 17, characterized in that In response to a fifth touch operation input by the user via the pressure-sensitive key, after performing a zoom operation on the zoomable content based on the zoom focus, the method further includes: Displaying a third interface after the zooming operation is performed on the zoomable content, the third interface including at least one controllable item; In response to a first touch operation input by the user via the pressure-sensitive key, at least one controllable item in the target control area in the third interface is sequentially in a selectable state; When a target controllable item among the at least one controllable item is in a selectable state, in response to a second touch operation input by the user via the pressure-sensitive key, the target controllable item in the selectable state is selected, and a function corresponding to the target controllable item in the selectable state is triggered.

21. An electronic device, characterized in that: The electronic device comprises a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, the computer program code comprises computer instructions, and when the processor executes the computer instructions, the electronic device executes the method as described in any one of claims 1-20.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program or instruction. When the computer program or instruction is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 20.

Images