A sliding detection method, apparatus and electronic device
By detecting the force of sliding and pressing operations on the buttons, the problem of easy failure of split volume buttons is solved, providing a more complex interaction method, improving the user experience and the lifespan of the buttons.
Patent Information
- Application Number
- CN202311375932.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-20
- Publication Date
- 2026-01-06
- Estimated Expiration
- 2043-10-20
AI Technical Summary
Separate volume buttons are prone to malfunction and cannot adapt to complex interaction needs, affecting the user experience.
By detecting the user's sliding and pressing actions on the buttons, the corresponding force information is obtained to determine whether to execute the corresponding operation command, providing a more complex interaction method.
It improves the user experience, avoids accidental operation, adapts to more complex interaction needs, and extends the lifespan of the buttons.
Smart Images

Figure CN119902733B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to a sliding detection method, device and electronic device. Background Technology
[0002] Electronic devices typically have volume buttons on the side. Currently, these volume buttons are split-type volume buttons, which are physical buttons with mechanical structures. Users usually use the pressing operation of split-type volume buttons to make electronic devices perform the function of increasing or decreasing volume.
[0003] However, when subjected to prolonged and frequent pressing by users or other physical factors, the separate volume buttons are prone to malfunction. For example, the buttons may become loose, lose sensitivity, or become unpressable. Furthermore, the mechanical structure of the separate volume buttons only provides simple pressing operations and cannot adapt to more complex interaction needs. This negatively impacts the user experience. Summary of the Invention
[0004] This application provides a sliding detection method, device, and electronic device, which can solve the problems that split volume buttons are prone to failure and cannot adapt to more complex interaction needs, thereby improving the user experience.
[0005] In a first aspect, embodiments of this application provide a sliding detection method, the method comprising: in response to a user's first operation on a button along a first direction, acquiring a first force of the first operation; determining, based on the first force, whether to execute a first operation instruction corresponding to the first operation; if it is determined that the first operation instruction will be executed, in response to a user's second operation on a button along a second direction, acquiring a second force of the second operation, the second direction being the opposite direction of the first direction; and determining, based on the second force, whether to execute a second operation instruction corresponding to the second operation.
[0006] The sliding detection method shown in this application embodiment can control electronic devices to perform corresponding functions through user operations such as sliding and pressing on buttons, thereby improving the user experience.
[0007] In one implementation, determining whether to execute a first operation instruction corresponding to a first operation based on a first force includes: executing the first operation instruction if the first force is greater than or equal to a first detection threshold; and not executing the first operation instruction if the first force is less than the first detection threshold. Using this implementation, the electronic device can determine that the first operation is a subjective operation by the user, and then make corresponding adjustments based on that operation, avoiding user errors and improving the user experience.
[0008] In one implementation, determining whether to execute the second operation instruction corresponding to the second operation based on the second force includes: when the second operation is a first sub-operation, if the second force is greater than or equal to a first detection threshold, executing the second operation instruction; the first sub-operation includes a sliding operation performed by the user in the second direction after performing the first operation, without lifting the finger from the button; if the second force is less than the first detection threshold, not executing the second operation instruction. Using this implementation, the electronic device matches the user's operating habits in scenarios where the user has a sliding operation, determines the user's actual operating intent, and identifies whether the user's current operation is a desired operation or an unconscious operating habit, thus avoiding user errors and improving the user experience.
[0009] In one implementation, determining whether to execute a second operation instruction corresponding to a second operation based on a second force includes: when the second operation is a second sub-operation, if the second force corresponding to the first pressing operation in the second sub-operation is greater than or equal to a second detection threshold, and the second force corresponding to the first sliding operation in the second sub-operation is greater than or equal to a first detection threshold, then executing the second operation instruction; wherein, the second sub-operation includes a first pressing operation performed by the user after performing the first operation, with the finger not leaving the button, and a first sliding operation performed by the user after the first pressing operation, with the finger not leaving the button, from the pressing position to a second direction. Using this implementation, the electronic device can determine that the second sub-operation is a subjective operation by the user, and then make corresponding adjustments based on this operation to improve the user experience.
[0010] In one implementation, if the second force is less than the first detection threshold, after not executing the second operation instruction, the method further includes: responding to a third operation performed by the user on the button along a first direction, acquiring the third force of the third operation, wherein the third operation is a sliding operation performed by the user after performing the first sub-operation without lifting their finger from the button; if the third force is greater than or equal to the first detection threshold, executing the third operation instruction corresponding to the third operation. Using this implementation, the electronic device can recognize unconscious user operations during continuous operations where the user's finger slides from the top to the bottom of the volume button multiple times, avoiding accidental user operations and improving the user experience.
[0011] In one implementation, after executing the second operation instruction, the method further includes: responding to a fourth operation performed by the user on the button along a first direction, acquiring a fourth force of the fourth operation, wherein the fourth operation is a sliding operation performed by the user after performing the second sub-operation without lifting their finger from the button; if the fourth force is greater than or equal to a first detection threshold, executing the fourth operation instruction corresponding to the fourth operation. Using this implementation, the electronic device can recognize both subjective and unconscious operations by the user during repeated sliding of their finger from the top to the bottom of the volume button, determining the user's actual usage intention, avoiding user errors, and improving the user experience.
[0012] In one implementation, before obtaining the first force of the first operation in response to a user's first operation on the button along a first direction, the method further includes: determining whether at least one preset application is running in the foreground or background; if any preset application is running in the foreground or background, determining the function to be executed by the target operation instruction based on the target application, wherein the target application is the preset application currently running in the foreground or background, and the target operation instruction includes at least a first operation instruction and a second operation instruction. Using this implementation, the electronic device can determine the different functions to be executed by the volume keys based on whether the application is running in the foreground or background, enabling the volume keys to be used in various scenarios and improving the user experience.
[0013] In one implementation, the function to be executed by the target operation instruction is determined based on the target application. This includes: when the target application is an audio application or a video application, determining that a first operation instruction executes the function of increasing the volume, and a second operation instruction executes the function of decreasing the volume; or, determining that a first operation instruction executes the function of decreasing the volume, and a second operation instruction executes the function of increasing the volume. Using this implementation, electronic devices can enable volume keys to perform volume increase / decrease functions when audio or video applications are running, while also matching user operating habits and improving the user experience.
[0014] In one implementation, the function to be executed by the target operation instruction is determined based on the target application. This includes: when the target application is a video application, determining that a first operation instruction executes the function of fast-forwarding video, and a second operation instruction executes the function of rewinding video; or, determining that a first operation instruction executes the function of rewinding video, and a second operation instruction executes the function of fast-forwarding video. Using this implementation, electronic devices can enable volume keys to perform the function of fast-forwarding or rewinding video when a video application is running, while also matching the user's operating habits and improving the user experience.
[0015] In one implementation, determining the function to be executed by the target operation instruction based on the target application includes: when the target application is a browser-like application, determining that a first operation instruction executes the function of scrolling up to navigate the screen, and a second operation instruction executes the function of scrolling down to navigate the screen; or, determining that a first operation instruction executes the function of scrolling down to navigate the screen, and a second operation instruction executes the function of scrolling up to navigate the screen. Using this implementation, electronic devices can enable volume keys to perform the function of scrolling up or down to navigate the screen when a browser-like application is running, while simultaneously matching the user's operating habits and improving the user experience.
[0016] In one implementation, determining the function to be executed by the target operation instruction based on the target application includes: when the target application is a camera application, determining that a first operation instruction executes the function of increasing zoom magnification, and a second operation instruction executes the function of decreasing zoom magnification; or, determining that a first operation instruction executes the function of decreasing zoom magnification, and a second operation instruction executes the function of increasing zoom magnification. Using this implementation, electronic devices can enable volume keys to perform the function of increasing or decreasing zoom magnification when a camera application is running, while simultaneously matching user operating habits and improving the user experience.
[0017] In one implementation, the button is a press-sensitive volume button, and the volume button structure includes at least one of a cantilever beam structure, a built-in sensor structure, and an ultrasonic structure. Using this implementation, the embodiments of this application can be applied to press-sensitive volume buttons with various structures.
[0018] In one implementation, before acquiring the first force of the first operation in response to a user's first action on the button along a first direction, the method further includes: acquiring the duration of the user's touch on the button; if the duration is greater than or equal to a first touch threshold, controlling the button to enter a wake-up state; or, acquiring the number of times the user taps the button; if the number of taps is greater than or equal to a first touch threshold, controlling the button to enter a wake-up state; or, acquiring the user's touch position on the button; if the touch position is a preset position, controlling the button to enter a wake-up state; or, monitoring whether a preset application is running in the foreground or background, controlling the button to enter a wake-up state. Using this implementation, the electronic device can execute the above-mentioned sliding detection method after the button enters the wake-up state, which can avoid accidental button touches by the user.
[0019] Secondly, embodiments of this application provide a sliding detection device, the device comprising: a first acquisition module, configured to acquire a first force of the first operation in response to a user's first operation on a button along a first direction; a first execution module, configured to determine whether to execute a first operation instruction corresponding to the first operation based on the first force; a second acquisition module, configured to acquire a second force of the second operation in response to a user's second operation on a button along a second direction, wherein the second direction is the opposite direction of the first direction, if the first operation instruction is determined to be executed; and a second execution module, configured to determine whether to execute a second operation instruction corresponding to the second operation based on the second force.
[0020] The sliding detection device shown in this application embodiment can control electronic devices to perform corresponding functions through user operations such as sliding and pressing on buttons, thereby improving the user experience.
[0021] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory; the memory stores program instructions, which, when executed by the processor, cause the electronic device to perform the methods described in the first aspect and any of the implementations above.
[0022] Fourthly, embodiments of this application provide a chip system, including: a memory and a processor; the memory stores program instructions, which, when executed by the processor, cause the chip system to perform the methods described in the first aspect and any of the implementations above.
[0023] Fifthly, embodiments of this application provide a computer storage medium storing program instructions that, when executed on a computer, cause the computer to perform the methods described in the first aspect and any of the implementations above.
[0024] Sixthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to execute the methods described in the first aspect and any of its implementations above.
[0025] Understandably, the electronic devices, computer-readable storage media, and computer program products provided in the above aspects are all applied to the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here. Attached Figure Description
[0026] Figure 1 This is a schematic diagram of a split volume control.
[0027] Figure 2 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application;
[0028] Figure 3 This is a schematic diagram of the software structure of the electronic device provided in the embodiments of this application;
[0029] Figure 4 This is a schematic diagram of an integrated volume button.
[0030] Figure 5 This is a diagram illustrating the usage scenarios of the integrated volume buttons;
[0031] Figure 6 This is a schematic diagram of another type of integrated volume button;
[0032] Figure 7 This is a diagram illustrating another usage scenario for an integrated volume button;
[0033] Figure 8 This is a schematic diagram of the sliding detection method provided in the embodiments of this application;
[0034] Figure 9 This is a first operation diagram provided in an embodiment of this application;
[0035] Figure 10 This is a schematic diagram of a misoperation scenario provided in an embodiment of this application;
[0036] Figure 11 This is a schematic diagram of the first sub-operation provided in the embodiments of this application;
[0037] Figure 12 This is a schematic diagram of the second sub-operation provided in the embodiments of this application;
[0038] Figure 13 This is a schematic diagram of the second sub-operation provided in another embodiment of this application;
[0039] Figure 14 This is a schematic diagram of the first scenario of the sliding detection method provided in the embodiments of this application;
[0040] Figure 15 This is a schematic diagram of a second scenario of the sliding detection method provided in the embodiments of this application;
[0041] Figure 16 This is the first schematic diagram of the time-force relationship provided in the embodiments of this application;
[0042] Figure 17 This is a schematic diagram of the third scenario of the sliding detection method provided in the embodiments of this application;
[0043] Figure 18 This is the second schematic diagram of the time-force relationship provided in the embodiments of this application;
[0044] Figure 19This is a schematic diagram of the fourth scenario of the sliding detection method provided in the embodiments of this application;
[0045] Figure 20 This is the third schematic diagram of the time-force relationship provided in the embodiments of this application;
[0046] Figure 21 This is a schematic diagram of the fifth scenario of the sliding detection method provided in the embodiments of this application;
[0047] Figure 22 This is the fourth schematic diagram of the time-force relationship provided in the embodiments of this application;
[0048] Figure 23 This is a schematic diagram of the sixth scenario of the sliding detection method provided in the embodiments of this application;
[0049] Figure 24 This is the fifth schematic diagram of the time-force relationship provided in the embodiments of this application;
[0050] Figure 25 This is a schematic diagram of a sliding detection device provided in an embodiment of this application. Detailed Implementation
[0051] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings.
[0052] In the description of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. The "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Furthermore, "at least one" means one or more, and "multiple" means two or more. The terms "first," "second," etc., do not limit the quantity or order of execution, and "first," "second," etc., do not necessarily imply differences.
[0053] It should be noted that, in this application, the terms "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0054] The application scenarios of the embodiments of this application will be described below first.
[0055] Electronic devices typically have volume buttons on the side. Compared to virtual volume buttons on a touchscreen, side volume buttons are more in line with user operating habits.
[0056] Figure 1 This is a schematic diagram of a split volume button.
[0057] like Figure 1 As shown, the volume keys can be separate volume keys 101. Separate volume keys 101 are physical buttons with a mechanical structure, typically including a volume up key 1011 and a volume down key 1012. When the user presses the volume up key 1011, the media volume of the electronic device is increased; when the user presses the volume down key, the media volume of the electronic device is decreased. Users can conveniently adjust the media volume of the electronic device using separate volume keys 101 without needing to adjust the volume through a touchscreen or other operations.
[0058] The split volume buttons 101 are typically raised buttons. These buttons can have different shapes and materials to provide users with a comfortable tactile experience and an easy-to-press operation. The internal mechanical structure of the button allows the user to feel a certain amount of resistance when pressing the split volume button 101. Based on the rebound of the resistance, the user can confirm that the press operation has been completed.
[0059] However, because the split volume buttons 101 are mechanical, they are prone to malfunction when subjected to prolonged and frequent pressing by the user or other physical factors. For example, the buttons may become loose, lose sensitivity, or become unpressable. Furthermore, the mechanical structure of the split volume buttons 101 only provides simple pressing operations and cannot adapt to more complex interaction needs. For instance, the split volume buttons 101 cannot achieve fast forward or rewind through sliding or long-press operations. This negatively impacts the user experience.
[0060] To address the issue that separate volume buttons are prone to malfunction and cannot adapt to more complex interaction requirements, this application provides a sliding detection method.
[0061] The sliding detection method provided in this application can be applied to electronic devices. These electronic devices include, but are not limited to, mobile phones, tablets, personal computers, workstations, large-screen devices (e.g., smart screens, smart TVs), wearable devices (e.g., smart bracelets, smartwatches), handheld game consoles, home game consoles, virtual reality devices, augmented reality devices, mixed reality devices, and in-vehicle smart terminals.
[0062] Figure 2 This is a schematic diagram of the hardware structure of the electronic device provided in the embodiments of this application.
[0063] like Figure 2As shown, the electronic device 100 may include a processor 110, a memory 120, an audio module 130, buttons 140, a motor 150, a camera 160, a display screen 170, a sensor module 180, etc. The sensor module 180 may include a pressure sensor 180A, a fingerprint sensor 180B, a touch sensor 180C, etc.
[0064] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0065] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0066] The memory 120 can be used to store computer executable program code, including instructions. The memory 120 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.). Furthermore, the memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the memory 120 and / or instructions stored in memory located within the processor.
[0067] The audio module 130 is used to play audio. In one implementation, the audio module 130 can increase or decrease the volume in response to a user's operation of the button 140.
[0068] Buttons 140 include a power button, volume buttons, etc. Buttons 140 can be mechanical buttons or touch buttons. The electronic device 100 can receive button inputs and generate signal inputs related to user settings and function control of the electronic device 100. In one implementation, the volume buttons are integrated volume buttons.
[0069] Motor 150 can generate vibration alerts. Motor 150 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to different touch operations performed by the user on different applications (such as camera applications and audio applications). In one implementation, motor 150 can generate vibration feedback in response to the user's operation of button 140.
[0070] Camera 160 is used to capture still images or videos. In one implementation, camera 160 can increase or decrease the zoom level in response to a user's operation of button 140.
[0071] The display screen 170 is used to display images, videos, etc. The display screen 170 includes a display panel.
[0072] The pressure sensor 180A can be installed on the display screen 170 to detect changes in pressure applied by the user's finger or palm to the phone screen, thereby enabling special gesture recognition functions. For example, different levels of operation, such as light touch and long press, can be achieved through touch responses of varying pressure levels. The pressure sensor 180A can also be installed inside the mid-frame of the electronic device 100 to detect changes in pressure applied to the button 140.
[0073] The fingerprint sensor 180B is used to collect fingerprints. In some embodiments, the fingerprint sensor 180B may be disposed on the surface of the button 140 for activating the button 140.
[0074] Touch sensor 180C, also known as a "touch device," can be disposed on display screen 170. The touch sensor 180C and display screen 170 together form a touchscreen, also known as a "touchscreen." Touch sensor 180C is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 170. In some embodiments, touch sensor 180C can also be disposed on the surface of electronic device 100, in a different location than display screen 170. In other embodiments, touch sensor 180C can also be disposed on button 140 to detect touch operations applied to button 140.
[0075] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.
[0076] Figure 3 This is a schematic diagram of the software structure of the electronic device provided in the embodiments of this application.
[0077] like Figure 3 As shown, the layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0078] The application layer can include a series of application packages.
[0079] like Figure 3 As shown, the application package may include applications such as battery management, camera, gallery, calendar, call, map, navigation, music, video, SMS, and games. In one implementation, the user can control the electronic device 100 to perform corresponding functions on the camera application, gallery application, music application, video application, etc., by sliding, pressing, or other operations on the button 140.
[0080] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0081] like Figure 3 As shown, the application framework layer may include a window manager, an input manager, a sensor manager, a phone manager, a resource manager, a notification manager, etc.
[0082] An input manager can be used to listen for user input events, such as clicks and swipes performed by the user's finger on the display screen 193 of the electronic device 100. By listening to input events, the electronic device 100 can determine whether it is in use. In one implementation, the input manager can listen for user input events on keypad 140 to determine the appropriate function to be performed.
[0083] The sensor manager is used to monitor data returned by various sensors in the electronic device, such as pressure sensor data, fingerprint sensor data, and touch sensor data. Using the data returned by these sensors, the electronic device 100 can determine whether there has been a user interaction on the button 140.
[0084] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0085] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0086] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0087] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0088] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0089] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0090] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0091] A 2D graphics engine is a graphics engine for 2D drawing.
[0092] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0093] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0094] The sliding detection method provided in this application embodiment is executed by the electronic device 100 based on the press-and-touch button. The following description will use the press-and-touch button as an integrated volume button.
[0095] Figure 4 This is a schematic diagram of an integrated volume button.
[0096] like Figure 4 As shown, the electronic device 100 can have an integrated volume button 102 installed by slotting the outer surface of the middle frame 1.
[0097] Specifically, the electronic device 100 may have a first groove 2 on the middle frame 1, and a first notch 21 and a second notch 22 are provided on the contact surface between the middle frame 1 and the first groove 2. The first groove 2 communicates with the interior of the middle frame 1 through the first notch 21 and the second notch 22.
[0098] The volume button 3 includes a first crossbeam 31, a first locking pin 32, and a second locking pin 33. The first locking pin 32 and the second locking pin 33 are symmetrically arranged on the radial center line of the first crossbeam 31. The first crossbeam 31 is engaged with the first groove 2, the first locking pin 32 extends into the middle frame 1 through the first notch 21, and the second locking pin 33 extends into the middle frame 1 through the second notch 22.
[0099] The interior of the middle frame 1 includes a first connecting column 11, a second connecting column 12, and a first connecting beam 13. One end of the first connecting column 11 and one end of the second connecting column 12 are arranged side by side on the inner surface of the middle frame 1, and the other ends of the first connecting column 11 and the second connecting column 12 extend into the interior of the middle frame 1. The other ends of the first connecting column 11 and the second connecting column 12 are respectively connected to the two ends of the first connecting beam 13. The first connecting column 11, the second connecting column 12, and the first connecting beam 13 can form an integrally formed support structure.
[0100] A first steel plate 111 can be provided between the first connecting post 11 and the second connecting post 12. One end of the first steel plate 111 can be fixed to the first connecting post 11, and the other end can be fixed to the second connecting post 12.
[0101] The first snap-fit post 32 and the second snap-fit post 33 can be embedded in the first steel plate 111.
[0102] Multiple first sensors 01 can be installed on the first steel sheet 111.
[0103] In this way, the above structure can form a cantilever beam structure between the volume button 3 and the middle frame 1. When the user slides or presses the volume button 3, the sensor in the cantilever beam structure can sense the pressure applied by the user and determine the user's sliding (or pressing) position based on the pressure applied by the user. The electronic device 100 can adjust the volume based on the pressure and the sliding (or pressing) position.
[0104] Figure 5 This is a diagram illustrating the usage scenarios of an integrated volume button.
[0105] like Figure 5 As shown, when the user's finger slides in region A of the first crossbeam 31, the finger applies pressure F to the first crossbeam 31, the first crossbeam 31 deforms and transmits the pressure F to the first snap-fit post 32, the first snap-fit post 32 transmits the pressure F to the first steel sheet 111, so that the first steel sheet 111 deforms. At this time, the first sensor 01 on the side of the first steel sheet 111 near the first connecting post 11 can measure the first pressure F1 and the first deformation.
[0106] Correspondingly, although area B of the first crossbeam 31 does not receive a user's sliding operation, the first crossbeam 31 and the first steel plate 111 are both integral structures. Therefore, the other end of the first steel plate 111 will also be deformed. At this time, the first sensor 01 on the side of the first steel plate 111 near the second connecting post 12 can measure the second pressure F2 and the second deformation. The value of the first pressure F1 is greater than the value of the second pressure F2, and the value of the first deformation is greater than the value of the second deformation. Based on the values of the first pressure F1, the first deformation, the second pressure F2, and the second deformation, the user's current sliding force and sliding position can be determined.
[0107] In this way, when the user slides at different positions on the first crossbeam 31, the different values detected by the first sensor 01 at different positions can determine the different sliding (or pressing) forces and different sliding (or pressing) positions of the user, and thus determine the adjustment operation that the user needs to perform.
[0108] Figure 6 This is a schematic diagram of another type of integrated volume button.
[0109] like Figure 6 As shown, the electronic device 100 can have an integrated volume button 102 installed on the outer surface of the mid-frame 10 without slotting.
[0110] Specifically, the electronic device 100 can have a second recess 20 inside the middle frame 10, so the thickness of region C of the middle frame 10 is less than the thickness of other regions of the middle frame 10. Multiple third sensors 30 are disposed on the inner surface of region C. Region C of the middle frame 10 and the multiple third sensors 30 can be combined to form an integrated volume button 102.
[0111] In this way, when the user slides or presses on the C area, the C area is more prone to deformation than other areas of the middle frame 10. Multiple third sensors 30 can sense the stress and strain applied by the user, and the electronic device 100 can adjust the volume based on the changes in stress and strain.
[0112] Figure 7 This is a diagram illustrating another usage scenario for an integrated volume button.
[0113] like Figure 7 As shown, when a user's finger slides along the M direction in region C of the middle frame 10, region C1 of the middle frame 10 deforms first. The third sensor 30 corresponding to region C1 can measure the first stress and first strain of the finger in that region. As the finger continues to slide, the third sensor 30 corresponding to the sliding position can measure the changes in stress and strain values. For users, the sliding force usually gradually decreases during the sliding along the M direction. For example, when the user slides to region C2 of the middle frame 10, the force usually decreases because the angle of the finger relative to the middle frame 10 changes. Therefore, the values of the second stress and second strain measured by the third sensor 30 corresponding to region C2 are less than the values of the first stress and first strain.
[0114] In this way, as the user's finger slides from region C1 to region C2, multiple third sensors 30 can detect changes in the sliding force from large to small, as well as changes in strain at different positions. The electronic device 100 can determine the user's volume adjustment needs when these changes are detected. For example, the user's finger sliding along the M direction in region C can be used to turn down the volume.
[0115] It should be noted that the integrated volume key 102 includes, but is not limited to, the structure shown in the embodiments of this application. For example, the integrated volume key 102 can also be designed with its internal structure based on the ultrasonic principle. Other structures of the integrated volume key 102 will not be described in detail in this application. The technical solutions shown in the embodiments of this application can be applied to integrated volume keys 102 with various structures, and the embodiments of this application do not limit this.
[0116] The integrated volume button 102 provided in this application embodiment can avoid the damage to the mechanical structure caused by the use of separate buttons, and has a longer service life. Furthermore, the integrated volume button 102 also provides users with more interaction methods.
[0117] Figure 8 This is a schematic diagram of the sliding detection method provided in the embodiments of this application.
[0118] like Figure 8 As shown, in one implementation, the method may include the following steps S101-S104.
[0119] Step S101: In response to the user's first operation on the button along the first direction, the first force of the first operation is obtained.
[0120] In one implementation, the button is an integrated volume button 102, and the structure of the integrated volume button 102 includes at least one of the cantilever beam structure, multiple sensor structure, and ultrasonic structure in the foregoing embodiments.
[0121] In one implementation, the electronic device 100 can control the button to enter the wake-up state and then execute step S101.
[0122] The integrated volume button 102 can be configured to have two states: a wake-up state and a sleep state. For example, when the integrated volume button 102 is in the wake-up state, the user's operations on the integrated volume button 102 can be as follows: Figure 4 The first sensor 01 shown, or as... Figure 6 The third sensor 30, as shown, detects and sends the data to the processor for processing and analysis. When the integrated volume buttons 102 are in sleep mode, user operations on the integrated volume buttons 102 are as follows: Figure 4 The first sensor 01 shown or as... Figure 6 After the third sensor 30 shown detects the data, the processor may not respond to user input.
[0123] Specifically, users can customize how the integrated volume button 102 enters the wake-up state, and the electronic device 100 controls the integrated volume button 102 to enter the wake-up state based on the corresponding method. For example, users can press and hold the button for a certain duration. The electronic device 100 obtains the duration of the user's touch on the integrated volume button 102. If the touch duration is greater than or equal to a first touch threshold, the electronic device 100 controls the button to enter the wake-up state. For example, the first touch threshold is 2 seconds.
[0124] Users can also tap the integrated volume button 102 a certain number of times. The electronic device 100 obtains the number of times the user taps the button. If the number of taps is greater than or equal to the first count threshold, the electronic device 100 controls the integrated volume button 102 to enter the wake-up state. For example, the first count threshold is 2 times.
[0125] The user can also touch a certain position of the button. The electronic device 100 obtains the user's touch position on the integrated volume button 102. If the touch position is a preset position, the electronic device 100 controls the integrated volume button 102 to enter the wake-up state. For example, the preset position is the center of the integrated volume button 102.
[0126] Electronic device 100 can also monitor the running status of preset applications. If the preset application is running in the foreground or background, electronic device 100 controls the integrated volume button 102 to enter the wake-up state.
[0127] To alert the user that the integrated volume button 102 has entered the wake-up state, the electronic device 100 can also vibrate to alert the user via the motor 191 after the button enters the wake-up state.
[0128] Users can also customize how the integrated volume button 102 enters sleep mode, and the electronic device 100 controls the integrated volume button 102 to enter sleep mode accordingly. For example, after the electronic device 100 enters sleep mode, the integrated volume button 102 can also enter sleep mode, or, if the user does not operate the integrated volume button 102 for a certain period of time, the integrated volume button 102 will automatically enter sleep mode. This application embodiment does not limit the specific method by which the integrated volume button 102 enters wake-up mode and sleep mode.
[0129] The slide detection method in this application embodiment can be implemented after the electronic device 100 controls the integrated volume button 102 to enter a wake-up state, or it can be implemented when the integrated volume button 102 is in a continuous running state. When the slide detection method in this application embodiment is implemented after the integrated volume button 102 enters a wake-up state, it can prevent accidental touches by the user. When the slide detection method in this application embodiment is implemented when the integrated volume button 102 is in a continuous running state, the user can quickly trigger the operation command at any time. The running state of the integrated volume button 102 in this application can be set according to user habits, and this application embodiment does not limit this.
[0130] When a user performs a first operation on the integrated volume button 102 along a first direction, the electronic device 100 can, based on, such as Figure 4 The multiple first sensors 01 shown acquire the first force of the first operation, or, based on, as... Figure 6The multiple third sensors 30 shown acquire the first force of the first operation.
[0131] Figure 9 This is a first operational schematic diagram provided in the embodiments of this application.
[0132] like Figure 9 As shown, taking the first direction as the Q1 direction from the top of the integrated volume key 102 to the bottom of the integrated volume key 102 as an example, the first operation can be a sliding operation along the Q1 direction.
[0133] It should be noted that the first direction can be either the top of the integrated volume button 102 pointing to the bottom of the integrated volume button 102, or the bottom of the integrated volume button 102 pointing to the top of the integrated volume button 102. The following embodiments of this application use the top of the integrated volume button 102 pointing to the bottom of the integrated volume button 102 as an example for illustration. In fact, the embodiments of this application do not limit the first direction, and the embodiments can be referred to interchangeably. The first operation can include a sliding operation, a pressing operation, a pressing-then-sliding operation, and a sliding-then-pressing operation, etc. The embodiments of this application do not limit the specific operation method of the first operation. The first force can be as follows: Figure 4 The pressure detected by the multiple first sensors 01 shown can also be as follows: Figure 6 The stress detected by the multiple third sensors 30 shown in this application embodiment does not limit the specific form of the first force.
[0134] Step S102: Based on the first force, determine whether to execute the first operation instruction corresponding to the first operation.
[0135] In one implementation, if the first force is greater than or equal to the first detection threshold, the first operation instruction is executed. If the first force is less than the first detection threshold, the first operation instruction is not executed.
[0136] The first detection threshold can be preset by the electronic device 100 according to the configured structure of the integrated volume key 102. When setting the first detection threshold for integrated volume keys 102 with different structures, the set value can be the same or different. This application embodiment is only used as an example to illustrate that integrated volume keys 102 with different structures have the same first detection threshold value.
[0137] The first detection threshold can be a sliding detection threshold. Taking a pressure of 0.4N as an example, the first detection threshold can be set to 0.25N. Thus, when the pressure is greater than the first detection threshold, the electronic device 100 can execute the first operation command corresponding to the first operation. This application embodiment only illustrates the first detection threshold by way of example; the specific value of the first detection threshold can be set according to actual conditions.
[0138] It should be noted that the detection of the first operation by the electronic device 100 includes not only the detection of the operation force, but also the detection of the operation position. The electronic device 100 converts the operation force and operation position detected by the sensor into corresponding analog or digital signals, and processes these signals in the processor so that the processor executes the corresponding first operation instruction.
[0139] Specifically, the electronic device 100 can determine whether a first operation command corresponding to the operation needs to be executed based on the force of the operation. The specific execution method of the first operation command needs to be determined jointly based on the force and position of the operation. For example, in a scenario where a user adjusts the volume, if the user slides down 8 mm from the top of the integrated volume button 102 with a force of 0.4N, the electronic device 100 can reduce the volume from the current volume value 20 to the volume value 10. If the user slides down 4 mm from the top of the integrated volume button 102 with a force of 0.4N, the electronic device 100 can reduce the volume from the current volume value 20 to the volume value 15. Therefore, when the force of the operation is 0.4N, the electronic device 100 can determine that the first operation command needs to be executed, and the degree of volume adjustment is further defined by the electronic device 100 in the first operation command based on the force and position of the operation.
[0140] It should be noted that users typically cannot operate with a constant force. When a user slides the integrated volume button 102 down 8 mm with a force of 0.4N, the user first increases the force from 0N to 0.4N, and then gradually decreases the force from 0.4N. The first force can actually be a range of forces, rather than just a single force value. This application only uses the peak value within the force range as an example for illustration.
[0141] When the initial pressure is 0.2N and the initial detection threshold is 0.25N, the initial pressure is less than the initial detection threshold. In this case, the electronic device 100 does not execute the initial operation command. This avoids accidental touches by the user.
[0142] In this embodiment, compared to separate buttons that can only control the electronic device to perform corresponding functions by pressing, the user can control the electronic device 100 to execute the first operation command based on the sliding operation on the integrated volume button 102. In this way, the sliding interaction method can improve the user experience.
[0143] Specifically, the sliding interaction method provided by the integrated volume button 102 can solve some of the limitations of separate buttons. For example, in the scenario of adjusting the volume, the operation command triggered by each press of a separate button may only increase the volume value by 2, which is preset in the electronic device. If the volume value needs to be adjusted from 0 to 8, at least 3 presses are required on the separate volume button. However, the first operation command generated by each slide of the integrated volume button 102 is different. Depending on the sliding distance, the first operation command may increase the volume value by 2, 4, 6, or 8, thus achieving the user's needs with fewer operations. Therefore, the sliding interaction process based on the integrated volume button 102 in this embodiment of the application has better flexibility.
[0144] In step S103, if it is determined that the first operation instruction will be executed, in response to the user's second operation on the button along the second direction, the second force of the second operation is obtained, wherein the second direction is the opposite of the first direction.
[0145] When the user performs a second operation on the integrated volume button 102 in a second direction, the electronic device 100 can, based on, Figure 4 The multiple first sensors 01 shown acquire the second force of the second operation, or, based on, as... Figure 6 The multiple third sensors 30 shown acquire the second force of the second operation.
[0146] Step S104: Based on the second force, determine whether to execute the second operation instruction corresponding to the second operation.
[0147] The second operation performed by the user on the integrated volume button 102 along the second direction usually includes two situations: the first situation is the second operation based on the user's unconscious operating habits, and the second situation is the second operation based on the user's subjective intention.
[0148] Therefore, the second operation based on the user's unconscious operating habits is prone to errors.
[0149] Figure 10 This is a schematic diagram of a misoperation scenario provided in an embodiment of this application.
[0150] like Figure 10 As shown, taking a photography scenario as an example, the integrated volume button 102 can adjust the zoom level on the camera application's camera page 103. For example, when the user slides their finger along the Q1 direction on the integrated volume button 102, the electronic device can magnify the scene 104 in the lens.
[0151] It should be noted that the function of the integrated volume button 102 in adjusting the zoom level in the camera application can be user-defined. Users can also customize the integrated volume button 102 to adjust the exposure. This application embodiment does not limit the customization method of the integrated volume button 102 in the camera application.
[0152] In this scenario, if a user needs to adjust from 1x zoom to 3x zoom, it might not be possible to achieve this in a single operation. Specifically, if the user slides their finger along the Q1 direction on the integrated volume button once, they can only adjust from 1x zoom to 2x zoom. Then, after sliding their finger to the bottom of the integrated volume button 102, they need to remove their finger and slide it again along the Q1 direction from the top of the integrated volume button 102 to adjust from 2x zoom to 3x zoom. However, some users might habitually keep their finger on the integrated volume button 102 and slide it directly from the bottom to the top. This could lead to the mistaken operation of adjusting from 1x zoom to 2x zoom and then back from 2x zoom to 1x zoom, requiring multiple operations to reach 3x zoom.
[0153] Taking a scenario where a user increases the volume as an example, after the user performs the first operation to decrease the volume, if the first operation has achieved the user's needs, the user's finger usually leaves the integrated volume button 102. If the first operation has not achieved the user's needs, the user needs to adjust based on the current operation position to continue decreasing or increasing the volume. In this case, the user can repeat the previous operation to continue decreasing the volume. In this case, the user needs to return from the current position to the top of the integrated volume button 102. This process involves the user's finger not leaving the integrated volume button 102, which is an unconscious operation that can easily lead to the accidental increase of the volume.
[0154] If a user needs to increase the volume, they can slide in the opposite direction from their current position. This process requires the user to consciously perform the sliding operation in the opposite direction.
[0155] Based on the two scenarios of unconscious and subjective operation in the second operation, the specific operation form of the second operation can be distinguished. The second operation includes either a first sub-operation or a second sub-operation. The first sub-operation includes a sliding operation performed by the user in a second direction without removing their finger from the button after performing the first operation. The second sub-operation includes a first pressing operation performed by the user on the integrated volume button 102 without removing their finger after performing the first operation, and a first sliding operation performed by the user from the pressing position in a second direction without removing their finger from the integrated volume button 102 after the first pressing operation.
[0156] Figure 11 This is a schematic diagram of the first sub-operation provided in the embodiments of this application.
[0157] like Figure 11 As shown, taking the second direction as the Q2 direction from the bottom of the integrated volume key 102 to the top of the integrated volume key 102 as an example, the first sub-operation can be a sliding operation along the Q2 direction.
[0158] In one implementation, step S104 includes steps S1041-S1042.
[0159] Step S1041: When the second operation is the first sub-operation, if the second force is greater than or equal to the first detection threshold, execute the second operation instruction.
[0160] Step S1042: If the second force is less than the first detection threshold, the second operation instruction is not executed.
[0161] In reality, the first sub-operation may be based on the user's subjective intention or it may be based on the user's unconscious operating habits.
[0162] When the first sub-operation is based on the user's subjective intention, the user usually subjectively increases the sliding force, resulting in a larger second force. For example, the electronic device 100 may obtain a second force of 0.4N. The electronic device 100 compares the second force with a first detection threshold. When the first detection threshold is 0.25N, the second force is greater than the first detection threshold, and the electronic device 100 executes the second operation instruction.
[0163] When the first sub-operation is based on the user's subjective intent, the user typically applies a certain amount of force to the integrated volume key 102. For example, in a volume adjustment scenario, the user first performs a first operation, sliding 0.4N downwards 8mm from the top of the integrated volume key 102. After the electronic device 100 reduces the volume from the current value 20 to 10, the user may feel the current volume is too low and immediately perform the first sub-operation, sliding from the current 8mm position back towards the top of the integrated volume key 102. Because the user has a subjective intent to slide, the second force applied during the first sub-operation is usually slightly less than or equal to the first force, for example, 0.3N. Thus, the second force of 0.3N is greater than the first detection threshold of 0.25N, and the electronic device 100 executes the second operation instruction. The second operation instruction can specifically be used to increase the volume of the electronic device 100 from the current value 10 to the volume value 15. Therefore, the electronic device 100 can accurately identify that the current first sub-operation is based on the user's subjective intent.
[0164] When the first sub-operation is based on the user's unconscious operating habits, the user typically slides lightly on the integrated volume button 102, without applying excessive force. For example, in a scenario where the user adjusts the volume, they first perform the first operation, sliding 8 mm downwards from the top of the integrated volume button 102 with a force of 0.4 N. The electronic device reduces the volume from the current value of 20 to the value of 10, meeting the user's needs. However, due to the user's unconscious operating habits, the first sub-operation is performed, sliding from the current 8 mm position towards the top of the integrated volume button 102. Since the user lacks the subjective intention to slide, the second force is smaller, for example, 0.1 N. Thus, the second force of 0.1 N is less than the first detection threshold of 0.25 N, and the electronic device 100 does not execute the second operation command. Therefore, the electronic device 100 can accurately identify that the current first sub-operation is based on the user's unconscious operating habits.
[0165] Specifically, after the electronic device 100 converts the operating force and position of the second operation detected by the sensor into corresponding signals, it processes these signals in a processor. The processor can determine the relationship between the second force and the first detection threshold, and then determine whether the second operation instruction needs to be executed. Based on this, the electronic device 100 can accurately identify whether the first sub-operation is based on the user's subjective intention or on the user's unconscious operating habits, and has the ability to detect the user's actual usage intention.
[0166] In one implementation, step S104 further includes step S1043.
[0167] Step S1043: When the second operation is a second sub-operation, if the second force corresponding to the first pressing operation in the second sub-operation is greater than or equal to the second detection threshold, and the second force corresponding to the first sliding operation in the second sub-operation is greater than or equal to the first detection threshold, execute the second operation instruction.
[0168] The second sub-operation is typically a subjective action by the user. After performing the first operation, the user may not have an immediate reaction time to perform the first sub-operation immediately, but rather needs a certain reaction time to continue with other sliding operations. Thus, the user's actual action is the second sub-operation: within the reaction time, the user performs the first press operation, and after the reaction time ends, performs the first sliding operation from the press position in the second direction. Since both the first press and the first sliding operation are subjective actions by the user, the user usually applies a certain amount of force during these two operations.
[0169] Figure 12 This is a schematic diagram of the second sub-operation provided in the embodiments of this application.
[0170] like Figure 12 As shown, taking the second direction as the Q2 direction from the bottom of the integrated volume button 102 to the top of the integrated volume button 102 as an example, the second sub-operation can be a pressing operation followed by a sliding operation along the Q2 direction.
[0171] In order to determine the user's current operation mode, the electronic device 100 pre-sets a second detection threshold according to the configured integrated volume key 102 structure.
[0172] The second detection threshold can be a pressure detection threshold. For example, the second detection threshold is 1.3N. Thus, when the second force corresponding to the first pressure operation in the second sub-operation is greater than or equal to the second detection threshold, the electronic device 100 can determine that the user has a subjective intention to change the sliding direction. Furthermore, when the second force corresponding to the first sliding operation in the second sub-operation is greater than or equal to the first detection threshold, the electronic device 100 can determine that the user has a subjective intention to slide along the Q2 direction. This embodiment only provides an illustrative example of the second detection threshold; the specific value of the second detection threshold can be set according to actual circumstances.
[0173] Figure 13 This is a schematic diagram of the second sub-operation provided in another embodiment of this application.
[0174] like Figure 13 As shown, the second sub-operation may also have other operation forms besides those described in the foregoing embodiments. For example, the second sub-operation may be a sliding operation performed by the user from the end position of the first operation to the second direction after performing the first operation, a second pressing operation on the integrated volume key 102 after sliding a certain distance, and a second sliding operation from the pressing position to the second direction.
[0175] This second sub-operation includes both an unconscious swipe and a subjective operation. Specifically, after performing the first operation, the user will unconsciously swipe back for a period of time. After a certain reaction time, the user can determine that a second press operation is needed. Thus, the electronic device 100 can determine that the user has a subjective intention to change the sliding direction. After the user performs the second press operation, the user can further subjectively perform a second slide operation in the second direction, allowing the electronic device 100 to determine that the user has a subjective intention to slide in the second direction and make corresponding adjustments based on the second slide operation. In other words, the electronic device 100 can accurately identify that the second sub-operation includes operations based on the user's subjective intention. Thus, the electronic device 100 has the ability to detect the user's actual usage intention.
[0176] The above operation method can be implemented in various application scenarios. Users may perform a series of continuous operations in different application scenarios.
[0177] Based on this, in one implementation, steps S105-S106 are included after step S1042.
[0178] Step S105: In response to the user's third operation on the button along the first direction, obtain the third force of the third operation.
[0179] The third operation is a sliding operation performed by the user without leaving the integrated volume button 102 after the first sub-operation.
[0180] Taking a user adjusting volume as an example, due to the small size of the integrated volume button 102, its single-adjustment range may not meet the user's needs, requiring multiple adjustments to reach the target volume value. For instance, the user first performs an operation, sliding the integrated volume button 102 down 8 millimeters with a force of 0.4N. After the electronic device 100 reduces the volume from the current value of 20 to 10, the current volume value may still be high, requiring further adjustment. Therefore, the user needs to return to the top of the integrated volume button 102 to adjust the volume again. During this process, due to unconscious operating habits, the user may not remove their finger from the integrated volume button 102, returning to its top, thus performing a second sub-operation with a force less than the first detection threshold. In this case, the electronic device 100 does not execute the corresponding instruction for the first sub-operation. After the user returns to the top of the integrated volume button 102 based on the first sub-operation, they can perform a third operation, which can be performed in the same way as the first operation.
[0181] Taking a user adjusting volume as an example, a user may not be able to reach the target volume value with just one adjustment. For instance, the user first performs an operation by sliding down 8 millimeters from the top of the integrated volume button 102 with a force of 0.4N. After the electronic device 100 reduces the volume from the current volume value of 20 to the volume value of 10, the current volume value may be too low, and the user needs to continue adjusting the volume value. The user can perform a second sub-operation, with a force greater than or equal to the first detection threshold, to slide back. In this way, the electronic device 100 can increase the current volume value to 14. If the user believes that the current volume value still needs to be reduced, the user can perform a third operation, the specific operation method of which can be the same as the first operation.
[0182] Step S106: If the third force is greater than or equal to the first detection threshold, execute the third operation instruction corresponding to the third operation.
[0183] The third operation is usually a subjective operation by the user. Therefore, the user usually applies a certain force to the integrated volume button 102. The electronic device 100 can determine that the third force is greater than or equal to the first detection threshold, and then execute the third operation instruction corresponding to the third operation.
[0184] In this way, when the user performs the first operation, the first sub-operation, and the third operation in sequence, a series of continuous operations can be formed. During the continuous operation, the electronic device 100 can accurately identify the operation instructions that need to be executed, match the user's operating habits, and avoid user misoperation.
[0185] In one implementation, steps S1041 or S1043 are followed by steps S107-S108.
[0186] Step S107: In response to the user's fourth operation on the button along the first direction, obtain the fourth force of the fourth operation.
[0187] The fourth operation is a sliding operation performed by the user without removing their finger from the integrated volume button 102 after performing the second sub-operation.
[0188] Taking a user adjusting volume as an example, a user may not be able to reach the target volume value with just one adjustment. For instance, the user first performs an operation by sliding the integrated volume button 102 down 8 millimeters with a force of 0.4N. After the electronic device 100 reduces the volume from the current volume value of 20 to the volume value of 10, the current volume value may be too low, and the user needs to continue adjusting the volume value. The user can perform a second sub-operation by pressing and then sliding back, which allows the electronic device 100 to increase the current volume value to 14. If the user believes that the current volume value still needs to be reduced, the user can perform a fourth operation, the specific operation method of which can be the same as the first operation.
[0189] Step S108: If the fourth force is greater than or equal to the first detection threshold, execute the fourth operation instruction corresponding to the fourth operation.
[0190] The fourth operation is usually a subjective operation by the user. Therefore, the user usually applies a certain force to the integrated volume button 102. The electronic device 100 can determine that the fourth force is greater than or equal to the first detection threshold, and then execute the fourth operation instruction corresponding to the fourth operation.
[0191] In this way, when the user performs the first operation, the second sub-operation, and the fourth operation in sequence, a series of continuous operations can be formed. During the continuous operation, the electronic device 100 can accurately identify the operation instructions that need to be executed, match the user's operating habits, and avoid user misoperation.
[0192] In one implementation, steps S201-S202 are included before step S101.
[0193] Step S201: Determine whether at least one preset application is running in the foreground or background.
[0194] The integrated volume key 102 can be used in various applications and perform different functions in different applications. To improve the convenience of operation, the electronic device 100 can pre-configure the functions performed by the integrated volume key 102 in preset applications, and when the preset application is in a foreground or background running state, the integrated volume key 102 will execute the operation instructions corresponding to the preset application. The foreground and background running states include the foreground running state and the background running state.
[0195] Specifically, the electronic device 100 can monitor the activity lifecycle of a preset application to determine whether the preset application is running in the foreground or background. The electronic device 100 can also query the application manager or task manager provided by the operating system to determine whether the preset application is running in the foreground or background. The electronic device 100 can also detect user interaction with the application to determine whether the preset application is running in the foreground or background. This application embodiment does not limit the specific method for determining whether a preset application is in the foreground or background.
[0196] In one implementation, the preset application may include audio applications, video applications, browser applications, camera applications, etc. The specific type of the preset application is not limited in this application embodiment.
[0197] Step S202: If any preset application is running in the foreground or background, determine the function to be executed by the target operation instruction based on the target application. The target application is the preset application currently running in the foreground or background, and the target operation instruction includes at least a first operation instruction and a second operation instruction.
[0198] When the target application is an audio application or a video application, the electronic device 100 can determine that the first operation instruction executes the function of increasing the volume and the second operation instruction executes the function of decreasing the volume, or determine that the first operation instruction executes the function of decreasing the volume and the second operation instruction executes the function of increasing the volume.
[0199] It should be noted that users encounter multiple combinations of operations in any application. This application embodiment only provides illustrative examples of the operation forms involved in some applications. In actual application, this application embodiment includes one or more combinations, and this application embodiment does not limit this.
[0200] Figure 14 This is a schematic diagram of the first scenario of the sliding detection method provided in the embodiments of this application.
[0201] like Figure 14 As shown, taking a scenario of a user using an audio application as an example, the user slides K1 along the Q1 direction on the integrated volume button 102. The electronic device 100 can obtain the sliding force R1 of the sliding operation K1 based on multiple third sensors 30. The sliding force R1 is usually greater than a first detection threshold of 0.25N, so the electronic device 100 can increase the volume. If the volume increase of the electronic device 100 exactly meets the user's needs, the user will usually remove the integrated volume button 102 after sliding K1, completing the operation. In this case, accidental operation by the user is unlikely.
[0202] If the user needs to continue adjusting the volume, the user's finger returns to the initial position of the integrated volume button 102, and slides the integrated volume button 102 along the Q1 direction again. The electronic device 100 can then obtain the sliding force R2 of the sliding operation K2 based on multiple third sensors 30. The sliding force R2 is usually greater than the first detection threshold of 0.25N. In this way, the electronic device 100 can increase the volume again.
[0203] Users can repeat the above process multiple times, and this application embodiment will not elaborate on this.
[0204] In other words, the user can perform multiple sliding operations along the Q1 direction on the integrated volume button 102, and the sliding operations are not continuous between each two adjacent sliding operations. That is, after each sliding operation from the initial position of the integrated volume button 102, the user lifts his finger to perform the next operation. During this operation, the electronic device 100 can determine that the sliding force corresponding to each operation is greater than or equal to the first detection threshold, thereby executing the operation command corresponding to each operation.
[0205] In the above scenario, since the user lifts their finger after each swipe to perform the next operation, the user's operating habits usually do not cause misoperation. The swipe detection method provided in this application embodiment can accurately execute the operation command and determine the user's actual usage intention.
[0206] In one implementation, if the user sequentially performs a first operation, a second sub-operation where the force is less than a first detection threshold, and a third operation, the electronic device 100 can decrease the volume according to the first operation instruction and decrease the volume according to the third operation instruction, or increase the volume according to the first operation instruction and increase the volume according to the third operation instruction.
[0207] Figure 15 This is a schematic diagram of a second scenario of the sliding detection method provided in the embodiments of this application.
[0208] like Figure 15 As shown, taking the scenario of a user using an audio application as an example, the user slides K3 along the Q1 direction on the integrated volume button 102. The electronic device 100 can obtain the sliding force R3 of the sliding operation K3 based on multiple third sensors 30. The sliding force R3 is usually greater than the first detection threshold of 0.25N, so the electronic device 100 can increase the volume. If the volume increase of the electronic device 100 does not meet the user's needs, after the user slides K3 on the integrated volume button 102, the finger may not leave the integrated volume button 102 due to unconscious operating habits. The user will slide back K4 along the Q2 direction from the end position of the sliding operation K3 to return to the initial position of the integrated volume button 102. The electronic device 100 can obtain the sliding force R4 of the back sliding operation K4 based on multiple third sensors 30. The sliding force R4 is usually less than the first detection threshold of 0.25N. In this way, the electronic device 100 does not execute the operation command corresponding to the sliding operation K4, does not decrease the volume, and after returning to the initial position of the integrated volume button 102, it performs the sliding operation K5 again along the Q1 direction on the integrated volume button 102. The electronic device 100 can obtain the sliding force R5 of the sliding operation K5 based on multiple third sensors 30. The sliding force R5 is usually greater than the first detection threshold of 0.25N. In this way, the electronic device 100 can continue to increase the volume.
[0209] Users can repeat the above process multiple times, and this application embodiment will not elaborate on this.
[0210] In other words, the user can perform a series of consecutive operations on the integrated volume button 102, such as sliding operation K3, sliding back operation K4, sliding operation K5, and sliding back operation K6 (the operation method is the same as sliding back operation K4, which is not detailed in this embodiment). This series of operations will be referred to as the first consecutive operation. During the first consecutive operation, sliding back operation K4, sliding back operation K6, etc., are unconscious operations by the user and not operations with the user's actual intention. The electronic device 100 can determine that it is unnecessary to execute the operation commands corresponding to sliding back operation K4 and sliding back operation K6.
[0211] In the above scenario, because the user does not lift their finger after each swipe to perform the next operation, the user's operating habits can easily lead to misoperations. During the initial continuous operation, the user's operation is similar to scrolling a wheel. This allows the user to perform the initial continuous operation quickly and avoids misoperations. The electronic device 100 can match the user's operating habits, accurately identify unnecessary operation commands, and determine the user's actual usage intention.
[0212] Figure 16 This is the first schematic diagram of the time-force relationship provided in the embodiments of this application.
[0213] like Figure 16 As shown, the horizontal axis represents time (s) and the vertical axis represents pressure (N), illustrating the time-force relationship between sliding operation K3, sliding back operation K4, and sliding operation K5.
[0214] Specifically, during the sliding operation K3, the pressure gradually increases from -0.04N to 0.5N within the time range of 1.1s-1.8s, and then gradually decreases from 0.5N to 0.1N within the time range of 1.8s-2.3s. During the sliding operation K4, the pressure fluctuates between 0.08N and 0.24N within the time range of 2.3s-3.5s. During the sliding operation K5, the pressure gradually increases from 0.1N to 0.52N within the time range of 3.5s-4.3s, and then gradually decreases from 0.52N to -0.04N within the time range of 4.3s-4.9s.
[0215] It should be noted that the pressure value can be a relative pressure difference, which can be the pressure relative to a given reference value. A positive pressure value indicates that the pressure is higher than the reference pressure, and a negative pressure value indicates that the pressure is lower than the reference pressure.
[0216] Thus, the sliding operation K3 triggered the first detection threshold of 0.25N as it gradually increased from -0.04N to 0.5N, and the sliding operation K5 also triggered the first detection threshold of 0.25N as it gradually increased from 0.1N to 0.52N. However, the force corresponding to the sliding back operation K4 was always below the first detection threshold of 0.25N, and therefore did not trigger it. Thus, the electronic device 100 can determine that the operation command corresponding to the sliding back operation K4 does not need to be executed.
[0217] The above time-force relationship diagram, based on numerical examples, shows that electronic device 100 can match the user's operating habits, accurately identify unnecessary operation commands, and determine the user's actual usage intention.
[0218] Figure 17 This is a schematic diagram of the third scenario of the sliding detection method provided in the embodiments of this application.
[0219] like Figure 17 As shown, taking the scenario of a user using an audio application as an example, the user slides K7 on the integrated volume button 102 along the Q1 direction. The electronic device 100 can obtain the sliding force R7 of the sliding operation K7 based on the third sensor 30. The sliding force R7 is usually greater than the first detection threshold of 0.25N, so the electronic device 100 can increase the volume. If the volume currently increased by the electronic device 100 is too large, after the user slides K7 on the integrated volume button 102, the finger can remain on the integrated volume button 102 and immediately slide back K8 from the ending position of the sliding operation K7 along the Q2 direction. After sliding back a certain distance, the electronic device 100 can obtain the sliding force R8 of the back sliding operation K8 based on the third sensor 30. The sliding force R8 is usually greater than or equal to the first detection threshold of 0.25N, so the electronic device 100 can decrease the volume. If the volume of the electronic device 100 decreases to below the target volume, the user can slide the device K9 along the Q1 direction again. The electronic device 100 can obtain the sliding force R9 of the sliding operation K9 based on the third sensor 30. The sliding force R9 is usually greater than the first detection threshold of 0.25N. In this way, the electronic device 100 can continue to increase the volume.
[0220] Users can repeat the above process multiple times, and this application embodiment will not elaborate on this.
[0221] In other words, the user can perform a series of consecutive operations, such as sliding operation K7, sliding back operation K8, and sliding operation K9, hereinafter referred to as the second consecutive operation. During the second consecutive operation, the sliding back operation K8 is an operation with the user's subjective intention, and the electronic device 100 can determine that the operation instruction corresponding to the sliding back operation K8 needs to be executed.
[0222] In the above scenario, if the user does not lift their finger to perform a swipe operation in the Q1 direction after performing a swipe operation in the Q2 direction, the electronic device 100 can determine whether the operation is a subjective operation or an unconscious operation habit of the user, so as to accurately distinguish the operation command and judge the user's actual usage intention.
[0223] Figure 18 This is the second schematic diagram of the time-force relationship provided in the embodiments of this application.
[0224] like Figure 18 As shown, the horizontal axis represents time (s) and the vertical axis represents pressure (N), illustrating the time-force relationship between sliding operation K7, sliding back operation K8, and sliding operation K9.
[0225] Specifically, during the sliding operation K7, the pressure gradually increases from -0.04N to 0.5N within the time range of 0.8s-1.8s, and gradually decreases from 0.5N to 0.25N within the time range of 1.8s-2.5s. During the sliding operation K8, the pressure fluctuates between 0.16N and 0.3N within the time range of 2.5s-3.6s. During the sliding operation K9, the pressure gradually increases from 0.16N to 0.5N within the time range of 3.6s-4.5s, and gradually decreases from 0.5N to -0.04N within the time range of 4.5s-5.4s.
[0226] Thus, the sliding operation K7 triggers the first detection threshold of 0.25N as the pressure gradually increases from -0.04N to 0.5N; the return operation K8 triggers the first detection threshold of 0.25N as the pressure fluctuates between 0.16N and 0.3N; and the sliding operation K9 triggers the first detection threshold of 0.25N as the pressure gradually increases from 0.16N to 0.5N. Therefore, the electronic device 100 sequentially executes the operation commands corresponding to the sliding operations K7, K8, and K9. The electronic device 100 can match the user's operating habits, determine that the return operation K8 is the operation command to be executed, and judge the user's actual usage intention.
[0227] In one implementation, if the user performs a first operation and a second sub-operation in sequence, the electronic device 100 can decrease the volume according to the first operation instruction and increase the volume according to the second operation instruction, or increase the volume according to the first operation instruction and decrease the volume according to the second operation instruction.
[0228] Figure 19 This is a schematic diagram of the fourth scenario of the sliding detection method provided in the embodiments of this application.
[0229] like Figure 19As shown, taking a scenario of a user using an audio application as an example, the user performs a swipe operation K10 along the Q1 direction. The electronic device 100 can obtain the swipe force R10 of the swipe operation K10 based on multiple third sensors 30. The swipe force R10 is usually greater than a first detection threshold of 0.25N, so the electronic device 100 can increase the volume. If the volume increase of the electronic device 100 is too large, the user can perform a pressing operation K11 after the swipe operation K10. The electronic device 100 can obtain the pressing force R11 of the pressing operation K11 based on multiple third sensors 30. The pressing force is usually greater than a second detection threshold of 1.3N, so the electronic device 100 can determine that the user's further operation is an operation with subjective intent. After a certain user reaction time, the finger performs a sliding operation K12 from the pressing position along the Q2 direction. After sliding back a certain distance, the electronic device 100 can obtain the swipe force R12 of the sliding operation K12 based on the third sensors 30. The swipe force R12 is usually greater than the first detection threshold of 0.25N, so the electronic device 100 can decrease the volume.
[0230] Users can repeat the above process multiple times, and this application embodiment will not elaborate on this.
[0231] In other words, the user can perform a series of consecutive operations, such as sliding operation K10, pressing operation K11, and sliding back operation K12, hereinafter referred to as the third consecutive operation. During the third consecutive operation, pressing operation K11 and sliding back operation K12 are operations with the user's subjective intention. The electronic device 100 can determine that after pressing operation K11, the user may have the intention to change direction. In this way, the electronic device 100 can accurately distinguish the operation command and judge the user's actual usage intention.
[0232] Figure 20 This is the third schematic diagram of the time-force relationship provided in the embodiments of this application.
[0233] like Figure 20 As shown, the horizontal axis represents time (s) and the vertical axis represents pressure (N), illustrating the time-force relationship between sliding operation K10, pressing operation K11, and sliding back operation K12.
[0234] Specifically, the sliding operation K10 gradually increases from -0.04N to 0.45N in the time range of 1s-1.6s, and gradually decreases from 0.45N to 0.3N in the time range of 1.6s-2.7s. The pressing operation K11 gradually increases from 0.3N to 2.25N in the time range of 2.7s-3.5s, and gradually decreases from 2.25N to 0.2N in the time range of 3.5s-4s. The sliding return operation K12 gradually increases from 0.2N to 0.65N in the time range of 4s-4.7s, and gradually decreases from 0.65N to -0.04N in the time range of 4.7s-5.4s.
[0235] Thus, the sliding operation K10 triggers the first detection threshold of 0.25N as it gradually increases from -0.04N to 0.45N; the pressing operation K11 triggers the second detection threshold of 2.25N as it gradually increases from 0.3N to 2.25N; and the sliding back operation K12 triggers the first detection threshold of 0.25N as it gradually increases from 0.2N to 0.65N. Therefore, the electronic device 100 sequentially executes the operation commands corresponding to the sliding operation K10, the pressing operation K11, and the sliding back operation K12. The electronic device 100 can match the user's operating habits and determine that the operation after the pressing operation K11 is an operation with the user's subjective intention, in order to judge the user's actual usage intention.
[0236] In scenarios where users adjust the volume, they can usually reach the target volume with fewer operations. In other scenarios, more complex operations are usually involved.
[0237] It should be noted that not only audio applications involve volume adjustment scenarios, but video applications also involve volume adjustment scenarios. Different types of applications can be referred to for each other, and this application embodiment will not elaborate on this.
[0238] The following describes how to operate in other applications.
[0239] When the target application is a video application, the electronic device 100 can determine that the first operation instruction executes the function of fast-forwarding the video, and the second operation instruction executes the function of rewinding the video, or determine that the first operation instruction executes the function of rewinding the video, and the second operation instruction executes the function of fast-forwarding the video.
[0240] It should be noted that video applications involve both volume adjustment and video progress adjustment. The electronic device 100 can distinguish the purpose of the integrated volume button 102 based on different user operation methods to determine whether the user's operation of the integrated volume button 102 is for adjusting the volume or for adjusting the video progress.
[0241] In one implementation, when the user is playing a video in full screen and does not perform any other operations, the user's operation of the integrated volume button 102 can be used to adjust the volume. Specific volume adjustment methods can be found in the aforementioned audio applications. This application embodiment will not elaborate further on this.
[0242] In one implementation, if a user needs to adjust the video progress while playing a video in full screen, the user can bring up the video progress bar. After determining that the video progress bar is displayed on the current page of the display screen, the electronic device 100 can adjust the video progress in response to the user's operation of the integrated volume key 102.
[0243] In one implementation, if a user sequentially performs a first operation, a second sub-operation with a force less than a first detection threshold, and a third operation, the electronic device 100 can fast-forward the video according to the first operation instruction and fast-forward the video according to the third operation instruction, or rewind the video according to the first operation instruction and rewind the video according to the third operation instruction. Specific video progress adjustment methods in this application embodiment can be found in the aforementioned audio applications, and will not be elaborated upon in this application embodiment.
[0244] When the target application is a browser-type application, the electronic device 100 can determine that the first operation instruction performs the function of scrolling up to flip the screen, and the second operation instruction performs the function of scrolling down to flip the screen, or determine that the first operation instruction performs the function of scrolling down to flip the screen, and the second operation instruction performs the function of scrolling up to flip the screen.
[0245] In one implementation, if the user sequentially performs a first operation, a second sub-operation with a force less than a first detection threshold, and a third operation, the electronic device 100 can scroll down the screen according to the first operation instruction and scroll down the screen according to the third operation instruction, or scroll up the screen according to the first operation instruction and scroll up the screen according to the third operation instruction.
[0246] In one implementation, if the user sequentially performs the first operation, the second sub-operation, and the fourth operation, the electronic device 100 can scroll down the screen according to the first operation instruction, scroll up the screen according to the second operation instruction, and scroll down the screen again according to the fourth operation instruction; or, it can scroll up the screen according to the first operation instruction, scroll down the screen according to the second operation instruction, and scroll up the screen again according to the fourth operation instruction. Specific browsing progress adjustment methods in this application embodiment can be found in the aforementioned audio applications, and will not be elaborated upon in this application embodiment.
[0247] In addition to the above implementation methods, users using browser-like applications also encounter the following more complex operation methods.
[0248] Figure 21 This is a schematic diagram of the fifth scenario of the sliding detection method provided in the embodiments of this application.
[0249] like Figure 21 As shown, taking a user's experience with a browser-like application as an example, when browsing text, for a long text 300, the user might initially browse to two-thirds of the text. Upon subsequent browsing, the user might return to the initial position of the long text 300 because the current browsing progress hasn't been saved. Therefore, the user might perform multiple rapid swipes to locate the two-thirds mark of the long text 300. Specifically, when the user swipes K13 along the Q1 direction on the integrated volume button 102, the electronic device 100 can obtain the swiping force R13 of the swiping operation K13 based on the third sensor 30. The swiping force R13 is typically greater than a first detection threshold of 0.25N, allowing the electronic device 100 to scroll down the screen. If a user's single operation does not locate the target browsing position, after performing the swipe operation K13, the user's finger quickly returns to the top of the integrated volume key 102. During this process, due to operating habits, the user may not leave the integrated volume key 102, i.e., perform a backslide operation K14 along the Q2 direction from the end position of the swipe operation K13 to return to the top of the integrated volume key 102. The electronic device 100 can obtain the swiping force R14 of the backslide operation K14 based on the third sensor 30. The swiping force R14 is usually less than the first detection threshold of 0.25N. Therefore, the electronic device 100 does not execute the operation command corresponding to the backslide operation K14. The user can repeat the process of swiping operation K13-backslide operation K14 three times consecutively to position the electronic device 100 at two-thirds of the long text 300.
[0250] In other words, when a user repeatedly slides K13 and slides back K14 on the integrated volume button 102 three times, the slide back operation is an unconscious operation by the user and not an operation with the user's actual intention. The electronic device 100 can determine that there is no need to execute the operation instruction corresponding to the slide back operation K14 during the three repetitions.
[0251] In the above scenario, because the user repeatedly and quickly slides the integrated volume button 102 three times, the user's sliding back operation K14 is prone to misoperation. The electronic device 100 can match the user's operating habits, accurately identify the operation command that does not need to be executed, and judge the user's actual usage intention.
[0252] Figure 22This is the fourth schematic diagram of the time-force relationship provided in the embodiments of this application.
[0253] like Figure 22 As shown, the diagram illustrates the time-force relationship during the three repetitions of sliding operation K13 and sliding back operation K14, with time (s) on the horizontal axis and pressure (N) on the vertical axis.
[0254] Specifically, during the user's first sliding operation K13, the pressure gradually increased from -0.04N to 0.64N within the time range of 0.5s-0.8s, and then gradually decreased from 0.64N to 0.08N within the time range of 0.8s-1.3s. The return sliding operation K14 fluctuated within the pressure range of 0.08N-0.15N within the time range of 1.3s-1.7s. During the user's second sliding operation K13a, the pressure gradually increased from 0.08N to 0.55N within the time range of 1.7s-2s, and then gradually decreased from 0.55N to 0.18N within the time range of 2s-2.6s. The return sliding operation K14a fluctuated within the pressure range of 0.18N-0.22N within the time range of 2.6s-2.9s. When the user performs the sliding operation K13b for the third time, the value of the sliding operation K13b gradually increases from 0.18N to 0.74N in the time range of 2.9s-3.3s, and gradually decreases from 0.74N to -0.04N in the time range of 3.3s-4.1s.
[0255] Thus, the sliding operation K13 triggered the first detection threshold of 0.25N as it gradually increased from -0.04N to 0.64N. The sliding return operation K14, with its corresponding force all below the first detection threshold of 0.25N, did not trigger it. Similarly, the sliding operation K13a triggered the first detection threshold of 0.25N as it gradually increased from 0.08N to 0.55N. The sliding return operation K14a, with its corresponding force all below the first detection threshold of 0.25N, did not trigger it. The sliding operation K13b triggered the first detection threshold of 0.25N as it gradually increased from 0.18N to 0.74N. The electronic device 100 can match the user's operating habits, accurately determine unnecessary operation commands, and judge the user's actual usage intention.
[0256] Figure 23 This is a schematic diagram of the sixth scenario of the sliding detection method provided in the embodiments of this application.
[0257] like Figure 23As shown, taking a user's experience with a browser-like application as an example, when browsing text, for a long text 300, the user might initially browse to one-third of the text. Upon subsequent browsing, the user might return to the initial position of the long text 300 because the current browsing progress hasn't been saved. Thus, the user can perform multiple quick swipes to locate the one-third mark. However, there are instances where the user cannot accurately locate the one-third mark; during multiple quick swipes, the user might directly locate the halfway point. In this case, the user needs to manually swipe back from the halfway point to the one-third mark. Specifically, when the user swipes K15 along the Q1 direction on the integrated volume button 102, the electronic device 100 can obtain the swiping force R15 of the swiping operation K15 based on the third sensor 30. The swiping force R15 is typically greater than a first detection threshold of 0.25N, allowing the electronic device 100 to scroll down the screen. If a user's single operation leaves the target browsing position some distance away, after performing a swipe operation K15, the user's finger may quickly return to the top of the integrated volume buttons 102. During this process, due to operating habits, the user may not leave the integrated volume buttons 102, i.e., they may perform a swipe-back operation K16 along the Q2 direction from the end position of swipe operation K15 to return to the top of the integrated volume buttons 102. The electronic device 100 can obtain the swiping force R16 of the swipe-back operation K16 based on the third sensor 30. The swiping force R16 is usually less than the first detection threshold of 0.25N. Therefore, the electronic device 100 does not execute the operation command corresponding to the swipe-back operation K16. The user can then perform another swipe operation K17 along the Q1 direction on the integrated volume buttons 102. The electronic device 100 can obtain the swiping force R17 of the swipe operation K17 based on the third sensor 30. The swiping force R17 is usually greater than the first detection threshold of 0.25N. In this case, the electronic device 100 may scroll down the screen to halfway through the long text 300, requiring the user to continue adjusting the browsing progress. The user can press K18 at the halfway point of the long text 300. The electronic device 100 can obtain the pressing force R18 of the pressing operation K18 based on the third sensor 30. The pressing force is usually greater than the second detection threshold of 1.3N. In this way, the electronic device 100 can determine that the user has the intention to subjectively change the sliding direction. After a certain user reaction time, the finger slides back along the Q2 direction K19 from the pressing position. After sliding back a certain distance, the electronic device 100 can obtain the sliding force R19 of the sliding operation K19 based on the third sensor 30. The sliding force R19 is usually greater than the first detection threshold of 0.25N. In this way, the electronic device 100 can scroll up the screen and move from the halfway point of the long text 300 to the one-third point of the long text 300.
[0258] In other words, the user can perform a series of continuous operations such as sliding operation K15, sliding back operation K16, sliding operation K17, pressing operation K18, and sliding back operation K19. This series of continuous operations will be referred to as the fourth continuous operation. During the fourth continuous operation, the sliding back operation K16 is an unconscious operation by the user, while the pressing operation K18 and sliding back operation K19 are operations with the user's subjective intention. The electronic device 100 can identify and distinguish the operation commands and judge the user's actual usage intention.
[0259] Figure 24 This is the fifth schematic diagram of the time-force relationship provided in the embodiments of this application.
[0260] like Figure 24 As shown, the horizontal axis represents time (s) and the vertical axis represents pressure (N), illustrating the time-force relationship between sliding operation K15, sliding back operation K16, sliding operation K17, pressing operation K18, and sliding back operation K19.
[0261] In this embodiment, the sliding operation K15 gradually increases from -0.04N to 0.5N within the time range of 0.4s-0.7s, and gradually decreases from 0.5N to 0.1N within the time range of 0.7s-1.1s. The return operation K16 fluctuates within the pressure range of 0.05N-0.1N within the time range of 1.1s-1.3s. The sliding operation K17 gradually increases from 0.1N to 0.55N within the time range of 1.3s-1.8s. There is a slight return operation between the sliding operation K17 and the pressing operation K18, which is not described in this embodiment. The pressing operation K18 gradually increases from 0.45N to 1.35N within the time range of 1.8s-2.2s, and gradually decreases from 1.35N to 0.45N within the time range of 2.2s-2.5s. During the retracement operation, K19 fluctuated within the pressure range of 0.45N-0.55N in the time range of 2.5s-3.5s, and then gradually decreased from 0.5N to -0.04N.
[0262] Thus, the sliding operation K15 triggered the first detection threshold of 0.25N as the pressure gradually increased from -0.04N to 0.5N; the sliding back operation K16 fluctuated within the pressure range of 0.05N-0.1N without triggering the first detection threshold of 0.25N; the sliding operation K17 triggered the first detection threshold of 0.25N as the pressure gradually increased from 0.1N to 0.55N; the pressing operation K18 triggered the second detection threshold of 1.3N as the pressure gradually increased from 0.45N to 1.35N; and the sliding back operation K19 triggered the first detection threshold of 0.25N when fluctuating within the pressure range of 0.45N-0.55N. The electronic device 100 can match the user's operating habits, determining that the sliding back operation K16 is an unconscious operation, and that the pressing operation K18 and the sliding back operation K19 are operations with the user's subjective intent. Therefore, the electronic device 100 can distinguish the operation commands and determine the user's actual usage intent.
[0263] When the target application is a camera application, the electronic device 100 can determine that the first operation instruction executes the function of increasing the zoom magnification and the second operation instruction executes the function of decreasing the zoom magnification, or determine that the first operation instruction executes the function of decreasing the zoom magnification and the second operation instruction executes the function of increasing the zoom magnification.
[0264] In one implementation, if the user sequentially performs a first operation, a second sub-operation where the force is less than a first detection threshold, and a third operation, the electronic device 100 can increase the zoom magnification according to the first operation instruction and increase the zoom magnification according to the third operation instruction, or decrease the zoom magnification according to the first operation instruction and decrease the zoom magnification according to the third operation instruction.
[0265] In one implementation, if the user executes a first operation and a second sub-operation in sequence, the electronic device 100 can increase the zoom magnification according to the first operation instruction and decrease the zoom magnification according to the second operation instruction, or decrease the zoom magnification according to the first operation instruction and increase the zoom magnification according to the second operation instruction.
[0266] The specific zoom adjustment method in this embodiment can be found in the aforementioned audio applications. This embodiment will not elaborate further.
[0267] It should be noted that the sliding detection method provided in this application embodiment includes, but is not limited to, applications described above. For specific implementation methods in other applications, please refer to the various embodiments in this application. This application does not limit such implementations.
[0268] The sliding detection method illustrated in this application's embodiments can solve the problems of malfunctions in split volume buttons and their inability to adapt to more complex interaction needs. For various user operation methods in different scenarios, the method illustrated in this application's embodiments can match user operating habits, determine the user's actual operating intent, and identify whether the user's current operation is a desired operation or an unconscious habit, thus avoiding user errors and improving user experience. The above mainly describes the solution provided by the embodiments of this application from the perspective of electronic device 100. It is understood that, in order to achieve the above functions, electronic device 100 includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should readily recognize that, based on the sliding detection method steps described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by software-driven hardware by electronic device 100 depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0269] This application embodiment can divide the above-described electronic device 100 into functional modules or functional units according to the above method example. For example, each function can be divided into a separate functional module or functional unit, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or in software functional modules or functional units. The module or unit division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.
[0270] Figure 25 This is a schematic diagram of a sliding detection device provided in this application.
[0271] like Figure 25 As shown, the device includes:
[0272] The first acquisition module is used to acquire the first force of the first operation in response to the user's first operation on the button along the first direction.
[0273] The first execution module is used to determine whether to execute the first operation instruction corresponding to the first operation based on the first force.
[0274] The second acquisition module is used to acquire the second force of the second operation in response to the user's second operation on the button along a second direction when it is determined that the first operation instruction will be executed. The second direction is the opposite direction of the first direction.
[0275] The second execution module is used to determine whether to execute the second operation instruction corresponding to the second operation based on the second force. Other embodiments of this application provide a sliding detection device.
[0276] In one embodiment, the sliding detection device can implement corresponding functions based on hardware. The device may include a touchscreen, a memory, a processor, and a communication module. These components can be connected via one or more communication buses. The touchscreen may include a display panel and a touch sensor. The display panel displays images, and the touch sensor transmits detected touch operations to the application processor to determine the touch event type and provides visual output related to the touch operation through the display panel. The processor may include one or more processing units, such as an application processor, modem processor, graphics processor, image signal processor, controller, video codec, digital signal processor, baseband processor, and / or neural network processor. Different processing units may be independent devices or integrated into one or more processors. The memory is coupled to the processor and stores various software programs and / or computer instructions. The memory may include volatile memory and / or non-volatile memory. When the processor executes computer instructions, the sliding detection device can perform various functions or steps of the above method embodiments.
[0277] When the software program and / or multiple sets of instructions in the memory are executed by the processor, the slide detection device performs the following steps: in response to a user's first operation on the button along a first direction, it acquires a first force of the first operation; based on the first force, it determines whether to execute a first operation instruction corresponding to the first operation; if it is determined that the first operation instruction should be executed, in response to a user's second operation on the button along a second direction, it acquires a second force of the second operation, the second direction being the opposite direction of the first direction; based on the second force, it determines whether to execute a second operation instruction corresponding to the second operation.
[0278] This application also provides an electronic device, including: a processor, a memory, and a touch screen; the memory stores program instructions, which, when executed by the processor, cause the electronic device to perform the sliding detection method in any of the above embodiments.
[0279] This application also provides a chip system including at least one processor and at least one interface circuit. The processor and the interface circuit are interconnected via lines. For example, the interface circuit can be used to receive signals from other devices (e.g., the memory of an electronic device). As another example, the interface circuit can be used to send signals to other devices. Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can perform the steps in the above embodiments. Of course, the chip system may also include other discrete devices, and this application does not specifically limit this.
[0280] This application also provides a computer-readable storage medium including computer instructions that, when executed on the electronic device, cause the electronic device to perform various functions or steps performed in the above method embodiments.
[0281] This application also provides a computer program product that, when run on a computer, causes the computer to perform the various functions or steps performed in the above method embodiments.
[0282] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0283] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0284] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0285] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0286] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0287] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A slip detection method characterized by, The method comprises: in response to a first operation of a user on a key in a first direction, acquiring a first force of the first operation; determining whether to execute a first operation instruction corresponding to the first operation according to the first force; in a case where it is determined to execute the first operation instruction, in response to a second operation of the user on the key in a second direction, acquiring a second force of the second operation, the second direction being an opposite direction of the first direction; determining whether to execute a second operation instruction corresponding to the second operation according to the second force, wherein when the second operation is a second sub-operation, if a first pressing operation in the second sub-operation corresponds to the second force greater than or equal to a second detection threshold, and a first sliding operation in the second sub-operation corresponds to the second force greater than or equal to a first detection threshold, the second operation instruction is executed; the second sub-operation comprises the first pressing operation of the user after the first operation, and the first sliding operation of the user without leaving the key after the first pressing operation.
2. The slide detection method according to claim 1, characterized by, The determination whether to execute the first operation instruction corresponding to the first operation according to the first force comprises: if the first force is greater than or equal to the first detection threshold, the first operation instruction is executed; if the first force is less than the first detection threshold, the first operation instruction is not executed.
3. The slide detection method according to claim 1, characterized by, The determination whether to execute the second operation instruction corresponding to the second operation according to the second force comprises: when the second operation is a first sub-operation, if the second force is greater than or equal to the first detection threshold, the second operation instruction is executed; the first sub-operation comprises a sliding operation of the user without leaving the key and in the second direction after the first operation; if the second force is less than the first detection threshold, the second operation instruction is not executed.
4. The slide detection method according to claim 3, characterized by, After the determination whether to execute the second operation instruction corresponding to the second operation according to the second force, the method further comprises: in response to a third operation of the user on the key in the first direction, acquiring a third force of the third operation, the third operation being a sliding operation of the user without leaving the key after the first sub-operation; if the third force is greater than or equal to the first detection threshold, a third operation instruction corresponding to the third operation is executed.
5. The slide detection method according to claim 1, characterized by, After the execution of the second operation instruction, the method further comprises: in response to a fourth operation of the user on the key in the first direction, acquiring a fourth force of the fourth operation, the fourth operation being a sliding operation of the user without leaving the key after the second sub-operation; if the fourth force is greater than or equal to the first detection threshold, a fourth operation instruction corresponding to the fourth operation is executed.
6. The slip detection method according to any one of claims 1 to 5, characterized by, Before the acquisition of the first force of the first operation of the user on the key in the first direction, the method further comprises: determining whether at least one preset application program is in a foreground or background running state; If any of the preset applications is in the foreground or background running state, a function executed by a target operation instruction is determined based on a target application, the target application being the preset application currently in the foreground or background running state, and the target operation instruction including at least the first operation instruction and the second operation instruction.
7. The slide detection method according to claim 6, characterized by, The function executed by the target operation instruction is determined based on the target application, including: when the target application is an audio application or a video application, determining that the first operation instruction executes a function of increasing volume, and the second operation instruction executes a function of decreasing volume; or, determining that the first operation instruction executes a function of decreasing volume, and the second operation instruction executes a function of increasing volume.
8. The slide detection method according to claim 6, characterized by, The function executed by the target operation instruction is determined based on the target application, including: when the target application is a video application, determining that the first operation instruction executes a function of fast forwarding a video, and the second operation instruction executes a function of fast rewinding the video; or, determining that the first operation instruction executes a function of fast rewinding the video, and the second operation instruction executes a function of fast forwarding the video.
9. The slide detection method according to claim 6, characterized by, The function executed by the target operation instruction is determined based on the target application, including: when the target application is a browser application, determining that the first operation instruction executes a function of scrolling up a screen, and the second operation instruction executes a function of scrolling down the screen; or, determining that the first operation instruction executes a function of scrolling down the screen, and the second operation instruction executes a function of scrolling up the screen.
10. The slide detection method according to claim 6, characterized by, The function executed by the target operation instruction is determined based on the target application, including: when the target application is a camera application, determining that the first operation instruction executes a function of increasing a zoom factor, and the second operation instruction executes a function of decreasing the zoom factor; or, determining that the first operation instruction executes a function of decreasing the zoom factor, and the second operation instruction executes a function of increasing the zoom factor.
11. The slide detection method according to claim 1, characterized by, The key is a press touch volume key, and the structure of the volume key includes at least one of a cantilever beam structure, a built-in sensor structure, and an ultrasonic structure.
12. The slide detection method according to claim 1, characterized by, Before the first force of the first operation of the user in the first direction on the key is acquired, the method further includes: acquiring a touch duration of the user on the key, and if the touch duration is greater than or equal to a first touch threshold, controlling the key to enter an awake state; or, acquiring a number of taps of the user on the key, and if the number of taps is greater than or equal to a first number threshold, controlling the key to enter the awake state; or, acquiring a touch position of the user on the key, and if the touch position is a preset position, controlling the key to enter the awake state; or, listening to a preset application in a foreground or background running state, and controlling the key to enter the awake state.
13. A slip detection device, characterized by comprising: The device includes: The first obtaining module is configured to obtain a first force degree of a first operation of a user on a key in a first direction; The first execution module is configured to determine whether to execute a first operation instruction corresponding to the first operation according to the first force degree; The second obtaining module is configured to, in a case where it is determined to execute the first operation instruction, obtain a second force degree of a second operation of the user on the key in a second direction in response to the second operation, the second direction being an opposite direction of the first direction; The second execution module is configured to determine whether to execute a second operation instruction corresponding to the second operation according to the second force degree, and specifically configured to, in a case where the second operation is a second sub-operation, execute the second operation instruction if a first pressing operation in the second sub-operation corresponds to the second force degree greater than or equal to a second detection threshold and a first sliding operation in the second sub-operation corresponds to the second force degree greater than or equal to a first detection threshold; the second sub-operation includes the first pressing operation performed by the user after the first operation without the finger leaving the key, and the first sliding operation performed from a pressing position to the second direction without the finger leaving the key after the first pressing operation.
14. An electronic device, comprising: The electronic device comprises: a processor and a memory; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the method in any one of claims 1-12.
15. A chip system, characterized by The electronic device comprises: a memory and a processor; The memory stores program instructions, and when the program instructions are executed by the processor, the chip system executes the method in any one of claims 1-12.
16. A computer storage medium, comprising, The computer-readable storage medium stores program instructions, and when the program instructions are run on the computer, the computer executes the method in any one of claims 1-12.
Citation Information
Patent Citations
Control method of mobile terminal and mobile terminal
CN107577446A