Interaction method and electronic device

By introducing virtual buttons in electronic devices to detect users' pressing operations and related parameters, the problem of single -interacting methods of virtual keys in existing technologies has been solved, and higher operating efficiency and user experience are achieved.

WO2025020809A1PCT designated stage expired Publication Date: 2025-01-30HUAWEI TECH CO LTD

Patent Information

Application Number
PCT/CN2024/101244
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-07-21
Filing Date
2024-06-25
Publication Date
2025-01-30

AI Technical Summary

Technical Problem

The virtual key interaction mode in existing electronic devices is single and the application scenarios are single, so the role of virtual keys is not fully utilized.

Method used

By introducing virtual buttons in electronic devices to detect users' pressing operations, pressing pressure, and pressing duration, perform corresponding functions according to different interfaces and user operations to improve operating efficiency and interaction.

Benefits of technology

Realize the efficiency and interaction of higher user operations, improve the user experience, and expand the application scenarios of virtual keys.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024101244_30012025_PF_FP_ABST
    Figure CN2024101244_30012025_PF_FP_ABST
Patent Text Reader

Abstract

The present application provides an interaction method and an electronic device. The method is applied to an electronic device, the electronic device comprises a virtual key, the virtual key is used for detecting a pressing operation of a user, the electronic device displays a first interface, and the method comprises: when detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing duration; determining a first function on the basis of the first interface, the first pressing force and the first pressing duration; and in response to the first pressing operation, executing the first function. The electronic device in the present application has a virtual key and, on the basis of the displayed interface, the force of pressing the virtual key by the user and the duration of pressing the virtual key, can execute a corresponding function, improving the operation efficiency of the user, enhancing the interactivity, and helping to improve the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Interactive method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on July 21, 2023, with application number 202310904535.0 and application name “A method of interaction and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of electronic devices, and more specifically, to an interaction method and an electronic device. Background Art

[0003] With the continuous advancement of technology, users have higher and higher requirements for electronic devices. In order to obtain a thinner and lighter body and better sealing, electronic devices tend to reduce internal structural parts and develop in the direction of an integrated body. For example, the 3.5mm headphone jack originally configured on electronic devices can be replaced by Bluetooth headphones, or share the interface with the charging port. At present, some electronic devices use virtual buttons instead of physical buttons (also called physical buttons), which improves the degree of body integration. However, the current interaction method of virtual buttons is single, the application scenario is single, and the role of virtual buttons is not fully utilized.

[0004] Summary of the Invention

[0005] The present application provides an interactive method and an electronic device, wherein the electronic device has virtual buttons, which can execute corresponding functions according to the displayed interface, the force with which the user presses the virtual buttons, and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to enhance the user experience.

[0006] In a first aspect, an interaction method is provided, which is applied to an electronic device, wherein the electronic device includes a virtual key, which is used to detect a user's pressing operation, and the electronic device displays a first interface. The method includes: detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing duration; determining a first function based on the first interface, the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0007] In an embodiment of the present application, the electronic device has virtual buttons and can execute corresponding functions based on the displayed interface, the force with which the user presses the virtual buttons, and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to enhance the user experience.

[0008] In combination with the first aspect, in certain implementations of the first aspect, the first interface is a main screen interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a system volume adjustment function.

[0009] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time with which the user presses a virtual key, allowing the user to operate conveniently.

[0010] In combination with the first aspect, in certain implementations of the first aspect, the virtual button is also used to detect the user's sliding gesture, and the method also includes: in response to the user's first sliding gesture on the virtual button, switching from the first function to the second function, wherein the direction of the first sliding gesture is the thickness direction of the electronic device, and the second function is one of the brightness adjustment function, the microphone volume adjustment function, the speaker volume adjustment function, the message prompt tone volume adjustment function, the screen display mode adjustment function, and the incoming call ring volume adjustment function.

[0011] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time the user presses the virtual button, allowing the user to operate conveniently, and the gesture for switching the parameter bar is simple, in line with daily usage habits, and can enhance the user experience.

[0012] In combination with the first aspect, in certain implementations of the first aspect, the virtual key is also used to detect the user's sliding gesture, and the method also includes: adjusting the system volume in response to a second sliding gesture of the user on the virtual key, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0013] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time the user presses the virtual button, allowing the user to operate conveniently, and the gesture for switching the parameter bar is simple, in line with daily usage habits, and can enhance the user experience.

[0014] In combination with the first aspect, in certain implementations of the first aspect, the first interface is the main screen interface, and when the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

[0015] In an embodiment of the present application, the electronic device can activate the voice assistant based on the strength and time of the user pressing the virtual button, so that the user can operate conveniently and improve the user experience.

[0016] In combination with the first aspect, in some implementations of the first aspect, the first interface is a photo taking interface, and when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0017] In combination with the first aspect, in some implementations of the first aspect, the method also includes: detecting a second press operation of the user on the virtual key, determining a second press strength and a second press duration; when the second press strength is less than the first threshold and the second press duration is greater than or equal to the second threshold, in response to the second press operation, displaying a focus frame, which is used to identify the first object.

[0018] In combination with the first aspect, in certain implementations of the first aspect, the virtual key is also used to detect the user's sliding gesture, and the method also includes: in response to the user's second sliding gesture on the virtual key, switching the first object in the focus frame to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0019] In combination with the first aspect, in some implementations of the first aspect, the method further includes: in response to the user's continuous pressing operation on the virtual key, locking the focus frame and the first object, wherein the pressing force of the continuous pressing operation is less than the first threshold.

[0020] In combination with the first aspect, in certain implementations of the first aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0021] In combination with the first aspect, in certain implementations of the first aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

[0022] In combination with the first aspect, in some implementations of the first aspect, when the first pressing force is less than the first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0023] In combination with the first aspect, in certain implementations of the first aspect, the virtual button is also used to detect the user's sliding gesture, and the method also includes: in response to the user's operation of adjusting the parameter, displaying an adjustment bar for the first parameter; in response to the user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, switching the adjustment bar for the first parameter to the adjustment bar for the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, adjusting the first parameter.

[0024] In an embodiment of the present application, when the electronic device is running a camera application, it can adjust the shooting parameters and switch the parameter adjustment bar according to the sliding direction of the user on the virtual button, so that the user can operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, in line with daily usage habits, and can enhance the user experience.

[0025] In combination with the first aspect, in certain implementations of the first aspect, the method also includes: detecting that at least two of the four edge areas of the screen are touched, and also detecting the user's third press operation on the virtual key, determining the third press strength and third press duration of the third press operation; when the third press strength is greater than or equal to the first threshold and less than or equal to the third threshold, starting the camera and performing autofocus; when the third press strength is first greater than the third threshold and then less than the first threshold, starting the camera and taking a picture; when the third press strength is greater than the third threshold and the third press duration is greater than the second threshold, starting the camera and recording a video.

[0026] In the implementation of this application, the electronic device can respond to the user's operation on the virtual button when displaying the interface of a non-camera application, enter the camera application, and execute the corresponding function according to the pressing force and pressing duration of the virtual button, so that it can quickly perform functions such as taking pictures and recording videos, which helps to improve the user experience.

[0027] In a second aspect, an interaction method is provided, which is applied to an electronic device, wherein the electronic device includes a virtual key, which is used to detect a user's pressing operation. The electronic device displays a first interface, which is a photo-taking interface. The method includes: detecting a first pressing operation of the user on the virtual key, determining a first pressing force and a first pressing duration; determining a first function based on the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0028] In combination with the second aspect, in certain implementations of the second aspect, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0029] In combination with the second aspect, in some implementations of the second aspect, the method also includes: detecting a second pressing operation of the user on the virtual key, determining a second pressing force and a second pressing duration; when the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, displaying a focus frame in response to the second pressing operation, and the focus frame is used to identify the first object.

[0030] In combination with the second aspect, in certain implementations of the second aspect, the virtual key is also used to detect the user's sliding gesture, and the method also includes: in response to the user's second sliding gesture on the virtual key, switching the first object in the focus frame to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0031] In combination with the second aspect, in certain implementations of the second aspect, the method further includes: in response to the user's continuous pressing operation on the virtual key, locking the focus frame and the first object, wherein the pressing force of the continuous pressing operation is less than the first threshold.

[0032] In combination with the second aspect, in some implementations of the second aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0033] In combination with the second aspect, in certain implementations of the second aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

[0034] In combination with the second aspect, in some implementations of the second aspect, when the first pressing force is less than the first threshold and the first pressing duration is greater than the second threshold, the first function is to display a viewfinder.

[0035] In combination with the second aspect, in certain implementations of the second aspect, the virtual button is also used to detect the user's sliding gesture, and the method also includes: in response to the user's operation of adjusting the parameter, displaying an adjustment bar for the first parameter; in response to the user's sliding gesture on the virtual button, if the direction of the sliding gesture is the thickness direction of the electronic device, switching the adjustment bar for the first parameter to the adjustment bar for the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, adjusting the first parameter.

[0036] In a third aspect, an interaction method is provided, which is applied to an electronic device, which includes a virtual key, which is used to detect a user's pressing operation. The electronic device displays a first interface, which is an interface of a non-camera application. The method includes: detecting that at least two edge areas of the four edge areas of the screen are touched, and also detecting the user's first pressing operation on the virtual key, determining a first pressing force and a first pressing duration; starting a camera application, and determining a first function based on the first pressing force and the first pressing duration; and executing the first function in response to the first pressing operation.

[0037] In combination with the third aspect, in certain implementations of the third aspect, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0038] In combination with the third aspect, in certain implementations of the third aspect, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0039] In combination with the third aspect, in certain implementations of the third aspect, when the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

[0040] In a fourth aspect, a computer-readable storage medium is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0041] In a fifth aspect, a computer program product is provided, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the first aspect and any possible implementation method of the first aspect are executed.

[0042] In a sixth aspect, a computer program is provided, which, when executed on a computer, enables the method in the first aspect and any possible implementation thereof to be executed.

[0043] The seventh aspect is an electronic device according to an embodiment of the present application, which includes modules / units for executing the above aspects or any possible design method of the above aspects; these modules / units can be implemented through hardware, or corresponding software can be implemented through hardware.

[0044] The eighth aspect is a chip according to an embodiment of the present application, which is coupled to a memory in an electronic device and is used to call a computer program stored in the memory and execute the technical solutions of the above aspects of the embodiment of the present application and any possible design of the above aspects; "coupling" in the embodiment of the present application refers to the direct or indirect combination of two components with each other.

[0045] The ninth aspect is a graphical user interface on an electronic device of an embodiment of the present application, wherein the electronic device has a display screen, one or more memories, and one or more processors, wherein the one or more processors are used to execute one or more computer programs stored in the one or more memories, and the graphical user interface includes a graphical user interface displayed when the electronic device executes the above aspect and any possible design technical solution of the above aspect.

[0046] The tenth aspect is an electronic device of an embodiment of the present application, which includes one or more processors; one or more memories; the one or more memories store one or more computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the above aspects or any possible implementation of the above aspects are executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] FIG1 is a schematic diagram of the configuration of virtual keys provided in an embodiment of the present application.

[0048] FIG2 is a schematic diagram of another form of setting virtual keys provided in an embodiment of the present application.

[0049] FIG3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0050] FIG4 is a block diagram of the software structure of the electronic device according to an embodiment of the present application.

[0051] FIG5 is a set of GUIs provided in an embodiment of the present application.

[0052] FIG6 is another set of GUIs provided in an embodiment of the present application.

[0053] FIG7 is another set of GUIs provided in an embodiment of the present application.

[0054] FIG8 is another set of GUIs provided in an embodiment of the present application.

[0055] FIG9 is another set of GUIs provided in an embodiment of the present application.

[0056] FIG10 is another set of GUIs provided in an embodiment of the present application.

[0057] FIG11 is another set of GUIs provided by an embodiment of the present application.

[0058] FIG12 is a schematic flowchart of the interaction method provided in an embodiment of the present application.

[0059] FIG13 is a schematic flowchart of the interaction method provided in an embodiment of the present application.

[0060] FIG14 is a schematic flowchart of the interaction method provided in an embodiment of the present application.

[0061] FIG15 is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0063] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of this application and the appended claims, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship.

[0064] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0065] The following describes an electronic device, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication functions (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer.

[0066] The electronic device is provided with virtual buttons, which specifically means that the electronic device is provided with a touch sensor and a pressure sensor. For example, the touch sensor and the pressure sensor can be set at the position where the physical button needs to be set on the electronic device. The electronic device can use the touch effect of the touch sensor and the piezoelectric effect of the pressure sensor to detect the pressing operation input by the user, thereby realizing the related functions of physical buttons such as locking the screen and adjusting the volume. In this way, the physical buttons set on the surface of the electronic device can be reduced, making the appearance of the electronic device more beautiful. In other embodiments, such buttons can also be referred to as touch buttons and other names, and the embodiments of the present application are not limited to this.

[0067] For example, if the electronic device is a mobile phone, the virtual buttons can be set on the side frame (such as the left frame or the right frame) of the mobile phone. Among them, one or more touch sensors and one or more pressure sensors can be set on the side frame of the mobile phone.

[0068] For example, take the example of a virtual key being set on the right side frame of the mobile phone 10 shown in (a) of Figure 1 . Figure 1 (b) shows the distribution of touch sensors and pressure sensors used to implement the virtual key. As shown in Figure 1 (b), a touch sensor and a pressure sensor 110 are set in a preset area 101 of the right side frame of the mobile phone 10, and a touch sensor and a pressure sensor 120 are set in a preset area 102. The pressure sensor 110 is set in a lower layer of the touch sensor in the preset area 101, and the pressure sensor 120 is set in a lower layer of the touch sensor in the preset area 102.

[0069] In some embodiments, the touch sensor provided in the preset area 101 and the preset area 102 can be the same touch sensor. That is, the right side frame of the mobile phone 10 can be provided with a touch sensor (referred to as touch sensor 1), and the touch sensor 1 is provided in the preset area 101 and the preset area 102 of the right side frame. Of course, the touch sensor 1 can also be provided on the entire right side frame of the mobile phone 10, and this embodiment of the application is not limited to this.

[0070] In some embodiments, the touch sensor and the pressure sensor can be integrated into one sensor. The sensor can be set in the preset area 101 and the preset area 102 of the right side frame. Of course, the sensor can also be set in the entire right side frame of the mobile phone 10, and this embodiment of the application is not limited to this.

[0071] In some embodiments, if mobile phone 10 is a curved screen mobile phone, the touch sensors corresponding to the virtual keys may be integrated with the touch sensors in the touch screen of mobile phone 10, i.e., the touch sensors of the virtual keys are touch sensors in the touch screen of mobile phone 10. If the touch screen of mobile phone 10 is a flat screen mobile phone, the touch sensors of the virtual keys are independent of the touch sensors in the touch screen of mobile phone 10, i.e., the touch sensors of the virtual keys are different from the touch sensors in the touch screen of mobile phone 10.

[0072] In other embodiments, the touch sensors provided in the preset area 101 and the preset area 102 may be at least two touch sensors. For example, if the mobile phone 10 is a flat-screen mobile phone, the preset area 101 and the preset area 102 on the right side frame of the mobile phone 10 may each be provided with a touch sensor.

[0073] For another example, consider the example of a touch-sensitive key being provided on the right side frame of a mobile phone 20 as shown in FIG2(a). FIG2(b) illustrates the distribution of the touch sensors and pressure sensors used to implement the touch-sensitive key. As shown in FIG2(b), a touch sensor is provided in a preset area 201 of the right side frame of the mobile phone 20, a touch sensor is provided in a preset area 202, and a pressure sensor 210 is provided at the junction of the preset areas 201 and 202. The pressure sensor 210 is provided below the touch sensors in the preset areas 201 and 202.

[0074] Exemplarily, the position of the pressure sensor 210 on the right side frame of the mobile phone 20 can be set with reference to the position of physical buttons (such as the "volume +" key and the "volume -" key) on the side frame of the mobile phone. For example, the pressure sensor 210 can be set in the middle of the position of the "volume +" key on the side frame of the mobile phone and the position of the "volume -" key on the side frame of the mobile phone. The preset area 201 is on the right side frame of the mobile phone 20, above the position of the pressure sensor 210. The preset area 202 is on the right side frame of the mobile phone 20, below the position of the pressure sensor 210. Among them, the sizes of the preset area 201 and the preset area 202 are pre-configured in the mobile phone 20.

[0075] In some embodiments, the touch sensor provided on the preset area 201 and the touch sensor provided on the preset area 202 may be the same touch sensor.

[0076] In other embodiments, the touch sensors provided on the preset area 201 and the preset area 202 may be at least two touch sensors.

[0077] For example, the pressure sensors in the embodiments of the present application (such as pressure sensor 110, pressure sensor 120, and pressure sensor 210) may be piezoelectric pressure sensors. For example, the piezoelectric pressure sensors may be piezoelectric ceramic sensors. Compared to other pressure sensors, piezoelectric ceramic sensors have higher sensitivity.

[0078] Of course, touch buttons can be set on both side frames of the mobile phone (such as the left frame and the right frame). That is, one or more pressure sensors and one or more touch sensors (not shown in the drawings) can be set on the left frame and the right frame of the mobile phone to realize the function of the touch button.

[0079] The above describes the structure of the electronic device for implementing the corresponding virtual keys. The following describes the internal structure of the electronic device.

[0080] 3 shows a schematic structural diagram of an electronic device 300. The electronic device 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, a button 390, a motor 391, an indicator 392, a camera 393, a display 394, and a subscriber identification module (SIM) card interface 395. The sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, an air pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.

[0081] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0082] The processor 310 may include one or more processing units. For example, the processor 310 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0083] The controller may be the nerve center and command center of the electronic device 300. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0084] Processor 310 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 310 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 310. If processor 310 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 310 latency, and thus improves system efficiency.

[0085] In some embodiments, the processor 310 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0086] The wireless communication function of the electronic device 300 can be implemented through the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor and the baseband processor.

[0087] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0088] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 300. The mobile communication module 350 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves from the antenna 3, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 3. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 can be set in the same device as at least some of the modules of the processor 310.

[0089] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 370A, the receiver 370B, etc.) or displays an image or video through the display screen 394. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 310 and be provided in the same device as the mobile communication module 350 or other functional modules.

[0090] The wireless communication module 360 ​​can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 300. The wireless communication module 360 ​​can be one or more devices that integrate at least one communication processing module. The wireless communication module 360 ​​receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310. The wireless communication module 360 ​​can also receive the signal to be sent from the processor 310, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0091] In some embodiments, the antenna 3 of the electronic device 300 is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the electronic device 300 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-CDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0092] Electronic device 300 implements display functionality through a GPU, display screen 394, and an application processor. A GPU is a microprocessor for image processing that connects display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs that execute program instructions to generate or modify display information.

[0093] Display screen 394 is used to display images, videos, and the like. Display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 300 may include one or N display screens 394, where N is a positive integer greater than one.

[0094] The electronic device 300 can realize the shooting function through the ISP, camera 393, video codec, GPU, display screen 394 and application processor.

[0095] The ISP processes data fed back by camera 393. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 393.

[0096] The camera 393 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 300 may include 1 or N cameras 393, where N is a positive integer greater than 1.

[0097] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 300 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0098] Video codecs are used to compress or decompress digital video. Electronic device 300 may support one or more video codecs. This allows electronic device 300 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0099] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in electronic device 300, such as image recognition, face recognition, speech recognition, and text comprehension.

[0100] The external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 300. The external memory card communicates with the processor 310 via the external memory interface 320 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0101] The internal memory 321 can be used to store computer executable program codes, which include instructions. The processor 310 executes various functional applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 321. The internal memory 321 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 300 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0102] The electronic device 300 can implement audio functions such as music playback and recording through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the headphone jack 370D, and the application processor.

[0103] The audio module 370 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 370 can also be used to encode and decode audio signals. In some embodiments, the audio module 370 can be provided in the processor 310, or some functional modules of the audio module 370 can be provided in the processor 310.

[0104] The speaker 370A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 300 can listen to music or listen to hands-free calls through the speaker 170A.

[0105] The receiver 370B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 300 receives a call or a voice message, the user can place the receiver 370B close to the ear to hear the voice.

[0106] Microphone 370C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 370C to input the sound signal into the microphone 370C. The electronic device 300 can be provided with at least one microphone 370C. In other embodiments, the electronic device 300 can be provided with two microphones 370C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 300 can also be provided with three, four or more microphones 370C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0107] The pressure sensor 380A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 380A can be set on the display screen 394. There are many types of pressure sensors 380A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates made of conductive material. When a force acts on the pressure sensor 380A, the capacitance between the electrodes changes. The electronic device 300 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 394, the electronic device 300 detects the intensity of the touch operation based on the pressure sensor 380A. The electronic device 300 can also calculate the position of the touch based on the detection signal of the pressure sensor 380A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the alarm application icon, the instruction to create a new alarm is executed.

[0108] Fingerprint sensor 380H is used to collect fingerprints. Electronic device 300 can use the collected fingerprints to unlock the device, access app locks, take photos, answer calls, and more. For example, when the phone detects a touch on the lock screen, the phone can use fingerprint sensor 380H to collect the user's fingerprint information and match it with the fingerprint information pre-set in the phone. If the match is successful, the phone can then enter the unlocked screen from the lock screen.

[0109] The touch sensor 380K is also called a "touch panel." The touch sensor 380K can be disposed on the display screen 394. The touch sensor 380K and the display screen 394 form a touch screen, also called a "touch screen." The touch sensor 380K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 394. In other embodiments, the touch sensor 380K can also be disposed on the surface of the electronic device 300, at a location different from that of the display screen 394.

[0110] Figure 4 is a software structure diagram of the electronic device 300 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer, from top to bottom. The application layer may include a series of application packages.

[0111] As shown in Figure 4, the application layer may include camera, settings, and third-party applications, etc. Among them, the third-party applications may include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0112] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer may include some predefined functions.

[0113] As shown in FIG4 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0114] The window manager manages windowed applications. It can determine the display size, determine whether a status bar is present, lock the screen, and take screenshots. Content providers store and retrieve data and make it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and phone books.

[0115] The view system includes visual controls, such as controls for displaying text and images, such as the instructions for prompting a virtual shutter button in the embodiments of this application. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0116] The phone manager is used to provide communication functions of the electronic device 300, such as management of call status (including answering, hanging up, etc.).

[0117] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0118] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0119] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0120] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0121] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0122] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (such as OpenGL ES), and a 2D graphics engine (such as SGL).

[0123] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0124] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0125] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0126] A 2D graphics engine is a drawing engine for 2D drawings.

[0127] In addition, the system library can also include status monitoring service modules, such as a physical status recognition module for analyzing and identifying user gestures; a sensor service module for monitoring sensor data uploaded by various sensors at the hardware layer to determine the physical status of the electronic device 100.

[0128] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0129] The hardware layer may include various sensors, such as the various sensors introduced in Figures 1 to 3, the acceleration sensor, gyroscope sensor, touch sensor, etc. involved in the embodiments of the present application.

[0130] With the continuous advancement of technology, users have higher and higher requirements for electronic devices. In order to obtain a thinner and lighter body and better sealing, electronic devices tend to reduce internal structural parts and develop in the direction of an integrated body. For example, the 3.5mm headphone jack originally configured on electronic devices can be replaced by Bluetooth headphones, or share the interface with the charging port. At present, some electronic devices use virtual buttons instead of physical buttons (also called physical buttons), which improves the degree of body integration. However, the current interaction method of virtual buttons is single, the application scenario is single, and the role of virtual buttons is not fully utilized.

[0131] Before introducing the embodiments of the present application, several possible application scenarios associated with virtual keys involved in the embodiments of the present application are first introduced.

[0132] 1. Adjust system parameters on the main screen.

[0133] When displaying the main screen interface, the electronic device can respond to the user's operation on the virtual button and adjust the system parameters.

[0134] For example, the system parameters may include volume and brightness.

[0135] Exemplarily, the main screen interface may be a desktop, a negative one screen, or the like.

[0136] 2. Adjust system parameters through the application interface.

[0137] When displaying some application interfaces, the electronic device can adjust system parameters in response to user operations on virtual keys.

[0138] For example, when the electronic device displays the interface of a music application, it detects the user's operation on a virtual key and can adjust the volume in response to the operation.

[0139] For another example, when the electronic device displays the interface of a call application, if it detects a user operation on a virtual key, it can adjust the volume in response to the operation.

[0140] 3. Adjust application parameters in the application interface.

[0141] When displaying the interface of some application programs, the electronic device can adjust the application parameters corresponding to the application programs in response to the user's operation on the virtual keys. The application parameters can be understood as the parameters corresponding to the application programs when performing a certain function.

[0142] For example, taking a camera application as an example, the camera application parameters may include focal length, sensitivity (ISO), and the like.

[0143] 4. Launch the application.

[0144] The electronic device can start application #1 in response to the user's operation on the virtual key. In this application scenario, before starting application #1, the electronic device can be in a locked state, or can be in a state where application #2 is running in the foreground, or can be in a state where the main screen interface is displayed.

[0145] For example, when the electronic device is in a locked state, a user operation on a virtual key is detected, and in response to the operation, a camera application can be started.

[0146] For another example, when the electronic device displays the desktop, it detects a user's operation on a virtual key and, in response to the operation, may start a camera application.

[0147] For another example, when the electronic device displays the interface of the gallery application, it detects the user's operation on the virtual key and can start the camera application in response to the operation.

[0148] The above describes several possible scenarios involved in the embodiments of the present application. The following describes the interaction method provided in the embodiments of the present application in conjunction with a graphical user interface (GUI).

[0149] FIG5 shows a set of GUIs provided by an embodiment of the present application.

[0150] As shown in FIG5(a), the electronic device displays interface 501, which is a desktop. While displaying interface 501, the electronic device detects a user pressing a virtual key and can determine the user's pressing force and duration. If it is determined that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, the electronic device displays the GUI shown in FIG5(b).

[0151] It should be noted that the virtual keys in the figure protrude relative to the frame of the electronic device only to facilitate identification of the virtual keys. In actual electronic devices, the sensing area of ​​the virtual keys is part of the frame and does not protrude from the frame.

[0152] It should be noted that, in the embodiment of the present application, only the interface 501 is the desktop as an example, and should not be understood as a specific limitation of the embodiment of the present application. For example, the interface 501 can also be a negative one screen interface, a settings interface, a lock screen interface, etc.

[0153] In the embodiment of the present application, the desktop, the negative one screen interface, and the lock screen interface can be collectively referred to as the main screen interface.

[0154] As shown in (b) of Figure 5 , when the electronic device determines that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, the system volume adjustment bar 502 is displayed in response to the user pressing the virtual key. Since the virtual key can detect the user's sliding gesture, the electronic device can perform different functions according to the direction of the user's sliding gesture. When the electronic device detects that the direction of the user's sliding gesture is the thickness direction of the electronic device, the system volume adjustment bar can be switched to an adjustment bar for other parameters, see (c) of Figure 5 . When the electronic device detects that the direction of the user's sliding gesture is the length direction of the electronic device, the parameter can be adjusted, see (d) of Figure 5 .

[0155] It should be noted that the embodiment of the present application only takes the case where the electronic device displays a system volume adjustment bar when the pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold as an example, but this should not be understood as a limitation on the embodiment of the present application. In other embodiments of the present application, when the pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold, the electronic device may also display adjustment bars for other parameters, such as a speaker volume adjustment bar, a message prompt tone volume adjustment bar, etc.

[0156] As shown in (c) of FIG. 5 , when the electronic device determines that the sliding direction of the user is in the thickness direction of the electronic device, the system volume adjustment bar 502 may be switched to a brightness adjustment bar 503 .

[0157] It is understandable that when the user continues to slide in the direction of the thickness of the electronic device, the electronic device can also switch the brightness adjustment bar 503 to adjustment bars of other parameters, such as a speaker volume adjustment bar, a message prompt tone volume adjustment bar, etc.

[0158] It can also be understood that after the electronic device switches the system volume adjustment bar 502 to the brightness adjustment bar 503 , and then detects a user sliding gesture in the opposite direction, the brightness adjustment bar 503 can be switched back to the system volume adjustment bar 502 .

[0159] It should be noted that the embodiment of the present application only takes the example of the electronic device determining that the user's sliding direction is the direction of its thickness and that the system volume adjustment bar 502 can be switched to the brightness adjustment bar 503, but this should not be understood as a limitation on the embodiment of the present application. In other embodiments of the present application, when the electronic device determines that the user's sliding direction is the direction of its thickness, the electronic device can switch the system volume adjustment bar 502 to the message prompt tone volume adjustment bar.

[0160] As shown in (d) of Figure 5 , when the electronic device determines that the user's swipe direction is the longitudinal direction of the electronic device, it can adjust the system volume. For example, if the user swipes upward, the electronic device can increase the system volume; if the user swipes downward, the electronic device can decrease the system volume.

[0161] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time the user presses the virtual button, allowing the user to operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, in line with daily usage habits, and can enhance the user experience.

[0162] FIG6 shows another set of GUIs provided by an embodiment of the present application.

[0163] As shown in FIG6(a), the electronic device displays interface 601, which is the interface of a music application. While displaying interface 601, the electronic device detects a user pressing a virtual key and can determine the user's pressing force and duration. When it is determined that the user's pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold, the electronic device displays the GUI shown in FIG6(b).

[0164] As shown in (b) in Figure 6, when the electronic device determines that the user's pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold, in response to the user pressing the virtual key, unlike (b) in Figure 5, since the electronic device displays the interface of the music application, the electronic device can display the volume adjustment bar 602 of the music application at this time.

[0165] It should be understood that if the interface 601 is an interface of a video application, the electronic device may display a volume adjustment bar of the video application.

[0166] It should also be understood that the electronic device can also switch the volume adjustment bar 602 of the music application or adjust the volume of the music application in response to the user's sliding gesture. For specific descriptions, please refer to the description of Figure 5. For the sake of brevity, it will not be repeated here.

[0167] By comparing FIG5 and FIG6 , it can be seen that when the electronic device displays the parameter adjustment bar, it can display different parameter adjustment bars according to different interfaces.

[0168] In an embodiment of the present application, the electronic device can display a parameter adjustment bar based on the strength and time the user presses the virtual button, allowing the user to operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, in line with daily usage habits, and can enhance the user experience.

[0169] FIG7 shows another set of GUIs provided by an embodiment of the present application.

[0170] As shown in FIG7(a), the electronic device displays an interface 701, which is a desktop. While displaying interface 701, the electronic device detects a user pressing a virtual key and can determine the user's pressing force and duration. When it is determined that the user's pressing force is greater than or equal to a second threshold and the pressing duration is greater than or equal to the second threshold, the electronic device displays a GUI as shown in FIG7(b).

[0171] As shown in (b) of Figure 7, when the electronic device determines that the user's pressing force is greater than or equal to the first threshold and the pressing duration is greater than or equal to the second threshold, in response to the user pressing the virtual key, the voice assistant is started and the voice assistant bar 702 is displayed.

[0172] It should be noted that, in other embodiments, the interface 701 may also be a negative one screen or a lock screen interface.

[0173] During the process of starting the voice assistant, since the electronic device can detect the user's pressing force and pressing time, it can gradually display the voice assistant's awakening animation effect according to the gradual increase in the user's pressing force and / or the increase in the pressing time, which can enhance the user experience.

[0174] In an embodiment of the present application, the electronic device can activate the voice assistant based on the strength and time of the user pressing the virtual button, so that the user can operate conveniently and improve the user experience.

[0175] FIG8 shows another set of GUIs provided by an embodiment of the present application.

[0176] As shown in FIG8(a), the electronic device displays interface 801, which is the lock screen interface. When displaying interface 801, the electronic device detects that at least two of the four edge areas of the screen are touched and also simultaneously detects a user pressing a virtual key, determines the pressing force and duration, and executes different functions based on the user's pressing force and duration.

[0177] As shown in (b) in Figure 8, when the electronic device determines that the pressing force is equal to or greater than the first threshold and less than or equal to the third threshold, it can start the camera application and execute the autofocus function, that is, it can jump from interface 801 to interface 802 and then perform autofocus.

[0178] It should be understood that when an electronic device performs the autofocus function, it may display a focus frame or not, or it may first display a focus frame to mark the focused object and then no longer display the focus frame. This embodiment of the present application does not limit this.

[0179] As shown in (c) of FIG8 , when the electronic device determines that the pressing force is first greater than the third threshold and then less than the first threshold, it can start the camera application and execute the photo taking function, that is, it can jump from interface 801 to interface 802 and then take a photo.

[0180] As shown in (d) in Figure 8, when the electronic device determines that the pressing force is greater than the third threshold and the pressing duration is greater than or equal to the second threshold, it can start the camera application and execute the recording function, that is, it can jump from interface 801 to interface 803 and then record the video.

[0181] It should be noted that FIG8 only uses the example of an electronic device accessing the camera application from the lock screen interface, but this should not be understood as a specific limitation on the embodiments of the present application. In other embodiments of the present application, the electronic device may also access the camera application and perform corresponding functions in response to user operations while displaying other interfaces. For example, the interface displayed by the electronic device may also be the negative screen, the desktop, an application interface, etc.

[0182] In the implementation of this application, the electronic device can respond to the user's operation on the virtual button when displaying the interface of a non-camera application, enter the camera application, and execute the corresponding function according to the pressing force and pressing duration of the virtual button, so that it can quickly perform functions such as taking pictures and recording videos, which helps to improve the user experience.

[0183] FIG9 shows another set of GUIs provided by an embodiment of the present application.

[0184] As shown in FIG9(a), the electronic device displays interface 901, which is a camera interface. When displaying interface 901, the electronic device detects a user pressing a virtual key, determines the user's pressing force and duration, and can execute different functions based on the user's pressing force and duration.

[0185] As shown in (b) of FIG9 , when the electronic device determines that the pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, the electronic device may perform the auto focus function.

[0186] It should be understood that when an electronic device performs the autofocus function, it may display a focus frame or not, or it may first display a focus frame to mark the focused object and then no longer display the focus frame. This embodiment of the present application does not limit this.

[0187] Optionally, in some embodiments, when the electronic device does not display a focus frame when executing an autofocus function, the electronic device may display a focus frame in response to a user operation of activating the focus frame.

[0188] Exemplarily, the user's operation of activating the focus frame may be pressing a virtual key, where the pressing force is less than a first threshold and the pressing duration is greater than or equal to a second threshold.

[0189] As shown in (c) of FIG9 , when the electronic device determines that the pressing force is first greater than the second threshold and then less than the third threshold, the electronic device may execute the photo-taking function.

[0190] As shown in (d) of FIG9 , when the electronic device determines that the pressing force is greater than the third threshold and the pressing duration is greater than the second threshold, it switches to interface 902 , which is a video recording interface.

[0191] When the electronic device switches to the recording interface 902 , the electronic device may directly record the video, or may also record the video in response to a user's recording operation.

[0192] Exemplarily, the user's recording operation may be the user clicking on the control 903 .

[0193] As shown in (e) of FIG9 , when the electronic device determines that the pressing force is less than the first threshold and the pressing duration is greater than or equal to the second threshold, the viewfinder may be displayed.

[0194] It can be understood that when the electronic device enters the autofocus function, if the user's pressing force is less than the first threshold and the pressing time is greater than or equal to the second threshold, the electronic device can display the focus frame. When the electronic device does not enter the autofocus function but only displays the photo taking interface, if the pressing force is less than the first threshold and the pressing time is greater than or equal to the second threshold, the electronic device can display the viewfinder frame.

[0195] In the implementation of this application, when the electronic device runs a camera application, it can execute corresponding functions according to the pressure and pressing duration of the virtual button by the user, so that functions such as taking pictures and recording videos can be executed quickly, which helps to improve the user experience.

[0196] FIG10 shows another set of GUIs provided by an embodiment of the present application.

[0197] As shown in FIG10(a), the electronic device displays an interface 1001, which is an autofocus interface. The electronic device can identify the focus object in this interface 1001. Because the virtual button can detect the user's sliding gesture, when the electronic device detects that the direction of the user's sliding gesture is the length direction of the electronic device, the focus object can be switched, as shown in FIG10(b). The electronic device can also lock the focus object in response to the user's operation to lock the focus object.

[0198] As shown in (b) of FIG10 , in response to a user sliding on a virtual key, when the sliding direction is the length direction of the electronic device, the electronic device may switch the focus object from the elephant to the tree.

[0199] Optionally, in some embodiments, the user's operation of switching the focus object may also be the user sliding on a virtual key, and the sliding direction is the thickness direction of the electronic device.

[0200] When the electronic device is automatically focusing, in addition to switching the focus object, it can also lock the focus object in response to a user's operation of locking the focus object.

[0201] Exemplarily, the user's operation of locking the focus object may be to continuously press a virtual key with a pressing force less than a first threshold. For example, in FIG10 , the electronic device may lock the focus object to the elephant in response to the user continuously pressing the virtual key twice with a pressing force less than a first threshold.

[0202] It should be understood that continuously pressing the virtual key can be understood as pressing the virtual key multiple times within a shorter time interval. The shorter time interval can be set by the user and is also preset by the electronic device before leaving the factory. The embodiments of the present application do not limit this.

[0203] FIG11 shows another set of GUIs provided by an embodiment of the present application.

[0204] As shown in FIG11( a ), the electronic device displays an interface 1101 , which is a parameter adjustment interface of a camera application. The electronic device may display a focus adjustment bar 1102 on the interface 1101 .

[0205] It should be noted that the embodiments of the present application do not limit the manner in which the electronic device displays the parameter adjustment interface. For example, as shown in (a) in Figure 11, the electronic device can enter a professional mode, in which the electronic device can display a parameter adjustment bar, such as a focal length adjustment bar 1102. Since the virtual button can detect the user's sliding gesture, the electronic device can perform different functions according to the direction of the user's sliding gesture. When the electronic device detects that the direction of the user's sliding gesture is the thickness direction of the electronic device, the focal length adjustment bar can be switched to an adjustment bar for other parameters, see (b) in Figure 11. When the electronic device detects that the direction of the user's sliding gesture is the length direction of the electronic device, the focal length parameter can be adjusted, see (c) in Figure 11.

[0206] As shown in (b) of FIG11 , when the electronic device determines that the sliding direction of the user is the thickness direction of the electronic device, the focus adjustment bar 1102 may be switched to the ISO adjustment bar 1103 .

[0207] It should be noted that the embodiments of the present application only take the focus adjustment bar and the ISO adjustment bar as examples, which should not be understood as a specific limitation on the embodiments of the present application.

[0208] In an embodiment of the present application, when the electronic device is running a camera application, it can adjust the shooting parameters and switch the parameter adjustment bar according to the sliding direction of the user on the virtual button, so that the user can operate conveniently, and the gestures for switching the parameter bar and adjusting the parameters are simple, in line with daily usage habits, and can enhance the user experience.

[0209] The above describes the interaction method provided in the embodiment of the present application in conjunction with the GUI, and the following describes the interaction method provided in the embodiment of the present application in conjunction with the flowchart.

[0210] FIG12 shows a schematic flow chart of an interaction method provided in an embodiment of the present application. As shown in FIG12 , the method is applied to an electronic device, the electronic device including a virtual key, the virtual key being used to detect a user's pressing operation, and the electronic device displaying a first interface. The method includes:

[0211] S1201: Detect a first pressing operation of a user on a virtual key, and determine a first pressing force and a first pressing duration.

[0212] S1202: Determine a first function according to the first interface, the first pressing force, and the first pressing duration.

[0213] S1203 , executing a first function in response to the first pressing operation.

[0214] Specifically, the electronic device can detect the user's first pressing operation on the virtual key, determine the first pressing force and the first pressing duration, and then determine the first function based on the displayed first interface, the first pressing force and the first pressing duration, and then execute the first function in response to the first pressing operation.

[0215] For example, as shown in FIG5 , when the electronic device displays the home screen interface, when the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device displays a system volume adjustment bar 502 .

[0216] For another example, as shown in FIG6 , when the electronic device displays the interface of a music application, when the first pressing force is less than the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device displays a volume adjustment bar 602 of the music application.

[0217] For another example, as shown in FIG7 , when the electronic device displays the main screen interface, when the first pressing force is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device activates the voice assistant function.

[0218] For another example, as shown in FIG9 , when the electronic device displays the photo-taking interface, the electronic device may perform different functions according to the first pressing force and the first pressing duration. For details, please refer to the above and will not be repeated here.

[0219] In an embodiment of the present application, the electronic device has virtual buttons and can execute corresponding functions based on the displayed interface, the force with which the user presses the virtual buttons, and the duration of pressing the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to enhance the user experience.

[0220] Optionally, in some embodiments, the first interface is a main screen interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a system music adjustment function.

[0221] Optionally, in some embodiments, the virtual key is further used to detect a sliding gesture of the user, and the method further includes:

[0222] In response to a first sliding gesture of the user on the virtual key, the first function is switched to the second function, wherein the direction of the first sliding gesture is the thickness direction of the electronic device.

[0223] For example, as shown in (b) and (c) of FIG. 5 , the electronic device switches the system volume adjustment bar 502 to a brightness adjustment bar 503 .

[0224] Optionally, in some embodiments, the second function is one of a brightness adjustment function, a microphone volume adjustment function, a speaker volume adjustment function, a message prompt tone volume adjustment function, a screen display mode adjustment function, and an incoming call ring volume adjustment function.

[0225] Optionally, in some embodiments, the virtual key is further used to detect a sliding gesture of the user, and the method further includes:

[0226] In response to a second sliding gesture of the user on the virtual key, the system volume is adjusted, wherein the direction of the second sliding gesture is the length direction of the electronic device.

[0227] For example, as shown in (b) and (d) of FIG5 , the electronic device can adjust the volume of the system.

[0228] Optionally, in some embodiments, the first interface is a main screen interface, and when the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

[0229] For example, as shown in FIG7 , when the electronic device displays the main screen interface, when the first pressing force is greater than or equal to the first threshold and the first pressing duration is greater than or equal to the second threshold, the electronic device activates the voice assistant function.

[0230] Optionally, in some embodiments, the first interface is a photo taking interface, and when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0231] For example, as shown in (a) and (b) of FIG9 , the electronic device determines that the first pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, and the elephant can be focused.

[0232] Optionally, in some embodiments, the electronic device does not display a focus frame when focusing, and the method further includes:

[0233] In response to a second pressing operation of the user on the virtual key, determining a second pressing force and a second pressing duration;

[0234] When the second pressing strength is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, a focus frame is displayed, where the focus frame is used to identify the first object.

[0235] For example, in Figure 9, the electronic device automatically focuses on the elephant when executing the autofocus function, but does not use a focus frame to identify it. The electronic device detects a second press operation by the user. When the second press force is less than the first threshold and the second press duration is greater than or equal to the second threshold, the electronic device can display a focus frame in response to the second press operation, so that the displayed focus frame identifies the elephant.

[0236] Optionally, in some embodiments, the method further comprises:

[0237] In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to a second object, wherein the direction of the second sliding gesture is the longitudinal direction of the electronic device.

[0238] As shown in (a)-(b) of FIG10 , the electronic device can switch the focus object from the elephant to the tree in response to the user sliding on the virtual key in the longitudinal direction of the electronic device.

[0239] Optionally, in other embodiments, the user's operation of switching the focus object may also be the user sliding on a virtual key, and the sliding direction is the thickness direction of the electronic device.

[0240] Optionally, in some embodiments, the method further comprises:

[0241] In response to a user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than a first threshold.

[0242] Optionally, in some embodiments, the first interface is a photo-taking interface, and when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo-taking function.

[0243] For example, as shown in (a) and (c) of FIG9 , when the electronic device determines that the first pressing force is first greater than the third threshold and then less than the first threshold, the photo taking function is executed.

[0244] Optionally, in some embodiments, the first interface is a photo taking interface, and when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0245] For example, as shown in (a) and (d) of FIG9 , the electronic device executes the video recording function when it determines that the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold.

[0246] Optionally, in some embodiments, the first interface is a photo-taking interface, and when the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0247] For example, as shown in (a) and (e) of FIG9 , when the electronic device determines that the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the electronic device displays the viewfinder.

[0248] Optionally, in some embodiments, the first interface is a photo taking interface, and the virtual button is further used to detect a sliding gesture of the user, and the method further includes:

[0249] In response to a user's operation of adjusting a parameter, displaying an adjustment bar for the first parameter;

[0250] In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

[0251] For example, as shown in (a) and (b) of FIG11 , the electronic device switches the focus adjustment bar to the ISO adjustment bar in response to the user sliding in the thickness direction of the electronic device.

[0252] For another example, as shown in (a) and (c) of FIG11 , the electronic device adjusts the focal length in response to the user sliding in the longitudinal direction thereof.

[0253] Optionally, in some embodiments, the first interface is an interface of a non-camera application, and the method further includes:

[0254] detecting that at least two of the four edge regions of the screen are touched and also detecting a third press operation of the user on the virtual key, and determining a third press force and a third press duration of the third press operation;

[0255] When the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, starting the camera and focusing;

[0256] When the third pressing force is first greater than the third threshold and then less than the first threshold, the camera is activated and a photo is taken;

[0257] When the third pressing force is greater than the third threshold and the third pressing duration is greater than the second threshold, the camera is started and video is recorded.

[0258] For example, as shown in (a) and (b) of FIG8 , when the electronic device determines that the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, it may start a camera application and perform an autofocus function.

[0259] For another example, as shown in (a) and (c) of FIG8 , when the electronic device determines that the pressing force is first greater than the third threshold and then less than the first threshold, the camera application can be started and the photo taking function can be executed.

[0260] For another example, as shown in (a) and (d) of FIG8 , when the electronic device determines that the pressing force is greater than the third threshold and the pressing duration is greater than or equal to the second threshold, it can start the camera application and execute the video recording function.

[0261] FIG13 shows a schematic flow chart of another interaction method provided by an embodiment of the present application. As shown in FIG13 , the method is applied to an electronic device, the electronic device including a virtual key, the virtual key being used to detect a user's pressing operation, the electronic device displaying a first interface, the first interface being a photo-taking interface, and the method comprising:

[0262] S1301: Detect a first pressing operation of a user on a virtual key, and determine a first pressing force and a first pressing duration.

[0263] S1302: Determine a first function according to a first pressing force and a first pressing duration.

[0264] S1303: In response to the first pressing operation, execute the first function.

[0265] Specifically, when the electronic device displays the photo-taking interface, it detects the user's first press operation on the virtual button, determines the first press strength and the first press duration, determines the first function based on the first press strength and the first press duration, and then executes the first function.

[0266] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0267] For example, as shown in (a) and (d) of FIG9 , the electronic device executes the video recording function when determining that the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold.

[0268] Optionally, in some embodiments, when the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

[0269] For example, as shown in (a) and (e) of FIG9 , when the electronic device determines that the first pressing force is less than a first threshold and the first pressing duration is greater than a second threshold, the electronic device displays the viewfinder.

[0270] Optionally, in some embodiments, the virtual key is further used to detect a sliding gesture of the user, and the method further includes:

[0271] In response to a user's operation of adjusting a parameter, displaying an adjustment bar for the first parameter;

[0272] In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

[0273] For example, as shown in (a) and (b) of FIG11 , the electronic device switches the focus adjustment bar to the ISO adjustment bar in response to the user sliding in the thickness direction of the electronic device.

[0274] For another example, as shown in (a) and (c) of FIG11 , the electronic device adjusts the focal length in response to the user sliding in the longitudinal direction thereof.

[0275] Optionally, in some embodiments, when the electronic device performs an autofocus function, the method further includes:

[0276] Detecting a second pressing operation of the user on the virtual key, and determining a second pressing force and a second pressing duration;

[0277] When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, a focus frame is displayed in response to the second pressing operation, and the focus frame is used to identify the first object. In other words, the electronic device may not display the focus frame when performing the autofocus function, and may display the focus frame when the second pressing force is detected and the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, or the electronic device may first display the focus frame when performing the autofocus function, and the focus frame disappears or fades after a period of time, and then display the focus frame when the second pressing force is detected and the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold.

[0278] Optionally, in some embodiments, when the electronic device performs an autofocus function, the method further includes:

[0279] In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to a second object, wherein the direction of the second sliding gesture is the longitudinal direction of the electronic device.

[0280] Optionally, in some embodiments, when the electronic device performs an autofocus function, the method further includes:

[0281] In response to a user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than a first threshold.

[0282] In an embodiment of the present application, the electronic device has virtual buttons, and when running a camera application, it can execute corresponding functions based on the strength and duration of the user's pressing of the virtual buttons, thereby improving the user's operating efficiency, enhancing interactivity, and helping to enhance the user experience.

[0283] FIG14 shows a schematic flow chart of another interaction method provided by an embodiment of the present application. As shown in FIG14 , the method is applied to an electronic device, the electronic device including a virtual key, the virtual key being used to detect a user's pressing operation, the electronic device displaying a first interface, the first interface being an interface of a non-camera application, and the method comprising:

[0284] S1401: Detecting that at least two edge areas of the four edge areas of the screen are touched, and also detecting a first pressing operation of a user on a virtual key, and determining a first pressing intensity and a first pressing duration.

[0285] S1402: Start a camera application and determine a first function according to a first pressing force and a first pressing duration.

[0286] S1403 , executing a first function in response to the first pressing operation.

[0287] Optionally, in some embodiments, when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an autofocus function.

[0288] Optionally, in some embodiments, when the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

[0289] Optionally, in some embodiments, when the first pressing force is greater than a third threshold and the first pressing duration is greater than a second threshold, the first function is a video recording function.

[0290] In an embodiment of the present application, the electronic device is provided with a virtual button. When displaying the interface of a non-camera application, the function in the camera application can be quickly executed according to the force with which the user presses the virtual button and the duration of pressing the virtual button, thereby improving the user's operating efficiency, enhancing interactivity, and helping to enhance the user experience.

[0291] The above mainly introduces an interaction method provided by an embodiment of the present application from the perspective of an electronic device. It is understandable that, in order to implement the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily appreciate that, in combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0292] The embodiment of the present application can divide the functional modules of the processor of the electronic device according to the above method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0293] In the case of dividing each functional module according to each function, Figure 15 shows a schematic diagram of the composition of an electronic device 1500 provided in an embodiment of the present application. As shown in Figure 15, the electronic device 1500 includes a display module 1510, a detection module 1520 and a processing module 1530.

[0294] In some embodiments:

[0295] The display module 1510 is configured to display the first interface.

[0296] The detection module 1520 is configured to detect a first pressing operation of a user on a virtual key and determine a first pressing force and a first pressing duration.

[0297] The processing module 1530 is configured to determine a first function according to the first interface, the first pressing force, and the first pressing duration.

[0298] The processing module 1530 is further configured to execute the first function.

[0299] In some embodiments:

[0300] The display module 1510 is used to display a first interface, which is a photo taking interface.

[0301] The detection module 1520 is configured to detect a first pressing operation of a user on a virtual key and determine a first pressing force and a first pressing duration.

[0302] The processing module 1530 is configured to determine a first function according to the first pressing force and the first pressing duration.

[0303] The processing module 1530 is further configured to execute the first function.

[0304] In some embodiments:

[0305] The display module 1510 is configured to display a first interface, which is an interface of a non-camera application program.

[0306] The detection module 1520 is configured to determine a first pressing force and a first pressing duration upon detecting that at least two edge areas of the four edge areas of the screen are touched and also detecting a first pressing operation of the user on a virtual key.

[0307] The processing module 1530 is configured to start a camera application and determine a first function according to a first pressing force and a first pressing duration.

[0308] The processing module 1530 is further configured to execute the first function.

[0309] The present application provides a computer program product that, when executed on an electronic device, enables the electronic device to execute the technical solution in the above embodiment. The implementation principle and technical effects are similar to those of the above method-related embodiments and will not be described in detail here.

[0310] The embodiment of the present application provides a readable storage medium, which contains instructions. When the instructions are executed on an electronic device, the electronic device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0311] The present application provides a chip for executing instructions. When the chip is running, the technical solution of the above embodiment is executed. The implementation principle and technical effect are similar and will not be described here.

[0312] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of this application.

[0313] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0314] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0315] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0316] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0317] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0318] The above description is merely a specific implementation of the embodiments of the present application, but the scope of protection of the embodiments of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the embodiments of the present application should be included in the scope of protection of the embodiments of the present application. Therefore, the scope of protection of the embodiments of the present application should be based on the scope of protection of the claims.

Claims

1. An interactive method, characterized in that: The method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, and the method includes: Detecting a first pressing operation of the user on the virtual key, and determining a first pressing force and a first pressing duration; Determine a first function according to the first interface, the first pressing force, and the first pressing duration; In response to the first pressing operation, the first function is executed.

2. The method according to claim 1, characterized in that The first interface is a main screen interface. When the first pressing force is less than a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a system volume adjustment function.

3. The method according to claim 2, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to the user's first sliding gesture on the virtual button, the first function is switched to the second function, wherein the direction of the first sliding gesture is the thickness direction of the electronic device, and the second function is one of a brightness adjustment function, a microphone volume adjustment function, a speaker volume adjustment function, a message alert sound volume adjustment function, a screen display mode adjustment function, and an incoming call ring volume adjustment function.

4. The method according to claim 2, characterized in that: The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to a second sliding gesture of the user on the virtual key, the system volume is adjusted, wherein the direction of the second sliding gesture is the length direction of the electronic device.

5. The method according to claim 1, characterized in that The first interface is a main screen interface. When the first pressing force is greater than or equal to a first threshold and the first pressing duration is greater than or equal to a second threshold, the first function is a voice assistant function.

6. The method according to claim 1, characterized in that The first interface is a photo taking interface, and when the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

7. The method according to claim 6, characterized in that The method further comprises: Detecting a second pressing operation of the user on the virtual key, and determining a second pressing force and a second pressing duration; When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, in response to the second pressing operation, a focus frame is displayed, where the focus frame is used to identify the first object.

8. The method according to claim 7, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

9. The method according to claim 7, characterized in that: The method further comprises: In response to the user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than the first threshold.

10. The method according to any one of claims 6 to 9, characterized in that When the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

11. The method according to any one of claims 6 to 10, characterized in that When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

12. The method according to any one of claims 6 to 11, characterized in that When the first pressing force is less than the first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

13. The method according to any one of claims 6 to 12, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to the user's operation of adjusting the parameter, displaying an adjustment bar of the first parameter; In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

14. The method according to any one of claims 2 to 5, characterized in that The method further comprises: detecting that at least two edge regions of the four edge regions of the screen are touched, and also detecting a third pressing operation of the user on the virtual key, and determining a third pressing force and a third pressing duration of the third pressing operation; When the third pressing force is greater than or equal to the first threshold and less than or equal to the third threshold, starting the camera and performing auto-focusing; When the third pressing force is first greater than the third threshold and then less than the first threshold, starting the camera and taking a photo; When the third pressing force is greater than the third threshold and the third pressing duration is greater than the second threshold, the camera is started and video is recorded.

15. An interactive method, characterized in that: The method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, the first interface is a photo taking interface, and the method includes: Detecting a first pressing operation of a user on a virtual key, and determining a first pressing force and a first pressing duration; determining a first function according to the first pressing force and the first pressing duration; In response to the first pressing operation, the first function is executed.

16. The method according to claim 15, characterized in that When the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

17. The method according to claim 16, characterized in that The method further comprises: Detecting a second pressing operation of the user on the virtual key, and determining a second pressing force and a second pressing duration; When the second pressing force is less than the first threshold and the second pressing duration is greater than or equal to the second threshold, in response to the second pressing operation, a focus frame is displayed, where the focus frame is used to identify the first object.

18. The method according to claim 17, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to a second sliding gesture of the user on the virtual key, the first object in the focus frame is switched to a second object, wherein the direction of the second sliding gesture is the length direction of the electronic device.

19. The method according to claim 17, characterized in that The method further comprises: In response to the user's continuous pressing operation on the virtual key, the focus frame and the first object are locked, wherein the pressing force of the continuous pressing operation is less than the first threshold.

20. The method according to any one of claims 15 to 19, characterized in that When the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

21. The method according to any one of claims 15 to 20, characterized in that When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

22. The method according to any one of claims 15 to 21, characterized in that When the first pressing force is less than the first threshold and the first pressing duration is greater than a second threshold, the first function is to display a viewfinder.

23. The method according to any one of claims 15 to 22, characterized in that The virtual key is also used to detect a sliding gesture of the user, and the method further includes: In response to the user's operation of adjusting the parameter, displaying an adjustment bar of the first parameter; In response to the user's sliding gesture on the virtual key, if the direction of the sliding gesture is the thickness direction of the electronic device, the adjustment bar of the first parameter is switched to the adjustment bar of the second parameter; if the direction of the sliding gesture is the length direction of the electronic device, the first parameter is adjusted.

24. An interactive method, characterized in that: The method is applied to an electronic device, the electronic device includes a virtual key, the virtual key is used to detect a user's pressing operation, the electronic device displays a first interface, the first interface is an interface of a non-camera application, and the method includes: Detecting that at least two edge regions of the four edge regions of the screen are touched, and also detecting a first pressing operation of the user on the virtual key, and determining a first pressing force and a first pressing duration; Starting a camera application and determining a first function according to the first pressing force and the first pressing duration; In response to the first pressing operation, a first function is executed.

25. The method according to claim 24, characterized in that When the first pressing force is greater than or equal to a first threshold and less than or equal to a third threshold, the first function is an auto focus function.

26. The method according to claim 24 or 25, characterized in that When the first pressing force is first greater than the third threshold and then less than the first threshold, the first function is a photo taking function.

27. The method according to claim 24, characterized in that When the first pressing force is greater than the third threshold and the first pressing duration is greater than the second threshold, the first function is a video recording function.

28. An electronic device, characterized in that: The method comprises one or more processors; one or more memories; the one or more memories storing one or more computer programs, the one or more computer programs comprising instructions, which, when executed by the one or more processors, cause the method as described in any one of claims 1 to 14 or 15 to 23 or 24 to 27 to be executed.

29. A chip, characterized in that: The chip includes a processor and a communication interface, wherein the communication interface is used to receive a signal and transmit the signal to the processor, and the processor processes the signal so that the method as described in any one of claims 1 to 14 or 15 to 23 or 24 to 27 is executed.

30. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on a computer, the method according to any one of claims 1 to 14, 15 to 23, or 24 to 27 is executed.

Citation Information

Patent Citations

  • Interaction method and electronic equipment

    CN119336226A

  • Touch method and electronic equipment

    CN111026321A

  • Shooting method and electronic equipment

    CN112449101A

  • Interaction method of electronic equipment and electronic equipment

    CN112738332A

  • Key mapping method, electronic equipment and system

    CN114527903A

Cited By

  • Intelligent interaction method and device

    CN120130785A